WO2021259275A1 - Conference cascading method and system, terminal and computer-readable storage medium - Google Patents

Conference cascading method and system, terminal and computer-readable storage medium Download PDF

Info

Publication number
WO2021259275A1
WO2021259275A1 PCT/CN2021/101574 CN2021101574W WO2021259275A1 WO 2021259275 A1 WO2021259275 A1 WO 2021259275A1 CN 2021101574 W CN2021101574 W CN 2021101574W WO 2021259275 A1 WO2021259275 A1 WO 2021259275A1
Authority
WO
WIPO (PCT)
Prior art keywords
video stream
video
request
response
processor
Prior art date
Application number
PCT/CN2021/101574
Other languages
French (fr)
Chinese (zh)
Inventor
阮富崇
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2021259275A1 publication Critical patent/WO2021259275A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management

Definitions

  • the embodiments of the present application relate to, but are not limited to, the field of communication technology, and in particular, to a conference cascading method, a cascading conference system, a terminal, and a computer-readable storage medium.
  • the source terminal includes at least two terminals, and the cascade port limits the video stream transmission.
  • the destination terminal can only subscribe to the video stream in one source terminal, but cannot subscribe to the video streams of different source terminals at the same time.
  • the embodiments of the present application provide a conference cascading method, a cascading conference system, a terminal, and a computer-readable storage medium.
  • an embodiment of the present application provides a conference cascading method, including: a conference terminal receives a video subscription request from a destination terminal and generates a first video subscription instruction, and sends it to a controller;
  • the first video subscription instruction generates a video stream delivery request and delivers it to the processor;
  • the processor delivers the video stream of the source terminal according to the video stream delivery request, and generates a video stream delivery response;
  • the controller delivers a response based on the video stream A first subscription confirmation response is generated, and the conference terminal generates a video subscription response according to the first subscription confirmation response.
  • an embodiment of the present application provides a cascaded conference system, including: a conference management module configured to receive a video subscription request and generate a first video subscription instruction; at least one control module is configured to A video subscription instruction generates a video stream delivery request; at least one processing module is configured to transmit the video stream according to the video stream delivery request.
  • the application embodiment provides a terminal, including: a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and the processor implements the above-mentioned conference cascading method when the program is executed .
  • Fig. 1 is a flowchart of a conference cascading method provided by an embodiment of the present application
  • FIG. 2 is a schematic diagram of the framework of a cascade conference system provided by another embodiment of the present application.
  • FIG. 3 is a sequence diagram of a conference cascading method provided by another embodiment of the present application.
  • FIG. 4 is a flowchart of a conference cascading method provided by another embodiment of the present application.
  • FIG. 7 is a flowchart of a conference cascading method provided by another embodiment of the present application.
  • FIG. 8 is a sequence diagram of a conference cascading method provided by another embodiment of the present application.
  • FIG. 9 is a flowchart of a conference cascading method provided by another embodiment of the present application.
  • FIG. 11 is a flowchart of a conference cascading method provided by another embodiment of the present application.
  • FIG. 12 is a schematic diagram of the framework of a cascaded conference system provided by another embodiment of the present application.
  • the terminal may be a mobile terminal device or a non-mobile terminal device.
  • Mobile terminal devices can be mobile phones, tablets, laptops, palmtops, vehicle-mounted terminal devices, wearable devices, ultra-mobile personal computers, netbooks, personal digital assistants, etc.; non-mobile terminal devices can be personal computers, televisions, etc.;
  • the application implementation plan is not specifically limited.
  • Destination terminal The terminal that initiates the video subscription request in the cascade conference.
  • Source terminal In a cascaded conference, the terminal to which the video subscription is requested.
  • Source processor a processor connected in communication with the source terminal.
  • MRFC Multimedia Resource Function Controller
  • MRFP Multimedia Resource Function Processor, multimedia resource processor.
  • processors, source processors, and destination processors can be any MRFP (Multimedia Resource Processor) in Figure 2; the following controllers, source controllers, and destination controllers can be any of Figure 2 MRFC (Multimedia Resource Controller).
  • MRFP Multimedia Resource Processor
  • controllers, source controllers, and destination controllers can be any of Figure 2 MRFC (Multimedia Resource Controller).
  • control module can be any MRFC (multimedia resource controller) in Figure 2; the processing module, source processing module, and destination processing module can be any MRFP (multimedia resource processing) in Figure 2 ⁇ ).
  • MRFC multimedia resource controller
  • processing module, source processing module, and destination processing module can be any MRFP (multimedia resource processing) in Figure 2 ⁇ ).
  • An embodiment of the application provides a conference cascading method, including: step S100, a conference terminal receives a video subscription request and generates a first video subscription instruction; step S200, a controller generates a video stream delivery request according to the first video subscription instruction; step S300 The processor delivers the video stream according to the video stream delivery request, and generates a video stream delivery response; step S400, the controller generates a first subscription confirmation response according to the video stream delivery response, and the conference terminal generates a video subscription response according to the first subscription confirmation response.
  • the conference cascading method provided by the embodiments of the present application can realize video subscription between different terminals, and the destination terminal can subscribe to the video of any other terminal in the same processor.
  • the conference terminal After the destination terminal joins the cascade conference, by sending a video subscription request to the conference terminal, the conference terminal generates a first video subscription instruction according to the video subscription request and sends it to the controller.
  • the processor delivers the video stream of the source terminal to the destination terminal to complete the forwarding of the video stream.
  • the conference terminal can be a cascaded conference component or a processor equipped with a cascaded conference component.
  • controllers are directly managed through the conference terminal, and each controller manages several processors, so that the upper module directly manages the lower module without using
  • the additional agent module simplifies the processing flow.
  • the conference terminal is provided with a location information list of the processor, and sends a video subscription request to the processor according to the location information list. If the conference terminal does not indirectly manage the corresponding processor, the processor reports the location information of the processor and adds the location information to the location information list, which increases the complexity of the subscription function of the solution.
  • the application server may include a Web server, daoArcIMS application server, and ArcIMS application server.
  • the application server receives user requests and sends the user request to the data server through the protocol.
  • the data server generates a response or instruction according to the user request and sends it to the terminal Or the controller.
  • the application server can concurrently process multiple user requests to process multiple video subscription requests in the cascaded conference at the same time.
  • the conference terminal (application server) is cascaded with multiple controllers, and each controller is cascaded with multiple processes to construct the basic architecture of the multi-party video conference.
  • the controller may concurrently process multiple first video subscription instructions and generate a corresponding video stream delivery request, and the processor delivers the video stream to the corresponding destination terminal according to the corresponding video stream delivery request.
  • the controller sends the first media sending request to the source processor to control the source processor to send the video stream of the destination terminal to the destination processor.
  • the destination processor receives the video stream processed by the source according to the first media receiving request of the controller.
  • a media channel is set between the destination processor and the source processor, so that video streaming can be performed between the destination processor and the source processor.
  • the first video subscription instruction is issued to the controller through the same conference terminal, and the controller generates the first media sending request according to the first video subscription instruction; the source processor according to the first video subscription instruction The media sending request sends the video stream of the source terminal to the destination processor, and generates a first media sending response.
  • the controller When the controller receives the first media transmission response, the controller generates the corresponding first media reception request and sends it to the destination processor; when the destination processor receives the first media reception request, the destination processor starts to receive the corresponding video stream, To pre-store the video stream in the designated area.
  • the first media sending response generated by the source processor is a response without subscription right.
  • the video subscription response generated by the conference terminal according to the response without subscription authority is still a response without subscription authority, and the response without subscription authority is returned to the destination terminal to remind the destination terminal that it does not have the video subscription authority to the source terminal temporarily.
  • the destination terminal may upload a video subscription permission request to the conference terminal to obtain the video subscription permission corresponding to the source terminal.
  • the conference terminal re-issues the first video subscription instruction to the controller to complete the video subscription of the destination terminal to the source terminal.
  • the destination terminal obtains the video subscription permission corresponding to the source terminal by uploading the video subscription permission request, and updates the terminal permission list in the conference terminal to update the subscription permission information of the destination terminal to the terminal permission list.
  • the destination processor When the destination processor receives the subscribed video stream, it requests to control the delivery of the video stream through a video stream delivery request, so as to avoid the situation that the destination processor does not receive the video stream and the destination processor sends the video stream to the destination terminal, resulting in communication Occupation of the channel.
  • the destination processor delivers the video stream to the designated destination terminal based on the identity verification string to prevent the destination processor from delivering the video stream to other than the destination terminal.
  • Other terminals If the video stream is sent to other terminals by mistake, the video subscription of the destination terminal may fail and the storage resources of other terminals may be occupied.
  • the destination terminal and the source terminal are respectively in the same cascaded conference, and the conference terminal sends a first video subscription instruction to the source controller to control the source processor to transmit the video stream to the corresponding destination processor.
  • the source processor After the source processor starts to transmit the video stream, the source processor generates a first media transmission response according to the first media transmission request and transmits it back to the source controller.
  • the media transmission response is sent back through the corresponding source processor to ensure that the source processor has started to send the video stream of the source terminal before the destination processor starts to receive the video stream, thereby avoiding resource occupation of the media channel.
  • the conference terminal sends the first video subscription instruction to multiple source controllers respectively, and the different source processors send the first media sending request according to the corresponding source controller, so that the cascaded conference can simultaneously conduct multiple terminal communication. Video subscriptions between.
  • the source controller generates a video stream delivery request according to the first media reception response; the source processor delivers the video stream to the designated terminal according to the video stream delivery request and generates a video stream delivery response; the destination controller generates the first video stream delivery response according to the video stream delivery response.
  • a subscription confirmation response is a response to the first media reception response.
  • the subscription terminal sends a video subscription request to the conference terminal
  • the conference management module is configured to generate a first video subscription instruction according to the video subscription request and send it to the control module.
  • the processing module is configured to deliver the video stream of the subscribed terminal to the subscribing terminal to complete the forwarding of the video stream.
  • the conference management module can be a cascade conference component or a processor provided with a cascade conference component.
  • the controller includes: a source controller, which generates a first media transmission request according to a video subscription instruction; and a destination controller, which generates a first media reception request according to the video subscription instruction.
  • the destination terminal is controlled by the destination processor, and the destination processor is controlled by the destination controller;
  • the source terminal is controlled by the source processor, and the source processor is controlled by the source controller;
  • the destination controller and the source controller are controlled by the same conference terminal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A conference cascading method, a cascaded conference system, a terminal and a computer-readable storage medium. The conference cascading method comprises: a conference terminal receiving a video subscription request, and generating a first video subscription instruction (S100); a controller generating a video stream delivery request according to the first video subscription instruction (S200); a processor delivering a video stream according to the video stream delivery request, and generating a video stream delivery response (S300); and the controller generating a first subscription confirmation response according to the video stream delivery response, and the conference terminal generating a video subscription response according to the first subscription confirmation response (S400).

Description

会议级联方法及系统、终端、计算机可读存储介质Conference cascading method and system, terminal, and computer readable storage medium
相关申请的交叉引用Cross-references to related applications
本申请基于申请号为202010591731.3、申请日为2020年6月24日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。This application is filed based on a Chinese patent application with an application number of 202010591731.3 and an application date of June 24, 2020, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated into this application by reference.
技术领域Technical field
本申请实施例涉及但不限于通讯技术领域,尤其涉及一种会议级联方法、级联会议系统、终端及计算机可读存储介质。The embodiments of the present application relate to, but are not limited to, the field of communication technology, and in particular, to a conference cascading method, a cascading conference system, a terminal, and a computer-readable storage medium.
背景技术Background technique
随着通讯技术的发展,通过对多个处理器进行级联,以在多个处理器上召开大容量会议。由于通过同一个级联口对多个处理器进行级联,而单个级联口无法同时传输多个信道的视频流。当目的终端、源终端位于不同处理器时,目的终端无法随意订阅其他源终端的视频流。With the development of communication technology, multiple processors are cascaded to hold large-capacity meetings on multiple processors. Because multiple processors are cascaded through the same cascade port, a single cascade port cannot transmit multiple channels of video streams at the same time. When the destination terminal and the source terminal are located in different processors, the destination terminal cannot arbitrarily subscribe to the video streams of other source terminals.
例如,源终端包括至少两个终端,由级联口对视频流传输的限制,目的终端只能对一个源终端中的视频流进行订阅,而无法同时订阅不同源终端的视频流。For example, the source terminal includes at least two terminals, and the cascade port limits the video stream transmission. The destination terminal can only subscribe to the video stream in one source terminal, but cannot subscribe to the video streams of different source terminals at the same time.
发明内容Summary of the invention
本申请实施例提供了会议级联方法、级联会议系统、终端及计算机可读存储介质。The embodiments of the present application provide a conference cascading method, a cascading conference system, a terminal, and a computer-readable storage medium.
第一方面,本申请实施例提供了一种会议级联方法,包括:会议终端接收来自于目的终端的视频订阅请求并生成第一视频订阅指令,并下发至控制器;控制器根据所述第一视频订阅指令生成视频流下发请求,并下发至处理器;处理器根据所述视频流下发请求下发源终端的视频流,并生成视频流下发响应;控制器根据所述视频流下发响应生成第一订阅确认响应,会议终端根据所述第一订阅确认响应生成视频订阅响应。In the first aspect, an embodiment of the present application provides a conference cascading method, including: a conference terminal receives a video subscription request from a destination terminal and generates a first video subscription instruction, and sends it to a controller; The first video subscription instruction generates a video stream delivery request and delivers it to the processor; the processor delivers the video stream of the source terminal according to the video stream delivery request, and generates a video stream delivery response; the controller delivers a response based on the video stream A first subscription confirmation response is generated, and the conference terminal generates a video subscription response according to the first subscription confirmation response.
第二方面,本申请实施例提供了一种级联会议系统,包括:会议管理模块,被配置为接收视频订阅请求并生成第一视频订阅指令;至少一个控制模块,被配置为根据所述第一视频订阅指令生成视频流下发请求;至少一个处理模块,被配置为根据所述视频流下发请求对视频流进行传输。In a second aspect, an embodiment of the present application provides a cascaded conference system, including: a conference management module configured to receive a video subscription request and generate a first video subscription instruction; at least one control module is configured to A video subscription instruction generates a video stream delivery request; at least one processing module is configured to transmit the video stream according to the video stream delivery request.
第三方面,申请实施例提供了一种终端,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现上述会议级联方法。In the third aspect, the application embodiment provides a terminal, including: a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and the processor implements the above-mentioned conference cascading method when the program is executed .
第四方面,申请实施例提供了一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令用于:执行上述的会议级联方法。In a fourth aspect, the application embodiment provides a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are used to execute the above-mentioned conference cascading method.
本申请的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本申请而了解。本申请的目的和其他优点可通过在说明书、权利要求书以及附图中所特别指出的结构来实现和获得。Other features and advantages of the present application will be described in the following description, and partly become obvious from the description, or understood by implementing the present application. The purpose and other advantages of the application can be realized and obtained through the structures specifically pointed out in the description, claims and drawings.
附图说明Description of the drawings
附图用来提供对本申请技术方案的进一步理解,并且构成说明书的一部分,与本申请的实施例一起用于解释本申请的技术方案,并不构成对本申请技术方案的限制。The accompanying drawings are used to provide a further understanding of the technical solution of the present application, and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the technical solution of the present application, and do not constitute a limitation to the technical solution of the present application.
图1是本申请一实施例提供的会议级联方法的流程图;Fig. 1 is a flowchart of a conference cascading method provided by an embodiment of the present application;
图2是本申请另一实施例提供的级联会议系统的框架示意图;2 is a schematic diagram of the framework of a cascade conference system provided by another embodiment of the present application;
图3是本申请另一实施例提供的会议级联方法的时序图;FIG. 3 is a sequence diagram of a conference cascading method provided by another embodiment of the present application;
图4是本申请另一实施例提供的会议级联方法的流程图;FIG. 4 is a flowchart of a conference cascading method provided by another embodiment of the present application;
图5是本申请又一实施例提供的会议级联方法的时序图;FIG. 5 is a sequence diagram of a conference cascading method provided by another embodiment of the present application;
图6是本申请再一实施例提供的会议级联方法的流程图;Fig. 6 is a flowchart of a conference cascading method provided by still another embodiment of the present application;
图7是本申请另一实施例提供的会议级联方法的流程图;FIG. 7 is a flowchart of a conference cascading method provided by another embodiment of the present application;
图8是本申请另一实施例提供的会议级联方法的时序图;FIG. 8 is a sequence diagram of a conference cascading method provided by another embodiment of the present application;
图9是本申请又一实施例提供的会议级联方法的流程图;FIG. 9 is a flowchart of a conference cascading method provided by another embodiment of the present application;
图10是本申请又一实施例提供的会议级联方法的流程图;FIG. 10 is a flowchart of a conference cascading method provided by another embodiment of the present application;
图11是本申请又一实施例提供的会议级联方法的流程图;FIG. 11 is a flowchart of a conference cascading method provided by another embodiment of the present application;
图12是本申请又一实施例提供的级联会议系统的框架示意图。FIG. 12 is a schematic diagram of the framework of a cascaded conference system provided by another embodiment of the present application.
具体实施方式detailed description
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本申请,并不用于限定本申请。不冲突的情况下,本申请中的实施例及实施例中的特征可以相互任意组合。In order to make the purpose, technical solutions, and advantages of this application clearer, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not used to limit the present application. In the case of no conflict, the embodiments in the application and the features in the embodiments can be combined with each other arbitrarily.
需要说明的是,虽然在装置示意图中进行了功能模块划分,在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于装置中的模块划分,或流程图中的顺序执行所示出或描述的步骤。说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It should be noted that although functional modules are divided in the schematic diagram of the device, and the logical sequence is shown in the flowchart, in some cases, it can be executed in a different order from the module division in the device or in the sequence in the flowchart. Steps shown or described. The terms "first", "second", etc. in the specification and claims and the above-mentioned drawings are used to distinguish similar objects, and not necessarily used to describe a specific sequence or sequence.
由于一般的级联会议中仅设有一个级联口,而多个信号通道的视频流无法同时通过同一个级联口,导致级联会议中的终端无法随意订阅其他终端的视频流。Since there is only one cascade port in a general cascade conference, and the video streams of multiple signal channels cannot pass through the same cascade port at the same time, the terminals in the cascade conference cannot freely subscribe to the video streams of other terminals.
基于此,本申请实施例提供了一种会议级联方法、级联会议系统、终端及计算机可读存储介质,使得终端可选看级联会议中任意一个处理器上终端的视频或者多个画面。Based on this, the embodiments of the present application provide a conference cascading method, a cascaded conference system, a terminal, and a computer-readable storage medium, so that the terminal can choose to watch the video or multiple screens of the terminal on any processor in the cascaded conference .
需要说明的是,终端可以为移动终端设备,也可以为非移动终端设备。移动终端设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载终端设备、可穿戴设备、超级移动个人计算机、上网本、个人数字助理等;非移动终端设备可以为个人计算机、电视机等;本申请实施方案不作具体限定。It should be noted that the terminal may be a mobile terminal device or a non-mobile terminal device. Mobile terminal devices can be mobile phones, tablets, laptops, palmtops, vehicle-mounted terminal devices, wearable devices, ultra-mobile personal computers, netbooks, personal digital assistants, etc.; non-mobile terminal devices can be personal computers, televisions, etc.; The application implementation plan is not specifically limited.
目的终端:在级联会议中,发起视频订阅请求的终端。Destination terminal: The terminal that initiates the video subscription request in the cascade conference.
源终端:在级联会议中,被请求视频订阅的终端。Source terminal: In a cascaded conference, the terminal to which the video subscription is requested.
源处理器;与源终端通讯连接的处理器。Source processor; a processor connected in communication with the source terminal.
目的处理器:与目的终端通讯连接的处理器。Destination processor: the processor connected to the destination terminal in communication.
MRFC;Multimedia Resource Function Controller,多媒体资源控制器。MRFC; Multimedia Resource Function Controller, multimedia resource controller.
MRFP:Multimedia Resource Function Processor,多媒体资源处理器。MRFP: Multimedia Resource Function Processor, multimedia resource processor.
此外,下述的处理器、源处理器、目的处理器可为图2中任意一个MRFP(多媒体资源处理器);下述的控制器、源控制器、目的控制器可为图2中任意一个MRFC(多媒体资源控制器)。In addition, the following processors, source processors, and destination processors can be any MRFP (Multimedia Resource Processor) in Figure 2; the following controllers, source controllers, and destination controllers can be any of Figure 2 MRFC (Multimedia Resource Controller).
下述的控制模块、源控制模块、目的控制模块可为图2中任意一个MRFC(多媒体资源控制器);处理模块、源处理模块、目的处理模块可为图2中任意一个MRFP(多媒体资源处理器)。The following control module, source control module, and destination control module can be any MRFC (multimedia resource controller) in Figure 2; the processing module, source processing module, and destination processing module can be any MRFP (multimedia resource processing) in Figure 2器).
请参照图1、图2、图3,目的终端、源终端位于同一处理器,处理器受控于一个控制器,控制受控于一个会议终端。目的终端通过会议终端订阅源终端的视频流。Please refer to Figure 1, Figure 2, and Figure 3, the destination terminal and the source terminal are located in the same processor, the processor is controlled by a controller, and the control is controlled by a conference terminal. The destination terminal subscribes to the video stream of the source terminal through the conference terminal.
本申请实施例提供一种会议级联方法,包括:步骤S100、会议终端接收视频订阅请求并生成第一视频订阅指令;步骤S200、控制器根据第一视频订阅指令生成视频流下发请求;步骤S300、处理器根据视频流下发请求下发视频流,并生成视频流下发响应;步骤S400、控制器根据视频流下发响应生成第一订阅确认响应,会议终端根据第一订阅确认响应生成视频订阅响应。An embodiment of the application provides a conference cascading method, including: step S100, a conference terminal receives a video subscription request and generates a first video subscription instruction; step S200, a controller generates a video stream delivery request according to the first video subscription instruction; step S300 The processor delivers the video stream according to the video stream delivery request, and generates a video stream delivery response; step S400, the controller generates a first subscription confirmation response according to the video stream delivery response, and the conference terminal generates a video subscription response according to the first subscription confirmation response.
通过本申请实施例提供的会议级联方法可实现不同终端间的视频订阅,目的终端可对同一处理器中其他任意终端的视频进行订阅。The conference cascading method provided by the embodiments of the present application can realize video subscription between different terminals, and the destination terminal can subscribe to the video of any other terminal in the same processor.
例如,当目的终端加入级联会议后,通过向会议终端发送视频订阅请求,会议终端根据视频订阅请求生成第一视频订阅指令下发至控制器。当目的终端与源终端处于受控于同一处理器,处理器将源终端的视频流下发至目的终端,以完成视频流的转发。For example, after the destination terminal joins the cascade conference, by sending a video subscription request to the conference terminal, the conference terminal generates a first video subscription instruction according to the video subscription request and sends it to the controller. When the destination terminal and the source terminal are controlled by the same processor, the processor delivers the video stream of the source terminal to the destination terminal to complete the forwarding of the video stream.
当处理器将源终端的视频流下发至目的终端,处理器生成第一媒体发送响应并上传至控制器;控制器根据第一媒体发送响应生成视频流下发响应,并将视频流下发响应上传至会议终端。会议终端根据视频流下发响应生成视频订阅响应,并将视频订阅响应回传目的终端。When the processor delivers the video stream of the source terminal to the destination terminal, the processor generates a first media transmission response and uploads it to the controller; the controller generates a video stream delivery response according to the first media transmission response, and uploads the video stream delivery response to Conference terminal. The conference terminal generates a video subscription response based on the response sent by the video stream, and sends the video subscription response back to the destination terminal.
其中,会议终端可为级联会议组件或设有级联会议组件的处理器,通过会议终端直接管理若干控制器,每一个控制器管理若干处理器,以使上层模块直接管理下层模块,不使用额外的代理模块,从而简化处理流程。Among them, the conference terminal can be a cascaded conference component or a processor equipped with a cascaded conference component. Several controllers are directly managed through the conference terminal, and each controller manages several processors, so that the upper module directly manages the lower module without using The additional agent module simplifies the processing flow.
会议终端设有处理器的位置信息列表,并根据位置信息列表向处理器发送视频订阅请求。若会议终端未间接管理对应的处理器,则处理器通过上报处理器的位置信息,并将位置信息添加至位置信息列表,增加本方案订阅功能的复杂度。The conference terminal is provided with a location information list of the processor, and sends a video subscription request to the processor according to the location information list. If the conference terminal does not indirectly manage the corresponding processor, the processor reports the location information of the processor and adds the location information to the location information list, which increases the complexity of the subscription function of the solution.
在一些实施例中,会议终端可为应用服务器,建立客户终端与数据服务器之间数据信息交流,并通过对XML进行解释及响应以完成数据信息交流。其中,XML为可扩展标记语言,用于标记电子文件以使电子文件具有结构性。In some embodiments, the conference terminal may be an application server, which establishes data information exchange between the client terminal and the data server, and completes the data information exchange by interpreting and responding to XML. Among them, XML is an extensible markup language, which is used to mark up electronic files to make them structured.
应用服务器可包括Web服务器、daoArcIMS应用服务器、ArcIMS应用服务器,通过应用服务器接收来用户请求,并通过协议将用户请求发送至数据服务器端,数据服务端根据用户请求生成响应或指令并下发至终端或者控制器。应用服务器可并发处理多个用户请求,以同时处理级联会议中的多个视频订阅请求。The application server may include a Web server, daoArcIMS application server, and ArcIMS application server. The application server receives user requests and sends the user request to the data server through the protocol. The data server generates a response or instruction according to the user request and sends it to the terminal Or the controller. The application server can concurrently process multiple user requests to process multiple video subscription requests in the cascaded conference at the same time.
例如,在一个多方视频会议中,会议终端(应用服务器)与多个控制器进行级联,每一个控制器与多个处理进行级联,以构建多方视频会议基本架构。For example, in a multi-party video conference, the conference terminal (application server) is cascaded with multiple controllers, and each controller is cascaded with multiple processes to construct the basic architecture of the multi-party video conference.
多个目的终端分别向受控于同一处理器的源终端进行视频订阅,多个目的终端分别向会议终端或应用服务器上传视频订阅请求,会议终端或应用服务器根据视频订阅请求对应生成第一视频订阅指令并下发至对应的控制器。多个控制器根据对应的第一视频订阅指令生成视频流下发请求,以控制对应的处理器进行视频流发送,从而同时完成多个视频订阅的视频流下发。Multiple destination terminals respectively subscribe to the source terminal controlled by the same processor, multiple destination terminals respectively upload video subscription requests to the conference terminal or application server, and the conference terminal or application server generates the first video subscription corresponding to the video subscription request The instruction is issued to the corresponding controller. The multiple controllers generate a video stream delivery request according to the corresponding first video subscription instruction, so as to control the corresponding processor to send the video stream, so as to complete the video stream delivery of multiple video subscriptions at the same time.
在一些实施例中,控制器可并发处理多个第一视频订阅指令并生成对应的视频流下发请求,处理器根据对应的视频流下发请求将视频流下发至对应的目的终端。In some embodiments, the controller may concurrently process multiple first video subscription instructions and generate a corresponding video stream delivery request, and the processor delivers the video stream to the corresponding destination terminal according to the corresponding video stream delivery request.
请参照图2、图4、图5,在一些实施例中,目的终端、源终端位于不同的处理器,不同的处理器受控于同一控制器。步骤S200、控制器第一视频订阅指令生成视频流下发请求, 还包括:步骤S201、控制器根据第一视频订阅指令生成第一媒体发送请求;步骤S202、源处理器根据第一媒体发送请求将视频流发送至目的处理器并生成第一媒体发送响应;步骤S203、控制器根据第一媒体发送响应生成第一媒体接收请求;步骤S204、目的处理器根据第一媒体接收请求接收视频流。Please refer to FIG. 2, FIG. 4, and FIG. 5. In some embodiments, the destination terminal and the source terminal are located in different processors, and the different processors are controlled by the same controller. Step S200: The controller generates a video stream delivery request according to the first video subscription instruction, and further includes: Step S201: The controller generates a first media transmission request according to the first video subscription instruction; Step S202: The video stream is sent to the destination processor and a first media transmission response is generated; step S203, the controller generates a first media reception request according to the first media transmission response; step S204, the destination processor receives the video stream according to the first media reception request.
控制器通过向源处理器下发第一媒体发送请求,以控制源处理器向目的处理器发送目的终端的视频流。目的处理器根据控制器第一媒体接收请求,接收来自于源处理的视频流。其中,通过在目的处理器、源处理器之间设置媒体通道,以使得目的处理器、源处理器之间可进行视频流传输。The controller sends the first media sending request to the source processor to control the source processor to send the video stream of the destination terminal to the destination processor. The destination processor receives the video stream processed by the source according to the first media receiving request of the controller. Among them, a media channel is set between the destination processor and the source processor, so that video streaming can be performed between the destination processor and the source processor.
例如,当目的终端向会议终端发送视频订阅请求,通过同一会议终端对控制器下发第一视频订阅指令,控制器根据第一视频订阅指令分别生成第一媒体发送请求;源处理器根据第一媒体发送请求将源终端的视频流发送至目的处理器,并生成第一媒体发送响应。For example, when the destination terminal sends a video subscription request to the conference terminal, the first video subscription instruction is issued to the controller through the same conference terminal, and the controller generates the first media sending request according to the first video subscription instruction; the source processor according to the first video subscription instruction The media sending request sends the video stream of the source terminal to the destination processor, and generates a first media sending response.
当控制器接收第一媒体发送响应,控制器生成对应的第一媒体接收请求并下发至目的处理器;当目的处理器接收到第一媒体接收请求,目的处理器开始接收对应的视频流,以将视频流预存储于指定区域中。When the controller receives the first media transmission response, the controller generates the corresponding first media reception request and sends it to the destination processor; when the destination processor receives the first media reception request, the destination processor starts to receive the corresponding video stream, To pre-store the video stream in the designated area.
在一些实施例中,在第一媒体发送请求中设置目的处理器或目的终端对应的身份校验字符串,以当目的终端无视频订阅权限时,禁止源处理器将视频流发送至目的处理器。In some embodiments, the identity verification string corresponding to the destination processor or the destination terminal is set in the first media sending request to prohibit the source processor from sending the video stream to the destination processor when the destination terminal has no video subscription rights .
例如,当源终端为受限终端,且目的终端无对应的视频订阅权限,控制器将第一媒体发送请求下发至源处理器,源处理器根据第一媒体发送请求中的身份校验字符串对目的终端或目的处理器的身份进行校验。若目的终端有对源终端的视频订阅权限时,源处理器根据第一媒体发送请求将源终端的视频流发送至目的处理器,并生成对应的订阅响应;若目的终端无对源终端的视频订阅权限时,源处理器判断第一媒体发送请求为无效请求,并生成对应的订阅响应。For example, when the source terminal is a restricted terminal and the destination terminal does not have the corresponding video subscription authority, the controller issues the first media sending request to the source processor, and the source processor uses the identity check character in the first media sending request The string verifies the identity of the destination terminal or destination processor. If the destination terminal has video subscription rights to the source terminal, the source processor sends the video stream of the source terminal to the destination processor according to the first media sending request, and generates a corresponding subscription response; if the destination terminal does not have a video to the source terminal When subscribing to the authority, the source processor determines that the first media sending request is an invalid request, and generates a corresponding subscription response.
其中,当目的终端无对源终端的视频订阅权限时,源处理器生成的第一媒体发送响应为无订阅权限响应。会议终端根据无订阅权限响应生成的视频订阅响应仍为无订阅权限响应,并将无订阅权限响应回传至目的终端,以提醒目的终端暂时不具有对源终端的视频订阅权限。Wherein, when the destination terminal has no video subscription right to the source terminal, the first media sending response generated by the source processor is a response without subscription right. The video subscription response generated by the conference terminal according to the response without subscription authority is still a response without subscription authority, and the response without subscription authority is returned to the destination terminal to remind the destination terminal that it does not have the video subscription authority to the source terminal temporarily.
在一些实施例中,当目的终端接收到无订阅权限响应时,目的终端可向会议终端上传视频订阅权限请求以获得与源终端对应的视频订阅权限。当目的终端获得对应的视频订阅权限后,会议终端重新下发第一视频订阅指令至控制器,以完成目的终端对源终端的视频订阅。In some embodiments, when the destination terminal receives a response without subscription permission, the destination terminal may upload a video subscription permission request to the conference terminal to obtain the video subscription permission corresponding to the source terminal. After the destination terminal obtains the corresponding video subscription authority, the conference terminal re-issues the first video subscription instruction to the controller to complete the video subscription of the destination terminal to the source terminal.
在一些实施例中,会议终端中设有终端权限列表,当目的终端对源终端进行视频订阅权限时,会议终端对视频订阅请求中身份校验字符串进行校验,以判断目的终端是否具有对应源终端的视频订阅权限。若目的终端具有有对应源终端的视频订阅权限,会议终端根据视频订阅请求生成第一视频订阅指令并下发至对应的控制器;若目的终端不具有对应源终端的视频订阅权限,会议终端根据视频订阅请求生成无订阅权限响应并回传至目的终端。In some embodiments, there is a terminal authority list in the conference terminal. When the destination terminal grants video subscription authority to the source terminal, the conference terminal verifies the identity verification string in the video subscription request to determine whether the destination terminal has a corresponding The video subscription permission of the source terminal. If the destination terminal has the video subscription authority corresponding to the source terminal, the conference terminal generates the first video subscription instruction according to the video subscription request and sends it to the corresponding controller; if the destination terminal does not have the video subscription authority corresponding to the source terminal, the conference terminal The video subscription request generates a response without subscription permission and sends it back to the destination terminal.
目的终端通过上传视频订阅权限请求以获得与源终端对应的视频订阅权限,并对会议终端中的终端权限列表进行更新以将目的终端的订阅权限信息更新至终端权限列表中。The destination terminal obtains the video subscription permission corresponding to the source terminal by uploading the video subscription permission request, and updates the terminal permission list in the conference terminal to update the subscription permission information of the destination terminal to the terminal permission list.
请参照图2、图4、图6,在一些实施例中,目的终端受控于目的处理器,源终端受控于源处理器,目的处理器、源处理器受控于同一控制器。其中,控制器生成视频流下发响应包括;步骤S2041、目的处理器根据第一媒体接收请求生成第一媒体接收响应;步骤S2042、 控制器根据第一媒体接收响应生成视频流下发请求;步骤S2043、目的处理器根据视频流下发请求下发视频流。Please refer to FIG. 2, FIG. 4, and FIG. 6. In some embodiments, the destination terminal is controlled by the destination processor, the source terminal is controlled by the source processor, and the destination processor and the source processor are controlled by the same controller. Wherein, the controller generating a video stream issuing response includes: step S2041, the destination processor generates a first media receiving response according to the first media receiving request; step S2042, the controller generating a video stream issuing request according to the first media receiving response; step S2043, The destination processor delivers the video stream according to the video stream delivery request.
目的处理器接收到第一媒体接收请求后,目的处理器开始接收来自源处理器的视频流,并生成第一媒体接收响应上传至控制器。控制器根据第一媒体接收响应生成视频流下发请求并下发至目的处理器,目的处理器根据视频流下发请求将源终端的视频流下发至目的终端。After the destination processor receives the first media reception request, the destination processor starts to receive the video stream from the source processor, and generates a first media reception response and uploads it to the controller. The controller generates a video stream delivery request according to the first media reception response and delivers it to the destination processor, and the destination processor delivers the video stream of the source terminal to the destination terminal according to the video stream delivery request.
当目的处理器接收订阅的视频流后,通过视频流下发请求控制视频流的下发,从而避免在目的处理器未接收到视频流的情况,目的处理器向目的终端进行视频流发送,导致通信通道的占用。When the destination processor receives the subscribed video stream, it requests to control the delivery of the video stream through a video stream delivery request, so as to avoid the situation that the destination processor does not receive the video stream and the destination processor sends the video stream to the destination terminal, resulting in communication Occupation of the channel.
例如,在目的处理器对视频流进行预存储的同时,目的处理器生成第一媒体接收响应并上传至控制器。通过将第一媒体接收响应回传至控制器,控制器根据第一媒体接收响应生成视频流下发响应。且控制器将视频流下发响应下发至目的处理器,目的处理器根据视频流下发响应将视频流下发至指定的目的终端。For example, while the destination processor pre-stores the video stream, the destination processor generates a first media reception response and uploads it to the controller. By returning the first media reception response to the controller, the controller generates a video stream delivery response according to the first media reception response. And the controller delivers the video stream delivery response to the destination processor, and the destination processor delivers the video stream to the designated destination terminal according to the video stream delivery response.
请一并参照图2、图4至图7,在一些实施例中,目的处理器与至少两个终端连接,仅其中一个终端为目的终端。步骤S2043、目的处理器根据视频流下发请求下发视频流,还包括:步骤S2044、目的处理器根据视频流下发请求将视频流下发至指定终端;步骤S2045、目的处理器根据视频流下发请求生成视频流下发响应。Please refer to FIGS. 2 and 4 to 7 together. In some embodiments, the destination processor is connected to at least two terminals, and only one of the terminals is the destination terminal. Step S2043, the destination processor delivers the video stream according to the video stream delivery request, and further includes: step S2044, the destination processor delivers the video stream to the designated terminal according to the video stream delivery request; step S2045, the destination processor generates the video stream based on the video stream delivery request The video stream sends a response.
目的处理器根据视频流下发请求将视频流下发至指定的目的终端,以避免视频流错发至其他终端,从而保证信息传输的准确性。例如,视频流下发请求中设有与目的终端对应的标记字符串,目的处理器根据标记字符串选择视频流下发的终端,并将视频流下发至对应的终端中,以完成视频订阅中视频流的下发。The destination processor delivers the video stream to the designated destination terminal according to the video stream delivery request, so as to prevent the video stream from being sent to other terminals by mistake, thereby ensuring the accuracy of information transmission. For example, a tag string corresponding to the destination terminal is set in the video stream delivery request, and the destination processor selects the terminal from which the video stream is delivered based on the tag string, and delivers the video stream to the corresponding terminal to complete the video stream in the video subscription. Issued.
例如,视频流下发响应中设有身份校验字符串,目的处理器根据身份校验字符串下发视频流至指定的目的终端,以避免目的处理器将视频流下发至除目的终端之外的其他终端。若视频流被错误发送至其他终端可能导致目的终端视频订阅失败及其他终端的存储资源被占用。For example, there is an identity verification string in the video stream delivery response, and the destination processor delivers the video stream to the designated destination terminal based on the identity verification string to prevent the destination processor from delivering the video stream to other than the destination terminal. Other terminals. If the video stream is sent to other terminals by mistake, the video subscription of the destination terminal may fail and the storage resources of other terminals may be occupied.
请一并参照图2、图8、图9,在一些实施例中,控制器至少包括一个源控制器和一个目的控制器,处理器至少包括一个源处理器和一个目的处理器。目的终端受控于目的处理器,目的处理器受控于目的控制器;源终端受控于源处理器,源处理器受控于源控制器;目的控制器及源控制器受控于同一会议终端。通过同一个会议终端对若干控制器进行级联控制,每一个控制器对若干处理器进行级联控制,以构建级联会议通讯网络。Please refer to FIG. 2, FIG. 8, and FIG. 9 together. In some embodiments, the controller includes at least one source controller and one destination controller, and the processor includes at least one source processor and one destination processor. The destination terminal is controlled by the destination processor, and the destination processor is controlled by the destination controller; the source terminal is controlled by the source processor, and the source processor is controlled by the source controller; the destination controller and the source controller are controlled by the same conference terminal. Several controllers are cascaded through the same conference terminal, and each controller is cascaded to control several processors to build a cascaded conference communication network.
步骤S203、控制器根据第一视频订阅指令生成第一媒体发送请求,包括:步骤S2031、源控制器根据第一视频订阅指令生成第一媒体发送请求并下发至源处理器;步骤S2032、源处理器根据第一媒体发送请求将源终端的视频流传输至目的处理器;步骤S2033、源处理器根据第一媒体发送请求生成第一媒体发送响应并回传至源控制器。当源处理器开始发送视频流,源处理器根据第一媒体发送请求生成第一媒体发送响应并回传至源控制器。Step S203: The controller generates a first media transmission request according to the first video subscription instruction, including: Step S2031. The source controller generates a first media transmission request according to the first video subscription instruction and sends it to the source processor; Step S2032, the source The processor transmits the video stream of the source terminal to the destination processor according to the first media transmission request; in step S2033, the source processor generates a first media transmission response according to the first media transmission request and transmits it back to the source controller. When the source processor starts to send the video stream, the source processor generates a first media sending response according to the first media sending request and transmits it back to the source controller.
例如,目的终端、源终端分别处于同一级联会议中,会议终端通过向源控制器下发第一视频订阅指令以控制源处理器将视频流传输至对应的目的处理器。当源处理器开始传输视频流后,源处理器根据第一媒体发送请求生成第一媒体发送响应并回传至源控制器。通过对应的源处理器回传媒体发送响应,以确保在目的处理器开始接收视频流前,源处理器已开始发送源终端的视频流,从而避免媒体通道的资源占用。For example, the destination terminal and the source terminal are respectively in the same cascaded conference, and the conference terminal sends a first video subscription instruction to the source controller to control the source processor to transmit the video stream to the corresponding destination processor. After the source processor starts to transmit the video stream, the source processor generates a first media transmission response according to the first media transmission request and transmits it back to the source controller. The media transmission response is sent back through the corresponding source processor to ensure that the source processor has started to send the video stream of the source terminal before the destination processor starts to receive the video stream, thereby avoiding resource occupation of the media channel.
在一些实施例中,目的终端、源终端之间设有媒体通道,且目的处理器至少连接有两个终端,源处理器至少连接有两个终端,目的处理器所对应的终端与源处理器所对应的终端共用同一个媒体通道。通过回传媒体发送响应至源控制器,以便于对媒体通道的资源分配,避免多个视频流在同一媒体通道传输导致媒体通道的传输资源分配不均。In some embodiments, a media channel is provided between the destination terminal and the source terminal, and the destination processor is connected to at least two terminals, the source processor is connected to at least two terminals, and the terminal corresponding to the destination processor is connected to the source processor. The corresponding terminals share the same media channel. Send the response to the source controller by returning the media to facilitate the resource allocation of the media channel and avoid the uneven distribution of the media channel transmission resources caused by multiple video streams being transmitted on the same media channel.
在一些实施例中,一个源处理器对应多个源终端,一个目的处理器对应多个目的终端,In some embodiments, one source processor corresponds to multiple source terminals, and one destination processor corresponds to multiple destination terminals,
目的终端、源终端之间的媒体通道为媒体复用通道。The media channel between the destination terminal and the source terminal is a media multiplexing channel.
通过对一个源处理器中多个源终端的初始视频流进行复用调制以形成视频流集合;通过媒体复用通道将视频流集合发送至目的处理器,目的处理器对视频流集合进行解复用以还原初始视频流并下发至对应的目的终端,从而提高视频订阅效率。Form a video stream set by multiplexing and modulating the initial video streams of multiple source terminals in a source processor; sending the video stream set to the destination processor through the media multiplexing channel, and the destination processor demultiplexes the video stream set It is used to restore the original video stream and deliver it to the corresponding destination terminal, thereby improving the efficiency of video subscription.
请一并参照图2、图8至图10,在一些实施例中,会议级联方法还包括:步骤S2034、源控制器根据第一媒体发送响应生成第二媒体发送响应;步骤S2035、会议终端根据第二媒体发送响应生成第二视频订阅指令并下发至目的控制器;步骤S2036、目的控制器根据第二视频订阅指令生成第一媒体接收请求;步骤S2037、目的处理器根据第一媒体接收请求接收视频流;步骤S2038、目的处理器根据第一媒体接收请求生成第一媒体接收响应。Please refer to Figure 2 and Figure 8 to Figure 10 together. In some embodiments, the conference cascading method further includes: step S2034, the source controller generates a second media transmission response according to the first media transmission response; step S2035, the conference terminal Generate a second video subscription instruction according to the second media sending response and issue it to the destination controller; step S2036, the destination controller generates a first media reception request according to the second video subscription instruction; step S2037, the destination processor receives according to the first media Request to receive a video stream; step S2038, the destination processor generates a first media reception response according to the first media reception request.
其中,通过会议终端对源控制器、目的控制器进行分级处理,以同时进行不同终端之间视频订阅。例如通过分设指令通道及媒体通道,会议终端、源控制器、源处理器、目的控制器及目的处理器之间通过指令通道进行请求信号及响应信号的传输,源终端、目的终端之间通过媒体信道进行视频流的传输。Among them, the source controller and the destination controller are hierarchically processed through the conference terminal to simultaneously perform video subscriptions between different terminals. For example, through separate command channels and media channels, the conference terminal, the source controller, the source processor, the destination controller, and the destination processor transmit request signals and response signals through the command channel, and the source terminal and the destination terminal use the media The channel carries on the transmission of the video stream.
会议终端通过向对多个源控制器分别下发第一视频订阅指令,不同源处理器根据对应的源控制器进行发送第一媒体发送请求,以使得级联会议中可同时进行多个终端之间的视频订阅。The conference terminal sends the first video subscription instruction to multiple source controllers respectively, and the different source processors send the first media sending request according to the corresponding source controller, so that the cascaded conference can simultaneously conduct multiple terminal communication. Video subscriptions between.
请一并参照图2、图8至图11,在一些实施例中,目的终端受控于目的处理器,目的处理器受控于目的控制器;源终端受控于源处理器,源处理器受控于源控制器;目的控制器及源控制器受控于同一会议终端。Please refer to Figure 2 and Figure 8 to Figure 11 together. In some embodiments, the destination terminal is controlled by the destination processor, and the destination processor is controlled by the destination controller; the source terminal is controlled by the source processor, and the source processor Controlled by the source controller; the destination controller and the source controller are controlled by the same conference terminal.
本申请实施例的会议级联方法,还包括:步骤S20391、目的控制器根据第一媒体接收响应生成视频流下发请求;步骤S20392、目的处理器根据视频流下发请求将视频流下发至指定终端;步骤S20393、目的处理器根据视频流下发请求生成视频流下发响应。The conference cascading method of the embodiment of the present application further includes: step S20391, the destination controller generates a video stream delivery request according to the first media reception response; step S20392, the destination processor delivers the video stream to the designated terminal according to the video stream delivery request; Step S20393: The destination processor generates a video stream delivery response according to the video stream delivery request.
具体地,源控制器根据第一媒体接收响应生成视频流下发请求;源处理器根据视频流下发请求将视频流下发至指定终端并生成视频流下发响应;目的控制器根据视频流下发响应生成第一订阅确认响应。Specifically, the source controller generates a video stream delivery request according to the first media reception response; the source processor delivers the video stream to the designated terminal according to the video stream delivery request and generates a video stream delivery response; the destination controller generates the first video stream delivery response according to the video stream delivery response. A subscription confirmation response.
在一些实施例中,源控制器根据第一视频订阅指令生成第二视频订阅响应,目的控制器根据第一媒体接收响应、第二视频订阅响应生成第一订阅确认响应。即通过判断源终端的视频流是否传输至目的处理器及视频流是否已下发至目的终端,仅当视频流已经下发至目的终端后,会议终端生成视频订阅响应。In some embodiments, the source controller generates the second video subscription response according to the first video subscription instruction, and the destination controller generates the first subscription confirmation response according to the first media reception response and the second video subscription response. That is, by judging whether the video stream of the source terminal is transmitted to the destination processor and whether the video stream has been delivered to the destination terminal, the conference terminal generates a video subscription response only after the video stream has been delivered to the destination terminal.
请参照图12,本申请实施例提供一种级联会议系统,包括:会议管理模块,被配置为接收视频订阅请求并生成第一视频订阅指令;至少一个控制模块,被配置为根据第一视频订阅指令生成视频流下发请求;至少一个处理模块,被配置为根据视频流下发请求对视频流进行传输。12, an embodiment of the present application provides a cascaded conference system, including: a conference management module configured to receive a video subscription request and generate a first video subscription instruction; at least one control module is configured to follow the first video The subscription instruction generates a video stream delivery request; at least one processing module is configured to transmit the video stream according to the video stream delivery request.
通过级联的方式组建级联会议,并通过同一个会议管理模块对若干控制器下发第一视频订阅指令,控制模块根据第一视频订阅指令生成视频流下发请求,处理器根据视频流下 发请求将视频流传输至指定位置。A cascaded conference is formed by cascading, and the first video subscription instruction is issued to several controllers through the same conference management module. The control module generates a video stream issuing request according to the first video subscription instruction, and the processor issues the request according to the video stream. Stream the video to the specified location.
例如,当位属于同一处理模块的两个终端加入级联会议后,订阅终端对被订阅终端的视频进行订阅。For example, when two terminals belonging to the same processing module join a cascade conference, the subscribing terminal subscribes to the video of the subscribed terminal.
订阅终端向会议终端发送视频订阅请求,会议管理模块被配置为根据视频订阅请求生成第一视频订阅指令下发至控制模块。处理模块被配置为将被订阅终端的视频流下发至订阅终端,以完成视频流的转发。The subscription terminal sends a video subscription request to the conference terminal, and the conference management module is configured to generate a first video subscription instruction according to the video subscription request and send it to the control module. The processing module is configured to deliver the video stream of the subscribed terminal to the subscribing terminal to complete the forwarding of the video stream.
当处理模块将被订阅终端的视频流下发至订阅终端,处理模块被配置为生成第一媒体发送响应并上传至控制模块;控制模块被配置为根据第一媒体发送响应生成视频流下发响应,并将视频流下发响应上传至会议终端。会议管理模块被配置为根据视频流下发响应生成视频订阅响应,并将视频订阅响应回传目订阅终端。When the processing module delivers the video stream of the subscribed terminal to the subscribing terminal, the processing module is configured to generate a first media transmission response and upload it to the control module; the control module is configured to generate a video stream delivery response according to the first media transmission response, and Upload the video stream delivery response to the conference terminal. The conference management module is configured to generate a video subscription response according to the video stream delivery response, and send the video subscription response back to the destination subscription terminal.
其中,会议管理模块可为级联会议组件或设有级联会议组件的处理器。Among them, the conference management module can be a cascade conference component or a processor provided with a cascade conference component.
在一些实施例中,会议管理模块可为应用服务器,建立客户终端与数据服务器之间数据信息交流,并通过对XML进行解释及响应以完成数据信息交流。其中,XML为可扩展标记语言,用于标记电子文件以使电子文件具有结构性。In some embodiments, the conference management module may be an application server, which establishes data information exchange between the client terminal and the data server, and completes the data information exchange by interpreting and responding to XML. Among them, XML is an extensible markup language, which is used to mark up electronic files to make them structured.
请一并参阅图3、图12,在一些实施例中,处理模块被配置为根据视频流下发请求生成视频流下发响应;控制模块被配置为根据视频流下发响应生成第一订阅确认响应;会议管理模块被配置为根据第一订阅确认响应生成视频订阅响应。Please refer to Figures 3 and 12 together. In some embodiments, the processing module is configured to generate a video stream delivery response according to the video stream delivery request; the control module is configured to generate a first subscription confirmation response according to the video stream delivery response; meeting The management module is configured to generate a video subscription response according to the first subscription confirmation response.
通过生成对应订阅响应,以使订阅终端确定视频订阅完成后,开始订阅视频流的播放。By generating the corresponding subscription response, the subscribing terminal can start playing the subscribed video stream after determining that the video subscription is completed.
请参照一并图2、图12,本申请实施例提供一种处理器包括:源处理模块,被配置为根据第一媒体发送请求发送视频流;目的处理模块,被配置为根据第一媒体接收请求接收视频流,其中,源处理模块与目的处理模块之间设有媒体复用通道。源处理模块、目的处理模块可任意一个MRFP(多媒体资源处理器)。Please refer to Figure 2 and Figure 12 together, an embodiment of the present application provides a processor including: a source processing module configured to send a video stream according to a first media sending request; a destination processing module configured to receive a video stream according to the first media Request to receive a video stream, where a media multiplexing channel is set between the source processing module and the destination processing module. The source processing module and the destination processing module can be any MRFP (Multimedia Resource Processor).
通过对一个源处理器中多个源终端的初始视频流进行复用调制以形成视频流集合;通过媒体复用通道将视频流集合发送至目的处理器,目的处理器对视频流集合进行解复用以还原初始视频流并下发至对应的目的终端,从而提高视频订阅效率。Form a video stream set by multiplexing and modulating the initial video streams of multiple source terminals in a source processor; sending the video stream set to the destination processor through the media multiplexing channel, and the destination processor demultiplexes the video stream set It is used to restore the initial video stream and deliver it to the corresponding destination terminal, thereby improving the efficiency of video subscription.
请参照一并图2、图12,控制器包括:源控制器,根据视频订阅指令生成第一媒体发送请求;目的控制器,根据视频订阅指令生成第一媒体接收请求。源控制器、目的控制器可任意一个MRFC(多媒体资源控制器)。Please refer to Figure 2 and Figure 12 together. The controller includes: a source controller, which generates a first media sending request according to a video subscription instruction; and a destination controller, which generates a first media receiving request according to the video subscription instruction. The source controller and the destination controller can be either MRFC (Multimedia Resource Controller).
在一些实施例中,控制器包括:源控制器,根据视频订阅指令生成第一媒体发送请求;目的控制器,根据视频订阅指令生成第一媒体接收请求。目的终端受控于目的处理器,目的处理器受控于目的控制器;源终端受控于源处理器,源处理器受控于源控制器;目的控制器及源控制器受控于同一会议终端。通过同一个会议终端对若干控制器进行级联控制,每一个控制器对若干处理器进行级联控制,以构建级联会议通讯网络。In some embodiments, the controller includes: a source controller, which generates a first media transmission request according to a video subscription instruction; and a destination controller, which generates a first media reception request according to the video subscription instruction. The destination terminal is controlled by the destination processor, and the destination processor is controlled by the destination controller; the source terminal is controlled by the source processor, and the source processor is controlled by the source controller; the destination controller and the source controller are controlled by the same conference terminal. Several controllers are cascaded through the same conference terminal, and each controller is cascaded to control several processors to build a cascaded conference communication network.
会议终端通过向源控制器下发第一视频订阅指令以控制源处理器将视频流传输至对应的目的处理器。在源处理器开始传输视频流后,源处理器根据第一媒体发送请求生成第一媒体发送响应并回传至源控制器。通过对应的源处理器回传媒体发送响应,以确保在目的处理器开始接收视频流前,源处理器已开始发送源终端的视频流,从而避免媒体通道的资源占用。The conference terminal sends the first video subscription instruction to the source controller to control the source processor to transmit the video stream to the corresponding destination processor. After the source processor starts to transmit the video stream, the source processor generates a first media transmission response according to the first media transmission request and transmits it back to the source controller. The media transmission response is sent back through the corresponding source processor to ensure that the source processor has started to send the video stream of the source terminal before the destination processor starts to receive the video stream, thereby avoiding resource occupation of the media channel.
本申请实施例提供一种终端,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,处理器执行程序时实现上述实施例中的会议级联方法。An embodiment of the present application provides a terminal, which includes a memory, a processor, and a computer program stored on the memory and capable of running on the processor, and the processor implements the conference cascading method in the foregoing embodiment when the processor executes the program.
通过本申请实施例提供的终端,执行上述实施例中的会议级联方法可实现不同终端间的视频订阅,目的终端可订阅同一处理器中或不同处理器的其他任意终端的视频。Through the terminal provided by the embodiment of the present application, the video subscription between different terminals can be realized by executing the conference cascading method in the above embodiment, and the destination terminal can subscribe to the video of any other terminal in the same processor or different processors.
本申请实施例提供一种计算机可读存储介质,存储有计算机可执行指令,计算机可执行指令用于:执行上述实施例中的会议级联方法。An embodiment of the present application provides a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are used to execute the conference cascading method in the foregoing embodiment.
通过本申请实施例提供的计算机可读存储介质,执行上述实施例中的会议级联方法可实现不同终端间的视频订阅,目的终端可订阅同一处理器中或不同处理器的其他任意终端的视频。Through the computer-readable storage medium provided by the embodiments of this application, the implementation of the conference cascading method in the above embodiments can realize video subscription between different terminals, and the target terminal can subscribe to the video of any other terminal in the same processor or different processors. .
本申请实施例公开了会议级联方法、级联会议系统、终端及计算机可读存储介质,通过本申请实施例的会议级联方法,可实现任意不同终端间的视频订阅。The embodiment of the application discloses a conference cascading method, a cascading conference system, a terminal, and a computer-readable storage medium. Through the conference cascading method of the embodiment of the application, video subscriptions between any different terminals can be realized.
以上所描述的装置实施例仅仅是示意性的,其中作为分离部件说明的单元可以是或者也可以不是物理上分开的,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
以上是对本申请的一些实施进行了具体说明,但本申请并不局限于上述实施方式,熟悉本领域的技术人员在不违背本申请范围的前提下还可作出种种的等同变形或替换,这些等同的变形或替换均包含在本申请权利要求所限定的范围内。The above is a specific description of some implementations of this application, but this application is not limited to the above-mentioned embodiments. Those skilled in the art can also make various equivalent modifications or substitutions without departing from the scope of this application. These equivalents Variations or replacements of are included within the scope defined by the claims of this application.

Claims (13)

  1. 一种会议级联方法,包括:A conference cascade method, including:
    会议终端接收视频订阅请求并生成第一视频订阅指令;The conference terminal receives the video subscription request and generates a first video subscription instruction;
    控制器根据所述第一视频订阅指令生成视频流下发请求;The controller generates a video stream delivery request according to the first video subscription instruction;
    处理器根据所述视频流下发请求下发视频流,并生成视频流下发响应;The processor delivers a video stream according to the video stream delivery request, and generates a video stream delivery response;
    所述控制器根据所述视频流下发响应生成第一订阅确认响应,所述会议终端根据所述第一订阅确认响应生成视频订阅响应。The controller generates a first subscription confirmation response according to the video stream delivery response, and the conference terminal generates a video subscription response according to the first subscription confirmation response.
  2. 根据权利要求1所述的会议级联方法,其中,所述控制器根据所述第一视频订阅指令生成视频流下发请求,还包括:The conference cascading method according to claim 1, wherein the controller generates a video stream delivery request according to the first video subscription instruction, further comprising:
    所述控制器根据所述第一视频订阅指令生成第一媒体发送请求;The controller generates a first media sending request according to the first video subscription instruction;
    源处理器根据所述第一媒体发送请求将视频流发送至目的处理器并生成第一媒体发送响应;The source processor sends the video stream to the destination processor according to the first media sending request and generates a first media sending response;
    所述控制器根据所述第一媒体发送响应生成第一媒体接收请求;Generating, by the controller, a first media reception request according to the first media transmission response;
    所述目的处理器根据所述第一媒体接收请求接收所述视频流。The destination processor receives the video stream according to the first media reception request.
  3. 根据权利要求2所述的会议级联方法,其中,所述生成视频流下发响应,还包括;The conference cascading method according to claim 2, wherein said generating a video stream delivery response further comprises;
    所述目的处理器根据所述第一媒体接收请求生成第一媒体接收响应;Generating, by the destination processor, a first media reception response according to the first media reception request;
    所述控制器根据所述第一媒体接收响应生成所述视频流下发请求;Generating, by the controller, the video stream delivery request according to the first media reception response;
    所述目的处理器根据所述视频流下发请求下发所述视频流。The destination processor delivers the video stream according to the video stream delivery request.
  4. 根据权利要求3所述的会议级联方法,其中,还包括:The conference cascading method according to claim 3, further comprising:
    所述目的处理器根据所述视频流下发请求将所述视频流下发至指定终端;The destination processor delivers the video stream to a designated terminal according to the video stream delivery request;
    所述目的处理器根据所述视频流下发请求生成视频流下发响应。The destination processor generates a video stream delivery response according to the video stream delivery request.
  5. 根据权利要求1至4任一项所述的会议级联方法,其中,所述控制器根据所述第一视频订阅指令生成第一媒体发送请求,包括:The conference cascading method according to any one of claims 1 to 4, wherein the controller generating a first media sending request according to the first video subscription instruction includes:
    源控制器根据所述第一视频订阅指令生成所述第一媒体发送请求;The source controller generates the first media sending request according to the first video subscription instruction;
    所述源处理器根据所述第一媒体发送请求将所述视频流传输至所述目的处理器;Transmitting, by the source processor, the video stream to the destination processor according to the first media sending request;
    所述源处理器根据所述第一媒体发送请求生成所述第一媒体发送响应并回传至所述源控制器。The source processor generates the first media transmission response according to the first media transmission request and transmits it back to the source controller.
  6. 根据权利要求5所述的会议级联方法,其中,还包括:The conference cascading method according to claim 5, further comprising:
    所述源控制器根据所述第一媒体发送响应生成第二媒体发送响应;Generating, by the source controller, a second media transmission response according to the first media transmission response;
    所述会议终端根据所述第二媒体发送响应生成第二视频订阅指令;Generating, by the conference terminal, a second video subscription instruction according to the second media sending response;
    目的控制器根据所述第二视频订阅指令生成所述第一媒体接收请求;The destination controller generates the first media reception request according to the second video subscription instruction;
    所述目的处理器根据所述第一媒体接收请求接收所述视频流;Receiving, by the destination processor, the video stream according to the first media reception request;
    所述目的处理器根据所述第一媒体接收请求生成所述第一媒体接收响应。The destination processor generates the first media reception response according to the first media reception request.
  7. 根据权利要求6所述的会议级联方法,其中,还包括:The conference cascading method according to claim 6, further comprising:
    所述目的控制器根据所述第一媒体接收响应生成所述视频流下发请求;Generating, by the destination controller, the video stream delivery request according to the first media reception response;
    所述目的处理器根据所述视频流下发请求将所述视频流下发至指定终端并生成所述视频流下发响应。The destination processor delivers the video stream to a designated terminal according to the video stream delivery request and generates the video stream delivery response.
  8. 一种级联会议系统,包括:A cascade conference system, including:
    会议管理模块,被配置为接收视频订阅请求并生成第一视频订阅指令;The conference management module is configured to receive a video subscription request and generate a first video subscription instruction;
    至少一个控制模块,被配置为根据所述第一视频订阅指令生成视频流下发请求;At least one control module configured to generate a video stream delivery request according to the first video subscription instruction;
    至少一个处理模块,被配置为根据所述视频流下发请求对所述视频流进行传输。At least one processing module is configured to transmit the video stream according to the video stream issuance request.
  9. 根据权利要求8所述的级联会议系统,其中,还包括:The cascaded conference system according to claim 8, further comprising:
    所述处理模块被配置为根据所述视频流下发请求生成视频流下发响应;The processing module is configured to generate a video stream delivery response according to the video stream delivery request;
    所述控制模块被配置为根据所述视频流下发响应生成第一订阅确认响应;The control module is configured to generate a first subscription confirmation response according to the video stream delivery response;
    所述会议管理模块被配置为根据所述第一订阅确认响应生成视频订阅响应。The conference management module is configured to generate a video subscription response according to the first subscription confirmation response.
  10. 根据权利要求8所述的级联会议系统,其中,所述控制模块被配置为生成第一媒体发送请求、第一媒体接收请求,所述处理模块包括:The cascaded conference system according to claim 8, wherein the control module is configured to generate a first media sending request and a first media receiving request, and the processing module comprises:
    源处理模块,被配置为根据所述第一媒体发送请求发送所述视频流;A source processing module configured to send the video stream according to the first media sending request;
    目的处理模块,被配置为根据所述第一媒体接收请求接收所述视频流;A destination processing module configured to receive the video stream according to the first media reception request;
    其中,所述源处理器与所述目的处理器之间设有媒体复用通道。Wherein, a media multiplexing channel is provided between the source processor and the destination processor.
  11. 根据权利要求10所述的级联会议系统,其中,所述控制模块包括:The cascaded conference system according to claim 10, wherein the control module comprises:
    源控制模块,被配置为根据所述视频订阅指令生成所述第一媒体发送请求;A source control module configured to generate the first media sending request according to the video subscription instruction;
    目的控制模块,被配置为根据所述视频订阅指令生成所述第一媒体接收请求。The purpose control module is configured to generate the first media reception request according to the video subscription instruction.
  12. 一种终端,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,所述处理器执行所述程序时实现:A terminal includes: a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the program when the program is executed:
    如权利要求1至9中任一项所述的会议级联方法。The conference cascading method according to any one of claims 1 to 9.
  13. 一种计算机可读存储介质,存储有计算机可执行指令,其中,所述计算机可执行指令用于:A computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are used for:
    执行权利要求1至7中任一项所述的会议级联方法。The conference cascade method according to any one of claims 1 to 7 is implemented.
PCT/CN2021/101574 2020-06-24 2021-06-22 Conference cascading method and system, terminal and computer-readable storage medium WO2021259275A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010591731.3A CN113840112A (en) 2020-06-24 2020-06-24 Conference cascading method and system, terminal and computer readable storage medium
CN202010591731.3 2020-06-24

Publications (1)

Publication Number Publication Date
WO2021259275A1 true WO2021259275A1 (en) 2021-12-30

Family

ID=78964813

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/101574 WO2021259275A1 (en) 2020-06-24 2021-06-22 Conference cascading method and system, terminal and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN113840112A (en)
WO (1) WO2021259275A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114513052A (en) * 2022-01-11 2022-05-17 珠海惠威科技有限公司 Power supply directional control system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101626300A (en) * 2008-07-08 2010-01-13 中兴通讯股份有限公司 Method and system for establishing subconference in multimedia conferences
US20110134807A1 (en) * 2009-12-08 2011-06-09 Alcatel-Lucent Usa Inc. Method for joining SIP communication devices into an existing call
CN102111278A (en) * 2010-12-28 2011-06-29 华为技术有限公司 Conference media quality monitoring method, device and system
EP2785012A1 (en) * 2013-03-28 2014-10-01 Alcatel Lucent A mediator for optimizing the transmission of media contents between a multimedia resource function and a plurality of terminals
CN104579707A (en) * 2014-12-26 2015-04-29 华为技术有限公司 Method for joining meeting, meeting invitation method, relevant equipment and systems
CN108737480A (en) * 2017-04-24 2018-11-02 中兴通讯股份有限公司 Conference cascading method, server based on w media server and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101626300A (en) * 2008-07-08 2010-01-13 中兴通讯股份有限公司 Method and system for establishing subconference in multimedia conferences
US20110134807A1 (en) * 2009-12-08 2011-06-09 Alcatel-Lucent Usa Inc. Method for joining SIP communication devices into an existing call
CN102111278A (en) * 2010-12-28 2011-06-29 华为技术有限公司 Conference media quality monitoring method, device and system
EP2785012A1 (en) * 2013-03-28 2014-10-01 Alcatel Lucent A mediator for optimizing the transmission of media contents between a multimedia resource function and a plurality of terminals
CN104579707A (en) * 2014-12-26 2015-04-29 华为技术有限公司 Method for joining meeting, meeting invitation method, relevant equipment and systems
CN108737480A (en) * 2017-04-24 2018-11-02 中兴通讯股份有限公司 Conference cascading method, server based on w media server and storage medium

Also Published As

Publication number Publication date
CN113840112A (en) 2021-12-24

Similar Documents

Publication Publication Date Title
US9166978B2 (en) Automatic resource provisioning for meeting collaboration
CN111555893A (en) Message data transmission method and device, computer equipment and storage medium
US10812324B2 (en) Technologies for managing application configurations and associated credentials
CN109408751B (en) Data processing method, terminal, server and storage medium
JP2022505374A (en) Online document sharing methods, devices, electronic devices and storage media
WO2019222934A1 (en) File processing method, apparatus and system
WO2018133721A1 (en) Authentication system and method, and server
JP2018532201A (en) System and method for transferring message data
WO2020001162A1 (en) Container management method, apparatus, and device
US20210089517A1 (en) Communication device and communication system
CN103036597A (en) Method and device of sharing resources among devices in close range
WO2021259275A1 (en) Conference cascading method and system, terminal and computer-readable storage medium
CN111931962A (en) Information display method and device and electronic equipment
US20220295133A1 (en) Technologies for managing collaborative and multiplatform media content playlists
CN114827094A (en) Cloud desktop-based authority control method and device, computer equipment and medium
US20130169733A1 (en) Device and method for providing api for sharing contents
JP7455232B2 (en) Interaction methods, devices and electronic equipment
WO2021147466A1 (en) Message processing method and apparatus, and electronic device
CN110178353A (en) Method for processing business, Cloud Server and terminal device
US11848762B2 (en) Live broadcast stream pushing method and apparatus, and electronic device
US20150012654A1 (en) Methods and apparatus for sharing a physical device between multiple physical machines
CN114968617B (en) API conversion system, access request processing method thereof, electronic equipment and medium
KR20220032229A (en) Method for controlling data transmission in distributed network and appratuses perfroming the same
US11544237B2 (en) Database connection refresh for server instances and live database updates
CN110928693B (en) Computing equipment and resource allocation method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21830014

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16.05.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21830014

Country of ref document: EP

Kind code of ref document: A1