CN112804267B

CN112804267B - Hierarchical conference processing method and device, electronic equipment and storage medium

Info

Publication number: CN112804267B
Application number: CN202110391521.4A
Authority: CN
Inventors: 吕少卿; 王克彦; 曹亚曦; 孙俊伟; 俞鸣园; 费敏健
Original assignee: Zhejiang Huachuang Video Signal Technology Co Ltd
Current assignee: Zhejiang Huachuang Video Signal Technology Co Ltd
Priority date: 2021-04-13
Filing date: 2021-04-13
Publication date: 2021-07-09
Anticipated expiration: 2041-04-13
Also published as: CN112804267A

Abstract

The invention provides a hierarchical conference processing method and device, electronic equipment and a storage medium. The hierarchical conference processing method is applied to conference equipment of a main conference of a hierarchical conference, and the hierarchical conference further comprises the following steps: at least one sub-conference created based on the main conference; the method comprises the following steps: when the main conference is in a first conference mode, receiving a first sub-conference stream sent by a first sub-conference in the sub-conferences; wherein the first sub-conference stream comprises: an audio stream and/or a video stream of the first sub-conference; treating the first sub-conference stream as a main conference stream of the main conference for stream processing, wherein the main conference stream includes: an audio stream and/or a video stream of the primary conference.

Description

Hierarchical conference processing method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of network communication technologies, but not limited to the field of network communication technologies, and in particular, to a hierarchical conference processing method and apparatus, an electronic device, and a storage medium.

Background

Network conferencing, also known as online conferencing, is becoming more common. The network conference can enable participants to ignore isolated remote participation in the conference in geographic space, thereby knowing the content discussed by the conference.

In a large conference, due to the numerous participants, the limited conference terminals that can be accessed by a single conference based on limited bandwidth resources and/or processing resources, etc., in this case, a sub-conference created based on a main conference is proposed.

In a hierarchical conference formed by a main conference and a sub-conference, the conference is managed by the main conference in the whole process in the related art, so that the requirements of some conference scenes cannot be realized, or the operation is inconvenient, and the conference has to be additionally created, and the like.

Disclosure of Invention

Embodiments of the present invention provide a method and an apparatus for processing a hierarchical conference, an electronic device, and a storage medium, so as to at least solve the above technical problems in the prior art.

An embodiment of the present invention provides a hierarchical conference processing method, which is applied to a conference device of a main conference of a hierarchical conference, where the hierarchical conference further includes: at least one sub-conference created based on the main conference; the method comprises the following steps:

when the main conference is in a first conference mode, receiving a first sub-conference stream sent by a first sub-conference in the sub-conferences; wherein the first sub-conference stream comprises: an audio stream and/or a video stream of the first sub-conference;

treating the first sub-conference stream as a main conference stream of the main conference for stream processing, wherein the main conference stream includes: an audio stream and/or a video stream of the primary conference.

Based on the above scheme, the stream processing by regarding the first sub-conference stream as the main conference stream of the main conference includes at least one of:

outputting the first sub-conference stream at a conference interface of the main conference;

sending the first sub-conference stream to a main conference terminal belonging to the main conference;

sending the first sub-conference stream to a second sub-conference, wherein the second sub-conference is as follows: a sub-conference different from the first sub-conference among the sub-conferences created based on the main conference.

Based on the above scheme, the method further comprises:

controlling the main conference to enter the first conference mode from a second conference mode when a conference mode switching operation of a host of the main conference is detected;

and/or the presence of a gas in the gas,

when a sub-conference takes over a conference process according to a preset conference flow, controlling the main conference to enter the first conference mode from the second conference mode;

and in the second conference mode, the main conference generates a main conference stream and carries out stream processing on the main conference stream.

Based on the above scheme, the conference mode switching operation includes: specifying a specified operation for the sub-conference;

the method further comprises the following steps:

and when the main conference is in the first conference mode, determining the first sub-conference according to the specified operation.

Based on the above scheme, the method further comprises:

when the main conference is in a first conference mode, at least part of the authority of the host conference is authorized to the host of the first sub-conference.

Based on the scheme, the at least part of the authority comprises at least one of the following:

a right to specify a right of a speaker; wherein the speaker comprises: at least one of a participant of a main conference, a participant of a second sub-conference, and a participant of the first sub-conference; wherein the second sub-conference is different from the first sub-conference;

creating a right of the second sub-conference;

increasing the authority of the second sub-conference participating in the conference;

deleting the authority of the second sub-conference participating in the conference;

a permission for mode switching of the master conference;

switching the switching permission of the first sub-conference among different sub-conferences;

modifying the authority of the conference interface layout of the main conference;

and calling the right of speaking of the second sub-conference.

Based on the above scheme, the method further comprises:

when a conference allows creation of a sub-conference of the main conference, at least one of the sub-conferences is created based on the main conference in response to a sub-conference creation operation.

Based on the scheme, when the conference allows the creation of the sub-conference of the main conference, the creating of at least one sub-conference based on the main conference in response to the sub-conference creating operation comprises at least one of the following steps:

when a sub-conference of a main conference is allowed to be created by default, creating at least one sub-conference based on the main conference in response to a sub-conference creating operation;

creating at least one of the sub-conferences based on the main conference in response to the sub-conference creating operation when a moderator of the main conference indicates that the sub-conference of the main conference is allowed to be created.

Based on the above scheme, the creating at least one sub-conference based on the main conference in response to the sub-conference creating operation includes:

setting a sub-conference identifier of at least one sub-conference based on a conference identifier of the main conference in response to the sub-conference creating operation;

in response to the sub-conference creating operation, creating a tunnel between the main conference and the created sub-conference, wherein the tunnel is used for transmitting conference streams between the main conference and the sub-conference;

determining at least one participant of the sub-conference in response to the sub-conference creation operation;

determining a moderator of at least one of the sub-conferences in response to the sub-conference creation operation;

and responding to the sub-conference creating operation, and granting the management authority of the sub-conference to the host of at least one sub-conference.

Based on the scheme, the management authority of the sub-conference comprises at least one of the following:

increasing the authority of the participants of the sub-conference;

deleting the authority of the participant of the sub-conference;

appointing the speaking right of the participants of the sub-conference;

determining the authority of the conference interface layout of the sub-conference;

forbidding the speaking right of the participants of the sub-conference.

A second aspect of the embodiments of the present disclosure provides a method for processing a hierarchical conference, where the method is applied to a conference device of a first sub-conference of the hierarchical conference, and the hierarchical conference further includes: a main conference; wherein the first sub-conference is created based on the main conference; the method comprises the following steps:

generating a first sub-conference stream of the first sub-conference; the first sub-conference stream includes: an audio stream and/or a video stream of the first sub-conference;

and when the main conference is in a first conference mode, sending the first sub-conference stream to conference equipment of the main conference, wherein the first sub-conference stream is used for treating the conference equipment in the main conference as a main conference stream of the main conference for stream processing.

Based on the above scheme, the method further comprises:

receiving a primary conference stream of the primary conference when the primary conference is in a second conference mode;

merging the first sub-conference stream and the main conference stream;

and carrying out stream processing on the fused first sub-conference stream and the main conference stream.

Based on the above scheme, the method further comprises:

accepting at least a portion of administrative rights granted by the master conference to a moderator of the first sub-conference when the master conference is in the first conference mode.

A third aspect of the embodiments of the present disclosure provides a hierarchical conference processing apparatus, which is applied to a conference device of a main conference of a hierarchical conference, where the hierarchical conference further includes: at least one sub-conference created based on the main conference; the device comprises:

a first receiving module, configured to receive, when the main conference is in a first conference mode, a first sub-conference stream sent by a first sub-conference in the sub-conferences; wherein the first sub-conference stream comprises: an audio stream and/or a video stream of the first sub-conference;

a first processing module, configured to treat the first sub-conference stream as a main conference stream of the main conference for stream processing, where the main conference stream includes: an audio stream and/or a video stream of the primary conference.

Based on the above solution, the first processing module is configured to execute at least one of:

Based on the above scheme, the apparatus further comprises: a control module;

the control module is used for controlling the main conference to enter the first conference mode from the second conference mode when detecting the conference mode switching operation of a host of the main conference; and/or controlling the main conference to enter the first conference mode from the second conference mode when the conference process is taken over by the sub-conference according to the preset conference flow;

the device further comprises:

and the determining module is used for determining the first sub-conference according to the specified operation when the main conference is in the first conference mode.

Based on the above scheme, the apparatus further comprises:

and the authorization module is used for authorizing at least part of the authority of the host of the main conference to the host of the first sub-conference when the main conference is in the first conference mode.

creating a right of the second sub-conference;

a permission for mode switching of the master conference;

and calling the right of speaking of the second sub-conference.

Based on the above scheme, the apparatus further comprises:

and the creating module is used for responding to a sub-conference creating operation to create at least one sub-conference based on the main conference when the conference allows the creation of the sub-conference of the main conference.

Based on the above scheme, the creating sub-module is configured to perform at least one of:

Based on the above scheme, the creating sub-module is specifically configured to execute at least one of:

increasing the authority of the participants of the sub-conference;

deleting the authority of the participant of the sub-conference;

appointing the speaking right of the participants of the sub-conference;

forbidding the speaking right of the participants of the sub-conference.

A fourth aspect of the embodiments of the present disclosure provides a hierarchical conference processing apparatus, which is applied to a conference device of a first sub-conference of the hierarchical conference, where the hierarchical conference further includes: a main conference; wherein the first sub-conference is created based on the main conference; the device comprises:

a generating module, configured to generate a first sub-conference stream of the first sub-conference; the first sub-conference stream includes: an audio stream and/or a video stream of the first sub-conference;

and a sending module, configured to send the first sub-conference stream to a conference device of the main conference when the main conference is in a first conference mode, where the first sub-conference stream is used for stream processing when the conference device in the main conference is regarded as a main conference stream of the main conference.

Based on the above scheme, the apparatus further comprises:

a second receiving module, configured to receive a main conference stream of the main conference when the main conference is in a second conference mode;

a merging module for merging the first sub-conference stream and the main conference stream;

and the second processing module is used for carrying out stream processing on the fused first sub-conference stream and the main conference stream.

Based on the above scheme, the apparatus further comprises:

and the accepting module is used for accepting at least part of the management authority which is granted to the host of the first sub-conference by the main conference when the main conference is in the first conference mode.

A fifth aspect of the embodiments of the present disclosure provides an electronic device, which includes a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus; a memory for storing a computer program; and a processor, configured to implement the method steps provided in any of the foregoing first aspect or second aspect when executing the program stored in the memory.

A sixth aspect of the embodiments of the present disclosure provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and the computer program, when executed by a processor, implements the method steps provided in any of the foregoing first aspect or second aspect.

According to the technical scheme provided by the embodiment of the disclosure, the main conference supports the first conference mode, and the sub-conference created under the main conference mode is allowed by the main conference in the first conference mode to exercise the right of the main conference, so that the sub-conference can have the authority of the main conference under the condition that the main conference and the sub-conference are not switched or a new conference is not additionally created, and thus, the conference requirement of main scene transfer of the conference is realized under the condition that the current hierarchical conference is not suspended, and the advantages of convenience in operation and high conference fluency are achieved.

Drawings

Fig. 1 is a schematic flow chart diagram of a method for processing a hierarchical conference according to an embodiment of the present disclosure;

fig. 2 is a schematic diagram of a conference hierarchy structure of a hierarchical conference provided in an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a hierarchical conference provided by an embodiment of the present disclosure;

fig. 4A is a schematic diagram illustrating a display effect of a conference screen according to an embodiment of the disclosure;

fig. 4B is a schematic diagram illustrating a display effect of a conference screen according to an embodiment of the present disclosure;

fig. 4C is a schematic view illustrating a display effect of a conference screen according to an embodiment of the present disclosure;

fig. 5A is a schematic view illustrating a display effect of a conference screen according to an embodiment of the disclosure;

fig. 5B is a schematic diagram illustrating a display effect of a conference screen according to an embodiment of the disclosure;

fig. 5C is a schematic view illustrating a display effect of a conference screen according to an embodiment of the disclosure;

fig. 6A is a schematic diagram of a conference hierarchy structure of a hierarchical conference provided in an embodiment of the present disclosure;

fig. 6B is a schematic diagram of transmission and distribution of conference streams when a main conference is in a second conference mode and a sub-conference is not called;

fig. 6C is a schematic diagram of transmission and distribution of conference streams in a case where a main conference is a named sub-conference in a second conference mode according to an embodiment of the present disclosure;

fig. 6D is a schematic diagram of transmission and distribution of conference streams when the main conference is in the first conference mode according to an embodiment of the present disclosure;

fig. 7 is a schematic flow chart illustrating a method for processing a hierarchical conference according to an embodiment of the present disclosure;

fig. 8 is a schematic structural diagram of a hierarchical conference processing apparatus according to an embodiment of the present disclosure;

fig. 9 is a schematic structural diagram of a hierarchical conference processing apparatus according to an embodiment of the present disclosure.

Detailed Description

In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

As shown in fig. 1, an embodiment of the present disclosure provides a hierarchical conference processing method, which is applied to a conference device of a main conference of a hierarchical conference, where the hierarchical conference further includes: at least one sub-conference created based on the main conference; the method comprises the following steps:

s110: when the main conference is in a first conference mode, receiving a first sub-conference stream sent by a first sub-conference in the sub-conferences; wherein the first sub-conference stream comprises: an audio stream and/or a video stream of the first sub-conference;

s120: treating the first sub-conference stream as a main conference stream of the main conference for stream processing, wherein the main conference stream includes: an audio stream and/or a video stream of the primary conference.

In this disclosure, the conference device of the main conference may be any device that performs conference stream generation or management, and the main conference device may be a server of a conference Application (App).

In the embodiment of the present disclosure, the hierarchical conference may be divided into multiple levels, and for example, the hierarchical conference may be divided into at least two levels, where one level is a main conference and the other level is a sub-conference under the main conference.

In some embodiments, one or more sub-conferences can be opened under a certain level of sub-conference; at this time, a certain conference with a next-stage sub-conference is a main conference of the next-stage sub-conference.

In the embodiment of the present disclosure, the sub-conferences at the same level are independent of each other. Illustratively, the plurality of sub-conferences linked under the main conference are independent of each other.

In one embodiment, the conference resources used by any two conferences (including the main conference and/or any level of sub-conference) under the hierarchical conference can be configured separately.

The resource independence between the main conference and the sub-conferences and the resource independence between any two sub-conferences ensure that the continuous operation of the main conference and/or other sub-conferences cannot be influenced by the fault of any one sub-conference, and therefore the fault linkage between different conferences is realized through resource decoupling.

Fig. 2 is a schematic diagram of a hierarchical conference, as can be seen from fig. 2: the hierarchical conference includes a main conference and one or more sub-conferences created based on the main conference. In fig. 2, there are shown a sub-conference 1, a sub-conference 2 to a sub-conference n, where n may be any positive integer.

Sub-conferences 1 to n are all independent of each other and are associated with the main conference independently of each other.

In the embodiment of the present disclosure, each of the at least two roles, which are allocated to each of the main conference and the sub-conference, is: the moderator and participants; the host has the management authority of the corresponding conference; the participants are the roles of participating in the conference except for the host, can autonomously control the self-control authority of participating in the conference, quitting the conference and the like, and do not have the management authority to other participants and/or hosts in the conference.

In this way, the moderator of the primary conference has administrative rights to the primary conference, and also has administrative rights to the secondary conference. Illustratively, the administrative authority of the host conference moderator for the sub-conference includes at least: the rights to create the sub-conference, the rights to delete the sub-conference, the rights to adjust the participants of the sub-conference, the rights to specify the host of the sub-conference, the rights to configure the number of participants of the sub-conference, the rights to control the layout of the conference interface between the main conference and the sub-conference, etc.

The host of the sub-conference has a sub-conference management authority including at least one of:

the right of speaking of participants of the point name sub-conference;

the permission of speaking of participants of the sub-conference is forbidden;

(ii) a right to invite participants of the sub-conference;

the authority for agreeing with the conference application of the sub-conference;

deleting the authority of the participant of the sub-conference;

configuring the conference layout authority of the sub-conference;

configuring the authority of the number of participants of the sub-conference;

configuring the use permission of the conference space of the sub-conference; the conference space can be a storage space for storing conference documents and the like;

applying for the right of speaking to a main conference;

the authority to request the master conference to distribute the master conference file, etc.

Therefore, in the hierarchical conference, the sub-conference is created under the main conference, the management authority owned by the host of the sub-conference manages the sub-conference, the problems that the management difficulty is large and the management affairs are numerous and complicated and the like caused by the management of only the host of one conference under the condition of a large conference are solved, and the online conference is more complete and the conference effect is better through the hierarchical and hierarchical management of the conference.

In some embodiments, if the main conference is created with a sub-conference, the method further comprises:

creating a moderator group, including in the moderator group: a moderator of the main conference and a moderator of the sub-conference.

In some embodiments, the moderator group is visible to moderators within the group and not to participants other than the moderator within the hierarchical conference, facilitating the moderator of the main conference and the moderator of the sub-conference to negotiate an associated time limit for the entire hierarchical conference at the moderator group. For example, the moderator of the main conference and the moderator of the sub-conference may negotiate the assignment of rights, the conference flow and/or the handling of a certain participant or participants, or the rules that the participants should follow, within the moderator group.

Illustratively, the moderator of the main conference may send a message to a group of moderators of a plurality of sub-conferences within the group of moderators.

In some embodiments, the group owner of the moderator group may default to the moderator of the primary conference, and the group owner may be transferred to other group members within the moderator group under the authority of the current group owner.

In some embodiments, the moderator group can be automatically disbanded after the hierarchical conference is over; in other embodiments, the moderator group needs to be resolved based on the group resolving operation, so that after the entire hierarchical conference is finished, the moderator of the main conference and the moderators of the respective sub-conferences can interact with subsequent discussion matters of the conference based on the moderator group, for example, sorting the conference records and/or distributing backlog matters left over by the conference, and the like.

The moderator group is also provided with a group space, the group space can store files imported by group members, and is convenient for inquiring during subsequent conference arrangement, for example, the group space can be used for storing conference records and the like.

In the disclosed embodiment, the primary conference supports a first conference mode, which may be referred to as a conference hosting mode.

In the first conference mode, the main conference itself may not generate a main conference stream, or may generate a main conference stream; and in the first conference mode, one of the plurality of sub-conferences created under the main conference (i.e., the first sub-conference) may be granted some right to exercise the main conference. For example, a first sub-conference stream recorded by a first sub-conference may be considered at least a part of a main conference stream, distributed to other sub-conferences, or directly connected to a main conference terminal under the main conference without reference to any sub-conference. For another example, the conference interface of the main conference is taken over by the conference interface of the first sub-conference; alternatively, a core portion of a main conference interface of the main conference is populated by conference interfaces of the first sub-conference.

And if the main conference is in the first conference mode and the main conference does not record the conference stream, the first sub-conference stream is taken as the whole conference stream of the main conference. And if the main conference has the recorded conference stream, the first sub-conference stream is used as a part of the main conference stream of the main conference.

Illustratively, the first sub-conference stream of the first sub-conference is streamed as a core part of the main conference stream of the main conference, and the conference stream recorded by the main conference itself is streamed as an auxiliary part of the main conference stream. When the first sub-conference stream is used as a core part of the main conference stream and the conference stream of the main conference itself is used as an auxiliary part for stream processing, on the main conference interface of the main conference, the area of the conference interface of the first sub-conference provided by the first sub-conference stream is larger than the area of the conference interface of the main conference place provided by the conference stream of the main conference itself; and/or the conference interface of the first sub-conference provided by the first sub-conference stream is positioned in the core area of the main conference interface, and the conference interface of the main conference scene of the main conference is positioned in the edge area of the main conference interface. The rim area is located at the periphery of the core area.

In this way, at least one sub-conference can exercise the right of the main conference to occupy the core part or most of the area of the main conference interface of the main conference and/or distribute the sub-conference stream of one sub-conference to other sub-conferences as the main conference stream of the main conference without switching the conference hierarchical relationship between the main conference and the sub-conferences.

Illustratively, under a main conference created by taking a class as a unit, a plurality of sub-conferences created by taking a group as a unit are created, when a certain group is regarded as a typical group, and conference streams corresponding to group discussions of the typical group need to be watched with emphasis by other sub-conferences, the main conference corresponding to the class can be controlled to enter a first conference mode, and the sub-conferences of the typical group determine a first sub-conference, so that the sub-conference streams of the sub-conferences of the typical group are distributed to the other watched groups to be watched with emphasis, and thus the requirement of easy transfer of core scenes under a hierarchical conference is met. Of course, the above is merely illustrative of a conference scenario.

In the embodiment of the present application, the conference stream of the main conference and the sub-conference stream of any one of the sub-conferences may be audio streams and/or video streams.

In the disclosed embodiment, the hierarchical conference may be an audio conference or a video conference. The conference stream of the audio conference transmission comprises: an audio stream; the conference stream of the video conference transmission includes: an audio stream and/or a video stream.

In some embodiments, the conference stream may be: and according to the audio and video stream submitted by the participant terminal, obtaining the audio stream through audio and video stream fusion and/or audio mixing processing.

In the embodiment of the present disclosure, when the main conference is in the first conference mode, a first sub-conference stream sent by a first sub-conference is received; and the first sub-conference stream is regarded as the conference stream of the main conference for conference processing. The conference processing here includes: output of conference streams and/or distribution of conference streams.

In summary, in the embodiment of the present disclosure, the main conference supports the first conference mode, and the main conference in the first conference mode allows a sub-conference created under the main conference to exercise the right of the main conference, so that the sub-conference can have the authority of the main conference without switching the main conference and the sub-conference or creating a new conference additionally, and thus, the conference requirement of the main scene transfer of the conference is met without suspending the current hierarchical conference, and the advantages of convenient operation and high conference fluency are provided.

In some embodiments, the S120 may include at least one of:

On a conference interface of the main conference, outputting the first sub-conference stream includes:

on the conference interface of the main conference, the conference interface provided by the first sub conference stream is taken as a main output, and the output comprises: audio output and/or picture output carried by a video stream.

Referring to FIG. 4A, the conference interface shown in FIG. 4A may be: and the effect schematic diagram of the conference interface of the main conference, the main conference terminal and/or the first sub-conference. For example, when the current main conference is in the first conference mode, the main conference itself does not generate the main conference stream, but receives the first sub conference stream from the first sub conference, and directly outputs the first sub conference stream on the main conference interface of the main conference, then the conference picture of the first sub conference stream will be displayed on the main conference interface of the main conference. If the main conference does not generate the main conference stream of the main conference at present, the first sub-conference will not receive the main conference stream of the main conference, and because the main conference is in the first conference mode, the sub-conference interface of the first sub-conference can directly output the first sub-conference stream generated by the first sub-conference interface, so that the conference picture of the first sub-conference is displayed. Since the main conference is in the first conference mode, and if the main conference stream is not generated by the main conference, the first sub-conference stream is directly distributed to the main conference terminal, so that the picture shown in fig. 4A can also be an effect schematic diagram of the display interface of the main conference terminal.

Some of the participating terminals directly belong to the main conference, and if any sub-conference is not referred to, the terminals directly connected to the main conference are called main conference terminals. Referring to fig. 3, the main conference terminal F and the main conference terminal Z are directly connected to the main conference without referring to the sub-conference 1 and the sub-conference 2. Meanwhile, in fig. 3, the sub-conference terminal participating in the sub-conference 1 includes: a terminal A, a terminal B and a terminal C; the sub-conference terminal participating in the sub-conference 2 comprises: terminal D and terminal E.

The conference Identification (ID) of the main conference is 3333 in fig. 3; the sub-conference ID of sub-conference 1 is: 3333-1 and the sub-conference ID of sub-conference 2 is 3333-2.

If the sub-conference 2 is designated as the first sub-conference by the host of the main conference at this time, the sub-conference 1 is the second sub-conference when the main conference is in the first conference mode.

When the conference stream is distributed, the first sub-conference stream is distributed to the main conference terminal, so that the main conference terminal mainly displays the conference interface of the first sub-conference.

And if a plurality of sub-conferences are established under one main conference, at least one second sub-conference different from the first main conference is included in addition to the first main conference.

In a normal situation, the first sub-conference stream of the first sub-conference is not transmitted to the main conference terminal and/or the second sub-conference, and since the main conference is in the first conference mode, the first sub-conference stream of the first sub-conference is regarded as the main conference stream of the main conference, the first sub-conference stream is distributed by the main conference to the main conference terminal and the at least one second sub-conference, so that the second sub-conference and/or the main conference terminal can also view the conference condition of the first sub-conference.

FIG. 4B shows: when the main conference is in a first conference mode, the first sub-conference stream is taken as a main conference stream of the main conference and distributed to a second sub-conference; after the second sub-conference receives the first sub-conference stream as the main conference stream, the second sub-conference stream generated by the second sub-conference stream is combined to generate a conference stream through fusion, and the conference stream generated through fusion is output on a sub-conference interface of the second sub-conference, so that an effect diagram shown in fig. 4B can be obtained.

FIG. 4C is: when the main conference is in a first conference mode, a first sub conference stream of the first sub conference is distributed to a second sub conference as a main conference stream; the second sub-conference also has an effect schematic diagram of a display interface of the sub-conference terminal of the second sub-conference after the merged conference stream which is merged with the sub-conference stream of the second sub-conference and is sent to the sub-conference terminal of the second sub-conference is merged with the first sub-conference stream.

In some embodiments, the primary conference supports multiple conference modes, and may support a second conference mode and/or a third conference mode in addition to the first conference mode.

In the second conference mode, a conference mode may be used in which a main conference stream is recorded by itself for the main conference and stream processing is performed based on the self-recorded main conference stream.

And in the third conference mode, the main conference mode sets the main conference and the parallel sub-conferences as conference modes, and the plurality of sub-conferences are regarded as participants of the main conference to participate in conference discussion of the main conference. And the plurality of sub-conferences submit the conference streams recorded by the sub-conferences to the main conference, and the main conference combines the conference streams of the main conference scene recorded by the main conference to generate the conference streams distributed to each sub-conference and/or the main conference terminal under the condition of not dividing the main conference into a main conference and a sub-conference. In the third conference mode, a host of the main conference has the operation authority to any one sub-conference, any one main conference terminal and/or any sub-conference terminal; and the host of the sub-conference can have the operation authority to the sub-conference and the sub-conference terminal managed by the host. Such operational rights include, but are not limited to, at least one of: speaking right, no speaking right,

Since the main conference supports multiple conference modes, in some embodiments, when the main conference detects a conference mode switching operation, the conference mode of the main conference is switched.

Taking the example that the primary conference supports the first conference mode and the second conference mode, the method further includes:

and/or the presence of a gas in the gas,

In some embodiments, the second conference mode may be a default mode or a regular mode of the primary conference. The primary conference will automatically enter the second conference mode without special designation. Thus, upon detection of a conference mode switching operation, the primary conference will exit the first conference mode and enter the second conference mode.

If the host of the main conference operates the main conference, various operations of the host of the main conference are monitored, and if a conference mode switching operation for switching to the first conference mode is detected, the main conference exits the current conference mode and enters the first conference mode, for example, exits the second conference mode and enters the first conference mode.

If the main conference only supports the first conference mode and the second conference mode and is currently in the second conference mode, and when the conference switching operation of the unspecified conference mode is detected, the main conference automatically exits the second conference mode and is switched to the first conference mode.

In some cases, a conference flow can be customized in advance for the conference, when different conference flows can be seen according to the conference flow, whether the conference flow is dominated by the main conference or the sub-conference, and if it is detected that one conference flow is dominated by the sub-conference, the main conference can be automatically switched from a second conference mode dominated by itself to a first conference mode dominated by at least one sub-conference according to the conference flow.

In some embodiments, the conference process may be that a conference device of the main conference automatically switches according to a conference proceeding status, or may automatically realize that the main conference is switched from the second conference mode to the first conference mode when determining whether to enter a conference takeover process dominated by the sub-conference according to a process switching operation of a host of the main conference or at least one core participant with an operation right other than the host.

Fig. 5A to 5C are conference screens in which the main conference is in the second conference mode. Fig. 5A is a display effect diagram of a main conference interface of the main conference in the second conference mode; fig. 5B is a diagram illustrating a display effect of a sub-conference interface of the sub-conference when the main conference is in the second conference mode and the sub-conference 2 is in the second conference mode. Fig. 5C is a schematic view of an effect of a display interface of the sub-conference terminal of the sub-conference 2 when the main conference is in the second conference mode.

In some embodiments, the conference mode switching operation comprises: specifying a specified operation for the sub-conference;

the method further comprises the following steps: and when the main conference is in the first conference mode, determining the first sub-conference according to the specified operation.

In some embodiments, an icon of a sub-conference connected under the main conference can be displayed on a conference control interface of a host of the main conference; the conference mode switching control or the icon of the sub-conference can be used as the control for switching the conference mode, at the moment, the conference mode switching operation is the appointed operation for appointing the first sub-conference at the same time, so that the host of the main conference can realize the control of the conference mode switching of the main conference and the appointing of the first sub-conference through one operation, and the method has the characteristic of simple and convenient operation of the host of the main conference.

In other embodiments, the mode switching operation may further be a voice operation, and the voice content carried by the voice operation may be: when the conference leading right is arbitrarily appointed to be handed to an appointed sub-conference, the same voice operation can realize the conference mode switching of the main conference and the switching of the first sub-conference.

In the second conference mode, the sub-conference does not submit its own sub-conference stream to the main conference for distribution by the main conference unless specified otherwise.

The second conference mode can be divided into two sub-modes, namely a first sub-mode and a second sub-mode, and no sub-conference is called to speak in the first sub-mode; and at least one sub-conference roll-call speech in the second sub-mode. In the first sub-mode, the sub-conference stream recorded by the sub-conference is not required to be submitted to the main conference; in the second sub-mode, the called sub-conference needs to submit the recorded sub-conference stream to the main conference for the main conference to output and/or distribute.

In some embodiments, the method further comprises:

in the second conference mode, when at least one sub-conference is called to speak, receiving a sub-conference stream of the sub-conference called to speak;

and taking the sub-conference stream as an auxiliary part of the main conference stream of the main conference for stream processing.

The auxiliary portion may be a conference interface displayed as a floating window on a main conference interface provided by the main conference stream or a specific area on the main conference interface. In the second conference mode, the sub-conference stream reported by the roll call sub-conference is only an auxiliary part but not a core part, and in the second conference mode, even if the roll call sub-conference reports the sub-conference stream, the main conference stream of the main conference is used as a main part distributed to other sub-conferences or main conference terminals, and the roll call sub-conference also needs to receive a fused conference stream which is sent by the main conference and is based on the conference stream of the main conference and the sub-conference stream of the roll call sub-conference. In the first conference mode, the first sub-conference may not receive any conference stream sent by the main conference, e.g., at least not receive the main conference stream of the main conference.

In one embodiment, in the first conference mode, the number of the sub-conferences corresponding to the first sub-conference may be only 1; while in the second conferencing mode, the named sub-conference may be one or more.

And directly taking the sub conference flow different from the sub conference flow in the first conference mode as a constituent part of the main conference flow after being reported.

Fig. 6B is a schematic diagram illustrating transmission and distribution of audio and video streams (i.e., one of the conference streams) generated by the main conference and the sub-conference in the second conference mode.

Fig. 6C is a schematic diagram illustrating transmission and distribution of audio and video streams generated by the main conference and the sub-conference when the sub-conference 1 is called to speak in the second conference mode.

Fig. 6D is a schematic diagram illustrating transmission and distribution of conference streams generated by the sub-conferences when the main conference is in the first conference mode and the sub-conference 1 is used as the first sub-conference.

In some embodiments, the method further comprises:

In some embodiments, the management authority of the main conference in the first conference mode has at least three processing manners, which are as follows:

the first method is as follows: authorizing a part of or all of the management authority of the host of the main conference to the host of the first sub-conference;

the second method comprises the following steps: the host authority of the main conference is not authorized to the host of the first sub-conference, but the host of the main conference continues to exercise the management authority of the host of the main conference;

the third method comprises the following steps: while continuing to exercise the management authority of the host of the main conference by the host of the main conference, the host of the main conference takes over the management authority of the host of the first sub-conference; in this case, the moderator of the main conference is equivalent to exercising the rights of the moderator of the main conference and the moderator of the first sub-conference simultaneously in the first conference mode of the main conference.

If the first method is adopted, in some embodiments, the at least part of the rights includes at least one of:

creating a right of the second sub-conference;

a permission for mode switching of the master conference;

and calling the right of speaking of the second sub-conference.

At least part of the authority of the host conference moderator is authorized to the moderator of the first sub-conference, so that the host conference moderator can leave temporarily in the process of the conference without tracking the whole conference.

The whole or partial authority of the host of the main conference is granted to the host of the first sub-conference, so that when the first sub-conference is the leading flow of the whole hierarchical conference, the host of the first sub-conference can better control and manage the whole online conference, and the order and the high quality of the conference are ensured.

It is worth noting that: the method further comprises the following steps:

and withdrawing the management authority granted to the host of the first sub-conference based on the authority recovery operation of the host of the main conference.

This permission recovery operation may be performed when the main conference is in any conference mode.

In some embodiments, the method further comprises:

The main conference may allow a sub-conference of the main conference to be created or may prohibit the creation of a sub-conference. In some embodiments, whether the main conference allows creation of a sub-conference of the main conference may be determined according to conference configuration and/or conference attributes of the main conference.

Illustratively, if the main conference is configured as a private conference, the creation of a sub-conference of the main conference is prohibited by default, in which case a special sub-conference creation operation is required to consider that the creation of a sub-conference of the main conference is allowed.

Illustratively, if the conference configuration of the main conference is the default of prohibiting creating the sub-conference of the main conference, the creation of the sub-conference is prohibited by default, and if the conference configuration is the default of permitting creating the sub-conference of the main conference, the creation of the sub-conference of the main conference is permitted.

In summary, in the disclosed embodiments, only when a sub-conference of a main conference is allowed to be created, at least one sub-conference is created based on the main conference in response to a sub-conference creation operation.

And if the sub-conference of the main conference is forbidden to be established, the conference equipment of the main conference receives the sub-conference establishing operation and at least suspends the execution of the sub-conference establishing operation. In some embodiments, the method further comprises at least one of:

when the execution of the sub-conference is refused, outputting a creation failure message;

when the execution of the sub-conference is refused, outputting a reason for refusing to create the sub-conference;

and when the execution of the sub-conference is refused or the creation operation of the sub-conference is suspended, outputting a configuration interface for configuring the sub-conference allowing the creation of the main conference.

If the configuration of the main conference is changed and the changed configuration allows the sub-conference of the main conference to be established, the establishment operation of the executed sub-conference is suspended and is continuously executed, so that the establishment of the sub-conference can be continuously executed without triggering the creation operation of the sub-conference again, and the user operation is simplified.

In some embodiments, when the conference allows creation of a sub-conference of the main conference, creating at least one of the sub-conferences based on the main conference in response to a sub-conference creating operation includes at least one of:

There are various ways to allow creation of a sub-conference of a main conference, and two alternatives are provided above, respectively, a default sub-conference allowing creation of a main conference, and another alternative is: an indication of a moderator of the primary conference is received.

In some embodiments, the sub-conference indicating permission to create the main conference may also be other participants with the administrative rights. For example, when the configuration of the main conference is set to prohibit the sub-conference of the main conference after the sub-conference is created, the host of the first sub-conference or any participant of the main conference or the sub-conference authorized by the host of the main conference may issue permission to the conference device of the main conference to allow the creation of the sub-conference of the main conference.

In the embodiment of the present disclosure, the sub-conference created based on the main conference has an association relationship with the main conference, and the association relationship is recorded in the conference devices of the main conference and/or the sub-conference.

For example, if a main conference has one or more sub-conferences, the conference configuration of the main conference has a sub-conference configuration, and the sub-conference configuration records at least conference identifications of one or more sub-conferences created based on the main conference and/or resource identifications of used conference resources. Illustratively, the sub-conference configuration includes at least: a sub-conference list in which at least a conference Identification (ID) of the sub-conference is recorded.

In other embodiments, the self-meeting configuration may further include: information of a moderator of the sub-conference and/or a communication identification of a communication channel between the main conference and the sub-conference. The communication channel can be used for interacting conference streams between the main conference and the sub-conference and/or conference control instructions. For example, the main conference may send a closing instruction through the communication channel to close a certain sub-conference, and the like.

Likewise, a main conference configuration is also introduced in the conference configuration of the sub-conference, which main conference configuration records at least the conference ID of the main conference of the sub-conference, the moderator of the main conference and/or the channel identification of the communication channel communicating with the main conference.

In another embodiment, since the sub-conference is created based on the main conference, and the conference ID of the sub-conference is created depending on the conference ID of the main conference, when the conference device of the sub-conference can decode the conference ID of the main conference according to the conference ID of the sub-conference managed by the conference device of the sub-conference, the conference configuration of the sub-conference may not include the conference configuration related to the conference ID of the main conference, but in order to ensure communication, at least the communication identifier of the communication channel for communicating with the main conference may be introduced into the conference configuration of the sub-conference.

In some embodiments, the communication channel comprises: a tunnel, the communication identification may include a tunnel identification.

In other embodiments, the communication channel may be a Transmission Control Protocol (TCP) connection including a predetermined bandwidth, and the communication identifier may be a connection identifier of the TCP connection.

If the sub-conference of the main conference is allowed to be created, the sub-conference creation operation may be initiated for any participant of the main conference. Any participant herein includes: the moderator of the main conference and/or other ordinary participants besides the moderator.

In still other embodiments, said creating at least one of said sub-conferences based on said main conference in response to a sub-conference creation operation comprises:

In one embodiment, the sub-conference identification may be divided into at least two parts: the first part is: a conference identifier of a main conference of the sub-conferences; a second part: the main conference assigns a creation sequence number to the sub-conference.

In some embodiments, there may not be any connection symbol between the first part and the second part, but the number of characters occupied by the first part and the second part may be predetermined, so that the device can know the conference identifier of the main conference of the sub-conference by decoding the sub-conference identifier.

In other embodiments, the first portion and the second portion are connected by a specific connection symbol. The connection symbols include, but are not limited to: "-", or "-", etc. In this way, the device can know which part of the sub-conference identifier is the conference identifier belonging to the main conference and which part is the creation serial number of the sub-conference by locating the connection symbol.

Illustratively, the conference identification of the primary conference is: ABC 201203; the sub-conference identifier of the sub-conference of the main conference may be: ABC 201203-01. Here, "-" is the aforementioned connection symbol.

In fig. 2 and fig. 6A to 6D, the conference ID of the main conference is: 3333; and the conference ID of the sub-conference is: 3333 plus the linker "-" plus the number of the sub-conference. Exemplarily, referring to the sub-conference IDs shown in fig. 2, 6A to 6D: 3333-1 and 3333-2.

In some embodiments, a tunnel is created between the main conference and the sub-conference that transports the conference stream. The identification of the tunnel, the conference ID can be directly multiplexed. For example, on the sub-conference 1 side, a Tunnel (Tunnel) between the sub-conference 1 and the main conference is named with the conference ID of the main conference, and thus the Tunnel is identified as 3333 at this time. On the sub-conference 2 side, the tunnel between sub-conference 1 and the main conference is named with the conference ID of the main conference, so the tunnel is now identified as 3333. On the main conference side, the tunnel between sub-conference 1 and the main conference is named with the sub-conference ID of the sub-conference, so the tunnel is now identified as 3333-1, and the tunnel between sub-conference 2 and the main conference is named with the sub-conference ID of the sub-conference, so the tunnel is now identified as 3333-2.

The host of the created sub-conference may default to the creation initiator of the sub-conference, may be specified by the host of the main conference, or may be a participant specified by the creation initiator of the sub-conference.

For example, based on the invitation of the creation initiator of the sub-conference and/or the consent of the required persons, at least one participant of the corresponding sub-conference may be determined.

In one embodiment, the rights authority of the host of the sub-conference can be automatically granted by the conference device, or can be granted based on the host indication of the main conference, or can be granted based on the application of the host of the sub-conference. In summary, the way of granting the administrative authority to the host of the sub-conference is various, and is not illustrated here.

In some embodiments, the administrative rights for the sub-conference include at least one of:

increasing the authority of the participants of the sub-conference;

deleting the authority of the participant of the sub-conference;

appointing the speaking right of the participants of the sub-conference;

forbidding the speaking right of the participants of the sub-conference.

As shown in fig. 7, an embodiment of the present disclosure provides a hierarchical conference processing method, which is applied to a conference device of a first sub-conference of the hierarchical conference, where the hierarchical conference further includes: a main conference; wherein the first sub-conference is created based on the main conference; the method comprises the following steps:

s210: generating a first sub-conference stream of the first sub-conference; the first sub-conference stream includes: an audio stream and/or a video stream of the first sub-conference;

s220: and when the main conference is in a first conference mode, sending the first sub-conference stream to conference equipment of the main conference, wherein the first sub-conference stream is used for treating the conference equipment in the main conference as a main conference stream of the main conference for stream processing.

In the embodiment of the present disclosure, the conference device of the sub-conference may record its own conference stream, and the conference stream is called a sub-conference stream recorded for the sub-conference. In an embodiment of the present disclosure, the first sub-conference may be: any sub-conference that temporarily dominates the conference instead of the main conference is designated when the main conference is in the first conference mode.

In this way, after the first sub-conference stream of the first sub-conference is generated, since the main conference is in the first conference mode, the first sub-conference stream is also submitted to the main conference device of the main conference, and the conference device of the main conference performs stream processing using the first sub-conference stream as the conference stream of the main conference. The stream processing here includes at least: distribution of conference streams and/or output of conference streams.

In some embodiments, if the main conference is in the first conference mode, the main conference stream recorded for the main conference is rejected unless preset. The preset condition here includes at least one of:

the participants of the main conference are called and speak;

the registrant of the main conference instructs to reverse the conference flow of the main conference into the first sub-conference.

In some cases, the method further comprises:

when the main conference is in the first conference mode and participants of the second sub-conference speak, receiving a second sub-conference stream of the second sub-conference forwarded by the main conference; and fusing the received second conference stream of the second sub-conference and the audio and video stream recorded by the first sub-conference to obtain the first sub-conference stream of the first sub-conference.

In some embodiments, it is necessary to ensure time domain alignment when performing conference stream fusion and/or audio-video stream fusion.

In some embodiments, the method further comprises:

merging the first sub-conference stream and the main conference stream;

The second conferencing mode is different from the first conferencing mode, and the second conferencing mode may be a regular mode of the primary conference. In the second conference mode, the dominant conference is the main conference and cannot be a sub conference.

In the embodiment of the present disclosure, if the main conference is in the second conference mode, the first sub-conference needs to receive the main conference stream of the main conference, merge the main conference stream with the first sub-conference stream recorded by the first sub-conference into a conference stream, and then distribute the conference stream to the sub-conference participant devices of the first sub-conference.

In some embodiments, the method further comprises:

If the main conference is in the first conference mode, the host of the first sub-conference grants part or all of the management authority to the whole hierarchical conference by the host of the main conference, so that the host of the first sub-conference can manage the conference in the process of leading the whole hierarchical conference conveniently.

A method for hierarchical conference creation and management is provided below in conjunction with any of the embodiments described above.

The following are enumerated conference scenarios with the need to create a hierarchical conference:

scene 1: in a daily multi-party communication, the lower part of participants are divided into several groups and communicate privately when the speaker speaks.

Scene 2: in an educational training session, a teacher presents a question on a desk, and then groups the following students for discussion, and then individual group speakers answer the question.

Scene 3: in a large performance conference, the conference comprises a main conference place conference and a plurality of branch conference places, and a host conference place host can switch pictures to the branch conference places. In this way, all participants can see the branch-room conference and the conference is hosted by the branch-room host. Finally, the host meeting place host can switch back to the host meeting place or switch to the next branch meeting place.

Therefore, in such several scenarios, it is desirable to be able to provide such conditions also in the network video conference service, which is a so-called "meeting-in-a-meeting" concurrent conference. For convenience of description, the network video conference in such several scenarios is referred to as a main conference, and the created "meeting" is referred to as a sub-conference.

These several conference scenarios have the following characteristics:

1) and (3) parallel conference: the participants are both in the entire hierarchical conference and in the sub-conferences.

2) The moderator of the sub-conference: the host of the sub-conference can manage the sub-conference, thereby realizing the hierarchical management in the large-scale conference and reducing the pressure of the host of the main conference.

3) And (3) conference intercommunication and mutual switching: the main conference and the sub conference can communicate and switch with each other. And after switching to a certain sub-conference, the conference audio and video stream of the conference is the audio and video stream of the sub-conference.

In view of this, the following describes processing methods such as creation and/or management of a hierarchical conference provided by the embodiments of the present disclosure from the viewpoint of conference creation and technical implementation.

Creation of a hierarchical conference:

1 conference (this conference may be a video conference or an audio conference) is created and in this conference, meeting conditions in the conference are selected. Illustratively, default permission conditions, require moderator permission conditions, or prohibit meetings directly. The meeting conditions are the aforementioned conditions that allow the creation of the sub-conference of the main conference.

Allowing: the moderator, and any participant in the conference, can create a sub-conference.

Requiring moderator permission: the moderator can create a sub-conference; when a participant creates a sub-conference, the participant can create the sub-conference after the participant agrees to the sub-conference.

And (3) forbidding: any participant is not allowed to create a sub-conference.

The master conference is created successfully, e.g., the conference ID of the master conference is 3333, and participants A, B, C, D, E and F are invited to join the master conference.

Where A creates a sub-conference (e.g., sub-conference ID 3333-1) and invites B and C to participate, and D creates a sub-conference (e.g., sub-conference ID 3333-2) and invites E to participate.

Moderator assignment for the sub-conference: default to the creator, or specify a participant for that sub-conference at the time of creation.

Moderator function of the sub-conference: the moderator has all administrative rights to the sub-conference, such as calling, speaking, modifying conference layout, adding/kicking people, and switching microphones, etc.

Situation classification of each scene

Grouping discussion: each sub-conference communicates privately.

The sub-conference situation is as follows: for example, A, B, C in the sub-conference in the above example may communicate with each other to obtain audio and video, and receive audio and video of the main conference at the same time, that is, receive 2 conference streams at the same time.

The main conference situation: the audio-video code stream of the sub-conference, such as the sub-conference (3333-1) in the above example, cannot be received.

The view seen by the participants of the main conference (without joining any sub-conferences) is as shown in fig. 5A and

the view seen by the participants of the sub-conference is shown in fig. 5C.

And (3) speaking of the sub-conference: the host of the main conference can roll a certain sub-conference, or the host of the sub-conference applies for speaking and is allowed, so that the audio and video of the sub-conference can be transmitted to all participants.

For the called sub-conference case: and simultaneously receiving the audio and video stream of the main conference and the audio and video stream of the called sub-conference.

The main conference situation: and simultaneously receiving the audio and video stream of the main conference and the audio and video stream of the called sub-conference.

The view seen by the participants of the main conference (without joining any sub-conferences) is shown in fig. 5A:

and (3) conference switching: the host of the main conference can switch the audio and video stream of the conference into the audio and video stream of a certain sub-conference. At this time, the audio and video code stream of the sub-conference can be transmitted to all participants.

The sub-conference situation is as follows: and receiving the audio and video stream of the sub-conference.

The main conference situation: and receiving the audio and video stream of the sub-conference.

The technical implementation steps can include:

a conference creation process:

create a primary conference (e.g., conference ID3333 of the primary conference), invite participants to the conference (e.g., A, B, C, D, E, F and Z), and set up the moderator of the primary conference (e.g., Z).

A sub-conference (e.g., conference ID 3333-1) is created, and participants in the main conference are invited to the conference (e.g., A, B and C, setting a as the moderator of the sub-conference). Next, a Tunnel ID (e.g., Tunnel-3333) is generated from the main conference ID in the participant list in the sub-conference.

When the creation of the sub-conference is completed, the sub-conference is added to the sub-conference list of the main conference in the main conference, and a Tunnel ID (such as Tunnel-3333-1) is set.

Tunneling: as a channel for the interaction of the sub-conference (e.g., Tunnel-3333) and the main conference (e.g., Tunnel-3333-1). The channel contains both signaling and media transmissions.

Another 1 sub-conference (conference ID 3333-2) may be created according to the above steps.

And (3) a conference media interaction process:

case 1 of the conventional mode: the normal mode here may be the aforementioned second conference mode. Case 1 here is: the main conference does not call for any sub-conference to speak.

And (3) main meeting:

receiving: and receiving the audio and video code stream of the main conference terminal of the main conference.

And (3) sending: the audio and video code stream of the main conference is sent to each sub-conference through a Tunnel, for example, the audio and video code stream is sent to a sub-conference 1 (ID 3333-1) through a Tunnel (Tunnel-3333-1); and sending the audio and video code stream of the main conference to terminals (not entering any sub-conference), such as terminals (F and Z).

The participating terminal of the main conference:

and (3) sending: and if the main conference needs, sending the audio and video code stream to the main conference.

Receiving: and receiving the audio and video code stream of the main conference.

And (3) sub-conference:

receiving: receiving audio and video code streams from the main conference (through a tunnel); and receiving the terminal audio and video code stream from the sub-conference.

And (3) sending: sending the audio and video code stream of the conference to a conference terminal in a sub-conference, such as a sub-conference 1 (ID 3333-1), and sending the audio and video code stream of the sub-conference 1 to terminals (A, B and C) in the conference; and forwarding the audio and video code stream from the main conference to all the sub-conference terminals.

The terminal of the sub-conference:

and (3) sending: and sending the audio and video code stream to the sub-conference, such as sending the audio and video code stream to the sub-conference 1 (ID 3333-1) by the terminals (A, B and C).

Receiving: and receiving the audio and video code stream of the sub-conference and the audio and video code stream (forwarded by the sub-conference) of the main conference. For example, the sub-conference 1 (ID 3333-1) fuses and mixes the audio and video code streams of the terminal and sends the audio and video code streams of the sub-conference to the terminals (A, B and C). Meanwhile, the sub-conference 1 (ID 3333-1) forwards the audio and video code stream of the main conference to the terminals (A, B and C).

Case 2 of the normal mode; case 2 here is: and (4) the main conference site names and the sub-conferences speak.

And (3) main meeting:

receiving: receiving an audio and video code stream of a host terminal; and receiving the audio and video code stream of the called sub-conference.

And (3) sending: and sending the received audio and video code streams (after audio mixing and fusion) to each sub-conference through a tunnel, and meanwhile, forwarding the audio and video code streams to other terminals (without entering any sub-conference).

Terminal of the main conference:

Receiving: and receiving the audio and video code stream sent by the main conference.

And (3) sub-conference:

And (3) sending:

the called sub-conference: and sending the audio and video code stream of the sub-conference to the main conference (through the tunnel).

And (4) other sub-conferences: and sending the audio and video code stream of the sub-conference to a terminal of the sub-conference.

The terminal of the sub-conference:

and (3) sending: and sending the audio and video code stream to the sub-conference.

Receiving:

the terminal of the called sub-conference: and receiving the audio and video code stream of the main conference (forwarded by the sub-conference through the tunnel).

Terminals of other sub-conferences: receiving audio and video code streams of the sub-conference; and receiving the audio and video code stream of the main conference (forwarded by the sub-conference through the tunnel).

And (3) switching a conference mode: the conference switching mode here is the aforementioned first conference mode.

And (3) main meeting:

receiving: and receiving the audio and video code stream of the switched sub-conference, and replacing the audio and video code stream of the main conference with the audio and video code stream of the sub-conference.

And (3) sending: and sending the received audio and video code stream to each sub-conference through the tunnel, and meanwhile, forwarding the audio and video code stream to other terminals (not entering any sub-conference).

Terminal of the main conference:

and (3) sending: none.

And (3) sub-conference:

receiving:

switched sub-conference: none.

And (4) other sub-conferences: and receiving the audio and video code stream sent by the main conference.

And (3) sending:

switched sub-conference: and sending the audio and video code stream of the sub-conference to the main conference (through the tunnel).

And (4) other sub-conferences: none.

The terminal of the sub-conference:

Receiving:

the terminal of the switched sub-conference: and receiving the audio and video code stream of the sub-conference.

Terminals of other sub-conferences: receiving audio and video code streams of the sub-conference; and receiving the audio and video code stream of the main conference.

The hierarchical conference provided by the embodiment of the disclosure has the following advantages:

and (3) parallel conference: the terminals do not need to be switched among a plurality of conferences, and the participants are in the whole hierarchical conference and are also in the sub-conference or the main conference at the same time.

The grading and grading management function: the host of the sub-conference can manage the sub-conference, the pressure of the host of the main conference is reduced, and the hierarchical and decentralized management function in the large conference is realized.

And (3) conference intercommunication and mutual switching: the main conference and the sub conference can communicate and switch with each other. And after switching to a certain sub-conference, the conference audio and video stream of the conference is the audio and video stream of the sub-conference.

The stability is stronger: the main conference and the sub-conferences are not necessarily related, and when a problem occurs in the main conference, a problem occurs in a certain sub-conference or a problem occurs between the main conference and a certain sub-conference, the whole conference is not influenced. For example, when a problem occurs in the main conference, the sub-conference can still be held normally; when a problem occurs in a certain sub-conference, the main conference is not affected.

Supporting the holding of ultra-large scale meetings: the sub-conference can share the working pressure of the main conference, such as network bandwidth, CPU resources, media resources, and the like.

Support for managing very large scale meetings: the moderator management effort for the conference grows linearly as participants increase. When reaching a certain scale, the management can not be effectively carried out basically. Therefore, group management of participants is necessary.

As shown in fig. 8, an embodiment of the present disclosure provides a hierarchical conference processing apparatus, which is applied in a conference device of a main conference of a hierarchical conference, where the hierarchical conference further includes: at least one sub-conference created based on the main conference; the device comprises:

a first receiving module 810, configured to receive a first sub-conference stream sent by a first sub-conference in the sub-conferences when the main conference is in a first conference mode; wherein the first sub-conference stream comprises: an audio stream and/or a video stream of the first sub-conference;

a first processing module 820, configured to treat the first sub-conference stream as a main conference stream of the main conference for stream processing, where the main conference stream includes: an audio stream and/or a video stream of the primary conference.

In some embodiments, the first receiving module 810 and the first processing module 820 may be both program modules, which are executed by a processor to implement the above-mentioned operations.

In another embodiment, the first receiving module 810 and the first processing module 820 may be a soft-hard combining module; the soft and hard combining module includes but is not limited to a programmable array.

In yet another embodiment, the first receiving module 810 and the first processing module 820 may both be pure hardware modules; the pure hardware modules include, but are not limited to: an application specific integrated circuit.

In some embodiments, the first processing module 820 is configured to perform at least one of:

In some embodiments, the apparatus further comprises: a control module;

the device further comprises:

In some embodiments, the apparatus further comprises:

In some embodiments, the at least partial rights include at least one of:

creating a right of the second sub-conference;

a permission for mode switching of the master conference;

and calling the right of speaking of the second sub-conference.

In some embodiments, the apparatus further comprises:

In some embodiments, the creating sub-module is configured to perform at least one of:

In some embodiments, the creating sub-module is specifically configured to perform at least one of:

increasing the authority of the participants of the sub-conference;

deleting the authority of the participant of the sub-conference;

appointing the speaking right of the participants of the sub-conference;

forbidding the speaking right of the participants of the sub-conference.

As shown in fig. 9, an embodiment of the present disclosure provides a hierarchical conference processing apparatus, which is applied in a conference device of a first sub-conference of the hierarchical conference, where the hierarchical conference further includes: a main conference; wherein the first sub-conference is created based on the main conference; the device comprises:

a generating module 910, configured to generate a first sub-conference stream of the first sub-conference; the first sub-conference stream includes: an audio stream and/or a video stream of the first sub-conference;

a sending module 920, configured to send the first sub-conference stream to a conference device of the main conference when the main conference is in a first conference mode, where the first sub-conference stream is used for stream processing of a main conference stream regarded as the conference device of the main conference by the conference device of the main conference.

In some embodiments, the generating module 910 and the sending module 920 may be both program modules, which are executed by a processor to implement the above-mentioned operations.

In another embodiment, the generating module 910 and the sending module 920 may be a hardware-software combination module; the soft and hard combining module includes but is not limited to a programmable array.

In yet another embodiment, the generating module 910 and the sending module 920 may both be pure hardware modules; the pure hardware modules include, but are not limited to: an application specific integrated circuit.

In some embodiments, the apparatus further comprises:

The embodiment of the disclosure provides electronic equipment, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for completing mutual communication by the memory through the communication bus; a memory for storing a computer program; and the processor is used for implementing the hierarchical conference processing method provided by any technical scheme when the processor executes the program stored in the memory, and at least can execute the method shown in fig. 1 and/or fig. 7.

The processor may include various types of storage media, non-transitory computer storage media, capable of continuing to remember the information stored thereon after a power loss to the communication device.

Here, the electronic device may include: the conference equipment of the main conference and/or the sub-conference. The conference device may be any form of terminal and/or server.

The processor may be connected to the memory via a bus or the like for reading an executable program stored on the memory, e.g. capable of performing at least one of the methods as shown in any of fig. 1 and/or fig. 3.

The embodiment of the present disclosure provides a computer-readable storage medium, in which a computer program is stored, and the computer program is executed by a processor to implement the hierarchical conference processing method provided in any of the foregoing technical solutions, for example, at least one of the methods shown in any of fig. 1 and/or fig. 3 may be executed.

The computer readable storage medium may be any form of non-transitory storage medium. The computer-readable storage medium may include: optical disks, magnetic disks, removable hard disks and/or U disks, and the like.

In addition to the above-described methods and apparatus, embodiments of the present application may also be a computer program product comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the methods according to the various embodiments of the present application described in the "exemplary methods" section of this specification, above.

The computer program product may be written with program code for performing the operations of embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.

Furthermore, embodiments of the present application may also be a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, cause the processor to perform steps in a method according to various embodiments of the present application described in the "exemplary methods" section above of this specification.

The computer-readable storage medium may take any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The foregoing describes the general principles of the present application in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present application are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present application. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the foregoing disclosure is not intended to be exhaustive or to limit the disclosure to the precise details disclosed.

The block diagrams of devices, apparatuses, systems referred to in this application are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".

It should also be noted that in the devices, apparatuses, and methods of the present application, the components or steps may be decomposed and/or recombined. These decompositions and/or recombinations are to be considered as equivalents of the present application.

The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the application to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims

1. A hierarchical conference processing method, applied to a conference device of a main conference of a hierarchical conference, the hierarchical conference further comprising: at least one sub-conference created based on the main conference; the method comprises the following steps:

when the main conference is in a first conference mode, receiving a first sub-conference stream sent by a first sub-conference in the sub-conferences; wherein the first sub-conference stream comprises: an audio stream and/or a video stream of the first sub-conference, wherein in the first conference mode, the main conference allows one sub-conference to exercise the authority of the main conference;

treating the first sub-conference stream as a main conference stream of the main conference for stream processing, wherein the main conference stream includes: an audio stream and/or a video stream of the main conference, wherein the stream processing by regarding the first sub-conference stream as a main conference stream of the main conference includes: outputting the conference picture of the first sub-conference provided by the first sub-conference stream on the conference interface of the main conference in a full screen manner; or the core part of the conference interface of the main conference is filled by the conference interface of the first sub-conference.

2. The method of claim 1,

the stream processing, which regards the first sub-conference stream as a main conference stream of the main conference, includes at least one of:

3. The method of claim 2, further comprising:

and/or the presence of a gas in the gas,

4. The method of claim 1, wherein the conference mode switching operation comprises: specifying a specified operation for the sub-conference;

the method further comprises the following steps:

5. The method of claim 1, further comprising:

6. The method of claim 5, wherein the at least partial rights comprise at least one of:

creating a right of the second sub-conference;

a permission for mode switching of the master conference;

and calling the right of speaking of the second sub-conference.

7. The method of claim 1, further comprising:

8. The method of claim 7, wherein creating at least one of the sub-conferences based on the main conference in response to a sub-conference creation operation when a conference allows creation of a sub-conference of the main conference comprises at least one of:

9. The method of claim 7 or 8, wherein the creating at least one of the sub-conferences based on the main conference in response to a sub-conference creating operation comprises:

10. The method of claim 9, wherein the administrative rights for the sub-conference comprise at least one of:

increasing the authority of the participants of the sub-conference;

deleting the authority of the participant of the sub-conference;

appointing the speaking right of the participants of the sub-conference;

forbidding the speaking right of the participants of the sub-conference.

11. A hierarchical conference processing method applied to a conference device of a first sub-conference of the hierarchical conference, the hierarchical conference further comprising: a main conference; wherein the first sub-conference is created based on the main conference; the method comprises the following steps:

when the main conference is in a first conference mode, sending the first sub-conference stream to conference equipment of the main conference, wherein the first sub-conference stream is used for stream processing of the conference equipment in the main conference as the main conference stream of the main conference, and in the first conference mode, the main conference allows one sub-conference to exercise the authority of the main conference; the stream processing that the first sub-conference stream is regarded as the main conference stream of the main conference comprises the following steps: outputting the conference picture of the first sub-conference provided by the first sub-conference stream on the conference interface of the main conference in a full screen manner; or the core part of the conference interface of the main conference is filled by the conference interface of the first sub-conference.

12. The method of claim 11, further comprising:

merging the first sub-conference stream and the main conference stream;

13. The method according to claim 11 or 12, characterized in that the method further comprises:

14. A hierarchical conference processing apparatus, applied to a conference device of a main conference of a hierarchical conference, the hierarchical conference further comprising: at least one sub-conference created based on the main conference; the device comprises:

a first receiving module, configured to receive, when the main conference is in a first conference mode, a first sub-conference stream sent by a first sub-conference in the sub-conferences; wherein the first sub-conference stream comprises: an audio stream and/or a video stream of the first sub-conference, wherein in the first conference mode, the main conference allows one sub-conference to exercise the authority of the main conference;

a first processing module, configured to treat the first sub-conference stream as a main conference stream of the main conference for stream processing, where the main conference stream includes: an audio stream and/or a video stream of the main conference, wherein the stream processing by regarding the first sub-conference stream as a main conference stream of the main conference includes: outputting the conference picture of the first sub-conference provided by the first sub-conference stream on the conference interface of the main conference in a full screen manner; or the core part of the conference interface of the main conference is filled by the conference interface of the first sub-conference.

15. A hierarchical conference processing apparatus, applied to a conference device of a first sub-conference of the hierarchical conference, the hierarchical conference further comprising: a main conference; wherein the first sub-conference is created based on the main conference; the device comprises:

a sending module, configured to send the first sub-conference stream to a conference device of the main conference when the main conference is in a first conference mode, where the first sub-conference stream is used for a conference device in the main conference to treat as a main conference stream of the main conference, and in the first conference mode, the main conference allows a sub-conference to exercise a right of the main conference; the stream processing that the first sub-conference stream is regarded as the main conference stream of the main conference comprises the following steps: outputting the conference picture of the first sub-conference provided by the first sub-conference stream on the conference interface of the main conference in a full screen manner; or the core part of the conference interface of the main conference is filled by the conference interface of the first sub-conference.

16. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus; a memory for storing a computer program; a processor for implementing the method steps of any one of claims 1 to 10 or 11 to 13 when executing a program stored in the memory.

17. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 10 or 11 to 13.