CN112995570B

CN112995570B - Information processing method, device, equipment, system and storage medium

Info

Publication number: CN112995570B
Application number: CN201911307953.1A
Authority: CN
Inventors: 刘昱; 陈艾; 周越
Original assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Current assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Priority date: 2019-12-18
Filing date: 2019-12-18
Publication date: 2023-08-01
Anticipated expiration: 2039-12-18
Also published as: CN112995570A

Abstract

The invention discloses an information processing method, an information processing device, information processing equipment, an information processing system and a storage medium, which relate to the technical field of communication and are used for solving the problem of low resource utilization rate. The method comprises the following steps: receiving subscription information of a target video conference sent by MRC; acquiring a target video according to the subscription information; performing screen mixing operation on the target video; and sending the target video after screen mixing to the MCU. The embodiment of the invention can improve the resource utilization rate.

Description

Information processing method, device, equipment, system and storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to an information processing method, apparatus, device, system, and storage medium.

Background

The independent multi-picture subscription process of the terminals such as UE (User Equipment) and the like on the network side is as follows: the UE initiates a multi-picture subscription, and the MRC (media router & resource controller, media route and resource controller) instructs the MCU (multipiont control unit, multipoint control unit) serving the UE to reserve codec mixing resources. After the MCU reserves resources, video subscription is carried out on the MCU of the split pictures to be displayed, and the obtained video is encoded and decoded and mixed with a screen and then the video stream is sent to the terminal. The MCU is composed of MR (media router), DEC (decoder), ENC (encoder), BC (blend center). The process of mixing the video in the MCU is as follows: MR initiates a data routing request to the MCU of the video source, DEC decodes the data while receiving the data, BC performs multi-picture mixing, and ENC performs encoding.

In the existing system, MCU needs to reserve full-quantity encoding and decoding and mixed screen resources for each UE which performs independent multi-picture subscription. For example, when the UE supports a 1 format resolution 25-way picture presentation, the MCU serving it will reserve 27 unit resources for this UE, namely 25-way decoding resources, 1-way mixing screen resources, and 1-way encoding resources. Since the MCU reserves the full amount of coding and decoding resources for each UE independently, the reserved resources of each UE are not overlapped, and the video code stream cannot be reused, so that the resource utilization rate is low.

Disclosure of Invention

The embodiment of the invention provides an information processing method, an information processing device, an information processing system and a storage medium, which are used for solving the problem of low resource utilization rate.

In a first aspect, an embodiment of the present invention provides an information processing method applied to a BBU (buffer and blend unit, buffering and mixing unit), the method including:

receiving subscription information of a target video conference sent by MRC;

acquiring a target video according to the subscription information;

performing screen mixing operation on the target video;

and sending the target video after screen mixing to the MCU.

Wherein, the obtaining the target video according to the subscription information includes:

determining whether the target video is cached according to the subscription information;

Under the condition that the target video is cached, acquiring the cached target video;

and under the condition that the target video is not cached, acquiring the target video from the MCU connected with the BBU.

Wherein after receiving the subscription information of the target video conference sent by the media route and the resource controller MRC, the method further includes:

reserving mixed screen resources according to the subscription information;

the screen mixing operation for the target video comprises the following steps:

and carrying out screen mixing operation on the target video according to the reserved screen mixing resources.

Wherein prior to receiving the media route and subscription information for the target video conference sent by the resource controller MRC, the method further comprises:

receiving address information of an MCU corresponding to the target video conference;

and establishing connection of the MCU corresponding to the target video conference according to the address information of the MCU corresponding to the target video conference.

In a second aspect, an embodiment of the present invention provides an information processing method, applied to MRC, where the method includes:

receiving a subscription request of a terminal to a target video conference;

and according to the subscription request, sending subscription information of the target video conference to the BBU.

Wherein, before the receiving terminal subscribes to the request of the target video conference, the method further comprises:

receiving a conference reservation request of the terminal;

and sending first indication information to the BBU according to the conference reservation request, wherein the first indication information is used for indicating the BBU to establish the connection of the MCU corresponding to the target video conference.

receiving a conference reservation request of the terminal;

and sending second indication information to an MRM (Media Resource Manager ) according to the conference reservation request, wherein the second indication information is used for indicating the MRM to generate the BBU for the target video conference and indicating the BBU to establish connection of the MCU corresponding to the target video conference.

In a third aspect, an embodiment of the present invention provides an information processing method, applied to an MCU, where the method includes:

receiving a video sent by a BBU, wherein the video is obtained after the BBU performs screen mixing operation by using the obtained target video of the target video conference;

decoding the video to obtain a first video;

Encoding the first video to obtain a second video;

and sending the second video to a terminal.

Wherein, before the receiving the video sent by the BBU, the method further comprises at least one of the following steps:

establishing a connection with the BBU;

and sending the video related to the target video conference to the BBU.

In a fourth aspect, an embodiment of the present invention provides an information processing method, applied to an MRM, where the method includes:

receiving second indication information sent by MRC;

generating a BBU for the target video conference according to the second indication information;

and sending third indication information to the BBU, wherein the third indication information is used for indicating the BBU to establish the connection of the MCU corresponding to the target video conference.

In a fifth aspect, an embodiment of the present invention provides an information processing apparatus, applied to a BBU, including:

the first receiving module is used for receiving subscription information of the target video conference sent by the MRC;

the first acquisition module is used for acquiring a target video according to the subscription information;

the screen mixing module is used for carrying out screen mixing operation on the target video;

and the first sending module is used for sending the target video after the screen mixing to the MCU.

Wherein, the first acquisition module includes:

the determining submodule is used for determining whether the target video is cached according to the subscription information;

the first acquisition sub-module is used for acquiring the cached target video under the condition that the target video is cached;

and the second acquisition sub-module is used for acquiring the target video from the MCU connected with the BBU under the condition that the target video is not cached.

Wherein the apparatus further comprises:

the reservation module is used for reserving mixed screen resources according to the subscription information;

the screen mixing module is used for carrying out screen mixing operation on the target video according to the reserved screen mixing resources.

Wherein the apparatus further comprises:

the second receiving module is used for receiving address information of the MCU corresponding to the target video conference;

and the processing module is used for establishing connection of the MCU corresponding to the target video conference according to the address information of the MCU corresponding to the target video conference.

In a sixth aspect, an embodiment of the present invention provides an information processing apparatus, applied to an MRC, including:

the first receiving module is used for receiving a subscription request of the terminal to the target video conference;

And the first sending module is used for sending subscription information of the target video conference to the BBU according to the subscription request.

Wherein the apparatus further comprises:

the second receiving module is used for receiving the conference reservation request of the terminal;

and the second sending module is used for sending first indication information to the BBU according to the conference reservation request, wherein the first indication information is used for indicating the BBU to establish the connection of the MCU corresponding to the target video conference.

Wherein the apparatus further comprises:

the third receiving module is used for receiving the conference reservation request of the terminal;

and the third sending module is used for sending second indicating information to the MRM according to the conference reservation request, wherein the second indicating information is used for indicating the MRM to generate the BBU for the target video conference and indicating the BBU to establish the connection of the MCU corresponding to the target video conference.

In a seventh aspect, an embodiment of the present invention provides an information processing apparatus, applied to an MCU, including:

the first receiving module is used for receiving videos sent by the BBU, wherein the videos are obtained after the BBU performs screen mixing operation by using the obtained target videos of the target video conference;

The decoding module is used for decoding the video to obtain a first video;

the encoding module is used for encoding the first video to obtain a second video;

and the first sending module is used for sending the second video to the terminal.

Wherein the device comprises at least one of the following modules:

the processing module is used for establishing connection with the BBU;

and the second sending module is used for sending the video related to the target video conference to the BBU.

In an eighth aspect, an embodiment of the present invention provides an information processing apparatus, applied to an MRM, including:

the first receiving module is used for receiving the second indication information sent by the MRC;

the generation module is used for generating a BBU for the target video conference according to the second indication information;

the first sending module is used for sending third indication information to the BBU, wherein the third indication information is used for indicating the BBU to establish the connection of the MCU corresponding to the target video conference.

In a ninth aspect, an embodiment of the present invention provides an information processing apparatus, applied to a BBU, including: a processor and a transceiver;

the transceiver is used for receiving subscription information of the target video conference sent by the MRC;

The processor is used for acquiring a target video according to the subscription information; performing screen mixing operation on the target video;

the transceiver is also used for sending the target video after screen mixing to the MCU.

The processor is further configured to determine, according to the subscription information, whether the target video is cached; under the condition that the target video is cached, acquiring the cached target video; and under the condition that the target video is not cached, acquiring the target video from the MCU connected with the BBU.

The processor is further used for reserving mixed screen resources according to the subscription information;

The transceiver is further used for receiving address information of the MCU corresponding to the target video conference;

the processor is further used for establishing connection of the MCU corresponding to the target video conference according to the address information of the MCU corresponding to the target video conference.

In a tenth aspect, an embodiment of the present invention provides an information processing apparatus applied to an MRC, including: a processor and a transceiver;

the transceiver is used for receiving a subscription request of the terminal to the target video conference; and according to the subscription request, sending subscription information of the target video conference to the BBU.

The transceiver is further used for receiving a conference reservation request of the terminal; and sending first indication information to the BBU according to the conference reservation request, wherein the first indication information is used for indicating the BBU to establish the connection of the MCU corresponding to the target video conference.

The transceiver is further used for receiving a conference reservation request of the terminal; and sending second indication information to an MRM according to the conference reservation request, wherein the second indication information is used for indicating the MRM to generate the BBU for the target video conference and indicating the BBU to establish connection of the MCU corresponding to the target video conference.

In an eleventh aspect, an embodiment of the present invention provides an information processing apparatus, applied to an MCU, including: a processor and a transceiver;

the transceiver is used for receiving videos sent by the BBU, wherein the videos are obtained after the BBU performs screen mixing operation by using the obtained target videos of the target video conference;

the processor is used for decoding the video to obtain a first video; encoding the first video to obtain a second video;

the transceiver is further configured to send the second video to a terminal.

Wherein the processor is further configured to perform at least one of the following steps:

establishing a connection with the BBU;

and sending the video related to the target video conference to the BBU.

In a twelfth aspect, an embodiment of the present invention provides an information processing apparatus, applied to an MRM, including: a processor and a transceiver;

the transceiver is used for receiving second indication information sent by the MRC;

the processor is used for generating a BBU for the target video conference according to the second indication information;

the transceiver is further configured to send third indication information to the BBU, where the third indication information is used to instruct the BBU to establish a connection with an MCU corresponding to the target video conference.

In a thirteenth aspect, an embodiment of the present invention provides an information processing system, including: MRC, BBU and MCU;

the MRC is used for receiving a subscription request of a terminal for a target video conference and sending subscription information for the target video conference to the BBU according to the subscription request;

the BBU is used for receiving the subscription information of the target video conference sent by the MRC; acquiring a target video according to the subscription information; performing screen mixing operation on the target video; transmitting the target video after screen mixing to the MCU;

The MCU is used for receiving the target video after screen mixing sent by the BBU, and decoding the target video to obtain a first video; encoding the first video to obtain a second video; and sending the second video to a terminal.

Wherein the system further comprises: MRM;

the MRM is used for receiving the second indication information sent by the MRC, generating the BBU for the target video conference according to the second indication information, and sending third indication information to the BBU, wherein the third indication information is used for indicating the BBU to establish connection of the MCU corresponding to the target video conference.

In a fourteenth aspect, an embodiment of the present invention provides a communication device, including: a transceiver, a memory, a processor, and a program stored on the memory and executable on the processor;

the processor is configured to read a program in the memory to implement the steps in the method as described in any of the previous aspects.

In a fifteenth aspect, embodiments of the present invention provide a computer readable storage medium storing a computer program which, when executed by a processor, performs steps in a method as described in any of the preceding aspects.

In the embodiment of the invention, BBU carries out screen mixing operation on the obtained target video of the target video conference, and sends the video after screen mixing to MCU. Therefore, the mixed screen video obtained by the BBU can be provided for a plurality of MCUs connected with the BBU, so that the recycling of resources is realized, and the utilization rate of the resources is improved by utilizing the scheme of the embodiment of the invention.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments of the present invention will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.

FIG. 1 is a schematic diagram of an information handling system according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a second embodiment of an information processing system;

FIG. 3 is one of the flowcharts of the information processing method provided by the embodiment of the present invention;

FIG. 4 is a second flowchart of an information processing method according to an embodiment of the present invention;

FIG. 5 is a third flowchart of an information processing method according to an embodiment of the present invention;

FIG. 6 is a flowchart of a method for processing information according to an embodiment of the present invention;

fig. 7 is a flowchart of a conference reservation processing method provided in an embodiment of the present invention;

FIG. 8 is a flow chart of an independent multi-screen subscription and processing provided by an embodiment of the present invention;

fig. 9 is one of the block diagrams of the information processing apparatus provided by the embodiment of the present invention;

FIG. 10 is a second block diagram of an information processing apparatus according to an embodiment of the present invention;

FIG. 11 is a third configuration diagram of an information processing apparatus according to an embodiment of the present invention;

FIG. 12 is a diagram showing a structure of an information processing apparatus according to an embodiment of the present invention;

FIG. 13 is a fifth block diagram of an information processing apparatus according to an embodiment of the present invention;

FIG. 14 is a sixth block diagram of an information processing apparatus provided by an embodiment of the present invention;

FIG. 15 is a seventh configuration diagram of an information processing apparatus according to an embodiment of the present invention;

FIG. 16 is a diagram showing a structure of an information processing apparatus according to an embodiment of the present invention;

FIG. 17 is one of the block diagrams of the communication device provided by the embodiment of the invention;

FIG. 18 is a second block diagram of a communication device according to an embodiment of the present invention;

FIG. 19 is a third block diagram of a communication device provided in accordance with an embodiment of the present invention;

Fig. 20 is a diagram showing a structure of a communication device according to an embodiment of the present invention.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

Referring to fig. 1, fig. 1 is a schematic diagram of an information processing system according to an embodiment of the present invention. As shown in fig. 1, the system may include: MRC101, BBU102, and MCU103;

the MRC101 is configured to receive a subscription request of a terminal for a target video conference, and send subscription information for the target video conference to the BBU102 according to the subscription request; the BBU102 is configured to receive subscription information of the target video conference sent by the MRC; acquiring a target video according to the subscription information; performing screen mixing operation on the target video; and sending the target video after screen mixing to the MCU. The MCU103 is configured to receive the mixed video sent by the BBU, encode the mixed target video, and send the encoded video to a terminal.

Optionally, referring to fig. 2, the system may further include: MRM104 is configured to receive the second indication information sent by the MRC, generate the BBU for the target video conference according to the second indication information, and send third indication information to the BBU, where the third indication information is used to instruct the BBU to establish a connection with an MCU corresponding to the target video conference.

Specifically, in connection with the system shown in fig. 2, the system may be divided into a control layer, a processing layer, and an access layer. Wherein the control layer comprises MRC. MRC is the master controller, managing each BBU. The processing layer comprises an MRM (multicast management module) and is used for generating the BBU and indicating the BBU to perform routing and screen mixing processing. The access layer comprises an MCU for encoding and decoding. The MRM is used for dynamically instantiating BBUs, and each BBU is responsible for all mixed screens of a conference (including unified live mixed screens and independent multi-picture mixed screens).

The BBU can be generated by dynamic instantiation of the MRM, or can be pre-established. In the case where the BBU is pre-established, the BBU may act as a processing layer. The BBU includes an MR (media router), a buffer (buffer), and a BC (Blend Center), where the MR is used for media routing, the buffer is used for buffering, and the memory is managed, and the BC is used for performing the Blend operation. The MCU supports multiplexing the existing MCU software and hardware functions, but does not need to carry out screen mixing operation. The MCU contains MR, DEC, ENC, where MR is used for media routing, DEC is used for decoding, and ENC is used for encoding.

In the system of the embodiment of the invention, the encoding and decoding of the existing MCU are separated from the screen mixing function, so that in the multi-picture video processing, the MCU only carries out the encoding and decoding and routing of the uplink and downlink media, and the BBU only carries out the screen mixing, thus the MCU does not need to carry out the full resource reservation of the screen mixing and the full media surface routing.

Referring to fig. 3, fig. 3 is a flowchart of an information processing method provided by an embodiment of the present invention, applied to a BBU, as shown in fig. 3, including the following steps:

step 301, receiving subscription information of a target video conference sent by the MRC.

After receiving an independent multi-picture subscription request sent by a terminal for a target video conference, the MRC sends subscription information to the BBU, wherein the subscription information can comprise the identification, the number and the like of subscribed pictures.

And 302, acquiring a target video according to the subscription information.

Wherein the target video is a related video of the target video conference. In the embodiment of the invention, the BBU can determine whether the target video is cached according to the subscription information. Under the condition that the target video is cached, acquiring the cached target video; and under the condition that the target video is not cached, acquiring the target video from the MCU connected with the BBU.

And 303, performing screen mixing operation on the target video.

The screen mixing operation refers to a process of synthesizing multiple video streams into one video stream. And for the obtained target video, the BBU performs screen mixing operation on the target video.

And step 304, transmitting the target video after screen mixing to the MCU.

The MCU is the MCU which provides service for the terminal currently.

On the basis of the above embodiment, to ensure the efficiency and success of performing the screen mixing operation, before step 301, the method further includes: and reserving mixed screen resources according to the subscription information. Then step 303 may specifically be to perform a mixing operation on the target video according to the reserved mixing resources.

In order to accurately send the video after screen mixing to the MCU, the BBU can also receive the address information of the MCU corresponding to the target video conference, and establish connection with the MCU corresponding to the target video conference according to the address information of the MCU corresponding to the target video conference. The MCU corresponding to the target video conference may refer to an MCU connected to the BBU, and information of the MCUs is allocated by the MRC.

In the embodiment of the invention, the BBU can be pre-established, and can also be generated by the MRM according to the request of the MRC. Therefore, the BBU can directly acquire the address information of the MCU corresponding to the target video conference from the MRC, and can also acquire the address information of the MCU corresponding to the target video conference from the MRM.

Referring to fig. 4, fig. 4 is a flowchart of an information processing method according to an embodiment of the present invention, which is applied to MRC, and as shown in fig. 4, includes the following steps:

step 401, receiving a subscription request of a terminal to a target video conference.

Step 402, according to the subscription request, subscription information of the target video conference is sent to a BBU.

Optionally, on the basis of the above embodiment, the MRC may further receive a conference reservation request of the terminal. And according to the conference reservation request, the MRC can allocate an accessed MCU for the terminal. In the allocation process, MRC may use multiple allocation modes such as nearby allocation, cluster allocation, and the like. And if the BBU is already established, the MRC sends first indication information to the BBU according to the conference reservation request, wherein the first indication information is used for indicating the BBU to establish the connection of the MCU corresponding to the target video conference. The first indication information may include address information of an MCU corresponding to the target video conference, and the like. If the BBU is not established, after receiving the conference reservation request, the MRC sends second indication information to the MRM, wherein the second indication information is used for indicating the MRM to generate the BBU for the target video conference and indicating the BBU to establish the connection of the MCU corresponding to the target video conference. The second indication information can include conference capacity, number of subscribers who subscribe to independent multi-pictures, MCU address and other conference information.

Referring to fig. 5, fig. 5 is a flowchart of an information processing method according to an embodiment of the present invention, which is applied to an MCU, and as shown in fig. 5, includes the following steps:

step 501, receiving a video sent by a BBU, wherein the video is obtained after the BBU performs screen mixing operation by using the obtained target video of the target video conference.

Step 502, decoding the video to obtain a first video.

Step 503, encoding the first video to obtain a second video.

Step 504, sending the second video to a terminal.

Optionally, on the basis of the above embodiment, before step 501, the method may further include any one of the following steps: establishing a connection with the BBU; and sending the video related to the target video conference to the BBU. The MCU can send the video related to the target video conference to the BBU according to the request of the BBU.

The encoding and decoding modes are not limited in the embodiment of the present invention.

Referring to fig. 6, fig. 6 is a flowchart of an information processing method according to an embodiment of the present invention, applied to an MCU, as shown in fig. 6, including the steps of:

step 601, receiving second indication information sent by the MRC. The second indication information can include conference capacity, number of subscribers who subscribe to independent multi-pictures, MCU address and other conference information.

Step 602, generating a BBU for the target video conference according to the second indication information.

Specifically, the MRM generates the BBU according to conference information such as conference capacity, number of subscribers subscribing to independent multiple pictures, and the like.

Step 603, sending third indication information to the BBU, where the third indication information is used to instruct the BBU to establish a connection with an MCU corresponding to the target video conference.

And the BBU establishes connection with each MCU of the target video conference according to the MCU address information issued by the MRM.

The flow of the information processing method according to the embodiment of the present invention will be described with reference to the systems shown in fig. 1 and 2.

Referring to fig. 7, fig. 7 is a flowchart of a conference reservation processing method according to an embodiment of the present invention, as shown in fig. 7, including the steps of:

and 701, the terminal sends a conference reservation request to the MRC to request access to the MRC.

In step 702, the MRC allocates an accessed MCU for each UE.

At the time of allocation, MRC may allocate based on the principles of nearby allocation, cluster allocation, etc.

Step 703, the MRC instructs the MRM to generate a BBU for the conference, where the BBU carries conference information, such as conference capacity, number of subscribers subscribing to multiple independent pictures, MCU address, etc., for the conference to perform screen mixing processing (including unified live broadcast screen mixing and independent multi-picture screen mixing).

Step 704, the MRM generates a BBU according to the conference capacity, the number of independent multi-picture subscribers, and other conference information, that is, instantiates the BBU, and meanwhile carries address information of the MCU related to the conference.

And step 705, the BBU establishes connection with each MCU of the conference according to the address information of the MCU issued by the MRM.

The BBU caches the video resources of the MCU or timely stores or manages the memory to the buffer.

Referring to fig. 8, fig. 8 is a flowchart of an independent multi-screen subscription and processing according to an embodiment of the present invention, as shown in fig. 8, including the following steps:

step 801, the terminal initiates an independent multi-picture subscription request to the MRC.

Step 802, the MRC instructs the BBU to reserve the mixed screen resources and carry subscription information.

And 803, the MRC indicates the MCU serving the terminal to reserve the coding resource.

Wherein steps 802 and 803 are not strictly sequential.

Step 804, the MRC instructs the BBU to perform multi-path video subscription and screen mixing.

Step 805, BC in BBU obtains the required or subscribed video from buffer. If the buffer does not have the corresponding video, the buffer acquires the acquired video from the corresponding MCU.

Step 806, the BU of the BBU performs screen mixing and issues to the MCU serving the terminal.

And step 807, after encoding the MCU serving the terminal, the mixed screen video is sent to the UE.

As can be seen from the above description, according to the embodiment of the present invention, multiparty independent multi-picture subscription and processing can be performed in a video conference system with mixed screens at the network side. On the one hand, in the embodiment of the invention, multiplexing of the mixed screen video is supported, the MCU is not required to carry out full-scale encoding and decoding and mixed screen resource reservation, the resource utilization rate of the MCU or BBU is improved, and a single BBU can support more paths of UE to carry out independent multi-picture subscription. On the other hand, in the embodiment of the invention, the mixed screen processing is uniformly executed by the BBU, and the MCU is not required to carry out full Mesh routing, thereby reducing the routing complexity of the MCU.

Suppose that a single MCU of a current network manufacturer has 512 paths of forwarding interfaces and 192 units of processing resources, and suppose that BBU multiplexes MCU resources.

If the traditional networking scheme is utilized, every 1 terminal capable of displaying 25 paths of pictures for independent multi-picture subscription is newly added, 25 units of decoding +1 units of synthesizing +1 units of encoding = 27 units of processing resource reservation is needed to be carried out on the MCU, namely, each MCU can only carry out independent multi-picture subscription for 192/27 about 7 UE.

By using the scheme of the embodiment of the invention, every 1 terminal capable of displaying 25 paths of pictures for independent multi-picture subscription is newly added, 1 unit coding is needed to be carried out on MCU, 1 unit synthesis is needed to be carried out on BBU, and 2 unit processing resource reservation is needed. If each MCU accesses 100 terminals, a single MCU supports independent multi-picture subscription for 192 (total) -100 (decoding of maximum number of uploaded videos) -1 (live mixed screen encoding) =91 UEs.

Through the comparison, the resource utilization rate of the MCU or the BBU is improved by utilizing the scheme of the embodiment of the invention.

The embodiment of the invention also provides an information processing device which is applied to the BBU. Referring to fig. 9, fig. 9 is a block diagram of an information processing apparatus provided in an embodiment of the present invention. Since the principle of solving the problem of the information processing apparatus is similar to that of the information processing method in the embodiment of the present invention, the implementation of the information processing apparatus can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 9, the information processing apparatus 900 includes:

a first receiving module 901, configured to receive subscription information of a target video conference sent by an MRC; a first obtaining module 902, configured to obtain a target video according to the subscription information; the screen mixing module 903 is configured to perform a screen mixing operation on the target video; and the first sending module 904 is configured to send the mixed target video to the MCU.

Wherein, the first obtaining module 901 includes:

the determining submodule is used for determining whether the target video is cached according to the subscription information; the first acquisition sub-module is used for acquiring the cached target video under the condition that the target video is cached; and the second acquisition sub-module is used for acquiring the target video from the MCU connected with the BBU under the condition that the target video is not cached.

Wherein the apparatus further comprises:

The device provided by the embodiment of the present invention may execute the above method embodiment, and its implementation principle and technical effects are similar, and this embodiment will not be described herein.

The embodiment of the invention also provides an information processing device which is applied to MRC. Referring to fig. 10, fig. 10 is a block diagram of an information processing apparatus provided in an embodiment of the present invention. Since the principle of solving the problem of the information processing apparatus is similar to that of the information processing method in the embodiment of the present invention, the implementation of the information processing apparatus can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 10, the information processing apparatus 1000 includes:

a first receiving module 1001, configured to receive a subscription request of a terminal to a target video conference; and a first sending module 1002, configured to send, to a BBU, subscription information for the target video conference according to the subscription request.

Wherein the apparatus further comprises:

The embodiment of the invention also provides an information processing device which is applied to the MCU. Referring to fig. 11, fig. 11 is a block diagram of an information processing apparatus provided in an embodiment of the present invention. Since the principle of solving the problem of the information processing apparatus is similar to that of the information processing method in the embodiment of the present invention, the implementation of the information processing apparatus can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 11, the information processing apparatus 1100 includes:

a first receiving module 1101, configured to receive a video sent by a BBU, where the video is obtained after performing a screen mixing operation by using an obtained target video of a target video conference by the BBU; a decoding module 1102, configured to decode the video to obtain a first video; an encoding module 1103, configured to encode the first video to obtain a second video; a first sending module 1104 is configured to send the second video to a terminal.

Wherein the apparatus may further comprise at least one of the following modules:

the processing module is used for establishing connection with the BBU;

The embodiment of the invention also provides an information processing device which is applied to the MRM. Referring to fig. 12, fig. 12 is a block diagram of an information processing apparatus provided in an embodiment of the present invention. Since the principle of solving the problem of the information processing apparatus is similar to that of the information processing method in the embodiment of the present invention, the implementation of the information processing apparatus can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 12, the information processing apparatus 1200 includes:

a first receiving module 1201, configured to receive second indication information sent by the MRC; a generating module 1202, configured to generate a BBU for a target video conference according to the second indication information; a first sending module 1203 is configured to send third indication information to the BBU, where the third indication information is used to instruct the BBU to establish a connection with an MCU corresponding to the target video conference.

The embodiment of the invention also provides an information processing device which is applied to the BBU. Referring to fig. 13, fig. 13 is a block diagram of an information processing apparatus provided in an embodiment of the present invention. Since the principle of solving the problem of the information processing apparatus is similar to that of the information processing method in the embodiment of the present invention, the implementation of the information processing apparatus can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 13, the information processing apparatus includes: a processor 1301 and a transceiver 1302;

the transceiver 1302 is configured to receive subscription information of a target video conference sent by an MRC;

the processor 1301 is configured to obtain a target video according to the subscription information; performing screen mixing operation on the target video;

the transceiver 1302 is further configured to send the mixed target video to the MCU.

The processor 1301 is further configured to reserve a mixed screen resource according to the subscription information;

The transceiver 1302 is further configured to receive address information of an MCU corresponding to the target video conference;

the processor 1301 is further configured to establish connection with an MCU corresponding to the target video conference according to address information of the MCU corresponding to the target video conference.

The embodiment of the invention also provides an information processing device which is applied to MRC. Referring to fig. 14, fig. 14 is a block diagram of an information processing apparatus provided in an embodiment of the present invention. Since the principle of solving the problem of the information processing apparatus is similar to that of the information processing method in the embodiment of the present invention, the implementation of the information processing apparatus can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 14, the information processing apparatus includes: a processor 1401 and a transceiver 1402;

the transceiver 1401 is configured to receive a subscription request of a terminal to a target video conference; and according to the subscription request, sending subscription information of the target video conference to the BBU.

Wherein the transceiver 1401 is further configured to receive a conference reservation request of the terminal; and sending first indication information to the BBU according to the conference reservation request, wherein the first indication information is used for indicating the BBU to establish the connection of the MCU corresponding to the target video conference.

Wherein the transceiver 1401 is further configured to receive a conference reservation request of the terminal; and sending second indication information to an MRM according to the conference reservation request, wherein the second indication information is used for indicating the MRM to generate the BBU for the target video conference and indicating the BBU to establish connection of the MCU corresponding to the target video conference.

The embodiment of the invention also provides an information processing device which is applied to the MCU. Referring to fig. 15, fig. 15 is a block diagram of an information processing apparatus provided in an embodiment of the present invention. Since the principle of solving the problem of the information processing apparatus is similar to that of the information processing method in the embodiment of the present invention, the implementation of the information processing apparatus can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 15, the information processing apparatus includes: a processor 1501 and a transceiver 1502;

the transceiver 1502 is configured to receive a video sent by a BBU, where the video is obtained after the BBU performs a screen mixing operation using an obtained target video of a target video conference;

the processor 1501 is configured to decode the video to obtain a first video; encoding the first video to obtain a second video;

the transceiver 1502 is further configured to send the second video to a terminal.

Wherein the processor 1501 is further configured to perform at least one of the following:

establishing a connection with the BBU;

and sending the video related to the target video conference to the BBU.

The embodiment of the invention also provides an information processing device which is applied to the MRM. Referring to fig. 16, fig. 16 is a block diagram of an information processing apparatus provided in an embodiment of the present invention. Since the principle of solving the problem of the information processing apparatus is similar to that of the information processing method in the embodiment of the present invention, the implementation of the information processing apparatus can refer to the implementation of the method, and the repetition is omitted.

As shown in fig. 16, the information processing apparatus includes: a processor 1601 and a transceiver 1602;

the transceiver 1602 is configured to receive second indication information sent by the MRC;

the processor 1601 is configured to generate a BBU for a target video conference according to the second indication information;

the transceiver 1602 is further configured to send third indication information to the BBU, where the third indication information is used to instruct the BBU to establish a connection with an MCU corresponding to the target video conference.

As shown in fig. 17, the communication device of the embodiment of the present invention is applied to a BBU, and includes: the processor 1700 is configured to read a program in the memory 1720, and execute the following procedures:

receiving subscription information of a target video conference sent by MRC;

acquiring a target video according to the subscription information;

performing screen mixing operation on the target video;

and sending the target video after screen mixing to the MCU.

A transceiver 1710 for receiving and transmitting data under the control of the processor 1700.

Wherein in fig. 17, a bus architecture may comprise any number of interconnected buses and bridges, and in particular one or more processors represented by processor 1700 and various circuits of memory represented by memory 1720. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides an interface. The transceiver 1710 may be a number of elements, including a transmitter and a transceiver, providing a means for communicating with various other apparatus over a transmission medium. The processor 1700 is responsible for managing the bus architecture and general processing, and the memory 1720 may store data used by the processor 1700 in performing operations.

The processor 1700 is responsible for managing the bus architecture and general processing, and the memory 1720 may store data used by the processor 1700 in performing operations.

The processor 1700 is also configured to read the program, and perform the following steps:

reserving mixed screen resources according to the subscription information;

the screen mixing operation for the target video comprises the following steps:

As shown in fig. 18, the communication device according to the embodiment of the present invention is applied to MRC, and includes: processor 1800, for reading the program in memory 1820, performs the following processes:

Receiving a subscription request of a terminal to a target video conference;

A transceiver 1810 for receiving and transmitting data under the control of the processor 1800.

Wherein in fig. 18, a bus architecture may comprise any number of interconnected buses and bridges, and in particular one or more processors represented by the processor 1800 and various circuits of the memory, represented by the memory 1820. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides an interface. The transceiver 1810 may be a number of elements, including a transmitter and a transceiver, providing a means for communicating with various other apparatus over a transmission medium. The processor 1800 is responsible for managing the bus architecture and general processing, with the memory 1820 storing data used by the processor 1800 in performing operations.

The processor 1800 is responsible for managing the bus architecture and general processing, with the memory 1820 storing data used by the processor 1800 in performing operations.

The processor 1800 is also configured to read the program and perform the following steps:

receiving a conference reservation request of the terminal;

and sending second indication information to an MRM according to the conference reservation request, wherein the second indication information is used for indicating the MRM to generate the BBU for the target video conference and indicating the BBU to establish connection of the MCU corresponding to the target video conference.

As shown in fig. 19, the communication device according to the embodiment of the present invention is applied to an MCU, and includes: processor 1900, for reading the program in memory 1920, performs the following process:

decoding the video to obtain a first video;

encoding the first video to obtain a second video;

and sending the second video to a terminal.

A transceiver 1910 for receiving and transmitting data under the control of the processor 1900.

Wherein in FIG. 19, a bus architecture may comprise any number of interconnected buses and bridges, and in particular one or more processors represented by processor 1900 and various circuits of memory, represented by memory 1920, linked together. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides an interface. The transceiver 1910 may be a number of elements, including a transmitter and a transceiver, providing a means for communicating with various other apparatus over a transmission medium. The processor 1900 is responsible for managing the bus architecture and general processing, and the memory 1920 may store data used by the processor 1900 in performing operations.

The processor 1900 is responsible for managing the bus architecture and general processing, and the memory 1920 may store data used by the processor 1900 in performing operations.

Processor 1900 is also configured to read the program, and perform the following steps:

establishing a connection with the BBU;

and sending the video related to the target video conference to the BBU.

As shown in fig. 20, the communication device according to the embodiment of the present invention is applied to an MRM, and includes: the processor 2000, configured to read the program in the memory 2020, performs the following procedures:

receiving second indication information sent by MRC;

A transceiver 2010 for receiving and transmitting data under the control of the processor 2000.

Wherein in fig. 20, a bus architecture may comprise any number of interconnected buses and bridges, and in particular one or more processors represented by the processor 2000 and various circuits of memory represented by the memory 2020. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides an interface. The transceiver 2010 may be a plurality of elements, i.e., include a transmitter and a transceiver, providing a means for communicating with various other apparatus over a transmission medium. The processor 2000 is responsible for managing the bus architecture and general processing, and the memory 2020 may store data used by the processor 2000 in performing operations.

The processor 2000 is responsible for managing the bus architecture and general processing, and the memory 2020 may store data used by the processor 2000 in performing operations.

The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the processes of the above-described information processing method embodiment, and can achieve the same technical effects, so that repetition is avoided, and no further description is given here. Wherein the computer readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. In light of such understanding, the technical solutions of the present invention may be embodied essentially or in part in the form of a software product stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a cell phone, computer, server, air conditioner, or network device, etc.) to perform the methods described in the various embodiments of the present invention.

The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.

Claims

1. An information processing method applied to a buffering and mixing unit BBU, characterized in that it comprises:

receiving subscription information of a target video conference sent by a media route and a resource controller MRC;

acquiring a target video according to the subscription information;

performing screen mixing operation on the target video;

transmitting the target video after screen mixing to a multipoint control unit MCU;

the multi-point control unit MCU comprises at least two multi-point control units MCU, the at least two multi-point control units MCU are connected with the buffering and screen mixing unit BBU, and the buffering and screen mixing unit BBU is generated by the media resource manager MRM for the target video conference according to the received media route and second indication information sent by the resource controller MRC.

2. The method of claim 1, wherein the obtaining the target video according to the subscription information comprises:

and under the condition that the target video is not cached, acquiring the target video from a multipoint control unit MCU connected with the buffering and mixing unit BBU.

3. The method of claim 1, wherein after receiving subscription information for the target video conference sent by the media route and resource controller MRC, the method further comprises:

reserving mixed screen resources according to the subscription information;

the screen mixing operation for the target video comprises the following steps:

4. The method of claim 1, wherein prior to receiving subscription information for the target video conference sent by the media route and resource controller MRC, the method further comprises:

receiving address information of a multipoint control unit MCU corresponding to the target video conference;

and establishing connection of the multipoint control unit MCU corresponding to the target video conference according to the address information of the multipoint control unit MCU corresponding to the target video conference.

5. An information processing method applied to media routing and resource controller MRC, characterized in that the method comprises:

receiving a subscription request of a terminal to a target video conference;

according to the subscription request, subscription information of the target video conference is sent to a buffering and mixing unit BBU;

Before the receiving the subscription request of the terminal to the target video conference, the method further comprises:

receiving a conference reservation request of the terminal;

sending second indication information to a media resource manager MRM according to the conference reservation request, wherein the second indication information is used for indicating the media resource manager MRM to generate the buffering and mixing screen unit BBU for the target video conference and indicating the buffering and mixing screen unit BBU to establish connection of a multipoint control unit MCU corresponding to the target video conference,

the multi-point control unit MCU comprises at least two multi-point control units MCU, and the buffering and mixing unit BBU performs mixing operation on the target video; and the buffering and mixing unit BBU sends the mixed target video to the multipoint control unit MCU.

6. The method of claim 5, wherein prior to receiving the terminal subscription request for the target videoconference, the method further comprises:

receiving a conference reservation request of the terminal;

and according to the conference reservation request, sending first indication information to the buffering and mixing unit BBU, wherein the first indication information is used for indicating the buffering and mixing unit BBU to establish connection of the multipoint control unit MCU corresponding to the target video conference.

7. An information processing method applied to a multipoint control unit MCU, the method comprising:

receiving a video sent by a buffering and mixing unit BBU, wherein the video is obtained after the buffering and mixing unit BBU performs mixing operation by using the obtained target video of the target video conference;

decoding the video to obtain a first video;

encoding the first video to obtain a second video;

sending the second video to a terminal;

8. The method according to claim 7, characterized in that before said receiving the video transmitted by the buffering and mixing unit BBU, the method further comprises at least one of the following steps:

establishing connection with the buffering and mixing unit BBU;

and sending the video related to the target video conference to the buffering and mixing unit BBU.

9. An information processing method applied to a media resource manager MRM, the method comprising:

receiving second indication information sent by a media route and a resource controller MRC;

generating a buffering and screen mixing unit BBU for the target video conference according to the second indication information;

sending third indication information to the buffering and mixing unit BBU, wherein the third indication information is used for indicating the buffering and mixing unit BBU to establish the connection of the multipoint control unit MCU corresponding to the target video conference,

10. An information processing apparatus applied to a buffering and mixing unit BBU, characterized in that it comprises:

the first receiving module is used for receiving the media route and subscription information of the target video conference sent by the resource controller MRC;

The first sending module is used for sending the target video after screen mixing to the multipoint control unit MCU;

11. An information processing apparatus for use in a media routing and resource controller MRC, the apparatus comprising:

the first sending module is used for sending subscription information of the target video conference to the buffering and mixing screen unit BBU according to the subscription request;

a third sending module, configured to send second indication information to a media resource manager MRM according to the conference reservation request, where the second indication information is configured to instruct the media resource manager MRM to generate the buffering and mixing unit BBU for the target video conference, and instruct the buffering and mixing unit BBU to establish connection with a multipoint control unit MCU corresponding to the target video conference,

12. An information processing apparatus applied to a multipoint control unit MCU, the apparatus comprising:

the first receiving module is used for receiving the video sent by the buffering and mixing unit BBU, wherein the video is obtained after the buffering and mixing unit BBU performs mixing operation by using the obtained target video of the target video conference;

the decoding module is used for decoding the video to obtain a first video;

the first sending module is used for sending the second video to the terminal;

13. An information processing apparatus applied to a media resource manager MRM, the apparatus comprising:

the first receiving module is used for receiving the second indication information sent by the media route and the resource controller MRC;

the generating module is used for generating a buffering and mixing screen unit BBU for the target video conference according to the second indication information;

a first sending module, configured to send third indication information to the buffering and mixing unit BBU, where the third indication information is used to instruct the buffering and mixing unit BBU to establish a connection with a multipoint control unit MCU corresponding to the target video conference,

14. An information processing apparatus applied to a buffering and mixing unit BBU, characterized in that it comprises: a processor and a transceiver;

the transceiver is used for receiving the media route and subscription information of the target video conference sent by the resource controller MRC;

The transceiver is also used for sending the target video after screen mixing to the multipoint control unit MCU;

15. An information processing apparatus for use in a media routing and resource controller MRC, the apparatus comprising: a processor and a transceiver;

the transceiver is used for receiving a subscription request of the terminal to the target video conference; according to the subscription request, subscription information of the target video conference is sent to a buffering and mixing unit BBU;

the transceiver is further used for receiving a conference reservation request of the terminal; sending second indication information to a media resource manager MRM according to the conference reservation request, wherein the second indication information is used for indicating the media resource manager MRM to generate the buffering and mixing screen unit BBU for the target video conference and indicating the BBU to establish connection of a multipoint control unit MCU corresponding to the target video conference,

16. An information processing apparatus applied to a multipoint control unit MCU, the apparatus comprising: a processor and a transceiver;

the transceiver is used for receiving the video sent by the buffering and mixing unit BBU, wherein the video is obtained after the buffering and mixing unit BBU performs mixing operation by using the obtained target video of the target video conference;

the transceiver is further configured to send the second video to a terminal;

17. An information processing apparatus applied to a media resource manager MRM, the apparatus comprising: a processor and a transceiver;

the transceiver is used for receiving the second indication information sent by the media route and the resource controller MRC;

the processor is used for generating a buffering and mixing unit BBU for the target video conference according to the second indication information;

the transceiver is further configured to send third indication information to the buffering and mixing unit BBU, where the third indication information is used to instruct the buffering and mixing unit BBU to establish a connection with a multipoint control unit MCU corresponding to the target video conference,

18. An information processing system, comprising: a media routing and resource controller MRC, a buffering and mixing screen unit BBU and a multipoint control unit MCU;

the media routing and resource controller MRC is used for receiving a subscription request of a terminal for a target video conference and sending subscription information for the target video conference to the buffering and screen mixing unit BBU according to the subscription request;

The buffering and mixing unit BBU is used for receiving the subscription information of the target video conference sent by the media route and resource controller MRC; acquiring a target video according to the subscription information; performing screen mixing operation on the target video; transmitting the target video after screen mixing to the multipoint control unit MCU;

the multipoint control unit MCU is used for receiving the target video after screen mixing sent by the buffering and screen mixing unit BBU, and decoding the target video to obtain a first video; encoding the first video to obtain a second video; sending the second video to a terminal;

the system further comprises: a media resource manager MRM;

the media resource manager MRM is configured to receive second indication information sent by the media router and resource controller MRC, generate the buffering and mixing unit BBU for the target video conference according to the second indication information, send third indication information to the buffering and mixing unit BBU, where the third indication information is used to instruct the BBU to establish connection with a multipoint control unit MCU corresponding to the target video conference,

19. A communication device, comprising: a transceiver, a memory, a processor, and a program stored on the memory and executable on the processor; it is characterized in that the method comprises the steps of,

the processor for reading a program in a memory to implement the steps in the method of any one of claims 1 to 4; or to carry out the steps of the method according to any one of claims 5 to 6; or to carry out the steps of the method according to any one of claims 7 to 8; or to implement the steps in the method as claimed in claim 9.

20. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method according to any one of claims 1 to 4; or to carry out the steps of the method according to any one of claims 5 to 6; or to carry out the steps of the method according to any one of claims 7 to 8; or to implement the steps in the method as claimed in claim 9.