WO2016082577A1

WO2016082577A1 - Video conference processing method and device

Info

Publication number: WO2016082577A1
Application number: PCT/CN2015/086161
Authority: WO
Inventors: 付永刚
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-11-24
Filing date: 2015-08-05
Publication date: 2016-06-02
Also published as: CN105611219A

Abstract

Provided is a video conference processing method and device, the processing method comprising: receiving notification information sent by a conference TV service management system and used for controlling a current video conference; according to the notification information, grouping and splitting the current video conference or combining the grouped and split current video conference. The above technical solution provided in the present invention solves the problem wherein a current complex operating procedure in related art brings inconvenience to a user when a group discussion is needed in a video conference, thus increasing video conference efficiency, and facilitating video use for user.

Description

Video conference processing method and device

Technical field

The present invention relates to the field of communications, and in particular to a method and apparatus for processing a video conference.

Background technique

With the rapid development of the Internet Protocol (IP) network and multimedia communication technology, users can participate in conferences, decision-making, etc. by means of audio and video multimedia technology without having to visit the site, which makes the conference television system It has been widely used in various industries, and the conference television system in the related art refers to the use of a display device such as a television and a conference television terminal, and a multipoint control unit (MCU) will be distributed throughout the country. The user terminals are convened into the same conference. Through the transmission of audio, video and data, the participants discuss the relevant topics to achieve the purpose of on-site interaction and communication.

In the actual application process, especially in the process of holding some large-scale video conferences, some topics need to be discussed in groups, and then discussed and decided after discussion. This situation usually requires the meeting administrator to close the ongoing meeting. Then re-convene a video conference for each group in groups. After the discussion, the meeting of each group will be ended, and the meeting occasions of each group will be re-opened together to convene a meeting. This is very complicated to operate, and it brings great inconvenience to users of video conferences.

In the related art, when a video conference needs to be discussed in groups, the existing operation process is complicated and inconvenient for the user, and an effective solution has not been proposed.

Summary of the invention

In order to solve the above technical problem, an embodiment of the present invention provides a method and an apparatus for processing a video conference.

According to an embodiment of the present invention, a method for processing a video conference is provided, the method comprising: receiving notification information sent by a conference television service management system for controlling a current video conference; The current video conference is split by a group, or the current video conference after the split is merged.

In the embodiment of the present invention, the notification information carries the following information: a terminal corresponding to each group conference when the video conference is split, or merges the video conference after the group split The terminal corresponding to the time.

In the embodiment of the present invention, the splitting of the current video conference according to the notification information includes: reselecting a broadcast source for the terminal corresponding to each group conference according to the notification information, and The terminal corresponding to each packet conference sends a terminal list of the conference packet to which the terminal belongs.

In the embodiment of the present invention, the merging the current video conference after the splitting of the packet according to the notification information includes: sending, according to the notification information, a terminal list including all terminals, for all terminals of the packet conference to be video-merged, And re-select the broadcast source for all of the terminals.

According to another embodiment of the present invention, a method for processing a video conference is further provided, the method comprising: acquiring notification information for controlling a current video conference, wherein the notification information is used to The video conference performs packet splitting, or merges the current video conference after the split of the packet; and sends the notification information to the multipoint control unit MCU.

In the embodiment of the present invention, acquiring the notification information for controlling the current video conference includes: receiving a selection instruction of the terminal user; and determining the notification information according to the selection instruction.

In the embodiment of the present invention, receiving the selection instruction of the terminal user includes: receiving a selection instruction of the terminal user on an operation interface provided by the conference service management system.

According to another embodiment of the present invention, a processing device for a video conference is further provided, the device comprising: a receiving module, configured to receive notification information sent by the conference television service management system for controlling a current video conference; And a splitting module, configured to perform group splitting on the current video conference according to the notification information, or a merge module, configured to merge the current video conference after splitting the packet.

According to another embodiment of the present invention, there is also provided a processing device for a video conference, the device comprising: an obtaining module, configured to acquire notification information for controlling a current video conference, wherein the notification information is used by Performing group splitting on the current video conference, or merging the current video conference after splitting the packet; and sending a module, configured to send the notification information to the multi-point control unit MCU.

In the embodiment of the present invention, the acquiring module includes: a receiving unit configured to receive a selection instruction of the terminal user; and a determining unit configured to determine the notification information according to the selection instruction.

According to the embodiment of the present invention, the method for grouping the current video conference by using the received notification information, or combining the current video conference after the splitting of the packet, is used to solve the need for video conference in the related art. In the group discussion, the existing operational process load brings inconvenience to the user, thereby improving the efficiency of the video conference and facilitating the use of the video user.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a flowchart of an operation processing method of an electronic drawing board according to an embodiment of the present invention;

2 is a structural block diagram of a processing apparatus for a video conference according to an embodiment of the present invention;

FIG. 3 is still another flowchart of a method for processing a video conference according to an embodiment of the present invention; FIG.

4 is a block diagram showing still another structure of a video conference processing apparatus according to an embodiment of the present invention;

FIG. 5 is still another structural block diagram of a processing apparatus for a video conference according to an embodiment of the present invention; FIG.

6 is a structural block diagram of a processing apparatus for a video conference according to a preferred embodiment of the present invention;

7 is a flow chart of a method for fast splitting and merging of video conferences in accordance with a preferred embodiment of the present invention.

detailed description

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

Other features and advantages of the invention will be set forth in the description which follows, The objectives and other advantages of the invention may be realized and obtained by means of the structure particularly pointed in the appended claims.

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is an embodiment of the invention, but not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of the present invention.

A method for processing a video conference is provided in this embodiment. FIG. 1 is a flowchart of a method for processing a video conference according to an embodiment of the present invention. As shown in FIG. 1 , the process includes the following steps:

Step S102: Receive notification information sent by the conference television service management system for controlling the current video conference.

Step S104: Perform group splitting on the current video conference according to the foregoing notification information, or merge the current video conference after the splitting of the packet.

Through the foregoing steps, the notification information delivered by the conference television service management system is received, and the current video conference can be split according to the received notification information, or the current video conference after the splitting is merged. The technical means solves the problem that the existing operation process is complicated and inconvenient to the user when the video conference needs to be grouped and discussed in the related technology, thereby improving the efficiency of the video conference and enabling the user to meet the conference at any time during the conference. Split and merge without breaking the meeting.

The notification information involved in the step S102 carries the following information; the terminal corresponding to each group conference when the video conference is split, or the video conference after the split session is merged; The corresponding terminal, that is, when splitting the video conference, needs to know the grouping situation: that is, which terminals are grouped into one group, and after the group splitting, which terminals perform time-frequency combining.

Optionally, the foregoing step S104 may be implemented in multiple manners. In the embodiment of the present invention, the process of performing packet splitting on the current video conference according to the foregoing notification information may be performed in the following manner: according to the foregoing notification information, The terminal corresponding to each group conference re-selects the broadcast source, and sends the terminal list of the conference group to which the terminal belongs to the terminal corresponding to each group conference; the method of splitting the packet according to the foregoing notification information may be performed in the following manner The process of merging the current video conferences: according to the above notification information, all terminals of the group conference to be subjected to video merging send a terminal list including all terminals, and reselect the broadcast source for all the terminals.

In order to better understand the above video grouping and the process of grouping and combining, the following technical examples are combined with two examples. The case is explained:

The splitting of the video conference group can be explained mainly by the following scheme:

Step 1: The user convene a video conference. Specifically, the user selects a list of participating terminals and convene a video conference through the conference television service management system.

Step 2: The user groups the participating terminals in the conference.

Optionally, the service management system provides a conference splitting interface, and the user groups the conferences through the conference splitting interface, and selects each grouped terminal.

Step 3: The conference television service management system generates a conference number for each group according to the grouping situation, and notifies the MCU to the conference terminal corresponding to each group, that is, the conference television service management system provides the split conference control page, and displays each The details of the grouping. A different conference number is generated for each packet, and the associated terminal of each packet is notified to the corresponding MCU.

Step 4: The MCU reassembles the terminals corresponding to the group conferences transmitted by the conference television service system into individual conference conferences, reselects the broadcast source for each conference conference, and retransmits the terminal list to each conference participant terminal. It is ensured that each grouping terminal can only see the terminal list of the group to which it belongs, hear the sound of the terminal of the grouping group, and see the image sent by the terminal of the grouping group. Each group meeting can be controlled independently without interference.

For the above step 4, the following solution can be implemented: the MCU combines each grouping terminal into an independent conference, and reselects the broadcast source for each packet conference, ensuring that the terminal in the packet can only see the image of the grouping terminal, and hear the grouping terminal. the sound of. The MCU resends the terminal list to each grouped terminal, ensuring that each packet terminal can only see the terminal list of the group to which it belongs. The MCU ensures that individual packet conferences can be independently controlled without interference.

The merging of the video conference group after splitting can be explained mainly by the following scheme:

In step 1, the user merges the split group conferences into one conference.

Similarly, for the process of video merging, the following technical solutions can be implemented: the service management system provides a conference merge interface, and the user merges the split conferences through the conference merge interface, and displays the merged content.

Step 2: The conference television service management informs the MCU to merge the originally split conferences into one conference. In short, the service system notifies the MCU to merge the split conferences.

In step 3, the MCU merges the original individual group conferences into one conference. Reselect the broadcast source and send a unified terminal list to all terminals. The meeting was restored to the shape before the split.

A processing device for a video conference is also provided in the embodiment, which is used to implement the above-mentioned embodiments and preferred embodiments. The descriptions of the modules involved in the device will be described below. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated. FIG. 2 is a structural block diagram of a processing apparatus for a video conference according to an embodiment of the present invention. As shown in Figure 2, the device comprises:

The receiving module 20 is configured to receive, by the conference television service management system, for controlling the current video conference. Notification information;

The splitting module 22 is connected to the receiving module 20, and configured to perform group splitting on the current video conference according to the foregoing notification information, or

The merging module 24 is connected to the receiving module 20 and configured to merge the current video conference after the splitting of the packet.

Through the comprehensive action of the foregoing modules, the notification information delivered by the conference television service management system is received, and the current video conference can be split according to the received notification information, or the current video after the split is split. The technical means of merging in the conference solves the problem that the existing operation process load brings inconvenience to the user when the video conference needs to be grouped and discussed in the related technology, thereby improving the efficiency of the video conference, and the user can be in the process of recalling Split and merge meetings at any time without interrupting the meeting.

In order to further improve the technical solution provided by the embodiment of the present invention, a method for processing a video conference is provided in this embodiment, and FIG. 3 is a flowchart of a method for processing a video conference according to an embodiment of the present invention. As shown in 3, the process includes the following steps:

Step S302: Acquire notification information for controlling the current video conference, where the notification information is used for group splitting the current video conference, or combining the current video conference after the splitting of the packet;

Step S304, the notification information is sent to the multipoint control unit MCU.

Through the above-mentioned various steps, the technical solution for transmitting the obtained notification information for controlling the current video conference to the MCU is solved, and the existing operation flow load is brought to the user when the video conference needs to be grouped and discussed in the related technology. The inconvenience of the problem, thereby improving the efficiency of the video conference, is that the user can split and merge the conference at any time during the process of recollection without interrupting the conference.

In an optional example of the embodiment of the present invention, the foregoing step S302 may be implemented by: receiving a selection instruction of the terminal user on an operation interface provided by the conference service management system; and determining notification information according to the selection instruction, that is, It is used to select a terminal to be split by using the above operation interface, and perform conference grouping.

A processing device for a video conference is also provided in the embodiment, which is used to implement the above-mentioned embodiments and preferred embodiments. The descriptions of the modules involved in the device will be described below. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated. FIG. 4 is a block diagram showing still another structure of a video conference processing apparatus according to an embodiment of the present invention. As shown in Figure 4, the device comprises:

The obtaining module 40 is configured to obtain notification information for controlling the current video conference, where the notification information is used for group splitting the current video conference, or the current video conference after splitting the packet Consolidate;

The sending module 42 is connected to the obtaining module 40 and configured to send the notification information to the multipoint control unit MCU.

Through the comprehensive function of the above-mentioned modules, the technical solution for delivering the notification information for controlling the current video conference to the MCU is solved, and the existing operation process load is solved when the video conference needs to be discussed in groups in the related art. The problem of inconvenience to the user, thereby improving the efficiency of the video conference, is that the user can always be in the process of recalling Split and merge meetings without interrupting the meeting.

Optionally, as shown in FIG. 5, the obtaining module 40 includes: a receiving unit 400 configured to receive a selection instruction of the terminal user; and a determining unit 402 connected to the receiving unit 400, configured to determine the notification information according to the selection instruction.

In order to better understand the structure of the processing apparatus of the video conference described above, the following describes a preferred embodiment of the video conference. FIG. 6 is a structural block diagram of a processing apparatus for a video conference according to a preferred embodiment of the present invention. The processing apparatus is applied to an MCU, and The conference television service management system 72 interacts, as shown in FIG. 6, and includes the following modules:

The protocol and channel management module 60 is configured to open, close, and manage logical channels for transferring audio, video, and data between the MCU 62 and the terminal.

The audio and video synthesis module 64 is configured to send the audio or video of the conference television terminal 66 to other user terminals.

The audio codec module 68 and the video codec module 74 are arranged to encode the media code stream into a particular format and to decode a particular media code stream.

The network transceiver module 70 is configured to send the media code stream to the transmission network and receive the media code stream from the network.

In summary, the technical solution provided by the foregoing embodiment of the present invention relates to an interaction process of a conference television service management system, a multipoint control unit MCU, and a user terminal, wherein the conference television service management system is configured to provide a user operation interface and manage Conference TV service system and MCU; multi-point control unit MCU, set to achieve multi-point access and interaction and control of audio, video and data at the user terminal; user terminal, set to perform real-time bidirectional video and audio with MCU Interaction.

The basic idea of the preferred embodiment of the present invention is: when a conference split is required in a conference scenario, the conference service management system sends an instruction for conference splitting to the MCU, and the MCU internally creates a packet for each packet according to the composition of each packet. Independent sub-conferences, audio, video, data and other information of each sub-conference are independent, and control signaling is also independent. Do not interfere with each other. The protocol and channel management module is responsible for completing the protocol exchange between the MCU and the terminal and opening and closing the media channel. Complete the split and merged broadcast source, token switch, and terminal list update. And controlling the video or audio module to send the switched audio and video to the terminals of each group conference. The video or audio module is responsible for receiving the audio and video data of the terminal, and then transmitting the terminal through synthesis. The encoding module is responsible for encoding the audio and video into a specific format. The decoding module is responsible for decoding the audio and video data of the terminal. The network receiving module is responsible for transmitting the media code stream of the MCU to the network and receiving the media stream from the network.

The method for fast splitting and merging video conferences in the preferred embodiment of the present invention will be described in detail below with reference to the accompanying drawings:

FIG. 7 is a flowchart of a method for fast splitting and merging video conferences according to a preferred embodiment of the present invention. As shown in FIG. 7, the following process is included:

Step S702: The conference administrator selects a terminal list in the conference service management system to hold a video conference. The service management system notification protocol and the channel control module hold a video conference, and call each conference terminal to join the conference.

Step S704: The conference service management system provides a conference splitting interface, and the conference administrator selects the number of splits of the conference and the terminal in each group conference to start conference splitting.

Step S706: The conference service management system notifies the MCU to perform conference splitting, and informs the MCU of the number of splits of the conference and the terminal of each group of conferences.

Step S708: The protocol and channel management module of the MCU combines the conference split information to each group conference and the terminal to form separate conferences. Reselect the video source for each group meeting and keep the original token. At the same time, the terminal list is resent to the terminal of each packet conference. Thus, the signaling groups of each packet conference are kept independent, and each group is controlled. At the same time, the video synthesis module is notified to send the video of the broadcast source to the terminal of each group conference, and the audio synthesis module remixes the terminal of each group conference.

Step S710: The network transceiver module of the MCU sends the audio and video code streams of each packet conference to the terminals in the packet; thereby ensuring that the terminal of each group conference can only see the video of the terminal in the same packet. Only the sound of the terminal in the same group can be heard.

Step S712: The conference administrator independently controls each group conference on the interface of the conference service management system. It can also be controlled on each terminal. The split of the meeting is over.

Step S714: The conference service management system provides a conference merge interface, and the conference administrator merges the split conferences.

Step S716: The conference service management system notifies the MCU to perform conference merge.

Step S718: The protocol and channel management module of the MCU reselects the video source and the token for the merged conference according to the conference merge information. And resend the terminal list to the merged terminal. At the same time, the video synthesis module is notified to send the video of the broadcast source to the terminal of the merged conference, and the audio synthesis module remixes the terminal of the merged conference.

Step S720: The network transceiver module of the MCU sends the merged audio and video code streams to the merged terminal of the conference; thereby ensuring that the terminals of the merged conference can see the video of the terminal in the same conference. Only the sound of the same conference terminal can be heard.

Step S722: The conference administrator controls each merged conference on the interface of the conference service management system. It can also be controlled on each terminal. The merger of the meeting is over.

In summary, the present invention can quickly split and merge conferences by adding conference splitting and merging interfaces, modifying MCU signaling, and audio and video synthesis modules in the conference service management system. Through the method described in the present invention, the scenario in which the user needs to discuss in groups and focus on the discussion in the process of using the video conference is fully satisfied. Greatly improve the efficiency of video conferencing.

The technical solutions provided by the embodiments of the present invention and the preferred embodiments achieve the following technical effects: enabling the user to split and merge the conferences at any time without interrupting the conference during the conference. And after the split group meeting, not only the audio, video, data and other information are independent, the signaling is also independently controlled; and the user is very convenient to use. It fully satisfies the scenario in which the user needs to discuss in groups and then focus on the process during the video conference. Greatly improve the efficiency of video conferencing.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases It is a better implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, can be embodied in the form of a software product stored in a storage medium (such as a read only memory (ROM, Read). -Only Memory), random access memory (RAM, Random Access Memory), disk, CD-ROM, including a number of instructions to enable a terminal device (which can be a mobile phone, computer, server, or network device, etc.) The above described methods of the various embodiments are invented.

In another embodiment, software is also provided for performing the technical solutions described in the above embodiments and preferred embodiments.

In another embodiment, a storage medium is further provided, wherein the software includes the above-mentioned software, including but not limited to: an optical disk, a floppy disk, a hard disk, an erasable memory, and the like.

It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order. It is to be understood that the objects so used are interchangeable, where appropriate, so that the embodiments of the invention described herein can be carried out in a sequence other than those illustrated or described herein. In addition, the terms "comprises" and "comprises" and "the" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

According to the technical solution provided by the present invention, the technical means for splitting the current video conference by using the received notification information, or combining the current video conference after the splitting of the packet is solved, and the related technology is solved. When a video conference needs group discussion, the existing operation process load brings inconvenience to the user, thereby improving the efficiency of the video conference and facilitating the use of the video user.

Claims

A method for processing a video conference, the method comprising:

Receiving, by the conference television service management system, notification information used to control the current video conference;

The current video conference is split according to the notification information, or the current video conference after the split is merged.
The method of claim 1 wherein said notification information carries the following information:

A terminal corresponding to each group conference when the video conference is split, or a terminal corresponding to the video conference after the split session is merged.
The method according to claim 2, wherein the splitting the current video conference according to the notification information comprises:

And re-selecting a broadcast source for the terminal corresponding to each group conference according to the notification information, and sending a terminal list of the conference group to which the terminal belongs for the terminal corresponding to each group conference.
The method according to claim 2, wherein the merging the current video conference after the splitting of the packet according to the notification information comprises:

According to the notification information, all terminals of the packet conference to be video merged are sent a terminal list including all terminals, and the broadcast source is reselected for all the terminals.
A method for processing a video conference, the method comprising:

Acquiring the notification information for controlling the current video conference, where the notification information is used for group splitting the current video conference, or combining the current video conference after the splitting of the packet;

The notification information is sent to the multipoint control unit MCU.
The method according to claim 5, wherein the obtaining notification information for controlling the current video conference comprises:

Receiving a selection instruction of the terminal user;

The notification information is determined according to the selection instruction.
The method of claim 6, wherein receiving the selection instruction of the end user comprises receiving the selection instruction of the end user on an operation interface provided by the conference service management system.
A processing device for a video conference, the device comprising:

a receiving module, configured to receive notification information sent by the conference television service management system for controlling the current video conference;

a splitting module, configured to perform group splitting on the current video conference according to the notification information, or

The merge module is configured to merge the current video conference after the split of the group.
A processing device for a video conference, the device comprising:

An obtaining module, configured to obtain notification information for controlling a current video conference, where the notification information is used for group splitting the current video conference, or performing the current video conference after the splitting of the packet merge;

The sending module is configured to send the notification information to the multipoint control unit MCU.
The device of claim 9, wherein the obtaining module comprises:

a receiving unit, configured to receive a selection instruction of the terminal user;

The determining unit is configured to determine the notification information according to the selection instruction.