CN105379179B - Multi-party real-time communication control method, device and system - Google Patents
Multi-party real-time communication control method, device and system Download PDFInfo
- Publication number
- CN105379179B CN105379179B CN201480000186.9A CN201480000186A CN105379179B CN 105379179 B CN105379179 B CN 105379179B CN 201480000186 A CN201480000186 A CN 201480000186A CN 105379179 B CN105379179 B CN 105379179B
- Authority
- CN
- China
- Prior art keywords
- terminal
- mcu
- information
- evaluation data
- reference information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1822—Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a multiparty real-time communication control method, a device and a system, wherein the method comprises the following steps: and collecting MCU reference information of a multi-point control unit, selecting a terminal used as an MCU according to the MCU reference information, and informing the selected terminal used as the MCU of the selected result. In the embodiment of the invention, the condition of the network where the terminal is located and/or the condition of the terminal can be known by collecting the MCU reference information required by the terminal used for determining the MCU, so that an optimal terminal can be dynamically and automatically determined to be the MCU, the strong capability of the terminal is fully exerted, services such as forwarding, transcoding and the like of audio and video data are provided for other terminals, and the stability of multiparty conference communication is improved. In addition, the burden of other terminals with poor capability can be reduced, so that the working efficiency of the multiparty real-time communication system is improved, the practicability of the system is enhanced, and the multiparty real-time communication system can be really used for business.
Description
Technical Field
The present invention relates to the field of multiparty real-time communication technologies, and in particular, to a multiparty real-time communication control method, apparatus and system.
Background
With the rapid development of internet technology, multi-party real-time communication technology is gradually emerging. The key equipment of the system is mainly a Multipoint Control Unit (MCU), the MCU can extract information and signaling of audio, video, data and the like after synchronously separating information streams from all participants, then completes corresponding processes of audio and video mixing or switching, data broadcasting and routing, timing and conference Control and the like according to requirements, and finally sends the information to corresponding terminal equipment.
The traditional multiparty real-time communication system usually needs special hardware equipment such as an MCU (microprogrammed control Unit) server and the like, so that the whole system is expensive, complex to build and high in maintenance cost, and once the MCU server goes wrong, the whole conference system cannot be used.
The multi-party real-time communication system based on Peer-to-Peer (P2P) architecture can solve the above problems theoretically. Different from the traditional method of using a special MCU server, the multi-party real-time communication system based on the P2P architecture can realize the function of the MCU by using a software module, and media data exchange is carried out through direct connection between terminals, so that the multi-party real-time communication system does not need to rely on a complex and expensive MCU server, and becomes a low-cost multi-party real-time communication solution.
However, in the process of implementing the present invention, the inventor finds that the multiparty real-time communication system created by using the direct connection method between terminals, such as P2P, is difficult to be put into commercial use, because various terminals (such as mobile phones, notebook computers, tablet computers, personal computers and PCs, etc.) have different conditions and different processing capabilities, it is difficult to establish stable multiparty conference communication, and there are problems of poor system stability, low working efficiency, etc., and as a result, there is not much practical value.
Disclosure of Invention
In view of the above, an object of the embodiments of the present invention is to provide a method, an apparatus and a system for controlling multiparty real-time communication, so as to improve the stability of the multiparty real-time communication system.
In order to solve the technical problem, the embodiment of the invention discloses the following technical scheme:
in a first aspect, a multiparty real-time communication control method is provided, which is used for a network control unit, and includes:
collecting MCU reference information of a multi-point control unit, wherein the MCU reference information is information required for determining a terminal as an MCU;
selecting a terminal as an MCU according to the MCU reference information;
and informing the selected result to the terminal selected as the MCU.
In a first possible implementation manner of the first aspect, the MCU reference information includes one or more of the following: network information and/or terminal information.
With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or status information of each terminal under the control of the network control unit.
With reference to the first possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, when the MCU reference information includes terminal information, the collecting multipoint control unit MCU reference information includes:
receiving a message which is sent by a terminal and carries the terminal information; alternatively, the first and second electrodes may be,
the terminal information is extracted from communication with a terminal.
With reference to the first aspect, in a fourth possible implementation manner of the first aspect, selecting a terminal as an MCU according to the MCU reference information includes:
and selecting a terminal meeting a specified rule from all terminals under the control of the network control unit as an MCU according to the MCU reference information.
With reference to the first aspect, in a fifth possible implementation manner of the first aspect, selecting a terminal as an MCU according to the MCU reference information includes:
calculating each terminal under the control of the network control unit according to each content in the quantized MCU reference information to obtain terminal evaluation data of each terminal;
and selecting the terminal as the MCU according to the terminal evaluation data of each terminal.
With reference to the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner of the first aspect, selecting a terminal as an MCU according to the terminal evaluation data of each terminal includes:
selecting a terminal as an MCU according to the relation between the terminal evaluation data of each terminal and a preset terminal evaluation data threshold value; alternatively, the first and second electrodes may be,
and selecting the terminal corresponding to the extreme value in the terminal evaluation data of each terminal as the MCU.
In a second aspect, a multiparty real-time communication control method is provided, which is used for a network control unit, and includes:
receiving terminal evaluation data of each terminal sent by each terminal, wherein the terminal evaluation data are obtained by quantifying and calculating each content in MCU reference information collected by each terminal according to the terminal, and the MCU reference information is information required by determining the terminal as an MCU;
selecting a terminal as an MCU according to the terminal evaluation data sent by each terminal;
and informing the selected result to the terminal selected as the MCU.
With reference to the second aspect, in a first possible implementation manner of the second aspect, selecting a terminal as an MCU according to the terminal evaluation data sent by each terminal includes:
selecting a terminal as an MCU according to the relation between the terminal evaluation data sent by each terminal and a preset terminal evaluation data threshold value; alternatively, the first and second electrodes may be,
and selecting the terminal corresponding to the extreme value in the terminal evaluation data sent by each terminal as the MCU.
In a third aspect, a multiparty real-time communication control method is provided, which is used for a terminal, and includes:
collecting MCU reference information of a multi-point control unit, wherein the MCU reference information is information required for determining a terminal as an MCU;
acquiring terminal evaluation data of the terminal according to the MCU reference information;
and sending the terminal evaluation data of the terminal to a network control unit.
With reference to the third aspect, in a first possible implementation manner of the third aspect, the MCU reference information includes one or more of the following: network information and/or terminal information.
With reference to the first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or state information of the terminal.
With reference to the first possible implementation manner of the third aspect, in a third possible implementation manner of the third aspect, when the MCU reference information includes network information, the collecting multipoint control unit MCU reference information includes:
extracting the network information from a message sent by the network control unit.
With reference to the third aspect, in a fourth possible implementation manner of the third aspect, the obtaining, according to the MCU reference information, terminal evaluation data of the terminal includes:
and calculating the terminal according to each content in the quantized MCU reference information to obtain terminal evaluation data of the terminal.
In a fourth aspect, a multiparty real-time communication control method is provided, which is used for a terminal, and includes:
collecting MCU reference information of a multi-point control unit, wherein the MCU reference information is information required for determining a terminal as an MCU;
acquiring terminal evaluation data of the terminal and other terminals except the terminal controlled by the network control unit according to the MCU reference information;
determining a terminal which is to be used as an MCU according to the acquired terminal evaluation data;
and if the terminal to be used as the MCU is the terminal, switching to the MCU working mode.
With reference to the fourth aspect, in a first possible implementation manner of the fourth aspect, the MCU reference information includes one or more of the following: network information and/or terminal information.
With reference to the first possible implementation manner of the fourth aspect, in a second possible implementation manner of the fourth aspect:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or status information of the terminal.
With reference to the first possible implementation manner of the fourth aspect, in a third possible implementation manner of the fourth aspect:
when the MCU reference information includes network information, the collecting the MCU reference information of the multipoint control unit includes:
extracting the network information from a message sent by the network control unit;
when the MCU reference information includes terminal information, the collecting multipoint control unit MCU reference information includes:
terminal information of other terminals is extracted in communication with the other terminals.
With reference to the fourth aspect, in a fourth possible implementation manner of the fourth aspect, the obtaining, according to the MCU reference information, terminal evaluation data of the terminal and other terminals controlled by the network control unit, where the terminal evaluation data is other than the terminal, includes:
and respectively calculating the terminal and other terminals except the terminal according to various items of quantized MCU reference information to acquire terminal evaluation data of the terminal and other terminals except the terminal.
With reference to the fourth aspect, in a fifth possible implementation manner of the fourth aspect, determining, according to the obtained terminal evaluation data, a terminal that should be used as an MCU includes:
determining a terminal to be used as an MCU according to the relation between the terminal evaluation data and a preset terminal evaluation data threshold value; alternatively, the first and second electrodes may be,
and determining the terminal corresponding to the extreme value in the terminal evaluation data as the terminal to be used as the MCU.
In a fifth aspect, a multiparty real-time communication control device is provided, which is used for a network control unit, and includes:
the first MCU reference information collection unit is used for collecting MCU reference information of the multipoint control unit, and the MCU reference information is information required for determining a terminal as an MCU;
the first MCU selecting unit is used for selecting a terminal as an MCU according to the MCU reference information;
and the notification unit is used for notifying the selected terminal as the MCU of the selected result.
With reference to the fifth aspect, in a first possible implementation manner of the fifth aspect, the MCU reference information includes one or more of the following: network information and/or terminal information.
With reference to the first possible implementation manner of the fifth aspect, in a second possible implementation manner of the fifth aspect:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or status information of each terminal under the control of the network control unit.
With reference to the first possible implementation manner of the fifth aspect, in a third possible implementation manner of the fifth aspect, when the MCU reference information includes terminal information, the first MCU reference information collecting unit includes:
the message receiving subunit is used for receiving a message which is sent by the terminal and carries the terminal information; alternatively, the first and second electrodes may be,
an information extraction subunit, configured to extract the terminal information from communication with a terminal.
With reference to the fifth aspect, in a fourth possible implementation manner of the fifth aspect, the first MCU selecting unit is specifically configured to select, as the MCU, a terminal that meets a specified rule from the terminals under the control of the network control unit according to the MCU reference information.
With reference to the fifth aspect, in a fifth possible implementation manner of the fifth aspect, the first MCU selecting unit includes:
the evaluation data calculation subunit is used for calculating each terminal under the control of the network control unit according to each content in the quantized MCU reference information so as to obtain terminal evaluation data of each terminal;
and the MCU selection subunit is used for selecting the terminal as the MCU according to the terminal evaluation data of each terminal.
With reference to the fifth possible implementation manner of the fifth aspect, in a sixth possible implementation manner of the fifth aspect, the MCU selection subunit is specifically configured to select a terminal serving as an MCU according to a relationship between the terminal evaluation data of each terminal and a preset terminal evaluation data threshold, or select a terminal corresponding to an extreme value in the terminal evaluation data of each terminal as the MCU.
In a sixth aspect, a multiparty real-time communication control device is provided, which is used for a network control unit, and comprises:
the system comprises an evaluation data receiving unit, a multipoint control unit and a multipoint control unit MCU, wherein the evaluation data receiving unit is used for receiving terminal evaluation data of each terminal sent by each terminal, the terminal evaluation data are obtained by quantifying and calculating each content in MCU reference information collected by each terminal according to the terminal, and the MCU reference information is information required by determining the terminal as an MCU;
the second MCU selection unit is used for selecting terminals as MCU according to the terminal evaluation data sent by each terminal;
and the notification unit is used for notifying the selected terminal as the MCU of the selected result.
With reference to the sixth aspect, in a first possible implementation manner of the sixth aspect, the second MCU selecting unit is specifically configured to select a terminal serving as an MCU according to a relationship between the terminal evaluation data sent by each terminal and a preset terminal evaluation data threshold, or select a terminal corresponding to an extreme value in the terminal evaluation data sent by each terminal as an MCU.
In a seventh aspect, a multiparty real-time communication control device is provided, which is used for a terminal, and includes:
the second MCU reference information collection unit is used for collecting MCU reference information of the multipoint control unit, wherein the MCU reference information is information required for determining a terminal used as an MCU;
the terminal evaluation data acquisition unit is used for acquiring the terminal evaluation data of the terminal according to the MCU reference information;
and the evaluation data sending unit is used for sending the terminal evaluation data of the terminal to the network control unit.
With reference to the seventh aspect, in a first possible implementation manner of the seventh aspect, the MCU reference information includes one or more of the following: network information and/or terminal information.
With reference to the first possible implementation manner of the seventh aspect, in a second possible implementation manner of the seventh aspect:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or state information of the terminal.
With reference to the first possible implementation manner of the seventh aspect, in a third possible implementation manner of the seventh aspect, when the MCU reference information includes network information, the second MCU reference information collecting unit is specifically configured to extract the network information from a message sent by the network control unit.
With reference to the seventh aspect, in a fourth possible implementation manner of the seventh aspect, the terminal evaluation data obtaining unit is specifically configured to calculate the terminal according to each item of content in the quantized MCU reference information, so as to obtain terminal evaluation data of the terminal.
In an eighth aspect, a multiparty real-time communication control device is provided, which is used for a terminal, and includes:
the third MCU reference information collection unit is used for collecting MCU reference information of the multipoint control unit, wherein the MCU reference information is information required for determining a terminal as an MCU;
the terminal and other terminal evaluation data acquisition unit is used for acquiring terminal evaluation data of other terminals except the terminal controlled by the terminal and the network control unit according to the MCU reference information;
and the third MCU selecting unit is used for determining a terminal which should be used as the MCU according to the acquired terminal evaluation data, and if the terminal which should be used as the MCU is the terminal, switching to the MCU working mode.
With reference to the eighth aspect, in a first possible implementation manner of the eighth aspect, the MCU reference information includes one or more of the following: network information and/or terminal information.
With reference to the first possible implementation manner of the eighth aspect, in a second possible implementation manner of the eighth aspect:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or status information of the terminal.
With reference to the first possible implementation manner of the eighth aspect, in a third possible implementation manner of the eighth aspect:
when the MCU reference information includes network information, the third MCU reference information collection unit is specifically configured to extract the network information from a message sent by the network control unit;
when the MCU reference information includes terminal information, the third MCU reference information collecting unit is specifically configured to extract the terminal information of the other terminal in communication with the other terminal.
With reference to the eighth aspect, in a fourth possible implementation manner of the eighth aspect, the own terminal and other terminal evaluation data obtaining unit is specifically configured to calculate the own terminal and other terminals except the own terminal according to each item of quantized MCU reference information, so as to obtain terminal evaluation data of the own terminal and other terminals except the own terminal.
With reference to the eighth aspect, in a fifth possible implementation manner of the eighth aspect, the third MCU selecting unit is specifically configured to determine a terminal that should be used as an MCU according to a relationship between the terminal evaluation data and a preset terminal evaluation data threshold, or determine a terminal corresponding to an extreme value in the terminal evaluation data as a terminal that should be used as an MCU.
A ninth aspect provides a multiparty real-time communication system, which comprises a network control unit and at least two terminals;
the network control unit is used for sending a request for acquiring terminal information to the terminal, collecting MCU reference information of a multipoint control unit, wherein the MCU reference information is information required for determining a terminal used as an MCU, selecting the terminal used as the MCU according to the MCU reference information, and informing the selected terminal used as the MCU of the selected result, and the MCU reference information comprises one or more of the following contents: network information and/or terminal information;
and the terminal is used for sending the terminal information of the terminal to the network control unit according to the request for obtaining the terminal information.
A tenth aspect provides a multiparty real-time communication system, which comprises a network control unit and at least two terminals;
the terminal is used for collecting MCU reference information of a multipoint control unit, the MCU reference information is information required by the terminal used for determining the MCU, terminal evaluation data of the terminal are obtained according to the MCU reference information, the terminal evaluation data are obtained by calculation after quantification according to various contents in the MCU reference information, and the terminal evaluation data of the terminal are sent to a network control unit;
and the network control unit is used for receiving the terminal evaluation data of the terminal sent by each terminal, selecting the terminal as the MCU according to the terminal evaluation data, and informing the selected terminal as the MCU of the selected result.
In an eleventh aspect, a multiparty real-time communication system is provided, which includes at least two terminals;
the terminal is used for collecting MCU reference information of the multipoint control unit, wherein the MCU reference information is information required for determining a terminal used as an MCU, terminal evaluation data of the terminal and other terminals except the terminal controlled by the network control unit are obtained according to the MCU reference information, the terminal to be used as the MCU is determined according to the obtained terminal evaluation data, and if the terminal to be used as the MCU is the terminal, the MCU working mode is switched to.
Some of the benefits of the present invention may include:
in the embodiment of the invention, the condition of the network where the terminal is located and/or the condition of the terminal can be known by collecting the MCU reference information required by the terminal used for determining the MCU, so that an optimal terminal can be dynamically and automatically determined to be the MCU, the strong capability of the terminal is fully exerted, services such as forwarding, transcoding and the like of audio and video data are provided for other terminals, and the stability of multiparty conference communication is improved. In addition, the burden of other terminals with poor capability can be reduced, the situation that the terminal with the worst condition becomes a short board of the system so that only the video format with the lowest code rate and the smallest occupied bandwidth can be selected for communication is avoided, the working efficiency of the multiparty real-time communication system is improved, the practicability of the system is enhanced, and the multiparty real-time communication system can be really put to commercial use.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is an exemplary flow chart of a method of an embodiment of the present invention;
FIG. 2 is an exemplary flow chart of a three-way method according to an embodiment of the present invention;
FIG. 3 is an exemplary flow chart of a three-way method according to an embodiment of the present invention;
FIG. 4 is an exemplary flow chart of a four-way method of an embodiment of the present invention;
FIG. 5 is a diagram illustrating a fifth embodiment of networking;
fig. 6 is a signaling diagram of a fifth embodiment of the present invention;
fig. 7 is a schematic diagram of the terminal 504 acting as an MCU after step S610 in fig. 6;
FIG. 8 is a schematic illustration of a sixth apparatus according to an embodiment of the present invention;
FIG. 9 is a schematic view of a seventh apparatus according to an embodiment of the present invention;
FIG. 10 is a schematic view of a seventh apparatus according to an embodiment of the present invention;
FIG. 11 is a schematic view of an eighth apparatus according to an embodiment of the present invention;
FIG. 12 is a schematic diagram of a nine-system embodiment of the present invention;
fig. 13 is a schematic diagram of a tenth system according to an embodiment of the present invention.
With the above figures, certain embodiments of the invention have been illustrated and described in more detail below. The drawings and the description are not intended to limit the scope of the inventive concept in any way, but rather to illustrate it by those skilled in the art with reference to specific embodiments.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the invention, but it will be appreciated by those skilled in the art that the invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail as not to unnecessarily obscure aspects of the embodiments.
Example one
FIG. 1 is an exemplary flow chart of a method of an embodiment of the present invention. The embodiment provides a multiparty real-time communication control method, which can be used for a network control unit, and the method can include:
s101, collecting MCU reference information of a multipoint control unit, wherein the MCU reference information is information required for determining a terminal serving as an MCU.
In this embodiment, the network control unit dynamically determines a terminal as an MCU according to MCU reference information (e.g., a network condition of the terminal under management of the network control unit and/or a terminal condition), and timely adjusts a carrier terminal of the MCU when the MCU reference information is found to change, thereby ensuring that the multiparty real-time communication system can always be in a stable and efficient working state.
The MCU reference information in this embodiment may contain one or more items of content. In this embodiment or some other embodiments of the present invention, the one or more items of content included in the MCU reference information may include: network information and/or terminal information. Further:
the network information may include network topology information and/or network load information, the network topology information includes physical topology information and/or logical topology information, and the network load information includes traffic information on a path and/or information whether the path is overloaded;
the terminal information may include hardware information, software information, and/or status information of each terminal under the control of the network control unit.
And S102, selecting a terminal as the MCU according to the MCU reference information.
With the MCU reference information, what kind of rules or manners are specifically used to select the MCU as the terminal may be formulated according to different scenarios, for example, some threshold values may be used to screen layer by layer, or comparison and evaluation may be performed by performing weighted calculation on each item of information, etc., which is not limited in the embodiments of the present invention, and these manners may be used herein without departing from the spirit and scope of the present invention.
S103, informing the selected result to the terminal selected as the MCU.
On the basis of the collected MCU reference information, the network control unit can judge which terminal is most suitable for being used as the MCU currently, and then the terminal is informed of the decision of the network control unit; in addition, in some scenes, the result can be notified to the terminal originally serving as the MCU so as to switch back to the normal operating state, and in other scenes, the terminal originally serving as the MCU can also determine whether to receive the notification continuously serving as the MCU within a specified time, and if not, the terminal originally serving as the MCU can automatically switch back to the normal operating state, so that the network control unit is not required to notify the terminal originally serving as the MCU of the selection result.
After that, the terminal newly designated as MCU starts to assume the duties of MCU, for example: after the information flow from all the terminals participating in the conference is synchronously separated, the information and signaling of audio, video and data are extracted, then the information and signaling of all the terminals participating in the conference are sent to the same processing module, the corresponding processes of audio mixing or switching, video mixing or switching, data broadcasting and routing selection, timing and conference control and the like are completed, finally various information required by each conference site is recombined and sent to each corresponding terminal device, and the like. The above-mentioned responsibilities of how a terminal can implement an MCU by software in particular are not within the scope of the present invention, and the functions of an MCU can be implemented by any of the prior art using software modules for terminals.
In this embodiment or some other embodiments of the present invention, when the MCU reference information includes terminal information, the collecting multipoint control unit MCU reference information may include:
receiving a message which is sent by a terminal and carries the terminal information; alternatively, the first and second electrodes may be,
the terminal information is extracted from communication with a terminal.
The network control unit may collect the terminal information in various ways, for example, may send a request to instruct the terminal to send a specific message carrying the terminal information, or may extract the terminal information from communication with the terminal.
Accordingly, when the method of the present embodiment is used on the terminal side, the method may include:
and sending the terminal information of the terminal to the network control unit according to the request of the network control unit. The terminal information may include hardware information, software information, and/or status information of the terminal.
In the embodiment, by collecting the MCU reference information required for determining the terminal as the MCU, the condition of the network where the terminal is located and/or the condition of the terminal itself can be known, so that an optimal terminal can be dynamically and automatically determined as the MCU, the powerful capability of the terminal can be fully exerted, services such as forwarding and transcoding of audio and video data can be provided for other terminals, and the stability of multiparty conference communication can be improved. In addition, the burden of other terminals with poor capability can be reduced, the situation that the terminal with the worst condition becomes a short board of the system so that only the video format with the lowest code rate and the smallest occupied bandwidth can be selected for communication is avoided, the working efficiency of the multiparty real-time communication system is improved, the practicability of the system is enhanced, and the multiparty real-time communication system can be really put to commercial use.
Example two
The present embodiment is based on the previous embodiment, and is a further supplement and improvement to the previous embodiment. In the above embodiment, it has been pointed out that what kind of rules and manners are specifically used to select the terminal as the MCU may be formulated according to different scenarios, for example, some threshold values may be used to screen layer by layer, or comparison and evaluation may be performed by performing weighted calculation on each item of information, and the like.
In a first manner, in this embodiment, the terminal selected as the MCU according to the MCU reference information may specifically be:
and selecting a terminal meeting a specified rule from all terminals under the control of the network control unit as an MCU according to the MCU reference information.
For example, the MCU reference information collected may include one or more of the following items in table 1:
TABLE 1
The following further illustrates how the selection is performed using the specified rules. For example, in a scenario, layer-by-layer filtering may be performed according to rules of 'a terminal is located at a central position of a conference network, a terminal type is PC + a memory is greater than YYY', or 'each communication path of the terminal has no overload, the terminal type is PC + a communication protocol type is XXX', and finally a terminal that can be suitable for being used as an MCU is obtained, and if more than one terminal is obtained, a rule that 'an IP address of the terminal should be in a certain segment' may be further increased to perform the filtering.
In a second manner, in this embodiment, the terminal selected as the MCU according to the MCU reference information may specifically be:
calculating each terminal under the control of the network control unit according to each content in the quantized MCU reference information to obtain terminal evaluation data of each terminal;
and selecting the terminal as the MCU according to the terminal evaluation data of each terminal.
Table 1 lists some items of content that can be used as MCU reference information, and if these items are quantized and given corresponding weights, then terminal evaluation data of each terminal can be calculated, or a score value that reflects whether the terminal is suitable for serving as an MCU is obtained. For example, the following formula can be used for calculation:
Mi＝∑ajxj＝a1x1+a2x2+a3x3+...+ajxj+…
wherein M isiIs the value of credit, x, of terminal ijFor the quantized value of the jth content in the MCU reference information, ajIs the weight of the item of content.
For example, in one scenario, the MCU reference information includes three items of content, i.e., 'whether the terminal is located in the center of the conference network + the terminal type + has joined the video conference', which can be quantified as follows:
| whether or not it is located in a central location of the conference network | Is located at the center | Not centrally located |
| Quantized value | 1 | 0 |
| Terminal type | Desk type machine | Notebook computer | Tablet personal computer | Smart phone |
| Quantized value | 4 | 3 | 2 | 1 |
| Whether or not a video conference has been joined | Joined video conference | Non-joined video conference |
| Quantized value | 0 | 1 |
Meanwhile, the three items are respectively given weight values of 1, 3 and 0.5
| Item | Weight value |
| Whether or not it is located in a central location of the conference network | 1 |
| Terminal type | 3 |
| Whether or not a video conference has been joined | 0.5 |
Then, assuming that there are two terminals a and B, if the terminal a is a laptop, is located at the central position of the network, and has joined the video conference, the score value of the terminal a is: 1 × 1+3 × 3+0.5 × 0 ═ 10; if terminal B is a desktop, is not located in the center of the network, and is not participating in the video conference, the score value of terminal B is 1 × 0+3 × 4+0.5 × 1 — 12.5. In comparison, terminal B is more suitable as MCU.
In this embodiment or some other embodiments of the present invention, selecting a terminal as an MCU according to the terminal evaluation data of each terminal may specifically include:
selecting a terminal as an MCU according to the relation between the terminal evaluation data of each terminal and a preset terminal evaluation data threshold value; alternatively, the first and second electrodes may be,
and selecting the terminal corresponding to the extreme value in the terminal evaluation data of each terminal as the MCU.
When a terminal is selected as the MCU according to the threshold, it may be specified that only terminals with a score greater than a certain threshold are qualified as the MCU. When the terminal is selected according to the extreme value in the terminal evaluation data, the terminal corresponding to the maximum scoring value can be usually selected, and certainly, in some scenes, it can be specified that the smaller the score value is, the stronger the representing capability is, and at this time, the terminal corresponding to the minimum value can be selected.
In the embodiment, by collecting the MCU reference information required for determining the terminal as the MCU, the condition of the network where the terminal is located and/or the condition of the terminal itself can be known, so that an optimal terminal can be dynamically and automatically determined as the MCU, the powerful capability of the terminal can be fully exerted, services such as forwarding and transcoding of audio and video data can be provided for other terminals, and the stability of multiparty conference communication can be improved. In addition, the burden of other terminals with poor capability can be reduced, the situation that the terminal with the worst condition becomes a short board of the system so that only the video format with the lowest code rate and the smallest occupied bandwidth can be selected for communication is avoided, the working efficiency of the multiparty real-time communication system is improved, the practicability of the system is enhanced, and the multiparty real-time communication system can be really put to commercial use.
EXAMPLE III
FIG. 2 is an exemplary flow chart of a third method of an embodiment of the present invention. The present embodiment is similar to the solution of the previous embodiment, and provides a multiparty real-time communication control method, which can be used for a network control unit, and the method includes:
s201, receiving terminal evaluation data of each terminal sent by each terminal, wherein the terminal evaluation data are obtained by quantifying and calculating each content in MCU reference information collected by each terminal, and the MCU reference information is information required by terminals used for determining MCU. The MCU reference information may contain one or more items of content.
The terminal evaluation data is used for evaluating the capability of the terminal selected as the multipoint control unit MCU, and can be generally understood as whether the terminal is suitable to be used as the evaluation value of the MCU.
In the first or second embodiment, the network control unit is responsible for collecting the MCU reference information and calculating the terminal evaluation data of each terminal based thereon, but in this embodiment, the terminal can calculate its own terminal evaluation data according to the MCU reference information collected by itself and then send it to the network control unit for its decision making, thereby reducing a part of the burden of the network control unit.
S202, selecting a terminal as an MCU according to the terminal evaluation data sent by each terminal.
In this embodiment or some other embodiments of the present invention, selecting a terminal as an MCU according to the terminal evaluation data sent by each terminal may include:
selecting a terminal as an MCU according to the relation between the terminal evaluation data sent by each terminal and a preset terminal evaluation data threshold value; alternatively, the first and second electrodes may be,
and selecting the terminal corresponding to the extreme value in the terminal evaluation data sent by each terminal as the MCU.
S203, notifying the selected result to the terminal selected as the MCU.
The steps/processes of the selection and the like are similar to those of the first or second embodiment, and the relevant points can be referred to the description of the first or second embodiment, which is not repeated in this embodiment.
Accordingly, when the method of the present embodiment is applied to the terminal side, as shown in fig. 3, the method may include:
s301, collecting MCU reference information of a multipoint control unit, wherein the MCU reference information is information required for determining a terminal serving as an MCU, and the MCU reference information comprises one or more items of content;
s302, acquiring terminal evaluation data of the terminal according to the MCU reference information;
and S303, sending the terminal evaluation data of the terminal to a network control unit.
The one or more contents included in the MCU reference information may include: network information and/or terminal information.
Further, the network information may include network topology information and/or network load information, the network topology information includes physical topology information and/or logical topology information, and the network load information includes traffic information on a path and/or information whether the path is overloaded;
the terminal information may include hardware information, software information, and/or status information of the terminal.
In this embodiment or some other embodiments of the present invention, when the MCU reference information includes network information, the collecting multipoint control unit MCU reference information may include:
the network information is extracted from a message sent by the network control unit (e.g., broadcast, multicast, or unicast).
In this embodiment or some other embodiments of the present invention, the obtaining terminal evaluation data of the terminal according to the MCU reference information includes:
and calculating the terminal according to each content in the quantized MCU reference information to obtain terminal evaluation data of the terminal.
The details of the MCU reference information, the calculation of the terminal evaluation data, and the like can be referred to the detailed description in the foregoing embodiments, and are not repeated in this embodiment.
In the embodiment, by collecting the MCU reference information required for determining the terminal as the MCU, the condition of the network where the terminal is located and/or the condition of the terminal itself can be known, so that an optimal terminal can be dynamically and automatically determined as the MCU, the powerful capability of the terminal can be fully exerted, services such as forwarding and transcoding of audio and video data can be provided for other terminals, and the stability of multiparty conference communication can be improved. In addition, the burden of other terminals with poor capability can be reduced, the situation that the terminal with the worst condition becomes a short board of the system so that only the video format with the lowest code rate and the smallest occupied bandwidth can be selected for communication is avoided, the working efficiency of the multiparty real-time communication system is improved, the practicability of the system is enhanced, and the multiparty real-time communication system can be really put to commercial use.
Example four
Fig. 4 is an exemplary flow chart of a four-way method of an embodiment of the present invention.
The present embodiment is similar to the solution of the previous embodiment, and provides a multiparty real-time communication control method, which can be used for a terminal, where the method includes:
s401, collecting MCU reference information of a multipoint control unit, wherein the MCU reference information is information required for determining a terminal serving as an MCU. The MCU reference information may contain one or more items of content.
S402, acquiring terminal evaluation data of the terminal and other terminals except the terminal controlled by the network control unit according to the MCU reference information.
And S403, determining a terminal to be used as the MCU according to the acquired terminal evaluation data.
S404, if the terminal to be used as the MCU is the terminal, switching to the MCU working mode.
It can be seen that in this embodiment, it is not necessary for the network control unit to determine which terminal is used as the MCU, but it is determined by each terminal. For each terminal, terminal evaluation data of other terminals including the terminal can be obtained by collecting MCU reference information, and then the terminal evaluation data is compared to know which terminal is most suitable as MCU.
Because the MCU reference information collection algorithm, the calculation terminal evaluation data algorithm, the evaluation terminal evaluation data algorithm and the like of each terminal are the same, the finally obtained results of each terminal are consistent, that is, objects suitable for being used as the MCU all point to the same terminal. The terminal suitable for serving as the MCU can automatically switch itself to be in the MCU working mode, namely, the terminal starts to bear the MCU responsibility, and other terminals correspondingly treat the terminal as the MCU. In addition, the network control unit can be informed of the MCU selection result, so that the network control unit can develop some possible coordination work.
It should be noted that, in some cases, more than one terminal may win the comparison result, that is, more than one terminal is suitable for being used as the MCU, and in order to cope with such cases, the same rule may be preset in each terminal for further screening. For example, each terminal may be assigned a unique serial number (e.g., the serial number represents the sequence in which the terminals join the conference), and then when more than one terminal is suitable as the MCU, the terminal that joined the conference earliest (or the latest) may be selected from the suitable terminals and finally used as the MCU.
In addition, it should be noted that, in some special cases, the MCU reference information collected by some terminals may be incomplete due to such problems, which may lead to the considered suitable object of the MCU being inconsistent with that of other terminals, and such special cases are out of the discussion range of the present invention.
In this embodiment or some other embodiments of the present invention, one or more contents included in the MCU reference information may include: network information and/or terminal information.
Further, the network information may include network topology information and/or network load information, the network topology information includes physical topology information and/or logical topology information, and the network load information includes traffic information on a path and/or information whether the path is overloaded;
the terminal information may include hardware information, software information, and/or status information of the terminal.
In this embodiment or some other embodiment of the invention:
when the MCU reference information includes network information, the collecting multipoint control unit MCU reference information includes:
extracting the network information from a message sent (e.g., broadcast, multicast, or unicast) by the network control element;
when the MCU reference information includes terminal information, the collecting multipoint control unit MCU reference information includes:
terminal information of other terminals is extracted in communication with the other terminals.
In this embodiment or some other embodiments of the present invention, the obtaining, according to the MCU reference information, terminal evaluation data of the terminal and other terminals other than the terminal controlled by the network control unit includes:
and respectively calculating the terminal and other terminals except the terminal according to various items of quantized MCU reference information to acquire terminal evaluation data of the terminal and other terminals except the terminal.
In this embodiment or some other embodiments of the present invention, determining a terminal to be used as an MCU according to the obtained terminal evaluation data includes:
determining a terminal to be used as an MCU according to the relation between the terminal evaluation data and a preset terminal evaluation data threshold value; alternatively, the first and second electrodes may be,
and determining the terminal corresponding to the extreme value in the terminal evaluation data as the terminal to be used as the MCU.
The details of the above steps, various processing manners, and the like can be referred to the detailed description in the foregoing embodiments, and are not repeated in this embodiment.
In the embodiment, by collecting the MCU reference information required for determining the terminal as the MCU, the condition of the network where the terminal is located and/or the condition of the terminal itself can be known, so that an optimal terminal can be dynamically and automatically determined as the MCU, the powerful capability of the terminal can be fully exerted, services such as forwarding and transcoding of audio and video data can be provided for other terminals, and the stability of multiparty conference communication can be improved. In addition, the burden of other terminals with poor capability can be reduced, the situation that the terminal with the worst condition becomes a short board of the system so that only the video format with the lowest code rate and the smallest occupied bandwidth can be selected for communication is avoided, the working efficiency of the multiparty real-time communication system is improved, the practicability of the system is enhanced, and the multiparty real-time communication system can be really put to commercial use.
EXAMPLE five
The invention is further described below in connection with a specific scenario.
Fig. 5 is a schematic networking diagram of a fifth embodiment of the present invention. In the present embodiment, the network control unit is served by the signaling server 500, and the terminals include a terminal 501 (notebook computer), a terminal 502 (notebook computer), a terminal 503 (mobile phone), and a terminal 504 (desktop computer).
Fig. 6 is a signaling diagram of a fifth embodiment of the present invention.
S601, the terminal 501 joins the video conference for the first time and reports the relevant information of the signaling server. So that the signalling server collects part of the MCU reference information.
S602, the terminal 502 joins the video conference for the second time, and reports the relevant information of the signaling server.
S603, the signaling server transmits the information of the conference participants to the terminal 501 and the terminal 502.
S604, the signaling server finally determines the terminal 501 to be MCU according to the information of the two terminals and the collected network information through quantitative weighting calculation, and sends the result to the terminal 501.
And S605, the terminal 503 at a certain time joins the video conference for the third time, and reports the relevant information of the signaling server.
S606, the signaling server transmits the information of the conference participants to the terminals 501, 502, 503.
S607, the signaling server determines to continue to act as the MCU by the terminal 501 after performing the re-weighting calculation, and sends the result to the terminal 501.
S608, at a certain time, the terminal 504 joins the video conference fourth, and reports the relevant information of the signaling server itself.
S609, the signaling server transmits the information of the conference participants to the terminals 501, 502, 503, and 504.
S610, the signaling server determines to act as the MCU by the terminal 504 after performing the re-weighting calculation, and sends the result to the terminal 504.
Fig. 7 is a schematic diagram of the MCU of fig. 6 after step S610, when the MCU is operated by the terminal 504.
As for the terminal 501, the decision to change the terminal 504 to act as an MCU may also be sent to the terminal 501 so that the terminal 501 starts to operate as a normal terminal. Or it may be designed to start operating in the manner of a normal terminal if the terminal 501 does not receive an instruction to continue to operate as an MCU within a predetermined time.
In the embodiment, by collecting the MCU reference information required for determining the terminal as the MCU, the condition of the network where the terminal is located and/or the condition of the terminal itself can be known, so that an optimal terminal can be dynamically and automatically determined as the MCU, the powerful capability of the terminal can be fully exerted, services such as forwarding and transcoding of audio and video data can be provided for other terminals, and the stability of multiparty conference communication can be improved. In addition, the burden of other terminals with poor capability can be reduced, the situation that the terminal with the worst condition becomes a short board of the system so that only the video format with the lowest code rate and the smallest occupied bandwidth can be selected for communication is avoided, the working efficiency of the multiparty real-time communication system is improved, the practicability of the system is enhanced, and the multiparty real-time communication system can be really put to commercial use.
EXAMPLE six
Fig. 8 is a schematic diagram of a sixth apparatus according to an embodiment of the present invention. This embodiment corresponds to the foregoing method embodiment, and provides a multiparty real-time communication control device, which may be used in a network control unit, where the device may include:
a first MCU reference information collecting unit 801 configured to collect MCU reference information of a multipoint control unit, where the MCU reference information is information required to determine a terminal as an MCU;
a first MCU selecting unit 802, configured to select a terminal as an MCU according to the MCU reference information;
a notifying unit 803, configured to notify the terminal selected as the MCU of the selected result.
Preferably, the MCU reference information comprises one or more of the following: network information and/or terminal information.
Preferably:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or status information of each terminal under the control of the network control unit.
Preferably, when the MCU reference information includes terminal information, the first MCU reference information collecting unit may include:
the message receiving subunit is used for receiving a message which is sent by the terminal and carries the terminal information; alternatively, the first and second electrodes may be,
an information extraction subunit, configured to extract the terminal information from communication with a terminal.
Preferably, the first MCU selecting unit is specifically configured to select, as the MCU, a terminal that meets a specified rule from among the terminals under the control of the network control unit according to the MCU reference information.
Preferably, the first MCU selecting unit may include:
the evaluation data calculation subunit is used for calculating each terminal under the control of the network control unit according to each content in the quantized MCU reference information so as to obtain terminal evaluation data of each terminal;
and the MCU selection subunit is used for selecting the terminal as the MCU according to the terminal evaluation data of each terminal.
Preferably, the MCU selection subunit is specifically configured to select a terminal serving as an MCU according to a relationship between the terminal evaluation data of each terminal and a preset terminal evaluation data threshold, or select a terminal corresponding to an extreme value in the terminal evaluation data of each terminal as an MCU.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
EXAMPLE seven
Fig. 9 is a schematic diagram of a seventh apparatus according to an embodiment of the present invention. This embodiment corresponds to the foregoing method embodiment, and provides a multiparty real-time communication control device, which may be used in a network control unit, where the device may include:
an evaluation data receiving unit 901, configured to receive terminal evaluation data of a terminal from each terminal, where the terminal evaluation data is obtained by quantizing and calculating each content in MCU reference information of a multipoint control unit collected by the terminal, and the MCU reference information is information required for determining a terminal serving as an MCU;
a second MCU selecting unit 902, configured to select a terminal as an MCU according to the terminal evaluation data sent by each terminal;
a notifying unit 903, configured to notify the selected terminal as the MCU to the selected result.
Preferably, the second MCU selecting unit is specifically configured to select a terminal serving as an MCU according to a relationship between the terminal evaluation data sent by each terminal and a preset terminal evaluation data threshold, or select a terminal corresponding to an extreme value in the terminal evaluation data sent by each terminal as an MCU.
Referring to fig. 10, the present embodiment further provides a multiparty real-time communication control device, which may be used for a terminal, and the device may include:
a second MCU reference information collecting unit 1001 configured to collect MCU reference information of a multipoint control unit, where the MCU reference information is information required to determine a terminal as an MCU;
the terminal evaluation data acquisition unit 1002 is configured to acquire terminal evaluation data of the terminal according to the MCU reference information;
an evaluation data transmitting unit 1003, configured to transmit the terminal evaluation data of the terminal to the network control unit.
Preferably, the MCU reference information comprises one or more of the following: network information and/or terminal information.
Preferably:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or state information of the terminal.
Preferably, when the MCU reference information includes network information, the second MCU reference information collecting unit is specifically configured to extract the network information from a message sent by the network control unit.
Preferably, the terminal evaluation data obtaining unit is specifically configured to calculate the terminal according to each item of content in the quantized MCU reference information, so as to obtain the terminal evaluation data of the terminal.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Example eight
Fig. 11 is a schematic diagram of an eighth apparatus according to an embodiment of the present invention. This embodiment corresponds to the foregoing method embodiment, and provides a multiparty real-time communication control device, which may be used in a terminal, where the device may include:
a third MCU reference information collecting unit 1101, configured to collect MCU reference information of a multipoint control unit, where the MCU reference information is information required for determining a terminal as an MCU;
the own terminal and other terminal evaluation data acquisition unit 1102 is configured to acquire terminal evaluation data of other terminals except the own terminal, which are controlled by the own terminal and the network control unit, according to the MCU reference information;
and a third MCU selecting unit 1103, configured to determine, according to the obtained terminal evaluation data, a terminal that should be used as an MCU, and switch to an MCU operating mode if the terminal that should be used as the MCU is the terminal itself.
Preferably, the MCU reference information comprises one or more of the following: network information and/or terminal information.
Preferably:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or status information of the terminal.
Preferably:
when the MCU reference information includes network information, the third MCU reference information collection unit is specifically configured to extract the network information from a message sent by the network control unit;
when the MCU reference information includes terminal information, the third MCU reference information collecting unit is specifically configured to extract the terminal information of the other terminal in communication with the other terminal.
Preferably, the own terminal and other terminal evaluation data obtaining unit is specifically configured to calculate the own terminal and other terminals except the own terminal according to each item of content in the quantized MCU reference information, so as to obtain the terminal evaluation data of the own terminal and other terminals except the own terminal.
Preferably, the third MCU selecting unit is specifically configured to determine a terminal that should be used as an MCU according to a relationship between the terminal evaluation data and a preset terminal evaluation data threshold, or determine a terminal corresponding to an extreme value in the terminal evaluation data as a terminal that should be used as an MCU.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Example nine
FIG. 12 is a diagram of a nine-system embodiment of the present invention. The present embodiment corresponds to the above method and apparatus embodiments, and provides a multiparty real-time communication system, which includes a network control unit 1201 and at least two terminals 1202;
the network control unit 1201 is configured to send a request for acquiring terminal information to the terminal, collect MCU reference information of a multipoint control unit, where the MCU reference information is information required to determine a terminal serving as an MCU, select the terminal serving as the MCU according to the MCU reference information, and notify the selected terminal serving as the MCU of the selected result, where the MCU reference information includes one or more of the following: network information and/or terminal information;
the terminal 1202 is configured to send the terminal information of the terminal to the network control unit according to the request for obtaining the terminal information.
The embodiment also provides another multiparty real-time communication system, which comprises a network control unit and at least two terminals;
the terminal is used for collecting MCU reference information of a multipoint control unit, the MCU reference information is information required by the terminal used for determining the MCU, terminal evaluation data of the terminal are obtained according to the MCU reference information, the terminal evaluation data are obtained by calculation after quantification according to various contents in the MCU reference information, and the terminal evaluation data of the terminal are sent to a network control unit;
and the network control unit is used for receiving the terminal evaluation data of the terminal sent by each terminal, selecting the terminal as the MCU according to the terminal evaluation data, and informing the selected terminal as the MCU of the selected result.
For the system embodiment, since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment for relevant points. The above-described system embodiments are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Example ten
Fig. 13 is a schematic diagram of a tenth system according to an embodiment of the present invention. The embodiment corresponds to the above method and device embodiments, and provides a multiparty real-time communication system, which comprises at least two terminals 1301;
the terminal 1301 is configured to collect MCU reference information of a multipoint control unit, where the MCU reference information is information required to determine a terminal serving as an MCU, acquire terminal evaluation data of the terminal and other terminals controlled by the network control unit other than the terminal according to the MCU reference information, determine a terminal to be used as an MCU according to the acquired terminal evaluation data, and switch to an MCU operating mode if the terminal to be used as an MCU is the terminal.
In fig. 13, a terminal 1301a is a terminal 1301 selected as an MCU and takes charge of the MCU, and other terminals 1301 (e.g., terminals 1301b, 1301c, 1301d, and 1301e) regard the terminal 1301a as an MCU.
For the system embodiment, since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment for relevant points. The above-described system embodiments are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
In the embodiment, by collecting the MCU reference information required for determining the terminal as the MCU, the condition of the network where the terminal is located and/or the condition of the terminal itself can be known, so that an optimal terminal can be dynamically and automatically determined as the MCU, the powerful capability of the terminal can be fully exerted, services such as forwarding and transcoding of audio and video data can be provided for other terminals, and the stability of multiparty conference communication can be improved. In addition, the burden of other terminals with poor capability can be reduced, the situation that the terminal with the worst condition becomes a short board of the system so that only the video format with the lowest code rate and the smallest occupied bandwidth can be selected for communication is avoided, the working efficiency of the multiparty real-time communication system is improved, the practicability of the system is enhanced, and the multiparty real-time communication system can be really put to commercial use.
The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
Those skilled in the art will appreciate that all or part of the steps in the above method embodiments may be implemented by a program to instruct relevant hardware to perform the steps, and the program may be stored in a computer-readable storage medium, which is referred to herein as a storage medium, such as: ROM, RAM, magnetic disk, optical disk, etc.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. The principles and embodiments of the present invention have been described herein using specific examples, which are presented solely to aid in the understanding of the methods and their core concepts; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the above, the present disclosure should not be construed as limiting the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (30)
1. A multiparty real-time communication control method, for a network control unit, the method comprising:
collecting MCU reference information of a multi-point control unit, wherein the MCU reference information is information required for determining a terminal as an MCU;
selecting a terminal as an MCU according to the MCU reference information;
the selecting of the terminal as the MCU according to the MCU reference information comprises the following steps:
quantizing each content of the MCU reference information, giving a corresponding weight, respectively carrying out weighted summation on each content quantized value of the MCU reference information of each terminal under the control of the network control unit according to the weight to obtain terminal evaluation data of each terminal, and selecting the terminal as an MCU according to the terminal evaluation data;
the MCU reference information comprises any one or more of: the physical topological position of the terminal in each terminal, the type of the terminal, the computing capacity of the terminal and the state information of the terminal are controlled by the network control unit;
and informing the selected result to the terminal selected as the MCU.
2. The method of claim 1, wherein the MCU reference information comprises one or more of: network information and/or terminal information.
3. The method of claim 2, wherein:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or status information of each terminal under the control of the network control unit.
4. The method according to claim 2, wherein when the MCU reference information includes terminal information, the collecting multipoint control unit MCU reference information comprises:
receiving a message which is sent by a terminal and carries the terminal information; alternatively, the first and second electrodes may be,
the terminal information is extracted from communication with a terminal.
5. The method according to claim 1, wherein the selecting the terminal as the MCU according to the MCU reference information comprises:
and selecting a terminal meeting a specified rule from all terminals under the control of the network control unit as an MCU according to the MCU reference information.
6. The method according to claim 1, wherein the selecting the terminal as the MCU according to the MCU reference information comprises:
calculating each terminal under the control of the network control unit according to each content in the quantized MCU reference information to obtain terminal evaluation data of each terminal;
and selecting the terminal as the MCU according to the terminal evaluation data of each terminal.
7. The method according to claim 6, wherein the selecting the terminal as the MCU according to the terminal evaluation data of each terminal comprises:
selecting the terminal as the MCU according to the relation between the terminal evaluation data of each terminal and a preset terminal evaluation data threshold value; alternatively, the first and second electrodes may be,
and selecting the terminal corresponding to the extreme value in the terminal evaluation data of each terminal as the MCU.
8. A multiparty real-time communication control method, for a network control unit, the method comprising:
receiving terminal evaluation data of each terminal sent by each terminal, wherein the terminal evaluation data are obtained by quantifying and calculating each content in MCU reference information collected by each terminal according to the terminal, and the MCU reference information is information required by determining the terminal as an MCU;
the terminal evaluation data is obtained by quantifying and calculating each content in the MCU reference information collected by each terminal according to the terminal, and comprises the following steps:
quantizing each content of the MCU reference information, giving a corresponding weight value, and weighting and summing each content quantized value of the MCU reference information collected by each terminal according to the weight value to obtain the terminal evaluation data;
selecting a terminal as an MCU according to the terminal evaluation data sent by each terminal;
and informing the selected result to the terminal selected as the MCU.
9. The method according to claim 8, wherein said selecting a terminal as an MCU according to the terminal evaluation data sent from each terminal comprises:
selecting the terminal as the MCU according to the relation between the terminal evaluation data sent by each terminal and a preset terminal evaluation data threshold value; alternatively, the first and second electrodes may be,
and selecting the terminal corresponding to the extreme value in the terminal evaluation data sent by each terminal as the MCU.
10. A multiparty real-time communication control method is used for a terminal, and comprises the following steps:
collecting MCU reference information of a multi-point control unit, wherein the MCU reference information is information required for determining a terminal as an MCU;
acquiring terminal evaluation data of the terminal according to the MCU reference information;
the acquiring of the terminal evaluation data of the terminal according to the MCU reference information includes:
quantizing each content of the MCU reference information, giving a corresponding weight value, and carrying out weighted summation on each content quantized value of the MCU reference information of the terminal according to the weight value to obtain terminal evaluation data of the terminal;
and sending the terminal evaluation data of the terminal to a network control unit so that the network control unit selects the terminal as the MCU according to the terminal evaluation data.
11. The method according to claim 10, wherein the MCU reference information comprises one or more of: network information and/or terminal information.
12. The method of claim 11, wherein:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or state information of the terminal.
13. The method of claim 11, wherein when the MCU reference information comprises network information, the collecting multipoint control unit MCU reference information comprises:
extracting the network information from a message sent by the network control unit.
14. The method according to claim 10, wherein the obtaining terminal evaluation data of the terminal according to the MCU reference information comprises:
and calculating the terminal according to each content in the quantized MCU reference information to obtain terminal evaluation data of the terminal.
15. A multiparty real-time communication control device, for a network control unit, the device comprising:
the first MCU reference information collection unit is used for collecting MCU reference information of the multipoint control unit, and the MCU reference information is information required for determining a terminal as an MCU;
the first MCU selecting unit is used for selecting a terminal as an MCU according to the MCU reference information; the selecting of the terminal as the MCU according to the MCU reference information comprises the following steps: quantizing each content of the MCU reference information, giving a corresponding weight, carrying out weighted summation on each content quantized value of the MCU reference information of each terminal under the control of the network control unit according to the weight to obtain terminal evaluation data of each terminal, and selecting the terminal as an MCU according to the terminal evaluation data;
the MCU reference information comprises any one or more of: the physical topological position of the terminal in each terminal, the type of the terminal, the computing capacity of the terminal and the state information of the terminal are controlled by the network control unit;
and the notification unit is used for notifying the selected terminal as the MCU of the selected result.
16. The apparatus of claim 15, wherein the MCU reference information comprises one or more of: network information and/or terminal information.
17. The apparatus of claim 16, wherein:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or status information of each terminal under the control of the network control unit.
18. The apparatus according to claim 16, wherein when the MCU reference information comprises terminal information, the first MCU reference information collecting unit comprises:
the message receiving subunit is used for receiving a message which is sent by the terminal and carries the terminal information; or, an information extraction subunit, configured to extract the terminal information from communication with a terminal.
19. The apparatus according to claim 15, wherein the first MCU selecting unit is specifically configured to select, as the MCU, a terminal that meets a specified rule from among the terminals under control of the network control unit according to the MCU reference information.
20. The apparatus of claim 15, wherein the first MCU choosing unit comprises:
the evaluation data calculation subunit is used for calculating each terminal under the control of the network control unit according to each content in the quantized MCU reference information so as to obtain terminal evaluation data of each terminal;
and the MCU selection subunit is used for selecting the terminal serving as the MCU according to the terminal evaluation data of each terminal.
21. The apparatus according to claim 20, wherein the MCU selecting subunit is specifically configured to select the terminal serving as the MCU according to a relationship between the terminal evaluation data of each terminal and a preset terminal evaluation data threshold, or select the terminal corresponding to an extreme value in the terminal evaluation data of each terminal as the MCU.
22. A multiparty real-time communication control device, for a network control unit, the device comprising:
the system comprises an evaluation data receiving unit, a multipoint control unit and a multipoint control unit MCU, wherein the evaluation data receiving unit is used for receiving terminal evaluation data of a terminal sent by each terminal, the terminal evaluation data are obtained by quantifying and calculating each content in MCU reference information collected by the terminal, and the MCU reference information is information required by determining the terminal as an MCU;
the terminal evaluation data is obtained by quantifying and calculating each content in the MCU reference information collected by each terminal according to the terminal, and comprises the following steps:
quantizing each content of the MCU reference information, giving a corresponding weight value, and weighting and summing each content quantized value of the MCU reference information collected by each terminal according to the weight value to obtain the terminal evaluation data;
the second MCU selection unit is used for selecting terminals as MCU according to the terminal evaluation data sent by each terminal;
and the notification unit is used for notifying the selected terminal as the MCU of the selected result.
23. The apparatus according to claim 22, wherein the second MCU selecting unit is specifically configured to select the terminal serving as the MCU according to a relationship between the terminal evaluation data sent by each terminal and a preset terminal evaluation data threshold, or select the terminal corresponding to an extreme value in the terminal evaluation data sent by each terminal as the MCU.
24. A multiparty real-time communication control device, for a terminal, the device comprising:
the second MCU reference information collection unit is used for collecting MCU reference information of the multipoint control unit, wherein the MCU reference information is information required for determining a terminal used as an MCU;
the terminal evaluation data acquisition unit is used for acquiring the terminal evaluation data of the terminal according to the MCU reference information;
the terminal evaluation data acquisition unit is configured to acquire terminal evaluation data of the terminal according to the MCU reference information, and includes:
quantizing each content of the MCU reference information, giving a corresponding weight value, and carrying out weighted summation on each content quantized value of the MCU reference information of the terminal according to the weight value to obtain terminal evaluation data of the terminal;
and the evaluation data sending unit is used for sending the terminal evaluation data of the terminal to the network control unit so that the network control unit selects the terminal as the MCU according to the terminal evaluation data.
25. The apparatus of claim 24, wherein the MCU reference information comprises one or more of: network information and/or terminal information.
26. The apparatus of claim 25, wherein:
the network information comprises network topology information and/or network load information, the network topology information comprises physical topology information and/or logic topology information, and the network load information comprises traffic information on a path and/or information whether the path is overloaded;
the terminal information includes hardware information, software information and/or state information of the terminal.
27. The apparatus according to claim 25, wherein when the MCU reference information comprises network information, the second MCU reference information collecting unit is specifically configured to extract the network information from a message sent by the network control unit.
28. The apparatus according to claim 24, wherein the terminal evaluation data obtaining unit is specifically configured to perform calculation on the terminal according to each item of quantized MCU reference information to obtain terminal evaluation data of the terminal.
29. A multi-party real-time communication system is characterized by comprising a network control unit and at least two terminals;
the network control unit is used for sending a request for acquiring terminal information to the terminal, collecting MCU reference information of a multipoint control unit, wherein the MCU reference information is information required for determining a terminal used as an MCU, selecting the terminal used as the MCU according to the MCU reference information, and informing the selected terminal used as the MCU of the selected result, and the MCU reference information comprises one or more of the following contents: network information and/or terminal information;
the network control unit is used for selecting a terminal as an MCU according to the MCU reference information, and comprises:
quantizing each content of the MCU reference information, giving a corresponding weight, respectively carrying out weighted summation on each content quantized value of the MCU reference information of each terminal under the control of the network control unit according to the weight to obtain terminal evaluation data of each terminal, and selecting the terminal as an MCU according to the terminal evaluation data;
and the terminal is used for sending the terminal information of the terminal to the network control unit according to the request for obtaining the terminal information.
30. A multi-party real-time communication system is characterized by comprising a network control unit and at least two terminals;
the terminal is used for collecting MCU reference information of a multipoint control unit, the MCU reference information is information required by the terminal used for determining the MCU, terminal evaluation data of the terminal are obtained according to the MCU reference information, the terminal evaluation data are obtained by calculation after quantification according to various contents in the MCU reference information, and the terminal evaluation data of the terminal are sent to a network control unit;
the terminal is used for acquiring the terminal evaluation data of the terminal according to the MCU reference information, and comprises the following steps:
quantizing each content of the MCU reference information, giving a corresponding weight value, and carrying out weighted summation on each content quantized value of the MCU reference information of the terminal according to the weight value to obtain terminal evaluation data of the terminal;
and the network control unit is used for receiving the terminal evaluation data of the terminal sent by each terminal, selecting the terminal as the MCU according to the terminal evaluation data, and informing the selected terminal as the MCU of the selected result.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2014/071928 WO2015117277A1 (en) | 2014-02-10 | 2014-02-10 | Method, apparatus and system for controlling multiparty real-time communication |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105379179A CN105379179A (en) | 2016-03-02 |
| CN105379179B true CN105379179B (en) | 2020-05-08 |
Family
ID=53777120
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201480000186.9A Active CN105379179B (en) | 2014-02-10 | 2014-02-10 | Multi-party real-time communication control method, device and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105379179B (en) |
| WO (1) | WO2015117277A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9787727B2 (en) | 2015-12-17 | 2017-10-10 | International Business Machines Corporation | VoIP call quality |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1297309A (en) * | 2000-02-01 | 2001-05-30 | 深圳市中兴通讯股份有限公司 | Method for increasing capacity of video conference system |
| CN1820505A (en) * | 2003-07-07 | 2006-08-16 | 泰德通信公司 | Distributed MCU |
| CN101047828A (en) * | 2006-03-31 | 2007-10-03 | 联想(北京)有限公司 | Distribution conference system |
| CN101047531A (en) * | 2006-03-31 | 2007-10-03 | 联想(北京)有限公司 | Distributed conference system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6414707B1 (en) * | 1998-10-16 | 2002-07-02 | At&T Corp. | Apparatus and method for incorporating virtual video conferencing environments |
| CN100496117C (en) * | 2006-12-04 | 2009-06-03 | 中国联合通信有限公司 | Resource allocating method in video frequency conference |
| CN1964475A (en) * | 2006-12-06 | 2007-05-16 | 杭州华为三康技术有限公司 | A realization method for video conference, control device and user terminal |
| US8854418B2 (en) * | 2011-05-23 | 2014-10-07 | Broadcom Corporation | Integrated media gateway processing and control to reduce latency for 2-way video conference applications |
| CN102739668B (en) * | 2012-06-26 | 2014-10-29 | 苏州科达科技股份有限公司 | Method for controlling external terminal to attend video conference |
-
2014
- 2014-02-10 WO PCT/CN2014/071928 patent/WO2015117277A1/en active Application Filing
- 2014-02-10 CN CN201480000186.9A patent/CN105379179B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1297309A (en) * | 2000-02-01 | 2001-05-30 | 深圳市中兴通讯股份有限公司 | Method for increasing capacity of video conference system |
| CN1820505A (en) * | 2003-07-07 | 2006-08-16 | 泰德通信公司 | Distributed MCU |
| CN101047828A (en) * | 2006-03-31 | 2007-10-03 | 联想(北京)有限公司 | Distribution conference system |
| CN101047531A (en) * | 2006-03-31 | 2007-10-03 | 联想(北京)有限公司 | Distributed conference system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2015117277A1 (en) | 2015-08-13 |
| CN105379179A (en) | 2016-03-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110858840B (en) | Method, system and apparatus for real-time multimedia communication technology | |
| CN102365857B (en) | Method and apparatus for the efficient transmission of multimedia streams for teleconferencing | |
| US9538134B2 (en) | Method and system for resource load balancing in a conferencing session | |
| CN104125540A (en) | Multipoint communication device and method of performing switching from multipoint communication to point-to-point communication | |
| Nan et al. | Distributed resource allocation in cloud-based wireless multimedia social networks | |
| CN102377686A (en) | Message subscription system, method and device | |
| CN104901815B (en) | A kind of group technology of user terminal, Conference server, conference system | |
| EP3073732B1 (en) | A method for allocating a video conferencing task to a processing device | |
| CN103716281A (en) | Control method, electronic device and server | |
| CN102469409A (en) | Multimedia conference realization method and device | |
| CN102882769A (en) | Instant communication method, terminal and system, and communication server | |
| CN102905315A (en) | Non-real-time traffic scheduling method, equipment and system | |
| CN106790249A (en) | A kind of server resource dispatching method and device | |
| CN105376718A (en) | LTE trunking communication method, user equipment and first network element equipment | |
| CN108833567B (en) | Selection method and system of optimal data transfer server and scheduling server | |
| CN104469259A (en) | Cloud terminal video synthesis method and system | |
| CN105379179B (en) | Multi-party real-time communication control method, device and system | |
| US9350948B2 (en) | Method and system for providing video service | |
| CN105915355A (en) | Conference control method and device | |
| CN102710920A (en) | Communication terminal calling method, communication terminal and communication system | |
| CN104917620A (en) | Peer-to-peer network conference access method and system, and peer-to-peer network client | |
| US8976225B2 (en) | Method, computer program and device for managing media stream in video conferencing | |
| CN102801953B (en) | Video code stream forwarding control method | |
| CN203984568U (en) | A kind ofly can be turned by point to point call the video conferencing system of tripartite talks | |
| CN102438120A (en) | Mobile terminal and method for realizing teleconference based on same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |