CN102469409A - Multimedia conference realization method and device - Google Patents
Multimedia conference realization method and device Download PDFInfo
- Publication number
- CN102469409A CN102469409A CN2010105334388A CN201010533438A CN102469409A CN 102469409 A CN102469409 A CN 102469409A CN 2010105334388 A CN2010105334388 A CN 2010105334388A CN 201010533438 A CN201010533438 A CN 201010533438A CN 102469409 A CN102469409 A CN 102469409A
- Authority
- CN
- China
- Prior art keywords
- terminal
- audio frequency
- meeting
- server
- main separation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
- H04M3/562—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities where the conference facilities are distributed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
- H04M3/567—Multimedia conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2203/00—Aspects of automatic or semi-automatic exchanges
- H04M2203/50—Aspects of automatic or semi-automatic exchanges related to audio conference
- H04M2203/5045—Selection of bridge/multipoint control unit
Abstract
The invention discloses a multimedia conference realization method, which comprises the following steps that: A, after receiving audio and video data acquisition requests from terminals participating in a conference, a server judges whether the terminals participating in the conference comprise terminals which can serve as a master node or not, executes a step B if the terminals participating in the conference comprise the terminals which can serve as the master node, otherwise executes a step C; B, the server takes the terminal as the master node if one terminal can serve as the master node, and selects one of the terminals as the master node if more than two terminals can serve as the master node, and the selected terminal is used for audio and video data transmission between every two terminals participating in the conference; and C, the server is used for the audio and video data transmission between every two terminals participating in the conference. The invention also discloses a multimedia conference realization device. By the method and the device, not only the load of the server can be reduced, but also the quality of service of the conference can be ensured.
Description
Technical field
The present invention relates to mobile communication technology, particularly a kind of multimedia conferencing implementation method and device.
Background technology
Multimedia conferencing is a kind of network virtual meeting that the network communications technology realizes of passing through; Specifically; Be meant through multiple modes such as image, sound, make a plurality of terminals that on the geographical position, disperse carry out remote information interaction in real time and share, carry out collaborative work.
Traditional multimedia conference system all is based on client/server (C/S; Client/server) framework; Micro-control unit (MCU; Micro Controller Unit) server is a core network element wherein, be used to accomplish functions such as audio mix or switching, video mix or switching, data distribution and meeting control, and the various information flows after will handling is sent to each terminal that adds meeting.But this mode can cause the load of MCU server excessive.
For this reason, propose a kind of distributed structure/architecture in the prior art again, Fig. 1 is the sketch map of existing distributed structure/architecture.As shown in Figure 1, one or more MCU nodes (having expressed 3 MCU nodes among Fig. 1) are set, each one or more terminal of MCU node subordinate, the MCU node is also born by the terminal, is used to accomplish the function of above-mentioned MCU server.The selection of MCU node and quantity can dynamically be confirmed according to the quantity at the terminal that adds meeting and the loading condition that adds each terminal of meeting.Can find out; This mode need not to use the MCU server, does not therefore also just have the excessive problem of load that causes the MCU server, still; Than the MCU server; The performance of aspects such as the computing capability at terminal, bandwidth and stability is all relatively poor, therefore can't effectively ensure the service quality (QoS, Quality of Service) of meeting.
Summary of the invention
In view of this, main purpose of the present invention is to provide a kind of multimedia conferencing implementation method, can reduce the load of server, can ensure the QoS of meeting again.
Another object of the present invention is to provide a kind of multimedia conferencing implement device, can reduce the load of server, can ensure the QoS of meeting again.
For achieving the above object, technical scheme of the present invention is achieved in that
A kind of multimedia conferencing implementation method comprises:
A, when receiving after the audio, video data that the terminal that adds meeting sends obtains request, server confirms to add in each terminal of meeting whether have the terminal that meets as the condition of main separation node, if, execution in step B then, otherwise, execution in step C;
If the qualified terminal of B is one; Then said server with this terminal as the main separation node; If be more than two, then said server is therefrom selected one as the main separation node, and utilizes said main separation node to bear the audio, video data transmission between each terminal that adds meeting;
C, said server by utilizing self are born the audio, video data transmission between each terminal that adds meeting.A kind of multimedia conferencing implement device comprises:
First processing unit is used for notifying second processing unit to carry out self function when receiving after the audio, video data that the terminal that adds meeting sends obtains request;
Said second processing unit is used for confirming whether each terminal that adds meeting exists the terminal that meets as the condition of main separation node, if; And qualified terminal is one; Then with this terminal as the main separation node, and if qualified terminal is more than two; Then therefrom select one as the main separation node; Utilize said main separation node to bear the audio, video data transmission between each terminal that adds meeting, otherwise, the audio, video data transmission of self bearing between each terminal that adds meeting utilized.
It is thus clear that; Adopt technical scheme of the present invention, meet terminal, then utilize its audio, video data of bearing terminal room transmission as the condition of main separation node if exist; Thereby effectively reduce the load of server; If there is not the terminal that meets as the condition of main separation node, then still utilizes server to bear the audio, video data transmission of terminal room, thereby ensured the QoS of meeting.
Description of drawings
Fig. 1 is the sketch map of existing distributed structure/architecture.
Fig. 2 be scheme according to the invention based on network architecture sketch map.
Fig. 3 adds the mode sketch map of meeting for the arbitrary terminal X of the present invention.
Fig. 4 obtains the mode sketch map of the audio, video data at other terminal that adds meeting for the terminal Y of the arbitrary adding meeting of the present invention.
Fig. 5 is the flow chart of multimedia conferencing implementation method embodiment of the present invention.
Fig. 6 is the composition structural representation of multimedia conferencing implement device embodiment of the present invention.
Embodiment
To the problem that exists in the prior art, the multimedia conferencing implementation among the present invention after a kind of improvement of proposition can reduce the load of server, can ensure the QoS of meeting again.
Fig. 2 be scheme according to the invention based on network architecture sketch map.As shown in Figure 2, comprising: platform management server (PMS, Platform Management Server), conference control server (CCS; Conference Control Server) and media control server (MCS; Media Control Server), in addition, also can further comprise encoder server; If encoder server is not set, its function can be integrated in the MCS server.
Wherein, the form that the PMS server can adopt a master one to be equipped with, major function comprises: 1) manage and monitor each server; 2) the storage system maintenance center of multimedia conferencing relevant information; 3) the storage system maintenance center of end message; 4) authority at terminal is carried out authentication and the conference facility resource is distributed.
According to parliamentary dimension, the quantity of CCS server can be one or more, and major function comprises: 1) be responsible for the login management at terminal, and safeguard its online information; 2) the conference facility resource into its distribution is notified in the management of joining meeting to terminal.
According to parliamentary dimension, the quantity of MCS server also can be one or more, and major function comprises:
1) audio, video data of processing terminal obtains request, and notifies corresponding target terminal; 2) audio, video data that sends of receiving target terminal is transmitted to the terminal of the request of sending; 3 carry out audio mixing, mix processing such as screen and transcoding audio, video data as required; 4) state information at each terminal of maintenance and management and deferred message etc., and make a strategic decision in view of the above, the main separation node selected.
Encoder server is the high-performance server that possesses audio frequency and video hardware compression chip, and major function comprises: according to the request of MCS server, the multichannel audio-video frequency digital coding is become one the tunnel, or one road audio, video data is carried out the transcoding of code check etc.
Based on the network architecture shown in Figure 2, Fig. 3 adds the mode sketch map of meeting for the arbitrary terminal X of the present invention.As shown in Figure 3, comprising:
Step 31: the multimedia conferencing sign that the user X that terminal X is corresponding with self selects sends to the CCS server.
If follow-up needs carry out purview certification, can require user X input meeting password so, and the meeting password is further sent to the CCS server.
Step 32:CCS server is transmitted to the PMS server with the multimedia conferencing sign that receives.
If the CCS server has received the meeting password, so the meeting password further is transmitted to the PMS server.
The address of the MCS server that step 33:PMS server is corresponding with the multimedia conferencing sign that receives returns to the CCS server.
If the PMS server has received the meeting password; Can at first carry out purview certification to terminal X so according to the meeting password; If authentication is not passed through; Then process ends if authentication is passed through, then returns to CCS server through information together with the address that the multimedia conferencing that receives identifies corresponding MCS server with authentication.
In addition, if terminal X is the terminal that first adds its selected multimedia conferencing, so in this step; After authentication was passed through, the PMS server needed at first to distribute the MCS server of a correspondence for the multimedia conferencing sign that receives, specifically; Can distribute a MCS server that load is lighter according to the loading condition of each MCS server, and then authentication is returned to the CCS server through information together with the address of the MCS server that is distributed; Certainly; If have only a MCS server, then need not to distribute, directly authentication is returned to the CCS server through information together with the address of this MCS server and get final product.
Step 34:CCS server returns to terminal X with the address of the MCS server that receives.
Step 35: terminal X connects according to the address and the MCS server of the MCS server that receives, and self relevant information is reported the MCS server.
The relevant information that step 36:MCS server will add each terminal of meeting returns to terminal X.
There is new terminal at each terminal that step 37:MCS server notification adds meeting, and promptly terminal X adds, and the relevant information of enclosing terminal X.
Said relevant information can comprise ID and address etc.
Fig. 4 obtains the mode sketch map of the audio, video data at other terminal that adds meeting for the terminal Y of the arbitrary adding meeting of the present invention.As shown in Figure 4, comprising:
Step 41: terminal Y sends audio, video data to the MCS server and obtains request, wherein carries targeted customer's sign.
The targeted customer that step 42:MCS server notification receives identifies corresponding terminal, and promptly target terminal 1 (for distinguishing with follow-up target terminal 2) carries out the transmission of audio, video data.
Step 43: target terminal 1 is gathered audio, video data, and returns to the MCS server.
The audio, video data that step 44:MCS server will be received from target terminal 1 returns to terminal Y.
Step 45: terminal Y sends audio, video data to the MCS server and obtains request, wherein carries another targeted customer's sign.
The targeted customer that step 46:MCS server notification receives identifies corresponding terminal, and promptly target terminal 2 carries out the transmission of audio, video data.
Step 47: target terminal 2 is gathered audio, video data, and returns to the MCS server.
The audio, video data that step 48:MCS server will be received from target terminal 2 returns to terminal Y.
In practical application, for saving bandwidth, the MCS server can become one the tunnel with the multichannel audio-video frequency digital coding, returns to terminal Y in the lump.
Basic identical in implementation and the prior art shown in Fig. 3 and 4, difference only is the function of MCU server of the prior art has been distributed on PMS server, CCS server and the MCS server, thereby makes that the function of each server is more single-minded and clear and definite.
Need to prove,, a MCU server only is set, also be fine, the realization of scheme according to the invention is not had substantial influence if according to existing mode.
For reducing the load of server; Ensure the QoS of meeting simultaneously, in the scheme according to the invention, behind each joining meeting to terminal; Can periodically obtain the state information of self; Comprise CPU (CPU, Central Processing Unit) utilance, audio frequency and video input bandwidth and audio frequency and video output bandwidth etc., and report the MCS server; In addition, also can periodically obtain self and other and add the deferred message between each terminal of meeting, and report the MCS server.The cycle of uploaded state information can be identical with the cycle that reports deferred message, also can be different.How to obtain state information and deferred message is prior art.
After the MCS server received the state information and deferred message of each terminal to report that adds meeting, form that can form was preserved, and periodicity upgrades, shown in table one and table two:
| Cpu busy percentage | Audio frequency and video input bandwidth | The audio frequency and video output bandwidth | |
| The terminal 1 that adds meeting | |||
| The terminal 2 that adds meeting | |||
| ?...... | |||
| The terminal n that adds meeting |
The preserving type of table one state information
| The terminal 1 that adds meeting | The terminal 2 that adds meeting | ...... | The terminal n that adds meeting | |
| The terminal 1 that adds meeting | ||||
| The terminal 2 that adds meeting | ||||
| ?...... | ||||
| The terminal n that adds meeting |
The preserving type of table two deferred message
Follow-up, when receiving after the audio, video data that sends from the arbitrary terminal that adds meeting obtains request at every turn, the MCS server all can confirm whether there is the terminal that meets as the condition of main separation node in each terminal of adding meeting according to the information of being preserved in table one and the table two; If; And qualified terminal is one, then with this terminal as the main separation node, if be more than two; Then therefrom select one as the main separation node; And utilize the main separation node to bear the audio, video data transmission between each terminal that adds meeting, otherwise, the audio, video data transmission of self bearing between each terminal that adds meeting utilized.
That is to say; Meet terminal if exist as the condition of main separation node; Then utilize its audio, video data of bearing terminal room transmission, thereby effectively reduce the load of MCS server, if there is not the terminal that meets as the condition of main separation node; Then still utilize the MCS server to bear the audio, video data transmission of terminal room, thereby ensured the QoS of meeting.
Based on above-mentioned introduction, Fig. 5 is the flow chart of multimedia conferencing implementation method embodiment of the present invention.As shown in Figure 5, comprising:
The audio, video data that step 51～send at arbitrary terminal of 52:MCS server reception adding meeting obtains request; Whether there is the terminal that meets as the condition of main separation node in each terminal of definite adding meeting, if then execution in step 53; Otherwise, execution in step 54.
In this step; The MCS server is according to the state information that reports at each terminal that adds meeting; I.e. information shown in the table one; Whether there is the terminal that meets as the condition of main separation node in each terminal of definite adding meeting; The concrete realization comprises: cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth that will add each terminal of meeting compare with the total cpu utilization of multimedia conferencing, total audio frequency and video input bandwidth and total audio frequency and video output bandwidth respectively; If the cpu busy percentage at a terminal is wider than more than or equal to total cpu utilization, audio frequency and video input tape or equals total audio frequency and video input bandwidth, and the audio frequency and video output bandwidth confirms then that more than or equal to total audio frequency and video output bandwidth this terminal is qualified terminal.How to confirm that total cpu utilization, total audio frequency and video input bandwidth and total audio frequency and video output bandwidth are prior art.
In addition; For the ease of finding qualified terminal; Also can the terminal that meet with set condition in each terminal that add meeting be divided into one group; Obtain dividing into groups more than one, the link between each divides into groups is independently of one another, and confirms cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of each grouping.The audio frequency and video input and output link that all comprises some during each divides into groups.In the audio frequency and video of viewing terminal B and terminal C, and the audio frequency and video of terminal B and terminal C are only watched by terminal A, so then can terminal A, terminal B and terminal C be divided into one group such as, terminal A.Cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth how to confirm each grouping are prior art.
In this step; If do not exist cpu busy percentage to be wider than or equal total audio frequency and video and import bandwidth more than or equal to total cpu utilization, audio frequency and video input tape; And the audio frequency and video output bandwidth is more than or equal to the terminal of total audio frequency and video output bandwidth; Then the MCS server can compare cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth at each terminal that adds meeting respectively with cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of each grouping; If all corresponding cpu busy percentage more than or equal to a grouping of the cpu busy percentage at a terminal, audio frequency and video input bandwidth and audio frequency and video output bandwidth, audio frequency and video input bandwidth and audio frequency and video output bandwidth confirm that then this terminal is qualified terminal.
Step 53: if qualified terminal is one; Then the MCS server with this terminal as the main separation node; If be more than two, then the MCS server is therefrom selected one as the main separation node, and utilizes the main separation node to bear the audio, video data transmission between each terminal that adds meeting.
In this step; If determine qualified terminal more than two according to ungrouped mode; Can therefrom select one so in such a way as the main separation node: the MCS server calculates each qualified terminal and other respectively and adds the delay summation between each terminal of meeting, and the terminal that result of calculation is minimum is as the main separation node.
If the mode according to dividing into groups is determined qualified terminal more than two; Can therefrom select one so in such a way as the main separation node: the MCS server calculates the delay summation between each terminal in each qualified terminal and its corresponding packet respectively, and the terminal that result of calculation is minimum is as the main separation node; Said corresponding packet is: cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth are all less than self grouping.
Below in conjunction with example, explanation is further done in the concrete realization of step 52～53:
Example one
The number of terminals of supposing current adding meeting is total up to 10; Be respectively terminal A～terminal J; Wherein, The cpu busy percentage of terminal A and terminal B, audio frequency and video input bandwidth and audio frequency and video output bandwidth are all corresponding to total cpu utilization, total audio frequency and video input bandwidth and total audio frequency and video output bandwidth, so terminal A and terminal B are confirmed as qualified terminal.
Afterwards, difference computing terminal A and the delay summation at other 9 terminals and the delay summation at terminal B and other 9 terminals, and the terminal that result of calculation is less is as the main separation node.
Example two
The number of terminals of supposing current adding multimedia conferencing is total up to 10; Be respectively terminal A～terminal J; Co-exist in two groupings; Be respectively divide into groups 1 with divide into groups 2, at first, cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth at 10 terminals are compared with divide into groups 1 cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth respectively; Suppose all corresponding cpu busy percentage more than or equal to grouping 1 of cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of terminal A and terminal B, terminal A and terminal B are qualified terminal so; Afterwards; Cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of 10 terminals (also no longer comparison terminal A and terminal B) are compared with divide into groups 2 cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth respectively; Suppose all corresponding cpu busy percentage more than or equal to grouping 2 of cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of terminal C and terminal D, terminal C and terminal D also are qualified terminal so.
Afterwards; The delay summation at each terminal in computing terminal A and the grouping 1 (divides into groups 1 if terminal A is arranged in respectively; Time-delay between self and self can be defaulted as 0 so), the delay summation at delay summation, the terminal C at terminal B and each terminal in 1 of dividing into groups and each terminal in 2 of dividing into groups; And the delay summation at each terminal in terminal D and the grouping 2, and the terminal that result of calculation is minimum is as the main separation node.
Need to prove that the mode of above-mentioned definite main separation node is merely and illustrates, in practical application; Also can adopt other mode, such as from terminal A, terminal B, terminal C and terminal D, selecting one at random as the main separation node, perhaps; From terminal A and terminal B, select a result of calculation smaller; From terminal C and terminal D, select a result of calculation smaller, from two smallers, select one at random as the main separation node, concrete implementation is not limit.
In this step, determine the main separation node after, MCS server notification main separation node starts service, the main separation node possibly opened a new port, and port information is returned to the MCS server; The MCS server sends to each terminal that adds meeting with the port information of main separation node; And each terminal of notice adding meeting utilizes the main separation node to carry out the transmission of audio, video data; After each terminal of adding meeting receives the port information of main separation node; Return definite information to the MCS server, and utilize the main separation node to carry out the audio, video data transmission.
In addition; The main separation node can be periodically sends heartbeat message to the MCS server, so as the MCS server know self with the main separation node between be connected and whether interrupt, and; When s own situation does not allow to continue as the main separation node; When having opened more video window such as self, the main separation node can send main separation node reselection request to the MCS server, promptly asks the MCS server to reselect the main separation node.Correspondingly; Do not receive heartbeat message yet if surpass scheduled duration, or receive reselection request, then whether have the terminal that meets as the condition of main separation node in each terminal of the definite again adding meeting of MCS server from the main separation node from the main separation node; If; Then execution in step 53, otherwise, execution in step 54.
Step 54:MCS server by utilizing self is born the audio, video data transmission between each terminal that adds meeting.
This step specifically be embodied as prior art.
Follow-up, when the MCS server receives after the audio, video data that sends at arbitrary terminal obtains request once more, confirm to add in each terminal of meeting whether have the terminal that meets as the condition of main separation node again; If; Then execution in step 53, otherwise, execution in step 54.
Can find out; Whether trigger the MCS server confirms again to add and exist the condition that meets as the terminal of the condition of main separation node to have 3 in each terminal of meeting: one is to surpass scheduled duration not receive the heartbeat message from the main separation node yet; Another is the reselection request that receives from the main separation node, and another is that the audio, video data that receives from arbitrary terminal obtains request.
So far, promptly accomplished introduction about the inventive method embodiment.
Based on above-mentioned introduction, Fig. 6 is the composition structural representation of multimedia conferencing implement device embodiment of the present invention.As shown in Figure 6, comprising:
First processing unit 61 is used for notifying second processing unit 62 to carry out self function when receiving after the audio, video data that the terminal that adds meeting sends obtains request;
Wherein, can specifically comprise (, not shown) in second processing unit 62 for simplifying accompanying drawing:
First handles subelement, is used to receive the state information that each terminal periodic property of adding meeting reports, and comprising: cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth, and send to second and handle subelement;
Second handles subelement; Whether each terminal that is used for confirm adding meeting exists cpu busy percentage to be wider than or to equal total audio frequency and video input bandwidth of multimedia conferencing more than or equal to total cpu utilization, the audio frequency and video input tape of multimedia conferencing, and the audio frequency and video output bandwidth is more than or equal to the terminal of total audio frequency and video output bandwidth of multimedia conferencing, if; Confirm that then this terminal is qualified terminal; And when being one at qualified terminal, with this terminal as the main separation node, when qualified terminal is two when above; Therefrom select one as the main separation node; And utilize the main separation node to bear the audio, video data transmission between each terminal that adds meeting, otherwise, the audio, video data transmission of self bearing between each terminal that adds meeting utilized.
First handles subelement can be further used for, and receives the deferred message between each the terminal periodic property that adds meeting each terminal that report and other adding meeting, and sends to the second processing subelement; When qualified terminal is two when above, second handles subelement calculates each qualified terminal respectively and adds the delay summation between each terminal of meeting with other, with the terminal of result of calculation minimum as the main separation node.
In addition; Second handles subelement also can be further used for; The terminal that meets with set condition in each terminal that adds meeting is divided into one group; Obtain dividing into groups more than one, the link between each divides into groups is independently of one another, and confirms cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of each grouping; If do not exist cpu busy percentage to be wider than or equal total audio frequency and video and import bandwidth more than or equal to total cpu utilization, audio frequency and video input tape; And the audio frequency and video output bandwidth is more than or equal to the terminal of total audio frequency and video output bandwidth; Cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth that then will add each terminal of meeting compares with cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of each grouping respectively; If all corresponding cpu busy percentage more than or equal to a grouping of the cpu busy percentage at a terminal, audio frequency and video input bandwidth and audio frequency and video output bandwidth, audio frequency and video input bandwidth and audio frequency and video output bandwidth confirm that then this terminal is qualified terminal; Calculate the delay summation between each terminal in each qualified terminal and its corresponding packet when qualified terminal is two respectively when above, the terminal that result of calculation is minimum is as the main separation node; Corresponding packet is: cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth are all less than self grouping.
Also can further comprise in the device shown in Figure 6: the 3rd processing unit 63; Be used to receive the heartbeat message that the main separation node periodically sends; And, notify second processing unit 62 to repeat self function after not receiving heartbeat message yet or receive reselection request from the main separation node above scheduled duration.
The concrete workflow of device embodiment shown in Figure 6 repeats no more please with reference to the respective description among the said method embodiment here.
In a word, adopt technical scheme of the present invention, can reduce the load of server, can ensure the QoS of meeting again.
The above is merely preferred embodiment of the present invention, and is in order to restriction the present invention, not all within spirit of the present invention and principle, any modification of being made, is equal to replacement, improvement etc., all should be included within the scope that the present invention protects.
Claims (14)
1. a multimedia conferencing implementation method is characterized in that, comprising:
A, when receiving after the audio, video data that the terminal that adds meeting sends obtains request, server confirms to add in each terminal of meeting whether have the terminal that meets as the condition of main separation node, if, execution in step B then, otherwise, execution in step C;
If the qualified terminal of B is one; Then said server with this terminal as the main separation node; If be more than two, then said server is therefrom selected one as the main separation node, and utilizes said main separation node to bear the audio, video data transmission between each terminal that adds meeting;
C, said server by utilizing self are born the audio, video data transmission between each terminal that adds meeting.
2. method according to claim 1 is characterized in that, this method further comprises: obtain the state information of self to each terminal periodic property of adding meeting, and report said server;
Whether said server confirm adds and to exist the terminal that meets as the condition of main separation node to comprise in each terminal of meeting: said server confirms to add in each terminal of meeting whether have the terminal that meets as the condition of main separation node according to said state information.
3. method according to claim 2 is characterized in that, said state information comprises: central processing unit CPU utilance, audio frequency and video input bandwidth and audio frequency and video output bandwidth;
Whether said server confirm adds according to said state information and exists the terminal that meets as the condition of main separation node to comprise in each terminal of meeting: if the cpu busy percentage at a terminal is wider than or equals total audio frequency and video input bandwidth of said multimedia conferencing more than or equal to total cpu utilization, the audio frequency and video input tape of said multimedia conferencing; And the audio frequency and video output bandwidth confirms then that more than or equal to total audio frequency and video output bandwidth of said multimedia conferencing this terminal is qualified terminal.
4. method according to claim 3 is characterized in that, this method further comprises: each the terminal periodic property ground that adds meeting obtains the deferred message between each terminal of self and other adding meeting, and reports said server;
Said server therefrom selects one to comprise as the main separation node: said server calculates each qualified terminal and other respectively and adds the delay summation between each terminal of meeting, and the terminal that result of calculation is minimum is as said main separation node.
5. method according to claim 4; It is characterized in that; This method further comprises: said server will add the terminal that meets with set condition in each terminal of meeting and be divided into one group; Obtain dividing into groups more than one, the link between each divides into groups is independently of one another, and confirms cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of each grouping;
Whether said server confirm adds according to said state information and exists the terminal that meets as the condition of main separation node to comprise in each terminal of meeting: if do not exist cpu busy percentage to be wider than more than or equal to said total cpu utilization, audio frequency and video input tape or equal said total audio frequency and video input bandwidth; And the audio frequency and video output bandwidth is more than or equal to the terminal of said total audio frequency and video output bandwidth; Cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth that then said server will add each terminal of meeting compares with cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of each grouping respectively; If all corresponding cpu busy percentage more than or equal to a grouping of the cpu busy percentage at a terminal, audio frequency and video input bandwidth and audio frequency and video output bandwidth, audio frequency and video input bandwidth and audio frequency and video output bandwidth confirm that then this terminal is qualified terminal.
6. method according to claim 5; It is characterized in that; Said server therefrom selects one to comprise as the main separation node: said server calculates the delay summation between each terminal in each qualified terminal and its corresponding packet respectively, and the terminal that result of calculation is minimum is as said main separation node; Said corresponding packet is: cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth are all less than self grouping.
7. method according to claim 1; It is characterized in that; This method further comprises: said main separation node periodically sends heartbeat message to said server, and when not allowing when s own situation to continue as the main separation node, sends main separation node reselection request to said server;
If surpassing scheduled duration does not receive said heartbeat message yet or receives the reselection request from said main separation node; Whether there is the terminal that meets as the condition of main separation node in each terminal of the definite again adding meeting of then said server; If; Execution in step B then, otherwise, execution in step C.
8. according to each described method in the claim 1～6, it is characterized in that said server is media control server MCS.
9. a multimedia conferencing implement device is characterized in that, comprising:
First processing unit is used for notifying second processing unit to carry out self function when receiving after the audio, video data that the terminal that adds meeting sends obtains request;
Said second processing unit is used for confirming whether each terminal that adds meeting exists the terminal that meets as the condition of main separation node, if; And qualified terminal is one; Then with this terminal as the main separation node, and if qualified terminal is more than two; Then therefrom select one as the main separation node; Utilize said main separation node to bear the audio, video data transmission between each terminal that adds meeting, otherwise, the audio, video data transmission of self bearing between each terminal that adds meeting utilized.
10. device according to claim 9 is characterized in that, said second processing unit comprises:
First handles subelement, is used to receive the state information that each terminal periodic property of adding meeting reports, and comprising: central processing unit CPU utilance, audio frequency and video input bandwidth and audio frequency and video output bandwidth, and send to second and handle subelement;
Said second handles subelement; Whether each terminal that is used for confirm adding meeting exists cpu busy percentage to be wider than or to equal total audio frequency and video input bandwidth of said multimedia conferencing more than or equal to total cpu utilization, the audio frequency and video input tape of said multimedia conferencing, and the audio frequency and video output bandwidth is more than or equal to the terminal of total audio frequency and video output bandwidth of said multimedia conferencing, if; Confirm that then this terminal is qualified terminal; And when being one at qualified terminal, with this terminal as the main separation node, when qualified terminal is two when above; Therefrom select one as the main separation node; Utilize said main separation node to bear the audio, video data transmission between each terminal that adds meeting, otherwise, the audio, video data transmission of self bearing between each terminal that adds meeting utilized.
11. device according to claim 10; It is characterized in that; Said first handles subelement is further used for, and receives the deferred message between each the terminal periodic property that adds meeting each terminal that report and other adding meeting, and sends to the said second processing subelement;
When qualified terminal is two when above, said second handles subelement calculates each qualified terminal respectively and adds the delay summation between each terminal of meeting with other, with the terminal of result of calculation minimum as said main separation node.
12. device according to claim 11; It is characterized in that; Said second handles subelement is further used for, and the terminal that meets with set condition in each terminal that adds meeting is divided into one group, obtains dividing into groups more than one; Link between each divides into groups is independently of one another, and confirms cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of each grouping; If do not exist cpu busy percentage to be wider than or equal said total audio frequency and video and import bandwidth more than or equal to said total cpu utilization, audio frequency and video input tape; And the audio frequency and video output bandwidth is more than or equal to the terminal of said total audio frequency and video output bandwidth; Cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth that then will add each terminal of meeting compares with cpu busy percentage, audio frequency and video input bandwidth and the audio frequency and video output bandwidth of each grouping respectively; If all corresponding cpu busy percentage more than or equal to a grouping of the cpu busy percentage at a terminal, audio frequency and video input bandwidth and audio frequency and video output bandwidth, audio frequency and video input bandwidth and audio frequency and video output bandwidth confirm that then this terminal is qualified terminal.
13. device according to claim 12; It is characterized in that; When qualified terminal is two when above; Said second handles subelement calculates the delay summation between each terminal in each qualified terminal and its corresponding packet respectively, and the terminal that result of calculation is minimum is as said main separation node; Said corresponding packet is: cpu busy percentage, audio frequency and video input bandwidth and audio frequency and video output bandwidth are all less than self grouping.
14. device according to claim 9; It is characterized in that; Further comprise in this device: the 3rd processing unit; Be used to receive the heartbeat message that said main separation node periodically sends, and, notify said second processing unit to repeat self function after not receiving said heartbeat message yet or receive reselection request from said main separation node above scheduled duration.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105334388A CN102469409A (en) | 2010-11-02 | 2010-11-02 | Multimedia conference realization method and device |
| PCT/CN2011/081690 WO2012059052A1 (en) | 2010-11-02 | 2011-11-02 | Method and apparatus for implementing multimedia conference |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105334388A CN102469409A (en) | 2010-11-02 | 2010-11-02 | Multimedia conference realization method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102469409A true CN102469409A (en) | 2012-05-23 |
Family
ID=46024033
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010105334388A Pending CN102469409A (en) | 2010-11-02 | 2010-11-02 | Multimedia conference realization method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102469409A (en) |
| WO (1) | WO2012059052A1 (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102546995A (en) * | 2010-12-20 | 2012-07-04 | 中国移动通信集团公司 | Data distribution processing method and device |
| CN104065914A (en) * | 2013-03-18 | 2014-09-24 | 中国移动通信集团公司 | Wireless terminal video conference system, realizing method and device |
| CN104184765A (en) * | 2013-05-23 | 2014-12-03 | 阿里巴巴集团控股有限公司 | Request control method, client apparatus and server-side apparatus |
| CN104901815A (en) * | 2014-03-05 | 2015-09-09 | 华为技术有限公司 | Grouping method for user terminals, conference server and conference system |
| CN104954149A (en) * | 2014-03-26 | 2015-09-30 | 华为技术有限公司 | Method for sharing data in network conference, device and system thereof |
| CN105357750A (en) * | 2015-10-20 | 2016-02-24 | 北京小鸟听听科技有限公司 | Method and selection device for selecting master synchronization equipment, control equipment and electronic equipment |
| CN105407526A (en) * | 2015-10-20 | 2016-03-16 | 北京小鸟听听科技有限公司 | Selection method, selection device, control equipment and electronic equipment |
| CN111526386A (en) * | 2020-05-06 | 2020-08-11 | 北京三体云时代科技有限公司 | Data transmission method and device based on auxiliary mixed screen equipment and data transmission system |
| CN111586434A (en) * | 2020-05-06 | 2020-08-25 | 北京三体云时代科技有限公司 | Load balancing method based on edge device and distributed mixed screen server |
| CN115914542A (en) * | 2022-10-20 | 2023-04-04 | 海南乾唐视联信息技术有限公司 | Conference processing method and device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1429024A (en) * | 2001-12-26 | 2003-07-09 | 好利集团有限公司 | Internet protocol interdynamic TV system and its method for implementing it |
| CN101141616A (en) * | 2007-10-18 | 2008-03-12 | 华为技术有限公司 | Video session method and system, application server and media resource server |
| CN101656723A (en) * | 2009-09-21 | 2010-02-24 | 中兴通讯股份有限公司 | A multimedia conference capacity-expanding system, realization method and WEB server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8325215B2 (en) * | 2008-12-30 | 2012-12-04 | Genesys Telecommunications Laboratories, Inc. | Trust conferencing apparatus and methods in digital communication |
-
2010
- 2010-11-02 CN CN2010105334388A patent/CN102469409A/en active Pending
-
2011
- 2011-11-02 WO PCT/CN2011/081690 patent/WO2012059052A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1429024A (en) * | 2001-12-26 | 2003-07-09 | 好利集团有限公司 | Internet protocol interdynamic TV system and its method for implementing it |
| CN101141616A (en) * | 2007-10-18 | 2008-03-12 | 华为技术有限公司 | Video session method and system, application server and media resource server |
| CN101656723A (en) * | 2009-09-21 | 2010-02-24 | 中兴通讯股份有限公司 | A multimedia conference capacity-expanding system, realization method and WEB server |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102546995B (en) * | 2010-12-20 | 2015-03-11 | 中国移动通信集团公司 | Data distribution processing method and device |
| CN102546995A (en) * | 2010-12-20 | 2012-07-04 | 中国移动通信集团公司 | Data distribution processing method and device |
| CN104065914B (en) * | 2013-03-18 | 2017-11-21 | 中国移动通信集团公司 | A kind of wireless terminal video conferencing system, implementation method and device |
| CN104065914A (en) * | 2013-03-18 | 2014-09-24 | 中国移动通信集团公司 | Wireless terminal video conference system, realizing method and device |
| CN104184765A (en) * | 2013-05-23 | 2014-12-03 | 阿里巴巴集团控股有限公司 | Request control method, client apparatus and server-side apparatus |
| CN104901815A (en) * | 2014-03-05 | 2015-09-09 | 华为技术有限公司 | Grouping method for user terminals, conference server and conference system |
| US10601926B2 (en) | 2014-03-05 | 2020-03-24 | Huawei Technologies Co., Ltd. | User terminal grouping method, conference server, and conference system |
| US11290539B2 (en) | 2014-03-05 | 2022-03-29 | Huawei Technologies Co., Ltd. | User terminal grouping method, conference server, and conference system |
| CN104954149A (en) * | 2014-03-26 | 2015-09-30 | 华为技术有限公司 | Method for sharing data in network conference, device and system thereof |
| CN104954149B (en) * | 2014-03-26 | 2018-10-30 | 华为技术有限公司 | The method, apparatus and system of data sharing are carried out in Web conference |
| CN105357750A (en) * | 2015-10-20 | 2016-02-24 | 北京小鸟听听科技有限公司 | Method and selection device for selecting master synchronization equipment, control equipment and electronic equipment |
| CN105407526A (en) * | 2015-10-20 | 2016-03-16 | 北京小鸟听听科技有限公司 | Selection method, selection device, control equipment and electronic equipment |
| CN111526386A (en) * | 2020-05-06 | 2020-08-11 | 北京三体云时代科技有限公司 | Data transmission method and device based on auxiliary mixed screen equipment and data transmission system |
| CN111586434A (en) * | 2020-05-06 | 2020-08-25 | 北京三体云时代科技有限公司 | Load balancing method based on edge device and distributed mixed screen server |
| CN111586434B (en) * | 2020-05-06 | 2022-07-15 | 北京世纪好未来教育科技有限公司 | Load balancing method based on edge device and distributed mixed screen server |
| CN115914542A (en) * | 2022-10-20 | 2023-04-04 | 海南乾唐视联信息技术有限公司 | Conference processing method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2012059052A1 (en) | 2012-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102469409A (en) | Multimedia conference realization method and device | |
| Liu et al. | On content-centric wireless delivery networks | |
| CN102655503B (en) | Use the Resourse Distribute in shared resource pond | |
| US8441517B2 (en) | Data processing apparatus and method, and network system | |
| US10277865B2 (en) | Data transmission method and system, and related devices | |
| CN102457492B (en) | Coordinated transmission method for streaming media file, system and device | |
| CN108668178B (en) | Multicast implementation method and related network equipment | |
| CN101141397B (en) | Single broadcast to multicast switching method | |
| CN110213526B (en) | Video conference creation method, video conference system, storage medium, and electronic apparatus | |
| CN103647921A (en) | Method and apparatus for the efficient transmission of multimedia streams for teleconferencing | |
| CN102857439B (en) | Media data access and scheduling system architecture design method based on multi-node cooperation | |
| CN105338288A (en) | Multi-people network video session method and system | |
| CN105357208A (en) | Multi-party network audio session method and system | |
| CN111131759B (en) | Real-time multimedia transmission system and use method thereof | |
| CN114071168A (en) | Mixed-flow direct-broadcast stream scheduling method and device | |
| Civanlar et al. | Peer-to-peer multipoint videoconferencing on the Internet | |
| CN102957729B (en) | A kind of multimedia conferencing audio/video transmission method and equipment | |
| WO2012046358A1 (en) | Route construction device and route construction method | |
| CN100490405C (en) | Flow medium data multi-point transmission method | |
| US9602295B1 (en) | Audio conferencing server for the internet | |
| US20150296182A1 (en) | Method and system for providing video service | |
| CN108243320B (en) | Conference control method, device and system | |
| CN102970236A (en) | Multicast distribution tree switching method and device | |
| US8976225B2 (en) | Method, computer program and device for managing media stream in video conferencing | |
| Soltanian et al. | A resource allocation mechanism for video mixing as a cloud computing service in multimedia conferencing applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120523 |