CN102348097A - Session method and multi-point control unit for video conference - Google Patents
Session method and multi-point control unit for video conference Download PDFInfo
- Publication number
- CN102348097A CN102348097A CN2010102435940A CN201010243594A CN102348097A CN 102348097 A CN102348097 A CN 102348097A CN 2010102435940 A CN2010102435940 A CN 2010102435940A CN 201010243594 A CN201010243594 A CN 201010243594A CN 102348097 A CN102348097 A CN 102348097A
- Authority
- CN
- China
- Prior art keywords
- meeting
- packet
- sent
- place
- audio pack
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a session method and a multi-point control unit for a video conference. The method comprises that: in a session between a first meeting place and a second meeting place, the multi-point control unit (MCU) receives first data packets from the first meeting place, copies the first data packets, directly forwards one first data packet to the second meeting place and transmits another first data packet to a local mixing processor at the same time, the local mixing processor performs audio mixing and/or screen mixing processing on the first data packet, and the MCU transmits the first processed data packet to other meeting places except the first and second meeting places in the video conference. By the method and the unit, session delay in the video conference is shortened.
Description
Technical field
The present invention relates to the video conferencing technology field, be specifically related to dialogue method and multipoint control unit (MCU, Multi-Point Control Unit) in the video conference.
Background technology
For ease of understanding, at first provide following conceptual illustration:
Video conference: integrate the meeting of video, audio frequency, data communication, but the image in each meeting-place of real-time Transmission and sound make each meeting-place from be in a meeting in logic, but physically not in a zone; Compare with traditional meeting, can save overspending and do not influence the quality of meeting.
The terminal, meeting-place: one of multimedia telecom equipment type, have a system control unit, H.225.0 layer, network interface and an audio codec unit, generally also have video codec unit and user data applications.
MCU: the nucleus equipment in the video conference, main be responsible for and terminal, meeting-place or other MCU between processing and the forwarding or the processing of code stream of signaling.
Many pictures: on MCU, select a plurality of can field picture, splice a picture according to certain span mode, make terminal in the meeting can on a display, just see the picture in a plurality of meeting-place.
Video conferencing system realizes virtual meeting through the network communications technology, and the user who disperses on the geography is accumulated in a place, through multiple mode exchange of information such as image, sound, carries out collaborative work.Space length has been shortened in video conference to the full extent, has made things convenient between the cooperation member in real time, has exchanged intuitively.This conference model has obtained more and more general application.
Generally, whole meeting is carried out according to predefined flow process, all watches a certain specific meeting field picture in all meeting-place of synchronization, listens to the sound in this meeting-place.The flow process of whole meeting is controled by administrative staff or the Chair site in the MCU side, maybe in meeting, broadcasts in the different meeting-place of needs switching according to agenda.
At present in the video conference, main have two kinds of application, and a kind of is speech, and in this case, owing to be unidirectional transmission, recipient's general sensation is less than time-delay; Another is dialogue, and have two meeting-place to speak mutually this moment, if time-delay is bigger in this case, then the influence to conversation is very big.
When having two people to talk with in the meeting, MCU generally does following processing:
1, for video: receive the picture in two meeting-place, be spliced into 2 panes after picture is decoded, to sending to all meeting-place behind the 2 panes coding;
2, for audio frequency: receive the sound in all meeting-place, carry out Energy Estimation, obtain the maximum several roads of volume such as: the 4 tunnel, to the sound that obtains decode successively, audio mixing, encoding process, send to all meeting-place then.
In existing scheme, the splicing step of many pictures need be accomplished decoding, splicing, 3 key steps of coding, also comprises buffering, the delay process of each step in addition, generally speaking, can introduce the time-delay of 100～200ms.Simultaneously, because audio frequency needs Energy Estimation, decoding, audio mixing, coding, generally also can introduce the time-delay of 60～150ms, and owing to need labial synchronous, audio frequency can increase time-delay, to be consistent with video.Therefore; When A and B were mutual, A had time-delay to the sound of B on MCU, and B hears that back answer A has time-delay again; Have under the situation of time-delay at terminal itself like this; The time-delay that increases will allow A and B find that oneself is talked to being over and all need make a short pause, and the other side's sound is just returned; Simultaneously; The audio mixing of A+B sends to other meeting-place, and other meeting-place also can be found to talk with discontinuous, and there is pause the centre.
Fig. 1 has provided the dialogue sketch map of a video conference, as shown in Figure 1,3 meeting-place is arranged in this meeting: meeting-place 1,2,3, wherein, meeting-place 1, dialogue between 2.Suppose that the audio pack transmission delay between MCU and each meeting-place is 150ms, mixer to audio pack carry out elder generation decode afterwards encode, audio mixing is handled 150ms consuming time, then is example with the audio pack, meeting-place 1, the dialog procedure between 2 as shown in Figure 2:
Step 01: meeting-place 1 speech, meeting-place 1 is sent audio pack 1 and is given MCU, and MCU receives audio pack 1, this step time-delay 150ms.
Step 02:MCU decodes earlier to audio pack 1 and afterwards encodes, audio mixing, this step time-delay 150ms.
The audio pack 1 of step 03:MCU after with audio mixing sends to meeting-place 2 and meeting-place 3, and meeting-place 2 receives audio pack 1 with meeting-place 3, this step time-delay 150ms; This moment, the sound in meeting-place 1 was heard in meeting-place 2, meeting-place 2 speeches.
Step 04: audio pack 22 sends to MCU from the meeting-place, and MCU receives audio pack 2, this step time-delay 150ms.
Step 05:MCU decodes earlier to audio pack 2 and afterwards encodes, audio mixing, this step time-delay 150ms.
The audio pack 2 of step 06:MCU after with audio mixing sends to meeting-place 1 and meeting-place 3, and meeting-place 1 receives audio pack 2 with meeting-place 3, this step time-delay 150ms; This moment, the answer in meeting-place 2 was heard in meeting-place 1.
As can be seen from Figure 2,1 finishes the answer that meeting-place 2 is heard in meeting-place 1 from the meeting-place, and 900ms has paused in the centre; And meeting-place 3 hear meeting-place 1 finish the back to the answer of hearing meeting-place 2,450ms has paused in the centre.
Summary of the invention
The present invention provides dialogue method and the device in the video conference, to reduce the time-delay in the videoconference session process.
Technical scheme of the present invention is achieved in that
Dialogue method in a kind of video conference, wherein, first meeting-place and the dialogue of second meeting-place, this method comprises:
Multipoint control unit MCU receives first packet that send in first meeting-place; Duplicate first packet; One first packet directly is transmitted to second meeting-place; Simultaneously; Another first packet is sent to local hybrid processor; This locality hybrid processor carries out audio mixing to first packet and/or mixes screen and handle, and first packet after MCU will handle sends to and removes first and second meeting other meeting-place outside the venue in the video conference.
Said MCU further comprises after one first packet directly is transmitted to second meeting-place:
MCU receives second packet that send in second meeting-place; Duplicate second packet; One second packet directly is transmitted to first meeting-place; Simultaneously; Another second packet is sent to local hybrid processor; This locality hybrid processor carries out audio mixing to second packet and/or mixes screen and handle, and second packet after MCU will handle sends to and removes first and second meeting other meeting-place outside the venue in the video conference.
Said MCU with one first packet directly be transmitted to after second meeting-place, MCU further comprises before receiving second packet of sending in second meeting-place:
Second meeting-place receives first packet, begins speech, and second packet is sent to MCU.
Said second packet is an audio pack, or video packets, or audio pack+video packets.
Said first packet is an audio pack, or video packets, or audio pack+video packets.
When said first packet is audio pack+video packets,
Said local hybrid processor second packet is carried out audio mixing and/or mix screen handle after, second packet of MCU after will handling send to and remove first and second in the video conference and can further comprise before in other meeting-place outside the venue:
MCU audio pack that processing obtains to audio mixing and mixed screen are handled the video packets that obtains and are carried out the labial Synchronous Processing, and audio pack after the labial Synchronous Processing and video packets are sent in the video conference except that first and second meeting other meeting-place outside the venue.
Multipoint control unit MCU in a kind of video conference, this MCU comprises:
Transceiver module: receive first packet that send in first meeting-place, first packet is sent to replication module; First packet after audio mixing and/or mixed screen processing that the reception hybrid processor is sent sends in the video conference this first packet except that first and second meeting other meeting-place outside the venue;
Replication module: receive first packet that transceiver module is sent, duplicate this first packet, one first packet directly is transmitted to second meeting-place, simultaneously, another first packet is sent to hybrid processor;
Hybrid processor: first packet that replication module is sent carries out audio mixing and/or mixes the screen processing, and first packet after handling is sent to transceiver module.
Said first packet is first audio pack+first video packets, and said hybrid processor comprises:
Mixer: receive first audio pack that replication module is sent, to first audio pack carry out elder generation decode afterwards encode, the audio mixing processing, first audio pack after the processing is sent to the labial synchronizer;
Mix the screen device: receive first video packets that replication module is sent, first video packets is mixed screen handle, first video packets after handling is sent to the labial synchronizer;
The labial synchronizer: first audio pack after audio mixing is handled that the reception mixer is sent is shielded first video packets after mixed screen is handled that device is sent with mixing; This two bag is carried out the labial Synchronous Processing; First audio pack after the labial Synchronous Processing, first video packets are sent to transceiver module, be transmitted to by transceiver module and remove first and second meeting other meeting-place outside the venue in the video conference.
Said transceiver module is further used for, and receives second packet that send in second meeting-place, and second packet is sent to replication module; Second packet after audio mixing and/or mixed screen processing that the reception hybrid processor is sent sends in the video conference this second packet except that first and second meeting other meeting-place outside the venue;
And said replication module is further used for, and receives second packet that transceiver module is sent, and duplicates this second packet, and one second packet directly is transmitted to first meeting-place, simultaneously, another second packet is sent to hybrid processor;
And said hybrid processor is further used for, and second packet that replication module is sent carries out audio mixing and/or mixes the screen processing, and second packet after handling is sent to transceiver module.
Said second packet is second audio pack+second video packets, and said hybrid processor comprises:
Mixer: receive first audio pack that replication module is sent, to first audio pack carry out elder generation decode afterwards encode, the audio mixing processing, first audio pack after the processing is sent to the labial synchronizer; Receive second audio pack that replication module is sent, to second audio pack carry out elder generation decode afterwards encode, the audio mixing processing, second audio pack after the processing is sent to the labial synchronizer;
Mix the screen device: receive first video packets that replication module is sent, first video packets is mixed screen handle, first video packets after handling is sent to the labial synchronizer; Receive second video packets that replication module is sent, second video packets is mixed screen handle, second video packets after handling is sent to the labial synchronizer;
The labial synchronizer: first audio pack after audio mixing is handled that the reception mixer is sent is shielded first video packets after mixed screen is handled that device is sent with mixing; This two bag is carried out the labial Synchronous Processing; First audio pack after the labial Synchronous Processing, first video packets are sent to transceiver module, be transmitted to by transceiver module and remove first and second meeting other meeting-place outside the venue in the video conference; Second audio pack after audio mixing is handled that the reception mixer is sent is shielded second video packets after mixed screen is handled that device is sent with mixing; This two bag is carried out the labial Synchronous Processing; Second audio pack after the labial Synchronous Processing, second video packets are sent to transceiver module, be transmitted to by transceiver module and remove first and second meeting other meeting-place outside the venue in the video conference.
Compared with prior art; Among the present invention; When MCU receives arbitrary meeting-place data sent bag; Duplicate this packet; One packet directly is transmitted to the meeting-place of talking with this meeting-place, another packet is transmitted to mixer and/or mixes the screen device, will send to other meeting-place in the video conference through audio mixing and/or the packet that mixes after shielding processing; The dialogue that the present invention has reduced the other side both sides postpones, and has also reduced other meeting-place and has heard the time-delay that both sides talk with.
Description of drawings
Fig. 1 is the dialogue sketch map of existing video conference;
Fig. 2 is in video conference shown in Figure 1, existing meeting-place 1, the dialog procedure sketch map between 2;
Conversation process figure in the video conference that Fig. 3 provides for the embodiment of the invention;
Fig. 4 during 1,2 dialogues of meeting-place, uses audio pack delay Analysis process sketch map of the present invention for being example with video conference shown in Figure 1;
The structural representation of MCU in the video conference that Fig. 5 provides for the embodiment of the invention.
Embodiment
Below in conjunction with accompanying drawing and specific embodiment the present invention is remake further detailed explanation.
Conversation process figure in the video conference that Fig. 3 provides for the embodiment of the invention, as shown in Figure 3, its concrete steps are following:
Step 301: the speech of first meeting-place, first audio pack and first video packets are sent to MCU in first meeting-place, and MCU receives first audio pack and first video packets.
This step comprises the transmission time-delay from first meeting-place to MCU of first audio pack, first video packets.
Step 302:MCU duplicates first audio pack and first video packets; One first audio pack, first video packets are sent to its own interfaces that links to each other with second meeting-place; Simultaneously, another first audio pack is sent to local mixer, another first video packets is sent to the local screen device that mixes.
This step all is that handle this locality of MCU, does not produce time-delay.
Step 303: first audio pack and first video packets are sent to second meeting-place from MCU, and then the sound in first meeting-place is heard in second meeting-place, see the speech image in first meeting-place simultaneously; Mixer to first audio pack carry out elder generation decode afterwards encode, audio mixing handles, and mixes the screen device and first video packets is mixed screen handles, MCU shields data and carries out the labial Synchronous Processing with mixing the audio mixing data.
In reality, first meeting-place, second meeting-place are to transmit audio pack and video packets to MCU in real time.Here, mixer carries out audio mixing to be handled and to be actually the dialogue both sides: the audio pack in first meeting-place and second meeting-place is carried out audio mixing and is handled, but this moment owing to do not talk in second meeting-place, therefore, the audio pack in second meeting-place is actually a quiet bag.
Equally; Here; Mixing the screen device is the video packets in first meeting-place and second meeting-place to be mixed screen handle, and for example: mixing the screen device can be with the video packets in first meeting-place input source as 2 panes left side picture, with the video packets in second meeting-place input source as picture on the right of the 2 panes.
This step comprises: the time-delay of first audio pack, first video packets from MCU to second meeting-place, and mixer, mixed screen device are delayed time to the processing of first audio pack, first video packets, and this two time-delay walks abreast.
Step 304: the speech of second meeting-place, second meeting-place sends to MCU with second audio pack and second video packets; First audio pack, first video packets of MCU after with the labial Synchronous Processing sends to and removes other meeting-place that first and second can be outside the venue in the video conference.
The labial Synchronous Processing is that teller's on the picture lip and its sound are carried out synchronously.
This step comprises: the transmission time-delay of second audio pack, second video packets from second meeting-place to MCU, and the transmission time-delay of first audio pack after the labial Synchronous Processing, first video packets from MCU to other meeting-place, this two time-delay walks abreast.
Step 305:MCU receives second audio pack and second video packets; Duplicate second audio pack and second video packets; One second audio pack, second video packets are sent to its own interfaces that links to each other with first meeting-place; Simultaneously; Another second audio pack is sent to local mixer, another second video packets is sent to the local screen device that mixes.
This step all is that handle this locality of MCU, does not produce time-delay.
Step 306: second audio pack and second video packets are sent to first meeting-place from MCU, and then the sound in second meeting-place is heard in first meeting-place, see the speech image in second meeting-place simultaneously; Mixer to second audio pack carry out elder generation decode afterwards encode, audio mixing handles, and mixes the screen device and second video packets is mixed screen handles, MCU shields data and carries out the labial Synchronous Processing with mixing the audio mixing data.
This step comprises: the transmission time-delay of second audio pack, second video packets from MCU to first meeting-place, and mixer, mixed screen device are delayed time to the processing of second audio pack, second video packets, and this two time-delay walks abreast.
Second audio pack of step 307:MCU after with the labial Synchronous Processing, second video packets are sent to from MCU and remove other meeting-place that first and second can be outside the venue the video conference, and then the answer in second meeting-place is heard in other meeting-place, and sees the answer image in second meeting-place.
This step comprises: the transmission time-delay from MCU to other meeting-place of second audio pack after the labial Synchronous Processing, second video packets.
Suppose that audio pack, video packets transmission delay between MCU and each meeting-place all are 150ms; Mixer to audio pack carry out elder generation decode afterwards encode, audio mixing handles 150ms consuming time; Mix the screen device video packets is mixed screen processing 150ms consuming time; Be example still then with video conference shown in Figure 1; When providing meeting-place 1,2 dialogues; Use audio pack delay Analysis process of the present invention, as shown in Figure 4:
Step 01: the speech of first meeting-place, audio pack 1 is sent to MCU from first meeting-place, time-delay 150ms.
Step 02: audio pack 1 is sent to second meeting-place from MCU, time-delay 150ms; Simultaneously,
The last mixer of MCU to audio pack 1 carry out elder generation decode afterwards encode, audio mixing handles time-delay 150ms.
Execution of step 02,300ms when coextensive.
Step 03: the speech of second meeting-place, audio pack 2 is sent to MCU from second meeting-place, time-delay 150ms; Simultaneously,
Audio pack 1 behind the audio mixing is sent to meeting-place 3 from MCU, time-delay 150ms, and meeting-place 1 speech is heard in meeting-place 3.
Execution of step 03,450ms when coextensive.
Step 04: audio pack 2 is sent to meeting-place 1 from MCU, time-delay 150ms, and the answer in meeting-place 2 is heard in meeting-place 1; Simultaneously,
The last mixer of MCU to audio pack 2 carry out elder generation decode afterwards encode, audio mixing handles time-delay 150ms.
Execution of step 04,600ms when coextensive.
Step 05: the audio pack 2 behind the audio mixing is sent to meeting-place 3 from MCU, time-delay 150ms, and the answer in meeting-place 2 is heard in meeting-place 3.
As can be seen from Figure 4: 1 finishes the answer that meeting-place 2 is heard in meeting-place 1 from the meeting-place, and promptly from step 01 to step 04,150ms+150ms+150ms+150ms=600ms altogether pauses in the centre; And can know from Fig. 2, adopt the middle 900ms that pauses altogether of prior art.
3 hear that meeting-place 1 talked about the answer that meeting-place 2 is heard in meeting-place 3 from the meeting-place, and promptly from step 03～05,300ms altogether pauses in the centre; And can know from Fig. 2, adopt the middle 450ms that pauses altogether of prior art.
It is thus clear that behind application the present invention, the dialogue time-delay in the video conference has reduced.
The structural representation of MCU in the video conference that Fig. 5 provides for the embodiment of the invention, as shown in Figure 5, it mainly comprises: transceiver module 51, replication module 52 and hybrid processor 53, wherein:
Transceiver module 51: receive first packet that send in first meeting-place, first packet is sent to replication module 52; First packet after audio mixing and/or mixed screen processing that reception hybrid processor 53 is sent sends in the video conference this first packet except that first and second meeting other meeting-place outside the venue; Receive second packet that send in second meeting-place, second packet is sent to replication module 52; Receive that hybrid processor 53 sends through audio mixing and/or mix second packet after screen is handled, this second packet is sent to removes other meeting-place that first and second can be outside the venue in the video conference, wherein, talk with second meeting-place in first meeting-place.
Replication module 52: receive first packet that transceiver module 51 is sent, duplicate this first packet, one first packet directly is transmitted to second meeting-place, simultaneously, another first packet is sent to hybrid processor 53; Receive second packet that transceiver module 51 is sent, duplicate this second packet, one second packet directly is transmitted to first meeting-place, simultaneously, another second packet is sent to hybrid processor 53.
Hybrid processor 53: first packet that replication module 52 is sent carries out audio mixing and/or mixes the screen processing, and first packet after handling is sent to transceiver module 51; Second packet that replication module 52 is sent carries out audio mixing and/or mixes the screen processing, and second packet after handling is sent to transceiver module 51.
In practical application, when first and second packet only comprised audio pack, hybrid processor 53 was actually mixer, first and second packet that replication module 52 is sent only carry out elder generation decode afterwards encode, audio mixing handles and gets final product; When first and second packet only comprised video packets, hybrid processor 53 was actually and mixes the screen device, and first and second packet that replication module 52 is sent only mixes the screen processing and gets final product; When first and second packet was audio pack+video packets, then hybrid processor 53 comprised: mixer, mix screen device and labial synchronizer, wherein:
Mixer: receive first audio pack that replication module 52 is sent, to first audio pack carry out elder generation decode afterwards encode, the audio mixing processing, first audio pack after the processing is sent to the labial synchronizer; Receive second audio pack that replication module 52 is sent, to second audio pack carry out elder generation decode afterwards encode, the audio mixing processing, second audio pack after the processing is sent to the labial synchronizer.
Mix the screen device: receive first video packets that replication module 52 is sent, first video packets is mixed screen handle, first video packets after handling is sent to the labial synchronizer; Receive second video packets that replication module 52 is sent, second video packets is mixed screen handle, second video packets after handling is sent to the labial synchronizer.
The labial synchronizer: first audio pack after audio mixing is handled that the reception mixer is sent is shielded first video packets after mixed screen is handled that device is sent with mixing; This two bag is carried out the labial Synchronous Processing; First audio pack after the labial Synchronous Processing, first video packets are sent to transceiver module 51, be transmitted to by transceiver module 51 and remove first and second meeting other meeting-place outside the venue in the video conference; Second audio pack after audio mixing is handled that the reception mixer is sent is shielded second video packets after mixed screen is handled that device is sent with mixing; This two bag is carried out the labial Synchronous Processing; Second audio pack after the labial Synchronous Processing, second video packets are sent to transceiver module 51, be transmitted to by transceiver module 51 and remove first and second meeting other meeting-place outside the venue in the video conference.
The above only is preferred embodiment of the present invention, and is in order to restriction the present invention, not all within spirit of the present invention and principle, any modification of being made, is equal to replacement, improvement etc., all should be included within the scope that the present invention protects.
Claims (10)
1. the dialogue method in the video conference, wherein, first meeting-place and the dialogue of second meeting-place is characterized in that this method comprises:
Multipoint control unit MCU receives first packet that send in first meeting-place; Duplicate first packet; One first packet directly is transmitted to second meeting-place; Simultaneously; Another first packet is sent to local hybrid processor; This locality hybrid processor carries out audio mixing to first packet and/or mixes screen and handle, and first packet after MCU will handle sends to and removes first and second meeting other meeting-place outside the venue in the video conference.
2. method according to claim 1 is characterized in that, said MCU further comprises after one first packet directly is transmitted to second meeting-place:
MCU receives second packet that send in second meeting-place; Duplicate second packet; One second packet directly is transmitted to first meeting-place; Simultaneously; Another second packet is sent to local hybrid processor; This locality hybrid processor carries out audio mixing to second packet and/or mixes screen and handle, and second packet after MCU will handle sends to and removes first and second meeting other meeting-place outside the venue in the video conference.
3. method according to claim 2 is characterized in that, said MCU with one first packet directly be transmitted to after second meeting-place, MCU further comprises before receiving second packet of sending in second meeting-place:
Second meeting-place receives first packet, begins speech, and second packet is sent to MCU.
4. according to claim 2 or 3 described methods, it is characterized in that said second packet is an audio pack, or video packets, or audio pack+video packets.
5. method according to claim 1 and 2 is characterized in that, said first packet is an audio pack, or video packets, or audio pack+video packets.
6. method according to claim 5 is characterized in that, when said first packet is audio pack+video packets,
Said local hybrid processor second packet is carried out audio mixing and/or mix screen handle after, second packet of MCU after will handling send to and remove first and second in the video conference and can further comprise before in other meeting-place outside the venue:
MCU audio pack that processing obtains to audio mixing and mixed screen are handled the video packets that obtains and are carried out the labial Synchronous Processing, and audio pack after the labial Synchronous Processing and video packets are sent in the video conference except that first and second meeting other meeting-place outside the venue.
7. the multipoint control unit MCU in the video conference is characterized in that this MCU comprises:
Transceiver module: receive first packet that send in first meeting-place, first packet is sent to replication module; First packet after audio mixing and/or mixed screen processing that the reception hybrid processor is sent sends in the video conference this first packet except that first and second meeting other meeting-place outside the venue;
Replication module: receive first packet that transceiver module is sent, duplicate this first packet, one first packet directly is transmitted to second meeting-place, simultaneously, another first packet is sent to hybrid processor;
Hybrid processor: first packet that replication module is sent carries out audio mixing and/or mixes the screen processing, and first packet after handling is sent to transceiver module.
8. MCU according to claim 7 is characterized in that, said first packet is first audio pack+first video packets, and said hybrid processor comprises:
Mixer: receive first audio pack that replication module is sent, to first audio pack carry out elder generation decode afterwards encode, the audio mixing processing, first audio pack after the processing is sent to the labial synchronizer;
Mix the screen device: receive first video packets that replication module is sent, first video packets is mixed screen handle, first video packets after handling is sent to the labial synchronizer;
The labial synchronizer: first audio pack after audio mixing is handled that the reception mixer is sent is shielded first video packets after mixed screen is handled that device is sent with mixing; This two bag is carried out the labial Synchronous Processing; First audio pack after the labial Synchronous Processing, first video packets are sent to transceiver module, be transmitted to by transceiver module and remove first and second meeting other meeting-place outside the venue in the video conference.
9. MCU according to claim 7 is characterized in that said transceiver module is further used for, and receives second packet that send in second meeting-place, and second packet is sent to replication module; Second packet after audio mixing and/or mixed screen processing that the reception hybrid processor is sent sends in the video conference this second packet except that first and second meeting other meeting-place outside the venue;
And said replication module is further used for, and receives second packet that transceiver module is sent, and duplicates this second packet, and one second packet directly is transmitted to first meeting-place, simultaneously, another second packet is sent to hybrid processor;
And said hybrid processor is further used for, and second packet that replication module is sent carries out audio mixing and/or mixes the screen processing, and second packet after handling is sent to transceiver module.
10. MCU according to claim 9 is characterized in that, said second packet is second audio pack+second video packets, and said hybrid processor comprises:
Mixer: receive first audio pack that replication module is sent, to first audio pack carry out elder generation decode afterwards encode, the audio mixing processing, first audio pack after the processing is sent to the labial synchronizer; Receive second audio pack that replication module is sent, to second audio pack carry out elder generation decode afterwards encode, the audio mixing processing, second audio pack after the processing is sent to the labial synchronizer;
Mix the screen device: receive first video packets that replication module is sent, first video packets is mixed screen handle, first video packets after handling is sent to the labial synchronizer; Receive second video packets that replication module is sent, second video packets is mixed screen handle, second video packets after handling is sent to the labial synchronizer;
The labial synchronizer: first audio pack after audio mixing is handled that the reception mixer is sent is shielded first video packets after mixed screen is handled that device is sent with mixing; This two bag is carried out the labial Synchronous Processing; First audio pack after the labial Synchronous Processing, first video packets are sent to transceiver module, be transmitted to by transceiver module and remove first and second meeting other meeting-place outside the venue in the video conference; Second audio pack after audio mixing is handled that the reception mixer is sent is shielded second video packets after mixed screen is handled that device is sent with mixing; This two bag is carried out the labial Synchronous Processing; Second audio pack after the labial Synchronous Processing, second video packets are sent to transceiver module, be transmitted to by transceiver module and remove first and second meeting other meeting-place outside the venue in the video conference.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010243594 CN102348097B (en) | 2010-08-02 | 2010-08-02 | Session method and multi-point control unit for video conference |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010243594 CN102348097B (en) | 2010-08-02 | 2010-08-02 | Session method and multi-point control unit for video conference |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102348097A true CN102348097A (en) | 2012-02-08 |
| CN102348097B CN102348097B (en) | 2013-05-22 |
Family
ID=45546331
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010243594 Active CN102348097B (en) | 2010-08-02 | 2010-08-02 | Session method and multi-point control unit for video conference |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102348097B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103870434A (en) * | 2012-12-14 | 2014-06-18 | 阿瓦亚公司 | Integrating audio and video conferencing capabilities |
| WO2015070377A1 (en) * | 2013-11-12 | 2015-05-21 | 华为技术有限公司 | Multiparty call method and apparatus |
| CN105280192A (en) * | 2015-11-23 | 2016-01-27 | 北京华夏电通科技有限公司 | Method and system of echo cancellation in three-party remote communication |
| CN105469803A (en) * | 2015-11-23 | 2016-04-06 | 北京华夏电通科技有限公司 | Method and system of echo elimination during three-party remote communication |
| CN106210764A (en) * | 2015-04-29 | 2016-12-07 | 北京视联动力国际信息技术有限公司 | The conjunction screen processing method of a kind of multichannel media stream and system |
| CN106534762A (en) * | 2016-11-16 | 2017-03-22 | 深圳市捷视飞通科技股份有限公司 | Low-time-delay distributed audio processing method and system |
| CN110971863A (en) * | 2019-11-21 | 2020-04-07 | 厦门亿联网络技术股份有限公司 | Multi-point control unit cross-area conference operation method, device, equipment and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1655609A (en) * | 2004-02-13 | 2005-08-17 | 精工爱普生株式会社 | Method and system for recording videoconference data |
| CN1849824A (en) * | 2003-10-08 | 2006-10-18 | 思科技术公司 | System and method for performing distributed video conferencing |
| CN101102456A (en) * | 2007-07-25 | 2008-01-09 | 中兴通讯股份有限公司 | A video conference system with instant messaging function and its implementation method |
-
2010
- 2010-08-02 CN CN 201010243594 patent/CN102348097B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1849824A (en) * | 2003-10-08 | 2006-10-18 | 思科技术公司 | System and method for performing distributed video conferencing |
| CN1655609A (en) * | 2004-02-13 | 2005-08-17 | 精工爱普生株式会社 | Method and system for recording videoconference data |
| CN101102456A (en) * | 2007-07-25 | 2008-01-09 | 中兴通讯股份有限公司 | A video conference system with instant messaging function and its implementation method |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103870434A (en) * | 2012-12-14 | 2014-06-18 | 阿瓦亚公司 | Integrating audio and video conferencing capabilities |
| WO2015070377A1 (en) * | 2013-11-12 | 2015-05-21 | 华为技术有限公司 | Multiparty call method and apparatus |
| US10193794B2 (en) | 2013-11-12 | 2019-01-29 | Huawei Technologies Co., Ltd. | Multiparty call method and apparatus |
| CN106210764A (en) * | 2015-04-29 | 2016-12-07 | 北京视联动力国际信息技术有限公司 | The conjunction screen processing method of a kind of multichannel media stream and system |
| CN105280192A (en) * | 2015-11-23 | 2016-01-27 | 北京华夏电通科技有限公司 | Method and system of echo cancellation in three-party remote communication |
| CN105469803A (en) * | 2015-11-23 | 2016-04-06 | 北京华夏电通科技有限公司 | Method and system of echo elimination during three-party remote communication |
| CN105280192B (en) * | 2015-11-23 | 2019-04-05 | 北京华夏电通科技有限公司 | Echo cancel method and system in tripartite's telecommunication based on multiple sound coding |
| CN105469803B (en) * | 2015-11-23 | 2019-04-05 | 北京华夏电通科技有限公司 | Echo cancel method and system in tripartite's telecommunication based on left and right acoustic channels coding |
| CN106534762A (en) * | 2016-11-16 | 2017-03-22 | 深圳市捷视飞通科技股份有限公司 | Low-time-delay distributed audio processing method and system |
| CN106534762B (en) * | 2016-11-16 | 2019-12-13 | 深圳市捷视飞通科技股份有限公司 | low-delay distributed audio processing method and system |
| CN110971863A (en) * | 2019-11-21 | 2020-04-07 | 厦门亿联网络技术股份有限公司 | Multi-point control unit cross-area conference operation method, device, equipment and system |
| CN110971863B (en) * | 2019-11-21 | 2021-03-23 | 厦门亿联网络技术股份有限公司 | Multi-point control unit cross-area conference operation method, device, equipment and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102348097B (en) | 2013-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5534813B2 (en) | System, method, and multipoint control apparatus for realizing multilingual conference | |
| CN102348097B (en) | Session method and multi-point control unit for video conference | |
| KR100880150B1 (en) | Multi-point video conference system and media processing method thereof | |
| US9462228B2 (en) | Distributed real-time media composer | |
| CN101478642A (en) | Multi-picture mixing method and apparatus for video meeting system | |
| CN103051864B (en) | Mobile video session method | |
| CN101022481A (en) | Method and device for realizing private conversation in multi-point meeting | |
| CN101395912A (en) | System and method for displaying participants in a videoconference between locations | |
| CN104980683A (en) | Implement method and device for video telephone conference | |
| US20110292165A1 (en) | System and method for scalable media switching conferencing | |
| CN101198008A (en) | Method and system for implementing multi-screen and multi-picture | |
| WO2014173091A1 (en) | Method and device for displaying conference material in video conference | |
| CN101645952A (en) | Conference telephone terminal, system and method for sharing data | |
| CN105376516A (en) | Mobile video conference system and implementing method thereof | |
| WO2015154608A1 (en) | Method, system and apparatus for sharing video conference material | |
| WO2016019775A1 (en) | Conference migration method, device and system | |
| CN101895718A (en) | Video conference system multi-image broadcast method, and device and system thereof | |
| KR20070076133A (en) | Video conference system and method using white board | |
| WO2016082577A1 (en) | Video conference processing method and device | |
| WO2015003532A1 (en) | Multimedia conferencing establishment method, device and system | |
| WO2014177082A1 (en) | Video conference video processing method and terminal | |
| WO2016026336A1 (en) | Remote interaction method and system in audio/video conference and mcu | |
| WO2016206471A1 (en) | Multimedia service processing method, system and device | |
| CN103533294A (en) | Video data flow transmission method, terminal and system | |
| WO2014026478A1 (en) | Video conference signal processing method, video conference server and video conference system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 310052 Binjiang District Changhe Road, Zhejiang, China, No. 466, No. Patentee after: Xinhua three Technology Co., Ltd. Address before: 310053 Hangzhou hi tech Industrial Development Zone, Zhejiang province science and Technology Industrial Park, No. 310 and No. six road, HUAWEI, Hangzhou production base Patentee before: Huasan Communication Technology Co., Ltd. |