CN102348097B - Session method and multi-point control unit for video conference - Google Patents

Session method and multi-point control unit for video conference Download PDF

Info

Publication number
CN102348097B
CN102348097B CN 201010243594 CN201010243594A CN102348097B CN 102348097 B CN102348097 B CN 102348097B CN 201010243594 CN201010243594 CN 201010243594 CN 201010243594 A CN201010243594 A CN 201010243594A CN 102348097 B CN102348097 B CN 102348097B
Authority
CN
China
Prior art keywords
meeting
packet
place
audio pack
video packets
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 201010243594
Other languages
Chinese (zh)
Other versions
CN102348097A (en
Inventor
丁志杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
New H3C Technologies Co Ltd
Original Assignee
Hangzhou H3C Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou H3C Technologies Co Ltd filed Critical Hangzhou H3C Technologies Co Ltd
Priority to CN 201010243594 priority Critical patent/CN102348097B/en
Publication of CN102348097A publication Critical patent/CN102348097A/en
Application granted granted Critical
Publication of CN102348097B publication Critical patent/CN102348097B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention discloses a session method and a multi-point control unit for a video conference. The method comprises that: in a session between a first meeting place and a second meeting place, the multi-point control unit (MCU) receives first data packets from the first meeting place, copies the first data packets, directly forwards one first data packet to the second meeting place and transmits another first data packet to a local mixing processor at the same time, the local mixing processor performs audio mixing and/or screen mixing processing on the first data packet, and the MCU transmits the first processed data packet to other meeting places except the first and second meeting places in the video conference. By the method and the unit, session delay in the video conference is shortened.

Description

Dialogue method in video conference and multipoint control unit
Technical field
The present invention relates to the video conferencing technology field, be specifically related to dialogue method and multipoint control unit (MCU, Multi-Point Control Unit) in video conference.
Background technology
For ease of understanding, the following conceptual illustration of given first:
Video conference: integrate the meeting of video, audio frequency, data communication, but image and the sound in real-time Transmission each meeting-place make each meeting-place from be in logic a meeting, but physically not in a zone; Compare with traditional meeting, can save overspending and not affect the quality of meeting.
The meeting-place terminal: one of multimedia telecom equipment type, have a system control unit, H.225.0 layer, network interface and an audio codec unit, generally also have video codec unit and user data applications.
MCU: the nucleus equipment in video conference, main be responsible for and meeting-place terminal or other MCU between the processing of signaling and forwarding or the processing of code stream.
Many pictures: select on MCU a plurality of can field picture, splice a picture according to certain span mode, make in meeting terminal can just see the picture in a plurality of meeting-place on a display.
Video conferencing system realizes virtual meeting by the network communications technology, and the user who geographically disperses is gathered in a place, by various ways exchange of information such as image, sound, carries out collaborative work.Space length has been shortened in video conference to the full extent, has facilitated between the cooperation member in real time, has exchanged intuitively.This conference model has obtained more and more general application.
Generally, whole meeting is carried out according to predefined flow process, all watch in synchronization all meeting-place a certain specific can field picture, listen to the sound in this meeting-place.The flow process of whole meeting operates control by administrative staff or the Chair site in the MCU side, maybe broadcasts in meeting in the different meeting-place of needs switching according to agenda.
At present in video conference, main have two kinds of application, and a kind of is speech, and in this case, owing to being unidirectional transmission, recipient's general sensation is less than time-delay; Another is dialogue, and have two meeting-place to speak mutually this moment, if time-delay is larger in this case, the impact on conversation is very large.
When having two people to talk with in meeting, MCU generally does following processing:
1, for video: receive the picture in two meeting-place, be spliced into 2 panes after picture is decoded, to sending to all meeting-place after the 2 panes coding;
2, for audio frequency: receive the sound in all meeting-place, carry out energy and estimate, several roads that obtain the volume maximum such as: the 4 tunnel, to the sound that obtains decode successively, audio mixing, coding process, and then sends to all meeting-place.
In existing scheme, the splicing step of many pictures need to be completed decoding, splicing, 3 key steps of coding, also comprises in addition buffering, the delay process of each step, generally, can introduce the time-delay of 100~200ms.Simultaneously, because audio frequency needs energy estimation, decoding, audio mixing, coding, generally also can introduce the time-delay of 60~150ms, and due to the needs labial synchronization, audio frequency can increase time-delay, to be consistent with video.Therefore, when A and B were mutual, A had time-delay to the sound of B on MCU, and B hears that rear answer A has again time-delay, like this in the situation that terminal itself has time-delay, the time-delay that increases will allow A and B find, oneself talks to being over all needs to make a short pause, and the other side's sound is just returned, simultaneously, the audio mixing of A+B sends to other meeting-place, and other meeting-place also can be found to talk with discontinuous, and there is pause the centre.
Fig. 1 has provided the dialogue schematic diagram of a video conference, as shown in Figure 1,3 meeting-place is arranged in this meeting: meeting-place 1,2,3, wherein, dialogue between meeting-place 1,2.Suppose that the audio pack transmission delay between MCU and each meeting-place is 150ms, mixer is to audio pack first decode rear coding, stereo process 150ms consuming time, take audio pack as example, the dialog procedure between meeting-place 1,2 as shown in Figure 2:
Step 01: meeting-place 1 speech, meeting-place 1 sends audio pack 1 to MCU, MCU audio reception bag 1, this step time-delay 150ms.
Step 02:MCU first decodes to audio pack 1 and encodes afterwards, audio mixing, this step time-delay 150ms.
The audio pack 1 of step 03:MCU after with audio mixing sends to meeting-place 2 and meeting-place 3, meeting-place 2 and meeting-place 3 audio reception bags 1, this step time-delay 150ms; This moment, the sound in meeting-place 1 was heard in meeting-place 2, meeting-place 2 speeches.
Step 04: audio pack 22 sends to MCU from the meeting-place, MCU audio reception bag 2, this step time-delay 150ms.
Step 05:MCU first decodes to audio pack 2 and encodes afterwards, audio mixing, this step time-delay 150ms.
The audio pack 2 of step 06:MCU after with audio mixing sends to meeting-place 1 and meeting-place 3, meeting-place 1 and meeting-place 3 audio reception bags 2, this step time-delay 150ms; This moment, the answer in meeting-place 2 was heard in meeting-place 1.
As can be seen from Figure 2,1 finishes the answer that meeting-place 2 is heard in meeting-place 1 from the meeting-place, and 900ms has paused in the centre; And meeting-place 3 hear meeting-place 1 finish after to the answer of hearing meeting-place 2,450ms has paused in the centre.
Summary of the invention
The invention provides dialogue method and device in video conference, to reduce the time-delay in the videoconference session process.
Technical scheme of the present invention is achieved in that
Dialogue method in a kind of video conference, wherein, the first meeting-place and the dialogue of the second meeting-place, the method comprises:
Multipoint control unit MCU receives the first packet that send in the first meeting-place, copy the first packet, first packet directly is transmitted to the second meeting-place, simultaneously, give local hybrid processor with another first Packet Generation, the first packet is carried out audio mixing with local hybrid processor and/or mixed screen is processed, the first Packet Generation after MCU will process in video conference except first and second meeting other meeting-place outside the venue.
Described MCU further comprises after first packet directly is transmitted to the second meeting-place:
MCU receives the second packet that send in the second meeting-place, copy the second packet, second packet directly is transmitted to the first meeting-place, simultaneously, give local hybrid processor with another second Packet Generation, the second packet is carried out audio mixing with local hybrid processor and/or mixed screen is processed, the second Packet Generation after MCU will process in video conference except first and second meeting other meeting-place outside the venue.
After described MCU directly is transmitted to the second meeting-place with first packet, MCU further comprises before receiving the second packet of sending in the second meeting-place:
The second meeting-place receives the first packet, begins speech, with the second Packet Generation to MCU.
Described the second packet is audio pack, or video packets, or audio pack+video packets.
Described the first packet is audio pack, or video packets, or audio pack+video packets.
When described the first packet is audio pack+video packets,
Described local hybrid processor to the second packet carry out audio mixing and/or mixed screen process after, second Packet Generation of MCU after processing be to can further comprising before in other meeting-place outside the venue except first and second in video conference:
The audio pack that MCU obtains stereo process and mixed screen are processed the video packets that obtains and are carried out labial synchronization and process, the audio pack after labial synchronization is processed and video packets send in video conference can be outside the venue except first and second other meeting-place.
Multipoint control unit MCU in a kind of video conference, this MCU comprises:
Transceiver module: receive the first packet that send in the first meeting-place, with the first Packet Generation to replication module; The first packet after audio mixing and/or mixed screen are processed that receives that hybrid processor sends, with this first Packet Generation to other meeting-place that can be outside the venue except first and second in video conference;
Replication module: receive the first packet that transceiver module is sent, copy this first packet, first packet directly is transmitted to the second meeting-place, simultaneously, with another first Packet Generation to hybrid processor;
Hybrid processor: the first packet that replication module is sent carries out audio mixing and/or mixed screen is processed, with the first Packet Generation after processing to transceiver module.
Described the first packet is the first audio pack+first video packets, and described hybrid processor comprises:
Mixer: receive the first audio pack that replication module is sent, to the first audio pack first decode rear coding, stereo process, the first audio pack after processing is sent to the labial synchronization device;
Mixed screen device: receive the first video packets that replication module is sent, the first video packets is mixed screen process, the first video packets after processing is sent to the labial synchronization device;
Labial synchronization device: the first video packets after mixed screen is processed sent through the first audio pack after stereo process and mixed screen device that receives that mixer sends, this two bag is carried out labial synchronization to be processed, the first audio pack, the first video packets after labial synchronization is processed send to transceiver module, are transmitted in video conference except first and second meeting other meeting-place outside the venue by transceiver module.
Described transceiver module is further used for, and receives the second packet that send in the second meeting-place, with the second Packet Generation to replication module; The second packet after audio mixing and/or mixed screen are processed that receives that hybrid processor sends, with this second Packet Generation to other meeting-place that can be outside the venue except first and second in video conference;
And described replication module is further used for, and receives the second packet that transceiver module is sent, and copies this second packet, and second packet directly is transmitted to the first meeting-place, simultaneously, with another second Packet Generation to hybrid processor;
And described hybrid processor is further used for, and the second packet that replication module is sent carries out audio mixing and/or mixed screen is processed, with the second Packet Generation after processing to transceiver module.
Described the second packet is the second audio pack+second video packets, and described hybrid processor comprises:
Mixer: receive the first audio pack that replication module is sent, to the first audio pack first decode rear coding, stereo process, the first audio pack after processing is sent to the labial synchronization device; Receive the second audio pack that replication module is sent, to the second audio pack first decode rear coding, stereo process, the second audio pack after processing is sent to the labial synchronization device;
Mixed screen device: receive the first video packets that replication module is sent, the first video packets is mixed screen process, the first video packets after processing is sent to the labial synchronization device; Receive the second video packets that replication module is sent, the second video packets is mixed screen process, the second video packets after processing is sent to the labial synchronization device;
Labial synchronization device: the first video packets after mixed screen is processed sent through the first audio pack after stereo process and mixed screen device that receives that mixer sends, this two bag is carried out labial synchronization to be processed, the first audio pack, the first video packets after labial synchronization is processed send to transceiver module, are transmitted in video conference except first and second meeting other meeting-place outside the venue by transceiver module; The second video packets after mixed screen is processed sent through the second audio pack after stereo process and mixed screen device that receives that mixer sends, this two bag is carried out labial synchronization to be processed, the second audio pack, the second video packets after labial synchronization is processed send to transceiver module, are transmitted in video conference except first and second meeting other meeting-place outside the venue by transceiver module.
Compared with prior art, in the present invention, when MCU receives the packet of sending in arbitrary meeting-place, copy this packet, one packet directly is transmitted to meeting-place with the dialogue of this meeting-place, with another package forward to mixer and/or mixed screen device, with the Packet Generation after audio mixing and/or mixed screen are processed to other meeting-place in video conference, the dialogue that the present invention has reduced the other side both sides postpones, and has also reduced other meeting-place and has heard the time-delay that both sides talk with.
Description of drawings
Fig. 1 is the dialogue schematic diagram of existing video conference;
Fig. 2 is in video conference shown in Figure 1, the dialog procedure schematic diagram between existing meeting-place 1,2;
Conversation process figure in the video conference that Fig. 3 provides for the embodiment of the present invention;
Fig. 4 when meeting-place 1,2 dialogue, uses audio pack delay Analysis process schematic diagram of the present invention for take video conference shown in Figure 1 as example;
The structural representation of MCU in the video conference that Fig. 5 provides for the embodiment of the present invention.
Embodiment
The present invention is further described in more detail below in conjunction with drawings and the specific embodiments.
Conversation process figure in the video conference that Fig. 3 provides for the embodiment of the present invention, as shown in Figure 3, its concrete steps are as follows:
Step 301: the first meeting-place speech, the first meeting-place sends the first audio pack and the first video packets to MCU, and MCU receives the first audio pack and the first video packets.
This step comprises the transmission time-delay from the first meeting-place to MCU of the first audio pack, the first video packets.
Step 302:MCU copies the first audio pack and the first video packets, first audio pack, first video packets are sent to its own interfaces that is connected with the second meeting-place, simultaneously, another first audio pack is sent to local mixer, another first video packets is sent to local mixed screen device.
This step is all that process this locality of MCU, does not produce time-delay.
Step 303: the first audio pack and the first video packets are sent to the second meeting-place from MCU, and the sound in the first meeting-place is heard in the second meeting-place, see simultaneously the speech image in the first meeting-place; Mixer is to the first audio pack first decode rear coding, stereo process, and mixed screen device mix screen to the first video packets and processes, and MCU carries out the labial synchronization processing to audio mixing data and mixed screen data.
In practice, the first meeting-place, the second meeting-place are to transmit audio pack and video packets to MCU in real time.Here, mixer carry out stereo process be actually to the dialogue both sides: the audio pack in the first meeting-place and the second meeting-place is carried out stereo process, but this moment owing to not talking in the second meeting-place, therefore, the audio pack in the second meeting-place is actually a quiet bag.
Equally, here, mixed screen device is the video packets in the first meeting-place and the second meeting-place mix screen process, and for example: mixed screen device can be with the video packets in the first meeting-place input source as 2 panes left side picture, with the video packets in the second meeting-place input source as picture on the right of 2 panes.
This step comprises: the time-delay from MCU to the second meeting-place of the first audio pack, the first video packets, and mixer, mixed screen device are delayed time to the processing of the first audio pack, the first video packets, and this two time-delay walks abreast.
Step 304: the second meeting-place speech, the second meeting-place sends to MCU with the second audio pack and the second video packets; The first audio pack, the first video packets after MCU processes labial synchronization sends in video conference except first and second meeting other meeting-place outside the venue.
It is that the lip of teller on picture is synchronizeed with its sound that labial synchronization is processed.
This step comprises: the transmission time-delay from the second meeting-place to MCU of the second audio pack, the second video packets, and the transmission time-delay from MCU to other meeting-place of the first audio pack after labial synchronization is processed, the first video packets, this two time-delay walks abreast.
Step 305:MCU receives the second audio pack and the second video packets, copy the second audio pack and the second video packets, second audio pack, second video packets are sent to its own interfaces that is connected with the first meeting-place, simultaneously, another second audio pack is sent to local mixer, another second video packets is sent to local mixed screen device.
This step is all that process this locality of MCU, does not produce time-delay.
Step 306: the second audio pack and the second video packets are sent to the first meeting-place from MCU, and the sound in the second meeting-place is heard in the first meeting-place, see simultaneously the speech image in the second meeting-place; Mixer is to the second audio pack first decode rear coding, stereo process, and mixed screen device mix screen to the second video packets and processes, and MCU carries out the labial synchronization processing to audio mixing data and mixed screen data.
This step comprises: the transmission time-delay from MCU to the first meeting-place of the second audio pack, the second video packets, and mixer, mixed screen device are delayed time to the processing of the second audio pack, the second video packets, and this two time-delay walks abreast.
The second audio pack after step 307:MCU processes labial synchronization, the second video packets from MCU be sent to video conference can be outside the venue except first and second other meeting-place, the answer in the second meeting-place is heard in other meeting-place, and sees the answer image in the second meeting-place.
This step comprises: the transmission time-delay from MCU to other meeting-place of the second audio pack after labial synchronization is processed, the second video packets.
Suppose that audio pack, video packets transmission delay between MCU and each meeting-place are all 150ms, mixer is to audio pack first decode rear coding, stereo process 150ms consuming time, mixed screen device mixes screen to video packets and processes 150ms consuming time, still take video conference shown in Figure 1 as example, when providing meeting-place 1,2 dialogue, use audio pack delay Analysis process of the present invention, as shown in Figure 4:
Step 01: the first meeting-place speech, audio pack 1 is sent to MCU from the first meeting-place, time-delay 150ms.
Step 02: audio pack 1 is sent to the second meeting-place from MCU, time-delay 150ms; Simultaneously,
Mixer on MCU is to audio pack 1 first decode rear coding, stereo process, time-delay 150ms.
Execution of step 02,300ms when coextensive.
Step 03: the second meeting-place speech, audio pack 2 is sent to MCU from the second meeting-place, time-delay 150ms; Simultaneously,
Audio pack 1 after audio mixing is sent to meeting-place 3 from MCU, time-delay 150ms, and meeting-place 1 speech is heard in meeting-place 3.
Execution of step 03,450ms when coextensive.
Step 04: audio pack 2 is sent to meeting-place 1 from MCU, time-delay 150ms, and the answer in meeting-place 2 is heard in meeting-place 1; Simultaneously,
Mixer on MCU is to audio pack 2 first decode rear coding, stereo process, time-delay 150ms.
Execution of step 04,600ms when coextensive.
Step 05: the audio pack 2 after audio mixing is sent to meeting-place 3 from MCU, time-delay 150ms, and the answer in meeting-place 2 is heard in meeting-place 3.
As can be seen from Figure 4: 1 finishes the answer that meeting-place 2 is heard in meeting-place 1 from the meeting-place, and namely from step 01 to step 04,150ms+150ms+150ms+150ms=600ms altogether pauses in the centre; And as can be seen from Figure 2, adopt the middle 900ms that pauses altogether of prior art.
3 hear that meeting-place 1 talked about the answer that meeting-place 2 is heard in meeting-place 3 from the meeting-place, and namely from step 03~05,300ms altogether pauses in the centre; And as can be seen from Figure 2, adopt the middle 450ms that pauses altogether of prior art.
As seen, after using the present invention, the dialogue time-delay in video conference has reduced.
The structural representation of MCU in the video conference that Fig. 5 provides for the embodiment of the present invention, as shown in Figure 5, it mainly comprises: transceiver module 51, replication module 52 and hybrid processor 53, wherein:
Transceiver module 51: receive the first packet that send in the first meeting-place, with the first Packet Generation to replication module 52; The first packet after audio mixing and/or mixed screen are processed that receives that hybrid processor 53 sends, with this first Packet Generation to other meeting-place that can be outside the venue except first and second in video conference; Receive the second packet that send in the second meeting-place, with the second Packet Generation to replication module 52; The second packet after audio mixing and/or mixed screen are processed that receives that hybrid processor 53 sends, to other meeting-place that can be outside the venue except first and second in video conference, wherein, talk with the second meeting-place in the first meeting-place with this second Packet Generation.
Replication module 52: receive the first packet that transceiver module 51 is sent, copy this first packet, first packet directly is transmitted to the second meeting-place, simultaneously, with another first Packet Generation to hybrid processor 53; Receive the second packet that transceiver module 51 is sent, copy this second packet, second packet directly is transmitted to the first meeting-place, simultaneously, with another second Packet Generation to hybrid processor 53.
Hybrid processor 53: the first packet that replication module 52 is sent carries out audio mixing and/or mixed screen is processed, with the first Packet Generation after processing to transceiver module 51; The second packet that replication module 52 is sent carries out audio mixing and/or mixed screen is processed, with the second Packet Generation after processing to transceiver module 51.
In actual applications, when first and second packet only comprised audio pack, hybrid processor 53 was actually mixer, and only first decode rear coding, stereo process of first and second packet that replication module 52 is sent gets final product; When first and second packet only comprised video packets, hybrid processor 53 was actually mixed screen device, and first and second packet that replication module 52 is sent only mix the screen processing and gets final product; When first and second packet was audio pack+video packets, hybrid processor 53 comprised: mixer, mixed screen device and labial synchronization device, wherein:
Mixer: receive the first audio pack that replication module 52 is sent, to the first audio pack first decode rear coding, stereo process, the first audio pack after processing is sent to the labial synchronization device; Receive the second audio pack that replication module 52 is sent, to the second audio pack first decode rear coding, stereo process, the second audio pack after processing is sent to the labial synchronization device.
Mixed screen device: receive the first video packets that replication module 52 is sent, the first video packets is mixed screen process, the first video packets after processing is sent to the labial synchronization device; Receive the second video packets that replication module 52 is sent, the second video packets is mixed screen process, the second video packets after processing is sent to the labial synchronization device.
Labial synchronization device: the first video packets after mixed screen is processed sent through the first audio pack after stereo process and mixed screen device that receives that mixer sends, this two bag is carried out labial synchronization to be processed, the first audio pack, the first video packets after labial synchronization is processed send to transceiver module 51, are transmitted in video conference except first and second meeting other meeting-place outside the venue by transceiver module 51; The second video packets after mixed screen is processed sent through the second audio pack after stereo process and mixed screen device that receives that mixer sends, this two bag is carried out labial synchronization to be processed, the second audio pack, the second video packets after labial synchronization is processed send to transceiver module 51, are transmitted in video conference except first and second meeting other meeting-place outside the venue by transceiver module 51.
The above is only preferred embodiment of the present invention, and is in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of making, is equal to replacement, improvement etc., within all should being included in the scope of protection of the invention.

Claims (7)

1. the dialogue method in a video conference, wherein, the first meeting-place and the dialogue of the second meeting-place is characterized in that, the method comprises:
Multipoint control unit MCU receives the first packet that send in the first meeting-place, copy the first packet, first packet directly is transmitted to the second meeting-place, simultaneously, give local hybrid processor with another first Packet Generation, the first packet is carried out audio mixing with local hybrid processor and/or mixed screen is processed, the first Packet Generation after MCU will process in video conference except first and second meeting other meeting-place outside the venue;
MCU receives the second packet that send in the second meeting-place, copy the second packet, second packet directly is transmitted to the first meeting-place, simultaneously, give local hybrid processor with another second Packet Generation, the second packet is carried out audio mixing with local hybrid processor and/or mixed screen is processed, the second Packet Generation after MCU will process in video conference except first and second meeting other meeting-place outside the venue.
2. method according to claim 1, is characterized in that, after described MCU directly is transmitted to the second meeting-place with first packet, MCU further comprises before receiving the second packet of sending in the second meeting-place:
The second meeting-place receives the first packet, begins speech, with the second Packet Generation to MCU.
3. method according to claim 1 and 2, is characterized in that, described the second packet is audio pack, or video packets, or audio pack+video packets.
4. method according to claim 1, is characterized in that, described the first packet is audio pack, or video packets, or audio pack+video packets.
5. method according to claim 4, is characterized in that, when described the first packet is audio pack+video packets,
Described local hybrid processor to the second packet carry out audio mixing and/or mixed screen process after, second Packet Generation of MCU after processing be to can further comprising before in other meeting-place outside the venue except first and second in video conference:
The audio pack that MCU obtains stereo process and mixed screen are processed the video packets that obtains and are carried out labial synchronization and process, the audio pack after labial synchronization is processed and video packets send in video conference can be outside the venue except first and second other meeting-place.
6. the multipoint control unit MCU in a video conference, is characterized in that, this MCU comprises:
Transceiver module: receive the first packet that send in the first meeting-place, with the first Packet Generation to replication module; The first packet after audio mixing and/or mixed screen are processed that receives that hybrid processor sends, with this first Packet Generation to other meeting-place that can be outside the venue except first and second in video conference; Receive the second packet that send in the second meeting-place, with the second Packet Generation to replication module; The second packet after audio mixing and/or mixed screen are processed that receives that hybrid processor sends, with this second Packet Generation to other meeting-place that can be outside the venue except first and second in video conference;
Replication module: receive the first packet that transceiver module is sent, copy this first packet, first packet directly is transmitted to the second meeting-place, simultaneously, with another first Packet Generation to hybrid processor; Receive the second packet that transceiver module is sent, copy this second packet, second packet directly is transmitted to the first meeting-place, simultaneously, with another second Packet Generation to hybrid processor;
Hybrid processor: the first packet that replication module is sent carries out audio mixing and/or mixed screen is processed, with the first Packet Generation after processing to transceiver module; The second packet that replication module is sent carries out audio mixing and/or mixed screen is processed, with the second Packet Generation after processing to transceiver module.
7. MCU according to claim 6, is characterized in that, described the first packet is the first audio pack+first video packets, and described the second packet is the second audio pack+second video packets, and described hybrid processor comprises:
Mixer: receive the first audio pack that replication module is sent, to the first audio pack first decode rear coding, stereo process, the first audio pack after processing is sent to the labial synchronization device; Receive the second audio pack that replication module is sent, to the second audio pack first decode rear coding, stereo process, the second audio pack after processing is sent to the labial synchronization device;
Mixed screen device: receive the first video packets that replication module is sent, the first video packets is mixed screen process, the first video packets after processing is sent to the labial synchronization device; Receive the second video packets that replication module is sent, the second video packets is mixed screen process, the second video packets after processing is sent to the labial synchronization device;
Labial synchronization device: the first video packets after mixed screen is processed sent through the first audio pack after stereo process and mixed screen device that receives that mixer sends, the first audio pack and the first video packets are carried out the labial synchronization processing, the first audio pack, the first video packets after labial synchronization is processed send to transceiver module, are transmitted in video conference except first and second meeting other meeting-place outside the venue by transceiver module; The second video packets after mixed screen is processed sent through the second audio pack after stereo process and mixed screen device that receives that mixer sends, the second audio pack and the second video packets are carried out the labial synchronization processing, the second audio pack, the second video packets after labial synchronization is processed send to transceiver module, are transmitted in video conference except first and second meeting other meeting-place outside the venue by transceiver module.
CN 201010243594 2010-08-02 2010-08-02 Session method and multi-point control unit for video conference Active CN102348097B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010243594 CN102348097B (en) 2010-08-02 2010-08-02 Session method and multi-point control unit for video conference

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010243594 CN102348097B (en) 2010-08-02 2010-08-02 Session method and multi-point control unit for video conference

Publications (2)

Publication Number Publication Date
CN102348097A CN102348097A (en) 2012-02-08
CN102348097B true CN102348097B (en) 2013-05-22

Family

ID=45546331

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010243594 Active CN102348097B (en) 2010-08-02 2010-08-02 Session method and multi-point control unit for video conference

Country Status (1)

Country Link
CN (1) CN102348097B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8970651B2 (en) * 2012-12-14 2015-03-03 Avaya Inc. Integrating audio and video conferencing capabilities
CN104272713A (en) 2013-11-12 2015-01-07 华为技术有限公司 Multi-party calling method and device
CN106210764A (en) * 2015-04-29 2016-12-07 北京视联动力国际信息技术有限公司 The conjunction screen processing method of a kind of multichannel media stream and system
CN105469803B (en) * 2015-11-23 2019-04-05 北京华夏电通科技有限公司 Echo cancel method and system in tripartite's telecommunication based on left and right acoustic channels coding
CN105280192B (en) * 2015-11-23 2019-04-05 北京华夏电通科技有限公司 Echo cancel method and system in tripartite's telecommunication based on multiple sound coding
CN106534762B (en) * 2016-11-16 2019-12-13 深圳市捷视飞通科技股份有限公司 low-delay distributed audio processing method and system
CN110971863B (en) * 2019-11-21 2021-03-23 厦门亿联网络技术股份有限公司 Multi-point control unit cross-area conference operation method, device, equipment and system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1655609A (en) * 2004-02-13 2005-08-17 精工爱普生株式会社 Method and system for recording videoconference data
CN1849824A (en) * 2003-10-08 2006-10-18 思科技术公司 System and method for performing distributed video conferencing
CN101102456A (en) * 2007-07-25 2008-01-09 中兴通讯股份有限公司 A video conference system with instant messaging function and its implementation method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1849824A (en) * 2003-10-08 2006-10-18 思科技术公司 System and method for performing distributed video conferencing
CN1655609A (en) * 2004-02-13 2005-08-17 精工爱普生株式会社 Method and system for recording videoconference data
CN101102456A (en) * 2007-07-25 2008-01-09 中兴通讯股份有限公司 A video conference system with instant messaging function and its implementation method

Also Published As

Publication number Publication date
CN102348097A (en) 2012-02-08

Similar Documents

Publication Publication Date Title
CN102348097B (en) Session method and multi-point control unit for video conference
KR100880150B1 (en) Multi-point video conference system and media processing method thereof
JP5534813B2 (en) System, method, and multipoint control apparatus for realizing multilingual conference
CN101478642A (en) Multi-picture mixing method and apparatus for video meeting system
CN103051864B (en) Mobile video session method
US20100039498A1 (en) Caption display method, video communication system and device
WO2008113269A1 (en) Method and device for realizing a private conversation in a multi-point session
CN104980683A (en) Implement method and device for video telephone conference
CN101198008A (en) Method and system for implementing multi-screen and multi-picture
CN101895718B (en) Video conference system multi-image broadcast method, and device and system thereof
CN105376516A (en) Mobile video conference system and implementing method thereof
CN101645952A (en) Conference telephone terminal, system and method for sharing data
US20110292165A1 (en) System and method for scalable media switching conferencing
WO2012034324A1 (en) Video conference system and implementation method thereof
WO2014173091A1 (en) Method and device for displaying conference material in video conference
US20090019112A1 (en) Audio and video conferencing using multicasting
WO2015154608A1 (en) Method, system and apparatus for sharing video conference material
WO2016019775A1 (en) Conference migration method, device and system
CN102625079A (en) Video implementation method for trilateral video conference
KR20070076133A (en) Video conference system and method using white board
CN104580763A (en) Method and device for realizing private chat in telephone conference
US20230199146A1 (en) System and method for scalable media switching conferencing
WO2015003532A1 (en) Multimedia conferencing establishment method, device and system
CN103856809A (en) Method, system and terminal equipment for multipoint at the same screen
WO2014177082A1 (en) Video conference video processing method and terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: 310052 Binjiang District Changhe Road, Zhejiang, China, No. 466, No.

Patentee after: Xinhua three Technology Co., Ltd.

Address before: 310053 Hangzhou hi tech Industrial Development Zone, Zhejiang province science and Technology Industrial Park, No. 310 and No. six road, HUAWEI, Hangzhou production base

Patentee before: Huasan Communication Technology Co., Ltd.