CN102118602B - Method and system for displaying auxiliary streaming video in multiple pictures - Google Patents
Method and system for displaying auxiliary streaming video in multiple pictures Download PDFInfo
- Publication number
- CN102118602B CN102118602B CN 201110061844 CN201110061844A CN102118602B CN 102118602 B CN102118602 B CN 102118602B CN 201110061844 CN201110061844 CN 201110061844 CN 201110061844 A CN201110061844 A CN 201110061844A CN 102118602 B CN102118602 B CN 102118602B
- Authority
- CN
- China
- Prior art keywords
- video
- auxilliary stream
- main flow
- yuv
- auxilliary
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method and system for displaying auxiliary streaming video in multiple pictures, which are applied to the field of video conferences. The method comprises the following steps of: receiving a main stream real-time transfer protocol (RTP) packet and an auxiliary stream RTP packet sent by one or more video conference terminals; processing the main stream RTP packet and the auxiliary stream RTP packet, and sending the main stream RTP packet and the auxiliary stream RTP packet to a video conference terminal of a conference place so that the video conference terminal simultaneously displays the main stream RTP packet and the auxiliary stream RTP packet in multiple pictures. The embodiment of the invention enables participants to conveniently select to watch a main streaming video or auxiliary streaming video, and thus, the good experience of the participants is effectively enhanced.
Description
Technical field
The invention belongs to the video conference field, relate in particular to a kind of method and system at the auxilliary stream of many screen displayed video.
Background technology
Video conferencing system realizes that by the network communications technology two places or a plurality of intersite transmit live image information in real time, has farthest shortened space length, conveniently is in different local participants and exchanges in real time.
In the existing video conferencing technology, usually on video conference terminal, only show the picture of main flow video, if the participant wishes to watch auxilliary stream video, then need be on video conference terminal current video be switched to auxilliary stream video.This method can not make the participant select main flow video or the auxilliary stream video of watching flexibly, and it is not good to cause the participant to experience.
Summary of the invention
The embodiment of the invention provides a kind of method at the auxilliary stream of many screen displayed video, is intended to solve the participant and can not selects to watch auxilliary stream video flexibly on video conference terminal, causes the user to experience not good problem.
The embodiment of the invention is achieved in that a kind of method at the auxilliary stream of many screen displayed video, and described method comprises step:
Receive the auxilliary stream transmission request that one or more video conference terminals send, and respond described auxilliary stream transmission request, so that described video conference terminal is opened the auxilliary stream RTP bag that auxilliary circulation road also sends correspondence;
Receive main flow real time transport protocol RTP bag and auxilliary stream RTP bag that single or multiple video conference terminals send;
The video conference terminal in meeting-place is handled and be sent to described main flow RTP bag and auxilliary stream RTP bag, so that described video conference terminal shows main flow video information and auxilliary stream video information simultaneously in many pictures;
By the described video conference terminal frozen picture of signaling, again compile a reference frame, and send described reference frame to the video conference terminal of described frozen picture, so that described video conference terminal receives after the described reference frame, automatically described frozen picture solution is consolidated;
Wherein, the step that described main flow RTP bag and auxilliary stream RTP bag are handled is specially:
Ordering, the described main flow RTP bag of decoding and auxilliary stream RTP, and main flow yuv format data and the auxilliary stream yuv format data splicing that obtains of will decoding is the data of picture yuv format more than;
And further comprising the steps: with main flow yuv format data with before assisting the step that stream yuv format data splicing is the data of picture yuv format more than
Transmission rate by the auxilliary stream of the auxilliary stream of buffer memory RTP bag control yuv format data, particularly, if the transmission rate of auxilliary stream YUV video formatted data is greater than the transmission rate of main flow YUV video formatted data, then buffer memory is partly assisted the transmission rate that stream RTP wraps to reduce described auxilliary stream YUV video formatted data, with when the transmission rate of the transmission rate of auxilliary stream YUV video formatted data and main flow YUV video formatted data is identical, with described a plurality of main flow YUV video formatted datas with auxilliary to flow that the YUV video formatted data splices and combines be the yuv format data of picture more than.
Another purpose of the embodiment of the invention is to provide a kind of system at the auxilliary stream of many screen displayed video, and described system comprises:
RTP wraps receiving element, receive the auxilliary stream transmission request that one or more video conference terminals send, and respond described auxilliary stream and send request, so that described video conference terminal is opened auxilliary circulation road and sent corresponding auxilliary stream RTP bag, receive main flow real time transport protocol RTP bag and auxilliary stream RTP bag that single or multiple video conference terminals send;
RTP wraps transmitting element, and the video conference terminal in meeting-place is handled and be sent to described main flow RTP bag and auxilliary stream RTP bag, so that described video conference terminal shows main flow video information and auxilliary stream video information simultaneously in many pictures;
MC is by the described video conference terminal frozen picture of signaling;
MP compiles a reference frame again, and sends described reference frame to the video conference terminal of described frozen picture, so that described video conference terminal receives after the described reference frame, automatically described frozen picture solution is consolidated;
Wherein, described RTP bag transmitting element comprises:
RTP packet sequencing decoder module is used for ordering, the described main flow RTP bag of decoding and auxilliary stream RTP;
The data splicing module, it is the data of picture yuv format more than that be used for decoding described main flow RTP bag and auxilliary stream RTP wrap the main flow yuv format data and the auxilliary stream yuv format data splicing that obtain;
The speed control module, be used for the transmission rate by the auxilliary stream of the auxilliary stream of buffer memory RTP bag control yuv format data, particularly, if the transmission rate of auxilliary stream YUV video formatted data is greater than the transmission rate of main flow YUV video formatted data, then buffer memory is partly assisted the transmission rate that stream RTP wraps to reduce described auxilliary stream YUV video formatted data, with when the transmission rate of the transmission rate of auxilliary stream YUV video formatted data and main flow YUV video formatted data is identical, with described a plurality of main flow YUV video formatted datas with auxilliary to flow that the YUV video formatted data splices and combines be the yuv format data of picture more than.
In the embodiment of the invention, MCU receives the RTP bag that each meeting-place sends, comprise main flow video information and auxilliary stream video information in each meeting-place in this RTP bag, the RTP bag that receives being sorted, decode, is spliced into after code check that many pictures yuv format data and the code check that the main flow video in these yuv format data is sent, auxilliary stream video send controlling, be sent to again on the video conference terminal in meeting-place.Further, before the yuv format data that comprise main flow video information and auxilliary stream video information after will splicing are sent to video conference terminal, if do not receive the auxilliary stream video instructions of watching of participant's transmission, then only the main flow video is sent on the video conference terminal of this participant's correspondence, if receive the auxilliary stream video instructions of watching of participant's transmission, then main flow video and auxilliary stream video are sent on the video conference terminal of this participant's correspondence simultaneously, so that this video conference terminal shows main flow video and auxilliary stream video simultaneously.Because the participant can select to watch main flow video or auxilliary stream video easily according to the demand of actual conditions, therefore effectively strengthens participant's good experience.
Description of drawings
Fig. 1 is the method flow at the auxilliary stream of many screen displayed video that first embodiment of the invention provides;
Fig. 2 is the system configuration at the auxilliary stream of many screen displayed video that second embodiment of the invention provides.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explaining the present invention, and be not used in restriction the present invention.
The embodiment of the invention is by receiving the real time transport protocol RTP bag of the video conference terminal transmission that participates in single or multiple meeting-place in the video conference, after the RTP bag that this is comprised main flow video information and auxilliary stream video information is handled, be sent to the video conference terminal in meeting-place so that this video conference terminal shows main flow video information and auxilliary stream video information simultaneously.
For technical solutions according to the invention are described, describe below by specific embodiment.
Embodiment one:
Fig. 1 shows the method flow at the auxilliary stream of many screen displayed video that first embodiment of the invention provides, and details are as follows:
In step S11, receive main flow real time transport protocol RTP bag and auxilliary stream RTP bag that single or multiple video conference terminals send.
As an alternative embodiment of the invention, before video conference begins, multipoint control unit (Multi-point Control Unit, MCU) receive the image mode selection instruction that chairman or web console send, be chosen in the many image modes that show on the video conference terminal according to this image mode selection instruction.Chairman or web console select to be presented at many image modes of video conference terminal according to the number that participates in meeting-place in the video conference, and wherein, the kind of these many image modes has 2,4,6,9 usually, 16 kind.Suppose that this video conference has 4 meeting-place, there is a video conference terminal in each meeting-place, and then chairman or web console select to show simultaneously the image mode in 4 meeting-place at MCU.Certainly, the image mode of having selected also can be changed by chairman or web console in the video conference process.
As an alternative embodiment of the invention, after having selected many image modes, in MCU, specify each meeting-place main flow video information and auxilliary stream video information in the position of many screen displayed by chairman or web console according to the affiliation order in each meeting-place, and specify this main flow video information and the numbering of auxilliary stream video information in many pictures.MCU receives position designated order or the numbering designated order of chairman or web console, and specifies the main flow video information that participates in each meeting-place in video conference and auxilliary stream video information in the position of many screen displayed or specify the main flow video information that participates in each meeting-place in video conference and auxilliary stream video information in the numbering of many screen displayed according to this numbering designated order according to this position designated order.Such as,, the main flow video information in the meeting-place of first affiliation is presented at the upper left corner of whole image, and is numbered 1 when showing many pictures in 4 meeting-place in the pattern of many pictures, the auxilliary stream video information in this meeting-place is presented at the upper right corner of whole image, and is numbered 2; The main flow video information in the meeting-place of second affiliation is presented at the lower left corner of whole image, and is numbered 3, the auxilliary stream video information in this meeting-place is presented at the lower right corner of whole image, and is numbered 4.Certainly, in the process of video conference, chairman or web console can be changed with the numbering of auxilliary stream video information and in the position of many screen displayed the main flow video information in each meeting-place, and present embodiment does not limit.
In the present embodiment, if video conference begins, then MCU receives the video conference terminal in each meeting-place by main flow RTP (the Real-time Transport Protocol of main flow sendaisle transmission, RTP) with by the auxilliary stream RTP bag that auxilliary stream sendaisle sends, main flow video and the auxilliary image information that flows video in each meeting-place have been comprised in this main flow PTP bag and the auxilliary stream RTP bag.
As an alternative embodiment of the invention, before receiving the main flow RTP bag of single or multiple video conference terminals transmissions and assist the step that flows the RTP bag, MCU also comprises the steps:
This MCU receives the auxilliary stream that certain video conference terminal sends and sends request, and response should send request by auxilliary stream, wraps so that this video conference terminal is opened auxilliary circulation road and sent corresponding auxilliary stream RTP.
In the present embodiment, if certain meeting-place in the participation video conference need send the auxilliary stream information in this meeting-place to other meeting-place, then send auxilliary stream and send a request to MCU, after this MCU responds, the video conference terminal in this meeting-place will be opened auxilliary stream sendaisle, and will assist stream RTP bag and be sent to this MCU.
In step S12, the video conference terminal in meeting-place is handled and be sent to this main flow RTP bag and auxilliary stream RTP bag, so that this video conference terminal shows main flow video information and auxilliary stream video information simultaneously.
In the present embodiment, when MCU receives out of order main flow RTP bag or out of order auxilliary stream RTP bag, then to this main flow RTP bag or auxilliary stream RTP bag according to the time sequencing rearrangement, and main flow RTP bag and the auxilliary stream RTP after the decoding ordering wraps respectively.
Behind decoding main flow RTP bag and auxilliary stream RTP bag, obtain the yuv format data of main flow video and the auxilliary stream video of video conference terminal in each meeting-place, wherein, Y represents brightness signal value, U, V then represent chromatic value, are used for describing colors of image and saturation.Transmission rate to this auxilliary stream YUV video formatted data is controlled, and does not jump in order to guarantee many pictures that the participant watches at video conference terminal.
If the transmission rate of auxilliary stream YUV video formatted data is greater than the transmission rate of main flow YUV video formatted data, then buffer memory is partly assisted the transmission rate that stream RTP wraps to reduce this auxilliary stream YUV video formatted data.
When the transmission rate of the transmission rate of auxilliary stream YUV video formatted data and main flow YUV video formatted data is identical, it is the yuv format data of picture more than that these a plurality of main flow YUV video formatted datas are spliced and combined with auxilliary stream YUV video formatted data, and to the yuv format data of these many pictures encode, flow control, will send to the video conference terminal of all participants through the yuv format data of many pictures of flow control by the main flow sendaisle at last.
As an alternative embodiment of the invention, will assist the stream video information at MCU and also comprise step before being forwarded to the step of video conference terminal of all participants: receive the auxilliary stream video information that the participant sends and send instruction.If the participant wishes to receive the auxilliary stream video information that MCU sends, then this MCU is sent auxilliary stream video information and send instruction, the auxilliary stream video information that this MCU receives participant's transmission sends after the instruction, other video conference terminals in the conference participation will be forwarded to from the auxilliary stream video information that video conference terminal receives the conference participation on other video conference terminals, so that can show main flow video information and auxilliary stream video information simultaneously.If MCU does not receive the auxilliary stream video information transmission instruction that the participant sends, then only the main flow video information is sent on the corresponding video conference terminal of participant.When the participant wishes to watch simultaneously main flow video and auxilliary stream video, trigger auxilliary stream video and watch button, then MCU should assist the stream video information and be sent to corresponding video conference terminal according to the port information that comprises in the auxilliary stream video information.In the present embodiment, because will assist the stream video information joins on many pictures, changed the picture of former main flow video information on video conference terminal, therefore, MC among the MCU is by this video conference terminal frozen picture of signaling, ask the MP among the MCU to compile a reference frame again again, it is the I frame, be sent to the video conference terminal of frozen picture, after this video conference terminal receives the I frame of MP transmission, automatically the image solution that will solidify is solid, effectively prevented from adding auxilliary stream video after, change the flower screen phenomenon that the main flow picture does not have reference frame to produce.
As an alternative embodiment of the invention, if after video conference begins, this video conference is withdrawed from the one or more meeting-place that participate in video conference, and residing position on many pictures, meeting-place of then withdrawing from this video conference will be shown as blank screen.Suppose to be numbered 1 meeting-place and be presented at the upper left corner on many pictures, after this is numbered 1 meeting-place and drops by the wayside this video conference, the upper left corner on many pictures will be shown as blank screen.
In first embodiment of the invention, MCU receives main flow RTP bag and the auxilliary stream RTP bag that each meeting-place sends, comprise the main flow video information in each meeting-place in this main flow RTP bag, should auxilliaryly flow the auxilliary stream video information that comprises in the RTP bag in each meeting-place, after receiving this main flow RTP bag and auxilliary stream RTP bag, ordering again, the main flow RTP bag that decoding receives and auxilliary stream RTP bag, and the auxilliary stream YUV video formatted data that the auxilliary stream RTP bag of will decoding obtains is carried out speed control, make this auxilliary stream YUV video formatted data transmission rate identical with main flow YUV video formatted data transmission rate, at last this main flow YUV video formatted data and auxilliary stream YUV video formatted data are spliced into many pictures yuv format data, and carry out flow control to this many pictures yuv format data coding and to the transmission rate of the main flow YUV video formatted data in the many pictures yuv format data behind this coding, be sent to again on the video conference terminal in each meeting-place.Further, many pictures yuv format data that MCU will comprise main flow video information and auxilliary stream video information be forwarded to have the video conference terminal that receives auxilliary stream video information before, if do not receive the auxilliary stream video information transmission instruction that the participant sends, then only the main flow video information is forwarded on the video conference terminal of this participant's correspondence, if receive the auxilliary stream video information transmission instruction that the participant sends, then main flow video information and auxilliary stream video information are forwarded on the video conference terminal of this participant's correspondence simultaneously, so that this video conference terminal shows main flow video information and auxilliary stream video information simultaneously.Because the participant can select to watch the main flow video information or watch the main flow video information simultaneously and auxilliary stream video information easily according to the demand of actual conditions, therefore effectively strengthens participant's good experience.
Embodiment two:
Fig. 2 shows the system configuration at the auxilliary stream of many screen displayed video that second embodiment of the invention provides, and for convenience of explanation, only shows the part relevant with present embodiment.
Should can be used for by the various information processing terminals wired or wireless network Connection Service device in the system of the auxilliary stream of many screen displayed video, mobile phone for example, pocket computer (Pocket Personal Computer, PPC), palmtop PC, computer, notebook computer, personal digital assistant (Personal Digital Assistant, PDA) etc., it can be the software unit that runs in these terminals, the unit that hardware cell or software and hardware combine, also can be used as independently, suspension member is integrated in these terminals or runs in the application system of these terminals.
Before video conference began, MCU received the image mode selection instruction of chairman or web console transmission, is chosen in the many image modes that show on the video conference terminal according to this image mode selection instruction.After video conference began, MCU received the auxilliary stream that one or more video conference terminals send and sends request, and response should send request by auxilliary stream, wrapped so that this video conference terminal is opened auxilliary circulation road and sent corresponding auxilliary stream RTP.
Should comprise that RTP bag receiving element 21, RTP wrapped transmitting element 22 in the system of the auxilliary stream of many screen displayed video.
Wherein, RTP bag receiving element 21 receives main flow real time transport protocol RTP bag and the auxilliary stream RTP bag that single or multiple video conference terminals send;
The video conference terminal in meeting-place is handled and be sent to main flow RTP bag and auxilliary stream RTP bag that 22 pairs of RTP bags of RTP bag transmitting element receiving element 21 receives, so that this video conference terminal shows main flow video information and auxilliary stream video information simultaneously in many pictures.
Wherein, this RTP bag transmitting element 22 comprises: RTP packet sequencing decoder module 221, data splicing module 222 and flow-control module 223.
This RTP packet sequencing decoder module 221 is used at the main flow RTP bag that receives or auxilliary stream RTP bag when out of order, according to time sequencing resequence this main flow RTP bag or auxilliary stream RTP bag and the main flow RTP bag after the decoding ordering or auxilliary stream RTP bag.
In the present embodiment, main flow RTP bag and auxilliary stream RTP bag that MCU receives according to different code stream form decodings.
This data splicing module 222, it is the data of picture yuv format more than that be used for decoding this main flow RTP bag and auxilliary stream RTP wrap the main flow yuv format data and the auxilliary stream yuv format data splicing that obtain.
This flow-control module 223 is used for these many pictures yuv format data are carried out flow control.
In the present embodiment, MCU controls the transmission rate of the yuv format data of these many pictures according to existing bandwidth.If the shared bandwidth of transmission rate of the transmission rate of main flow YUV video formatted data and auxilliary stream YUV video formatted data exceeds existing bandwidth, then control the transmission rate of this main flow YUV video formatted data, so that the shared bandwidth of the transmission rate of the yuv format data of these many pictures does not exceed existing bandwidth.
As an alternative embodiment of the invention, this RTP bag transmitting element 22 also comprises speed control module 224.
In the present embodiment, behind decoding main flow RTP bag and auxilliary stream RTP bag, obtain the yuv format data of main flow video and the auxilliary stream video of video conference terminal in each meeting-place, wherein, Y represents brightness signal value, and U, V then represent chromatic value, is used for describing colors of image and saturation.Because the code check that auxilliary stream video sends is different from the code check that the main flow video sends, therefore when the main flow YUV video formatted data with each meeting-place is spliced into picture more than with auxilliary stream YUV video formatted data, need the transmission rate of this auxilliary stream YUV video formatted data of control, make that the transmission rate of this auxilliary stream YUV video formatted data is identical with the transmission rate of main flow YUV video formatted data, do not jump in order to guarantee many pictures that the participant watches at video conference terminal.
If the transmission rate of auxilliary stream YUV video formatted data is greater than the transmission rate of main flow YUV video formatted data, then buffer memory is partly assisted the transmission rate that stream RTP wraps to reduce this auxilliary stream YUV video formatted data.
This speed control module 224 is used for the transmission rate by the auxilliary stream of the auxilliary stream of buffer memory RTP bag control yuv format data.
If after video conference begins, this video conference is withdrawed from the one or more meeting-place that participate in video conference, and residing position on many pictures, meeting-place of then withdrawing from this video conference will be shown as blank screen.Suppose to be numbered 1 meeting-place and be presented at the upper left corner on many pictures, after this is numbered 1 meeting-place and drops by the wayside this video conference, the upper left corner on many pictures will be shown as blank screen.
In second embodiment of the invention, RTP bag receiving element 21 receives main flow real time transport protocol RTP bag and the auxilliary stream RTP bag that single or multiple video conference terminals send, the video conference terminal in meeting-place is handled and be sent to RTP bag transmitting element 22 to main flow RTP bag and auxilliary stream RTP bag that RTP bag receiving element 21 receives again, so that this video conference terminal shows main flow video information and auxilliary stream video information simultaneously in many pictures.Because the participant can select to watch main flow video or auxilliary stream video easily according to the demand of actual conditions, has therefore strengthened participant's good experience.
In the embodiment of the invention, MCU receives main flow RTP bag and the auxilliary stream RTP bag that each meeting-place sends, comprise the main flow video information in each meeting-place in this main flow RTP bag, should auxilliaryly flow the auxilliary stream video information that comprises in the RTP bag in each meeting-place, after receiving this main flow RTP bag and auxilliary stream RTP bag, ordering again, the main flow RTP bag that decoding receives and auxilliary stream RTP bag, and the auxilliary stream YUV video formatted data that the auxilliary stream RTP bag of will decoding obtains is carried out speed control, make this auxilliary stream YUV video formatted data transmission rate identical with main flow YUV video formatted data transmission rate, at last this main flow YUV video formatted data and auxilliary stream YUV video formatted data are spliced into many pictures yuv format data, and carry out flow control to this many pictures yuv format data coding and to the transmission rate of the main flow YUV video formatted data in the many pictures yuv format data behind this coding, be sent to again on the video conference terminal in each meeting-place.Further, before many pictures yuv format data that MCU will comprise main flow video information and auxilliary stream video information are forwarded to the video conference terminal of all participants, if do not receive the auxilliary stream video information transmission instruction that the participant sends, then only the main flow video information is forwarded on the video conference terminal of this participant's correspondence, if receive the auxilliary stream video information transmission instruction that the participant sends, then main flow video information and auxilliary stream video information are forwarded on the video conference terminal of this participant's correspondence simultaneously, so that this video conference terminal shows main flow video information and auxilliary stream video information simultaneously.Because the participant can select to watch the main flow video information or watch the main flow video information simultaneously and auxilliary stream video information easily according to the demand of actual conditions, therefore effectively strengthens participant's good experience.
The above only is preferred embodiment of the present invention, not in order to limiting the present invention, all any modifications of doing within the spirit and principles in the present invention, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.
Claims (3)
1. method at the auxilliary stream of many screen displayed video is characterized in that described method comprises step:
Receive the auxilliary stream transmission request that one or more video conference terminals send, and respond described auxilliary stream transmission request, so that described video conference terminal is opened the auxilliary stream RTP bag that auxilliary circulation road also sends correspondence;
Receive main flow real time transport protocol RTP bag and auxilliary stream RTP bag that single or multiple video conference terminals send;
The video conference terminal in meeting-place is handled and be sent to described main flow RTP bag and auxilliary stream RTP bag, so that described video conference terminal shows main flow video information and auxilliary stream video information simultaneously in many pictures;
By the described video conference terminal frozen picture of signaling, again compile a reference frame, and send described reference frame to the video conference terminal of described frozen picture, so that described video conference terminal receives after the described reference frame, automatically described frozen picture solution is consolidated;
Wherein, the step that described main flow RTP bag and auxilliary stream RTP bag are handled is specially:
Ordering, the described main flow RTP bag of decoding and auxilliary stream RTP, and main flow yuv format data and the auxilliary stream yuv format data splicing that obtains of will decoding is the data of picture yuv format more than;
And further comprising the steps: with main flow yuv format data with before assisting the step that stream yuv format data splicing is the data of picture yuv format more than
Transmission rate by the auxilliary stream of the auxilliary stream of buffer memory RTP bag control yuv format data, particularly, if the transmission rate of auxilliary stream YUV video formatted data is greater than the transmission rate of main flow YUV video formatted data, then buffer memory is partly assisted the transmission rate that stream RTP wraps to reduce described auxilliary stream YUV video formatted data, with when the transmission rate of the transmission rate of auxilliary stream YUV video formatted data and main flow YUV video formatted data is identical, with described a plurality of main flow YUV video formatted datas with auxilliary to flow that the YUV video formatted data splices and combines be the yuv format data of picture more than.
2. the method for claim 1 is characterized in that, further comprises the steps: before the step of the main flow real time transport protocol RTP bag that receives single or multiple video conference terminals transmissions and auxilliary stream RTP bag
Receive the image mode selection instruction that chairman or web console send, be chosen in the many image modes that show on the video conference terminal according to described image mode selection instruction;
Specify auxilliary stream video information in position and the numbering of many screen displayed according to many image modes of selecting.
3. system at the auxilliary stream of many screen displayed video is characterized in that described system comprises:
RTP wraps receiving element, receive the auxilliary stream transmission request that one or more video conference terminals send, and respond described auxilliary stream and send request, so that described video conference terminal is opened auxilliary circulation road and sent corresponding auxilliary stream RTP bag, receive main flow real time transport protocol RTP bag and auxilliary stream RTP bag that single or multiple video conference terminals send;
RTP wraps transmitting element, and the video conference terminal in meeting-place is handled and be sent to described main flow RTP bag and auxilliary stream RTP bag, so that described video conference terminal shows main flow video information and auxilliary stream video information simultaneously in many pictures;
MC is by the described video conference terminal frozen picture of signaling;
MP compiles a reference frame again, and sends described reference frame to the video conference terminal of described frozen picture, so that described video conference terminal receives after the described reference frame, automatically described frozen picture solution is consolidated;
Wherein, described RTP bag transmitting element comprises:
RTP packet sequencing decoder module is used for ordering, the described main flow RTP bag of decoding and auxilliary stream RTP;
The data splicing module, it is the data of picture yuv format more than that be used for decoding described main flow RTP bag and auxilliary stream RTP wrap the main flow yuv format data and the auxilliary stream yuv format data splicing that obtain;
The speed control module, be used for the transmission rate by the auxilliary stream of the auxilliary stream of buffer memory RTP bag control yuv format data, particularly, if the transmission rate of auxilliary stream YUV video formatted data is greater than the transmission rate of main flow YUV video formatted data, then buffer memory is partly assisted the transmission rate that stream RTP wraps to reduce described auxilliary stream YUV video formatted data, with when the transmission rate of the transmission rate of auxilliary stream YUV video formatted data and main flow YUV video formatted data is identical, with described a plurality of main flow YUV video formatted datas with auxilliary to flow that the YUV video formatted data splices and combines be the yuv format data of picture more than.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110061844 CN102118602B (en) | 2011-03-15 | 2011-03-15 | Method and system for displaying auxiliary streaming video in multiple pictures |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110061844 CN102118602B (en) | 2011-03-15 | 2011-03-15 | Method and system for displaying auxiliary streaming video in multiple pictures |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102118602A CN102118602A (en) | 2011-07-06 |
| CN102118602B true CN102118602B (en) | 2013-08-21 |
Family
ID=44217171
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110061844 Active CN102118602B (en) | 2011-03-15 | 2011-03-15 | Method and system for displaying auxiliary streaming video in multiple pictures |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102118602B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103974023B (en) * | 2013-02-04 | 2019-04-02 | 鸿富锦精密工业（深圳）有限公司 | Video pictures regulating system and method |
| CN103139531A (en) * | 2013-03-14 | 2013-06-05 | 广东威创视讯科技股份有限公司 | Method and device of video conference terminal display frame processing |
| CN103327287B (en) | 2013-05-23 | 2018-01-02 | 华为技术有限公司 | A kind of conference signal playing method and device, video conference terminal, mobile device |
| CN103281509B (en) * | 2013-05-29 | 2016-08-10 | 华为技术有限公司 | A kind of video conference optimizes display packing and device |
| CN104253969B (en) * | 2013-06-28 | 2017-12-05 | 华为技术有限公司 | The rendering method and device of more picture compositions |
| CN110324563A (en) * | 2018-03-29 | 2019-10-11 | 北京视联动力国际信息技术有限公司 | A kind of major-minor source switch method and system of video conference |
| CN111556273A (en) * | 2020-02-27 | 2020-08-18 | 上海创视通软件技术有限公司 | Method for controlling recording code stream in video conference recording and broadcasting |
| CN112040171B (en) * | 2020-09-17 | 2022-07-08 | 苏州科达科技股份有限公司 | Auxiliary stream display method, system, equipment and storage medium for video conference |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1411278A (en) * | 2002-11-25 | 2003-04-16 | 北京邮电通信设备厂 | IP network TV conference system |
| CN1450816A (en) * | 2003-04-22 | 2003-10-22 | 上海大学 | Stereo video stream coder/decoder and stereo video coding/decoding system |
| CN101505226A (en) * | 2009-02-25 | 2009-08-12 | 中国联合网络通信集团有限公司 | Multimedia communication interaction system and method |
| CN101820524A (en) * | 2010-03-22 | 2010-09-01 | 中兴通讯股份有限公司 | Video display method for video conference |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002237824A (en) * | 2001-02-09 | 2002-08-23 | Hitachi Ltd | Method for serving information |
| CN101296184B (en) * | 2008-05-30 | 2011-04-13 | 华为技术有限公司 | Method, system and device for data transmission |
-
2011
- 2011-03-15 CN CN 201110061844 patent/CN102118602B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1411278A (en) * | 2002-11-25 | 2003-04-16 | 北京邮电通信设备厂 | IP network TV conference system |
| CN1450816A (en) * | 2003-04-22 | 2003-10-22 | 上海大学 | Stereo video stream coder/decoder and stereo video coding/decoding system |
| CN101505226A (en) * | 2009-02-25 | 2009-08-12 | 中国联合网络通信集团有限公司 | Multimedia communication interaction system and method |
| CN101820524A (en) * | 2010-03-22 | 2010-09-01 | 中兴通讯股份有限公司 | Video display method for video conference |
Non-Patent Citations (1)
| Title |
|---|
| JP特开2002-237824A 2002.08.23 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102118602A (en) | 2011-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102118602B (en) | Method and system for displaying auxiliary streaming video in multiple pictures | |
| CN101370114B (en) | Video and audio processing method, multi-point control unit and video conference system | |
| US9532000B2 (en) | Method and system for sending and playing media data in telepresence technology | |
| CN102843542B (en) | The media consulation method of multithread meeting, equipment and system | |
| EP2214410B1 (en) | Method and system for conducting continuous presence conferences | |
| CN100531382C (en) | Device and method for transmitting visual telephone video-audio signal | |
| CN101198008A (en) | Method and system for implementing multi-screen and multi-picture | |
| CN101437140B (en) | Multi-picture transmission method and multi-point control unit | |
| CN101895718B (en) | Video conference system multi-image broadcast method, and device and system thereof | |
| CN103039072A (en) | Systems and methods for scalable video communication using multiple cameras and multiple monitors | |
| CN100562094C (en) | Camera with multiple frames at far end remote control thereof in a kind of TV conference system | |
| EP2936803B1 (en) | Method and a device for optimizing large scaled video conferences | |
| CN102387338B (en) | Distributed type video processing method and video session system | |
| CN104980683A (en) | Implement method and device for video telephone conference | |
| CN102883131A (en) | Signaling interaction method and device based on tele-presence system | |
| CN102892032A (en) | Real-time interactive high definition network video communication system | |
| CN103856809A (en) | Method, system and terminal equipment for multipoint at the same screen | |
| CN104283857A (en) | Method, device and system for creating multimedia conference | |
| CN104883344A (en) | Method and device of negotiating media capabilities | |
| CN113542660A (en) | Method, system and storage medium for realizing conference multi-picture high-definition display | |
| CN114546308A (en) | Application interface screen projection method, device, equipment and storage medium | |
| CN101345844A (en) | Multimedia code stream transmission method and multi-point control cell | |
| CN103957391A (en) | Method and system for displaying videos of all parties at same time during multi-party call in video intercom | |
| CN105306872A (en) | Method, apparatus and system for controlling multipoint video conference | |
| CN101083752A (en) | Method for displaying meeting place name of video conference and video terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518000 D401 room, Hua Han Innovation Park, long mountain road, Nanshan District, Guangdong, Shenzhen Patentee after: IFREECOMM TECHNOLOGY CO., LTD. Address before: 518000 D401 room, Hua Han Innovation Park, long mountain road, Nanshan District, Guangdong, Shenzhen Patentee before: Shenzhen City Freecomm Technology Co., Ltd. |