CN101489090A - Method, apparatus and system for multipath media stream transmission and reception - Google Patents
Method, apparatus and system for multipath media stream transmission and reception Download PDFInfo
- Publication number
- CN101489090A CN101489090A CNA2009100082994A CN200910008299A CN101489090A CN 101489090 A CN101489090 A CN 101489090A CN A2009100082994 A CNA2009100082994 A CN A2009100082994A CN 200910008299 A CN200910008299 A CN 200910008299A CN 101489090 A CN101489090 A CN 101489090A
- Authority
- CN
- China
- Prior art keywords
- media data
- data flow
- grouping
- path
- groups
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 54
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000004891 communication Methods 0.000 claims abstract description 46
- 238000003384 imaging method Methods 0.000 claims description 9
- 230000000875 corresponding effect Effects 0.000 description 54
- 238000010586 diagram Methods 0.000 description 13
- 239000002131 composite material Substances 0.000 description 3
- 241001269238 Data Species 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
Abstract
The invention discloses a method for transmitting and receiving a multiplex media data stream, a device and a system, and relates to a network technique capable of solving the problem of unable freely combination and output of the multiplex media stream. The transmission method of the multiplex media data stream in a multimedia communication comprises: grouping the untransmitted multiplex media data stream; performing a grouping description to the grouped multiplex media data stream; transmitting the grouped multiplex media data stream and the corresponding grouping description. A receiving treatment method of the multiplex media data stream in the multimedia communication comprises: receiving the multiplex media data stream with the grouping description and the grouping description corresponding to the media data stream; and grouping and outputting the media data stream according to the received multiplex media data stream. The examples of the invention can suit for the multiplex media stream transmission and output in the multimedia communication.
Description
Technical field
The present invention relates to network technology, relate in particular to method, the Apparatus and system of multi-path media flow transmission and reception in a kind of multimedia communication.
Background technology
In order further to strengthen the clinical sense of meeting, in video conferencing, usually need to transmit simultaneously a plurality of (or the many groups) participant's in a meeting-place video, audio frequency and data.Based on ITU-T standard definition H.239 the transmission of multipath media stream in the video conferencing, terminal and terminal and terminal and MCU (MultipointControl Unit, multipoint control unit) can transmit multipath media stream between, this standard has only defined how to transmit one tunnel auxiliary video stream at present, H.239 only defined simultaneously the role of every road Media Stream, this role can be live image or lantern slide content, but can not show the relation between the multipath media stream, therefore after receiving terminal gets access to the multi-path media data, need be undertaken exporting again after the operational processes by receiving terminal.
Be illustrated in figure 1 as the method schematic diagram of many a kind of roads media flow transmission in the video conferencing of prior art.Meeting-place A and meeting-place B place two cover video conference terminals respectively, and every locking terminal uses for 1 (or 1 group) participant.Wherein, each locking terminal comprises equipment such as camera, microphone, display device and loud speaker respectively.In addition, connect network by switch between two meeting-place A, B.The terminal 1 of meeting-place A connects with the terminal 3 of meeting-place B, the terminal 2 of meeting-place A connects with the terminal 4 of meeting-place B, the terminal 1 of meeting-place A will present the acoustic image and the data of terminal 3 collections of meeting-place B like this, and the terminal 2 of meeting-place A will present the acoustic image and the data of terminal 4 collections of meeting-place B.Conversely, the terminal 3 of meeting-place B will present the acoustic image and the data of terminal 1 collection of meeting-place A, and the terminal 4 of meeting-place B will present the acoustic image and the data of terminal 2 collections of meeting-place A.By such technical scheme, realized the transmission of two meeting-place two-way video-voice frequency flows.
Also has the another kind of method that produces corresponding audio position for the video layout in the prior art, comprise: by MCU produce synthetic a plurality of end points images many picture videos and with the corresponding sound position information of many picture layout, and a plurality of audio streams, many picture videos and sound position information are sent to receiving terminal according to the loud speaker situation of receiving terminal, receiving terminal uses a plurality of audio streams to reappear according to positional information, makes that the position (layout) of end points is approaching in the position of the end points sound that the participant hears and the many pictures.For the participant, to compare with audio broadcasting at the loud speaker place of display screen proximal end, the audio broadcasting at the loud speaker place of screen far-end may be attenuated, and is perhaps delayed time.This scheme can strengthen the clinical sense of meeting.But sound position is determined by MCU in this scheme, is carried out by terminal, lacks flexibility, and terminal can not be done autonomous the adjustment to the position of sound.Prior art can't realize multipath media stream independent assortment output in the multimedia communication, and does not consider the transmission and the processing of data service.
Summary of the invention
Embodiments of the invention provide the methods, devices and systems of multi-path media flow transmission and output in a kind of multimedia communication, can solve the problem that multipath media stream in the multimedia communication can not independent assortment output.
Embodiments of the invention adopt following technical scheme:
The transmission method of multi-path media data flow in a kind of multimedia communication comprises:
The multi-path media data flow that will transmit is divided into groups; Multi-path media data flow after the described grouping is divided into groups to describe; Transmit multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow.
Embodiments of the invention also provide the receiving handling method of multi-path media data flow in a kind of multimedia communication, comprising: receive the multi-path media data flow that has the grouping description; Grouping according to the multi-path media data flow of described reception is described, the described media data flow of grouping output.
Embodiments of the invention also provide the transmitting device of multi-path media data flow in a kind of multimedia communication, comprising: grouped element is used for the multi-path media data flow that will transmit is divided into groups; The grouping description unit divides into groups to describe to the multi-path media data flow after the described grouping; Data transmission unit transmits multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow.
Embodiments of the invention also provide the receiving and processing device of multi-path media data flow in a kind of multimedia communication, comprising: receiving element is used to receive the multi-path media data flow that has the grouping description and reaches the grouping description corresponding with described media data flow; Output unit is used for the grouping description according to the multi-path media data flow of described reception, the described media data flow of grouping output.
Embodiments of the invention also provide a kind of conference terminal, comprising:
Dispensing device is used to obtain the multi-path media data flow that will transmit and divides into groups, and the multi-path media data flow after the described grouping is divided into groups to describe, and transmit multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow; And/or
Receiving and processing device is used to receive and has multi-path media data flow that grouping describes and the grouping corresponding with described media data flow described, and describes according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping.
Embodiments of the invention also provide the system of multi-path media data flow transmission in a kind of multimedia communication, comprising:
Data acquisition facility comprises that video capture device, audio frequency obtain equipment or data acquisition facility, are used to obtain the multi-path media data flow;
Transmitting device, the multi-path media data flow that is used for described data acquisition facility is obtained is divided into groups, multi-path media data flow after the described grouping is divided into groups to describe, and the multi-path media data flow of transmitting after the described grouping reaches the grouping description corresponding with described media data flow;
Receiving and processing device is used to receive and has multi-path media data flow that grouping describes and the grouping corresponding with described media data flow described, and describes according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping;
Data output device is used for the media data flow after the described grouping is exported by picture output device, audio output apparatus or data output apparatus.
The method of multi-path media flow transmission and reception, Apparatus and system in the multimedia communication that the embodiment of the invention provides, the multi-path media data can be divided into groups, and each grouping is divided into groups to describe, and will divide into groups back multimedia data stream and grouping are described and are sent; And carry after multimedia data stream that grouping describes and the grouping corresponding with described multimedia data stream describe receiving, describe according to these groupings, the described media data flow of grouping output, thereby realized the independent assortment output of multipath media stream.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, to do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the method schematic diagram of multi-path media flow transmission in the prior art video conferencing;
Fig. 2 is the method flow diagram of multi-path media data flow transmission in the embodiment of the invention multimedia communication;
Fig. 3 is the method flow diagram of multi-path media data flow output in the embodiment of the invention multimedia communication;
Fig. 4 is the method schematic diagram of multi-path media data flow transmission and output in the embodiment of the invention one multimedia communication;
Fig. 5 is the method flow diagram of the embodiment of the invention one;
The schematic diagram that Fig. 6 divides into groups at input for the embodiment of the invention one multipath media stream;
The schematic diagram that Fig. 7 divides into groups at output for the embodiment of the invention one multipath media stream;
Fig. 8 is the method schematic diagram of multi-path media data flow transmission and output in the embodiment of the invention two multimedia communications;
Fig. 9 is the method flow diagram of multi-path media data flow transmission and output in the embodiment of the invention three multimedia communications;
Figure 10 is the device schematic diagram of multi-path media data flow transmission in the embodiment of the invention multimedia communication;
Figure 11 is that the multi-path media data flow receives the device schematic diagram of handling in the embodiment of the invention multimedia communication;
Figure 12 is the system schematic of multi-path media data flow transmission in the embodiment of the invention multimedia communication.
Embodiment
Be described in detail below in conjunction with the methods, devices and systems of accompanying drawing multi-path media flow transmission and reception in the embodiment of the invention multimedia communication.
Should be clear and definite, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that is obtained under the creative work prerequisite.
As shown in Figure 2, the method for multi-path media flow transmission in the embodiments of the invention multimedia communication comprises:
S201, the multi-path media data flow that will transmit is divided into groups.
Wherein, divide into groups to adopt following any mode to the multi-path media data flow:
Divide into groups according to the relation of the position between the interface of media data flow, the media data flow that is about to the close physical interface in same physical interface or position is divided into one group; Or divide into groups by the locus of audio frequency and/or video, promptly obtain the locus of image by video camera, microphone obtains the locus of sound, and video that the locus of image and/or sound position is consistent or close and/or audio frequency are as one group; Or utilize array microphone to pick up out the multichannel sound source position, form corresponding independent audio stream after, described multichannel voice frequency stream is divided into groups; Or after getting access to panoramic picture by the wide-angle imaging machine, described panoramic picture is cut into the image that multichannel separates after, described multi-path video stream is divided into groups.
S202, the multi-path media data flow after the described grouping is divided into groups to describe.
Particularly, can by media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or in the control protocol relevant, carry grouping and describe with media data flow; Or in media data flow, increase and carry and divide into groups the accordingly control messages described of media data, thereby realize the multi-path media data flow after the grouping is divided into groups to describe.
Multi-path media data flow after S203, the described grouping of transmission and the grouping corresponding with described media data flow are described.
The method of the multi-path media flow transmission that the embodiment of the invention provides is by dividing into groups the multi-path media data flow, and add the grouping description for the media data flow after the grouping, can specify the group feature for the media data flow of transmission, receiving terminal can be described according to this grouping and export processing accordingly, thereby has realized the independent assortment transmission of multipath media stream at different terminals.
As shown in Figure 3, multipath media stream receives the method for handling in the embodiments of the invention multimedia communication, comprising:
S301, reception have the multi-path media data flow of grouping description and the grouping corresponding with described media data flow described.
Particularly, grouping describe can be carried at media data flow or with the corresponding bearer path of media data flow in; Or be carried in the control protocol relevant with media data flow; Or be carried in the control messages that increases in the media data flow.
S302, grouping described media data flow of output and the grouping description corresponding with described media data flow are described according to the grouping of the multi-path media data flow of described reception.
The method that the multipath media stream reception is handled in the embodiments of the invention multimedia communication has the multi-path media data flow of grouping description by reception and the grouping corresponding with described media data flow described, describe the described media data of grouping output according to described grouping again, thereby realized that multipath media stream can be in the independent assortment output of different terminals.
Below by the transmission of multipath media stream in the multimedia communication under the different scenes and the practical application of output the specific embodiment of the present invention is described.
Embodiment one
As shown in Figure 4, be the schematic diagram of present embodiment multi-path media flow transmission with the output scene.It is example that present embodiment receives multipath media stream with meeting-place A transmission multipath media stream, meeting-place B.Mandatory declaration be that in actual applications, meeting-place A and meeting-place B generally comprise transmitting and receiving device simultaneously, also comprise transmitting and receiving device on terminal simultaneously.The present invention for convenience of description, embodiments of the invention are simplified.
In the present embodiment, meeting-place A comprises participant P1 and P2, terminal 1, P1 and P2 have corresponding with it microphone 1, shooting 1 and data processing equipment 1 (such as a computer) respectively, meeting-place B comprises terminal 2, and a plurality of participant P3 lay respectively at the display 1 and the loud speaker 1 of position 1, with the display 3 and the loud speaker 3 of position 3, be positioned at the display 2 of position 2.Terminal 1 and terminal 2 are connected by network.As shown in Figure 5, the basic processing process is as follows:
S501, terminal 1 collect 6 road media datas and divide into groups.These 6 group media data comprise: data service medium 1, data service medium 2, video media 1, video media 2, audio frequency media 1, audio frequency media 2.
Can divide into groups according to the relation of the position between the interface of media data flow, the media data flow that is about to the close physical interface in same physical interface or position is divided into one group.As shown in Figure 6, this 6 road Media Stream is divided into two groups of L1 and L2, wherein the media data of L1 group is corresponding with participant P1, comprising: data service medium 1, video media 1, audio frequency media 1; The Media Stream of L2 group is corresponding with participant P2, comprising: data service medium 2, video media 2, audio frequency media 2.
Above-mentioned is terminal 1 is determined grouping according to interface relationship method, the data that the video input of corresponding participant P1, audio frequency input, data service input interface are received are organized as L1, and the data that the video input of corresponding participant P2, audio frequency input, data service input interface are received are organized as L2.Video interface can be CVBS (Composite Video Broadcast Signal or Composite Video Blanking and Sync, the composite video broadcast singal) interface, S-Video (Separate Video, separating video) interface, VGA (VideoGraphics Array, video graphics array) interface, DVI (Digital Visual Interface, digital video) interface etc.Audio interface can be various forms MIC (Medium Interface Connector, media interface connector), Line IN (input signal) analog or digital interface.The data service interface can be network interface, USB, also can be VGA interface (data content has been converted to video output on PC), and data business content comprises file or lantern slide broadcast.These interfaces physically also may merge, for example video interface and audio interface can be merged into HDMI (High Definition Multimedia Interface, high-resolution multimedia) interface or IEEE1394 interface, even video, audio frequency, data service can all connect by USB interface, and video, audio frequency, data service can also be transmitted by logical channel in this case.
The present invention is not limited thereto, and each grouping also may exist many group videos, audio frequency, data traffic flow, and the L1 that for example divides into groups also can have the two-way audio input, the two-path video input.
The method of determining the grouping relation can also be, divide into groups in locus by audio frequency and/or video, promptly obtain the locus of image by video camera, microphone obtains the locus of sound, and video that the locus of image and/or sound position is consistent or close and/or audio frequency are as one group.
The method of determining the grouping relation can also be, utilizes array microphone to pick up out the multichannel sound source position, form corresponding independent audio stream after, described multichannel voice frequency stream is divided into groups; Or after getting access to panoramic picture by the wide-angle imaging machine, described panoramic picture is cut into the image that multichannel separates after, described multi-path video stream is divided into groups.Again corresponding video media and audio frequency media are categorized into one group afterwards, for example video media and audio frequency media can be divided into groups according to the position relation.The Media Stream that promptly divides into groups can constitute by other means, and not necessarily directly obtain from interface.
S502, terminal 1 will be carried out compressed encoding through the media data flow after the grouping.
S503, the multi-path media data flow after the described grouping is divided into groups to describe.
The multi-path media data flow divided into groups to describe following three kinds of modes:
Mode one media data flow or with the corresponding bearer path of media data flow in carry grouping and describe.
For example, can carry grouping in the extended head of RTP or the media data flow describes.Particularly, can in the extended head of RTP or extended field in the media data flow or specific fields, fill the group feature.
For example, fill the grouping description field, have the rtp streaming that same packets is described, be same group at the extended head (RTP Header Extension) of RTP.Perhaps, can also in corresponding bearer path, identification packet describe, for example, in the data (payload) of RTP, carry out field extension, increase grouping and describe.
Extended head that in addition can also self-defined RTP, and in self-defining extended head, carry grouping and describe.
Also can realize carrying of grouping description in the SIP/SDP communication by in RTP, identifying.
Mode two is carried the grouping descriptor in the control protocol relevant with Media Stream.Particularly, can fill the group feature in the extended field in control protocol.
With standard H.323 is example, each Media Stream all can distribute corresponding session id (sessionID), so just can be by being the session that each session id designated packet describes association to be correlated with, such as in opening logical channel (OpenLogicalChannel) message, expand a grouping description field, be used for filling grouping and describe, as following definition:
OpenLogicalChannel::＝SEQUENCE
{
forwardLogicalChannelNumber?LogicalChannelNumber，
forwardLogicalChannelParametersSEQUENCE
{
portNumber?INTEGER(0..65535)OPTIONAL，
dataType?DataType，
multiplexParameters?CHOICE
{
h222LogicalChannelParameters H222LogicalChannelParameters，
h223LogicalChannelParameters H223LogicalChannelParameters，
v76LogicalChannelParameters V76LogicalChannelParameters，
...，
h2250LogicalChannelParameters?H2250LogicalChannelParameters，
none?NULL --for?use?with?Separate?Stack?when
--multiplexParameters?are?not?required
--or?appropriate
}，
...，
forwardLogicalChannelDependency?LogicalChannelNumber?OPTIONAL，
--also?used?to?refer?to?the?primary?logical?channel?when?using?video?redundancy
coding
replacementFor?LogicalChannelNumber?OPTIONAL，
group?IDINTEGER(0..65535)OPTIONAL
}，
--Used?to?specify?the?reverse?channel?for?bi-directional?open?request
reverseLogicalChannelParameters?SEQUENCE
{
dataType DataType，
multiplex?Parameters?CHOICE
{
--H.222?parameters?are?never?present?in?reverse?direction
h223LogicalChannelParameters H223LogicalChannelParameters，
v76LogicalChannelParameters V76LogicalChannelParameters，
...，
h2250LogicalChannelParametersH2250LogicalChannelParameters
}OPTIONAL，--Not?present?for?H.222
...，
reverseLogicalChannelDependency?LogicalChannelNumber?OPTIONAL，
--also?used?to?refer?to?the?primary?logical?channel?when?using?video?redundancy
coding
replacementFor?LogicalChannelNumber?OPTIONAL
}OPTIONAL，--Not?present?for?uni-directional?channel?request
...，
separateStack?NetworkAccessParameters?OPTIONAL，
--for?Open?responder?to?establish?the?stack
encryptionSync?EncryptionSync?OPTIONAL--used?only?by?Master
}
Wherein groupID is the grouping description field of expansion, is used for filling grouping and describes.
Mode three increases in media data flow carries the control messages that corresponding packets of media data is described.Particularly, in each described control messages, define the group feature, in the message body of described control messages, comprised at least one Media Stream that belongs to same grouping.
For example, increase a control messages, it is same grouping that this message is used to notify which media data of opposite end.Suppose grouping L1 video, audio frequency, the session logical channel number (LCN) of data service data be respectively 1,2,3, then transmit a message GroupIndication, comprise logical channel number (LCN) 1,2 in this message, 3, receiving terminal is same group according to the media data of this message decision logic channel number 1,2,3 like this.
When adopting the SIP/SDP agreement to carry out multimedia communication, that also can realize by the mode of a plurality of sessions of employing (session) dividing into groups to describe carries.For example:
v＝0
o＝mhandley?2890844526?2890842807?IN?IP4?126.16.64.4
s＝P1
...
m＝audio?49170?RTP/AVP?0
m＝video?51372?RTP/AVP?31
m＝application?32416?udp?wb
v＝0
o＝mhandley?2890844526?2890842807?IN?IP4?126.16.64.4
s＝P2
...
m＝audio?49171?RTP/AVP?0
m＝video?51373?RTP/AVP?31
m＝application?32417?udp?wb
Wherein, session P1 (S=P1) is corresponding to grouping L1, and session P2 (S=P1) comprises audio frequency, video and application data stream respectively corresponding to grouping L2.
Can certainly grouping be described by increasing an attribute, for example:
v＝0
m＝audio?49170?RTP/AVP?0
m＝video?51372?RTP/AVP?31
m＝application?32416?udp?wb
m＝audio?49171?RTP/AVP?0
m＝video?51373?RTP/AVP?31
m＝application?32417?udp?wb
...
g＝49170?51372?32416
g＝49171?51373?32417
With port 49170,51372,32416 corresponding media datas are divided into one group, by g=49171 51,373 32417 the corresponding media data of 49171,51373,32417 ports are divided into other one group by g=49170 51,372 32416 these explanations.
In addition, also can describe, increase and divide group profile to realize grouping by direct extended medium, for example:
v＝0
m＝audio?49170?RTP/AVP?0?group1
m＝video?51372?RTP/AVP?31?group1
m＝application?32416?udp?wb?group1
m＝audio?49171?RTP/AVP?0?group2
m＝video?51373?RTP/AVP?31?group2
m＝application?32417?udp?wb?group2
...
Like this, the group1 in the media description, group2 are used to illustrate the group number of this Media Stream correspondence, and the Media Stream of identical group number is same group.Group1 and group2 can be numeral or character mark.
S504, terminal 1 send to terminal 2 with the multi-path media data.
S505, terminal 2 receive and have the media data that grouping is described, the decompression of decoding.
S506, the output medium data are described according to grouping.
As Fig. 4, shown in Figure 7, be specially: according to the grouping relation, determine to divide into groups the video data 1 of L1 correspondence and display 1 and the loud speaker 1 that voice data 1 outputs to position 1, with the video data 2 of grouping L2 and display 3 and the loud speaker 3 that voice data 2 outputs to position 3, with grouping L1 and the data service medium 1 of L2 and the display 2 that data service medium 2 output to position 2 as required.
Embodiments of the invention can also realize that the data service data output interface switches output to the data service of a plurality of transmitting terminals of getting access to, promptly can switch as required.For example, when the participant P1 of transmitting terminal explanation lantern slide, then the data service output interface is switched to the data service output of L1, when P2 explanation lantern slide, switch to the data service output of L2.The video here, audio frequency, data service output interface also can be various forms and the combinations the same with above-mentioned input interface.
Embodiments of the invention can also realize that describing video data, voice data or data service data that output interface is exported according to the grouping of the media data flow of described reception switches.For example, terminal 2 can also further be described according to grouping, automatically control is when participant P1 explanation lantern slide, the output content that video output 1 and video are exported 2 interfaces all switches to the video of grouping L1, audio frequency output 1 and audio frequency output 2 are all switched to the audio frequency of exporting grouping L1, can on loud speaker separately, hear the sound of P1 so that the participant of meeting-place B can see the image of P1 simultaneously on display separately like this.Further, receiving terminal can be notified the transmission of looking audio frequency of looking audio collection or time-out L2 group that transmitting terminal suspends generation L2 group simultaneously, to reduce taking bandwidth.
The network of connecting terminal 1 and terminal 2 can be circuit-domain network (as E1/SDH/ISDN), also can be packet network (as IP network), and H.320/H.323/H.324/SIP communication protocol can adopt and wait.
In the foregoing description, video media 1, audio frequency media 1 and data service medium 1 are divided into 1 group, and this is a kind of common applicable cases, but actual grouping can be very flexible, for example with video media 2 as 1 group, with audio frequency media 2 and video media 1 as 1 group.
By above-mentioned steps, the embodiment of the invention has realized by dividing into groups the multi-path media data being transmitted and being exported, thereby receiving terminal can carry out multipath media stream independent assortment output, has also solved the transmission and the control of the data service corresponding with looking audio frequency.The embodiment of the invention has also realized using single terminal in a meeting-place, has therefore also solved the too high problem of cost that prior art uses a plurality of terminals to bring.
Embodiment two
On the basis of embodiment one, the method for present embodiment multi-path media data flow transmission and output can also be passed through intermediate equipment (for example: conference control equipment is specifically as follows multipoint control unit MCU) and handle.
MCU obtains each road packets of media data description after receiving the media data flow and corresponding grouping description that carries the description of dividing into groups, and can redefine the grouping relation of each road media data flow according to the output needs.In the present embodiment, thereby can concern, or regenerate the grouping relation of multi-path media data flow by the grouping between the grouping relation change media data flow of multipoint control unit MCU forwarding media data flow.
As shown in Figure 8, video media stream and audio medium stream that terminal 1 sends, and the data service Media Stream that terminal 3 sends sends to terminal 2 after the MCU place is combined as a new group L.Concrete compound mode is not limited to the foregoing description.
Be understood that in video conference, conference control equipment is mainly finished main Media Stream control, therefore, adopt this mode can be comparatively neatly according to the request of some conference terminals, corresponding Media Stream (audio medium stream, video media stream and data medium stream) is combined, can diversifiedly satisfy user's demand.
The embodiment of the invention has realized by dividing into groups multipath media stream being transmitted and exporting, thereby receiving terminal can carry out multipath media stream independent assortment output, the transmission and the control that have also solved the data service Media Stream corresponding with looking audio frequency.
Implement three
Present embodiment is on the basis of implementing transmission multi-path media data flow in, and the method for terminal 2 output multipath media streams specifically comprises the steps:
S901, in the B of meeting-place, arrange a plurality of loud speakers;
S902, terminal 2 are obtained the spatial positional information of each display among the B of meeting-place;
Video data 1 is by display 1 output of position 1 among S903, the grouping L1 that will receive, and the video data 2 among the grouping L2 is by display 3 outputs of position 3.
The voice data 1 of S904, the grouping L1 that will receive is exported by at least one loud speaker among the B of meeting-place, makes that its locus sense is identical or close with the display 1 of position 1.
The voice data 2 of S905, the grouping L2 that will receive is exported by at least one loud speaker among the B of meeting-place, makes that its locus sense is identical or close with the display 3 of position 3.
Above-mentioned steps S904 and S905 are not limited to said sequence, and step S905 can be before step S904.
Present embodiment can realize in many meeting-place that the sound that the participant hears is identical or close with corresponding video location, thereby has realized the sense of reality of video conferencing better.
Embodiments of the invention also provide a kind of device of multi-path media flow transmission, can solve the problem that multipath media stream can only transmit between specific terminal.
As shown in figure 10, the device of multi-path media data flow transmission in the embodiments of the invention multimedia communication comprises:
Grouped element 101 is used for the multi-path media data flow that will transmit is divided into groups;
Further, can divide into groups to media data flow by following any mode at grouped element described in a preferred embodiment of the present invention 101: divide into groups according to the relation of the position between the interface of media data flow, the media data flow that is about to the close physical interface in same physical interface or position is divided into one group; Or divide into groups by the locus of audio frequency and/or video, promptly obtain the locus of image by video camera, microphone obtains the locus of sound, and video that the locus of image and/or sound position is consistent or close and/or audio frequency are as one group; Or utilize array microphone to pick up out the multichannel sound source position, form corresponding independent audio stream after, described multichannel voice frequency stream is divided into groups; Or after getting access to panoramic picture by the wide-angle imaging machine, described panoramic picture is cut into the image that multichannel separates after, described multi-path video stream is divided into groups.
Media data flow after described grouping description unit 102 can adopt following any mode to grouping divides into groups to describe: media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or in the control protocol relevant, carry grouping and describe with media data flow; Or in media data flow, increase and carry and divide into groups the accordingly control messages described of media data.
Media data flow is specifically as follows following one or more described in the present embodiment: audio stream, video flowing, data flow.
The device of multi-path media data flow transmission in the embodiments of the invention multimedia communication, by grouped element the multi-path media data are divided into groups, the grouping description unit divides into groups to describe to multimedia data stream, thereby realized that multipath media stream transmits by a terminal, and make receiving terminal to export each media data according to grouping description respective packets, realized of the independent assortment transmission of multi-path media data at different terminals.
The present invention also provides multi-path media data flow in a kind of multimedia communication to receive the device of handling, and can solve the problem that multipath media stream can not independent assortment output.
As shown in figure 11, the multi-path media data flow receives the device of handling in the embodiments of the invention multimedia communication, comprises receiving element 111 and output unit 112.
Receiving element 111 is used to receive the multi-path media data flow that has the grouping description and reaches the grouping description corresponding with described media data flow.Wherein, grouping describe can be carried at media data flow or with the corresponding bearer path of media data flow in; Or be carried in the control protocol relevant with media data flow; Or be carried in the control messages that increases in the media data flow.
Further, described device can also comprise: switch unit is used for the media data flow that the grouping of the media data flow that receives according to described receiving element describes described output unit output and switches.Described device can also comprise the time-out unit, is used for when all output ports all switch to the media data flow of designated groups, suspends the collection or the transmission of the media data flow of other group except that designated groups.
The device that the multi-path media data flow receive to be handled in the embodiments of the invention multimedia communication is receiving when having multi-path media data flow that grouping describes and the grouping corresponding with described media data flow and describing, can describe according to grouping, the described media data flow of grouping output, thus realized that multipath media stream can freely export at different terminals.In addition, switch unit can also switch the transmission of media data of specific cluster, suspends collection or transmission that the unit can suspend the media data of some group, has slowed down network pressure.
The device of multi-path media flow transmission in the multimedia communication that embodiments of the invention provide, and receive the device of handling, can realize the independent assortment output of multipath media stream in the multimedia communication with reference to said method embodiment one, two, three.
Embodiments of the invention also provide a kind of conference terminal, comprise dispensing device and receiving and processing device.
Described dispensing device, be used to obtain the multi-path media data flow that to transmit and divide into groups, multi-path media data flow after the described grouping is divided into groups to describe, and the multi-path media data flow of transmitting after the described grouping reaches the grouping description corresponding with described media data flow; And/or
Described receiving and processing device is used to receive and has multi-path media data flow that grouping describes and the grouping corresponding with described media data flow described, and describes according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping.
For a conference terminal, preferably have dispensing device and receiving and processing device simultaneously.
On the basis of such scheme, described dispensing device further comprises:
Grouped element, be used for the multi-path media data flow that will transmit is divided into groups, comprise according to the relation of the position between the interface of media data flow and dividing into groups, or divide into groups by the locus of audio frequency and/or video, or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described multichannel voice frequency stream is divided into groups; Or after getting access to panoramic picture by the wide-angle imaging machine, described panoramic picture is cut into the image that multichannel separates after, described multi-path video stream is divided into groups;
The grouping description unit divides into groups to describe to the multi-path media data flow after the described grouping; Be included in media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or in the control protocol relevant, carry grouping and describe with media data flow; Or in media data flow, increase and carry and divide into groups the accordingly control messages described of media data;
Data transmission unit transmits multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow.
The embodiments of the invention conference terminal, can realize the grouping of multimedia data stream and carrying of grouping description to sending, thereby the multi-path media data flow can be divided into groups to send, and after the grouping of multimedia data stream that receives the grouping transmission and correspondence is described, can describe according to this grouping each media data flow is exported, thereby realize multi-path media data independent assortment is exported.
Embodiments of the invention also provide multipath media stream system for transmitting in a kind of multimedia communication, can solve multipath media stream can not independent assortment the problem of output.
Present embodiment can combine with the embodiment of Fig. 4 and describe.As shown in figure 12, multipath media stream system for transmitting in the embodiments of the invention multimedia communication comprises: data acquisition facility 121, transmitting device 122, receiving and processing device 123 and data output device 124.Wherein,
Described data acquisition facility 121 comprises that video capture device, audio frequency obtain equipment or data acquisition facility, are used to obtain the multi-path media data flow.
Described transmitting device 122, the multi-path media data flow that is used for described data acquisition facility is obtained is divided into groups, multi-path media data flow after the described grouping is divided into groups to describe, and the multi-path media data flow of transmitting after the described grouping reaches the grouping description corresponding with described media data flow.
Described receiving and processing device 123 is used to receive and has multi-path media data flow that grouping describes and the grouping corresponding with described media data flow described, and describes according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping.
Described data output device 124 is used for the media data flow after the described grouping is exported by picture output device, audio output apparatus or data output apparatus.
On the basis of such scheme, described transmitting device further can comprise:
Grouped element, be used for the multi-path media data flow that will transmit is divided into groups, comprise according to the relation of the position between the interface of media data flow and dividing into groups, or divide into groups by the locus of audio frequency and/or video, or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described multichannel voice frequency stream is divided into groups; Or after getting access to panoramic picture by the wide-angle imaging machine, described panoramic picture is cut into the image that multichannel separates after, described multi-path video stream is divided into groups;
The grouping description unit divides into groups to describe to the multi-path media data flow after the described grouping; Be included in media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or in the control protocol relevant, carry grouping and describe with media data flow; Or in media data flow, increase and carry and divide into groups the accordingly control messages described of media data;
Data transmission unit transmits multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow.
In a preferred embodiment of the present invention, described system can also comprise:
Conference control equipment is used for concerning by transmitting media data stream packets relation change grouping, or the multi-path media data flow in different meeting-place is divided into groups.Described conference control equipment can be MCU.
Multipath media stream system for transmitting in the multimedia communication that the embodiment of the invention provides, by transmitting device the multi-path media data are divided into groups, multi-path media data flow after the described grouping is divided into groups to describe, and send and describedly have media data that grouping describes and corresponding grouping is described, and output device receives after multi-path media data and grouping describe, describe the described media data of grouping output according to described grouping, thereby can realize the independent assortment output of multipath media stream; Preferred L CU can also change or transmit by transmitting media data stream packets relation and then change grouping relation packets of media data relation in the described system, thereby can realize the independent assortment output of multipath media stream.
Multipath media stream system for transmitting in the multimedia communication that embodiments of the invention provide can realize that multi-path media flow transmission, reception and output are handled in the multimedia communication with reference to said method embodiment one, two, three.
One of ordinary skill in the art will appreciate that all or part of flow process that realizes in the foregoing description method, be to instruct relevant hardware to finish by computer program, described program can be stored in the computer read/write memory medium, this program can comprise the flow process as the embodiment of above-mentioned each side method when carrying out.Wherein, described storage medium can be magnetic disc, CD, read-only storage memory body (Read-Only Memory, ROM) or at random store memory body (Random Access Memory, RAM) etc.
The above; only be the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, anyly is familiar with those skilled in the art in the technical scope that the present invention discloses; the variation that can expect easily or replacement all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion by described protection range with claim.
Claims (21)
1, the method for multi-path media data flow transmission in a kind of multimedia communication is characterized in that, comprising:
The multi-path media data flow that will transmit is divided into groups;
Multi-path media data flow after the described grouping is divided into groups to describe;
Transmit multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow.
2, the method for claim 1 is characterized in that, described the multi-path media data flow is divided into groups to be specially:
Divide into groups according to the relation of the position between the interface of media data flow, the media data flow that is about to the close physical interface in same physical interface or position is divided into one group; Or
Divide into groups in locus by audio frequency and/or video, promptly obtain the locus of image by video camera, microphone obtains the locus of sound, and video that the locus of image and/or sound position is consistent or close and/or audio frequency are as one group; Or
Utilize array microphone to pick up out the multichannel sound source position, form corresponding independent audio stream after, described multichannel voice frequency stream is divided into groups; Or
After getting access to panoramic picture by the wide-angle imaging machine, described panoramic picture is cut into the image that multichannel separates after, described multi-path video stream is divided into groups.
3, method as claimed in claim 1 or 2 is characterized in that, the multi-path media data flow after the described grouping is divided into groups to describe, and comprising:
Media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or
Carrying grouping in the control protocol relevant with media data flow describes; Or
In media data flow, increase and carry and divide into groups the accordingly control messages described of media data.
4, method as claimed in claim 1 or 2 is characterized in that, described the multi-path media data flow that will transmit is divided into groups, and comprising:
Change the grouping relation by conference control equipment by the grouping relation of transmitting the multi-path media data flow; Or
By conference control equipment the multi-path media data flow in different meeting-place is divided into groups.
5, method as claimed in claim 1 or 2 is characterized in that, described media data flow is specially following one or more: audio stream, video flowing, data flow.
6, the multi-path media data flow receives the method for handling in a kind of multimedia communication, it is characterized in that, comprising:
Reception has the multi-path media data flow of grouping description and the grouping corresponding with described media data flow described;
Grouping according to the multi-path media data flow of described reception is described, the described media data flow of grouping output.
7, method as claimed in claim 6 is characterized in that, describes according to the grouping of the multi-path media data flow of described reception, and the described media data flow of grouping output comprises:
The video data of describing described reception according to the grouping of the media data flow of described reception outputs to corresponding video output interface; And/or
The voice data of described reception is outputed to corresponding voice data interface; And/or
The data service data of described reception are outputed to corresponding data service data output interface.
8, method as claimed in claim 7 is characterized in that, the data service data of described reception is outputed to corresponding data service data output interface comprise:
Described data service data output interface switches output to the data service data of a plurality of transmitting terminals of receiving.
9, method as claimed in claim 6 is characterized in that, describes according to the grouping of the multi-path media data flow of described reception, and the described media data flow of grouping output comprises:
Grouping according to the multi-path media data flow of described reception is described, video data is outputed on the corresponding display equipment, obtain the spatial positional information of described display device, voice data that will be relevant with described video data makes that with at least one the equipment output of raising one's voice the audio space position of output is identical with the locus of described display device or close.
10, method as claimed in claim 6 is characterized in that, also comprises:
Describe according to the grouping of the media data flow of described reception video data, voice data or the data service data of output interface output are switched.
11, the device of multi-path media data flow transmission in a kind of multimedia communication is characterized in that, comprising:
Grouped element is used for the multi-path media data flow that will transmit is divided into groups;
The grouping description unit divides into groups to describe to the multi-path media data flow after the described grouping;
Data transmission unit transmits multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow.
12, device according to claim 11 is characterized in that, described grouped element divides into groups to the multi-path media data flow that will transmit by following each:
Divide into groups according to the relation of the position between the interface of media data flow, the media data flow that is about to the close physical interface in same physical interface or position is divided into one group; Or
Divide into groups in locus by audio frequency and/or video, promptly obtain the locus of image by video camera, microphone obtains the locus of sound, and video that the locus of image and/or sound position is consistent or close and/or audio frequency are as one group; Or
Utilize array microphone to pick up out the multichannel sound source position, form corresponding independent audio stream after, described multichannel voice frequency stream is divided into groups; Or
After getting access to panoramic picture by the wide-angle imaging machine, described panoramic picture is cut into the image that multichannel separates after, described multi-path video stream is divided into groups.
13, device according to claim 11 is characterized in that, described grouping description unit divides into groups to describe by following each multi-path media data flow after to described grouping:
Media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or
Carrying grouping in the control protocol relevant with media data flow describes; Or
In media data flow, increase and carry and divide into groups the accordingly control messages described of media data.
14, according to each described device in the claim 11 to 13, it is characterized in that,
Described media data flow is specially following one or more: audio stream, video flowing, data flow.
15, the multi-path media data flow receives the device of handling in a kind of multimedia communication, it is characterized in that, comprising:
Receiving element is used to receive the multi-path media data flow that has the grouping description and reaches the grouping description corresponding with described media data flow;
Output unit is used for the grouping description according to the multi-path media data flow of described reception, the described media data flow of grouping output.
16, device according to claim 15 is characterized in that, also comprises:
Switch unit is used for the media data flow that the grouping of the media data flow that receives according to described receiving element describes described output unit output and switches.
17, a kind of conference terminal is characterized in that, comprising:
Dispensing device is used to obtain the multi-path media data flow that will transmit and divides into groups, and the multi-path media data flow after the described grouping is divided into groups to describe, and transmit multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow; And/or
Receiving and processing device is used to receive and has multi-path media data flow that grouping describes and the grouping corresponding with described media data flow described, and describes according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping.
18, conference terminal according to claim 17 is characterized in that, described dispensing device comprises:
Grouped element, be used for the multi-path media data flow that will transmit is divided into groups, comprise according to the relation of the position between the interface of media data flow and dividing into groups, or divide into groups by the locus of audio frequency and/or video, or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described multichannel voice frequency stream is divided into groups; Or after getting access to panoramic picture by the wide-angle imaging machine, described panoramic picture is cut into the image that multichannel separates after, described multi-path video stream is divided into groups;
The grouping description unit divides into groups to describe to the multi-path media data flow after the described grouping; Be included in media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or in the control protocol relevant, carry grouping and describe with media data flow; Or in media data flow, increase and carry and divide into groups the accordingly control messages described of media data;
Data transmission unit transmits multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow.
19, the system of multi-path media data flow transmission in a kind of multimedia communication is characterized in that, comprising:
Data acquisition facility comprises that video capture device, audio frequency obtain equipment or data acquisition facility, are used to obtain the multi-path media data flow;
Transmitting device, the multi-path media data flow that is used for described data acquisition facility is obtained is divided into groups, multi-path media data flow after the described grouping is divided into groups to describe, and the multi-path media data flow of transmitting after the described grouping reaches the grouping description corresponding with described media data flow;
Receiving and processing device is used to receive and has multi-path media data flow that grouping describes and the grouping corresponding with described media data flow described, and describes according to the grouping of the multi-path media data flow of described reception, and described media data flow is exported in grouping;
Data output device is used for the media data flow after the described grouping is exported by picture output device, audio output apparatus or data output apparatus.
20, system according to claim 19 is characterized in that, described transmitting device comprises:
Grouped element, be used for the multi-path media data flow that will transmit is divided into groups, comprise according to the relation of the position between the interface of media data flow and dividing into groups, or divide into groups by the locus of audio frequency and/or video, or utilize array microphone to pick up out the multichannel sound source position, after forming corresponding independent audio stream, described multichannel voice frequency stream is divided into groups; Or after getting access to panoramic picture by the wide-angle imaging machine, described panoramic picture is cut into the image that multichannel separates after, described multi-path video stream is divided into groups;
The grouping description unit divides into groups to describe to the multi-path media data flow after the described grouping; Be included in media data flow or with the corresponding bearer path of media data flow in carry grouping and describe; Or in the control protocol relevant, carry grouping and describe with media data flow; Or in media data flow, increase and carry and divide into groups the accordingly control messages described of media data;
Data transmission unit transmits multi-path media data flow after the described grouping and the grouping description corresponding with described media data flow.
21, according to claim 19 or 20 described systems, it is characterized in that, also comprise:
Conference control equipment is used for concerning by transmitting media data stream packets relation change grouping, or the multi-path media data flow in different meeting-place is divided into groups.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910008299.4A CN101489090B (en) | 2009-02-20 | 2009-02-20 | Method, apparatus and system for multipath media stream transmission and reception |
| PCT/CN2010/070180 WO2010094213A1 (en) | 2009-02-20 | 2010-01-14 | Method, apparatus and system for transmitting and receiving multiplex media data stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910008299.4A CN101489090B (en) | 2009-02-20 | 2009-02-20 | Method, apparatus and system for multipath media stream transmission and reception |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101489090A true CN101489090A (en) | 2009-07-22 |
| CN101489090B CN101489090B (en) | 2014-01-08 |
Family
ID=40891737
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910008299.4A Active CN101489090B (en) | 2009-02-20 | 2009-02-20 | Method, apparatus and system for multipath media stream transmission and reception |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN101489090B (en) |
| WO (1) | WO2010094213A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010094213A1 (en) * | 2009-02-20 | 2010-08-26 | 华为终端有限公司 | Method, apparatus and system for transmitting and receiving multiplex media data stream |
| WO2016150320A1 (en) * | 2015-03-25 | 2016-09-29 | 中兴通讯股份有限公司 | Method and device for sending audio |
| WO2019170037A1 (en) * | 2018-03-05 | 2019-09-12 | 集思谱（北京）科技有限公司 | Multimedia information distribution method and system combining individual units |
| CN110349584A (en) * | 2019-07-31 | 2019-10-18 | 北京声智科技有限公司 | A kind of audio data transmission method, device and speech recognition system |
| CN113542688A (en) * | 2021-07-14 | 2021-10-22 | 杭州海康威视数字技术股份有限公司 | Audio and video monitoring method, device, equipment, storage medium and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1128921A (en) * | 1995-02-09 | 1996-08-14 | 三菱电机株式会社 | Multi medium information treatment system |
| US5548346A (en) * | 1993-11-05 | 1996-08-20 | Hitachi, Ltd. | Apparatus for integrally controlling audio and video signals in real time and multi-site communication control method |
| CN1466385A (en) * | 2002-06-19 | 2004-01-07 | 华为技术有限公司 | Real time receiving and sxtorage method for video signal conference stream medium |
| CN1929593A (en) * | 2005-09-07 | 2007-03-14 | 宝利通公司 | Spatially correlated audio in multipoint videoconferencing |
| JP2007072739A (en) * | 2005-09-07 | 2007-03-22 | Hitachi Communication Technologies Ltd | Multipoint conference system, multipoint conference apparatus, and client terminal |
| CN101217658A (en) * | 2008-01-09 | 2008-07-09 | 杭州华三通信技术有限公司 | A media transmission method, system and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101489090B (en) * | 2009-02-20 | 2014-01-08 | 华为终端有限公司 | Method, apparatus and system for multipath media stream transmission and reception |
-
2009
- 2009-02-20 CN CN200910008299.4A patent/CN101489090B/en active Active
-
2010
- 2010-01-14 WO PCT/CN2010/070180 patent/WO2010094213A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5548346A (en) * | 1993-11-05 | 1996-08-20 | Hitachi, Ltd. | Apparatus for integrally controlling audio and video signals in real time and multi-site communication control method |
| CN1128921A (en) * | 1995-02-09 | 1996-08-14 | 三菱电机株式会社 | Multi medium information treatment system |
| CN1466385A (en) * | 2002-06-19 | 2004-01-07 | 华为技术有限公司 | Real time receiving and sxtorage method for video signal conference stream medium |
| CN1929593A (en) * | 2005-09-07 | 2007-03-14 | 宝利通公司 | Spatially correlated audio in multipoint videoconferencing |
| JP2007072739A (en) * | 2005-09-07 | 2007-03-22 | Hitachi Communication Technologies Ltd | Multipoint conference system, multipoint conference apparatus, and client terminal |
| CN101217658A (en) * | 2008-01-09 | 2008-07-09 | 杭州华三通信技术有限公司 | A media transmission method, system and device |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010094213A1 (en) * | 2009-02-20 | 2010-08-26 | 华为终端有限公司 | Method, apparatus and system for transmitting and receiving multiplex media data stream |
| WO2016150320A1 (en) * | 2015-03-25 | 2016-09-29 | 中兴通讯股份有限公司 | Method and device for sending audio |
| CN106162038A (en) * | 2015-03-25 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of audio frequency sending method and device |
| WO2019170037A1 (en) * | 2018-03-05 | 2019-09-12 | 集思谱（北京）科技有限公司 | Multimedia information distribution method and system combining individual units |
| CN110349584A (en) * | 2019-07-31 | 2019-10-18 | 北京声智科技有限公司 | A kind of audio data transmission method, device and speech recognition system |
| CN113542688A (en) * | 2021-07-14 | 2021-10-22 | 杭州海康威视数字技术股份有限公司 | Audio and video monitoring method, device, equipment, storage medium and system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2010094213A1 (en) | 2010-08-26 |
| CN101489090B (en) | 2014-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101370114B (en) | Video and audio processing method, multi-point control unit and video conference system | |
| CN102055949B (en) | Recording method, device and system of multimedia conference and rewinding method and device | |
| EP2214410B1 (en) | Method and system for conducting continuous presence conferences | |
| US8633962B2 (en) | Video decoder which processes multiple video streams | |
| JP3676979B2 (en) | High-speed video transmission via telephone line | |
| US9344475B2 (en) | Media transmission method and system based on telepresence | |
| EP2469853B1 (en) | Method and device for processing video image data, system and terminal for video conference | |
| CN103220543B (en) | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect | |
| US8139100B2 (en) | Virtual multiway scaler compensation | |
| CN110392047A (en) | Data transmission method, device and equipment | |
| US8184142B2 (en) | Method and system for composing video images from a plurality of endpoints | |
| CN102655584A (en) | Media data transmitting and playing method and system in tele-presence technology | |
| CN101489090B (en) | Method, apparatus and system for multipath media stream transmission and reception | |
| WO2007140668A1 (en) | Method and apparatus for realizing remote monitoring in conference television system | |
| CN106688213A (en) | Router fabric | |
| CN112866725A (en) | Live broadcast control method and device | |
| US20110088069A1 (en) | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system | |
| CN101141615B (en) | External implementing method of session television terminal supporting double currents | |
| KR20160149150A (en) | MMT apparatus and method for processing stereoscopic video data | |
| JP2016540454A (en) | Endpoint information interaction processing method, apparatus, and telepresence endpoint | |
| CN102761530A (en) | Method, device and system for media code stream transmission | |
| KR101673184B1 (en) | An ip switching/routing apparatus by separated processing of sdi format image signals and the method thereof | |
| WO2016204502A1 (en) | Mmt apparatus and mmt method for processing stereoscopic video data | |
| CN104219484A (en) | Method and device of capability interaction of tele-presence endpoints as well as data stream | |
| CN116866287A (en) | Audio and video signal exchange processing method, interface board and exchange equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Su Honghong Inventor after: Wang Zhaoxiang Inventor before: Su Honghong |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: SU HONGHONG TO: SU HONGHONG WANG ZHAOXIANG |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518129 Building 2, B District, Bantian HUAWEI base, Longgang District, Shenzhen, Guangdong. Patentee after: Huawei terminal (Shenzhen) Co.,Ltd. Address before: 518129 Building 2, B District, Bantian HUAWEI base, Longgang District, Shenzhen, Guangdong. Patentee before: HUAWEI DEVICE Co.,Ltd. |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20181218 Address after: 523808 Southern Factory Building (Phase I) Project B2 Production Plant-5, New Town Avenue, Songshan Lake High-tech Industrial Development Zone, Dongguan City, Guangdong Province Patentee after: HUAWEI DEVICE Co.,Ltd. Address before: 518129 Building 2, B District, Bantian HUAWEI base, Longgang District, Shenzhen, Guangdong. Patentee before: Huawei terminal (Shenzhen) Co.,Ltd. |
|
| TR01 | Transfer of patent right |