US8166170B2 - Distributed multiplexing - Google Patents

Distributed multiplexing Download PDF

Info

Publication number
US8166170B2
US8166170B2 US12589690 US58969009A US8166170B2 US 8166170 B2 US8166170 B2 US 8166170B2 US 12589690 US12589690 US 12589690 US 58969009 A US58969009 A US 58969009A US 8166170 B2 US8166170 B2 US 8166170B2
Authority
US
Grant status
Grant
Patent type
Prior art keywords
video streams
method according
bandwidth
streams
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US12589690
Other versions
US20100106838A1 (en )
Inventor
Doron Segev
Ron Gutman
Lior Morad
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Imagine Communications Ltd
Original Assignee
Imagine Communications Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347Demultiplexing of several video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a Uniform Resource Locator [URL] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365Multiplexing of several video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385Channel allocation; Bandwidth allocation

Abstract

The present invention is directed to a method of delivering a video stream. The method operates by determining a group of video streams to be provided to a particular destination over a particular communication link. Next, the band width of the link is allocated to the video streams based upon the particular properties of the various video streams to be transmitted. The video streams are processed so that they fit into the band width allocations. Next, the video streams are transmitted in separate channels, synchronized with respect to each other, to reach the subject destination.

Description

PRIORITY INFORMATION

The present invention claims priority to U.S. Provisional Application No. 61/108,514 filed on Oct. 26, 2008, making reference to same in its entirety.

FIELD OF THE INVENTION

The present invention relates to communication systems and in particular to systems for the delivery of video signals.

BACKGROUND OF THE INVENTION

One of the uses of communication networks, such as cable television, the Internet and the like, is for the distribution of movies and/or other video programs in the form of video streams. Video streams are formed from a sequence of discrete images referred to as frames, with corresponding display times. The transmission of video streams requires wide bandwidth and therefore video streams are generally compressed before transmission. For a given quality level, some video frames (e.g., frames having a large amount of detail) can be compressed only to a small extent, while other video frames (e.g., frames merely showing a blue sky) can be compressed to a larger extent, without substantial loss of quality. Therefore, many video compression methods provide variable bit-rate (VBR) video streams, in which different frames are compressed by different amounts.

Handling VBR video streams is somewhat inconvenient in that at different times different amounts of data are managed. Consequently, some protocols, such as the MPEG-2 transport stream (TS) protocol, handle only constant bit rate video channels. When a single VBR stream is to be handled, the VBR stream is encapsulated in a constant bit rate video channel, with padding bits, such as null transport stream packets of the MPEG-2 TS protocol, or other data unrelated to the video stream, filling the gaps between the VBR stream and the constant bit rate channel.

When a plurality of video streams are delivered together to a single location, the combined size of the encapsulating channels of the video streams may be substantially greater than the combined size of the video streams. Statistical multiplexers are designed to combine a plurality of VBR video streams onto a single channel, taking advantage of the fact that different video streams statistically require momentary high bit rates at different times. Statistical multiplexers also generally compress one or more of the multiplexed video streams when required and/or slightly change the timing of frames to enhance the multiplexing process.

U.S. Pat. No. 6,195,388 to Choi et al., the disclosure of which is incorporated herein by reference in its entirety, describes a statistical multiplexer.

U.S. Pat. No. 7,266,133 to Wu et al., the disclosure of which is incorporated herein by reference in its entirety, suggests a two stage statistical multiplexer, for cases in which large numbers of streams need to be multiplexed together.

Since statistical multiplexers are relatively complex, there have been various attempts to reduce their work load so that they can be made simpler.

US patent publication 2006/0195881 to Segev et al., the disclosure of which is incorporated herein by reference in its entirety, suggests generating compressed replacement blocks in advance for blocks of the video stream. When necessary, the statistical multiplexer uses these pre-prepared blocks instead of recompressing the blocks of the stream. This publication further describes performing statistical multiplexing of a channel, by software running on a processor not designed specifically for statistical multiplexing (e.g., not including a dedicated ASIC or FPGA).

In video on demand (VoD) cable television systems, video streams are generally provided to subscribers using quadrature amplitude modulation (QAM). The video streams are stored on VoD servers which transmit them to QAM modulators servicing clients on demand. The stored and transmitted video streams are generally CBR streams, which are easier to handle. The QAM modulator receives and modulates the stream and transmits it to the receiver, where a QAM tuner demodulates the stream and displays it on a television set. Some QAM modulators, such as the NSG 9116 Edge QAM, described for example at http://www.harmonicinc.com/view_collateral.cfm?ID=1346, are adapted to receive a plurality of single or multiple program channels and to combine them into a single channel, prior to modulation. The QAM modulator, however, usually does not perform statistical multiplexing, as such a function would make the modulator very complex. Instead, the QAM simply takes the CBR streams and combines them to generate a multi-program CBR stream having a size which is a sum of its CBR components. This simplicity is achieved at the expense of not using statistical multiplexing.

SUMMARY OF THE INVENTION

An aspect of some embodiments of the present invention relates to synchronizing the sizes and/or data transmission timing of a plurality of VBR video streams delivered in separate channels, optionally single program transport stream (SPTS) channels, to a receiving unit, such that combining the channels results in a single multi-program transport stream (MPTS) channel that is substantially smaller than the aggregate size of the separate channels, while still including the plurality of video streams. Optionally, the combining of the channels is performed without time-shifting and/or recompressing the data of the stream. The synchronizing of the streams although they are transmitted separately, allows simple combining of the streams at a different location, without forgoing the flexibility of separate delivery of the streams within the network.

There is therefore provided in accordance with an exemplary embodiment of the invention, a method of delivering a video stream, comprising determining a group of video streams to be provided together to a destination over a communication link of a specific size; allocating bandwidth to the streams of the group, responsive to the size of the communication link and properties of the video streams of the group processing the video streams so that they fit into their respective bandwidth allocations; and transmitting the processed video streams in separate channels, synchronized relative to each other, toward the destination.

Optionally, the communication link of the specific size has a constant size. Alternatively, the communication link of the specific size has a size which varies over time.

Optionally, allocating bandwidth to the streams comprises allocating bandwidth separately for a plurality of time segments. Optionally, allocating bandwidth to the streams comprises allocating for each time segment responsive to an analysis of the image content of the video streams during or around the time segment for which the allocation is performed.

Optionally, transmitting the processed video streams in separate channels comprises transmitting at times corresponding to the relative times of the time segments in the streams.

Optionally, allocating bandwidth to the streams comprises allocating in a manner designed to achieve substantially equal quality of the streams in each time segment.

Optionally, allocating bandwidth to the streams comprises allocating responsive to meta data describing properties of the video streams.

Optionally, processing the video streams comprises processing at least two of the streams by different or separate processing units. Optionally, the processing units are distanced from each other by at least one kilometer. Optionally, the different processing units are located within less than 50 meters from each other. Optionally, transmitting the processed video streams in separate channels comprises transmitting in separate constant bit rate channels or in separate variable bit rate channels. Optionally, the sum of the maximal sizes over time of the separate channels is greater from the size of the destination channel by at least 10%.

Optionally, transmitting the processed video streams in separate channels comprises transmitting in separate TS channels. Optionally, transmitting the processed video streams in separate channels comprises transmitting with different transport layer classifiers. Optionally, the method includes combining the processed video streams from the separate channels onto the communication link by a QAM modulator, without re-encoding the streams.

Optionally, the determined group of video streams comprises at least one real time video stream. Optionally, processing the video streams so that they fit into their respective bandwidth allocations is performed by one or more hardware units which serve as a source of the stream. Optionally, processing the video streams so that they fit into their respective bandwidth allocations is performed by a first hardware unit separate from one or more second hardware units which serve as sources of the streams. Optionally, processing the video streams so that they fit into their respective bandwidth allocations comprises processing such that the peak bit rate of the sum of the processed video streams is at least 10% smaller than the sum of the peak bit rates of the determined video streams before they are processed.

There is further provided in accordance with an exemplary embodiment of the invention, rate adapter, comprising an input interface adapted to receive a plurality of video streams, a bandwidth allocator configured to allocate bandwidth to the plurality of video streams in a manner which allows transmission of the plurality of video streams on a communication link of a given size and a video processing unit configured to receive bandwidth allocations for the plurality of video streams from the bandwidth allocator, to process the video streams, if necessary, so that they fit in their allocated bandwidth and to forward the streams, synchronized relative to each other, in separate channels.

Optionally, the bandwidth allocator is adapted to allocate bandwidth for the streams in advance for the entire duration of the video streams. Alternatively, the bandwidth allocator is adapted to allocate bandwidth periodically for an upcoming time segment of the video stream.

BRIEF DESCRIPTION OF THE FIGURES

Exemplary non-limiting embodiments of the invention will be described with reference to the following description of embodiments in conjunction with the figures. Identical structures, elements or parts which appear in more than one figure are preferably labeled with a same or similar number in all the figures in which they appear, in which:

FIG. 1 is a schematic illustration of a video delivery system, in accordance with an exemplary embodiment of the invention; and

FIG. 2 is a schematic illustration of video streams before and after they are combined, in accordance with an exemplary embodiment of the invention.

DETAILED DESCRIPTION OF EMBODIMENTS Network Overview

FIG. 1 is a schematic illustration of a video delivery system 100, in accordance with an exemplary embodiment of the invention. System 100 includes a plurality of video on demand (VoD) servers 102, which store video streams and provide them to subscribers, and/or one or more real time video sources, such as Integrated Receiver Decoders (IRD) 122. The output of each VoD server 102 and/or each IRD 122 may feed into one or more rate adapters 104 which adjust the rate of the video stream, according to instructions from a rate controller 106. Rate controller 106 is optionally configured with the identities of a group of streams that are to be delivered together to a client and a channel size allocated for the delivery of the group of streams to the client. The rate controller 106 receives information regarding the streams and/or the streams themselves and accordingly determines how to allocate the channel size to the different streams within the group.

It is noted that a single rate adapter 104 may handle a single video stream or a plurality of video streams. In addition, a single video stream may belong to a plurality of different groups of streams transmitted on separate links to separate end-users, and in such cases the stream is rate adapted into a plurality of different channels, by either a single rate adapter 104 or by a plurality of different rate adapters. Similarly, rate controller 106 may be configured to handle fitting a single group of streams on one channel, or handle concurrently fitting a plurality of groups of streams into a plurality of respective channel sizes.

It is noted that two different groups may include a common video stream and rate controller 106 may allocate different bandwidth allocations to the video stream at the same time, for the different groups. Optionally, rate controller 106 is dynamically instructed as to which groups it is to handle. In some embodiments, a session resource manager (SRM) 146 receives requests from clients for delivery of video streams and accordingly provides rate controller 106 with instructions regarding the groups it is to handle.

The rate adapted streams from rate adapters 104 are transmitted through a network 108 as separate single program transport streams (SPTS) to a QAM modulator 110, which optionally combines the streams, modulates the combination and transmits the modulated stream via a hybrid fiber-coax (HFC) link 112, or any other suitable link, toward a set-top box 114, or other client. The combining of the streams by QAM modulator 110 is a simple procedure, as the streams were previously rate adapted to fit with each other onto a channel having the bandwidth of link 112, or of that portion of link 112 allocated to the group of streams. In the combining of the streams, QAM modulator 110 optionally does not perform statistical multiplexing tasks, such as block replacements, timing adjustments or recompression. QAM modulator 110 may be a standard modulator which is unaware of the operation of rate adapters 104, such that embodiments of the invention can be implemented without replacing QAM modulators 110.

Real time video streams are generated shortly before they are handled by their respective one or more rate adapters 104, generally less than 5 minutes, but perhaps less than 10 seconds or even less than 5 seconds from when they were generated.

Servers and Rate Adapters

Servers 102 may all be located next to each other or some or all of the servers 102 may be distanced from each other, possibly being separated by more than 100 meters, more than a kilometer or even more than 10 kilometers.

Rate adapters 104 are optionally separate units from servers 102. In an exemplary embodiment, an existing video delivery system including servers 102 and QAM modulator 110 is upgraded by adding rate adapters 104 and rate controller 106, without altering servers 102 and/or QAM modulator 110. Optionally, before the adding of rate adapters 104 and rate controller 106, streams are transmitted to QAM modulator 110 as constant bit rate (CBR) streams or as non-correlated VBR streams having a size defined by a bounding fixed rate channel. Modulator 110 combines the streams into a combined stream having a size equal to the sum of the sizes of the bounding fixed rate channels. After the video delivery system is upgraded by adding rate adapters 104 and rate controller 106, the streams are provided as size synchronized variable bit rate (VBR) streams in separate channels, which are combined by QAM modulator 110 into a single multi-stream channel that is smaller than the sum of the bounding sizes of the channels that are combined. Due to the rate adjustment, the number of streams delivered to QAM modulator 110 after adding rate adapters 104 is optionally at least 20% or even at least 40% more than prior to the addition, while retaining a similar quality.

Alternatively to using rate adapters 104 separate from servers 102, some or all of servers 102 may be adapted to perform the rate adjustment, responsive to instructions from controller 106, during or after generation of the stream.

Rate adapters 104 optionally perform the rate adaptation by recompressing blocks of the video stream that are larger than the bandwidth allocated for them by rate controller 106. The recompression may be performed using substantially any method known in the art. In some embodiments of the invention, rate adapter 104 receives for some blocks of the video stream (e.g., macroblocks, frames, GOPs) of the video stream, a plurality of blocks representing the frame at different compression levels, and selects one of the blocks according to the allocated bandwidth. This may be performed, for example, using any of the methods described in above mentioned US patent publication 2006/0195881 to Segev et al. Alternatively or additionally, the rate adaptation includes shifting one or more blocks backwards in the timeline of the video stream such that they are transmitted slightly before they are required, at a time in which other video streams within the same group have lower bandwidth requirements.

It is noted, however, that in some cases, no rate adaptation is required, since the received video stream fits onto the allocated bandwidth without size adaptation. In such cases, the processing of the video stream by the rate adapter may consist of merely adding or removing null filler bits or even merely transferring the input of the rate adapter to its output port.

Rate Controller

Rate controller 106 may operate using any method for allocating bandwidth that is known in the art. In some embodiments of the invention, rate controller 106 periodically receives meta-data on each of the streams in a group of streams which are to be size synchronized and accordingly, for each time segment, assigns a portion of the available bandwidth to each of the streams. The allocation is optionally based on an attempt to achieve equal quality for all the streams of the group, for example using methods described in U.S. patent application Ser. No. 12/152,814, titled “Quality Based Video Encoding”, filed May 16, 2008, the disclosure of which is incorporated herein by reference in its entirety. Alternatively or additionally, other stream synchronization methods are used, such as the Test Model 5 method described in http://www.mpeg.org/MPEG/MSSG/tm5/, the disclosure of which is incorporated herein by reference.

The size of the time segments for which rate controller 106 periodically provides bandwidth allocations to rate adapters 104, may be defined, for example, in terms of a video portion length or in terms of a time period. For example, for each video stream in the handled group rate controller 106 may provide an indication of the bandwidth it is to use for a next time period. Alternatively or additionally, rate controller 106 provides indications of a bandwidth to be used for a next given portion of the video stream, such as the next GOP or frame. Optionally, in these embodiments, each bandwidth allocation relates to at least the length of a group of pictures (GOP) or even several GOPs. Alternatively, the allocations relate to shorter portions, for example for a single frame or even for durations shorter than a single frame. While the bandwidth allocation may be performed repeatedly for periods of the same length, this is not mandatory, and the allocation may be performed at different times for segments of different lengths.

In some embodiments of the invention, when dealing with non-real-time streams, instead of separately providing bandwidth allocations for each time segment slightly before that time segment, bandwidth allocations are provided at once for a plurality of time segments. Possibly, rate controller 106 provides bandwidth allocations in advance for an entire video stream or for a substantial portion thereof, e.g., at least 10% or even 20% of the stream.

Alternatively to using a rate controller 106 to perform the bandwidth allocation, the allocation is performed in a distributed manner by the rate adapters 104. In some such embodiments, the rate adapters 104 dynamically select one of them to serve as the rate controller for each given group of streams to be transmitted to a specific client. Alternatively, each rate adapter 104 determines on its own the bandwidth allocation it is to use, based on a predetermined distributed algorithm. Optionally, in accordance with this alternative, the meta-data of the streams of the groups is sent to all the rate adapters 104 participating in handling streams of the group and accordingly the rate adapters determine the allocations of the streams they handle, possibly as a result of determining the allocations of all the streams of the group.

The bandwidth allocation optionally provides equal service to all the streams, for example being directed at achieving equal quality degradation for all the streams and/or equal average bandwidth amounts. Alternatively or additionally, the video streams are associated with quality of service (QoS) ratings and their bandwidth allocations depend on their QoS ratings. In some embodiments of the invention, one or more of the video streams in the group may be classified as a high priority stream which is not to be degraded or altered at all. Such streams are passed through rate adapters 104 without alterations; the remaining streams of the groups receiving bandwidth allocations according to the bandwidth remaining after the high priority stream is allocated its bandwidth. As other streams received by rate adapters 104, the high priority streams may be CBR or VBR streams.

Channels

As mentioned above, the video streams of a correlated group of streams are transmitted to QAM modulator 110 in a plurality of separate channels. Optionally, each video stream is transmitted from its rate adapter 104 in a separate channel, although two or more video streams may be transmitted together in a single channel, for example when these video streams are always supplied together. Each channel is optionally identified by a separate and unique channel classifier (e.g., a unique header). The different channels optionally have different control signals. For example, the channels may be transmitted on separate physical/link layer interfaces (e.g., separate Ethernet interfaces) and/or with separate transport layer (e.g., IP, UDP) address and/or port identifiers. In an exemplary embodiment of the invention, the channels are transmitted according to the MPEG-2 transport stream (TS) protocol. In such embodiments, each channel containing a video stream is optionally transmitted as a separate TS stream having a unique channel ID.

The streams of the correlated group of streams are not necessarily provided from a single server and even not necessarily from a single location. Thus, they do not necessarily have the same source network layer address, e.g., IP address.

In some embodiments of the invention, each video stream of the correlated group is transmitted from its server 102 to QAM modulator 110 on a separate constant bit rate (CBR) channel, adhering to CBR timing constraints, such as those of the MPEG-2 transport stream protocol. For example, if the streams are originally VBR streams, they are optionally encased in CBR streams with padding bits. The total size of the CBR channels provided to QAM modulator 110 is optionally substantially greater than the maximal size of the combination of all the rate adjusted streams, for example at least 20% or even at least 30% greater. Transmitting the rate adjusted channels to QAM modulator 110 in separate CBR channels makes the delivery of the streams simple and easy, while still allowing simple combination of the streams into a suitable size, by QAM modulator 110.

In some embodiments of the invention, the video streams are transmitted to QAM modulator 110 in a synchronized manner, such that the segments of the video streams are transmitted according to their relative times in the streams. Accordingly, if the entire bandwidth of link 112 is utilized by the group of streams, the amount of data belonging to the group transmitted toward QAM modulator 110 during each time segment would be substantially equal to the size of the link 112. Optionally, the transmitted segments of the video streams are received by QAM 110 according to the relative timing of the segments of the video streams. Optionally, the jitter in the transmission of the segments is smaller than a given value, for example less than 50 milliseconds or even less than 10 milliseconds.

In other embodiments, QAM modulator 110 has a large buffer and/or a large buffer is provided before QAM modulator 110, and stream portions may be transmitted in advance and buffered, before modulator 110 organizes the data for transmission.

FIG. 2 is a schematic illustration of three video channels generated by one or more rate adapters 104 (FIG. 1), in accordance with an exemplary embodiment of the invention. Based on allocation instructions from rate controller 106, three streams 202A, 202B and 202C are generated by one or more rate adapters 104. Each stream 202A-C is packed into a respective CBR channel 204 (marked 204A, 204B and 204C) and is transmitted separately to QAM modulator 110. QAM modulator 110 extracts the video streams 202A-C from channels 204 and combines them onto a single combined stream 206.

The padding of the VBR stream into a CBR stream may include null bits which do not carry information, such as null MPEG-2 transport stream TS packets, or may include packets including additional information beyond that included in the VBR stream, such as packets with additional content, quality enhancement packets and/or packets which aid in further handling of the VBR stream.

Alternatively to transmitting the streams in CBR channels, one or more of the streams is provided as a VBR stream without padding into a CBR stream.

The video stream is optionally transmitted in accordance with any suitable video encapsulation format, such as MP-4, AVI, FLV or mpeg-2 TS, and/or using any suitable video coding, such as h.264, VP6 or VC-1. In some embodiments of the invention, the video streams are transmitted in accordance with the Real-Time Protocol (RTP). Although the above description relates to video streams, the principles of the present invention may be applied to audio streams (e.g., high quality audio streams) and/or other data types.

End Remarks

It will be appreciated that the methods described hereinabove may be varied in many ways, including, changing the order of some of the steps, and/or performing a plurality of steps concurrently. It should also be appreciated that the above described description of methods and apparatus are to be interpreted as including apparatus for carrying out the methods and methods of using the apparatus.

It should be understood that features and/or steps described with respect to one embodiment may be used with other embodiments and that not all embodiments of the invention have all of the features and/or steps shown in a particular figure or described with respect to one of the embodiments. Variations of embodiments described will occur to persons of the art. Furthermore, within the claims, the terms “comprise,” “include,” “have” and their conjugates, mean, “including but not necessarily limited to.”

It is noted that some of the above described embodiments may describe the best mode contemplated by the inventors and therefore may include structure, acts or details of structures and acts that may not be essential to the invention and which are described by way of example only. Structure and acts described herein are replaceable by equivalents which perform the same function, even if the structure or acts are different, as known in the art. Therefore, the scope of the invention is limited only by the elements and limitations as used in the claims.

Claims (18)

1. A method of delivering a video stream, comprising:
determining a group of video streams to be provided together to a destination over a communication link of a specific bandwidth size;
allocating bandwidth to the video streams of the group, responsive to the bandwidth size of the communication link and properties of the video streams of the group;
processing the video streams, by one or more processors, so that they fit into their respective bandwidth allocations; and
transmitting the processed video streams in separate constant bit rate channels, synchronized relative to each other, toward the destination, wherein a sum of maximal bandwidth sizes over time of the separate channels exceeds the bandwidth size of the communication link of the specific bandwidth size by at least 10%.
2. A method according to claim 1, wherein the communication link of the specific bandwidth size has a constant bandwidth size.
3. A method according to claim 1, wherein the communication link of the specific bandwidth size has a bandwidth size which varies over time.
4. A method according to claim 1, wherein allocating bandwidth to the video streams comprises allocating bandwidth separately for a plurality of time segments.
5. A method according to claim 4, wherein allocating bandwidth to the video streams comprises allocating for each time segment responsive to an analysis of the image content of the video streams during or around the time segment for which the allocation is performed.
6. A method according to claim 4, wherein transmitting the processed video streams in separate channels comprises transmitting at times corresponding to the relative times of the time segments within the video streams.
7. A method according to claim 4, wherein allocating bandwidth to the video streams comprises allocating in a manner designed to achieve substantially equal quality of the video streams in each time segment.
8. A method according to claim 1, wherein allocating bandwidth to the video streams comprises allocating responsive to meta data describing properties of the video streams.
9. A method according to claim 1, wherein processing the video streams comprises processing at least two of the video streams by separate processing units.
10. A method according to claim 9, wherein the separate processing units are distanced from each other by at least one kilometer.
11. A method according to claim 9, wherein the separate processing units are located within 50 meters of each other.
12. A method according to claim 1, wherein transmitting the processed video streams in separate channels comprises transmitting in separate TS channels.
13. A method according to claim 1, wherein transmitting the processed video streams in separate channels comprises transmitting with different transport layer classifiers.
14. A method according to claim 1, comprising combining the processed video streams from the separate channels onto the communication link by a QAM modulator, without re-encoding the video streams.
15. A method according to claim 1, wherein the determined group of video streams comprises at least one real time video stream.
16. A method according to claim 1, wherein processing the video streams so that they fit into their respective bandwidth allocations is performed by one or more hardware units which serve as a source of the video stream.
17. A method according to claim 1, wherein processing the video streams so that they fit into their respective bandwidth allocations comprises processing such that the peak bit rate of a sum of the processed video streams is at least 10% less than the sum of the peak bit rates of the determined video streams prior to processing.
18. A method according to claim 1, wherein processing the video streams so that they fit into their respective bandwidth allocations is performed by a first hardware unit separate from one or more second hardware units which serve as sources of the video streams.
US12589690 2008-10-26 2009-10-26 Distributed multiplexing Active 2030-07-03 US8166170B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US10851408 true 2008-10-26 2008-10-26
US12589690 US8166170B2 (en) 2008-10-26 2009-10-26 Distributed multiplexing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US12589690 US8166170B2 (en) 2008-10-26 2009-10-26 Distributed multiplexing

Publications (2)

Publication Number Publication Date
US20100106838A1 true US20100106838A1 (en) 2010-04-29
US8166170B2 true US8166170B2 (en) 2012-04-24

Family

ID=42118559

Family Applications (1)

Application Number Title Priority Date Filing Date
US12589690 Active 2030-07-03 US8166170B2 (en) 2008-10-26 2009-10-26 Distributed multiplexing

Country Status (1)

Country Link
US (1) US8166170B2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130332622A1 (en) * 2012-06-06 2013-12-12 Huawei Technologies Co., Ltd. Data stream scheduling method, device, and system
US9106544B2 (en) 2008-11-12 2015-08-11 Google Technology Holdings LLC Multi-rate statistical multiplexing
US9241174B1 (en) 2014-11-18 2016-01-19 Concurrent Computer Corporation Demand-based edge caching video content system and methods

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7836030B2 (en) * 2007-11-13 2010-11-16 International Business Machines Corporation Data library optimization
US9294526B2 (en) * 2009-12-28 2016-03-22 Microsoft Technology Licensing, Llc Managing multiple dynamic media streams
KR101628432B1 (en) 2010-02-19 2016-06-21 텔레폰악티에볼라겟엘엠에릭슨(펍) Method and arrangement for representation switching in http streaming
US9407876B1 (en) * 2010-09-14 2016-08-02 Pixia Corp. Method and system for encoding and decoding multiple wide-area surveillance area-of-interest video codestreams

Citations (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5603058A (en) * 1994-09-08 1997-02-11 International Business Machines Corporation Video optimized media streamer having communication nodes received digital data from storage node and transmitted said data to adapters for generating isochronous digital data streams
US6052384A (en) * 1997-03-21 2000-04-18 Scientific-Atlanta, Inc. Using a receiver model to multiplex variable-rate bit streams having timing constraints
US6081295A (en) 1994-05-13 2000-06-27 Deutsche Thomson-Brandt Gmbh Method and apparatus for transcoding bit streams with video data
US6195388B1 (en) * 1997-11-27 2001-02-27 Electronics And Telecommunications Research Institute Apparatus and method for encoding multiple video programs
US6215824B1 (en) 1998-05-01 2001-04-10 Boom Corporation Transcoding method for digital video networking
US6279158B1 (en) * 1994-09-26 2001-08-21 Adc Telecommunications, Inc. Dynamic bandwidth allocation
US6310915B1 (en) * 1998-11-20 2001-10-30 Harmonic Inc. Video transcoder with bitstream look ahead for rate control and statistical multiplexing
US20020018477A1 (en) * 2000-05-18 2002-02-14 Firemedia Communications (Israel) Ltd. Bandwidth and path allocation method for a switched fabric connecting multiple multimedia buses
US20020029274A1 (en) * 1998-11-17 2002-03-07 Allen Arthur Douglas Method for connection acceptance control and rapid determination of optimal multi-media content delivery over network
US6359863B1 (en) * 1998-08-12 2002-03-19 The Regents Of The University Of California Rate allocation system and method for ATM switched networks
US6795506B1 (en) * 1999-10-05 2004-09-21 Cisco Technology, Inc. Methods and apparatus for efficient scheduling and multiplexing
US20050058200A1 (en) * 2003-09-17 2005-03-17 International Business Machines Corporation Method and system for multiple pass video coding
US7058087B1 (en) 2001-05-29 2006-06-06 Bigband Networks, Inc. Method and system for prioritized bit rate conversion
US7058677B1 (en) 2001-07-17 2006-06-06 Vixs, Inc. Method and apparatus for selectible quantization in an encoder
US20060195881A1 (en) 2004-12-08 2006-08-31 Imagine Communications, Ltd. Distributed statistical multiplexing of multi-media
US20060224762A1 (en) * 2005-03-10 2006-10-05 Qualcomm Incorporated Quasi-constant-quality rate control with look-ahead
US20060265512A1 (en) * 1998-11-17 2006-11-23 Burst.Com Method for connection acceptance control and optimal multi-media content delivery over networks
US7174385B2 (en) * 2004-09-03 2007-02-06 Microsoft Corporation System and method for receiver-driven streaming in a peer-to-peer network
US20070165524A1 (en) * 2003-08-29 2007-07-19 Saverio Mascolo Rate based congestion control for packet networks
US20070200948A1 (en) * 2006-02-09 2007-08-30 Samsung Electronics Co., Ltd. Broadcasting system and method for providing multiple broadcasting service
US7266133B2 (en) * 2002-11-13 2007-09-04 General Instrument Corporation Methods and apparatus for statistical multiplexing with distributed multiplexers
US7292602B1 (en) * 2001-12-27 2007-11-06 Cisco Techonology, Inc. Efficient available bandwidth usage in transmission of compressed video data
US20080130501A1 (en) * 2006-12-01 2008-06-05 Leigh Bailey Bandwidth packing rate controller for optimizing resource utilization
US20090028192A1 (en) * 2007-07-24 2009-01-29 Remi Rieger Generation, distribution and use of content metadata in a network
US7529276B1 (en) * 2002-09-03 2009-05-05 Cisco Technology, Inc. Combined jitter and multiplexing systems and methods
US20090177793A1 (en) * 2006-04-13 2009-07-09 Flowing Content S.A. Method and system for content distribution
US7590200B2 (en) * 2004-04-16 2009-09-15 Ntt Docomo, Inc. Receiver, a transmitter, a radio communication system and a channel estimation method
US7793329B2 (en) * 2006-02-06 2010-09-07 Kasenna, Inc. Method and system for reducing switching delays between digital video feeds using multicast slotted transmission technique
US7809853B1 (en) * 2002-03-08 2010-10-05 Juniper Networks, Inc. Scheduler for transmit system interfaces
US7849194B2 (en) * 2000-07-28 2010-12-07 Kasenna, Inc. File system and method for administrating storage space and bandwidth in a computer system serving media assets

Patent Citations (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6081295A (en) 1994-05-13 2000-06-27 Deutsche Thomson-Brandt Gmbh Method and apparatus for transcoding bit streams with video data
US5603058A (en) * 1994-09-08 1997-02-11 International Business Machines Corporation Video optimized media streamer having communication nodes received digital data from storage node and transmitted said data to adapters for generating isochronous digital data streams
US6279158B1 (en) * 1994-09-26 2001-08-21 Adc Telecommunications, Inc. Dynamic bandwidth allocation
US6516002B1 (en) * 1997-03-21 2003-02-04 Scientific-Atlanta, Inc. Apparatus for using a receiver model to multiplex variable-rate bit streams having timing constraints
US6052384A (en) * 1997-03-21 2000-04-18 Scientific-Atlanta, Inc. Using a receiver model to multiplex variable-rate bit streams having timing constraints
US20010022789A1 (en) * 1997-03-21 2001-09-20 Scientific-Atlanta, Inc. Using a receiver model to multiplex variable-rate bit streams having timing constraints
US7009997B2 (en) * 1997-03-21 2006-03-07 Scientific-Atlanta, Inc. Using a receiver model to multiplex variable-rate bit streams having timing constraints
US6570888B1 (en) * 1997-03-21 2003-05-27 Scientific-Atlanta, Inc. Using a receiver model to multiplex variable-rate bit streams having timing constraints
US6438139B1 (en) * 1997-03-21 2002-08-20 Scientific-Atlanta, Inc. Method and apparatus for using a receiver model to multiplex variable-rate bit streams having timing constraints
US6195388B1 (en) * 1997-11-27 2001-02-27 Electronics And Telecommunications Research Institute Apparatus and method for encoding multiple video programs
US6215824B1 (en) 1998-05-01 2001-04-10 Boom Corporation Transcoding method for digital video networking
US6359863B1 (en) * 1998-08-12 2002-03-19 The Regents Of The University Of California Rate allocation system and method for ATM switched networks
US20020029274A1 (en) * 1998-11-17 2002-03-07 Allen Arthur Douglas Method for connection acceptance control and rapid determination of optimal multi-media content delivery over network
US20060265512A1 (en) * 1998-11-17 2006-11-23 Burst.Com Method for connection acceptance control and optimal multi-media content delivery over networks
US20060224768A1 (en) * 1998-11-17 2006-10-05 Burst.Com Method for connection acceptance control and rapid determination of optimal multi-media content delivery over networks
US6850965B2 (en) * 1998-11-17 2005-02-01 Arthur Douglas Allen Method for connection acceptance and rapid determination of optimal multi-media content delivery over network
US20060218281A1 (en) * 1998-11-17 2006-09-28 Burst.Com Method for connection acceptance control and rapid determination of optimal multi-media content delivery over networks
US20080228921A1 (en) * 1998-11-17 2008-09-18 Arthur Douglas Allen Connection Acceptance Control
US7890631B2 (en) * 1998-11-17 2011-02-15 Democrasoft, Inc. Connection acceptance control
US7383338B2 (en) * 1998-11-17 2008-06-03 Burst.Com, Inc. Method for connection acceptance control and rapid determination of optimal multi-media content delivery over networks
US7346688B2 (en) * 1998-11-17 2008-03-18 Burst.Com Method for connection acceptance control and rapid determination of optimal multi-media content delivery over networks
US6310915B1 (en) * 1998-11-20 2001-10-30 Harmonic Inc. Video transcoder with bitstream look ahead for rate control and statistical multiplexing
US6795506B1 (en) * 1999-10-05 2004-09-21 Cisco Technology, Inc. Methods and apparatus for efficient scheduling and multiplexing
US20020018477A1 (en) * 2000-05-18 2002-02-14 Firemedia Communications (Israel) Ltd. Bandwidth and path allocation method for a switched fabric connecting multiple multimedia buses
US7849194B2 (en) * 2000-07-28 2010-12-07 Kasenna, Inc. File system and method for administrating storage space and bandwidth in a computer system serving media assets
US7058087B1 (en) 2001-05-29 2006-06-06 Bigband Networks, Inc. Method and system for prioritized bit rate conversion
US7058677B1 (en) 2001-07-17 2006-06-06 Vixs, Inc. Method and apparatus for selectible quantization in an encoder
US7292602B1 (en) * 2001-12-27 2007-11-06 Cisco Techonology, Inc. Efficient available bandwidth usage in transmission of compressed video data
US7809853B1 (en) * 2002-03-08 2010-10-05 Juniper Networks, Inc. Scheduler for transmit system interfaces
US7529276B1 (en) * 2002-09-03 2009-05-05 Cisco Technology, Inc. Combined jitter and multiplexing systems and methods
US7266133B2 (en) * 2002-11-13 2007-09-04 General Instrument Corporation Methods and apparatus for statistical multiplexing with distributed multiplexers
US20070165524A1 (en) * 2003-08-29 2007-07-19 Saverio Mascolo Rate based congestion control for packet networks
US20050058200A1 (en) * 2003-09-17 2005-03-17 International Business Machines Corporation Method and system for multiple pass video coding
US7590200B2 (en) * 2004-04-16 2009-09-15 Ntt Docomo, Inc. Receiver, a transmitter, a radio communication system and a channel estimation method
US7174385B2 (en) * 2004-09-03 2007-02-06 Microsoft Corporation System and method for receiver-driven streaming in a peer-to-peer network
US20060195881A1 (en) 2004-12-08 2006-08-31 Imagine Communications, Ltd. Distributed statistical multiplexing of multi-media
US20060224762A1 (en) * 2005-03-10 2006-10-05 Qualcomm Incorporated Quasi-constant-quality rate control with look-ahead
US7793329B2 (en) * 2006-02-06 2010-09-07 Kasenna, Inc. Method and system for reducing switching delays between digital video feeds using multicast slotted transmission technique
US20070200948A1 (en) * 2006-02-09 2007-08-30 Samsung Electronics Co., Ltd. Broadcasting system and method for providing multiple broadcasting service
US20090177793A1 (en) * 2006-04-13 2009-07-09 Flowing Content S.A. Method and system for content distribution
US20080130501A1 (en) * 2006-12-01 2008-06-05 Leigh Bailey Bandwidth packing rate controller for optimizing resource utilization
US7936675B2 (en) * 2006-12-01 2011-05-03 Alcatel-Lucent Usa Inc. Bandwidth packing rate controller for optimizing resource utilization
US20090028192A1 (en) * 2007-07-24 2009-01-29 Remi Rieger Generation, distribution and use of content metadata in a network

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Harmonic: Narrowcast Services Gateway(TM) NSG(TM) 9116; 2 pages; © Harmonic Inc.; Jun. 2007; downloaded from http://www.harmonicinc.com/view-collateral.cfm?ID=1346.
Harmonic: Narrowcast Services Gateway™ NSG™ 9116; 2 pages; © Harmonic Inc.; Jun. 2007; downloaded from http://www.harmonicinc.com/view—collateral.cfm?ID=1346.
Test Model 5, MPEG-2 Video Main Profile; downloaded from http://www.mpeg.org/MPEG/MSSG/tm5/, Oct. 22, 2009.

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9106544B2 (en) 2008-11-12 2015-08-11 Google Technology Holdings LLC Multi-rate statistical multiplexing
US20130332622A1 (en) * 2012-06-06 2013-12-12 Huawei Technologies Co., Ltd. Data stream scheduling method, device, and system
US9479384B2 (en) * 2012-06-06 2016-10-25 Huawei Technologies Co., Ltd. Data stream scheduling method, device, and system
US9241174B1 (en) 2014-11-18 2016-01-19 Concurrent Computer Corporation Demand-based edge caching video content system and methods

Also Published As

Publication number Publication date Type
US20100106838A1 (en) 2010-04-29 application

Similar Documents

Publication Publication Date Title
Yeadon et al. Filters: QoS support mechanisms for multipeer communications
US7418007B1 (en) Method and apparatus for determining a transmission bit rate in a statistical multiplexer
US6434141B1 (en) Communication management system and method
US6327275B1 (en) Remultiplexing variable rate bitstreams using a delay buffer and rate estimation
US20070091789A1 (en) Strategies for disseminating media information using redundant network streams
US7477688B1 (en) Methods for efficient bandwidth scaling of compressed video data
US20020170059A1 (en) Universal STB architectures and control methods
US7266132B1 (en) Flexible memory allocation for data transmission
US20090003432A1 (en) Expedited splicing of video streams
US20090150943A1 (en) Policy control over switched delivery networks
US7039048B1 (en) Headend cherrypicker multiplexer with switched front end
US7023882B2 (en) Interfacing at least one information stream with at least one modulator
US20130263201A1 (en) Data transmission apparatus, system and method
US6298071B1 (en) Method and apparatus for processing variable bit rate information in an information distribution system
US20090201988A1 (en) Systems and methods for video processing in network edge devices
US20060067362A1 (en) Statistical remultiplexer performance for video on demand applications by use of metadata
US7451475B1 (en) Method for delivery of narrow-cast data over digital broadcast channels
US20060130113A1 (en) Method and apparatus for wideband distribution of content
US20080229379A1 (en) Method and apparatus providing scalability for channel change requests in a switched digital video system
US20110030019A1 (en) Ip video delivery using flexible channel bonding
US7039116B1 (en) Methods and apparatus for embedding and format conversion of compressed video data
US7602820B2 (en) Apparatus and methods for multi-stage multiplexing in a network
US20060195881A1 (en) Distributed statistical multiplexing of multi-media
US20070121629A1 (en) Accelerated channel change
US20090207866A1 (en) Apparatus and methods for utilizing statistical multiplexing to ensure quality of service in a network

Legal Events

Date Code Title Description
AS Assignment

Owner name: IMAGINE COMMUNICATIONS LTD.,ISRAEL

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SEGEV, DORON;GUTMAN, RON;MORAD, LIOR;SIGNING DATES FROM 20091022 TO 20091023;REEL/FRAME:023475/0144

Owner name: IMAGINE COMMUNICATIONS LTD., ISRAEL

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SEGEV, DORON;GUTMAN, RON;MORAD, LIOR;SIGNING DATES FROM 20091022 TO 20091023;REEL/FRAME:023475/0144

FPAY Fee payment

Year of fee payment: 4