USRE45983E1 - Hypothetical reference decoder - Google Patents
Hypothetical reference decoder Download PDFInfo
- Publication number
- USRE45983E1 USRE45983E1 US13/284,683 US201113284683A USRE45983E US RE45983 E1 USRE45983 E1 US RE45983E1 US 201113284683 A US201113284683 A US 201113284683A US RE45983 E USRE45983 E US RE45983E
- Authority
- US
- United States
- Prior art keywords
- segment
- video
- buffer
- values
- decoder
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 230000005540 biological transmission Effects 0.000 claims description 17
- 238000000034 method Methods 0.000 claims description 15
- 230000000295 complement effect Effects 0.000 claims 1
- 230000003139 buffering effect Effects 0.000 description 6
- 238000013459 approach Methods 0.000 description 4
- 230000014509 gene expression Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 239000000470 constituent Substances 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000008014 freezing Effects 0.000 description 1
- 238000007710 freezing Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003116 impacting effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2401—Monitoring of the client buffer
Definitions
- the present invention relates to a hypothetical reference decoder.
- a digital video system includes a transmitter and a receiver which assemble video comprising audio, images, and ancillary components for coordinated presentation to a user.
- the transmitter system includes subsystems to receive and compress the digital source data (the elementary or application data streams representing a program's audio, video, and ancillary data components); multiplex the data from the several elementary data streams into a single transport bit stream; and transmit the data to the receiver.
- the transport bit stream is demultiplexed into its constituent elementary data streams.
- the elementary data streams are decoded and the audio and video data streams are delivered as synchronized program elements to the receiver's presentation subsystem for display as parts of a coordinated program.
- a compliant bit stream to the decoder is decoded by a hypothetical decoder that is conceptually connected to the output of an encoder and consists of a decoder buffer, a decoder, and a display unit.
- This virtual decoder is known as the hypothetical reference decoder (HRD) in H.263 and the video buffering verifier (VBV) in MPEG-2.
- the encoder creates a bit stream so that the hypothetical decoder buffer does not overflow or underflow.
- the quantity of data the receiver may be required to buffer might exceed its capacity (a condition of memory overflow) or throughput capabilities.
- the receiver may fail to receive all of the data in a data access unit in time for decoding and synchronized presentation with a specified instant in the audio or video data streams resulting in a loss of data and inconsistent performance (a condition of memory underflow).
- the video bit stream is received at a given constant bit rate (usually the average rate in bits/sec of the stream) and is stored into the decoder buffer until the buffer fullness reaches a desired level.
- a desired level is denoted as the initial decoder buffer fullness and is directly proportional to the transmission or start-up (buffer) delay.
- the decoder instantaneously removes the bits for the first video frame of the sequence, decodes the bits, and displays the frame. The bits for the following frames are also removed, decoded, and displayed instantaneously at subsequent time intervals.
- the video bit streams are delivered to a variety of devices with different buffer capabilities (e.g., hand-sets, PDAs, PCs, Set-top-boxes, DVD-like players, etc.) and are created for scenarios with different delay requirements (e.g., low-delay streaming, progressive download, etc.).
- these applications require a more flexible hypothetical reference decoder that can decode a bit stream at different peak bit rates, and with different buffer sizes and start-up delays.
- the decoder operates according to N sets of rate and buffer parameters for a given bit stream. Each set characterizes what is known as a leaky bucket model and contains three values (R, B, F), where R is the transmission bit rate, B is the buffer size, and F is the initial decoder buffer fullness (F/R is the start-up or initial buffer delay).
- R is the transmission bit rate
- B is the buffer size
- F is the initial decoder buffer fullness
- F/R the start-up or initial buffer delay
- the hypothetical reference decoder may interpolate among the leaky bucket parameters and can operate at any desired peak bit rate, buffer size, or delay. For example, given a peak transmission rate R′, the reference decoder may select the smallest buffer size and delay (according to the available leaky bucket data) that will be able to decode the bit stream without suffering from buffer underflow or overflow. Conversely, for a given buffer size B′, the hypothetical decoder may select and operate at the minimum required peak transmission rate.
- a content provider can create a bit stream once, and a server can deliver it to multiple devices of different capabilities, using a variety of channels of different peak transmission rates.
- a server and a terminal can negotiate the best leaky bucket for the given networking conditions—e.g., the ones that will produce the lowest start-up (buffer) delay, or the one that will require the lowest peak transmission rate for the given buffer size of the device.
- a leaky bucket is a model for the state (or fullness) of an encoder or decoder buffer as a function of time.
- the fullness of the encoder and the decoder buffer are complements of each other.
- a leaky bucket model is characterized by three parameters (R, B, F), where:
- FIG. 1 illustrates the decoder buffer fullness along time of a bit stream that is constrained in a leaky bucket of parameters (R, B, F).
- B i be the decoder buffer fullness immediately before removing b i bits at time t i .
- t i+1 ⁇ t i 1/M seconds, where M is the frame rate (normally in frames/sec) for the bit stream.
- a leaky bucket model with parameters (R, B, F) contains a bit stream if there is no underflow of the decoder buffer. Because the encoder and decoder buffer fullness are complements of each other this is equivalent to no overflow of the encoder buffer. However, the encoder buffer (the leaky bucket) is allowed to become empty, or equivalently the decoder buffer may become full, at which point no further bits are transmitted from the encoder buffer to the decoder buffer. Thus, the decoder buffer stops receiving bits when it is full, which is why the min operator in equation (1) is included. A full decoder buffer simply means that the encoder buffer is empty.
- the curve of (R min , B min ) pairs for any bit stream (such as the one in FIG. 2 ) is piecewise linear and convex.
- the decoder can linearly interpolate the values to arrive at some points (R interp , B interp ) that are slightly but safely larger than (R min , B min ).
- R interp , B interp some points that are slightly but safely larger than (R min , B min ).
- the decoder can linearly interpolate the values to arrive at some points (R interp , B interp ) that are slightly but safely larger than (R min , B min ).
- the buffer size and consequently also the delay, by an order of magnitude, relative to a single leaky bucket containing the bit stream at its average rate.
- MPEG Video Buffering Verifier (VBV)
- the MPEG video buffering verifier can operate in two modes: constant bit rate (CBR) and variable bit rate (VBR).
- CBR constant bit rate
- VBR variable bit rate
- MPEG-1 only supports the CBR mode, while MPEG-2 supports both modes.
- the encoder ensures that B i ⁇ b i is always greater than or equal to zero. That is, the encoder must ensure that the decoder buffer does not underflow. However, in this VBR case the encoder does not need to ensure that the decoder buffer does not overflow. If the decoder buffer becomes full, then it is assumed that the encoder buffer is empty and hence no further bits are transmitted from the encoder buffer to the decoder buffer.
- VBR mode is useful for devices that can read data up to the peak rate R max .
- a DVD includes VBR clips where R max is about 10 Mbits/sec, which corresponds to the maximum reading speed of the disk drive, even though the average rate of the DVD video stream is only about 4 Mbits/sec.
- FIG. 3A and 3B plots of decoder buffer fullness for some bit streams operating in CBR and VBR modes, respectively, are shown.
- the CBR mode can be considered a special case of VBR where R max happens to be the average rate of the clip.
- HRD Hypothetical Reference Decoder
- hypothetic reference model for H.263 is similar to the CBR mode of MPEG's VBV previously discussed, except for the following:
- a generalized hypothetical reference decoder can operate given the information of N leaky bucket models, (R 1 , B 1 , F 1 ), (R 2 , B 2 , F 2 ), . . . , (R N , B N , R N ), (4) each of which contains the bit stream. Without loss of generality, let us assume that these leaky buckets are ordered from smallest to largest bit rate, i.e., R i ⁇ R i+ . Lets also assume that the encoder computes these leaky buckets models correctly and hence B i ⁇ B i+1 .
- the encoder can choose to: (a) pre-select the leaky bucket values and encode the bit stream with a rate control that makes sure that all of the leaky bucket constraints are met, (b) encode the bit stream and then use equation (1) to compute a set of leaky buckets containing the bit stream at N different values of R, or (c) do both.
- the first approach (a) can be applied to live or on-demand transmission, while (b) and (c) only apply to on-demand.
- the number of leaky buckets N and the leaky bucket parameters (4) are inserted into the bit stream. In this way, the decoder can determine which leaky bucket it wishes to use, knowing the peak bit rate available to it and/or its physical buffer size.
- the leaky bucket models in (4) as well as all the linearly interpolated or extrapolated models are available for use.
- FIG. 4 illustrates a set of N leaky bucket models and their interpolated or extrapolated (R, B) values.
- WD-2 The Joint Video Team of ISO/IEC MPEG and ITU-T VCEG Working Draft Number 2, Revision 0 (WD-2) incorporated many of the concepts of the hypothetical reference decoder proposed by Jordi Ribas-Cobera, et al. of Microsoft Corporation, incorporated by reference herein.
- the WD-2 document is similar to the decoder proposed by Jordi Ribas-Cobera, et al. of Microsoft Corporation, though the syntax is somewhat modified.
- WD-2 describes an example algorithm to compute B, and F for a given rate R.
- FIG. 1 illustrates decoder buffer fullness.
- FIG. 2 illustrates a R-B curve
- FIGS. 3A and 3B illustrate plots of decoder buffer fullness for some bit streams operating in CBR and VBR modes, respectively.
- FIG. 4 illustrates a set of N leaky bucket models and their interpolated or extrapolated (R, B) values.
- FIG. 5 illustrates initial buffering B j for any point of the decoder the user seeks to when the rate is R j .
- FIG. 6 illustrates sets of (R, B, F) defined in a forward looking fashion for the particular video stream.
- FIG. 7 illustrates the initial buffer fullness (in bits) for a video segment.
- FIG. 8 illustrates the selection criteria of a set of 10 points for FIG. 7 .
- FIG. 9 illustrates selection criteria
- FIG. 10 illustrates delay reductions.
- F i the initial buffer fullness
- B i the buffer size
- the amount of data in the buffer fluctuates.
- the present inventor came to the realization that if the F i value of the initial buffer fullness (when the channel rate is R i ) is used before starting to decode the video from the access point, then it is possible that the decoder will have an underflow. For example, at the access point or sometime thereafter the amount of bits necessary for video reconstruction may be greater than the bits currently in the buffer, resulting in underflow and inability to present video frames in a timely manner. It can likewise be shown that in a video stream the value of initial buffer fullness required to make sure there in no underflow at the decoder varies based on the point at which the user seeks to. This value is bounded by the B i . Accordingly, the combination of B and F provided for the entire video sequence, if used for an intermediate point in the video will not likely be appropriate, resulting in an underflow, and thus freezing frames.
- the present inventor then came to the realization that if only a set of R, B, and F values are defined for an entire video segment, then the system should wait until the buffer B for the corresponding rate R is full or substantially full (or greater than 90% full) to start decoding frames when a user jumps to an access point. In this manner, the initial fullness of the buffer will be at a maximum and thus there is no potential of underflow during subsequent decoding starting from the access point. This may be achieved without any additional changes to the existing bit stream, thus not impacting existing systems. Accordingly, the decoder would use the value of initial buffering B j for any point the user seeks to when the rate is R j , as shown in FIG. 5 . However, this unfortunately sometimes results in a significant delay until video frames are presented after selecting a different location (e.g., access point) from which to present video.
- a different location e.g., access point
- the initial buffer fullness (F) may likewise be characterized as a delay until the video sequence is presented (e.g., initial_cpb_removal_delay).
- the delay is temporal in nature being related to the time necessary to achieve initial buffer fullness (F).
- the delay and/or F may be associated with the entire video or the access points. It is likewise to be understood that delay may be substituted for F in all embodiments described herein (e.g., (R,B,delay)).
- sets of (R, B, F) may be defined for a particular video stream at each access point.
- these sets of (R, B, F) are preferably defined in a forward looking fashion for the particular video stream.
- set of (R, B, F) values may be computed in the previously existing manner for the video stream as a whole
- a set of F values for the same (R, B) values as those for the whole video stream may be computed in the previously existing manner for the video stream with respect to the video stream from position “2” looking forward, etc.
- the same process may be used for the remaining access points.
- the access points may be any frame within the video sequence, I frames of the sequence, B frames of the sequence, or P frames of the sequence (I, B, and P frames are typically used in MPEG based video encoding). Accordingly, the user may select one of the access points and thereafter use the respective F ij for the desired initial fullness (assuming that the buffer B j and rate R j remain unchanged) or otherwise a set of two or more of R i , B i , F ij .
- the sets of R, B, F values for each access point may be located at any suitable location, such as for example, at the start of the video sequence together with sets of (R, B, F) values for the entire video stream or before each access point which avoids the need for an index; or stored in a manner external to the video stream itself which is especially suitable for a server/client environment.
- This technique may be characterized by the following model: (R 1 , B 1 , F 1 , M 1 , f 11 , t 11 , . . . , f M11 , t M11 ) . . . , (R N , B N , F N , M N , f 1N t 1N , . . . , F MnN t MnN ), where f kj denotes the initial buffer fullness value at rate R j at access point t kj (time stamp).
- the values of M j may be provided as an input parameter or may be automatically selected.
- M j may include the following options:
- the system may, for a given R j , use an initial buffer fullness equal to f jk if the user seeks an access point t kj . This occurs when the user selects to start at an access point, or otherwise the system adjusts the user's selection to one of the access points.
- variable bit rate in bit stream
- the initial buffer fullness value is preferably different than the buffer size, albeit it may be the same.
- F value of B is represented by vbv_buffer_size
- the decoding data set would need to be provided for each and every frame. While permissible, the resulting data set would be excessively large and consume a significant amount of the bitrate available for the data. A more reasonable approach would be to limit the user to specific access points within the video stream, such as every second, 10 seconds, 1 minute, etc. While an improvement, the resulting data set may still be somewhat extensive resulting in excessive data for limited bandwidth devices, such as mobile communication devices.
- the initial buffer fullness may be equal to max(f kj , f (k+1)j ) for a time between t kj and t (k+1)j , especially if the access points are properly selected. In this manner, the system is guaranteed of having a set of values that will be free from resulting in an underflow condition, or otherwise reduce the likelihood of an underflow condition, as explained below.
- FIG. 7 illustrates the initial buffer fullness (in bits) for a video segment, where the forwarding looking initial buffer fullness is calculated for 10 second increments. Then the system preferably selects an access point at the start of the video sequence and an access point at the end of the video segment. Between the start and the end of the video segment, the system selects the local maximums to include as access points. Also, the system may select the local minimums to include as access points. Preferably, if a limited set of access points are desired the system first selects the local maximums, then the local minimums, which helps to ensure no underflow. Thereafter, the system may further select intermediate points, as desired.
- a set of 10 points for FIG. 7 may be selected as indicated in FIG. 8 .
- the 10 selected points are shown by the dashed curve.
- the resulting initial buffer fullness values at all access points are shown by the solid curve.
- the solid curve illustrates a “safe” set of values for all points in the video so that the decoder buffer will not underflow. If extreme fluctuations occurred in the bit rate of the actual bit stream that were not detected in the processing, such as a sharp spike, then it is possible to result in an underflow, through normally unlikely.
- the optimal initial buffer fullness values at all access points are shown by the dash-dotted curve. A significant reduction in the buffering time delay is achieved, in contrast to requiring a hill buffer when accessing an access point, as illustrated in FIG. 10 .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Color Television Systems (AREA)
- Color Television Image Signal Generators (AREA)
- Vehicle Body Suspensions (AREA)
- Studio Devices (AREA)
- Apparatus For Making Beverages (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
Description
-
- R is the peak bit rate (in bits per second) at which bits enter the decoder buffer. In constant to bit rate scenarios, R is often the channel bit rate and the average bit rate of the video clip.
- B is the size of the bucket or decoder buffer (in bits) which smoothes the video bit rate fluctuations. This buffer size cannot be larger than the physical buffer of the decoding device.
- F is the initial decoder buffer fullness (also in bits) before the decoder starts removing bits from the buffer. F and R determine the initial or start-up delay D, where D=F/R seconds.
B0=F
Bi+1=min (B, Bi−bi+R(ti+1−ti)), i=0, 1, 2, . . . (1)
-
- A given video stream can be contained in many leaky buckets. For example, if a video stream is contained in a leaky bucket with parameters (R, B, F), it will also be contained in a leaky bucket with a larger buffer (R, B′, F), B′>B, or in a leaky bucket with a higher peak transmission rate (R′, B, F), R′>R.
- For any bit rate R′, the system can always find a buffer size that will contain the (time-limited) video bit stream. In the worst case (R′ approaches 0), the buffer size will need to be as large as the bit stream itself. Put another way, a video bit stream can be transmitted at any rate (regardless of the average bit rate of the clip) as long as the buffer size is large enough.
MPEG Video Buffering Verifier (VBV)
R=Rmax=the average bit rate of the stream.
-
- The value of B is stored in the syntax parameter vbv_buffer_size using a special size unit (i.e., 16×1024 bit units).
- The value of F/R is stored in the syntax element vbv_delay associated to the first video frame in the sequence using a special time unit (i.e., number of periods of a 90 KHz clock).
- The decoder buffer fullness follows the following equations:
B0=F
Bi+1=Bi−bi+Rmax/M, i=0, 1, 2, . . . (2) - The encoder must ensure that Bi−bi is always greater than or equal to zero while Bi is always less than or equal to B. In other words, the encoder ensures that the decoder buffer does not undertow or overflow.
R=Rmax=the peak or maximum rate. Rmax is higher than the average rate of the bit stream.
-
- F=B, i.e., the buffer fills up initially.
- The value of B is represented in the syntax parameter vbv_buffer_size, as in the CBR case.
B0=B
Bi+1=min (B, Bi−bi+Rmax/M), i=0, 1, 2, . . . (3)
H.263's Hypothetical Reference Decoder (HRD)
-
- The decoder inspects the buffer fullness at some time intervals and decodes a frame as soon as all the bits for the frame are available. This approach results in a couple of benefits: (a) the delay is minimized because F is usually just slightly larger than the number of bits for the first frame, and (b) if frame skipping is common, the decoder simply waits until the next available frame. The latter is enabled in the low-delay mode of MPEG's VBV as well.
- The check for buffer overflow is done after the bits for a frame are removed from the buffer. This relaxes the constraint for sending large I frames once in awhile, but there is a maximum value for the largest frame.
H.263's HRD can essentially be mapped to a type of low delay leaky bucket model.
-
- If the bit rate available in the channel R′ is lower than R (e.g., this is common for Internet streaming and progressive download, or when an MPEG VBR clip needs to be transmitted at a rate lower than the peak), strictly speaking, the hypothetical decoder would not be able to decode the bit stream.
- If the available bandwidth R′ is larger than R (e.g., this is also common for Internet streaming, as well as for local playback), the previous hypothetical decoders could operate in the VBR mode and decode the bit stream. However, if more information on the Rate-Buffer curve were available, the buffer size and associated start-up delay required to decode the bit stream could be significantly reduced.
- If the physical buffer size in a decoder device is smaller than B, the device will not be able to decode that bit stream.
- If the buffer size is larger than B, the device will be able to decode the bit stream but the start-up delay will be the same.
- More generally, a bit stream that was generated according to a leaky bucket (R, B, F) will not usually be able to be distributed through different networks of bit rate smaller than R, and to a variety of devices with buffer sizes smaller than B. Also, the start-up delay will not be minimized.
(R1, B1, F1), (R2, B2, F2), . . . , (RN, BN, RN), (4)
each of which contains the bit stream. Without loss of generality, let us assume that these leaky buckets are ordered from smallest to largest bit rate, i.e., Ri<Ri+. Lets also assume that the encoder computes these leaky buckets models correctly and hence Bi<Bi+1.
B={(Rk+1−R)/(Rk+1−Rk)}Bk+{(R−Rk)/(Rk+1−Rk)}Bk+1Rk<R<Rk+1
Likewise, the initial decoder buffer fullness F can be linearly interpolated:
F={(Rk+1−R)/(Rk+1−Rk)}Fk+{(R−Rk)/(Rk+1−Rk)}Fk+1Rk<R<Rk+1
(R1, B1, F1, M1, f11, t11, . . . , fM11, tM11) . . . , (RN, BN, FN, MN, f1Nt1N, . . . , FMnNtMnN),
where fkj denotes the initial buffer fullness value at rate Rj at access point tkj (time stamp). The values of Mj may be provided as an input parameter or may be automatically selected.
For example, Mj may include the following options:
-
- (a) Mj may be set equal to the number of access points. In this manner the values of fkj may be stored for each access point at each rate Rj (either at the start of the video stream, within the video stream, distributed through the video stream, or otherwise in any location).
- (b) Mj may be set equal to zero if no seekability support is desired.
- (c) Mj values for each rate Rj may be automatically selected (described later).
Claims (12)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/284,683 USRE45983E1 (en) | 2003-03-31 | 2011-10-28 | Hypothetical reference decoder |
US14/970,087 USRE48953E1 (en) | 2003-03-31 | 2015-12-15 | Hypothetical reference decoder |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/404,947 US7266147B2 (en) | 2003-03-31 | 2003-03-31 | Hypothetical reference decoder |
US12/553,836 USRE43062E1 (en) | 2003-03-31 | 2009-09-03 | Hypothetical reference decoder |
US13/284,683 USRE45983E1 (en) | 2003-03-31 | 2011-10-28 | Hypothetical reference decoder |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/404,947 Reissue US7266147B2 (en) | 2003-03-31 | 2003-03-31 | Hypothetical reference decoder |
US12/553,836 Continuation USRE43062E1 (en) | 2003-03-31 | 2009-09-03 | Hypothetical reference decoder |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/404,947 Continuation US7266147B2 (en) | 2003-03-31 | 2003-03-31 | Hypothetical reference decoder |
Publications (1)
Publication Number | Publication Date |
---|---|
USRE45983E1 true USRE45983E1 (en) | 2016-04-19 |
Family
ID=32990219
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/404,947 Ceased US7266147B2 (en) | 2003-03-31 | 2003-03-31 | Hypothetical reference decoder |
US12/553,836 Active 2025-05-31 USRE43062E1 (en) | 2003-03-31 | 2009-09-03 | Hypothetical reference decoder |
US13/284,683 Active 2025-05-31 USRE45983E1 (en) | 2003-03-31 | 2011-10-28 | Hypothetical reference decoder |
US14/970,087 Active 2025-05-31 USRE48953E1 (en) | 2003-03-31 | 2015-12-15 | Hypothetical reference decoder |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/404,947 Ceased US7266147B2 (en) | 2003-03-31 | 2003-03-31 | Hypothetical reference decoder |
US12/553,836 Active 2025-05-31 USRE43062E1 (en) | 2003-03-31 | 2009-09-03 | Hypothetical reference decoder |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/970,087 Active 2025-05-31 USRE48953E1 (en) | 2003-03-31 | 2015-12-15 | Hypothetical reference decoder |
Country Status (11)
Country | Link |
---|---|
US (4) | US7266147B2 (en) |
EP (3) | EP2209319B1 (en) |
JP (4) | JP2006519517A (en) |
CN (3) | CN1826812B (en) |
AT (2) | ATE390019T1 (en) |
DE (2) | DE602004012540T2 (en) |
ES (3) | ES2390596T3 (en) |
HK (2) | HK1145413A1 (en) |
PL (1) | PL2209319T3 (en) |
PT (3) | PT1611747E (en) |
WO (1) | WO2004088988A1 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9445120B2 (en) | 2011-04-12 | 2016-09-13 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US9456217B2 (en) | 2011-05-24 | 2016-09-27 | Sun Patent Trust | Coding method and apparatus with candidate motion vectors |
US9456214B2 (en) | 2011-08-03 | 2016-09-27 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus, and moving picture coding and decoding apparatus |
US9485518B2 (en) | 2011-05-27 | 2016-11-01 | Sun Patent Trust | Decoding method and apparatus with candidate motion vectors |
US9560373B2 (en) | 2011-05-31 | 2017-01-31 | Sun Patent Trust | Image coding method and apparatus with candidate motion vectors |
US9609356B2 (en) | 2011-05-31 | 2017-03-28 | Sun Patent Trust | Moving picture coding method and apparatus with candidate motion vectors |
US9615107B2 (en) | 2011-05-27 | 2017-04-04 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US10887585B2 (en) | 2011-06-30 | 2021-01-05 | Sun Patent Trust | Image decoding method, image coding method, image decoding apparatus, image coding apparatus, and image coding and decoding apparatus |
US11218708B2 (en) | 2011-10-19 | 2022-01-04 | Sun Patent Trust | Picture decoding method for decoding using a merging candidate selected from a first merging candidate derived using a first derivation process and a second merging candidate derived using a second derivation process |
Families Citing this family (67)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7068729B2 (en) | 2001-12-21 | 2006-06-27 | Digital Fountain, Inc. | Multi-stage code generator and decoder for communication systems |
US6307487B1 (en) | 1998-09-23 | 2001-10-23 | Digital Fountain, Inc. | Information additive code generator and decoder for communication systems |
US9240810B2 (en) | 2002-06-11 | 2016-01-19 | Digital Fountain, Inc. | Systems and processes for decoding chain reaction codes through inactivation |
JP4546246B2 (en) | 2002-10-05 | 2010-09-15 | デジタル ファウンテン, インコーポレイテッド | Systematic encoding and decryption of chained encryption reactions |
US7908130B2 (en) * | 2002-12-12 | 2011-03-15 | Ixia | Modelling aggregate transport layer network traffic behaviour with feedback containing packet loss information |
US7266147B2 (en) * | 2003-03-31 | 2007-09-04 | Sharp Laboratories Of America, Inc. | Hypothetical reference decoder |
US7054774B2 (en) * | 2003-06-27 | 2006-05-30 | Microsoft Corporation | Midstream determination of varying bandwidth availability |
US7979886B2 (en) * | 2003-10-17 | 2011-07-12 | Telefonaktiebolaget Lm Ericsson (Publ) | Container format for multimedia presentations |
US8683535B2 (en) * | 2004-03-26 | 2014-03-25 | Broadcom Corporation | Fast channel change |
US8842175B2 (en) | 2004-03-26 | 2014-09-23 | Broadcom Corporation | Anticipatory video signal reception and processing |
US7162533B2 (en) * | 2004-04-30 | 2007-01-09 | Microsoft Corporation | Session description message extensions |
CN103124182B (en) | 2004-05-07 | 2017-05-10 | 数字方敦股份有限公司 | File download and streaming system |
US8218439B2 (en) * | 2004-11-24 | 2012-07-10 | Sharp Laboratories Of America, Inc. | Method and apparatus for adaptive buffering |
US7543073B2 (en) * | 2004-12-10 | 2009-06-02 | Microsoft Corporation | System and process for performing an exponentially weighted moving average on streaming data to establish a moving average bit rate |
KR20060065482A (en) * | 2004-12-10 | 2006-06-14 | 마이크로소프트 코포레이션 | A system and process for controlling the coding bit rate of streaming media data |
US20060143678A1 (en) * | 2004-12-10 | 2006-06-29 | Microsoft Corporation | System and process for controlling the coding bit rate of streaming media data employing a linear quadratic control technique and leaky bucket model |
US7536469B2 (en) * | 2004-12-10 | 2009-05-19 | Microsoft Corporation | System and process for controlling the coding bit rate of streaming media data employing a limited number of supported coding bit rates |
BRPI0610404A2 (en) * | 2005-04-07 | 2012-01-10 | Nokia Corp | method, system and device for storing media stream packets, wireless communication device, server, multipoint media broadcasting server / service, device for receiving packets having a transmission schedule and at least one transmission frame, signal associated with a media stream, computer program product |
CN101686107B (en) | 2006-02-13 | 2014-08-13 | 数字方敦股份有限公司 | Streaming and buffering using variable FEC overhead and protection periods |
US9270414B2 (en) | 2006-02-21 | 2016-02-23 | Digital Fountain, Inc. | Multiple-field based code generator and decoder for communications systems |
WO2007134196A2 (en) | 2006-05-10 | 2007-11-22 | Digital Fountain, Inc. | Code generator and decoder using hybrid codes |
US9380096B2 (en) | 2006-06-09 | 2016-06-28 | Qualcomm Incorporated | Enhanced block-request streaming system for handling low-latency streaming |
US9419749B2 (en) | 2009-08-19 | 2016-08-16 | Qualcomm Incorporated | Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes |
US9178535B2 (en) | 2006-06-09 | 2015-11-03 | Digital Fountain, Inc. | Dynamic stream interleaving and sub-stream based delivery |
US9209934B2 (en) | 2006-06-09 | 2015-12-08 | Qualcomm Incorporated | Enhanced block-request streaming using cooperative parallel HTTP and forward error correction |
US9432433B2 (en) | 2006-06-09 | 2016-08-30 | Qualcomm Incorporated | Enhanced block-request streaming system using signaling or block creation |
US9386064B2 (en) | 2006-06-09 | 2016-07-05 | Qualcomm Incorporated | Enhanced block-request streaming using URL templates and construction rules |
US20100211690A1 (en) * | 2009-02-13 | 2010-08-19 | Digital Fountain, Inc. | Block partitioning for a data stream |
CN101299808B (en) * | 2007-04-30 | 2011-11-16 | 北京希格玛和芯微电子技术有限公司 | Method and apparatus for real-time image data transmission |
EP2203836A4 (en) | 2007-09-12 | 2014-11-05 | Digital Fountain Inc | Generating and communicating source identification information to enable reliable communications |
JP5171413B2 (en) * | 2008-06-16 | 2013-03-27 | 三菱電機株式会社 | Content transmission device, content reception device, and content transmission method |
US9281847B2 (en) | 2009-02-27 | 2016-03-08 | Qualcomm Incorporated | Mobile reception of digital video broadcasting—terrestrial services |
US9288010B2 (en) | 2009-08-19 | 2016-03-15 | Qualcomm Incorporated | Universal file delivery methods for providing unequal error protection and bundled file delivery services |
US9917874B2 (en) | 2009-09-22 | 2018-03-13 | Qualcomm Incorporated | Enhanced block-request streaming using block partitioning or request controls for improved client-side handling |
EP2534643A4 (en) * | 2010-02-11 | 2016-01-06 | Nokia Technologies Oy | Method and apparatus for providing multi-threaded video decoding |
US9485546B2 (en) | 2010-06-29 | 2016-11-01 | Qualcomm Incorporated | Signaling video samples for trick mode video representations |
US9185439B2 (en) | 2010-07-15 | 2015-11-10 | Qualcomm Incorporated | Signaling data for multiplexing video components |
US9596447B2 (en) | 2010-07-21 | 2017-03-14 | Qualcomm Incorporated | Providing frame packing type information for video coding |
US8825886B2 (en) | 2010-07-28 | 2014-09-02 | Hong Kong Applied Science and Technology Research Institute Company Limited | System and method for evaluating network transport effects on delivery of media content |
US8806050B2 (en) | 2010-08-10 | 2014-08-12 | Qualcomm Incorporated | Manifest file updates for network streaming of coded multimedia data |
US9270299B2 (en) | 2011-02-11 | 2016-02-23 | Qualcomm Incorporated | Encoding and decoding using elastic codes with flexible source block mapping |
US9253233B2 (en) | 2011-08-31 | 2016-02-02 | Qualcomm Incorporated | Switch signaling methods providing improved switching between representations for adaptive HTTP streaming |
US9131245B2 (en) | 2011-09-23 | 2015-09-08 | Qualcomm Incorporated | Reference picture list construction for video coding |
US9843844B2 (en) | 2011-10-05 | 2017-12-12 | Qualcomm Incorporated | Network streaming of media data |
US9264717B2 (en) * | 2011-10-31 | 2016-02-16 | Qualcomm Incorporated | Random access with advanced decoded picture buffer (DPB) management in video coding |
KR20130058584A (en) | 2011-11-25 | 2013-06-04 | 삼성전자주식회사 | Method and apparatus for encoding image, and method and apparatus for decoding image to manage buffer of decoder |
US9294226B2 (en) | 2012-03-26 | 2016-03-22 | Qualcomm Incorporated | Universal object delivery and template-based file delivery |
MX341068B (en) * | 2012-04-23 | 2016-08-05 | Panasonic Ip Corp America | Image encoding method, image decoding method, image encoding device, image decoding device, and image encoding/decoding device. |
JP5994367B2 (en) * | 2012-04-27 | 2016-09-21 | 富士通株式会社 | Moving picture coding apparatus and moving picture coding method |
US20140003534A1 (en) | 2012-07-02 | 2014-01-02 | Sony Corporation | Video coding system with temporal scalability and method of operation thereof |
US9912941B2 (en) | 2012-07-02 | 2018-03-06 | Sony Corporation | Video coding system with temporal layers and method of operation thereof |
US10110890B2 (en) | 2012-07-02 | 2018-10-23 | Sony Corporation | Video coding system with low delay and method of operation thereof |
JP6094126B2 (en) * | 2012-10-01 | 2017-03-15 | 富士通株式会社 | Video decoding device |
CN109905726B (en) * | 2013-03-15 | 2021-06-04 | 构造数据有限责任公司 | System and method for real-time television advertisement detection |
US10021432B2 (en) | 2013-06-06 | 2018-07-10 | Nec Corporation | Time series data encoding apparatus, method, and program, and time series data re-encoding apparatus, method, and program |
JP6146471B2 (en) * | 2013-07-26 | 2017-06-14 | 富士通株式会社 | Encoding apparatus, encoding method, and encoding program |
US20160227227A1 (en) * | 2013-10-11 | 2016-08-04 | Sharp Kabushiki Kaisha | Color information and chromaticity signaling |
JP6271756B2 (en) * | 2013-12-02 | 2018-01-31 | ドルビー・インターナショナル・アーベー | Method of bit rate signaling and bit stream format enabling the method |
US9813719B2 (en) * | 2014-06-18 | 2017-11-07 | Qualcomm Incorporated | Signaling HRD parameters for bitstream partitions |
US10979747B2 (en) * | 2017-12-21 | 2021-04-13 | Arris Enterprises Llc | Statistical multiplexing system for variable bit rate encoding with constant bit rate encoder |
KR20220003084A (en) * | 2019-05-06 | 2022-01-07 | 후아웨이 테크놀러지 컴퍼니 리미티드 | Virtual reference decoder for progressive decoding refresh |
KR20220065867A (en) * | 2019-09-24 | 2022-05-20 | 후아웨이 테크놀러지 컴퍼니 리미티드 | HRD parameters for layers |
US11483227B2 (en) | 2020-10-13 | 2022-10-25 | Keysight Technologies, Inc. | Methods, systems and computer readable media for active queue management |
US11483228B2 (en) | 2021-01-29 | 2022-10-25 | Keysight Technologies, Inc. | Methods, systems, and computer readable media for network testing using an emulated data center environment |
US11405302B1 (en) | 2021-03-11 | 2022-08-02 | Keysight Technologies, Inc. | Methods, systems, and computer readable media for network testing using configurable test infrastructure |
US11388081B1 (en) | 2021-03-30 | 2022-07-12 | Keysight Technologies, Inc. | Methods, systems, and computer readable media for impairment testing using an impairment device |
US11765068B2 (en) | 2021-12-22 | 2023-09-19 | Keysight Technologies, Inc. | Methods, systems, and computer readable media for programmable data plane processor based traffic impairment |
Citations (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH02272851A (en) | 1989-04-14 | 1990-11-07 | Oki Electric Ind Co Ltd | Assembly system and disassembly system of picture packet |
US5159447A (en) * | 1991-05-23 | 1992-10-27 | At&T Bell Laboratories | Buffer control for variable bit-rate channel |
US5287182A (en) * | 1992-07-02 | 1994-02-15 | At&T Bell Laboratories | Timing recovery for variable bit-rate video on asynchronous transfer mode (ATM) networks |
US5365552A (en) | 1992-11-16 | 1994-11-15 | Intel Corporation | Buffer fullness indicator |
US5398072A (en) | 1993-10-25 | 1995-03-14 | Lsi Logic Corporation | Management of channel buffer in video decoders |
JPH07107429A (en) | 1993-10-05 | 1995-04-21 | Matsushita Electric Ind Co Ltd | Picture signal recorder and reproducing device therefor |
US5481543A (en) | 1993-03-16 | 1996-01-02 | Sony Corporation | Rational input buffer arrangements for auxiliary information in video and audio signal processing systems |
US5534944A (en) | 1994-07-15 | 1996-07-09 | Matsushita Electric Corporation Of America | Method of splicing MPEG encoded video |
US5537408A (en) | 1995-02-03 | 1996-07-16 | International Business Machines Corporation | apparatus and method for segmentation and time synchronization of the transmission of multimedia data |
US5543853A (en) * | 1995-01-19 | 1996-08-06 | At&T Corp. | Encoder/decoder buffer control for variable bit-rate channel |
US5619341A (en) * | 1995-02-23 | 1997-04-08 | Motorola, Inc. | Method and apparatus for preventing overflow and underflow of an encoder buffer in a video compression system |
US5629736A (en) | 1994-11-01 | 1997-05-13 | Lucent Technologies Inc. | Coded domain picture composition for multimedia communications systems |
US5652749A (en) | 1995-02-03 | 1997-07-29 | International Business Machines Corporation | Apparatus and method for segmentation and time synchronization of the transmission of a multiple program multimedia data stream |
US5663962A (en) * | 1994-09-29 | 1997-09-02 | Cselt- Centro Studi E Laboratori Telecomunicazioni S.P.A. | Method of multiplexing streams of audio-visual signals coded according to standard MPEG1 |
US5668841A (en) * | 1994-05-27 | 1997-09-16 | Lucent Technologies Inc. | Timing recovery for variable bit-rate video on asynchronous transfer mode (ATM) networks |
US5831688A (en) * | 1994-10-31 | 1998-11-03 | Mitsubishi Denki Kabushiki Kaisha | Image coded data re-encoding apparatus |
US5877812A (en) | 1995-11-21 | 1999-03-02 | Imedia Corporation | Method and apparatus for increasing channel utilization for digital video transmission |
EP0930786A2 (en) | 1998-01-19 | 1999-07-21 | Sony Corporation | Compressed picture data editing apparatus and method |
US5982436A (en) * | 1997-03-28 | 1999-11-09 | Philips Electronics North America Corp. | Method for seamless splicing in a video encoder |
US5995151A (en) * | 1995-12-04 | 1999-11-30 | Tektronix, Inc. | Bit rate control mechanism for digital image and video data compression |
US6055270A (en) * | 1994-04-20 | 2000-04-25 | Thomson Cosumer Electronics, Inc. | Multiplexer system using constant bit rate encoders |
JP2000124958A (en) | 1998-10-20 | 2000-04-28 | Mitsubishi Electric Corp | Encoded data switching device |
US6085221A (en) * | 1996-01-08 | 2000-07-04 | International Business Machines Corporation | File server for multimedia file distribution |
US6188703B1 (en) * | 1997-08-01 | 2001-02-13 | International Business Machines Corp. | Multiplexer for multiple media streams |
US6272566B1 (en) | 1998-11-18 | 2001-08-07 | International Business Machines Corporation | System for maintaining proper buffering within video play list |
US20020037161A1 (en) | 2000-09-27 | 2002-03-28 | Takayuki Sugahara | MPEG picture data recording apparatus, MPEG picture data recording method, MPEG picture data recording medium, MPEG picture data generating apparatus, MPEG picture data reproducing apparatus, and MPEG picture data reproducing method |
US6366704B1 (en) * | 1997-12-01 | 2002-04-02 | Sharp Laboratories Of America, Inc. | Method and apparatus for a delay-adaptive rate control scheme for the frame layer |
JP2002112183A (en) | 2000-09-27 | 2002-04-12 | Victor Co Of Japan Ltd | Mpeg image data recording method |
US6381254B1 (en) * | 1996-11-08 | 2002-04-30 | Matsushita Electric Industrial Co., Ltd. | Moving image encoding device/method, moving image multiplexing device/method, and image transmission device |
US6389072B1 (en) * | 1998-12-23 | 2002-05-14 | U.S. Philips Corp. | Motion analysis based buffer regulation scheme |
US6397251B1 (en) * | 1997-09-02 | 2002-05-28 | International Business Machines Corporation | File server for multimedia file distribution |
US20030053416A1 (en) | 2001-09-19 | 2003-03-20 | Microsoft Corporation | Generalized reference decoder for image or video processing |
JP2003092752A (en) | 2001-09-19 | 2003-03-28 | Mitsubishi Electric Corp | Multiplexer, multiplexing method, image decoder and image decoding method |
US6542549B1 (en) * | 1998-10-13 | 2003-04-01 | Matsushita Electric Industrial Co., Ltd. | Method and model for regulating the computational and memory requirements of a compressed bitstream in a video decoder |
US6587506B1 (en) * | 1999-11-02 | 2003-07-01 | Matsushita Electric Industrial Co., Ltd. | Video editing apparatus, video editing method, and data storage medium for a video editing program |
US6637031B1 (en) | 1998-12-04 | 2003-10-21 | Microsoft Corporation | Multimedia presentation latency minimization |
US6907481B2 (en) * | 2001-03-06 | 2005-06-14 | Ati Technologies, Inc. | System for bit-rate controlled digital stream playback and method thereof |
US6909743B1 (en) * | 1999-04-14 | 2005-06-21 | Sarnoff Corporation | Method for generating and processing transition streams |
US6912251B1 (en) * | 1998-09-25 | 2005-06-28 | Sarnoff Corporation | Frame-accurate seamless splicing of information streams |
US7088771B2 (en) * | 1999-04-06 | 2006-08-08 | Broadcom Corporation | Video encoding and video/audio/data multiplexing device |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6023296A (en) * | 1997-07-10 | 2000-02-08 | Sarnoff Corporation | Apparatus and method for object based rate control in a coding system |
US6301428B1 (en) * | 1997-12-09 | 2001-10-09 | Lsi Logic Corporation | Compressed video editor with transition buffer matcher |
US6269120B1 (en) * | 1998-03-23 | 2001-07-31 | International Business Machines Corporation | Method of precise buffer management for MPEG video splicing |
US6289129B1 (en) * | 1998-06-19 | 2001-09-11 | Motorola, Inc. | Video rate buffer for use with push dataflow |
JP2004511976A (en) * | 2000-10-10 | 2004-04-15 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Video bit rate control method and apparatus for digital video recording |
US6763067B2 (en) * | 2000-10-10 | 2004-07-13 | Sarnoff Corporation | Rate control for bitstream re-encoding |
KR100468726B1 (en) * | 2002-04-18 | 2005-01-29 | 삼성전자주식회사 | Apparatus and method for performing variable bit rate control in real time |
WO2004006446A2 (en) * | 2002-07-02 | 2004-01-15 | Conexant Systems, Inc. | Hypothetical reference decoder for compressed image and video |
US7266147B2 (en) * | 2003-03-31 | 2007-09-04 | Sharp Laboratories Of America, Inc. | Hypothetical reference decoder |
US7380028B2 (en) * | 2003-06-13 | 2008-05-27 | Microsoft Corporation | Robust delivery of video data |
US8345754B2 (en) * | 2003-09-07 | 2013-01-01 | Microsoft Corporation | Signaling buffer fullness |
US7535959B2 (en) * | 2003-10-16 | 2009-05-19 | Nvidia Corporation | Apparatus, system, and method for video encoder rate control |
US9654533B2 (en) * | 2013-01-17 | 2017-05-16 | Electronics And Telecommunications Research Institute | Method of adaptively delivering media based on reception status information from media client and apparatus using the same |
-
2003
- 2003-03-31 US US10/404,947 patent/US7266147B2/en not_active Ceased
-
2004
- 2004-03-26 DE DE602004012540T patent/DE602004012540T2/en not_active Expired - Lifetime
- 2004-03-26 CN CN2004800075271A patent/CN1826812B/en not_active Expired - Lifetime
- 2004-03-26 EP EP10162205A patent/EP2209319B1/en not_active Expired - Lifetime
- 2004-03-26 CN CN201010199014.2A patent/CN101854553B/en not_active Expired - Lifetime
- 2004-03-26 WO PCT/JP2004/004374 patent/WO2004088988A1/en active IP Right Grant
- 2004-03-26 ES ES10162205T patent/ES2390596T3/en not_active Expired - Lifetime
- 2004-03-26 AT AT04723847T patent/ATE390019T1/en not_active IP Right Cessation
- 2004-03-26 JP JP2005518546A patent/JP2006519517A/en active Pending
- 2004-03-26 PT PT04723847T patent/PT1611747E/en unknown
- 2004-03-26 ES ES07000483T patent/ES2348075T3/en not_active Expired - Lifetime
- 2004-03-26 PL PL10162205T patent/PL2209319T3/en unknown
- 2004-03-26 DE DE602004027847T patent/DE602004027847D1/en not_active Expired - Lifetime
- 2004-03-26 AT AT07000483T patent/ATE472228T1/en not_active IP Right Cessation
- 2004-03-26 PT PT07000483T patent/PT1791369E/en unknown
- 2004-03-26 EP EP04723847A patent/EP1611747B1/en not_active Expired - Lifetime
- 2004-03-26 PT PT10162205T patent/PT2209319E/en unknown
- 2004-03-26 EP EP07000483A patent/EP1791369B1/en not_active Expired - Lifetime
- 2004-03-26 CN CN201010198922.XA patent/CN101854552B/en not_active Expired - Lifetime
- 2004-03-26 ES ES04723847T patent/ES2300757T3/en not_active Expired - Lifetime
-
2007
- 2007-03-07 JP JP2007057153A patent/JP5025289B2/en not_active Expired - Lifetime
-
2009
- 2009-09-03 US US12/553,836 patent/USRE43062E1/en active Active
-
2010
- 2010-03-11 JP JP2010053952A patent/JP5444047B2/en not_active Expired - Lifetime
- 2010-12-17 HK HK10111836.3A patent/HK1145413A1/en not_active IP Right Cessation
-
2011
- 2011-02-10 HK HK11101310.8A patent/HK1147374A1/en not_active IP Right Cessation
- 2011-10-28 US US13/284,683 patent/USRE45983E1/en active Active
-
2012
- 2012-02-09 JP JP2012025690A patent/JP5536811B2/en not_active Expired - Lifetime
-
2015
- 2015-12-15 US US14/970,087 patent/USRE48953E1/en active Active
Patent Citations (42)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH02272851A (en) | 1989-04-14 | 1990-11-07 | Oki Electric Ind Co Ltd | Assembly system and disassembly system of picture packet |
US5159447A (en) * | 1991-05-23 | 1992-10-27 | At&T Bell Laboratories | Buffer control for variable bit-rate channel |
US5287182A (en) * | 1992-07-02 | 1994-02-15 | At&T Bell Laboratories | Timing recovery for variable bit-rate video on asynchronous transfer mode (ATM) networks |
US5365552A (en) | 1992-11-16 | 1994-11-15 | Intel Corporation | Buffer fullness indicator |
US5481543A (en) | 1993-03-16 | 1996-01-02 | Sony Corporation | Rational input buffer arrangements for auxiliary information in video and audio signal processing systems |
JPH07107429A (en) | 1993-10-05 | 1995-04-21 | Matsushita Electric Ind Co Ltd | Picture signal recorder and reproducing device therefor |
US5398072A (en) | 1993-10-25 | 1995-03-14 | Lsi Logic Corporation | Management of channel buffer in video decoders |
US6055270A (en) * | 1994-04-20 | 2000-04-25 | Thomson Cosumer Electronics, Inc. | Multiplexer system using constant bit rate encoders |
US5668841A (en) * | 1994-05-27 | 1997-09-16 | Lucent Technologies Inc. | Timing recovery for variable bit-rate video on asynchronous transfer mode (ATM) networks |
US5534944A (en) | 1994-07-15 | 1996-07-09 | Matsushita Electric Corporation Of America | Method of splicing MPEG encoded video |
US5663962A (en) * | 1994-09-29 | 1997-09-02 | Cselt- Centro Studi E Laboratori Telecomunicazioni S.P.A. | Method of multiplexing streams of audio-visual signals coded according to standard MPEG1 |
US5831688A (en) * | 1994-10-31 | 1998-11-03 | Mitsubishi Denki Kabushiki Kaisha | Image coded data re-encoding apparatus |
US5629736A (en) | 1994-11-01 | 1997-05-13 | Lucent Technologies Inc. | Coded domain picture composition for multimedia communications systems |
US5565924A (en) * | 1995-01-19 | 1996-10-15 | Lucent Technologies Inc. | Encoder/decoder buffer control for variable bit-rate channel |
US5543853A (en) * | 1995-01-19 | 1996-08-06 | At&T Corp. | Encoder/decoder buffer control for variable bit-rate channel |
US5652749A (en) | 1995-02-03 | 1997-07-29 | International Business Machines Corporation | Apparatus and method for segmentation and time synchronization of the transmission of a multiple program multimedia data stream |
US5537408A (en) | 1995-02-03 | 1996-07-16 | International Business Machines Corporation | apparatus and method for segmentation and time synchronization of the transmission of multimedia data |
US5619341A (en) * | 1995-02-23 | 1997-04-08 | Motorola, Inc. | Method and apparatus for preventing overflow and underflow of an encoder buffer in a video compression system |
US5877812A (en) | 1995-11-21 | 1999-03-02 | Imedia Corporation | Method and apparatus for increasing channel utilization for digital video transmission |
US5995151A (en) * | 1995-12-04 | 1999-11-30 | Tektronix, Inc. | Bit rate control mechanism for digital image and video data compression |
US6085221A (en) * | 1996-01-08 | 2000-07-04 | International Business Machines Corporation | File server for multimedia file distribution |
US6381254B1 (en) * | 1996-11-08 | 2002-04-30 | Matsushita Electric Industrial Co., Ltd. | Moving image encoding device/method, moving image multiplexing device/method, and image transmission device |
US5982436A (en) * | 1997-03-28 | 1999-11-09 | Philips Electronics North America Corp. | Method for seamless splicing in a video encoder |
US6188703B1 (en) * | 1997-08-01 | 2001-02-13 | International Business Machines Corp. | Multiplexer for multiple media streams |
US6397251B1 (en) * | 1997-09-02 | 2002-05-28 | International Business Machines Corporation | File server for multimedia file distribution |
US6366704B1 (en) * | 1997-12-01 | 2002-04-02 | Sharp Laboratories Of America, Inc. | Method and apparatus for a delay-adaptive rate control scheme for the frame layer |
EP0930786A2 (en) | 1998-01-19 | 1999-07-21 | Sony Corporation | Compressed picture data editing apparatus and method |
US6912251B1 (en) * | 1998-09-25 | 2005-06-28 | Sarnoff Corporation | Frame-accurate seamless splicing of information streams |
US6542549B1 (en) * | 1998-10-13 | 2003-04-01 | Matsushita Electric Industrial Co., Ltd. | Method and model for regulating the computational and memory requirements of a compressed bitstream in a video decoder |
JP2000124958A (en) | 1998-10-20 | 2000-04-28 | Mitsubishi Electric Corp | Encoded data switching device |
US6272566B1 (en) | 1998-11-18 | 2001-08-07 | International Business Machines Corporation | System for maintaining proper buffering within video play list |
US6637031B1 (en) | 1998-12-04 | 2003-10-21 | Microsoft Corporation | Multimedia presentation latency minimization |
US6389072B1 (en) * | 1998-12-23 | 2002-05-14 | U.S. Philips Corp. | Motion analysis based buffer regulation scheme |
US7088771B2 (en) * | 1999-04-06 | 2006-08-08 | Broadcom Corporation | Video encoding and video/audio/data multiplexing device |
US6909743B1 (en) * | 1999-04-14 | 2005-06-21 | Sarnoff Corporation | Method for generating and processing transition streams |
US6587506B1 (en) * | 1999-11-02 | 2003-07-01 | Matsushita Electric Industrial Co., Ltd. | Video editing apparatus, video editing method, and data storage medium for a video editing program |
JP2002112183A (en) | 2000-09-27 | 2002-04-12 | Victor Co Of Japan Ltd | Mpeg image data recording method |
US20020037161A1 (en) | 2000-09-27 | 2002-03-28 | Takayuki Sugahara | MPEG picture data recording apparatus, MPEG picture data recording method, MPEG picture data recording medium, MPEG picture data generating apparatus, MPEG picture data reproducing apparatus, and MPEG picture data reproducing method |
US6907481B2 (en) * | 2001-03-06 | 2005-06-14 | Ati Technologies, Inc. | System for bit-rate controlled digital stream playback and method thereof |
JP2003092752A (en) | 2001-09-19 | 2003-03-28 | Mitsubishi Electric Corp | Multiplexer, multiplexing method, image decoder and image decoding method |
US20030053416A1 (en) | 2001-09-19 | 2003-03-20 | Microsoft Corporation | Generalized reference decoder for image or video processing |
US7646816B2 (en) * | 2001-09-19 | 2010-01-12 | Microsoft Corporation | Generalized reference decoder for image or video processing |
Non-Patent Citations (17)
Title |
---|
"Annex C-Video Buffering Verifier, Information Technology-Generic coding of moving pictures and associated audio information: Video," ITU-T Recommendation H.262, Feb. 2000, pp. 1, 138-142, XP 002 248 658. |
"Working Draft No. 2, Revision 3 (WD-2r3)," Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, Gary Sullivan, One Microsoft Way, Redmond, WA 98052 USA, Mar. 26, 2002, Dovument JVT-B118r3, 99 pages. |
Annex B-"Hypothetical Reference Decoder, Video Coding for Low Bit Rate Communication," ITU-T Recommendation H.263, Feb. 1998, pp. 1, 49-50, XP 002 248 657. |
Annex C, "Hypothetical Reference Decoder," Draft ISO/IEC 14496-10:2002(E), Draft ITU-T Rec. H.2649, (2002)E, pp. 160-188. |
Annex C, "Video Buffering Verifier," H.262/MPEG-2, ITU-T Rec. H.262 (1995E), pp. 143-147. |
Annex D, "Features Supported by the Algorithm," ITU-T Rec. H.262 (1995 E), pp. 148-150. |
Hannuksela, M., "Simple Definition of GOP for Random Access," Nokia Corporation, JVT-B041, Jan. 23, 2002, pp. 1-6. |
Hannuksela, Miska M., et al., Random Access and Time Information; JVT-B109, Mar. 2002, pp. 1-6. |
Hiroshi, Fujiwara, "Point Illustrated Newest MPEG Textbook," ASCII Corporation, Aug. 1, 1994, p. 113-114. |
Jordi Ribas-Corbera, Philip A. Chou, and Shankar Regunathan, "A Flexible Decoder Buffer Model for JVT Video Coding," International Conference on Image Processing ICIP 2002, vol. 2, Sep. 22, 2002, pp. II-493-II-496. |
Ribas-Corbera et al., "A Flexible Decoder Buffer Model for JVT Video Coding,". |
Ribas-Corbera et al., "A Generalized Hypothetical Reference Decoder for H.26L," ITU Telecommunications Standardization Sector, Sep. 24-27, 2001. |
Ribas-Corbera, Jordi, "A Generalized Hypothetical Reference Decoder for H.264/AVC," IEEE Transactions on Circuits and Systems for Video Technology, IEEE Service Center, Piscataway, NJ, US, vol. 13, No. 7 Jul. 2003, pp. 674-687, XP 001 051 195. |
Shankar L. Regunathan, Phil A. Chou, Jordi Ribas-Corbera; Video Complexity Verifier for HRD; Microsoft, JVT-BO50, Jan. 18, 2002, pp. 1-19. |
Sullivan, Gary, "On Random Access and Bitstream Format for JVT Video," Microsoft Corporation, JVT-B063R1, pp. 1-16. |
Sullivan, Gary, "Working Draft No. 2, Revision 3 (WD-2r3)," Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, Mar. 2002, Document JVT-B118r3. |
Viscito, Eric, "H.26L Buffering Ad-Hoc Group Report," Globespan Virata, ITU Sector Member, JVT-B013, Jan. 23, 2002, pp. 1-3. |
Cited By (51)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10609406B2 (en) | 2011-04-12 | 2020-03-31 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US9872036B2 (en) | 2011-04-12 | 2018-01-16 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US11917186B2 (en) | 2011-04-12 | 2024-02-27 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US11356694B2 (en) | 2011-04-12 | 2022-06-07 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US10178404B2 (en) | 2011-04-12 | 2019-01-08 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US11012705B2 (en) | 2011-04-12 | 2021-05-18 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US9445120B2 (en) | 2011-04-12 | 2016-09-13 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US10536712B2 (en) | 2011-04-12 | 2020-01-14 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US10382774B2 (en) | 2011-04-12 | 2019-08-13 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus |
US10129564B2 (en) | 2011-05-24 | 2018-11-13 | Velos Media, LCC | Decoding method and apparatuses with candidate motion vectors |
US10484708B2 (en) | 2011-05-24 | 2019-11-19 | Velos Media, Llc | Decoding method and apparatuses with candidate motion vectors |
US9826249B2 (en) | 2011-05-24 | 2017-11-21 | Velos Media, Llc | Decoding method and apparatuses with candidate motion vectors |
US9456217B2 (en) | 2011-05-24 | 2016-09-27 | Sun Patent Trust | Coding method and apparatus with candidate motion vectors |
US11228784B2 (en) | 2011-05-24 | 2022-01-18 | Velos Media, Llc | Decoding method and apparatuses with candidate motion vectors |
US9883199B2 (en) | 2011-05-27 | 2018-01-30 | Sun Patent Trust | Coding method and apparatus with candidate motion vectors |
US10721474B2 (en) | 2011-05-27 | 2020-07-21 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US11979582B2 (en) | 2011-05-27 | 2024-05-07 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US11895324B2 (en) | 2011-05-27 | 2024-02-06 | Sun Patent Trust | Coding method and apparatus with candidate motion vectors |
US10200714B2 (en) | 2011-05-27 | 2019-02-05 | Sun Patent Trust | Decoding method and apparatus with candidate motion vectors |
US10212450B2 (en) | 2011-05-27 | 2019-02-19 | Sun Patent Trust | Coding method and apparatus with candidate motion vectors |
US11575930B2 (en) | 2011-05-27 | 2023-02-07 | Sun Patent Trust | Coding method and apparatus with candidate motion vectors |
US9838695B2 (en) | 2011-05-27 | 2017-12-05 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US11570444B2 (en) | 2011-05-27 | 2023-01-31 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US9485518B2 (en) | 2011-05-27 | 2016-11-01 | Sun Patent Trust | Decoding method and apparatus with candidate motion vectors |
US10034001B2 (en) | 2011-05-27 | 2018-07-24 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US9723322B2 (en) | 2011-05-27 | 2017-08-01 | Sun Patent Trust | Decoding method and apparatus with candidate motion vectors |
US10595023B2 (en) | 2011-05-27 | 2020-03-17 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US9615107B2 (en) | 2011-05-27 | 2017-04-04 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US11115664B2 (en) | 2011-05-27 | 2021-09-07 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US11076170B2 (en) | 2011-05-27 | 2021-07-27 | Sun Patent Trust | Coding method and apparatus with candidate motion vectors |
US10708598B2 (en) | 2011-05-27 | 2020-07-07 | Sun Patent Trust | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus |
US9819961B2 (en) | 2011-05-31 | 2017-11-14 | Sun Patent Trust | Decoding method and apparatuses with candidate motion vectors |
US11509928B2 (en) | 2011-05-31 | 2022-11-22 | Sun Patent Trust | Derivation method and apparatuses with candidate motion vectors |
US9609356B2 (en) | 2011-05-31 | 2017-03-28 | Sun Patent Trust | Moving picture coding method and apparatus with candidate motion vectors |
US11057639B2 (en) | 2011-05-31 | 2021-07-06 | Sun Patent Trust | Derivation method and apparatuses with candidate motion vectors |
US10652573B2 (en) | 2011-05-31 | 2020-05-12 | Sun Patent Trust | Video encoding method, video encoding device, video decoding method, video decoding device, and video encoding/decoding device |
US10645413B2 (en) | 2011-05-31 | 2020-05-05 | Sun Patent Trust | Derivation method and apparatuses with candidate motion vectors |
US11917192B2 (en) | 2011-05-31 | 2024-02-27 | Sun Patent Trust | Derivation method and apparatuses with candidate motion vectors |
US9560373B2 (en) | 2011-05-31 | 2017-01-31 | Sun Patent Trust | Image coding method and apparatus with candidate motion vectors |
US9900613B2 (en) | 2011-05-31 | 2018-02-20 | Sun Patent Trust | Image coding and decoding system using candidate motion vectors |
US10412404B2 (en) | 2011-05-31 | 2019-09-10 | Velos Media, Llc | Image decoding method and image decoding apparatus using candidate motion vectors |
US10887585B2 (en) | 2011-06-30 | 2021-01-05 | Sun Patent Trust | Image decoding method, image coding method, image decoding apparatus, image coding apparatus, and image coding and decoding apparatus |
US11553202B2 (en) | 2011-08-03 | 2023-01-10 | Sun Patent Trust | Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus |
US10284872B2 (en) | 2011-08-03 | 2019-05-07 | Sun Patent Trust | Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus |
US10440387B2 (en) | 2011-08-03 | 2019-10-08 | Sun Patent Trust | Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus |
US9456214B2 (en) | 2011-08-03 | 2016-09-27 | Sun Patent Trust | Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus, and moving picture coding and decoding apparatus |
US11979598B2 (en) | 2011-08-03 | 2024-05-07 | Sun Patent Trust | Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus |
US10129561B2 (en) | 2011-08-03 | 2018-11-13 | Sun Patent Trust | Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus |
US11647208B2 (en) | 2011-10-19 | 2023-05-09 | Sun Patent Trust | Picture coding method, picture coding apparatus, picture decoding method, and picture decoding apparatus |
US11218708B2 (en) | 2011-10-19 | 2022-01-04 | Sun Patent Trust | Picture decoding method for decoding using a merging candidate selected from a first merging candidate derived using a first derivation process and a second merging candidate derived using a second derivation process |
US12120324B2 (en) | 2011-10-19 | 2024-10-15 | Sun Patent Trust | Picture coding method, picture coding apparatus, picture decoding method, and picture decoding apparatus |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
USRE48953E1 (en) | Hypothetical reference decoder | |
EP1753248B1 (en) | Generating and providing parameters for video generalized reference decoder | |
US7760801B2 (en) | Transmission of video | |
US6327421B1 (en) | Multiple speed fast forward/rewind compressed video delivery system | |
JP2001502125A (en) | Improvements in or related to data transmission |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: DOLBY LABORATORIES LICENSING CORPORATION, CALIFORN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SHARP KABUSHIKI KAISHA;REEL/FRAME:036724/0111 Effective date: 20150929 |
|
AS | Assignment |
Owner name: SHARP KABUSHIKI KAISHA, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SHARP LABORATORIES OF AMERICA, INC.;REEL/FRAME:038182/0473 Effective date: 20080428 Owner name: SHARP LABORAORIES OF AMERICA, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DESHPANDE, SACHIN G.;REEL/FRAME:038182/0361 Effective date: 20030328 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |