WO2004064255A2 - Mixed inter/intra video coding of macroblock partitions - Google Patents

Mixed inter/intra video coding of macroblock partitions Download PDF

Info

Publication number
WO2004064255A2
WO2004064255A2 PCT/US2004/000074 US2004000074W WO2004064255A2 WO 2004064255 A2 WO2004064255 A2 WO 2004064255A2 US 2004000074 W US2004000074 W US 2004000074W WO 2004064255 A2 WO2004064255 A2 WO 2004064255A2
Authority
WO
WIPO (PCT)
Prior art keywords
reference picture
intra
coding
macroblock
inter
Prior art date
Application number
PCT/US2004/000074
Other languages
French (fr)
Other versions
WO2004064255A3 (en
Inventor
Jill Macdonald Boyce
Original Assignee
Thomson Licensing S.A.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing S.A. filed Critical Thomson Licensing S.A.
Priority to CN2004800018531A priority Critical patent/CN1723706B/en
Priority to BR0406625-1A priority patent/BRPI0406625A/en
Priority to EP04700324.9A priority patent/EP1582063B1/en
Priority to JP2006500779A priority patent/JP2006517364A/en
Priority to MXPA05007384A priority patent/MXPA05007384A/en
Priority to US10/541,603 priority patent/US7466774B2/en
Publication of WO2004064255A2 publication Critical patent/WO2004064255A2/en
Publication of WO2004064255A3 publication Critical patent/WO2004064255A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/57Motion estimation characterised by a search window with variable size or shape
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/107Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/109Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/11Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/147Data rate or code amount at the encoder output according to rate distortion criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/15Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the present invention is directed towards video encoders, and more particularly, towards an apparatus and method for encoding mixed interblock and intrablock video.
  • Video data is generally processed and transferred in the form of bit streams.
  • Typical video compression encoders gain much of their compression efficiency by forming a reference picture prediction of a picture or macroblock to be encoded, and encoding the difference between the current picture and the prediction. The more closely that the prediction is correlated with the current picture, the fewer the number of bits that are needed to compress that picture, thereby increasing the efficiency of the process. Thus, it is desirable for the best possible reference picture prediction to be formed.
  • Interblock and intrablock (“intra”) coding are commonly used in video compression standards.
  • an encoder makes an inter/intra coding decision for each macroblock based on coding efficiency and subjective quality considerations.
  • each individual macroblock was either coded as Intra, i.e., using only spatial correlation, or coded as Inter, i.e., using temporal correlation from previously coded frames.
  • Inter coding is typically used for macroblocks that are well predicted from previous frames, and intra coding is generally used for macroblocks that are not well predicted from previous frames, or for macroblocks with low spatial activity.
  • the JVT video compression standard which is also known as H.264 and MPEG AVC, uses tree-structured hierarchical macroblock partitions. Inter-coded 16x16 pixel macroblocks may be broken into macroblock partitions, of sizes 16x8, 8x16, or 8x8. 8x8 macroblock partitions are also known as sub-macroblocks. Sub- macroblocks may also be broken into sub-macroblock partitions, of sizes 8x4, 4x8, and 4x4. An encoder may select how to divide the macroblock into partitions and sub-macroblock partitions based on the characteristics of a particular macroblock in order to maximize compression efficiency and subjective quality.
  • Multiple reference pictures may be used for Inter prediction, with a reference picture index coded to indicate which of the multiple reference pictures is used.
  • P pictures or P slices
  • only single directional prediction is used, and the allowable reference pictures are managed in list 0.
  • B pictures or B slices
  • two lists of reference pictures are managed, list 0 and list 1.
  • B pictures or B slices
  • single directional prediction using either list 0 or list 1 is allowed, or bi-prediction using both list 0 and list 1 is allowed.
  • the list 0 and the list 1 predictors are averaged together to form a final predictor.
  • Each macroblock partition may have independent reference picture indices, prediction type (e.g., list 0, list 1 , bi-prediction), and an independent motion vector.
  • prediction type e.g., list 0, list 1 , bi-prediction
  • Each sub-macroblock partition may have independent motion vectors, but all sub- macroblock partitions in the same sub-macroblock use the same reference picture index and prediction type.
  • intra prediction could be used for some of the partitions of an inter-coded macroblock. Because of complexity concerns, ultimately this flexibility was disallowed, and intra-coding mode is not allowed for individual macroblock partitions under the current standards. Some of the increased complexity in supporting both inter and intra coded partitions inside the same macroblock is due to the intra spatial directional prediction used in the JVT standard. Disallowing mixed inter/intra coding inside the same macroblock can hurt coding efficiency and especially subjective quality. For some blocks in an image, intra coding is more efficient than intra coding.
  • the weighted predictor is formed as:
  • SampleP Clipl ((SamplePO-Wo + SamplePl-W, + 2 LWD ) » (LWD+1) + (O 0 + O + 1)»1) ;
  • W 0 and Oo are the list 0 reference picture weighting factor and offset, respectively, and Wi and O ⁇ are the list 1 reference picture weighting factor and offset, and LWD is the log weight denominator-rounding factor.
  • SamplePo and SamplePi are the list 0 and list 1 initial predictors, and SampleP is the weighted predictor. Weighting factors and offsets are optionally coded in the slice header and are associated with particular reference picture indices.
  • the relevant syntax elements in the JVT standard are: luma_log_weight_denom, chromaJog_weight_denom, Iuma_weightj0, chroma_weight_IO, luma_offset_IO, chroma_offset_IO, Iuma_weight_l1 , chroma_weight_l1 , luma_offset_H , and chroma_offset_l1.
  • more than one reference picture index can be associated with a particular reference picture store by using reference picture reordering, which allows more than one weighting factor to be used while predicting from the same reference picture store.
  • JVT Joint Video Team
  • a video encoder and corresponding method are provided for mixed inter/intra encoding of a macroblock having a plurality of partitions, where the encoder includes a reference picture weighting applicator coupled with a reference picture weighting factor unit for assigning weighting factors corresponding to each of the inter and intra coded partitions, respectively; and the corresponding method for encoding a macroblock with several partitions includes inter-coding at least one partition and intra-coding at least a second partition.
  • Exemplary embodiments of the present invention are capable of providing mixed inter/intra coding in compliance with the JVT compression standard through the use of weighted prediction.
  • mixed inter/intra coding of partitions within the same macroblock is allowed, which can improve coding efficiency as well as subjective video quality.
  • Figure 1 shows a block diagram for a standard video encoder
  • Figure 2 shows a block diagram for a video encoder with reference picture weighting
  • Figure 3 shows a block diagram for a video encoder with integrated motion estimation and weighting prediction
  • Figure 4 shows a flow diagram for a method of encoding macroblocks in accordance with the principles of the present invention.
  • JVT Joint Video Team
  • JVT Joint Video Team
  • the Joint Video Team (“JVT”) video compression standard supports division of 16x16 pixel macroblocks into smaller sized macroblock partitions for inter coding, but does not allow inter coding of some partitions of a macroblock and intra coding of other partitions of the same macroblock.
  • mixed inter/intra coding can be accomplished using the JVT compression standard, using weighted prediction.
  • processor or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage.
  • DSP digital signal processor
  • ROM read-only memory
  • RAM random access memory
  • any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
  • any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function.
  • the invention as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. Applicant thus regards any means that can provide those functionalities as equivalent to those shown herein.
  • a standard video encoder is indicated generally by the reference numeral 100.
  • An input to the encoder 100 is connected in signal communication with a non-inverting input of a summing junction 110.
  • the output of the summing junction 110 is connected in signal communication with a block transform function 120.
  • the transformer 120 is connected in signal communication with a quantizer 130.
  • the output of the quantizer 130 is connected in signal communication with a variable length coder (“VLC") 140, where the output of the VLC 140 is an externally available output of the encoder 100.
  • VLC variable length coder
  • the output of the quantizer 130 is further connected in signal communication with an inverse quantizer 150.
  • the inverse quantizer 150 is connected in signal communication with an inverse block transformer 160, which, in turn, is connected in signal communication with a reference picture store 170.
  • a first output of the reference picture store 170 is connected in signal communication with a first input of a motion estimator 180.
  • the input to the encoder 100 is further connected in signal communication with a second input of the motion estimator 180.
  • the output of the motion estimator 180 is connected in signal communication with a first input of a motion compensator 190.
  • a second output of the reference picture store 170 is connected in signal communication with a second input of the motion compensator 190.
  • the output of the motion compensator 190 is connected in signal communication with an inverting input of the summing junction 110.
  • a video encoder with reference picture weighting is indicated generally by the reference numeral 200.
  • An input to the encoder 200 is connected in signal communication with a non-inverting input of a summing junction 210.
  • the output of the summing junction 210 is connected in signal communication with a block transformer 220.
  • the transformer 220 is connected in signal communication with a quantizer 230.
  • the output of the quantizer 230 is connected in signal communication with a VLC 240, where the output of the VLC 440 is an externally available output of the encoder 200.
  • the output of the quantizer 230 is further connected in signal communication with an inverse quantizer 250.
  • the inverse quantizer 250 is connected in signal communication with an inverse block transformer 260, which, in turn, is connected in signal communication with a reference picture store 270.
  • a first output of the reference picture store 270 is connected in signal communication with a first input of a reference picture weighting factor assignor 272.
  • the input to the encoder 200 is further connected in signal communication with a second input of the reference picture weighting factor assignor 272.
  • the output of the reference picture weighting factor assignor 272, which is indicative of a weighting factor, is connected in signal communication with a first input of a motion estimator 280.
  • a second output of the reference picture store 270 is connected in signal communication with a second input of the motion estimator 280.
  • the input to the encoder 200 is further connected in signal communication with a third input of the motion estimator 280.
  • the output of the motion estimator 280 which is indicative of motion vectors, is connected in signal communication with a first input of a motion compensator 290.
  • a third output of the reference picture store 270 is connected in signal communication with a second input of the motion compensator 290.
  • the output of the motion compensator 290 which is indicative of a motion compensated reference picture, is connected in signal communication with a first input of a multiplier 292.
  • the output of the reference picture weighting factor assignor 272, which is indicative of a weighting factor, is connected in signal communication with a second input of the multiplier 292.
  • the output of the multiplier 292 is connected in signal communication with an inverting input of the summing junction 210.
  • a video encoder with integrated motion estimation and weighting prediction is indicated generally by the reference numeral 300.
  • An input to the encoder 300 is connected in signal communication with a non-inverting input of a summing junction 310.
  • the output of the summing junction 310 is connected in signal communication with a block transformer 320.
  • the transformer 320 is connected in signal communication with a quantizer 330.
  • the output of the quantizer 330 is connected in signal communication with a VLC 340, where the output of the VLC 340 is an externally available output of the encoder 300.
  • the output of the quantizer 330 is further connected in signal communication with an inverse quantizer 350.
  • the inverse quantizer 350 is connected in signal communication with an inverse block transformer 360, which, in turn, is connected in signal communication with a reference picture store 370.
  • a first output of the reference picture store 370 is connected in signal communication with a first input of a reference picture weighting factor selector 372.
  • the input to the encoder 300 is further connected in signal communication with a second input of the reference picture weighting factor selector 372 to provide the current picture to the selector.
  • the output of the reference picture weighting factor selector 372, which is indicative of a weighting factor, is connected in signal communication with a first input of a multiplier 374.
  • a second input of the multiplier 374 is connected in signal communication with the reference picture output of the reference picture store 370. It should be noted that although shown simply as a multiplier 374, other types of weighting factor applicators may be constructed other than a multiplier, as would be apparent to those of ordinary skill in the art.
  • the output of the multiplier 374 is connected in signal communication with a weighted reference picture store 376.
  • the output of the weighted reference picture store 376 is connected in signal communication with a first input of a motion estimator 380 for providing a weighted reference picture.
  • the output of the motion estimator 380 is connected in signal communication with a first motion compensator 382 for providing motion vectors.
  • the output of. the motion estimator 380 is further connected in signal communication with a first input of a second motion compensator 390.
  • a second output of the weighted reference picture store 376 is connected in signal communication with a second input of the first motion compensator 382.
  • the output of the first motion compensator 382, which is indicative of a weighted motion compensated reference picture, is connected in signal communication with a first input of an absolute difference generator 384.
  • the input to the encoder 300, which is the current picture, is further connected in signal communication with a second input of the absolute difference generator 384.
  • the output of the absolute difference function 384 is connected in signal communication with a third input of the reference picture weighting factor selector 372.
  • a third output of the reference picture store 370 is connected in signal communication with a second input of the second motion compensator 390.
  • the output of the second motion compensator 390 which is indicative of a motion compensated reference picture, is connected in signal communication with a first input of a multiplier 392.
  • the output of the multiplier 392 is connected in signal communication with an inverting input of the summing junction 310.
  • a flow diagram for a method of encoding macroblocks is indicated generally by the reference numeral 400.
  • a begin block 410 passes control to a function block 412, which finds the best Inter macroblock division, calculates the cost for each partition, CPINTER; and calculates the cost for the entire macroblock, CINTER.
  • the block 412 passes control to a function block 414, which finds the best Intra prediction direction and calculates the cost for the entire macroblock, CINTRA.
  • the block 414 passes control to a decision block 416, which determines whether CINTER is less than CINTRA.
  • control passes to a function block 418 that Intra codes the entire macroblock, and then passes control to an end block 434. If, on the other hand, CINTER is less than CINTRA, control passes to a function block 420, which uses Inter coding for the macroblock and selects the first (/ 0) partition of the macroblock. The block 420 passes control to a function block 422, which calculates the cost for the current partition, CPINTRA / , which is coded as Intra using a zero weighting factor. The block 422, in turn, passes control to a decision block 424, which determines whether CPINTER,- is less than CPINTRA / .
  • the decision block 430 determines whether the current partition / is the last partition in the macroblock. If the current partition / is not the last partition in the macroblock, control passes to a function block 432, which increments the current partition /, and passes control back to the function block 422. If, on the other hand, the current partition / is the last partition in the macroblock, then control passes to the end block 434.
  • mixed inter/intra coding of partitions of the same macroblock can be accomplished using the JVT compression standard. Intra coding of a macroblock partition is accomplished by using a weighting factor of zero with the weighted prediction tool in the Main and Extended profiles of the JVT standard.
  • This type of intra coding is referred to as non-predictive intra coding, to differentiate it from the spatial directional intra coding used when entire macroblocks are intra coded.
  • a macroblock containing some non-predictive intra coded partitions is still considered to be an inter coded macroblock.
  • a weighting factor of zero is coded in the slice header, associated with a particular reference picture index.
  • the encoder may associate multiple reference picture indices with a particular reference picture store, using reference picture reordering, in order to allow both a zero and a non-zero weighting factor to be associated with a particular reference picture store. Or the encoder may choose to use the default reference picture ordering, without using reference picture reordering, and to associate only a zero weighting factor with a particular reference picture store.
  • a long-term reference picture can be associated with a zero weighting factor for this purpose.
  • the weighted prediction formula for calculating the inter prediction For the single directional prediction case, with a weighting factor of zero, the weighted prediction formula for calculating the inter prediction:
  • SampleP C lip 1 (((SampleP 0 • W 0 + 2 WD ⁇ l ) » LWD) + O 0 )
  • the offset value Oo may be set to be equal to zero, or to 128, or to any other desired value.
  • MPEG-1 and MPEG-2 effectively use an offset of 128 for intra coding.
  • the macroblock partition With a sample prediction of zero or of Oo for all pixels of a macroblock partition, the macroblock partition is effectively intra coded, but spatial directional prediction is not performed.
  • the partition is referred to as being non-predictive intra coded.
  • non-predictive intra coding for a macroblock partition can be accomplished either by selecting only List 0 or List 1 prediction and the reference picture index which was associated with a zero weighting factor.
  • bi-prediction could be used, with a zero weighting factor sent in the slice header for a particular index for list 0 and for another index for list 1
  • non- predictive intra coding could be accomplished for that macroblock partition by coding using bi-prediction with the appropriate zero weighting factor associated reference picture indices for list 0 and list 1.
  • a JVT video encoder encodes the macroblocks of a picture.
  • the encoder determines whether is it is more advantageous for each macroblock partition to be coded as non-predictive intra or as inter (e.g., list 0, list 1 , direct, or bi-predictive).
  • an inter coding mode e.g., list 0, list 1 , direct, or bi- predictive
  • mb_type for that partition, with reference picture indices used that are associated with a zero weighting factor.
  • Non-predictive intra coded partitions are not further divided in sub-macroblock partitions, as is generally allowed for 8x8 sub-macroblock partitions, as additional bits would be required to indicate the division into sub-macroblock partitions, with no benefit.
  • the differential motion vector for the non-predictive intra coded partition is set to zero, because that will use the fewest number of bits to code, and all possible values of the motion vector will yield the same decoded pixels.
  • intra coding is effectively accomplished for some but not all of the partitions of a macroblock, which is compatible with the JVT compression standard.
  • No intra spatial directional prediction is performed for non-predictive intra coded partitions.
  • An exemplary method for encoding a macroblock in accordance with the proposed invention is shown in the flowchart 400 described with respect to Figure 4.
  • the best division of the macroblock into macroblock partitions and sub-macroblock partitions for Inter coding of the macroblock is determined using rate-distortion optimization, and a cost measure is calculated for each partition, CPINTER / , and for the entire macroblock, CINTER.
  • the cost for coding the partition includes the cost of coding the reference picture index, the motion vector, and the prediction residual.
  • the best Intra spatial prediction direction for the Intra coding of the macroblock is determined and a cost measure is calculated for Intra coding of the entire macroblock, CINTRA.
  • each partition of the inter macroblock is considered to be coded as inter or non-predictive intra.
  • the cost for intra coding the partition, using zero weighted prediction is computed, CPINTRA / , considering the cost of coding the reference picture index, and the residual, and the zero valued differential motion vector cost.
  • the partition / will be inter coded normally, and may be further divided into sub-macroblock partitions.
  • the partition will be non-predictive intra coded, by selecting the reference picture index associated with a zero weighting factor.
  • the principles of the present invention are implemented as a combination of hardware and software.
  • the software is preferably implemented as an application program tangibly embodied on a program storage unit.
  • the application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
  • the machine is implemented on a computer platform having hardware such as one or more central processing units (“CPU"), a random access memory (“RAM”), and input/output ("I/O") interfaces.
  • CPU central processing units
  • RAM random access memory
  • I/O input/output
  • the computer platform may also include an operating system and microinstruction code.
  • the various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU.
  • various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

A video encoder (200, 300) and corresponding method (400) are provided for mixed inter/intra encoding of a macroblock having a plurality of partitions, where the encoder includes a reference picture weighting applicator (292, 392) coupled with a reference picture weighting factor unit (272, 372) for assigning weighting factors corresponding to each of the inter and intra coded partitions, respectively; and the corresponding method for encoding a macroblock with several partitions includes inter-coding (426) at least one partition and intra-coding (428) at least a second partition.

Description

MIXED INTER/INTRA VIDEO CODING OF MACROBLOCK PARTITIONS
CROSS-REFERENCE TO RELATED APPLICATION
This application claims the benefit of U.S. Provisional Application Serial No. 60/438,427 (Attorney Docket No. PU030010), filed January 7, 2003 and entitled
"MIXED INTER/INTRA VIDEO CODING OF MACROBLOCK PARTITIONS", which is incorporated herein by reference in its entirety.
FIELD OF THE INVENTION The present invention is directed towards video encoders, and more particularly, towards an apparatus and method for encoding mixed interblock and intrablock video.
BACKGROUND OF THE INVENTION Video data is generally processed and transferred in the form of bit streams.
Typical video compression encoders gain much of their compression efficiency by forming a reference picture prediction of a picture or macroblock to be encoded, and encoding the difference between the current picture and the prediction. The more closely that the prediction is correlated with the current picture, the fewer the number of bits that are needed to compress that picture, thereby increasing the efficiency of the process. Thus, it is desirable for the best possible reference picture prediction to be formed.
Interblock ("inter") and intrablock ("intra") coding are commonly used in video compression standards. Generally, an encoder makes an inter/intra coding decision for each macroblock based on coding efficiency and subjective quality considerations. Some partitions (e.g., 16x8, 8x16 or 8x8 sub-blocks) of a 16x16 macroblock, for example, might be more efficiently coded using intra coding while other partitions of the same macroblock might be more efficiently coded using inter coding. Thus, each individual macroblock was either coded as Intra, i.e., using only spatial correlation, or coded as Inter, i.e., using temporal correlation from previously coded frames. Inter coding is typically used for macroblocks that are well predicted from previous frames, and intra coding is generally used for macroblocks that are not well predicted from previous frames, or for macroblocks with low spatial activity. The JVT video compression standard, which is also known as H.264 and MPEG AVC, uses tree-structured hierarchical macroblock partitions. Inter-coded 16x16 pixel macroblocks may be broken into macroblock partitions, of sizes 16x8, 8x16, or 8x8. 8x8 macroblock partitions are also known as sub-macroblocks. Sub- macroblocks may also be broken into sub-macroblock partitions, of sizes 8x4, 4x8, and 4x4. An encoder may select how to divide the macroblock into partitions and sub-macroblock partitions based on the characteristics of a particular macroblock in order to maximize compression efficiency and subjective quality.
Multiple reference pictures may be used for Inter prediction, with a reference picture index coded to indicate which of the multiple reference pictures is used. In P pictures (or P slices), only single directional prediction is used, and the allowable reference pictures are managed in list 0. In B pictures (or B slices), two lists of reference pictures are managed, list 0 and list 1. In B pictures (or B slices), single directional prediction using either list 0 or list 1 is allowed, or bi-prediction using both list 0 and list 1 is allowed. When bi-prediction is used, the list 0 and the list 1 predictors are averaged together to form a final predictor.
Each macroblock partition may have independent reference picture indices, prediction type (e.g., list 0, list 1 , bi-prediction), and an independent motion vector. Each sub-macroblock partition may have independent motion vectors, but all sub- macroblock partitions in the same sub-macroblock use the same reference picture index and prediction type.
It was proposed that intra prediction could be used for some of the partitions of an inter-coded macroblock. Because of complexity concerns, ultimately this flexibility was disallowed, and intra-coding mode is not allowed for individual macroblock partitions under the current standards. Some of the increased complexity in supporting both inter and intra coded partitions inside the same macroblock is due to the intra spatial directional prediction used in the JVT standard. Disallowing mixed inter/intra coding inside the same macroblock can hurt coding efficiency and especially subjective quality. For some blocks in an image, intra coding is more efficient than intra coding. The Main and Extended profiles of the JVT standard provide a tool for weighted prediction. When weighted prediction is in use, a weighting factor and an offset are applied to inter predictions. For single directional prediction, the weighted predictor is formed as: SampleP = Clipl(((SampleP0- 0 + 2 H'D-!) » WD) + O0) ;
and for bi-directional prediction, the weighted predictor is formed as:
SampleP = Clipl ((SamplePO-Wo + SamplePl-W, + 2LWD) » (LWD+1) + (O0 + O + 1)»1) ;
where W0 and Oo are the list 0 reference picture weighting factor and offset, respectively, and Wi and Oι are the list 1 reference picture weighting factor and offset, and LWD is the log weight denominator-rounding factor. SamplePo and SamplePi are the list 0 and list 1 initial predictors, and SampleP is the weighted predictor. Weighting factors and offsets are optionally coded in the slice header and are associated with particular reference picture indices.
The relevant syntax elements in the JVT standard are: luma_log_weight_denom, chromaJog_weight_denom, Iuma_weightj0, chroma_weight_IO, luma_offset_IO, chroma_offset_IO, Iuma_weight_l1 , chroma_weight_l1 , luma_offset_H , and chroma_offset_l1. In addition, more than one reference picture index can be associated with a particular reference picture store by using reference picture reordering, which allows more than one weighting factor to be used while predicting from the same reference picture store.
The Joint Video Team ("JVT") video compression standard explicitly supports 16x16 pixel macroblocks being divided into smaller sized macroblock partitions for inter coding, but does not support inter coding of some partitions of a macroblock and intra coding of other partitions of the same macroblock.
SUMMARY OF THE INVENTION These and other drawbacks and disadvantages of the prior art are addressed by an apparatus and method that provide mixed inter/intra coding of macroblocks through the use of weighted prediction. A video encoder and corresponding method are provided for mixed inter/intra encoding of a macroblock having a plurality of partitions, where the encoder includes a reference picture weighting applicator coupled with a reference picture weighting factor unit for assigning weighting factors corresponding to each of the inter and intra coded partitions, respectively; and the corresponding method for encoding a macroblock with several partitions includes inter-coding at least one partition and intra-coding at least a second partition.
Exemplary embodiments of the present invention are capable of providing mixed inter/intra coding in compliance with the JVT compression standard through the use of weighted prediction. In accordance with the principles of the invention, mixed inter/intra coding of partitions within the same macroblock is allowed, which can improve coding efficiency as well as subjective video quality.
These and other aspects, features and advantages of the present invention will become apparent from the following description of exemplary embodiments, which is to be read in connection with the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention may be better understood in accordance with the following exemplary figures, in which: Figure 1 shows a block diagram for a standard video encoder;
Figure 2 shows a block diagram for a video encoder with reference picture weighting;
Figure 3 shows a block diagram for a video encoder with integrated motion estimation and weighting prediction; and Figure 4 shows a flow diagram for a method of encoding macroblocks in accordance with the principles of the present invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
The Joint Video Team ("JVT") video compression standard supports division of 16x16 pixel macroblocks into smaller sized macroblock partitions for inter coding, but does not allow inter coding of some partitions of a macroblock and intra coding of other partitions of the same macroblock. In embodiments of the present invention, mixed inter/intra coding can be accomplished using the JVT compression standard, using weighted prediction.
The instant description illustrates the principles and various embodiments of the present invention. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the invention and are included within its spirit and scope.
All examples and conditional language recited herein are intended for pedagogical purposes to aid the reader in understanding the principles of the invention and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions.
Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative circuitry embodying the principles of the invention. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudocode, and the like represent various processes which may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
The functions of the various elements shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. Moreover, explicit use of the term "processor" or "controller" should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor ("DSP") hardware, read-only memory ("ROM") for storing software, random access memory ("RAM"), and non-volatile storage.
Other hardware, conventional and/or custom, may also be included. Similarly, any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
In the claims hereof, any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function. The invention as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. Applicant thus regards any means that can provide those functionalities as equivalent to those shown herein.
As shown in Figure 1 , a standard video encoder is indicated generally by the reference numeral 100. An input to the encoder 100 is connected in signal communication with a non-inverting input of a summing junction 110. The output of the summing junction 110 is connected in signal communication with a block transform function 120. The transformer 120 is connected in signal communication with a quantizer 130. The output of the quantizer 130 is connected in signal communication with a variable length coder ("VLC") 140, where the output of the VLC 140 is an externally available output of the encoder 100.
The output of the quantizer 130 is further connected in signal communication with an inverse quantizer 150. The inverse quantizer 150 is connected in signal communication with an inverse block transformer 160, which, in turn, is connected in signal communication with a reference picture store 170. A first output of the reference picture store 170 is connected in signal communication with a first input of a motion estimator 180. The input to the encoder 100 is further connected in signal communication with a second input of the motion estimator 180. The output of the motion estimator 180 is connected in signal communication with a first input of a motion compensator 190. A second output of the reference picture store 170 is connected in signal communication with a second input of the motion compensator 190. The output of the motion compensator 190 is connected in signal communication with an inverting input of the summing junction 110. Turning to Figure 2, a video encoder with reference picture weighting is indicated generally by the reference numeral 200. An input to the encoder 200 is connected in signal communication with a non-inverting input of a summing junction 210. The output of the summing junction 210 is connected in signal communication with a block transformer 220. The transformer 220 is connected in signal communication with a quantizer 230. The output of the quantizer 230 is connected in signal communication with a VLC 240, where the output of the VLC 440 is an externally available output of the encoder 200.
The output of the quantizer 230 is further connected in signal communication with an inverse quantizer 250. The inverse quantizer 250 is connected in signal communication with an inverse block transformer 260, which, in turn, is connected in signal communication with a reference picture store 270. A first output of the reference picture store 270 is connected in signal communication with a first input of a reference picture weighting factor assignor 272. The input to the encoder 200 is further connected in signal communication with a second input of the reference picture weighting factor assignor 272. The output of the reference picture weighting factor assignor 272, which is indicative of a weighting factor, is connected in signal communication with a first input of a motion estimator 280. A second output of the reference picture store 270 is connected in signal communication with a second input of the motion estimator 280. The input to the encoder 200 is further connected in signal communication with a third input of the motion estimator 280. The output of the motion estimator 280, which is indicative of motion vectors, is connected in signal communication with a first input of a motion compensator 290. A third output of the reference picture store 270 is connected in signal communication with a second input of the motion compensator 290. The output of the motion compensator 290, which is indicative of a motion compensated reference picture, is connected in signal communication with a first input of a multiplier 292. The output of the reference picture weighting factor assignor 272, which is indicative of a weighting factor, is connected in signal communication with a second input of the multiplier 292. The output of the multiplier 292 is connected in signal communication with an inverting input of the summing junction 210.
In U.S. Patent Application Serial No. 10/410,481 (attorney docket number PU020340), filed April 9, 2003, having a common assignee, and entitled "ADAPTIVE WEIGHTING OF REFERENCE PICTURES IN VIDEO DECODING"; and in U.S. Patent Application Serial No. 10/410,456 (attorney docket number PU020477), also filed April 9, 2003 and also having a common assignee, and entitled "ADAPTIVE WEIGHTING OF REFERENCE PICTURES IN VIDEO ENCODING", both of which are incorporated herein by reference in their entireties; an apparatus and method are disclosed which utilize a set of weighting factors transmitted once per picture or slice, with a particular weighting factor associated with each reference picture index.
Turning now to Figure 3, a video encoder with integrated motion estimation and weighting prediction is indicated generally by the reference numeral 300. An input to the encoder 300 is connected in signal communication with a non-inverting input of a summing junction 310. The output of the summing junction 310 is connected in signal communication with a block transformer 320. The transformer 320 is connected in signal communication with a quantizer 330. The output of the quantizer 330 is connected in signal communication with a VLC 340, where the output of the VLC 340 is an externally available output of the encoder 300.
The output of the quantizer 330 is further connected in signal communication with an inverse quantizer 350. The inverse quantizer 350 is connected in signal communication with an inverse block transformer 360, which, in turn, is connected in signal communication with a reference picture store 370. A first output of the reference picture store 370 is connected in signal communication with a first input of a reference picture weighting factor selector 372. The input to the encoder 300 is further connected in signal communication with a second input of the reference picture weighting factor selector 372 to provide the current picture to the selector. The output of the reference picture weighting factor selector 372, which is indicative of a weighting factor, is connected in signal communication with a first input of a multiplier 374. A second input of the multiplier 374 is connected in signal communication with the reference picture output of the reference picture store 370. It should be noted that although shown simply as a multiplier 374, other types of weighting factor applicators may be constructed other than a multiplier, as would be apparent to those of ordinary skill in the art.
The output of the multiplier 374 is connected in signal communication with a weighted reference picture store 376. The output of the weighted reference picture store 376 is connected in signal communication with a first input of a motion estimator 380 for providing a weighted reference picture. The output of the motion estimator 380 is connected in signal communication with a first motion compensator 382 for providing motion vectors. The output of. the motion estimator 380 is further connected in signal communication with a first input of a second motion compensator 390. A second output of the weighted reference picture store 376 is connected in signal communication with a second input of the first motion compensator 382. The output of the first motion compensator 382, which is indicative of a weighted motion compensated reference picture, is connected in signal communication with a first input of an absolute difference generator 384. The input to the encoder 300, which is the current picture, is further connected in signal communication with a second input of the absolute difference generator 384. The output of the absolute difference function 384 is connected in signal communication with a third input of the reference picture weighting factor selector 372.
A third output of the reference picture store 370 is connected in signal communication with a second input of the second motion compensator 390. The output of the second motion compensator 390, which is indicative of a motion compensated reference picture, is connected in signal communication with a first input of a multiplier 392. The output of the reference picture weighting factor selector 372, which is indicative of a weighting factor, is connected in signal communication with a second input of the multiplier 392. The output of the multiplier 392 is connected in signal communication with an inverting input of the summing junction 310.
In U.S. Patent Application Serial No. 10/410,479 (attorney docket number PU020339), filed April 9, 2003 and having a common assignee, and entitled "MOTION ESTIMATION WITH WEIGHTING PREDICTION", and which is incorporated herein by reference in its entirety; an apparatus and method are disclosed for combining the weighting factor search with the motion estimation search, resulting in a higher number of computations performed for finding the weighting factor with motion estimation than for performing estimation alone in the absence of reference picture weighting.
As shown in Figure 4, a flow diagram for a method of encoding macroblocks is indicated generally by the reference numeral 400. Here, a begin block 410 passes control to a function block 412, which finds the best Inter macroblock division, calculates the cost for each partition, CPINTER; and calculates the cost for the entire macroblock, CINTER. The block 412 passes control to a function block 414, which finds the best Intra prediction direction and calculates the cost for the entire macroblock, CINTRA. The block 414 passes control to a decision block 416, which determines whether CINTER is less than CINTRA.
If CINTER is not less than CINTRA, control passes to a function block 418 that Intra codes the entire macroblock, and then passes control to an end block 434. If, on the other hand, CINTER is less than CINTRA, control passes to a function block 420, which uses Inter coding for the macroblock and selects the first (/=0) partition of the macroblock. The block 420 passes control to a function block 422, which calculates the cost for the current partition, CPINTRA/, which is coded as Intra using a zero weighting factor. The block 422, in turn, passes control to a decision block 424, which determines whether CPINTER,- is less than CPINTRA/.
If CPINTER,- is less than CPINTRA/, control passes to a function block 426, which Inter codes the current partition /', and passes control to a decision block 430. If, on the other hand, CPINTER/ is not less than CPINTRA/, control passes to a function block 428, which non-predictively Intra codes the partition / using a zero weighting factor, and passes control to the decision block 430.
The decision block 430, in turn, determines whether the current partition / is the last partition in the macroblock. If the current partition / is not the last partition in the macroblock, control passes to a function block 432, which increments the current partition /, and passes control back to the function block 422. If, on the other hand, the current partition / is the last partition in the macroblock, then control passes to the end block 434. Thus, in operation of the present invention, mixed inter/intra coding of partitions of the same macroblock can be accomplished using the JVT compression standard. Intra coding of a macroblock partition is accomplished by using a weighting factor of zero with the weighted prediction tool in the Main and Extended profiles of the JVT standard. This type of intra coding is referred to as non-predictive intra coding, to differentiate it from the spatial directional intra coding used when entire macroblocks are intra coded. A macroblock containing some non-predictive intra coded partitions is still considered to be an inter coded macroblock. A weighting factor of zero is coded in the slice header, associated with a particular reference picture index. The encoder may associate multiple reference picture indices with a particular reference picture store, using reference picture reordering, in order to allow both a zero and a non-zero weighting factor to be associated with a particular reference picture store. Or the encoder may choose to use the default reference picture ordering, without using reference picture reordering, and to associate only a zero weighting factor with a particular reference picture store. If only a zero weighting factor is associated with a given reference picture store, it can not be used for inter prediction, so the encoder will select to do this when it is determined that this reference picture store would not be frequently selected for inter prediction. A long-term reference picture can be associated with a zero weighting factor for this purpose.
For the single directional prediction case, with a weighting factor of zero, the weighted prediction formula for calculating the inter prediction:
SampleP = C lip 1 (((SampleP 0 • W0 + 2WD~l ) » LWD) + O0 )
becomes:
SampleP = Oo
The offset value Oo may be set to be equal to zero, or to 128, or to any other desired value. MPEG-1 and MPEG-2 effectively use an offset of 128 for intra coding.
With a sample prediction of zero or of Oo for all pixels of a macroblock partition, the macroblock partition is effectively intra coded, but spatial directional prediction is not performed. The partition is referred to as being non-predictive intra coded.
In B pictures (or B slices), non-predictive intra coding for a macroblock partition can be accomplished either by selecting only List 0 or List 1 prediction and the reference picture index which was associated with a zero weighting factor. Alternatively, bi-prediction could be used, with a zero weighting factor sent in the slice header for a particular index for list 0 and for another index for list 1 , and non- predictive intra coding could be accomplished for that macroblock partition by coding using bi-prediction with the appropriate zero weighting factor associated reference picture indices for list 0 and list 1.
In a preferred embodiment of the present invention, a JVT video encoder encodes the macroblocks of a picture. When encoding a given macroblock, in addition to determining how to divide a macroblock into partitions and sub- macroblock partitions, the encoder determines whether is it is more advantageous for each macroblock partition to be coded as non-predictive intra or as inter (e.g., list 0, list 1 , direct, or bi-predictive). For those macroblock partitions(s) which are to be coded as non-predictive intra, an inter coding mode (e.g., list 0, list 1 , direct, or bi- predictive) is used in the mb_type for that partition, with reference picture indices used that are associated with a zero weighting factor. Non-predictive intra coded partitions are not further divided in sub-macroblock partitions, as is generally allowed for 8x8 sub-macroblock partitions, as additional bits would be required to indicate the division into sub-macroblock partitions, with no benefit. The differential motion vector for the non-predictive intra coded partition is set to zero, because that will use the fewest number of bits to code, and all possible values of the motion vector will yield the same decoded pixels.
Using this method, intra coding is effectively accomplished for some but not all of the partitions of a macroblock, which is compatible with the JVT compression standard. No intra spatial directional prediction is performed for non-predictive intra coded partitions.
An exemplary method for encoding a macroblock in accordance with the proposed invention is shown in the flowchart 400 described with respect to Figure 4. The best division of the macroblock into macroblock partitions and sub-macroblock partitions for Inter coding of the macroblock is determined using rate-distortion optimization, and a cost measure is calculated for each partition, CPINTER/, and for the entire macroblock, CINTER. The cost for coding the partition includes the cost of coding the reference picture index, the motion vector, and the prediction residual. Then the best Intra spatial prediction direction for the Intra coding of the macroblock is determined and a cost measure is calculated for Intra coding of the entire macroblock, CINTRA. Then if CINTER is not less than CINTRA, the entire macroblock is coded as Intra, using spatial directional prediction. Otherwise, the macroblock is coded as an inter macroblock. Next, each partition of the inter macroblock is considered to be coded as inter or non-predictive intra. The cost for intra coding the partition, using zero weighted prediction is computed, CPINTRA/, considering the cost of coding the reference picture index, and the residual, and the zero valued differential motion vector cost.
If for the partition / CPINTER/ is less than CPINTRA/, the partition /will be inter coded normally, and may be further divided into sub-macroblock partitions.
Otherwise, the partition will be non-predictive intra coded, by selecting the reference picture index associated with a zero weighting factor.
These and other features and advantages of the present invention may be readily ascertained by one of ordinary skill in the pertinent art based on the teachings herein. It is to be understood that the principles of the present invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or combinations thereof.
Most preferably, the principles of the present invention are implemented as a combination of hardware and software. Moreover, the software is preferably implemented as an application program tangibly embodied on a program storage unit. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. Preferably, the machine is implemented on a computer platform having hardware such as one or more central processing units ("CPU"), a random access memory ("RAM"), and input/output ("I/O") interfaces. The computer platform may also include an operating system and microinstruction code. The various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU. In addition, various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit.
It is to be further understood that, because some of the constituent system components and methods depicted in the accompanying drawings are preferably implemented in software, the actual connections between the system components or the process function blocks may differ depending upon the manner in which the present invention is programmed. Given the teachings herein, one of ordinary skill in the pertinent art will be able to contemplate these and similar implementations or configurations of the present invention. Although the illustrative embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the present invention is not limited to those precise embodiments, and that various changes and modifications may be effected therein by one of ordinary skill in the pertinent art without departing from the scope or spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as set forth in the appended claims.

Claims

1. A method (400) for encoding a macroblock having a plurality of partitions, the method comprising: inter-coding (426) at least one of said plurality of partitions; and intra-coding (428) at least a second of said plurality of partitions wherein said intra-coding comprises providing a reference picture index that is associated with a weighting factor of zero.
2. A method as defined in Claim 1 wherein said macroblock comprises video data in compliance with the Joint Video Team ("JVT") standard.
3. A method as defined in Claim 1 wherein said macroblock comprises a non-intra macroblock type.
4. A method as defined in Claim 1 wherein said intra-coding comprises non-predictive intra-coding performed within a weighted prediction encoding mode by using a weighting factor of zero with a weighted prediction tool from at least one of the Main and Extended profiles of the JVT standard.
5. A method as defined in Claim 4, further comprising coding a zero differential motion vector for a partition that is non-predictively intra-coded.
6. A method as defined in Claim 1 wherein the inter-coded at least one of said plurality of partitions has a reference picture index associated with a non-zero valued weighting factor.
7. A method as defined in Claim 6, further comprising deciding between inter-coding and non-predictive intra-coding of a partition in response to a measure of cost for each coding method.
8. A method as defined in Claim 1 , further comprising: associating a plurality of reference picture indices with a particular reference picture store using reference picture reordering commands; and assigning a zero weight to one of the plurality of reference picture indices and non-zero weights to the other reference picture indices.
9. A method (400) for encoding a macroblock having at least one partition, the method comprising non-predictively intra-coding (428) the at least one partition by providing a reference picture index that is associated with a weighting factor of zero.
10. A method as defined in Claim 9 wherein said non-predictive intra-coding is performed within a weighted prediction encoding mode by using a weighting factor of zero with a weighted prediction tool from at least one of the Main and Extended profiles of the JVT standard.
11. A video encoder (200, 300) for mixed inter/intra encoding of a macroblock having a plurality of partitions, the encoder comprising: a reference picture weighting applicator (292, 392); and a reference picture weighting factor unit (272, 372) in signal communication with the reference picture weighting applicator for assigning weighting factors corresponding to each of the mixed inter and intra coded partitions, respectively.
12. A video encoder as defined in Claim 11 , further comprising a motion compensation unit (290, 390) in signal communication with the reference picture weighting applicator for providing at least one each of a motion compensated inter and intra coded partition, respectively.
13. A video encoder as defined in Claim 12, further comprising a reference picture store (270, 370) in signal communication with each of the reference picture weighting factor unit and the motion compensation unit for storing at least one each of a motion compensated inter and intra coded partition, respectively.
14. A video encoder as defined in Claim 12 wherein the reference picture weighting applicator applies a weighting factor selected by the reference picture weighting factor unit to at least one of the motion compensated inter and intra coded partitions, respectively.
15. A video encoder as defined in Claim 14 usable with bi-predictive picture predictors, the encoder further comprising prediction means for forming first and second predictors from the at least one weighted and motion compensated inter/intra coded partition.
16. A video encoder as defined in Claim 11 , further comprising: inter-coding means for inter-coding at least one partition of a macroblock; and intra-coding means for intra-coding at least a second partition of the macroblock.
17. A video encoder as defined in Claim 16 wherein said macroblock comprises video data in compliance with the Joint Video Team ("JVT") standard.
18. A video encoder as defined in Claim 16 wherein said macroblock comprises a non-intra macroblock type.
19. A video encoder as defined in Claim 16 wherein said intra-coding means comprises indexing means for providing a reference picture index that is associated with a weighting factor of zero.
20. A video encoder as defined in Claim 16, further comprising non- predictive intra-coding means for coding a zero differential motion vector for a partition that is non-predictively intra-coded.
21. A video encoder as defined in Claim 16 wherein the inter-coded at least one of said plurality of partitions has a reference picture index associated with a nonzero valued weighting factor.
22. A video encoder as defined in Claim 21 , further comprising decision means for deciding between inter-coding and non-predictive intra-coding of a partition in response to a measure of cost for each coding method.
23. A video encoder as defined in Claim 16, further comprising: reference picture reordering means for associating a plurality of reference picture indices with a particular reference picture store using reference picture reordering commands; and weighting means for assigning a zero weight to one of the plurality of reference picture indices and non-zero weights to at least one other reference picture index.
24. A video encoder (200, 300) for non-predictive intra encoding of a macroblock having at least one partition, the encoder comprising: a reference picture weighting applicator (292, 392); and a reference picture weighting factor unit (272, 372) in signal communication with the reference picture weighting applicator for assigning weighting factors corresponding to the at least one non-predictive intra coded partition.
25. A video encoder as defined in Claim 24, further comprising non- predictive intra-coding means for intra-coding the at least one partition by providing a reference picture index that is associated with a weighting factor of zero.
26. A method as defined in Claim 25 wherein said non-predictive intra- coding is performed within a weighted prediction encoding mode by using a weighting factor of zero with a weighted prediction tool from at least one of the Main and Extended profiles of the JVT standard.
27. An apparatus for encoding a macroblock having a plurality of partitions comprising: means for inter-coding (426) at least one of said plurality of partitions; and means for intra-coding (428) at least a second of said plurality of partitions, wherein said means for intra-coding utilizes a reference picture index that is associated with a weighting factor of zero.
PCT/US2004/000074 2003-01-07 2004-01-06 Mixed inter/intra video coding of macroblock partitions WO2004064255A2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CN2004800018531A CN1723706B (en) 2003-01-07 2004-01-06 Method and apparatus for mixed inter/intra video coding of macroblock partitions
BR0406625-1A BRPI0406625A (en) 2003-01-07 2004-01-06 Inter / intra mixed video-encoding of macroblock partitions
EP04700324.9A EP1582063B1 (en) 2003-01-07 2004-01-06 Mixed inter/intra video coding of macroblock partitions
JP2006500779A JP2006517364A (en) 2003-01-07 2004-01-06 Inter / intra mixed video coding of macroblock partitions
MXPA05007384A MXPA05007384A (en) 2003-01-07 2004-01-06 Mixed inter/intra video coding of macroblock partitions.
US10/541,603 US7466774B2 (en) 2003-01-07 2004-01-06 Mixed inter/intra video coding of macroblock partitions

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US43842703P 2003-01-07 2003-01-07
US60/438,427 2003-01-07

Publications (2)

Publication Number Publication Date
WO2004064255A2 true WO2004064255A2 (en) 2004-07-29
WO2004064255A3 WO2004064255A3 (en) 2004-10-28

Family

ID=32713323

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2004/000074 WO2004064255A2 (en) 2003-01-07 2004-01-06 Mixed inter/intra video coding of macroblock partitions

Country Status (9)

Country Link
US (1) US7466774B2 (en)
EP (1) EP1582063B1 (en)
JP (2) JP2006517364A (en)
KR (1) KR100992044B1 (en)
CN (1) CN1723706B (en)
BR (1) BRPI0406625A (en)
MX (1) MXPA05007384A (en)
MY (1) MY139467A (en)
WO (1) WO2004064255A2 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006033953A1 (en) * 2004-09-16 2006-03-30 Thomson Licensing Video codec with weighted prediction utilizing local brightness variation
KR100727970B1 (en) 2005-08-30 2007-06-13 삼성전자주식회사 Apparatus for encoding and decoding image, and method theroff, and a recording medium storing program to implement the method
KR100727969B1 (en) 2005-08-27 2007-06-14 삼성전자주식회사 Apparatus for encoding and decoding image, and method theroff, and a recording medium storing program to implement the method
WO2008004940A1 (en) * 2006-07-07 2008-01-10 Telefonaktiebolaget Lm Ericsson (Publ) Video data management
JP2008524932A (en) * 2004-12-17 2008-07-10 インテル・コーポレーション Image decoder with context-based parameter buffer
EP1705920A3 (en) * 2005-03-23 2009-01-07 Kabushiki Kaisha Toshiba Video encoder and portable radio terminal device
US7653253B2 (en) * 2006-01-23 2010-01-26 Kabushiki Kaisha Toshiba Moving image decoder
WO2010076748A1 (en) * 2008-12-31 2010-07-08 Nxp B.V. System and method for video compression using predictive coding
US8189667B2 (en) 2006-08-11 2012-05-29 Kabushiki Kaisha Toshiba Moving picture encoding apparatus
CN101385346B (en) * 2006-02-17 2012-05-30 汤姆森许可贸易公司 Video frequency endong device and mehtod for solving local lightness variation
US8228989B2 (en) * 2007-02-05 2012-07-24 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding based on inter prediction
EP3139608A1 (en) * 2015-09-04 2017-03-08 STMicroelectronics (Grenoble 2) SAS Method for compressing a video data stream
US9870606B2 (en) 2012-09-19 2018-01-16 Thomson Licensing Method and apparatus for compensating illumination variations in a sequence of images
JP2021100273A (en) * 2018-04-04 2021-07-01 日本放送協会 Predictive image correction device, image coding device, image decoding device, and program

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100693669B1 (en) * 2003-03-03 2007-03-09 엘지전자 주식회사 Determination of a reference picture for processing a field macroblock
US7809059B2 (en) * 2003-06-25 2010-10-05 Thomson Licensing Method and apparatus for weighted prediction estimation using a displaced frame differential
JP4247680B2 (en) * 2004-07-07 2009-04-02 ソニー株式会社 Encoding apparatus, encoding method, encoding method program, and recording medium recording the encoding method program
US8457203B2 (en) * 2005-05-26 2013-06-04 Ntt Docomo, Inc. Method and apparatus for coding motion and prediction weighting parameters
JP2008252176A (en) * 2007-03-29 2008-10-16 Toshiba Corp Motion picture encoder and encoding method
KR20080107965A (en) * 2007-06-08 2008-12-11 삼성전자주식회사 Method and apparatus for encoding and decoding image using object boundary based partition
EP2208350A2 (en) * 2007-10-12 2010-07-21 Thomson Licensing Methods and apparatus for video encoding and decoding geometrically partitioned bi-predictive mode partitions
JP5400133B2 (en) * 2008-04-15 2014-01-29 オランジュ Encoding and decoding images or image sequences sliced into linearly shaped pixel partitions
US20110170793A1 (en) * 2008-09-24 2011-07-14 Kazushi Sato Image processing apparatus and method
US8634456B2 (en) * 2008-10-03 2014-01-21 Qualcomm Incorporated Video coding with large macroblocks
US8619856B2 (en) * 2008-10-03 2013-12-31 Qualcomm Incorporated Video coding with large macroblocks
US8503527B2 (en) 2008-10-03 2013-08-06 Qualcomm Incorporated Video coding with large macroblocks
US8483285B2 (en) * 2008-10-03 2013-07-09 Qualcomm Incorporated Video coding using transforms bigger than 4×4 and 8×8
WO2010041858A2 (en) * 2008-10-06 2010-04-15 Lg Electronics Inc. A method and an apparatus for decoding a video signal
KR20100095992A (en) 2009-02-23 2010-09-01 한국과학기술원 Method for encoding partitioned block in video encoding, method for decoding partitioned block in video decoding and recording medium implementing the same
WO2010131903A2 (en) 2009-05-12 2010-11-18 Lg Electronics Inc. Method and apparatus for processing a video signal
WO2011075071A1 (en) 2009-12-17 2011-06-23 Telefonaktiebolaget Lm Ericsson (Publ) Method and arrangement for video coding
KR101675118B1 (en) 2010-01-14 2016-11-10 삼성전자 주식회사 Method and apparatus for video encoding considering order of skip and split, and method and apparatus for video decoding considering order of skip and split
US9736486B2 (en) 2010-02-08 2017-08-15 Nokia Technologies Oy Apparatus, a method and a computer program for video coding
KR101633153B1 (en) 2010-04-01 2016-06-23 소니 주식회사 Image processing device and method
FR2959093B1 (en) * 2010-04-20 2013-07-26 Canon Kk METHOD AND DEVICE FOR PREDICTING TEXTURE COMPLEXITY INFORMATION CONTAINED IN AN IMAGE
KR102219985B1 (en) 2010-05-04 2021-02-25 엘지전자 주식회사 Method and apparatus for processing a video signal
US8638863B1 (en) 2010-05-18 2014-01-28 Google Inc. Apparatus and method for filtering video using extended edge-detection
KR102233820B1 (en) * 2010-05-26 2021-03-29 엘지전자 주식회사 Method and apparatus for processing a video signal
EP2942957A1 (en) * 2010-07-02 2015-11-11 HUMAX Holdings Co., Ltd. Apparatus for decoding images for intra-prediction
JP2012034213A (en) * 2010-07-30 2012-02-16 Toshiba Corp Image processing device, image processing system and image processing method
KR101719448B1 (en) 2010-09-27 2017-03-23 엘지전자 주식회사 Method for partitioning block and decoding device
WO2012097376A1 (en) 2011-01-14 2012-07-19 General Instrument Corporation Spatial block merge mode
US8767817B1 (en) 2011-04-07 2014-07-01 Google Inc. Apparatus and method for coding using parameterized equation
CN102238391B (en) * 2011-05-25 2016-12-07 深圳市云宙多媒体技术有限公司 A kind of predictive coding method, device
US9280835B2 (en) * 2011-10-18 2016-03-08 Nokia Technologies Oy Method for coding and an apparatus based on a DC prediction value
US9020294B2 (en) 2012-01-18 2015-04-28 Dolby Laboratories Licensing Corporation Spatiotemporal metrics for rate distortion optimization
US9531990B1 (en) 2012-01-21 2016-12-27 Google Inc. Compound prediction using multiple sources or prediction modes
US8737824B1 (en) 2012-03-09 2014-05-27 Google Inc. Adaptively encoding a media stream with compound prediction
US9781447B1 (en) 2012-06-21 2017-10-03 Google Inc. Correlation based inter-plane prediction encoding and decoding
US9185414B1 (en) 2012-06-29 2015-11-10 Google Inc. Video encoding using variance
US9167268B1 (en) 2012-08-09 2015-10-20 Google Inc. Second-order orthogonal spatial intra prediction
US9344742B2 (en) 2012-08-10 2016-05-17 Google Inc. Transform-domain intra prediction
US9380298B1 (en) 2012-08-10 2016-06-28 Google Inc. Object-based intra-prediction
US9369732B2 (en) 2012-10-08 2016-06-14 Google Inc. Lossless intra-prediction video coding
US9948939B2 (en) * 2012-12-07 2018-04-17 Qualcomm Incorporated Advanced residual prediction in scalable and multi-view video coding
US9628790B1 (en) 2013-01-03 2017-04-18 Google Inc. Adaptive composite intra prediction for image and video compression
US9374578B1 (en) 2013-05-23 2016-06-21 Google Inc. Video coding using combined inter and intra predictors
US9247251B1 (en) 2013-07-26 2016-01-26 Google Inc. Right-edge extension for quad-tree intra-prediction
US9609343B1 (en) 2013-12-20 2017-03-28 Google Inc. Video coding using compound prediction
KR101644967B1 (en) * 2015-01-21 2016-08-03 한국과학기술원 Method for decoding partitioned block in video decoding and recording medium implementing the same
KR101644970B1 (en) * 2015-01-21 2016-08-03 한국과학기술원 Method for decoding partitioned block in video decoding and recording medium implementing the same
KR101644969B1 (en) * 2015-01-21 2016-08-03 한국과학기술원 Method for decoding partitioned block in video decoding and recording medium implementing the same
US11032550B2 (en) * 2016-02-25 2021-06-08 Mediatek Inc. Method and apparatus of video coding
US10404989B2 (en) * 2016-04-26 2019-09-03 Google Llc Hybrid prediction modes for video coding
WO2019135447A1 (en) * 2018-01-02 2019-07-11 삼성전자 주식회사 Video encoding method and device and video decoding method and device, using padding technique based on motion prediction
KR102258057B1 (en) * 2018-05-04 2021-05-28 한국과학기술원 Method for decoding partitioned block in video decoding and recording medium implementing the same
KR102062894B1 (en) * 2018-05-04 2020-01-07 한국과학기술원 Method for decoding partitioned block in video decoding and recording medium implementing the same
CN118413642A (en) 2018-05-10 2024-07-30 三星电子株式会社 Video decoding method, video encoding apparatus, and method of storing bit stream
US11310515B2 (en) 2018-11-14 2022-04-19 Tencent America LLC Methods and apparatus for improvement for intra-inter prediction mode

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6563875B2 (en) 1987-12-30 2003-05-13 Thomson Licensing S.A. Adaptive method of encoding and decoding a series of pictures by transformation, and devices for implementing this method
AU6099594A (en) * 1993-02-03 1994-08-29 Qualcomm Incorporated Interframe video encoding and decoding system
US6005981A (en) 1996-04-11 1999-12-21 National Semiconductor Corporation Quadtree-structured coding of color images and intra-coded images
JP3844844B2 (en) * 1997-06-06 2006-11-15 富士通株式会社 Moving picture coding apparatus and moving picture coding method
US6542549B1 (en) 1998-10-13 2003-04-01 Matsushita Electric Industrial Co., Ltd. Method and model for regulating the computational and memory requirements of a compressed bitstream in a video decoder
US6404814B1 (en) * 2000-04-28 2002-06-11 Hewlett-Packard Company Transcoding method and transcoder for transcoding a predictively-coded object-based picture signal to a predictively-coded block-based picture signal

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
See also references of EP1582063A4
WIEGAND: "Editor's Proposed Draft Text Modifications for Joint Video Specification (ITU-T Rec. H 264 ISO IEC14495-10 AVC), Draft 7", ITU STUDY GROUP 16 - VIDEO CODING EXPERTS GROUP -ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6, 18 October 2002 (2002-10-18)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101023673B (en) * 2004-09-16 2011-06-08 汤姆逊许可证公司 Video codec with weighted prediction utilizing local brightness variation
EP3133813A1 (en) 2004-09-16 2017-02-22 Thomson Licensing Method and apparatus for weighted prediction video codec utilizing local brightness variation
US8284837B2 (en) 2004-09-16 2012-10-09 Thomson Licensing Video codec with weighted prediction utilizing local brightness variation
JP2008514122A (en) * 2004-09-16 2008-05-01 トムソン ライセンシング Method and apparatus for weighted predictive video codec utilizing localized luminance variation
JP2008312266A (en) * 2004-09-16 2008-12-25 Thomson Licensing Video codec with weighted prediction utilizing local brightness variation
WO2006033953A1 (en) * 2004-09-16 2006-03-30 Thomson Licensing Video codec with weighted prediction utilizing local brightness variation
JP2008524932A (en) * 2004-12-17 2008-07-10 インテル・コーポレーション Image decoder with context-based parameter buffer
EP1705920A3 (en) * 2005-03-23 2009-01-07 Kabushiki Kaisha Toshiba Video encoder and portable radio terminal device
US7688893B2 (en) 2005-03-23 2010-03-30 Kabushiki Kaisha Toshiba Video encoder and portable radio terminal device
KR100727969B1 (en) 2005-08-27 2007-06-14 삼성전자주식회사 Apparatus for encoding and decoding image, and method theroff, and a recording medium storing program to implement the method
KR100727970B1 (en) 2005-08-30 2007-06-13 삼성전자주식회사 Apparatus for encoding and decoding image, and method theroff, and a recording medium storing program to implement the method
US7653253B2 (en) * 2006-01-23 2010-01-26 Kabushiki Kaisha Toshiba Moving image decoder
CN101385346B (en) * 2006-02-17 2012-05-30 汤姆森许可贸易公司 Video frequency endong device and mehtod for solving local lightness variation
EP2039171A4 (en) * 2006-07-07 2011-09-28 Ericsson Telefon Ab L M Video data management
US8457200B2 (en) 2006-07-07 2013-06-04 Telefonaktiebolaget Lm Ericsson (Publ) Video data management
EP2039171A1 (en) * 2006-07-07 2009-03-25 Telefonaktiebolaget LM Ericsson (PUBL) Video data management
WO2008004940A1 (en) * 2006-07-07 2008-01-10 Telefonaktiebolaget Lm Ericsson (Publ) Video data management
US8189667B2 (en) 2006-08-11 2012-05-29 Kabushiki Kaisha Toshiba Moving picture encoding apparatus
US8228989B2 (en) * 2007-02-05 2012-07-24 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding based on inter prediction
WO2010076748A1 (en) * 2008-12-31 2010-07-08 Nxp B.V. System and method for video compression using predictive coding
US9870606B2 (en) 2012-09-19 2018-01-16 Thomson Licensing Method and apparatus for compensating illumination variations in a sequence of images
FR3040849A1 (en) * 2015-09-04 2017-03-10 Stmicroelectronics (Grenoble 2) Sas METHOD FOR COMPRESSING A VIDEO DATA STREAM
EP3139608A1 (en) * 2015-09-04 2017-03-08 STMicroelectronics (Grenoble 2) SAS Method for compressing a video data stream
JP2021100273A (en) * 2018-04-04 2021-07-01 日本放送協会 Predictive image correction device, image coding device, image decoding device, and program

Also Published As

Publication number Publication date
BRPI0406625A (en) 2005-12-06
EP1582063A2 (en) 2005-10-05
US7466774B2 (en) 2008-12-16
US20060153297A1 (en) 2006-07-13
JP2010136411A (en) 2010-06-17
CN1723706A (en) 2006-01-18
MY139467A (en) 2009-10-30
CN1723706B (en) 2010-09-22
WO2004064255A3 (en) 2004-10-28
EP1582063A4 (en) 2011-05-25
KR100992044B1 (en) 2010-11-05
MXPA05007384A (en) 2005-09-12
JP2006517364A (en) 2006-07-20
EP1582063B1 (en) 2018-03-07
KR20050089876A (en) 2005-09-08

Similar Documents

Publication Publication Date Title
US7466774B2 (en) Mixed inter/intra video coding of macroblock partitions
US8155191B2 (en) Method and apparatus for fast mode decision of B-frames in a video encoder
JP4968726B2 (en) Fast mode decision coding for interframes.
KR101406156B1 (en) Method and apparatus for adaptive weight selection for motion compensated prediction
EP1790167B1 (en) Method and apparatus for fast mode decision for interframes
EP1790168B1 (en) Video codec with weighted prediction utilizing local brightness variation
KR100984517B1 (en) Fast mode decision making for interframe encoding
WO2006052399A1 (en) Fast intra mode prediction for a video encoder
Yin et al. Localized weighted prediction for video coding
EP2514206A1 (en) Method and apparatus for bi-directional prediction within p-slices
KR101083399B1 (en) Fast mode-decision encoding for interframes

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

DPEN Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2883/DELNP/2005

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 2006500779

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 20048018531

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 1020057012656

Country of ref document: KR

ENP Entry into the national phase

Ref document number: 2006153297

Country of ref document: US

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: PA/a/2005/007384

Country of ref document: MX

Ref document number: 10541603

Country of ref document: US

Ref document number: 2004700324

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020057012656

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2004700324

Country of ref document: EP

ENP Entry into the national phase

Ref document number: PI0406625

Country of ref document: BR

WWP Wipo information: published in national office

Ref document number: 10541603

Country of ref document: US