WO2011003479A1 - Hybrid open-loop/closed-loop intra prediction - Google Patents

Hybrid open-loop/closed-loop intra prediction Download PDF

Info

Publication number
WO2011003479A1
WO2011003479A1 PCT/EP2009/058879 EP2009058879W WO2011003479A1 WO 2011003479 A1 WO2011003479 A1 WO 2011003479A1 EP 2009058879 W EP2009058879 W EP 2009058879W WO 2011003479 A1 WO2011003479 A1 WO 2011003479A1
Authority
WO
WIPO (PCT)
Prior art keywords
block
prediction values
predictor
picture
values
Prior art date
Application number
PCT/EP2009/058879
Other languages
French (fr)
Inventor
Thomas Davies
James Barrett
Original Assignee
British Broadcasting Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by British Broadcasting Corporation filed Critical British Broadcasting Corporation
Priority to PCT/EP2009/058879 priority Critical patent/WO2011003479A1/en
Priority to CA2767617A priority patent/CA2767617C/en
Priority to JP2012519020A priority patent/JP5841940B2/en
Priority to US13/383,229 priority patent/US9451272B2/en
Priority to PCT/EP2010/059945 priority patent/WO2011004027A2/en
Priority to EP10732356.0A priority patent/EP2452496B1/en
Publication of WO2011003479A1 publication Critical patent/WO2011003479A1/en
Priority to US15/235,328 priority patent/US20160353132A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/107Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/11Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Definitions

  • This invention relates to compression coding of pictures and especially to the coding of pictures in video sequences.
  • the term picture is used here to include fields and frames.
  • DPCM DPCM Modulation
  • a well recognised video encoder thus included motion compensated prediction, DCT or other spatial transform, quantisation and variable length or other entropy coding.
  • One technique included in MPEG-4 Part 10 / AVC / H.264 is to supplement the spatial transform with intra-picture prediction.
  • the decoder data from blocks which have already been decoded and reconstructed can be used to provide a spatial prediction for the current block.
  • this intra-prediction is of course made available through the local decoder.
  • the present invention addresses this tension between the small block size required for effective prediction and the large block size required (especially at increased definition) for effective transform coding gain.
  • the present invention consists in one aspect in a method of compression coding, comprising the steps of forming a difference between input picture values and picture prediction values; and transforming the difference; wherein a picture prediction is formed by the combination of a predictor P c which is restricted to prediction values capable of exact reconstruction in a downstream decoder and a spatial predictor P° which is not restricted to prediction values capable of exact reconstruction in a
  • the spatial predictor P° may access pixels within the current block, so enabling effective intra-picture spatial prediction within blocks that are large enough for efficient transform coding.
  • the combination of the spatial predictor P°with a predictor P c which is restricted to prediction values capable of exact reconstruction in a downstream decoder may enable noise growth to be controlled.
  • the combination may comprises a weighted sum of the respective outputs of the predictor P c and the predictor P°, such as
  • c is a weighting factor variable between zero and unity.
  • c may be chosen so as to optimise control of noise growth and accuracy of prediction, the overall prediction does not in this example change in weight.
  • the factor c or more generally the relative weighting of the predictor P c and the predictor P°, may vary with picture content.
  • the predictor P c will be a spatial predictor, such as - for example - the described H.264 spatial predictor.
  • the predictor P c is a temporal predictor such as the well known motion compensated predictor in MPEG standards.
  • the present invention consists in a method of compression decoding a bitstream encoded as outlined above, comprising the steps of receiving a bitstream representing picture differences; exactly reconstructing the prediction values of the predictor P c ; inexactly reconstructing the prediction values of the predictor P°; and using a combination of the reconstructed prediction values for summation with the picture differences.
  • the present invention consists in a video compression encoder comprising: a block splitter receiving picture information and splitting the picture information into spatial blocks; a block predictor operating on a block to provide block prediction values for the block; subtractor means receiving picture information and prediction values and forming difference values; a block transform conducting a spatial transform to provide transform coefficients; a quantisation unit for producing
  • an entropy coding unit for encoding transform coefficients into a coded bitstream
  • an inverse quantisation unit for inverse quantisation
  • the present invention also consist in a video compression decoder comprising: an input receiving a compression encoded bitstream representing
  • the predictor comprises a closed predictor operating wholly outside a particular block to provide closed prediction values for summation with picture differences in that block and an open predictor operating at least partly inside a particular block to provide open prediction values for summation with picture differences in that block; the prediction values comprising a combination of the closed prediction values and the open prediction values.
  • the present invention consists in a video compression system comprising in an encoder: block splitter means for receiving picture information and splitting the picture information into spatial blocks; block predictor means for operating on a block to provide block prediction values for the block; subtractor means for receiving picture information and prediction values and forming picture difference values; block transform means for conducting a spatial transform on the picture difference values to provide transform coefficients; quantisation means for approximating transform coefficients; inverse quantisation means for reconstructing transform coefficients; inverse block transform means for conducting an inverse spatial transform on the transform coefficients to provide locally decoded picture values; local decoder predictor means for operating on the locally decoded picture values to provide local decoder prediction values, wherein the prediction values received by said subtractor means comprise a variable combination of the block prediction values and the local decoder prediction values; and means for outputting a compression encoded bitstream representing the quantised transform coefficients and including a parameter recording variation of said combination, and further comprising in a decoder: receiving said compression encoded bitstream: inverse
  • the prediction values comprising a varying combination of the closed prediction values and the open prediction values, the combination being varied by the prediction means in accordance with said parameter in the bitstream.
  • picture prediction values P are formed as:
  • is the block prediction values
  • P c is local decoder prediction values
  • c is a weighting factor variable between zero and unity.
  • Figure 1 is a diagram illustrating a known spatial prediction technique
  • Figure 2 is a block diagram of an encoder
  • Figure 3 is a diagram illustrating spatial prediction:
  • Figure 4 is a block diagram of an encoder; and Figures 5 and 6 are block diagrams illustrating multi-pass encoding techniques.
  • MPEG Part 10 / AVC / H.264 contains an addition to previous MPEG standards, which is the provision for intra prediction of blocks.
  • Figure 1 shows the 8 possible directional predictions that can be used for 4x4 blocks
  • the DC can be predicted from the mean of pixels at the edges of the block, giving 9 modes in all. Other predictions are available for 16x16 and 8x8 blocks.
  • the H264 intra prediction tool showed the advantage of combining spatial predictive coding with transform coding. It was particularly effective for edge detail and for strongly directional texture, such as diagonal stripes.
  • the decrease in efficiency in spatial prediction coding with increasing block size can be understood to arise from the increasing distance (at least towards the end of a raster scanned block) between the current pixel and the pixels upon which the prediction is based. As that distance increases, correlation between pixels reduces and so also does differential coding efficiency.
  • motion compensated prediction has formed an essential part of video compression standards since MPEG-1.
  • a key issue is the trade-off between block size and prediction accuracy. Larger block sizes require fewer motion vectors to be coded, but have less prediction accuracy, since small objects or parts of objects in a large block may move differentially with respect to the rest of the block.
  • Transform block sizes are consequentially constrained since block transforms are generally applied wholly within a prediction block, to avoid the difficulties of transforming the transitions from one block to another. In H264, these trade-offs may be achieved by selecting from among a very wide variety of motion block partitions.
  • the samples available to the decoder are those that have been decoded and reconstructed.
  • the samples used in the encoder are the original samples, which are different due to subsequent quantisation .
  • the prediction would in this sense be open loop, in contrast to the closed loop that is provided where a local decoder within the encoder guarantees that the prediction values used by the encoder can be exactly reconstructed in the decoder. This difference could cause significant noise growth
  • the prediction will differ because of the noise on each of the previous reconstructed values X and this noise can therefore grow.
  • a good predictor P will typically have unity gain at DC, meaning that 1— P has a zero and the inverse filter will have a pole i.e. infinite gain at DC.
  • noise can grow in an unbounded fashion.
  • a closed-loop predictor, in which the predictor uses the reconstructed values Xo at the encoder also, will not have this problem.
  • P c and P 0 to be two predictors.
  • P c will be applied closed-loop, to produce a prediction constructed solely from previously coded and reconstructed coefficients;
  • P 0 will be applied open-loop, that is it will be applied to produce predictions from original uncoded coefficients.
  • both predictions must use reconstructed coefficients.
  • P c would be to predict pixels in a block by the mean of pixels in neighbouring blocks.
  • P 0 would be to predict a pixel from immediately neighbouring pixels, whether they fall in the same block or not.
  • a factor c applies to P 0 . If this factor c is between zero and unity it acts as a damping or leakiness factor on the noise contributed by the open-loop predictor in the decoder, and this controls noise growth. Yet the combined predictor remains an excellent predictor due to the complementary contribution of the closed-loop predictor, whereas without a complementary closed-loop predictor the efficacy of the prediction would fall as the factor c got smaller.. In particular, if both predictors eliminate DC, then so will the combined predictor.
  • An example of an encoder architecture is shown in Figure 2. Input video is received at block splitter B which serves to split the input data into blocks. The block information is supplied to a block store BS and to a subtractor 200.
  • Block store BS provides data to an open loop predictor P 0 .
  • This predictor operates within the block to provide a prediction value for the current pixel.
  • the predicted value takes the form, in one example, of the arithmetic mean of the three pixels, respectively: horizontally to the left, diagonally to the top left and vertically above the current pixel. It will be understood that a predicted value can be formed in a variety of other ways, utilising further or different neighbouring pixels and applying different weightings to different neighbouring pixels.
  • the predicted value from P 0 is supplied as the negative input to subtractor via a multiplier which applies a gain factor c.
  • the parameter c may typically vary between zero and unity. This gain control, when c is less than unity, addresses the problem of noise growth that would otherwise be associated with the use of an open loop predictor.
  • the output from subtract passes through a second subtractor 204 to a
  • the transform T operates on the received picture difference to provide transform coefficients to a generally conventional quantiser block Q.
  • the quantised transform coefficients undergo variable length or other entropy coding in block EC to provide the output bitstream of the encoder.
  • a locally decoded block store LDBS is maintained containing values that have been reconstructed just as they would be in the decoder, using only previously reconstructed data values.
  • the closed loop spatial prediction may conveniently take the form of the known H.264 spatial predictor or motion compensated predictors.
  • the closed loop prediction values are passed as a negative input to subtractor via multiplier applying a gain control factor of (1 -c).
  • Values from the LDBS are constructed by means of an inverse quantiser block Q "1 , an inverse transform block T "1 , and the addition of predictions in the same proportions but using only previously-decoded reconstructed values from the LDBS itself.
  • the feed-forward predictor P 0 can also use reconstructed samples where they are available, at the top and left of a block if we assume blocks are scanned in raster order.
  • the samples input to P c are also input to P 0 . This means that wherever possible the predictions use reconstructed samples.
  • the pixels in the top row and the left column of the current 4x4 block can be predicted entirely or mostly from locally decoded pixels (outside the current block) which are shown cross hatched in the figure.
  • the result should be to restrict the growth of noise still further by synchronising the prediction in encoder and decoder each block.
  • the parameter c may - in addition to any variation in accordance with picture content - may vary with the position of the current pixel in the block. This variation with pixel position need not necessarily be signalled in the bitstream; it may for example form part of an industry or de facto standard.
  • Raster scanning within a block could be used, but other scan patterns may give a better result, for example scanning in concentric 'L' shapes as shown in Figure 3.
  • this architecture allows for varying the degree of leakiness across a block without introducing spurious frequency components.
  • the parameter c may be optimised for different picture content depending on the block sizes used, the quantisation parameters selected and the relative success of the two predictions. Small block sizes and low levels of quantisation will in general produce less divergence between the encoder and decoder open loop predictions, and so the overall value of c could be adjusted closer to unity in these circumstances, either through encoding in the bitstream or according to the governing standard.
  • P c could be a directional predictor already defined in H264, and P 0 could be a directional pixelwise predictor.
  • P c could be a motion compensated temporal predictor.
  • a decoder architecture is shown in Figure 4.
  • the bitstream is received by an entropy decoding block ED and passes through an inverse quantiser block Q "1 and an inverse transform block T "1 .
  • the output of the inverse transform block is passed to the input of a decoded block store DBS.
  • Decoded data from the decoded block store is passed to the inputs of a closed loop predictor P c and an open loop protector P 0 .
  • the output of P 0 is passed an adder through a multiplier 402 applying a gain control factor c.
  • the output of predictor P c is applied to an adder through a multiplier applying gain control factor (1 -c).
  • the two adders serve to add the weighted prediction outputs to the values output from the inverse transform block. Once reconstructed, the values are passed into the DBS for use in predicting subsequent values.
  • the input to the DBS of course also provides the video output from the decoder.
  • Optimum predictors can be selected of by adaptive means. Predictors may be chosen, for example, by linear optimisation techniques, minimising mean square error, or by determining and extrapolating local gradients. Whatever the method, a fundamental distinction is between continuous adaptive techniques, whereby the choice of predictor is a continuous function of values in a
  • both the basic samples and the autocorrelation functions would be different between encoder and decoder, causing different filters to be used. This might well not be significant, however, if the prediction could be much better.
  • the adaption could be made more stable by assuming a degree of white noise, for example by adding a small delta impulse to the measured autocorrelation R(k), or by directly adding artificial noise to the feedback signal in the LMS/RLS algorithm.
  • the architectures described above involve predictions using the original, uncoded samples. It is this that causes the noise addition from the prediction process.
  • an encoder is able to use any samples it likes to generate a bit stream: it is only decoder processes that need to be specified. So the encoder may modify the samples used for prediction in order that they are closer to the samples that the decoder uses for

Abstract

In a method of video coding, in which a difference is formed between input picture values and picture prediction values and that difference is transforming with a DCT, the picture prediction is formed as: P = (1-c)PC + CPO where PC is a closed loop predictor which is restricted to prediction values capable of exact reconstruction in a downstream decoder and PO is a spatial predictor which is not restricted to prediction values capable of exact reconstruction. The factor can vary from zero to unity depending on a variety of parameters.

Description

HYBRID OPEN-LOOP/ CLOSED-LOOP INTRA PREDICTION
This invention relates to compression coding of pictures and especially to the coding of pictures in video sequences. The term picture is used here to include fields and frames.
An early idea in the compression of pictures, known as Differential Pulse Code
Modulation (DPCM), was to transmit not a pixel value but the difference between that picture value and a predicted value for that pixel. This differential approach can exploit spatial redundancy in a picture and can exploit both spatial and temporal redundancies in a video sequence of pictures.
As video compression techniques developed towards the well known MPEG
compression schemes, attention focussed on the use of differential techniques in the temporal domain. With accurate motion measurement techniques defining motion vectors between blocks in successive pictures, inter-picture differences can be very small and coded highly efficiently. To exploit spatial redundancy, spatial transform techniques were preferred, and applied both to motion-predicted (inter-coded) and unpredicted (intra-coded) areas of the picture.
A well recognised video encoder thus included motion compensated prediction, DCT or other spatial transform, quantisation and variable length or other entropy coding.
Efforts have continued in MPEG and in other coding regimes to increase coding efficiency and to extend coding capability to HDTV and still higher picture resolutions.
One technique included in MPEG-4 Part 10 / AVC / H.264 is to supplement the spatial transform with intra-picture prediction. In the decoder, data from blocks which have already been decoded and reconstructed can be used to provide a spatial prediction for the current block. In the encoder, this intra-prediction is of course made available through the local decoder.
This additional spatial prediction has been found to increase performance significantly, particularly for edge detail and for strongly directional texture, such as diagonal stripes.
Experiments have however shown that the increase in performance is greatest at small block sizes and that performance declines as block sizes increase. This is a problem first because transform coding gain is relatively poor for small block sizes and efficient transform coding demands large block sizes. Second, moves to higher definitions will necessarily involve still higher block sizes. To give some examples, intra-predictions have been found to work well with 4X4 block sizes. Moving to 8x8 blocks might give around 1 dB in transform coding gain, but spatial prediction becomes more complex and less effective. At HD resolutions and above, 16x16 blocks or larger transforms will be needed, (perhaps up to 64x64 for UHDTV).
A similar tension exists in motion-compensated prediction: larger block size requires that fewer motion vectors are encoded, and allows the use of larger transforms on the residual. However, it increases the likelihood that some part of the large block will be poorly predicted, perhaps because of the motion of some small object or part of an object within the block area.
The present invention addresses this tension between the small block size required for effective prediction and the large block size required (especially at increased definition) for effective transform coding gain.
Accordingly, the present invention consists in one aspect in a method of compression coding, comprising the steps of forming a difference between input picture values and picture prediction values; and transforming the difference; wherein a picture prediction is formed by the combination of a predictor Pc which is restricted to prediction values capable of exact reconstruction in a downstream decoder and a spatial predictor P° which is not restricted to prediction values capable of exact reconstruction in a
downstream decoder.
The spatial predictor P° may access pixels within the current block, so enabling effective intra-picture spatial prediction within blocks that are large enough for efficient transform coding.
The combination of the spatial predictor P°with a predictor Pc which is restricted to prediction values capable of exact reconstruction in a downstream decoder may enable noise growth to be controlled. The combination may comprises a weighted sum of the respective outputs of the predictor Pc and the predictor P°, such as
P = (1 -c)Pc + cP°
where c is a weighting factor variable between zero and unity.
Whilst c may be chosen so as to optimise control of noise growth and accuracy of prediction, the overall prediction does not in this example change in weight.
The factor c or more generally the relative weighting of the predictor Pc and the predictor P°, may vary with picture content.
Often, the predictor Pc will be a spatial predictor, such as - for example - the described H.264 spatial predictor. In other arrangements, the predictor Pc is a temporal predictor such as the well known motion compensated predictor in MPEG standards. In another aspect, the present invention consists in a method of compression decoding a bitstream encoded as outlined above, comprising the steps of receiving a bitstream representing picture differences; exactly reconstructing the prediction values of the predictor Pc; inexactly reconstructing the prediction values of the predictor P°; and using a combination of the reconstructed prediction values for summation with the picture differences.
In yet a further aspect, the present invention consists in a video compression encoder comprising: a block splitter receiving picture information and splitting the picture information into spatial blocks; a block predictor operating on a block to provide block prediction values for the block; subtractor means receiving picture information and prediction values and forming difference values; a block transform conducting a spatial transform to provide transform coefficients; a quantisation unit for producing
approximations to the transform coefficients; an entropy coding unit for encoding transform coefficients into a coded bitstream; an inverse quantisation unit for
reconstructing transform coefficients; an inverse block transform conducting an inverse spatial transform on the transform coefficients to provide locally decoded picture values; and a local decoder predictor operating on the locally decoded picture values to provide local decoder prediction values, wherein the prediction values received by said subtractor means comprise a combination of the block prediction values and the local decoder prediction values.
In this aspect, the present invention also consist in a video compression decoder comprising: an input receiving a compression encoded bitstream representing
transformed picture differences organised in blocks; an inverse quantisation unit providing re-scaled transform coefficients; an inverse block transform conducting an inverse spatial transform on the transform coefficients to provide decoded picture values; and a predictor operating on the decoded picture values to provide prediction values for summation with said picture differences, wherein the predictor comprises a closed predictor operating wholly outside a particular block to provide closed prediction values for summation with picture differences in that block and an open predictor operating at least partly inside a particular block to provide open prediction values for summation with picture differences in that block; the prediction values comprising a combination of the closed prediction values and the open prediction values.
In still a further aspect, the present invention consists in a video compression system comprising in an encoder: block splitter means for receiving picture information and splitting the picture information into spatial blocks; block predictor means for operating on a block to provide block prediction values for the block; subtractor means for receiving picture information and prediction values and forming picture difference values; block transform means for conducting a spatial transform on the picture difference values to provide transform coefficients; quantisation means for approximating transform coefficients; inverse quantisation means for reconstructing transform coefficients; inverse block transform means for conducting an inverse spatial transform on the transform coefficients to provide locally decoded picture values; local decoder predictor means for operating on the locally decoded picture values to provide local decoder prediction values, wherein the prediction values received by said subtractor means comprise a variable combination of the block prediction values and the local decoder prediction values; and means for outputting a compression encoded bitstream representing the quantised transform coefficients and including a parameter recording variation of said combination, and further comprising in a decoder: receiving said compression encoded bitstream: inverse block transform means for conducting an inverse spatial transform on the transform coefficients to provide decoded picture values; inverse quantisation means for reconstructing transform coefficients; and predictor means operating on the decoded picture values to provide prediction values for summation with said picture differences, wherein the predictor means comprises a closed predictor operating wholly outside a particular block to provide closed prediction values for summation with picture
differences in that block and an open predictor operating at least partly inside a particular block to provide open prediction values for summation with picture differences in that block; the prediction values comprising a varying combination of the closed prediction values and the open prediction values, the combination being varied by the prediction means in accordance with said parameter in the bitstream.
Suitably, wherein the picture prediction values P are formed as:
P = (1 -c)Pc + cP°
where P° is the block prediction values; Pc is local decoder prediction values; and c is a weighting factor variable between zero and unity.
The invention will now be described by way of example with reference to the accompany drawings, in which:
Figure 1 is a diagram illustrating a known spatial prediction technique;
Figure 2 is a block diagram of an encoder:
Figure 3 is a diagram illustrating spatial prediction:
Figure 4 is a block diagram of an encoder; and Figures 5 and 6 are block diagrams illustrating multi-pass encoding techniques.
As has been mentioned MPEG Part 10 / AVC / H.264 (from here referred to as H.264 for convenience) contains an addition to previous MPEG standards, which is the provision for intra prediction of blocks. Data along the top and to the left of a block, which has been decoded and reconstructed already, can be used to provide a prediction for the current block which can now be coded differentially. Figure 1 shows the 8 possible directional predictions that can be used for 4x4 blocks
(previously reconstructed samples are shaded). In addition to these directional predictions, the DC can be predicted from the mean of pixels at the edges of the block, giving 9 modes in all. Other predictions are available for 16x16 and 8x8 blocks.
The H264 intra prediction tool showed the advantage of combining spatial predictive coding with transform coding. It was particularly effective for edge detail and for strongly directional texture, such as diagonal stripes.
There is however one problem in the inherent tension between the small blocks required to produce a good prediction, and the large blocks required to get good transform coding gain.
The decrease in efficiency in spatial prediction coding with increasing block size can be understood to arise from the increasing distance (at least towards the end of a raster scanned block) between the current pixel and the pixels upon which the prediction is based. As that distance increases, correlation between pixels reduces and so also does differential coding efficiency.
Likewise, motion compensated prediction has formed an essential part of video compression standards since MPEG-1. A key issue is the trade-off between block size and prediction accuracy. Larger block sizes require fewer motion vectors to be coded, but have less prediction accuracy, since small objects or parts of objects in a large block may move differentially with respect to the rest of the block.
Transform block sizes are consequentially constrained since block transforms are generally applied wholly within a prediction block, to avoid the difficulties of transforming the transitions from one block to another. In H264, these trade-offs may be achieved by selecting from among a very wide variety of motion block partitions.
What would be desirable is to predict at a finer grain than the transform may allow. However, within a block, the samples available to the decoder are those that have been decoded and reconstructed. The samples used in the encoder are the original samples, which are different due to subsequent quantisation . The prediction would in this sense be open loop, in contrast to the closed loop that is provided where a local decoder within the encoder guarantees that the prediction values used by the encoder can be exactly reconstructed in the decoder. This difference could cause significant noise growth
To see how the reconstruction noise can grow, let P(x0,..., xr-i) denote the prediction of sample x^ from samples Xk, k = 0,... ,r— 1. Then the prediction residues >v are given by:
yr = Xr - P (X o , . . . , Xr- i )
Let L = T1Q 1QT denote the process of transforming, quantising, inverse
quantising and inverse transforming the sequence yr. We can assume for the moment that the effect of L is to add a noise source nr of variance σ2 n to yr, i.e.
Figure imgf000007_0001
In reconstructing, the decoder will form
Figure imgf000007_0002
In addition to the noise nr on Yr, the prediction will differ because of the noise on each of the previous reconstructed values X and this noise can therefore grow. In particular, since a good predictor P will typically have unity gain at DC, meaning that 1— P has a zero and the inverse filter will have a pole i.e. infinite gain at DC. Thus noise can grow in an unbounded fashion. A closed-loop predictor, in which the predictor uses the reconstructed values Xo at the encoder also, will not have this problem.
There is thus a problem that a closed-loop predictor in conjunction with a transform encoder is limited either in the accuracy of the prediction (if the block is large) or in the efficiency of the transform (if the block is small); and an open-loop predictor can suffer from unbounded noise gain.
A solution to this problem will now be described.
Mathematically, define Pc and P0 to be two predictors. At the encoder Pc will be applied closed-loop, to produce a prediction constructed solely from previously coded and reconstructed coefficients; P0 will be applied open-loop, that is it will be applied to produce predictions from original uncoded coefficients. Of course, at the decoder both predictions must use reconstructed coefficients.
An example of Pc would be to predict pixels in a block by the mean of pixels in neighbouring blocks. An example of P0 would be to predict a pixel from immediately neighbouring pixels, whether they fall in the same block or not.
Then a new combined predictor P can be created by,
P = (1 - c) Pc +c P0
In this case, a factor c applies to P0 . If this factor c is between zero and unity it acts as a damping or leakiness factor on the noise contributed by the open-loop predictor in the decoder, and this controls noise growth. Yet the combined predictor remains an excellent predictor due to the complementary contribution of the closed-loop predictor, whereas without a complementary closed-loop predictor the efficacy of the prediction would fall as the factor c got smaller.. In particular, if both predictors eliminate DC, then so will the combined predictor. An example of an encoder architecture is shown in Figure 2. Input video is received at block splitter B which serves to split the input data into blocks. The block information is supplied to a block store BS and to a subtractor 200. Block store BS provides data to an open loop predictor P0. This predictor operates within the block to provide a prediction value for the current pixel. The predicted value takes the form, in one example, of the arithmetic mean of the three pixels, respectively: horizontally to the left, diagonally to the top left and vertically above the current pixel. It will be understood that a predicted value can be formed in a variety of other ways, utilising further or different neighbouring pixels and applying different weightings to different neighbouring pixels.
The predicted value from P0 is supplied as the negative input to subtractor via a multiplier which applies a gain factor c. The parameter c may typically vary between zero and unity. This gain control, when c is less than unity, addresses the problem of noise growth that would otherwise be associated with the use of an open loop predictor.
The output from subtract passes through a second subtractor 204 to a
conventional DCT or other spatial transform block T. The transform T operates on the received picture difference to provide transform coefficients to a generally conventional quantiser block Q. The quantised transform coefficients undergo variable length or other entropy coding in block EC to provide the output bitstream of the encoder.
To provide the closed loop prediction, a locally decoded block store LDBS is maintained containing values that have been reconstructed just as they would be in the decoder, using only previously reconstructed data values. The closed loop spatial prediction may conveniently take the form of the known H.264 spatial predictor or motion compensated predictors.
The closed loop prediction values are passed as a negative input to subtractor via multiplier applying a gain control factor of (1 -c).
Values from the LDBS are constructed by means of an inverse quantiser block Q"1, an inverse transform block T"1 , and the addition of predictions in the same proportions but using only previously-decoded reconstructed values from the LDBS itself.
Note that in block operation, the feed-forward predictor P0 can also use reconstructed samples where they are available, at the top and left of a block if we assume blocks are scanned in raster order. Thus the samples input to Pc are also input to P0. This means that wherever possible the predictions use reconstructed samples.
Thus, referring to Figure 3, the pixels in the top row and the left column of the current 4x4 block (marked X in the figure) can be predicted entirely or mostly from locally decoded pixels (outside the current block) which are shown cross hatched in the figure. The result should be to restrict the growth of noise still further by synchronising the prediction in encoder and decoder each block.
Since there will be little or no divergence between encoder and decoder on the top and left of the block, a lower degree of leakiness may be required there, thus allowing for better prediction to be used in these areas. In other words, the parameter c may - in addition to any variation in accordance with picture content - may vary with the position of the current pixel in the block. This variation with pixel position need not necessarily be signalled in the bitstream; it may for example form part of an industry or de facto standard.
In this approach, the coefficient order for the prediction and difference
generation will not be a raster order but will be block-by-block, scanning coefficients within each block before moving on to the next one. Raster scanning within a block could be used, but other scan patterns may give a better result, for example scanning in concentric 'L' shapes as shown in Figure 3.
Since the total prediction now has no weighting factor, this architecture allows for varying the degree of leakiness across a block without introducing spurious frequency components.
If c is fixed, a useful value has been found to be around 0.5.
The parameter c may be optimised for different picture content depending on the block sizes used, the quantisation parameters selected and the relative success of the two predictions. Small block sizes and low levels of quantisation will in general produce less divergence between the encoder and decoder open loop predictions, and so the overall value of c could be adjusted closer to unity in these circumstances, either through encoding in the bitstream or according to the governing standard.
This system is particularly attractive since it can be combined easily with a whole range of different predictors. For example, Pc could be a directional predictor already defined in H264, and P0 could be a directional pixelwise predictor. Alternatively Pc could be a motion compensated temporal predictor.
Or, for wavelet coding, one could do a form of hierarchical coding where the low-pass coefficients provide a closed-loop prediction at each level.
A decoder architecture is shown in Figure 4. In the decoder, the bitstream is received by an entropy decoding block ED and passes through an inverse quantiser block Q"1 and an inverse transform block T"1. The output of the inverse transform block is passed to the input of a decoded block store DBS. Decoded data from the decoded block store is passed to the inputs of a closed loop predictor Pc and an open loop protector P0. The output of P0 is passed an adder through a multiplier 402 applying a gain control factor c. The output of predictor Pc is applied to an adder through a multiplier applying gain control factor (1 -c). The two adders serve to add the weighted prediction outputs to the values output from the inverse transform block. Once reconstructed, the values are passed into the DBS for use in predicting subsequent values.
The input to the DBS of course also provides the video output from the decoder. Optimum predictors can be selected of by adaptive means. Predictors may be chosen, for example, by linear optimisation techniques, minimising mean square error, or by determining and extrapolating local gradients. Whatever the method, a fundamental distinction is between continuous adaptive techniques, whereby the choice of predictor is a continuous function of values in a
neighbourhood of the current pixel, and discontinuous techniques in which the predictor is switched.
Operating open-loop, in any adaptive technique the adaptive predictor itself could differ between encoder and decoder. Discontinuous adaptive techniques would appear especially dangerous, since very different predictors could be chosen. In a continuous system, given similar values, similar predictors would be chosen.
As an example of continuous adaption, it can be shown that if pixels are scanned to produce a sequence x(n) with autocorrelation R(k), then the MMSE predictor
N
P(x, n) =∑arχ(n - r)
k=\
has coefficients ak which satisfy the system of TV linear equations
R(j) -∑aJL(J -k\j = \,...,N
k=\
Therefore an adaptive system can be obtained by taking a rolling snapshot of the signal and solving this system. A more tractable adaption method which would approximate this (and converge to it, given stationary statistics) would be to use the LMS or RLS algorithms.
In this case both the basic samples and the autocorrelation functions would be different between encoder and decoder, causing different filters to be used. This might well not be significant, however, if the prediction could be much better. The adaption could be made more stable by assuming a degree of white noise, for example by adding a small delta impulse to the measured autocorrelation R(k), or by directly adding artificial noise to the feedback signal in the LMS/RLS algorithm. The architectures described above involve predictions using the original, uncoded samples. It is this that causes the noise addition from the prediction process. However, in a compression system an encoder is able to use any samples it likes to generate a bit stream: it is only decoder processes that need to be specified. So the encoder may modify the samples used for prediction in order that they are closer to the samples that the decoder uses for
reconstruction. With open-loop predictors, it cannot be guaranteed that the samples are identical, but multiple passes should provide some degree of convergence.
The way to do this is to concatenate two (or more) encoders, so that the prediction utilises data that has been coded and locally decoded by a first encoder. In this case an element of feedback has been reintroduced into the encoding process. Block diagram are shown in Figures 5 and 6. Here a first encoder performs the initial coding in the manner described above. A decoder again as described above then produces a first-pass decoded signal, which is then passed to the second encoder. Of course, whilst the first and second encoders are drawn separately, they will typically constitute first and second passes of one hardware or software encoder.
Two basic variants may be considered. In the first, shown in Figure 5, only the predictor of the second encoder uses the locally decoded version, but the pixels being predicted remain the original ones (with a compensating delay to account for the first-pass encode and decode). In the second, shown in Figure 6, both prediction and predicted pixels would use a locally decoded version. Any number of these stages may be concatenated in order to achieve greater convergence between encoder and decoder prediction coding processes.
It will be understood that this invention has been described only by way of example and that a wide variety of modifications are possible without departing from the scope of the appended claims. To the extent that described examples include separate features and options, all practicable combinations of such features and options are to be regarded as disclosed herein. Specifically, the subject matter of any one of the claims appended hereto is to be regarded as disclosed in combination with the subject matter of every other claim.

Claims

1. A method of compression coding, comprising the steps of forming a difference between input picture values and picture prediction values; and transforming the difference;
wherein a picture prediction is formed by the combination of a predictor Pc which is restricted to prediction values capable of exact reconstruction in a downstream decoder and a spatial predictor P° which is not restricted to prediction values capable of exact reconstruction in a downstream decoder.
2. A method according to Claim 1 , wherein said combination comprises a weighted sum of the respective outputs of the predictor Pc and the predictor P°.
3. A method according to Claim 1 or Claim 2, wherein the relative weighting of the predictor Pc and the predictor P° varies with picture content.
4. A method according to any one of the preceding claims, wherein the picture prediction P is formed as:
P = (1 -c)Pc + CP° where c is a weighting factor variable between zero and unity.
5. A method according to any one of the preceding claims wherein the predictor Pc is a spatial predictor.
6. A method according to any one of Claims 1 to 4, wherein the predictor Pc is a temporal predictor.
7. A method according to any one of the preceding claims wherein the difference is
transformed in a spatial block transform.
8. A method of compression decoding a bitstream encoded in accordance with any one of the preceding claims, comprising the steps of receiving a bitstream representing picture differences; exactly reconstructing the prediction values of the predictor Pc; inexactly reconstructing the prediction values of the predictor P°; and using a combination of the reconstructed prediction values for summation with the picture differences.
9. A method according to Claim 8, wherein the manner of combination of the reconstructed prediction values is varied under the control of a parameter represented in the bitstream.
10. A method according to Claim 8 or Claim 9, wherein said combination comprises a
weighted sum of the reconstructed prediction values of the predictor Pc and the reconstructed prediction values of the predictor P°.
11. A method according to Claim 10, wherein the relative weighting is varied in said weighted sum.
12. A method according to Claim 10, wherein the combination P is formed as:
P = (1 -c)Pc + cP° where c is a weighting factor variable between zero and unity
13. A method according to any one of Claims 1 to 7, comprising: in a first step: forming a difference between input picture values and picture prediction values; and transforming the difference; wherein a picture prediction is formed by the combination of a predictor Pc which is restricted to prediction values capable of exact reconstruction in a downstream decoder and a spatial predictor P° which is not restricted to prediction values capable of exact reconstruction in a downstream decoder; in a second step: receiving a bitstream from said first encoding; and inexactly
reconstructing the prediction values of the predictor P°; and in a third step: forming a difference between said input picture values and the inexactly reconstructed picture prediction values from said second step; and transforming the difference.
14. Apparatus configured and adapted to implement a method in accordance with any one of the preceding claims.
15. A computer program product comprising instructions causing programmable apparatus to a method in accordance with any one of Claims 1 to 13.
16. A video compression encoder comprising:
a block splitter receiving picture information and splitting the picture information into spatial blocks;
a block predictor operating on a block to provide block prediction values for the block; subtractor means receiving picture information and prediction values and forming difference values;
a block transform conducting a spatial transform to provide transform coefficients;
a quantisation unit for producing approximations to the transform coefficients;
an entropy coding unit for encoding transform coefficients into a coded bitstream;
an inverse quantisation unit for reconstructing transform coefficients;
an inverse block transform conducting an inverse spatial transform on the transform coefficients to provide locally decoded picture values;
and a local decoder predictor operating on the locally decoded picture values to provide local decoder prediction values,
wherein the prediction values received by said subtractor means comprise a combination of the block prediction values and the local decoder prediction values.
17. An encoder according to Claim 16, wherein said combination comprises the weighted sum of the block prediction values and the local decoder prediction values.
18. An encoder according to Claim 16 or Claim 17, wherein the relative weighting of the block prediction values and the local decoder prediction values varies with picture content.
19. An encoder according to any one of Claims 16 to 18, wherein the picture prediction P is formed as:
P = (1 -c)Pc + cP° where P° is the block prediction values; Pc is local decoder prediction values; and c is a weighting factor variable between zero and unity.
20. A video compression decoder comprising:
an input receiving a compression encoded bitstream representing transformed picture differences organised in blocks; an inverse quantisation unit providing re-scaled transform coefficients;
an inverse block transform conducting an inverse spatial transform on the transform coefficients to provide decoded picture values; and a predictor operating on the decoded picture values to provide prediction values for summation with said picture differences, wherein the predictor comprises a closed predictor operating wholly outside a particular block to provide closed prediction values for summation with picture differences in that block and an open predictor operating at least partly inside a particular block to provide open prediction values for summation with picture differences in that block; the prediction values comprising a combination of the closed prediction values and the open prediction values.
21. A decoder according to Claim 20, wherein said combination varies.
22. A decoder according to Claim 21 , wherein parameter values in the encoded bitstream control variation of said combination.
23. A video compression system comprising in an encoder:
block splitter means for receiving picture information and splitting the picture information into spatial blocks;
block predictor means for operating on a block to provide block prediction values for the block;
subtractor means for receiving picture information and prediction values and forming picture difference values;
block transform means for conducting a spatial transform on the picture difference values to provide transform coefficients;
quantisation means for approximating transform coefficients;
inverse quantisation means for reconstructing transform coefficients;
inverse block transform means for conducting an inverse spatial transform on the transform coefficients to provide locally decoded picture values;
local decoder predictor means for operating on the locally decoded picture values to provide local decoder prediction values,
wherein the prediction values received by said subtractor means comprise a variable combination of the block prediction values and the local decoder prediction values; and means for outputting a compression encoded bitstream representing the quantised transform coefficients and including a parameter recording variation of said combination, and
further comprising in a decoder receiving said compression encoded bitstream, inverse block transform means for conducting an inverse spatial transform on the transform coefficients to provide decoded picture values; inverse quantisation means for reconstructing transform coefficients; and
predictor means operating on the decoded picture values to provide prediction values for summation with said picture differences,
wherein the predictor means comprises a closed predictor operating wholly outside a particular block to provide closed prediction values for summation with picture differences in that block and an open predictor operating at least partly inside a particular block to provide open prediction values for summation with picture differences in that block; the prediction values comprising a varying combination of the closed prediction values and the open prediction values, the combination being varied by the prediction means in accordance with said parameter in the bitstream.
24. An encoder according to Claim 22, wherein the picture prediction values P are formed as:
P = (1 -c)Pc + cP° where P° is the block prediction values; Pc is local decoder prediction values; and c is a weighting factor variable between zero and unity.
PCT/EP2009/058879 2009-07-10 2009-07-10 Hybrid open-loop/closed-loop intra prediction WO2011003479A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
PCT/EP2009/058879 WO2011003479A1 (en) 2009-07-10 2009-07-10 Hybrid open-loop/closed-loop intra prediction
CA2767617A CA2767617C (en) 2009-07-10 2010-07-09 Hybrid open-loop/closed-loop compression of pictures
JP2012519020A JP5841940B2 (en) 2009-07-10 2010-07-09 Hybrid open-loop / closed-loop compression of images
US13/383,229 US9451272B2 (en) 2009-07-10 2010-07-09 Hybrid open-loop/closed-loop compression of pictures
PCT/EP2010/059945 WO2011004027A2 (en) 2009-07-10 2010-07-09 Compression of pictures
EP10732356.0A EP2452496B1 (en) 2009-07-10 2010-07-09 Hybrid open-loop/closed-loop compression of pictures
US15/235,328 US20160353132A1 (en) 2009-07-10 2016-08-12 Hybrid open-loop/closed-loop compression of pictures

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2009/058879 WO2011003479A1 (en) 2009-07-10 2009-07-10 Hybrid open-loop/closed-loop intra prediction

Publications (1)

Publication Number Publication Date
WO2011003479A1 true WO2011003479A1 (en) 2011-01-13

Family

ID=41228211

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2009/058879 WO2011003479A1 (en) 2009-07-10 2009-07-10 Hybrid open-loop/closed-loop intra prediction

Country Status (1)

Country Link
WO (1) WO2011003479A1 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008004940A1 (en) * 2006-07-07 2008-01-10 Telefonaktiebolaget Lm Ericsson (Publ) Video data management

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008004940A1 (en) * 2006-07-07 2008-01-10 Telefonaktiebolaget Lm Ericsson (Publ) Video data management

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
ADRIAN MUNTEANU ET AL: "Applying Open-Loop Coding in Predictive Coding Systems", ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS; [LECTURE NOTES IN COMPUTER SCIENCE], SPRINGER BERLIN HEIDELBERG, BERLIN, HEIDELBERG, vol. 5259, 20 October 2008 (2008-10-20), pages 25 - 37, XP019108416, ISBN: 978-3-540-88457-6 *
SCHWARZ H ET AL: "SVC overview", JOINT VIDEO TEAM (JVT) OF ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), no. JVT-U145, 20 October 2006 (2006-10-20), XP030006791 *
STEFFEN KAMP ET AL: "Quality scalable low delay video coding using leaky base layer prediction", COMMUNICATIONS AND INFORMATION TECHNOLOGIES, 2007. ISCIT '07. INT ERNATIONAL SYMPOSIUM ON, IEEE, PI, 1 October 2007 (2007-10-01), pages 541 - 545, XP031166523, ISBN: 978-1-4244-0976-1 *
WIEGAND T ET AL: "Overview of the H.264/AVC video coding standard", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 13, no. 7, 1 July 2003 (2003-07-01), pages 560 - 576, XP011099249, ISSN: 1051-8215 *

Similar Documents

Publication Publication Date Title
US9058659B2 (en) Methods and apparatuses for encoding/decoding high resolution images
US7782955B2 (en) Transcoder and transcoding method operating in a transform domain for video coding schemes possessing different transform kernels
US10298943B2 (en) Compression of pictures
CA2703775C (en) Method and apparatus for selecting a coding mode
US7885341B2 (en) Spatial filtering for improving compression efficiency of motion compensated interframe coding
US20070098067A1 (en) Method and apparatus for video encoding/decoding
US20160353132A1 (en) Hybrid open-loop/closed-loop compression of pictures
US20120218432A1 (en) Recursive adaptive intra smoothing for video coding
WO2011003480A1 (en) Hybrid open-loop/closed-loop compression of pictures
EP2452496B1 (en) Hybrid open-loop/closed-loop compression of pictures
Lei et al. New distributed video coding paradigm with partial boundary matching algorithm, spatio-temporal texture synthesis and image inpainting
WO2011003479A1 (en) Hybrid open-loop/closed-loop intra prediction
Lee et al. An efficient algorithm for VC-1 to H. 264 video transcoding in progressive compression
Akbulut et al. One-dimensional processing for efficient optimal post-process/in-loop filtering in video coding
KR102111437B1 (en) Method and apparatus for image interpolation having quarter pixel accuracy using intra prediction modes
Udupa Taylor Rate-Distortion trade-off and Adaptive block search for HEVC Encoding
Kumari et al. Taylor rate-distortion trade-off and adaptive block search for HEVC encoding
Pastuszak Quantization selection in the high-throughput H. 264/AVC encoder based on the RD
Qian et al. Transform domain transcoding from MPEG-2 to H. 264 with interpolation error drift compensation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09780478

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09780478

Country of ref document: EP

Kind code of ref document: A1