WO2006108654A2 - Method and apparatus for enhanced video coding - Google Patents

Method and apparatus for enhanced video coding Download PDF

Info

Publication number
WO2006108654A2
WO2006108654A2 PCT/EP2006/003410 EP2006003410W WO2006108654A2 WO 2006108654 A2 WO2006108654 A2 WO 2006108654A2 EP 2006003410 W EP2006003410 W EP 2006003410W WO 2006108654 A2 WO2006108654 A2 WO 2006108654A2
Authority
WO
WIPO (PCT)
Prior art keywords
filter
video signal
sub
pel
filter coefficients
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2006/003410
Other languages
English (en)
French (fr)
Other versions
WO2006108654A3 (en
Inventor
Yuri Vatis
Bernd Edler
Ingolf Wassermann
Dieu Thanh Nguyen
Jörn OSTERMANN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leibniz Universitaet Hannover
Original Assignee
Leibniz Universitaet Hannover
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leibniz Universitaet Hannover filed Critical Leibniz Universitaet Hannover
Priority to US11/911,505 priority Critical patent/US20090022220A1/en
Priority to EP06742578A priority patent/EP1886502A2/en
Priority to JP2008505817A priority patent/JP2008536414A/ja
Publication of WO2006108654A2 publication Critical patent/WO2006108654A2/en
Publication of WO2006108654A3 publication Critical patent/WO2006108654A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/31—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain

Definitions

  • the invention relates to methods for encoding and decoding a video signal and corresponding apparatuses.
  • Coding of video signals is well known in the art and usually related to the MPEG 4 or H.264/AVC standard.
  • the responsible committees for these two standards are the ISO and ITU.
  • the ISO and ITU coding standards apply hybrid video coding with motion- compensated prediction combined with transform coding of the prediction error.
  • the motion-compensated prediction is performed.
  • the temporal redundancy i.e. the correlation between consecutive images is exploited for the prediction of the current image from already transmitted images.
  • the residual error is transform coded, thus the spatial redundancy is reduced.
  • the current image of a sequence is split into blocks.
  • a displacement vector dj is esti- mated and transmitted that refers to the corresponding position in one of refer- ence images.
  • the displacement vectors may have fractional-pel resolution.
  • Today's standard H.264/AVC allows for 1 ⁇ -pel displacement resolution.
  • Displacement vectors with fractional-pel resolution may refer to positions in the reference image, which are located between the sampled positions.
  • the reference image has to be interpolated on the sub-pel positions.
  • H.264/AVC uses a 6-tap Wiener interpolation filter with fixed filter coefficients.
  • the interpolation process used in H.264/AVC is depicted in Figure 1 and can be subdivided into two steps.
  • the half-pel positions aa, bb, cc, dd, ee, ff and gg, hh, H, kk, II, mm are calculated, using a horizontal or vertical 6-tap Wiener filter, respectively.
  • the sub-pel position j is computed.
  • the sub-pel position j can be computed using the horizontal filter set applied at sub-pel positions gg, hh, ii, kk, II, mm).
  • the residual quarter-pel positions are obtained, using a bilinear filter, applied at already calculated half-pel positions and existing full-pel positions.
  • the object is solved by the methods according to claim 1 , 13, and 21.
  • a method for encoding a video signal representing a moving picture comprises the steps of receiving successive frames of a video signal, coding a frame of the video signal, using a reference frame of the video signal, and calculating analytically a value of a sub-pel position of the reference frame by use of a filter having an individual set of two-dimensional filter coefficients.
  • the present invention instead of calculating the values of sub-pel positions in two steps based on two one-dimensional filters, the present invention discloses a method of calculating the value of a sub-pel position in a single step by use of a set of two-dimensional filter coefficients.
  • the filter set can be established by setting up an individual set of equations for the sub-pel position. Accordingly, the calculation is independent for each sub-pel position.
  • some of the two-dimensional filter coeffi- cients are set equal under the constraint that the distance of the corresponding full-pel position to the current sub-pel position for which the two-dimensional filter coefficients are calculated is equal. This contributes to reduce data overhead. Instead of transmitting all filter coefficients, only a reduced number of filter coefficients has to be transmitted.
  • the filter coefficients are coded.
  • the coding may be based on a temporal prediction, wherein the differences of a first filter set with respect to a second filter set have to be transmitted. It is also possible to base the prediction on spatial prediction, wherein the symmetry of the statistical properties of the video signal is exploited.
  • the step of predicting the two-dimensional filter coefficients of a second sub-pel is carried out by the use of an interpolation step with respect to the impulse response of a filter set up of two- dimensional filter coefficients for a first sub-pel, such that the result is used for a second sub-pel. Coding the filter coefficients provides further reduction of the amount of data to be transmitted from an encoder to a decoder.
  • the standard representation form of a filter having one-dimensional filter coefficients is replaced by the corresponding two-dimensional form of the filter. Accordingly, the means provided to encode or decode a video signal can be configured to fulfil only the requirements for a two- dimensional representation form even though two-dimensional and one- dimensional filter sets are used.
  • the method according to the present invention supports all kinds of filtering, such as for example a Wiener-filter having fixed coefficients.
  • the two-dimensional filter can also be a polyphase filter.
  • different filters are provided for different regions of a picture, such that several sets of filter coefficients can be transmitted and the method comprises the step of indicating which filter set is to be used for a specific region. Accordingly, it is not necessary to transmit all individual sets of filter coefficients, if these sets are identical for different regions. Instead of conveying the data related to the filter coefficients repeatedly from the encoder to the decoder, a single flag or the like is used to select the filter set for a specific region.
  • the region can be a macroblock or a slice. In particular, for a macroblock, it is possible to signal the partition id.
  • a different method for encoding a video signal representing a moving picture by use of a motion compensated prediction includes the steps of receiving successive frames of a video signal, coding a frame of the video signal using a reference frame of the video signal and calculating a value of the sub-pel position inde- pendently by minimisation of an optimisation criteria in an adaptive manner.
  • the calculation step of a value of sub-pel position is not only carried out independently, but also by minimisation of an optimisation criteria in an adaptive manner. "In an adaptive manner” implies the use of an adaptive algorithm or iteration. Providing an adaptive solution enables the encoder to find an optimum solution with respect to a certain optimisation criteria.
  • the optimisation criteria may vary in time or for different locations of the sub-pel, entailing a continuously adapted optimum solution.
  • This aspect of the invention can be combined with the step of calculating the value of the sub-pel position analytically by use of a filter having an individual set of two-dimensional filter coefficients, such that the filter coefficients are calculated adaptively.
  • the optimisation criteria can be based on the rate distortion measure or on the prediction error energy.
  • the calculation can be carried out by setting up an individual set of equations for the filter coefficients of each sub-pel position. In particular, with respect to the prediction error energy as an optimisation criteria, it is possible to compute first the derivative of the prediction error energy in order to find an optimum solution.
  • the set of two-dimensional filter coefficients can also profit from setting two-dimensional filter coefficients equal for which the distance of the corresponding full-pel position to the current sub-pel position is equal.
  • the step of equating can be based on statistical properties of the video signal, a still picture, or any other criteria.
  • the two-dimensional filter coefficients can be coded by means of temporal prediction, wherein the differences of a first filter set to a second filter set (e.g. used for the previous image or picture or frame) have to be determined.
  • the filter coefficients can also be coded by a spatial prediction, wherein the symmetry of the statistical properties of the video signal is exploited as set out before.
  • the two-dimensional filter can be a polyphase filter.
  • Different filters can be provided for different regions of a picture, such that several sets of filter coefficients can be transmitted and the method may comprise a step of indicating which filter set is to be used for a specific region. This can be done by a specific flag provided in the coding semantics.
  • the region can be a macro- block or a slice, wherein the partition id can be signalled for each macroblock.
  • a method for encoding and decoding a video signal.
  • the method provides an adaptive filter flag in the syntax of a coding scheme.
  • the adaptive filter flag is suitable to indicate whether a specific filter is used or not. This is particularly useful, since an adaptive filtering step may not be beneficial for all kinds of video signals. Accordingly, a flag (adaptive filter flag) is provided in order to switch on or off the adaptive filter function.
  • a sub-pel is selected for which, among a plurality of sub-pels, a filter coefficient is to be transmitted.
  • This information is included for example in a coding scheme or a coding syntax.
  • it can be indicated whether a set of filter coefficients is to be transmitted for the selected sub-pel. This measure takes account of the fact that filter coefficients are not always calculated for all sub-pels.
  • the adaptive filter flag can be introduced in the picture parameter set raw byte sequence payload syntax of the coding scheme. This is only one example for a position of an adaptive filter flag in the coding syntax. Other flags may be provided to indicate whether an adaptive filter is used for a current macroblock, another region of a picture, or for B- or P-slices.
  • the present invention provides also an apparatus for encoding a video signal representing a moving picture by use of motion compensated prediction.
  • An apparatus according to the present invention comprises means for receiving successive frames of a video signal, means for coding the frame of the video signal using a reference frame of the video signal, and means for calculating analytically a value of a sub-pel position of the reference frame by use of a filter having an individual set of two-dimensional filter coefficients.
  • the apparatus may include means for receiving successive frames of a video signal, means for coding a frame of the video signal using a reference frame of the video signal, and means for calculating a value of a sub-pel position inde- pendently by minimisation of an optimisation criteria in an adaptive manner.
  • the present invention provides also a respective method for decoding a coded video signal being encoded according to the method for encoding the video signal as set out above and an apparatus for decoding a coded video signal comprising means to carry out the method for decoding.
  • the methods and apparatuses for encoding and decoding as well as the coding semantics explained above are applicable to scalable video. It is an aspect of the present invention to provide the methods and apparatuses explained above for scalable video, wherein an independent filter set is used for a layer or a set of layers of the scalable video coding.
  • the filter set for a second layer is predicted from a filter set of a first layer.
  • the layers are typically produced by spatial or temporal decomposition.
  • Fig. 1 shows a simplified diagram of the pels and sub-pels of an im- age
  • Fig. 2 shows another simplified diagram of the pels an sub-pels of an image
  • Fig. 3 shows the prediction of the impulse response of a polyphase filter for sub-pel positions
  • Fig. 4 illustrates an example with interpolated impulse response of a predicted filter at sub-pel position j and calculated filter coefficients
  • Fig. 5 shows the frequency responses of a Wiener filter, applied at half-pel positions, and a bilinear filter, applied at quarter-pel po- sitions.
  • the present invention relates to an adaptive interpolation filter, which is independently estimated for every image.
  • This approach enables to take into account the alteration of image signal properties, especially aliasing, on the basis of minimization of the prediction error energy.
  • an approach is disclosed for efficient coding of filter coefficients, required especially at low bit rates and videos with low spatial resolution.
  • the new scheme of interpolation filter is described.
  • an optimized low-overhead syntax that allows definite filter coefficients decoding is disclosed.
  • a two-dimensional 6x6-tap filter is calculated.
  • the filter coefficients are calculated in a way that an optimization criterion is minimized.
  • the optimization criteria could be the mean squared difference or mean absolute difference between the original and the predicted image signals. Note, that in this proposal we limit the size of the filter to 6x6 and the displacement vector resolution to a quarter-pel, but other filter sizes like 6x4, 4x4, 4x6, 6x1 etc. and displacement vector resolutions are also conceivable with our approach.
  • h O o SP , h O i SP , ... , h ⁇ , h 55 sp are the 36 filter coefficients of a 6x6-tap 2D filter used for a particular sub-pel position SP. Then the value p SP (a ... o) to be interpolated is computed by a convolution:
  • P,j is an integer sample value (A1 ... F6).
  • a first interpolation filter is applied to every reference image.
  • This first interpolation filter could be a fixed one like in the standard H.264/AVC, the filter of the previous image or defined by another method.
  • 2D filter coefficients h,- j are calculated for each sub-pel position SP independently by minimization of the optimization criteria.
  • prediction error energy
  • New displacement vectors are estimated.
  • the adaptive interpolation filter computed in step 2 is applied. This step en- ables reducing motion estimation errors, caused by aliasing, camera noise, etc. on the one hand and to treat the problem in the rate-distortion sense on the other hand.
  • the filter coefficients have to be quantized and transmitted as side information e.g. using an intra/inter-prediction and entropy coding (s. Heading "Prediction and Coding of the Filter Coefficients").
  • Symmetric two-dimensional Filter Since transmitting 360 filter coefficients may result in a high additional bit rate, the coding gain can be drastically reduced, especially for video sequences with small spatial resolution. In order to reduce the side information, we assume that statistical properties of an image signal are symmetric.
  • the filter coefficients are assumed to be equal, in case the distance of the corresponding full-pel positions to the current sub-pel position are equal (the distance equality between the pixels in x- and y-direction is also assumed, i.e. if the image signal is interlaced, a scaling factor should be considered etc.).
  • h C i B a filter coefficient used for computing the interpolated pixel at sub-pel position a at the integer position C1, depicted in Figure 2.
  • the remaining filter coefficients are derived in the same manner. Then, based on symmetry assumptions only 5 independent 1 D or 2D filter sets consisting of different numbers of coefficients are required. Thus, for the sub-pel positions a, c, d, I only one filter with 6 coefficients is estimated, since:
  • the first type is a temporal (inter) prediction, so the differ- ences of the current filter set to the filter set used for the previous image have to be transmitted.
  • This type of coding is applied for filter coefficients at sub-pel positions a and b.
  • the second type is a spatial (intra) prediction. Exploiting the symmetry of statistical properties of an image signal and knowing that no bilinear interpolation is used, coefficients of 2D filters for the different sub-pel positions can be regarded as samples of a common 2D filter, also called as polyphase filter. So, knowing the impulse response of the common filter at particular positions, we can predict its impulse response at other positions by interpolation.
  • Figure 4 illustrates an example with interpolated impulse response of a predicted filter, at sub-pel position; and actually calculated filter coefficients.
  • a matrix for a position f is given:
  • the matrix coefficients for the sub-pel positions /, n, k can be obtained, when rotating the matrix used for the sub-pel position f by 90°, 180° and 270° in mathematical sense, respectively.
  • the same can be applied at sub-pel positions e, g, m and o.
  • the coefficient matrix for the sub-pel position e is given as example. 0 0 1 0 0 0 0
  • the quarter-pel positions are calculated using already quantized half-pel positions, they are quantized twice. This can be avoided, if the quarter-pel positions are calculated directly.
  • coefficients of 2D filter sets can be regarded as samples of one common 2D filter, sampled at different positions. Since the standard filter as used in H.264 uses a bilinear interpolation for quarter-pel positions, its impulse and frequency response diverges from that of the Wiener filter. In order to show, that the standard interpolation filter applied at quarter-pel positions is far away from the Wiener filter, which is the optimal one, if fixed coefficients are preconditioned, the frequency responses of both, Wiener filter, applied at half-pel positions, and a bilinear filter, applied at quarter-pel positions, are depicted in Figure 5.
  • the introduced approach is not restricted to describe settings like quarter-pel motion resolution and 6x6 tap filter size.
  • the filter can be either extended to an 8x8-tap filter, what would result in a better prediction quality, but also increase the computational effort, or reduced to a 4x4-tap filter.
  • Non-separable two-dimensional Adap- tive Wiener Interpolation Filter can be applied to each reference frame independently. Though, this would increase side information.
  • Another extension is defining a set of n predetermined filter sets or n predetermined filters. For each frame, just the index of one or more of the predetermined filter sets is transmitted. Thus, the analytically calculated optimal filter is mapped to the best predetermined filter set or filter of the set. So, only the index of the predetermined filter set or filter (if necessary, entropy coded) needs to be transmitted.
  • the adaptive filter scheme can be switched on or off by the encoder.
  • adaptive_filter_flagB 1 indicates, that adaptive interpolation scheme is in use for B-slices.
  • adaptive_filter_flagB 0 indicates, that adaptive interpolation scheme is not in use for B-slices.
  • the entropy coded filter coefficients are transmitted by the encoder.
  • This code indicates to the decoder that if adaptive_filter_flag is set to 1 and cur- rent slice is a P-Slice than the entropy coded filter coefficients are transmitted.
  • use_all_subpel_positions is transmitted.
  • use_all_subpel_positions 1 specifies that all independent filter subsets are in use.
  • use_all_subpel_positions 0 indicates that not every sub-pel position sub_pel (a...o) has been used by the motion estimation tool and positions_pattem is transmitted, posi- tions_pattern[ sub_pel ] equal to 1 specifies that FilterCoef[ sub_pel ][ i ] is in use, whereat FilterCoef represents the actually transmitted optimal filter coefficients.
  • use_all_subpel_positions signals, if every sub-pel position is in use, posi- tions_pattern cannot be equal to 11111. If use_all_subpel_positions is equal to 0 and the first four entries of positions_pattern are equal to 1 , the last entry G_pos) must be equal to 0 and is not transmitted.
  • the entropy coded here, using CAVLC
  • DiffFilterCoef are transmitted.
  • the reconstructed filter coefficients are obtained by adding differences and predicted filter coefficients.
  • a similar scheme can be applied to a scalable video coder, where for each layer (or for several layers) either independent filter sets or common filter set is used. In case that each layer uses independent filter set, it can be predicted from lower to upper layer.
  • Locally-adaptive filter
  • an additional step at the encoder can be performed, whereby for each macroblock two filter sets, the standard and the adaptive one are compared. For these mac- roblocks where the adaptive filter is better (e.g. in terms of rate-distortion criterion), a new filter is calculated and only this one is transmitted. For the remaining macroblocks, the standard interpolation filter is applied. In order to signal, if the adaptive or the standard filter is applied to the current macroblock, an additional flag has to be transmitted for each macroblock.
  • adaptive_filter_in_current_mb 1 specifies, that adaptive filter is in use for current macroblock.
  • adaptive_filter_in_current_mb 0 specifies, that standard (fixed) filter is in use for current macroblock.
  • adaptive filter_in_current_mb flag would switch between two filter sets, adap- tive_filter_in_current_mb flag can be predicted from neighboring already decoded macroblock so that only the prediction error for adaptive_filter_in_current_mb flag is transmitted. If entropy coding is used (e.g. arithmetic coding, CABAC), this flag can be coded with less than 1 bit/flag.
  • CABAC arithmetic coding
  • the present invention is beneficial for a broad variety of applications such as digital cinema, video coding, digital TV, DVD, blue ray, HDTV, scalable video. All these applications will profit from one or more aspects of the present invention.
  • the present invention is in particular dedicated to improving the MPEG 4 Part 10 H.264/AVC standard.
  • particular semantics are disclosed which may comply with the standard requirements.
  • the basic principle of the present invention should not be constrained to any particular syntax given on the previous pages, but will be acknowledged by the person skilled in the art in a much broader sense.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
PCT/EP2006/003410 2005-04-13 2006-04-13 Method and apparatus for enhanced video coding Ceased WO2006108654A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US11/911,505 US20090022220A1 (en) 2005-04-13 2006-04-13 Method and apparatus for enhanced video coding
EP06742578A EP1886502A2 (en) 2005-04-13 2006-04-13 Method and apparatus for enhanced video coding
JP2008505817A JP2008536414A (ja) 2005-04-13 2006-04-13 ビデオの拡張された符号化方法及び装置

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US59449405P 2005-04-13 2005-04-13
US60/594,494 2005-04-13
US59594105P 2005-08-19 2005-08-19
US60/595,941 2005-08-19

Publications (2)

Publication Number Publication Date
WO2006108654A2 true WO2006108654A2 (en) 2006-10-19
WO2006108654A3 WO2006108654A3 (en) 2007-05-10

Family

ID=36750011

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2006/003410 Ceased WO2006108654A2 (en) 2005-04-13 2006-04-13 Method and apparatus for enhanced video coding

Country Status (4)

Country Link
US (1) US20090022220A1 (enExample)
EP (1) EP1886502A2 (enExample)
JP (1) JP2008536414A (enExample)
WO (1) WO2006108654A2 (enExample)

Cited By (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007002437A3 (en) * 2005-06-24 2007-05-03 Ntt Docomo Inc Method and apparatus for video encoding and decoding using adaptive interpolation
WO2008085109A1 (en) 2007-01-09 2008-07-17 Telefonaktiebolaget Lm Ericsson (Publ) Adaptive filter representation
WO2008084378A3 (en) * 2007-01-09 2008-10-23 Nokia Corp Adaptive interpolation filters for video coding
WO2008149327A3 (en) * 2007-06-04 2009-02-12 France Telecom Method and apparatus for motion-compensated video signal prediction
WO2009087095A1 (en) * 2008-01-08 2009-07-16 Telefonaktiebolaget Lm Ericsson (Publ) Encoding filter coefficients
WO2009126928A1 (en) * 2008-04-10 2009-10-15 Qualcomm Incorporated Symmetry for interpolation filtering of sub-pixel positions in video coding
EP2157799A1 (en) 2008-08-18 2010-02-24 Panasonic Corporation Interpolation filter with local adaptation based on block edges in the reference frame
EP2237557A1 (en) * 2009-04-03 2010-10-06 Panasonic Corporation Coding for filter coefficients
WO2010083438A3 (en) * 2009-01-15 2010-11-11 Qualcomn Incorporated Filter prediction based on activity metrics in video coding
CN101990760A (zh) * 2008-04-10 2011-03-23 高通股份有限公司 用于视频译码中的运动补偿的高级内插技术
JP2011517238A (ja) * 2008-04-10 2011-05-26 クゥアルコム・インコーポレイテッド 固定フィルタまたは適応フィルタに基づくビデオ・コーディングのためのレートひずみ定義補間
JP2011518508A (ja) * 2008-04-10 2011-06-23 クゥアルコム・インコーポレイテッド ビデオコーディングにおけるサブピクセル解像度のための補間フィルタサポート
WO2009089373A3 (en) * 2008-01-08 2011-06-30 Qualcomm Incorporated Video coding with compression of filter coefficients depending on horizontal and vertical symmetry of the filter tap matrix and the position of a filter tap relative to the central tap
CN102172022A (zh) * 2008-10-03 2011-08-31 高通股份有限公司 使用内插滤波器及偏移的数字视频译码
CN102204255A (zh) * 2009-07-07 2011-09-28 松下电器产业株式会社 运动图像解码装置、方法和系统以及集成电路、程序
EP2144446A3 (en) * 2008-07-09 2011-12-14 Intel Corporation Video encoding techniques
US8090031B2 (en) 2007-10-05 2012-01-03 Hong Kong Applied Science and Technology Research Institute Company Limited Method for motion compensation
JP2012186573A (ja) * 2011-03-04 2012-09-27 Kddi Corp 動画像符号化装置、動画像符号化方法、およびプログラム
RU2477576C2 (ru) * 2008-04-10 2013-03-10 Квэлкомм Инкорпорейтед Поддержка интерполяционного фильтра для субпиксельного разрешения в видеокодировании
RU2481727C2 (ru) * 2008-04-10 2013-05-10 Квэлкомм Инкорпорейтед Усовершенствованные технологии интерполяции для компенсации движения при кодировании видео
WO2013011492A3 (en) * 2011-07-21 2013-05-30 Luca Rossato Tiered signal decoding and signal reconstruction
CN103430545A (zh) * 2010-12-21 2013-12-04 英特尔公司 用于高效视频编码的内容适应性运动补偿滤波
CN103546748A (zh) * 2008-07-11 2014-01-29 高通股份有限公司 使用多个滤波程序对视频数据进行滤波
EP2605516A4 (en) * 2010-09-30 2014-05-14 Nippon Telegraph & Telephone PICTURE CODING, PICTURE DECODING, PICTURE CODING DEVICE, IMAGE CODING DEVICE AND PROGRAM THEREFOR
US8804831B2 (en) 2008-04-10 2014-08-12 Qualcomm Incorporated Offsets at sub-pixel resolution
US8811484B2 (en) 2008-07-07 2014-08-19 Qualcomm Incorporated Video encoding by filter selection
US8831086B2 (en) 2008-04-10 2014-09-09 Qualcomm Incorporated Prediction techniques for interpolation in video coding
CN104067613A (zh) * 2011-11-08 2014-09-24 株式会社Kt 图像编码方法和装置以及图像解码方法和装置
US8885730B2 (en) 2009-06-10 2014-11-11 Panasonic Corporation Image coding method, image decoding method, and apparatuses therefor
TWI463878B (zh) * 2009-02-19 2014-12-01 Sony Corp Image processing apparatus and method
US8964853B2 (en) 2011-02-23 2015-02-24 Qualcomm Incorporated Multi-metric filtering
US8971412B2 (en) 2008-04-10 2015-03-03 Qualcomm Incorporated Advanced interpolation techniques for motion compensation in video coding
US9077971B2 (en) 2008-04-10 2015-07-07 Qualcomm Incorporated Interpolation-like filtering of integer-pixel positions in video coding
EP2901703A2 (en) * 2012-09-28 2015-08-05 VID SCALE, Inc. Cross-plane filtering for chroma signal enhancement in video coding
EP2538673A4 (en) * 2010-01-22 2015-12-23 Samsung Electronics Co Ltd DEVICE AND METHOD FOR RANGE-BASED CODING AND DECODING
JP5902814B2 (ja) * 2012-07-09 2016-04-13 日本電信電話株式会社 映像符号化方法および装置、映像復号方法および装置、及びそれらのプログラム
EP2104358A4 (en) * 2006-11-30 2016-04-27 Ntt Docomo Inc DEVICE, METHOD AND PROGRAM FOR DYNAMIC IMAGE DEFINITION, DEVICE, METHOD AND PROGRAM FOR DYNAMIC IMAGE DECODING
WO2017196852A1 (en) * 2016-05-09 2017-11-16 Qualcomm Incorporated Signalling of filtering information
RU2684193C1 (ru) * 2015-05-21 2019-04-04 Хуавэй Текнолоджиз Ко., Лтд. Устройство и способ для компенсации движения в видеоизображении
US10972728B2 (en) 2015-04-17 2021-04-06 Interdigital Madison Patent Holdings, Sas Chroma enhancement filtering for high dynamic range video coding
US11438605B2 (en) 2015-07-08 2022-09-06 Interdigital Madison Patent Holdings, Sas Enhanced chroma coding using cross plane filtering
US12536666B2 (en) 2020-05-27 2026-01-27 Telefonaktiebolaget Lm Ericsson (Publ) Computer software module arrangement, a circuitry arrangement, an arrangement and a method for improved image processing

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070160134A1 (en) * 2006-01-10 2007-07-12 Segall Christopher A Methods and Systems for Filter Characterization
EP2041981B1 (en) * 2006-07-18 2013-09-04 Thomson Licensing Methods and apparatus for adaptive reference filtering
KR101354659B1 (ko) * 2006-11-08 2014-01-28 삼성전자주식회사 멀티 코덱을 지원하는 움직임 보상 방법 및 장치
EP1983759A1 (en) * 2007-04-19 2008-10-22 Matsushita Electric Industrial Co., Ltd. Estimation of separable adaptive interpolation filters for hybrid video coding
EP2048886A1 (en) * 2007-10-11 2009-04-15 Panasonic Corporation Coding of adaptive interpolation filter coefficients
US8184693B2 (en) 2008-04-11 2012-05-22 Intel Corporation Adaptive filtering for bit-depth scalable video codec
JP5628155B2 (ja) * 2008-06-12 2014-11-19 トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ 動き補償の補間フィルタリング及び参照画像のフィルタリングのための局所的な適応フィルタリングの方法及び装置
WO2010038857A1 (ja) * 2008-10-02 2010-04-08 ソニー株式会社 画像処理装置および方法
BRPI1009553A2 (pt) * 2009-03-13 2019-04-09 Thomson Licensing medição de desfocagem em uma imagem comprimida baseada em bloco
US8761268B2 (en) * 2009-04-06 2014-06-24 Intel Corporation Selective local adaptive wiener filter for video coding and decoding
US8218644B1 (en) 2009-05-12 2012-07-10 Accumulus Technologies Inc. System for compressing and de-compressing data used in video processing
US8811485B1 (en) 2009-05-12 2014-08-19 Accumulus Technologies Inc. System for generating difference measurements in a video processor
CN102484713A (zh) * 2009-09-17 2012-05-30 株式会社东芝 运动图像编码方法以及运动图像解码方法
WO2011039931A1 (ja) * 2009-09-30 2011-04-07 三菱電機株式会社 画像符号化装置、画像復号装置、画像符号化方法及び画像復号方法
US20120243611A1 (en) * 2009-12-22 2012-09-27 Sony Corporation Image processing apparatus and method as well as program
WO2011083666A1 (ja) * 2010-01-08 2011-07-14 シャープ株式会社 符号化装置、復号装置、および、データ構造
WO2011086672A1 (ja) * 2010-01-13 2011-07-21 株式会社 東芝 動画像符号化装置および復号装置
JP5323211B2 (ja) * 2010-01-13 2013-10-23 株式会社東芝 動画像符号化装置および復号装置
US8611414B2 (en) * 2010-02-17 2013-12-17 University-Industry Cooperation Group Of Kyung Hee University Video signal processing and encoding
JP5323252B2 (ja) * 2010-03-30 2013-10-23 株式会社東芝 動画像符号化方法、復号化方法、符号化装置および復号化装置
WO2011127961A1 (en) * 2010-04-13 2011-10-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e. V. Adaptive image filtering method and apparatus
US9154807B2 (en) 2010-06-25 2015-10-06 Qualcomm Incorporated Inclusion of switched interpolation filter coefficients in a compressed bit-stream
WO2012000191A1 (en) * 2010-06-30 2012-01-05 France Telecom Research & Development Beijing Company Limited Pixel interpolation method and system
US9247265B2 (en) * 2010-09-01 2016-01-26 Qualcomm Incorporated Multi-input adaptive filter based on combination of sum-modified Laplacian filter indexing and quadtree partitioning
JP2012060208A (ja) * 2010-09-06 2012-03-22 Nippon Telegr & Teleph Corp <Ntt> 動画像符号化方法，動画像符号化装置，動画像復号方法，動画像復号装置およびそれらのプログラム
JP2012124673A (ja) * 2010-12-07 2012-06-28 Sony Corp 画像処理装置、画像処理方法、およびプログラム
US10045046B2 (en) * 2010-12-10 2018-08-07 Qualcomm Incorporated Adaptive support for interpolating values of sub-pixels for video coding
JP5762243B2 (ja) * 2011-10-18 2015-08-12 日本電信電話株式会社 映像符号化方法，装置，映像復号方法，装置およびそれらのプログラム
US10448032B2 (en) * 2012-09-04 2019-10-15 Qualcomm Incorporated Signaling of down-sampling location information in scalable video coding
KR20150050561A (ko) * 2012-09-28 2015-05-08 인텔 코포레이션 계층간 화소 샘플 예측
JP5612177B2 (ja) * 2013-07-17 2014-10-22 株式会社東芝 動画像符号化方法、復号化方法、符号化装置および復号化装置
WO2016068685A1 (ko) * 2014-10-31 2016-05-06 삼성전자 주식회사 고정밀 스킵 부호화를 이용한 비디오 부호화 장치 및 비디오 복호화 장치 및 그 방법
US10390038B2 (en) 2016-02-17 2019-08-20 Telefonaktiebolaget Lm Ericsson (Publ) Methods and devices for encoding and decoding video pictures using a denoised reference picture
US11044480B2 (en) * 2019-01-24 2021-06-22 Google Llc More accurate 2-tap interpolation filters for video compression

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4866647A (en) * 1988-02-04 1989-09-12 American Telephone And Telegraph Company Continuously variable digital delay circuit
US5422827A (en) * 1993-02-12 1995-06-06 Cirrus Logic, Inc. Integrated video scaling and sharpening filter
US6037986A (en) * 1996-07-16 2000-03-14 Divicom Inc. Video preprocessing method and apparatus with selective filtering based on motion detection
US6067125A (en) * 1997-05-15 2000-05-23 Minerva Systems Structure and method for film grain noise reduction
DE19730305A1 (de) * 1997-07-15 1999-01-21 Bosch Gmbh Robert Verfahren zur Erzeugung eines verbesserten Bildsignals bei der Bewegungsschätzung von Bildsequenzen, insbesondere eines Prädiktionssignals für Bewegtbilder mit bewegungskompensierender Prädiktion
US6968008B1 (en) * 1999-07-27 2005-11-22 Sharp Laboratories Of America, Inc. Methods for motion estimation with adaptive motion accuracy
US6600495B1 (en) * 2000-01-10 2003-07-29 Koninklijke Philips Electronics N.V. Image interpolation and decimation using a continuously variable delay filter and combined with a polyphase filter
US6510177B1 (en) * 2000-03-24 2003-01-21 Microsoft Corporation System and method for layered video coding enhancement
DE10120395A1 (de) * 2001-04-25 2002-10-31 Bosch Gmbh Robert Einrichtung zur Interpolation von Abtastwerten sowie Bildencoder und Bilddecoder
CN101448162B (zh) * 2001-12-17 2013-01-02 微软公司 处理视频图像的方法
MXPA04006814A (es) * 2002-01-14 2004-12-06 Nokia Corp Filtros dinamicos de codificacion.
US7389226B2 (en) * 2002-10-29 2008-06-17 Ntt Docomo, Inc. Optimized windows and methods therefore for gradient-descent based window optimization for linear prediction analysis in the ITU-T G.723.1 speech coding standard
US7724818B2 (en) * 2003-04-30 2010-05-25 Nokia Corporation Method for coding sequences of pictures
US7471724B2 (en) * 2003-06-23 2008-12-30 Vichip Corp. Limited Method and apparatus for adaptive multiple-dimensional signal sequences encoding/decoding
US7415069B2 (en) * 2003-12-09 2008-08-19 Lsi Corporation Method for activation and deactivation of infrequently changing sequence and picture parameter sets

Cited By (118)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8208564B2 (en) 2005-06-24 2012-06-26 Ntt Docomo, Inc. Method and apparatus for video encoding and decoding using adaptive interpolation
WO2007002437A3 (en) * 2005-06-24 2007-05-03 Ntt Docomo Inc Method and apparatus for video encoding and decoding using adaptive interpolation
EP2104358A4 (en) * 2006-11-30 2016-04-27 Ntt Docomo Inc DEVICE, METHOD AND PROGRAM FOR DYNAMIC IMAGE DEFINITION, DEVICE, METHOD AND PROGRAM FOR DYNAMIC IMAGE DECODING
US8509316B2 (en) 2007-01-09 2013-08-13 Core Wireless Licensing, S.a.r.l. Adaptive interpolation filters for video coding
US9769490B2 (en) 2007-01-09 2017-09-19 Core Wireless Licensing S.A.R.L. Adaptive interpolation filters for video coding
JP2010516082A (ja) * 2007-01-09 2010-05-13 テレフオンアクチーボラゲット エル エム エリクソン（パブル） 適応フィルタ表現
WO2008084378A3 (en) * 2007-01-09 2008-10-23 Nokia Corp Adaptive interpolation filters for video coding
US8942505B2 (en) 2007-01-09 2015-01-27 Telefonaktiebolaget L M Ericsson (Publ) Adaptive filter representation
WO2008085109A1 (en) 2007-01-09 2008-07-17 Telefonaktiebolaget Lm Ericsson (Publ) Adaptive filter representation
EP2105031A4 (en) * 2007-01-09 2011-06-29 Ericsson Telefon Ab L M ADAPTIVE FILTER REPRESENTATION
WO2008149327A3 (en) * 2007-06-04 2009-02-12 France Telecom Method and apparatus for motion-compensated video signal prediction
US8090031B2 (en) 2007-10-05 2012-01-03 Hong Kong Applied Science and Technology Research Institute Company Limited Method for motion compensation
US8687711B2 (en) 2008-01-08 2014-04-01 Telefonaktiebolaget Lm Ericsson (Publ) Encoding filter coefficients
RU2482616C2 (ru) * 2008-01-08 2013-05-20 Квэлкомм Инкорпорейтед Видеокодирование коэффициентов фильтра на основе горизонтальной и вертикальной симметрии
CN101939993B (zh) * 2008-01-08 2013-01-02 艾利森电话股份有限公司 对滤波器系数进行编码
US8638852B2 (en) 2008-01-08 2014-01-28 Qualcomm Incorporated Video coding of filter coefficients based on horizontal and vertical symmetry
WO2009089373A3 (en) * 2008-01-08 2011-06-30 Qualcomm Incorporated Video coding with compression of filter coefficients depending on horizontal and vertical symmetry of the filter tap matrix and the position of a filter tap relative to the central tap
WO2009087095A1 (en) * 2008-01-08 2009-07-16 Telefonaktiebolaget Lm Ericsson (Publ) Encoding filter coefficients
EP2816806A1 (en) * 2008-04-10 2014-12-24 Qualcomm Incorporated Symmetry for interpolation filtering of sub-pixel positions in video coding
US8804831B2 (en) 2008-04-10 2014-08-12 Qualcomm Incorporated Offsets at sub-pixel resolution
WO2009126928A1 (en) * 2008-04-10 2009-10-15 Qualcomm Incorporated Symmetry for interpolation filtering of sub-pixel positions in video coding
US9077971B2 (en) 2008-04-10 2015-07-07 Qualcomm Incorporated Interpolation-like filtering of integer-pixel positions in video coding
US9967590B2 (en) * 2008-04-10 2018-05-08 Qualcomm Incorporated Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter
US8971412B2 (en) 2008-04-10 2015-03-03 Qualcomm Incorporated Advanced interpolation techniques for motion compensation in video coding
JP2011518508A (ja) * 2008-04-10 2011-06-23 クゥアルコム・インコーポレイテッド ビデオコーディングにおけるサブピクセル解像度のための補間フィルタサポート
CN102017630B (zh) * 2008-04-10 2013-01-23 高通股份有限公司 用于视频译码中的子像素位置的内插滤波的对称性
US20190028736A1 (en) * 2008-04-10 2019-01-24 Qualcomm Incorporated Advanced interpolation techniques for motion compensation in video coding
RU2477576C2 (ru) * 2008-04-10 2013-03-10 Квэлкомм Инкорпорейтед Поддержка интерполяционного фильтра для субпиксельного разрешения в видеокодировании
RU2477577C2 (ru) * 2008-04-10 2013-03-10 Квэлкомм Инкорпорейтед Подобная интерполяции фильтрация положений целочисленных пикселей при видеокодировании
RU2479941C2 (ru) * 2008-04-10 2013-04-20 Квэлкомм Инкорпорейтед Технологии прогнозирования для интерполяции при кодировании видео
RU2481727C2 (ru) * 2008-04-10 2013-05-10 Квэлкомм Инкорпорейтед Усовершенствованные технологии интерполяции для компенсации движения при кодировании видео
JP2011517912A (ja) * 2008-04-10 2011-06-16 クゥアルコム・インコーポレイテッド ビデオコーディングにおけるサブピクセル位置の補間フィルタリングに対する対称性
US11683519B2 (en) 2008-04-10 2023-06-20 Qualcomm Incorporated Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter
US8462842B2 (en) 2008-04-10 2013-06-11 Qualcomm, Incorporated Symmetry for interpolation filtering of sub-pixel positions in video coding
JP2011517238A (ja) * 2008-04-10 2011-05-26 クゥアルコム・インコーポレイテッド 固定フィルタまたは適応フィルタに基づくビデオ・コーディングのためのレートひずみ定義補間
US8831086B2 (en) 2008-04-10 2014-09-09 Qualcomm Incorporated Prediction techniques for interpolation in video coding
JP2013243739A (ja) * 2008-04-10 2013-12-05 Qualcomm Inc ビデオコード化における動き補償のための高度内挿技術
JP2014140192A (ja) * 2008-04-10 2014-07-31 Qualcomm Incorporated 固定フィルタまたは適応フィルタに基づくビデオ・コーディングのためのレートひずみ定義補間
RU2505938C2 (ru) * 2008-04-10 2014-01-27 Квэлкомм Инкорпорейтед Интерполяция на основе искажений в зависимости от скорости передачи для кодирования видео на основе неперестраиваемого фильтра или адаптивного фильтра
CN101990760A (zh) * 2008-04-10 2011-03-23 高通股份有限公司 用于视频译码中的运动补偿的高级内插技术
US10440388B2 (en) * 2008-04-10 2019-10-08 Qualcomm Incorporated Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter
JP2014057333A (ja) * 2008-04-10 2014-03-27 Qualcomm Incorporated ビデオコーディングにおけるサブピクセル解像度のための補間フィルタサポート
CN101990760B (zh) * 2008-04-10 2014-04-23 高通股份有限公司 用于视频译码中的运动补偿的高级内插技术
US8705622B2 (en) 2008-04-10 2014-04-22 Qualcomm Incorporated Interpolation filter support for sub-pixel resolution in video coding
US8811484B2 (en) 2008-07-07 2014-08-19 Qualcomm Incorporated Video encoding by filter selection
CN102905135A (zh) * 2008-07-09 2013-01-30 英特尔公司 视频编码技术
US8625681B2 (en) 2008-07-09 2014-01-07 Intel Corporation Rate-distortion cost reducing video encoding techniques
EP2144446A3 (en) * 2008-07-09 2011-12-14 Intel Corporation Video encoding techniques
CN103546748A (zh) * 2008-07-11 2014-01-29 高通股份有限公司 使用多个滤波程序对视频数据进行滤波
CN103546748B (zh) * 2008-07-11 2017-09-15 高通股份有限公司 使用多个滤波程序对视频数据进行滤波
US11711548B2 (en) 2008-07-11 2023-07-25 Qualcomm Incorporated Filtering video data using a plurality of filters
US10123050B2 (en) 2008-07-11 2018-11-06 Qualcomm Incorporated Filtering video data using a plurality of filters
EP2157799A1 (en) 2008-08-18 2010-02-24 Panasonic Corporation Interpolation filter with local adaptation based on block edges in the reference frame
CN102172022B (zh) * 2008-10-03 2016-08-17 高通股份有限公司 使用内插滤波器及偏移的数字视频译码
CN102172022A (zh) * 2008-10-03 2011-08-31 高通股份有限公司 使用内插滤波器及偏移的数字视频译码
US9078007B2 (en) 2008-10-03 2015-07-07 Qualcomm Incorporated Digital video coding with interpolation filters and offsets
US9143803B2 (en) 2009-01-15 2015-09-22 Qualcomm Incorporated Filter prediction based on activity metrics in video coding
WO2010083438A3 (en) * 2009-01-15 2010-11-11 Qualcomn Incorporated Filter prediction based on activity metrics in video coding
CN102369731B (zh) * 2009-01-15 2015-03-18 高通股份有限公司 基于视频译码中的活动度量的滤波预测
CN102369731A (zh) * 2009-01-15 2012-03-07 高通股份有限公司 基于视频译码中的活动度量的滤波预测
TWI463878B (zh) * 2009-02-19 2014-12-01 Sony Corp Image processing apparatus and method
EP2237557A1 (en) * 2009-04-03 2010-10-06 Panasonic Corporation Coding for filter coefficients
US9232236B2 (en) 2009-04-03 2016-01-05 Panasonic Intellectual Property Corporation Of America Video coding method, video decoding method, video coding apparatus, and video decoding apparatus that use filters for filtering signals
EP2237558A1 (en) * 2009-04-03 2010-10-06 Panasonic Corporation Coding for filter coefficients
US8885730B2 (en) 2009-06-10 2014-11-11 Panasonic Corporation Image coding method, image decoding method, and apparatuses therefor
CN102204255A (zh) * 2009-07-07 2011-09-28 松下电器产业株式会社 运动图像解码装置、方法和系统以及集成电路、程序
CN102204255B (zh) * 2009-07-07 2014-09-17 松下电器产业株式会社 运动图像解码装置、方法和系统以及集成电路
US8811473B2 (en) 2009-07-07 2014-08-19 Panasonic Corporation Moving picture decoding device, moving picture decoding method, moving picture decoding system, integrated circuit, and program
US9386315B2 (en) 2010-01-22 2016-07-05 Samsung Electronics Co., Ltd. Area-based encoding/decoding device and method
EP2538673A4 (en) * 2010-01-22 2015-12-23 Samsung Electronics Co Ltd DEVICE AND METHOD FOR RANGE-BASED CODING AND DECODING
EP2963928A1 (en) * 2010-01-22 2016-01-06 Samsung Electronics Co., Ltd Apparatus and method for encoding and decoding based on region
US9414071B2 (en) 2010-01-22 2016-08-09 Samsung Electronics Co., Ltd. Area-based encoding/decoding device and method
US9386314B2 (en) 2010-01-22 2016-07-05 Samsung Electronics Co., Ltd. Area-based encoding/decoding device and method
US9374587B2 (en) 2010-01-22 2016-06-21 Samsung Electronics Co., Ltd. Area-based encoding/decoding device and method
EP2605516A4 (en) * 2010-09-30 2014-05-14 Nippon Telegraph & Telephone PICTURE CODING, PICTURE DECODING, PICTURE CODING DEVICE, IMAGE CODING DEVICE AND PROGRAM THEREFOR
US10298945B2 (en) 2010-09-30 2019-05-21 Nippon Telegraph And Telephone Corporation Video encoding method, video decoding method, video encoding apparatus, video decoding apparatus, and programs thereof
CN103430545A (zh) * 2010-12-21 2013-12-04 英特尔公司 用于高效视频编码的内容适应性运动补偿滤波
US8964853B2 (en) 2011-02-23 2015-02-24 Qualcomm Incorporated Multi-metric filtering
US8964852B2 (en) 2011-02-23 2015-02-24 Qualcomm Incorporated Multi-metric filtering
US9258563B2 (en) 2011-02-23 2016-02-09 Qualcomm Incorporated Multi-metric filtering
USRE50496E1 (en) 2011-02-23 2025-07-15 Qualcomm Incorporated Multi-metric filtering
US9877023B2 (en) 2011-02-23 2018-01-23 Qualcomm Incorporated Multi-metric filtering
US9819936B2 (en) 2011-02-23 2017-11-14 Qualcomm Incorporated Multi-metric filtering
US8982960B2 (en) 2011-02-23 2015-03-17 Qualcomm Incorporated Multi-metric filtering
US8989261B2 (en) 2011-02-23 2015-03-24 Qualcomm Incorporated Multi-metric filtering
CN102655591B (zh) * 2011-03-04 2016-12-14 Kddi株式会社 运动图像编码装置、运动图像解码装置以及运动图像编码方法
JP2012186573A (ja) * 2011-03-04 2012-09-27 Kddi Corp 動画像符号化装置、動画像符号化方法、およびプログラム
US8976864B2 (en) 2011-03-04 2015-03-10 Kddi Corporation Video encoding apparatus, video encoding method, and computer program
US8948248B2 (en) 2011-07-21 2015-02-03 Luca Rossato Tiered signal decoding and signal reconstruction
WO2013011492A3 (en) * 2011-07-21 2013-05-30 Luca Rossato Tiered signal decoding and signal reconstruction
CN108712646A (zh) * 2011-07-21 2018-10-26 卢卡·罗萨托 分层信号解码和信号重构
KR102165147B1 (ko) * 2011-07-21 2020-10-14 루카 로사토 계층형 신호 디코딩 및 신호 복원
KR20140051344A (ko) * 2011-07-21 2014-04-30 루카 로사토 계층형 신호 디코딩 및 신호 복원
CN108712646B (zh) * 2011-07-21 2022-12-06 威诺瓦国际有限公司 分层信号解码和信号重构的方法、系统和存储介质
EA032859B1 (ru) * 2011-07-21 2019-07-31 Лука Россато Многоуровневое декодирование сигнала и восстановление сигнала
US9554140B1 (en) 2011-11-08 2017-01-24 Kt Corporation Method and apparatus for encoding image, and method and apparatus for decoding image
US9578338B1 (en) 2011-11-08 2017-02-21 Kt Corporation Method and apparatus for encoding image, and method and apparatus for decoding image
US9729893B2 (en) 2011-11-08 2017-08-08 Kt Corporation Method and apparatus for encoding image, and method and apparatus for decoding image
CN104067613A (zh) * 2011-11-08 2014-09-24 株式会社Kt 图像编码方法和装置以及图像解码方法和装置
JP5902814B2 (ja) * 2012-07-09 2016-04-13 日本電信電話株式会社 映像符号化方法および装置、映像復号方法および装置、及びそれらのプログラム
EP2901703A2 (en) * 2012-09-28 2015-08-05 VID SCALE, Inc. Cross-plane filtering for chroma signal enhancement in video coding
US10397616B2 (en) 2012-09-28 2019-08-27 Vid Scale, Inc. Cross-plane filtering for chroma signal enhancement in video coding
US12262064B2 (en) 2012-09-28 2025-03-25 Interdigital Madison Patent Holdings, Sas Cross-plane filtering for chroma signal enhancement in video coding
US10798423B2 (en) 2012-09-28 2020-10-06 Interdigital Madison Patent Holdings, Sas Cross-plane filtering for chroma signal enhancement in video coding
US11356708B2 (en) 2012-09-28 2022-06-07 Interdigital Madison Patent Holdings, Sas Cross-plane filtering for chroma signal enhancement in video coding
US10972728B2 (en) 2015-04-17 2021-04-06 Interdigital Madison Patent Holdings, Sas Chroma enhancement filtering for high dynamic range video coding
RU2684193C1 (ru) * 2015-05-21 2019-04-04 Хуавэй Текнолоджиз Ко., Лтд. Устройство и способ для компенсации движения в видеоизображении
US10536716B2 (en) 2015-05-21 2020-01-14 Huawei Technologies Co., Ltd. Apparatus and method for video motion compensation
US11438605B2 (en) 2015-07-08 2022-09-06 Interdigital Madison Patent Holdings, Sas Enhanced chroma coding using cross plane filtering
WO2017196852A1 (en) * 2016-05-09 2017-11-16 Qualcomm Incorporated Signalling of filtering information
CN109076228B (zh) * 2016-05-09 2022-05-24 高通股份有限公司 滤波信息的发信号
KR102465720B1 (ko) 2016-05-09 2022-11-10 퀄컴 인코포레이티드 필터링 정보의 시그널링
US10887604B2 (en) 2016-05-09 2021-01-05 Qualcomm Incorporation Signalling of filtering information
US10382766B2 (en) 2016-05-09 2019-08-13 Qualcomm Incorporated Signalling of filtering information
EP3456046A1 (en) * 2016-05-09 2019-03-20 Qualcomm Incorporated Signalling of filtering information
KR20190006174A (ko) * 2016-05-09 2019-01-17 퀄컴 인코포레이티드 필터링 정보의 시그널링
CN109076228A (zh) * 2016-05-09 2018-12-21 高通股份有限公司 滤波信息的发信号
US12536666B2 (en) 2020-05-27 2026-01-27 Telefonaktiebolaget Lm Ericsson (Publ) Computer software module arrangement, a circuitry arrangement, an arrangement and a method for improved image processing

Also Published As

Publication number Publication date
US20090022220A1 (en) 2009-01-22
WO2006108654A3 (en) 2007-05-10
EP1886502A2 (en) 2008-02-13
JP2008536414A (ja) 2008-09-04

Similar Documents

Publication Publication Date Title
EP1886502A2 (en) Method and apparatus for enhanced video coding
US11889065B2 (en) Method of decoding motion vector
CN107959858B (zh) 视频信号解码方法
US9516319B2 (en) Method of deriving motion information
KR101403343B1 (ko) 부화소 움직임 추정을 이용한 인터 예측 부호화, 복호화방법 및 장치
US9648343B2 (en) Method of decoding video data
US7535961B2 (en) Video encoding/decoding apparatus and method for color image
US20150139317A1 (en) Method and apparatus for encoding image, and method and apparatus for decoding image
JP5211240B2 (ja) フレームの１つ以上の画素を補間するためのフィルタを決定する方法
US20110002554A1 (en) Digital image compression by residual decimation
WO2010144408A1 (en) Digital image compression by adaptive macroblock resolution coding
CN101009832A (zh) 方向内插方法和使用该方法的视频编码/解码设备和方法
EP2724534A2 (en) Selection of phase offsets for interpolation filters for motion compensation
WO2011095583A2 (en) Improved method and apparatus for sub-pixel interpolation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2008505817

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

WWE Wipo information: entry into national phase

Ref document number: 2006742578

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: RU

WWW Wipo information: withdrawn in national office

Country of ref document: RU

WWP Wipo information: published in national office

Ref document number: 2006742578

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 11911505

Country of ref document: US