WO2016138779A1 - 帧内编解码方法、编码器和解码器 - Google Patents
帧内编解码方法、编码器和解码器 Download PDFInfo
- Publication number
- WO2016138779A1 WO2016138779A1 PCT/CN2015/096021 CN2015096021W WO2016138779A1 WO 2016138779 A1 WO2016138779 A1 WO 2016138779A1 CN 2015096021 W CN2015096021 W CN 2015096021W WO 2016138779 A1 WO2016138779 A1 WO 2016138779A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- type
- pixel
- pixels
- value
- transform coefficients
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
- H04N19/122—Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/18—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
- H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
Definitions
- the present invention relates to the field of video coding and decoding, and in particular, to an intraframe coding and decoding method, an encoder, and a decoder.
- video signals Due to the large amount of information, video signals have high requirements on transmission network bandwidth or media storage space. Therefore, the video signal is transmitted before being compressed and then transmitted to save the transmitted network bandwidth or the storage space of the medium.
- the main goal of video compression coding is to make the distortion of the reconstructed image as small as possible at a certain rate/bitrate.
- Conventional intraframe coding usually includes multiple steps of prediction, transform, quantization, entropy coding, etc. Specifically, first, for an image block, according to the reconstruction of the image block. Intra prediction is performed with reference to the pixels. Intra prediction methods such as 33 directional predictions in High Efficiency Video Coding (HEVC), Direct Current (DC) prediction, Planar prediction, or prediction based on template matching. Then, the original pixel value of the image block (that is, the original pixel uncompressed value in the image block) and the predicted pixel value (that is, the predicted value of the pixel in the image block through prediction) Subtract, the residual of the entire image block is obtained. The residual value is transformed to obtain a transform coefficient. Thereafter, the transform coefficients are quantized to obtain a quantized transform coefficient. Finally, the prediction mode information and the residual difference information represented by the quantized transform coefficients are encoded into a code stream by an entropy coding method.
- HEVC High Efficiency Video Coding
- DC Direct Current
- Planar prediction Planar prediction
- video decoding is a process of converting a code stream into a video image.
- Traditional intraframe decoding includes entropy decoding, prediction, dequantization, and inverse transform.
- the code stream is parsed out of the coding mode information and the quantized transform coefficients by entropy decoding processing.
- the intra prediction mode information and the reconstructed pixels that have been decoded The predicted pixel is obtained;
- the quantized transform coefficient is inversely quantized to obtain the reconstructed transform coefficient, and then the reconstructed transform coefficient is inversely transformed to obtain the reconstructed residual difference information.
- the reconstructed residual value information is added to the predicted pixels to obtain reconstructed pixels, thereby recovering the video image.
- the existing coding method is not flexible enough and the coding efficiency is low.
- the embodiment of the invention provides a method, an encoder and a decoder for intraframe coding and decoding, and the intraframe coding method can flexibly encode and improve coding efficiency.
- the first aspect provides a method for intra-frame coding, including: acquiring a reference pixel value of a current image block; and obtaining, by using an intra prediction algorithm, a first type of pixel in the current image block according to the reference pixel value of the current image block; a predicted value, the current image block includes a first type of pixel and a second type of pixel, wherein the second type of pixel is a pixel other than the first type of pixel in the current image block; and a predicted value according to the first type of pixel Determining the residual value of the first type of pixel with the original pixel value of the first type of pixel; obtaining a transform coefficient according to the residual value of the first type of pixel; and quantizing the transform coefficient to obtain a quantized transform coefficient; according to the quantized transform a coefficient and a predicted value of the first type of pixel, reconstructing the first type of pixel to obtain a reconstructed value of the first type of pixel; and according to the reconstructed value of the first type of
- the method further includes: according to the intra prediction The algorithm determines the interpolation method, wherein the interpolation method in the interpolation method is the same as the interpolation method included in the intra prediction algorithm.
- the transform coefficient is obtained according to the residual value of the first type of pixel, including: Obtaining a residual value of B pixels in the second type of pixel according to a residual value of the first type of pixel, where B is a positive integer not less than 1, and a residual value of the first type of pixel and the B pixel The residual value is transformed to obtain the transform coefficient, wherein the number of fixed zero coefficients in the transform coefficient is equal to B.
- the number of residual values of the first type of pixels is A
- the B pixels of the second type of pixels correspond to B residual values.
- the A residual value is in one-to-one correspondence with the pixels in the first type of pixels
- the B residual values are in one-to-one correspondence with the B pixels, and the residual value is obtained according to the residual value of the first type of pixels.
- a residual value of the B pixels comprising: a B ⁇ A matrix corresponding to the number A of residual values of the first type of pixels and the number B of residual values of B pixels of the second type of pixels; Multiplying the B ⁇ A matrix by a column vector composed of residual values of the A first type of pixels to obtain a column vector formed by residual values of B pixels in the second type of pixels; according to the second type A column vector formed by residual values of B pixels in a pixel obtains a residual value of B pixels in the second type of pixel.
- the obtaining the transform coefficient according to the residual value of the first type of pixel includes: Subtracting the predicted value of each pixel from the original value of each of the at least one of the second type of pixels to obtain a residual value of each of the pixels, wherein the predicted value of each pixel is a frame Obtained by the intra prediction algorithm; transforming the residual value of the first type of pixel and the residual value of at least one pixel of the second type of pixel to obtain the transform coefficient.
- any one of the first to the fourth possible implementation manners in a fifth possible implementation manner, is quantized to obtain quantized transform coefficients, including The transform coefficients are quantized by the scan order of the transform coefficients to obtain quantized transform coefficients.
- the transform coefficient is quantized according to a scan order of the transform coefficients to obtain quantized transform coefficients, including: obtaining the quantized transform coefficients according to the following formula:
- C m is the mth transform coefficient excluding the fixed 0 coefficient in the scanning order
- Q(*) is the quantization processing function
- ⁇ m is a correction term determined by the quantization error of the transform coefficient after C m
- b m,j is the weighting coefficient, by the transformation matrix and the scanning order
- any one of the first to the sixth possible implementation manners in a seventh possible implementation manner, the predicted value according to the first type of pixel and the first type The original pixel value of the pixel is obtained as a residual value of the first type of pixel, including: subtracting the predicted value of the first type of pixel from the original value of the first type of pixel to obtain a residual value of the first type of pixel.
- the method further includes: generating a code stream according to the quantized transform coefficient, so that the decoding device reconstructs the current image block according to the code stream.
- the generating the code stream according to the quantized transform coefficient includes: using an entropy coding method, performing information about the intra prediction algorithm and the quantized transform coefficient Encode to get the code stream.
- the generating a code stream according to the quantized transform coefficient includes: using an entropy coding method, information about the intra prediction algorithm, the quantized transform coefficient, and The information of the interpolation method is encoded to obtain the code stream.
- a method for intra-frame decoding including: acquiring a reference pixel value of a current image block; and obtaining, by using an intra prediction algorithm, a first type of pixel in the current image block according to the reference pixel value of the current image block; a prediction value, the current image block includes a first type of pixel and a second type of pixel, wherein the second type of pixel is a pixel other than the first type of pixel in the current image block; and the quantized transform coefficient of the current image block is reversed Quantizing, obtaining a transform coefficient; performing inverse transform on the transform coefficient to obtain a reconstructed residual value of the first type of pixel; adding the reconstructed residual value of the first type of pixel to the predicted value of the first type of pixel, a reconstructed value of the first type of pixel; and a reconstructed value of the second type of pixel is obtained by interpolation according to the reconstructed value of the first type of pixel.
- the method before inverse transforming the transform coefficient, the method further includes: placing the transform coefficient in a first type of preset in the transform coefficient matrix according to a scan order of the transform coefficients a position, wherein a transform coefficient of the second type of preset position in the transform coefficient matrix is set to a preset value, and a sum of the number of the second type of preset positions and the number of the first type of preset positions is equal to the transform coefficient The total number of transform coefficients in the matrix.
- the reconstructed value of the second type of pixel is obtained by interpolation according to the reconstructed value of the first type of pixel
- the method further includes: determining the interpolation method according to the intra prediction algorithm, and the interpolation method in the interpolation method is the same as the interpolation method included in the intra prediction algorithm.
- the reconstructed value of the second type of pixel is obtained by interpolation according to the reconstructed value of the first type of pixel Previously, the method further includes: determining the interpolation method according to a code stream of the image block.
- an encoder including: a first acquiring unit, configured to acquire a reference pixel value of a current image block; and a second acquiring unit, configured to use an intra prediction according to a reference pixel value of the current image block.
- the algorithm obtains a predicted value of the first type of pixel in the current image block, the current image block a first type of pixel and a second type of pixel, wherein the second type of pixel is a pixel other than the first type of pixel in the current image block;
- the first determining unit is configured to use the predicted value of the first type of pixel and the The original pixel value of the first type of pixel obtains the residual value of the first type of pixel;
- the transform unit is configured to obtain a transform coefficient according to the residual value of the first type of pixel; and a quantization unit, configured to quantize the transform coefficient, to obtain a first transform unit, configured to reconstruct the first type of pixel according to the quantized transform coefficient and the predicted value of the first type of pixel, to obtain a reconstructed value of the first type of pixel; and a second reconstruction unit,
- the reconstructed value of the second type of pixel is obtained by interpolation according to the reconstructed value of the first type of pixel.
- the method further includes: a second determining unit, configured to determine the interpolation method according to the intra prediction algorithm, where the interpolation method and the intra prediction in the interpolation method
- the algorithm includes the same interpolation method.
- the transform unit is specifically configured to use the residual of the first type of pixel
- the difference is obtained by the residual value of the B pixels in the second type of pixel, and B is a positive integer not less than 1, and the residual value of the first type of pixel and the residual value of the B pixel are transformed to obtain The transform coefficient, wherein the number of fixed zero coefficients in the transform coefficient is equal to B.
- the number of residual values of the first type of pixels is A
- the B pixels of the second type of pixels correspond to B.
- a residual value wherein the A residual values are in one-to-one correspondence with the pixels in the first type of pixels
- the B residual values are in one-to-one correspondence with the B pixels
- the third acquiring unit is specifically configured to determine a B ⁇ A matrix corresponding to the number A of residual values of the first type of pixels and the number B of residual values of B pixels in the second type of pixels; the B ⁇ A matrix and the first of the A Multiplying the column vectors of the residual values of the pixel-like pixels to obtain a column vector formed by the residual values of the B pixels in the second type of pixels; according to the residual values of the B pixels in the second type of pixels The constructed column vector obtains the residual value of the B pixels in the second type of pixel.
- the transform unit is specifically used in the second type of pixel Substituting the predicted value of each pixel of the at least one pixel to obtain a residual value of each pixel, wherein the predicted value of each pixel is obtained by using an intra prediction algorithm; The residual value of the first type of pixel and the residual value of at least one of the second type of pixels are transformed to obtain the transform coefficient.
- the quantization unit is specifically configured to scan according to the transform coefficient The transform coefficients are sequentially quantized to obtain quantized transform coefficients.
- the quantization unit is specifically configured to obtain the quantized transform coefficient according to the following formula:
- C m is the mth transform coefficient excluding the fixed 0 coefficient in the scanning order
- Q(*) is the quantization processing function
- ⁇ m is a correction term determined by the quantization error of the transform coefficient after C m
- b m,j is the weighting coefficient, by the transformation matrix and the scanning order
- the first determining unit is specifically configured to use the The original value of a type of pixel is subtracted from the predicted value of the first type of pixel to obtain a residual value of the first type of pixel.
- the method further includes: generating, The transform coefficients generate a code stream such that the decoding device reconstructs the current image block from the code stream.
- the generating unit is specifically configured to use the entropy coding method to encode the information of the intra prediction algorithm and the quantized transform coefficient, The code stream is obtained.
- the generating unit is specifically configured to adopt an entropy coding method, information about the intra prediction algorithm, the quantized transform coefficient, and the interpolation
- the information of the method is encoded to obtain the code stream.
- a fourth aspect provides a decoder, including: a first acquiring unit, configured to acquire a reference pixel value of a current image block; and a second acquiring unit, configured to use an intra prediction according to a reference pixel value of the current image block.
- the algorithm obtains a predicted value of the first type of pixel in the current image block, the current image block includes a first type of pixel and a second type of pixel, and the second type of pixel is a pixel other than the first type of pixel in the current image block;
- An inverse quantization unit configured to inverse quantize the quantized transform coefficients of the current image block, Obtaining a transform coefficient; an inverse transform unit, configured to inverse transform the transform coefficient to obtain a reconstructed residual value of the first type of pixel; and a first reconstruction unit configured to reconstruct the residual residual value of the first type of pixel
- the predicted values of the first type of pixels are added to obtain a reconstructed value of the first type of pixels; and the second reconstructing unit is configured
- the method further includes: a placing unit, configured to: place the transform coefficient in a first type preset position in a matrix of transform coefficients according to a scan order of transform coefficients, where The transform coefficient of the second type of preset position in the transform coefficient matrix is set to a preset value, and the sum of the number of the second type of preset positions and the number of the first type of preset positions is equal to the transform coefficient of the transform coefficient matrix The total number.
- a placing unit configured to: place the transform coefficient in a first type preset position in a matrix of transform coefficients according to a scan order of transform coefficients, where The transform coefficient of the second type of preset position in the transform coefficient matrix is set to a preset value, and the sum of the number of the second type of preset positions and the number of the first type of preset positions is equal to the transform coefficient of the transform coefficient matrix The total number.
- the method further includes: a first determining unit, configured to determine, according to the intra prediction algorithm, the interpolation method, the interpolation
- the interpolation method in the method is the same as the interpolation method included in the intra prediction algorithm.
- the third possible implementation manner further includes: a second determining unit, configured to determine the interpolation method according to the code stream of the image block.
- the embodiment of the present invention obtains a code stream by transforming and quantizing only the residual value of the first type of pixel, and does not need to encode the residual value of the entire image block, and can flexibly encode and improve coding efficiency.
- FIG. 1 is a schematic flow chart of a method of intra coding according to an embodiment of the present invention.
- FIG. 2 is a schematic diagram showing the classification of a first type of pixel and a second type of pixel of a 4x4 image block, in accordance with one embodiment of the present invention.
- FIG. 3 is a schematic diagram showing the classification of a first type of pixel and a second type of pixel of an 8x8 image block, in accordance with one embodiment of the present invention.
- FIG. 4 is a schematic diagram of a transformation in accordance with one embodiment of the present invention.
- Figure 5 is a schematic illustration of a scanning sequence in accordance with one embodiment of the present invention.
- FIG. 6 is a schematic flowchart of a method of intra decoding according to an embodiment of the present invention.
- Figure 7 is a schematic block diagram of an encoder in accordance with one embodiment of the present invention.
- Figure 8 is a schematic block diagram of a decoder in accordance with one embodiment of the present invention.
- FIG. 9 is a schematic block diagram of an encoder in accordance with another embodiment of the present invention.
- Figure 10 is a schematic block diagram of a decoder in accordance with one embodiment of the present invention.
- the pixel value in the present invention may be the luminance component value of the pixel, or may be the chrominance component value of the pixel (such as one of the Cb and Cr components), or may be one of the R, G, and B component values;
- a pixel is represented by other color spaces such as Lab (color model), HSV (hue, saturation, and brightness), it can also be one of these color components.
- the transform coefficients and residual values also correspond to this color component.
- FIG. 1 is a schematic flow chart of a method of intra coding according to an embodiment of the present invention.
- the method shown in FIG. 1 can be performed by an encoder.
- the method shown in FIG. 1 includes:
- the current image block includes a first type of pixel and a second type of pixel, and the second type of pixel is a current image.
- the reconstructed value of the first type of pixel is obtained by interpolation.
- the embodiment of the present invention obtains a code stream by transforming and quantizing only the residual values of the first type of pixels, and does not need to encode the residual values of the entire image block, and can flexibly encode, thereby improving coding efficiency.
- the embodiment of the present invention is based on quantized transform coefficients and first type pixels (part of pixels)
- the predicted value is reconstructed for the first type of pixel to obtain the reconstructed value of the first type of pixel; and the second type of pixel (the other part of the pixel) is directly reconstructed using an interpolation method based on a portion of the reconstructed pixel.
- the current image block can be any one or one of the current frames.
- the image blocks in the embodiments of the present invention may be image blocks of various sizes, for example, may be 3 ⁇ 3, 4 ⁇ 4, 8 ⁇ 8, 16 ⁇ 16, 32 ⁇ 32, 64 ⁇ 64, 8 ⁇ 4, 4 ⁇ 8, 16 ⁇ 12 or 9 ⁇ 9 image blocks and the like, and embodiments of the present invention are not limited thereto.
- the pixels in the current image block include two types of pixels, which are a first type of pixels and a second type of pixels, wherein the first type of pixels may be pixels located at any position in the current image block, for example, the first type.
- the pixel may be located at a right boundary, a lower boundary, a center, a lower left diagonal line, a lower right diagonal line, or the like of the current image block, or may be located at other positions; the number of the first type of pixels is greater than 0 and smaller than the pixels of the entire current image block.
- the number, for example, the number of pixels of the first type is 1/2, 7/16, 15/32, 3/4 or 1/4 of the total number of pixels of the current image block.
- the second type of pixel is a pixel in the image block other than the first type of pixel.
- FIG. 2 is a classification example of a first type of pixel and a second type of pixel of a 4 ⁇ 4 image block according to an embodiment of the present invention, and FIG. 2 shows eight examples, and FIG. 2(a) to FIG. 2(h) The classification of the first type of pixels and the second type of pixels in Fig. 2(a) can be employed.
- the classification of the first type of pixels and the second type of pixels in a larger image block can be viewed as a combination of a plurality of small image blocks, for example, an 8x8 image block or a pixel classification of a larger image block.
- Four or more pixel classification combinations of image blocks smaller than the image block size may be used, for example, the pixel classification of 8 ⁇ 8 blocks in the example of FIG. 3(a) is classified by the pixel classification of the 4 ⁇ 4 block of FIG. 2(a).
- the pixel classification of four 4 ⁇ 4 blocks in the 8 ⁇ 8 block is the pixel classification method of the 4 ⁇ 4 block illustrated in FIG.
- the pixel classification of 8 ⁇ 8 blocks or larger blocks may also be Other approaches are used, such as Figures 2b, 2c, and 2d in Figure 2. All intra prediction modes may use the same pixel classification; different intra-prediction modes may also use different pixel classifications; or several intra prediction modes may use the same pixel classification.
- the pixel processing method in FIG. 2(a) is mainly taken as a 4 ⁇ 4 image block, and a specific processing method is introduced.
- the intra prediction algorithm may include directional prediction, DC prediction or Planar prediction in H.265/HEVC or H.264/AVC (Advanced Video Coding), or may be template-based matching.
- the intra prediction and the like are not limited in the embodiment of the present invention.
- the decoder and the encoder may be the same device, and the decoder and the encoder may also be different devices, which are not limited by the embodiment of the present invention.
- the original value of the first type of pixel may be subtracted from the predicted value of the first type of pixel to obtain a residual value of the first type of pixel. It is also possible to subtract the predicted value of the first type of pixel from the original value of the first type of pixel to obtain the residual value of the first type of pixel.
- the residual value of the first type of pixel obtained by the first method is opposite to the residual value of the first type of pixel obtained by the second method.
- the first way can be used to obtain the residual values of the first type of pixels.
- the first residual value of the residual values of the first type of pixels is the difference between the original value of the first pixel and the predicted value, in other words, the residual of the first type of pixel.
- Each residual value of the value is the difference between the original value of the same first type of pixel and the predicted value.
- the original value of the second type of pixel can be subtracted from the predicted value of the second type of pixel to obtain the residual value of the second type of pixel.
- the residual values of the first type of pixels may be transformed in various forms, for example, one-dimensional transformation or two-dimensional transformation may be performed, wherein the two-dimensional transformation may be a two-dimensional discrete cosine transform (DCT). Or a two-dimensional discrete sine transform (DST) or the like, and embodiments of the present invention are not limited thereto.
- DCT discrete cosine transform
- DST discrete sine transform
- a transformation of a square can be transformed using the following formula:
- C is a matrix of transform coefficients, including a plurality of transform coefficients
- E is a matrix of residual values
- the matrix of residual values includes at least residual values of all first type of pixels, and may also include residual values of at least one second type of pixels
- H is a transformation matrix
- H T is a transposed matrix of the transformation matrix H, for example, when H is a 4 ⁇ 4 DST transformation matrix
- an 8 ⁇ 8 DCT matrix can use the DCT matrix specified in the HEVC standard.
- the number of non-zero transform coefficients in the transform coefficients is less than or equal to the number of pixels of the first type.
- the transform coefficients can be quantized in a variety of forms, for example, a method,
- the transform coefficient can be divided by the quantization step and rounded to an integer, which is called normal quantization processing.
- Another method can be quantized using the Rate-distortion optimized quantization (RDOQ) method.
- RDOQ Rate-distortion optimized quantization
- the quantized transform coefficients are inverse quantized to obtain reconstructed transform coefficients; and the reconstructed transform coefficients are inversely transformed to obtain reconstructed residual values of the first type of pixels; The reconstructed residual value is added to the predicted value of the first type of pixel to obtain a reconstructed value of the first type of pixel.
- the inverse quantization process may be to multiply the quantized transform coefficients by the quantization step size to obtain the reconstructed transform coefficients; wherein the operation of multiplying the quantization step size may also be performed by using integer multiplication plus shift, for example, H.265/HEVC
- the inverse quantization process is:
- Q(i) is the i-th quantized transform coefficient
- R(i) is the reconstructed transform coefficient
- bdshift is the shift parameter
- Qs'(i) is an integer
- Qs' (i)/2 bdshift approximates the quantization step size.
- Qs'(i) is determined by the level scale and the scaling factor.
- the transform coefficients are obtained, and the transform coefficients may be placed in a first order preset position in the matrix of transform coefficients according to the scan order, wherein the transform coefficients of the second type of preset positions in the transform coefficient matrix are set as presets.
- the value, the number of the second type of preset positions is greater than or equal to 0 and less than the total number of transform coefficients in the transform coefficient matrix, for example, the preset value may be 0; the transform coefficient matrix is divided into two parts, that is, the first type of preset position and the first The second type of preset position.
- the scanning order may include vertical scanning, horizontal scanning, or diagonal scanning.
- the three scanning sequences shown in FIG. 5 are vertical scanning of FIG. 5(a), horizontal scanning of FIG. 5(b), and diagonal scanning of FIG. 5(c), respectively.
- inverse transform forms there are various forms of inverse transform forms.
- a two-dimensional separable transform such as DCT inverse transform or DST inverse transform may be used.
- DCT inverse transform or DST inverse transform
- a transform coefficient matrix reconstructed after inverse quantization including a plurality of reconstructed transform coefficients
- To reconstruct the residual difference matrix which includes a plurality of reconstruction residual values
- H is a transform matrix
- H T is a transposed matrix of the transformation matrix H
- the residual values obtained by the inverse transformation include at least all of the first classes
- the residual value of the pixel may also include the residual value of at least one second type of pixel.
- the size of the inverse transform can be the same as the size of the image block.
- the number of residuals generated by the inverse transform is equal to the number of pixels in the image block. For the two-dimensional DST and two-dimensional DCT, the two-dimensional separable transform satisfies the transformation matrix.
- the size is equal to the size of the image block.
- the inverse transform can also be smaller than the size of the image block. For example, for the 4 ⁇ 4 block in the example of FIG. 2(f), the 3 ⁇ 3 block in the lower right corner contains all the first type of pixels. In this case, the reconstructed transform coefficients are inversely transformed by the inverse transform of 3 ⁇ 3, and the 3 ⁇ is obtained.
- the residual value of 3 blocks; for example, for the 8 ⁇ 8 block in the example of FIG. 3( a ), 4 4 ⁇ 4 blocks can be used to obtain 4 4 ⁇ 4 block residual values for 4 ⁇ 4 blocks respectively. .
- the inverse transform can simultaneously generate the residual values of the first type of pixels and the second type of pixels in the image block; to save the calculation, only the residual values of the first type of pixels can be generated without generating the residual values of the second type of pixels.
- the residual value and the predicted value may exceed the dynamic range of the pixel, for example, the dynamic range of the 8-bit pixel is 0 to 255, therefore, in the embodiment of the present invention, when the residual value and the predicted value are added When the predicted value exceeds the upper or lower limit of the dynamic range of the pixel, the predicted value is set to the maximum or minimum value of the dynamic range, for example, 255 or 0.
- the process of reconstructing the first type of pixels may be the same as the process of reconstructing the first type of pixels in the decoding method shown in FIG. 6.
- the decoding method involves the process of reconstructing the first type of pixels. To avoid repetition, it is not detailed here.
- the method of the embodiment of the present invention further includes determining an interpolation method according to an intra prediction algorithm, where an interpolation manner in the interpolation method is the same as an interpolation method included in the intra prediction algorithm.
- the interpolation method can be determined by an intra prediction algorithm in 120, and the reconstructed value of the second type of pixel can be obtained by interpolation according to the reference pixel of the image block or/and the reconstructed value of the first type of pixel.
- the interpolation method has various forms, and several methods of reconstructing the second pixel are described below.
- Method 1 Interpolation method based on the average of surrounding pixels.
- a reference pixel around the second type of pixel or/and a reconstructed first type of pixel is obtained, and the pixels are weighted averaged to interpolate to obtain a reconstructed value of the second type of pixel.
- reference pixels R 0,0 , R 0,1 , R 0,2 , R 1,0 , R 2,0 reference pixels R 0,0 , R 0,1 , R 0,2 , R 1,0 , R 2,0
- the weighted average of the reconstructed first type of pixels R 2,2 yields P 1,1
- the weighted average method that can be used is one of the following:
- the pixel value is usually an integer, it may be necessary to perform a rounding operation on the weighted average.
- Method 2 A directional based interpolation method.
- the reference pixels of the second type of pixels in this direction or/and the reconstructed first type of pixels are obtained, and an interpolation filter is used to obtain the reconstructed values of the second type of pixels.
- the interpolation direction is the vertical direction (vertically downward)
- the pixel P 1,2 belonging to the second type of pixel in FIG. 7 can be obtained from the linear interpolation filter according to R 0, 2 and R 2, 2 .
- Method 3 Hybrid interpolation method. Obtaining the reference pixels around the predetermined position or/and the reconstructed first type of pixels for the second pixels at the predetermined positions, obtaining the reconstructed values of the second type of pixels by linear interpolation; and then, for the second type of pixels of the remaining positions, Obtaining reference pixels of the second type of pixels in this direction or/and reconstructed first type pixels and reconstructed second type pixels according to a predetermined direction, and reconstructing values of the second type of pixels by interpolation filters .
- Method 4 Transform-based interpolation method. Filling the second type of pixel position with a preset value, such as 0 or 128; transforming the pixel block formed by the reference pixel, the reconstructed first type of pixel, and the filled second type of pixel, and removing the preset in the transform coefficient The transform coefficients of the position are inversely transformed to obtain reconstructed values of the second type of pixels.
- a preset value such as 0 or 128
- Method 5 An intra prediction mode of HEVC is used as an interpolation method of the second type of pixels. At this time, the intra prediction mode of the first type of pixel and the intra prediction mode of the second type of pixel may be the same or different.
- the second pixel may be reconstructed by using the foregoing method, and the second pixel may be reconstructed by using the combination of the foregoing methods.
- a residual value of B pixels in the second type of pixel is obtained according to a residual value of the first type of pixel, where B is a positive integer not less than 1.
- the above transformation may be only the residual value of all the first type of pixels.
- the first type of pixel is a small square block in the current image block, only all the first type of pixels may be transformed. Residual difference, for example, all of the first type of pixels is one of 8 ⁇ 8 current block image blocks 4 x 4 blocks.
- the transform may also be the residual value of all the first type of pixels and the residual value of at least one (B) of the second type of pixels.
- the size of the transform may be the same as the size of the image block, that is, The number of residuals transformed is equal to the number of pixels in the image block, and the size of the transform may also be smaller than the size of the image block.
- the 3 ⁇ 3 block in the lower right corner contains all the first type of pixels, and at this time, only the residual value of the 3 ⁇ 3 block may be transformed;
- a 4x4 transform can be employed for each of the 4x4 blocks.
- the number of residual values of the first type of pixels is A
- the B pixels of the second type of pixels correspond to B residual values
- a residual values and the first type The pixels in the pixel are in one-to-one correspondence
- the B residual values are in one-to-one correspondence with the B pixels
- the residual values of the B pixels in the second type of pixels are obtained according to the residual values of the first type of pixels, including: The B ⁇ A matrix corresponding to the number A of residual values of one type of pixels and the number B of residual values of B pixels in the second type of pixels; the residual value of the B ⁇ A matrix and A first type of pixels Multiplying the composed column vectors to obtain a column vector composed of residual values of B pixels in the second type of pixels; obtaining a second column vector according to the residual values of the B pixels in the second type of pixels The residual value of B pixels in a class pixel.
- the document "A new padding technique for coding of arbitrarily-shaped image/video segments” (ICIP 1999) describes a smart padding method based on A known pixel values (first type of pixels).
- the vector (column vector) consisting of a derived B ⁇ A matrix multiplied by the vector (column vector) to obtain another B pixel values (residual values of the second type of pixels) Column vector, and then obtain B pixel values; the coefficients of B fixed positions in the transform coefficients obtained by DCT transform are always 0 (or close to 0 due to insufficient precision), this B
- the coefficients are simply referred to as fixed zero coefficients. In this way, the partial coefficients of the transform coefficients of the image block residual values can be fixed 0 coefficients, thereby reducing the number of non-zero coefficients that need to be encoded.
- the generated residual difference may have a plurality of fixed zero coefficients in the transformed transform coefficient.
- the number is equal to or greater than the number B of the second type of pixels that produce the residual value, because The non-zero coefficient that needs to be encoded is reduced; the fixed zero coefficient can be set at any position in the matrix of the transform coefficients, which is not limited by the embodiment of the present invention.
- the fixed zero coefficient may be set at a high frequency coefficient position in the matrix of transform coefficients, such as a coefficient position in the lower right corner, or at a coefficient position that follows the coefficient scan sequence.
- all 8 pixel-like residual values (such as x 14 , x 22 , . . . , x 44 in FIG. 4 ) are obtained.
- the second type of pixel residual value (such as p 11 , p 12 , ..., p 33 in Fig. 4), this process can be obtained by multiplying the vector formed by the first type of pixel residuals by an 8 ⁇ 8 matrix.
- the second type of pixel residual value as shown in the following formula:
- the calculation method of the 8 ⁇ 8 matrix can be obtained by the smart padding method.
- the lower right 3 ⁇ 3 block of the 4 ⁇ 4 block includes all the first type of pixels, and at this time, the smart padding method can be used to obtain only the residual of the second type of pixels in the 3 ⁇ 3 block. Difference. It should be noted that, in the subsequent processing, the residual value of the lower right 3 ⁇ 3 block can be transformed and quantized by the 3 ⁇ 3 transform.
- the original value of each of the at least one of the pixels of the second type of pixels is subtracted from the predicted value of each pixel, and the residual value of each pixel is obtained.
- the predicted value of each pixel is obtained by using an intra prediction algorithm; and the residual value of the first type of pixel and the residual value of at least one of the second type of pixels are transformed to obtain a transform coefficient.
- each of the residual values of at least one of the second type of pixels is the difference between the original value of the same second type of pixel and the predicted value.
- the transform coefficients are quantized according to the scan order of the transform coefficients to obtain quantized transform coefficients.
- the transform coefficients are quantized to obtain quantized transform coefficients (quantized transform Coefficient).
- the quantization method is usually scalar quantization, and may be other methods such as vector quantization.
- a smart quantization method as set forth in the literature "Constrained Quantization in the Transform Domain with Applications in Arbitrarily-Shaped Object Coding" (IEEE TCSVT, vol. 20, no. 11, 2010) can be used: from the backward in the scan order of the transform coefficients
- the quantized transform coefficients are determined in order, such that the distortion of the reconstructed residual value of the target pixel in one coding block is minimized.
- the embodiment of the present invention determines the quantized transform coefficients from the back to the front in order according to the scan order of the transform coefficients, so that the residual residual distortion of the first type of pixels is minimized.
- the quantized transform coefficients are obtained according to the following formula:
- C m is the mth transform coefficient excluding the fixed 0 coefficient in the scanning order
- Q(*) is the quantization processing function
- ⁇ m is a correction term determined by the quantization error of the transform coefficient after C m in the scan order, and is the quantized transform coefficient according to the scan order.
- the scanning order of the transform coefficients includes a vertical scan, a horizontal scan, or a diagonal scan.
- the transform coefficient matrix obtained by transforming the residual value formed by using the smart padding method in FIG. 4 is vertically scanned in FIG. 5(a) and FIG. 5(b in the three scanning sequences shown in FIG. 5, respectively. ) Horizontal scanning and Figure 5 (c) diagonal scanning.
- the coefficients C 1,3 of the first row and the third column are the ninth coefficient in the vertical scanning order, but since C 3,2 and C 3,3 are fixed 0 coefficients, the actual number of C 1,3 Is 7, which is C 1,3 is C 7 ; similarly, C 1,4 is C 8 .
- the two methods of obtaining the residual difference and the three methods of obtaining the quantized transform coefficient may be used in combination. Among them, when the residual value processing based on the smart padding method and the quantization technique based on the smart quantization method are combined, good coding efficiency is obtained. In addition, when using the smart padding method, fixed 0 coefficients appear in the transform coefficients. These fixed 0 coefficients may be located between two non-zero coefficients in the scan sequence. When the transform coefficients are encoded, the non-zero of these fixed positions may be skipped. Scan of the coefficient.
- the method of the embodiment of the present invention further includes: generating a code stream according to the quantized transform coefficients, so that the decoding device reconstructs the current image block according to the code stream.
- generating the code stream according to the quantized transform coefficients comprises: encoding the intra prediction algorithm information and the quantized transform coefficients into a code stream by using an entropy coding method; and the intra prediction algorithm information is, for example, intra prediction mode information.
- generating the code stream according to the quantized transform coefficients includes encoding the information of the intra prediction algorithm information, the quantized transform coefficients, and the interpolation method into a code stream by using an entropy encoding method.
- the interpolation method information can be explicitly transmitted in the code stream.
- a preset second type of pixel interpolation mode may also be implicitly mapped according to an intra prediction mode of the first type of pixel.
- the interpolation method information does not need to be transmitted in the code stream, for example, the intra prediction mode of the first type of pixel.
- the second type of pixel interpolation is based on the method of surrounding pixel averaging.
- the intra prediction mode of the first type of pixels is directional prediction
- the second type of pixel interpolation is directional interpolation based on the same direction. It is also possible to adopt the preset second type of pixel interpolation mode corresponding to the intra prediction modes of some first type pixels, and transmit the second intra prediction mode of the first type of pixels in the code stream.
- Interpolation method information for class pixels are also possible to adopt the preset second type of pixel interpolation mode corresponding to the intra prediction modes of some first type pixels, and transmit the second intra prediction mode of the first type of pixels in the code
- the intra coding method of the present invention can be used as a supplement to the conventional intra coding method, for example, adding the intra coding method of the present invention in addition to the 35 intra prediction coding modes of HEVC; and can also be used to replace the conventional intra coding.
- Method for example, replacing the DC prediction mode of HEVC with the original An intra coding method in which the intra prediction mode of the first type of pixel uses a DC prediction mode or a Planar prediction mode.
- the actual intra-coding mode of the image block can be obtained by the commonly used rate-distortion optimization, that is, the image block is pre-coded using a plurality of candidate intra-coding modes, and the rate distortion cost of each mode is judged, and the mode with the lowest rate-distortion cost is adopted as the mode.
- the actual coding mode of this image block can be obtained by the commonly used rate-distortion optimization, that is, the image block is pre-coded using a plurality of candidate intra-coding modes, and the rate distortion cost of each mode is judged, and the mode with the lowest rate-distortion cost is adopted as the mode.
- the actual coding mode of this image block can be obtained by the commonly used rate-distortion optimization, that is, the image block is pre-coded using a plurality of candidate intra-coding modes, and the rate distortion cost of each mode is judged, and the mode with the lowest rate-distortion cost is adopted as the mode.
- the actual coding mode of this image block can be obtained by
- FIG. 1 to FIG. 5 are merely intended to assist those skilled in the art to understand the embodiments of the present invention, and the embodiments of the present invention are not limited to the specific numerical values or specific examples illustrated. A person skilled in the art will be able to make various modifications or changes in the embodiments according to the examples of FIG. 1 to FIG. 5, and such modifications or variations are also within the scope of the embodiments of the present invention.
- FIG. 6 is a schematic flowchart of a method of intra decoding according to an embodiment of the present invention.
- the method shown in FIG. 6 can be performed by a decoder.
- the intra-frame decoding method shown in FIG. 6 corresponds to the intra-frame coding method shown in FIG. 1.
- the method shown in FIG. 6 can be the inverse process of the method shown in FIG. .
- the method shown in FIG. 6 includes:
- the current image block includes a first type of pixel and a second type of pixel, and the second type of pixel is a current image.
- the reconstructed value of the first type of pixel is obtained by reconstructing the first type of pixel according to the quantized transform coefficient and the predicted value of the first type of pixel (a part of the pixel); and the second pixel (the other part of the pixel) Reconstruction is performed directly using interpolation methods based on reference pixels and/or a portion of reconstructed pixels, saving code rate.
- image blocks in the embodiments of the present invention may be image blocks of various sizes, for example, may be 3 ⁇ 3, 4 ⁇ 4, 8 ⁇ 8, 16 ⁇ 16, 32 ⁇ 32, 64 ⁇ 64, 8 in size.
- the image block of ⁇ 4, 4x8, 16x12 or 9x9, etc., the embodiment of the present invention is not limited thereto.
- the first type of pixels may be pixels located at any position in the current image block.
- the first type of pixels may be located at the right boundary, the lower boundary, the center, the lower left diagonal, and the lower right diagonal of the current image block.
- the equal position may also be located at other positions; the number of pixels of the first type is greater than 0 and less than the number of pixels of the entire current image block, for example, the number of pixels of the first type is 1/2, 7/16 of the total number of pixels of the current image block. , 15/32, 3/4 or 1/4, etc.
- the second type of pixel is a pixel other than the first type of pixel in the current image block.
- FIG. 2 is a classification example of a first type of pixel and a second type of pixel of a 4 ⁇ 4 image block according to an embodiment of the present invention, and FIG. 2 shows eight examples, and FIG. 2(a) to FIG. 2(h) In the preferred embodiment, the classification of the first type of pixels and the second type of pixels in FIG. 2(a) can be employed.
- the classification of the first type of pixels and the second type of pixels in a larger image block can be viewed as a combination of a plurality of small image blocks, for example, an 8x8 image block or a pixel classification of a larger image block.
- Four or more pixel classification combinations of image blocks smaller than the image block size may be used, for example, the pixel classification of 8 ⁇ 8 blocks in the example of FIG. 3(a) is classified by the pixel classification of the 4 ⁇ 4 block of FIG. 2(a).
- the pixel classification of four 4 ⁇ 4 blocks in the 8 ⁇ 8 block is the pixel classification method of the 4 ⁇ 4 block illustrated in FIG.
- the pixel classification of 8 ⁇ 8 blocks or larger blocks may also be Other approaches are used, such as Figures 2b, 2c, and 2d in Figure 2. All intra prediction modes may use the same pixel classification; different intra-prediction modes may also use different pixel classifications; or several intra prediction modes may use the same pixel classification.
- the pixel processing method in FIG. 2(a) is mainly taken as a 4 ⁇ 4 image block, and a specific processing method is introduced.
- the intra prediction algorithm information may be parsed from the code stream, and the intra prediction algorithm may include directional prediction, DC prediction, or Planar prediction in H.265/HEVC or H.264/AVC, also The embodiment of the present invention does not limit the intra prediction based on the template matching.
- the method of the embodiment of the present invention further includes: placing the transform coefficients in a first type of preset position in the matrix of transform coefficients according to a scan order of the transform coefficients, where the transform coefficient matrix
- the transform coefficient of the second type of preset position is set to a preset value, and the sum of the number of the second type of preset positions and the number of the first type of preset positions is equal to the total number of transform coefficients in the transform coefficient matrix.
- the quantized transform coefficients can be resolved from the code stream.
- the inverse quantization process may be to multiply the quantized transform coefficients by the quantization step size to obtain the reconstructed transform coefficients; wherein the operation of multiplying the quantization step size may also be performed by using integer multiplication and shifting, for example, H.265/HEVC will
- the inverse quantification process is:
- Q(i) is the i-th quantized transform coefficient
- R(i) is the reconstructed transform coefficient
- bdshift is the shift parameter
- Qs'(i) is an integer
- Qs' (i)/2 bdshift approximates the quantization step size.
- Qs'(i) is determined by the level scale and the scaling factor.
- the transform coefficients are obtained, and the transform coefficients may be placed in a first type of preset position in the matrix of the transform coefficients according to the scan order of the transform coefficients, wherein the transform coefficients of the second type of preset positions in the transform coefficient matrix are set.
- the number of the second type of preset positions is smaller than the total number of transform coefficients in the transform coefficient matrix, for example, the preset value may be 0.
- the scanning sequence includes vertical scanning, horizontal scanning, or diagonal scanning.
- the scan order may be determined by the first type of pixel intra prediction mode or by the code stream.
- the three scanning sequences shown in FIG. 5 are vertical scanning of FIG. 5(a), horizontal scanning of FIG. 5(b), and diagonal scanning of FIG. 5(c), respectively.
- a two-dimensional separable transform such as DCT inverse transform or DST inverse transform can be used.
- DCT inverse transform or DST inverse transform
- the residual value obtained by the inverse transform includes at least the residual value of all the first type of pixels; and may further include the residual value of the at least one second type of pixel.
- the size of the inverse transform can be the same as the size of the image block.
- the number of residuals generated by the inverse transform is equal to the number of pixels in the image block. For the two-dimensional DST and two-dimensional DCT, the two-dimensional separable transform satisfies the transformation matrix.
- the size is equal to the size of the image block.
- the inverse transform can also be smaller than the size of the image block.
- the 3 ⁇ 3 block in the lower right corner contains all the first type of pixels.
- the reconstructed transform coefficients are inversely transformed by the inverse transform of 3 ⁇ 3, and the 3 ⁇ is obtained.
- the residual value of 3 blocks; for example, for the 8 ⁇ 8 block in the example of Fig. 3 (a), 4 ⁇ 4 inverse transforms can be used for 4 4 ⁇ 4 blocks to obtain 4 4 ⁇ 4 block residual values. .
- the inverse transform can simultaneously generate the residual values of the first type of pixels and the second type of pixels in the image block; to save the calculation, only the residual values of the first type of pixels can be generated without generating the residual values of the second type of pixels.
- the residual value and the predicted value may exceed the dynamic range of the pixel, for example, the dynamic range of the 8-bit pixel is 0 to 255, therefore, in the embodiment of the present invention, when the residual value and the predicted value are added When the predicted value exceeds the upper or lower limit of the dynamic range of the pixel, the predicted value is set to the maximum or minimum value of the dynamic range, for example, 255 or 0.
- the method of the embodiment of the present invention further includes: determining an interpolation method according to an intra prediction algorithm, where the interpolation manner in the interpolation method is the same as the interpolation method included in the intra prediction algorithm.
- the method of the embodiment of the present invention further includes: determining an interpolation method according to a code stream of the image.
- the interpolation method can be determined by the intra prediction algorithm in 620, and the reconstructed value of the second type of pixel can be obtained by interpolation according to the reconstructed value of the first type of pixel.
- the interpolation method has various forms, and several methods of reconstructing the second pixel are described below.
- Method 1 Interpolation method based on the average of surrounding pixels. A reference pixel around the second type of pixel or/and a reconstructed first type of pixel is obtained, and the pixels are weighted averaged to interpolate to obtain a reconstructed value of the second type of pixel.
- Method 2 A directional based interpolation method. According to a predetermined interpolation direction, the reference pixels of the second type of pixels in this direction or/and the reconstructed first type of pixels are obtained, and an interpolation filter is used to obtain the reconstructed values of the second type of pixels.
- Method 3 Hybrid interpolation method. For the second pixel at the predetermined position, obtain the reference pixels around them or/and the reconstructed first type of pixels, and obtain the reconstructed values of the second type of pixels by linear interpolation; for the second type of pixels of the remaining positions, according to one The predetermined direction, the reference pixels of the second type of pixels in this direction or/and the reconstructed first type of pixels, and the reconstructed second type of pixels are obtained, and the reconstructed values of the second type of pixels are obtained by linear interpolation.
- Method 4 Transform-based interpolation method. Filling the second type of pixel position with a preset value, such as 0 or 128; transforming the pixel block formed by the reference pixel, the reconstructed first type of pixel, and the filled second type of pixel, and removing the preset position The coefficients are then inverse transformed to obtain reconstructed values for the second type of pixels.
- a preset value such as 0 or 128
- Method 5 An intra prediction mode of HEVC is used as an interpolation method of the second type of pixels.
- the intra prediction mode of the first type of pixel and the intra prediction mode used for the second type of pixel interpolation may be the same or different.
- the second pixel may be reconstructed by using the foregoing method, and the second pixel may be reconstructed by using the combination of the foregoing methods.
- the interpolation method information of the second type of pixels can be obtained from the code stream; or can be obtained according to the first type of intra-frame prediction mode mapping, for example, the first type of intra-pixel prediction mode is a directional prediction mode (for example, the HEVC-defined method)
- the second type of pixels adopts a directional interpolation method based on the same direction; and a certain type of the first type of pixel intra prediction mode may also be used.
- a second type of pixel interpolation method is provided, and the second type of pixel interpolation method is obtained by parsing the remaining first type of pixel intra prediction modes from the code stream.
- the pixel classifications of the first type of pixels and the second type of pixels may be the same or different.
- some of the first type of pixels use the same pixel classification method in the intra prediction mode; or use different pixel classification methods in each of the first type of pixel intra prediction modes, more specifically 4 ⁇ 4 blocks.
- the first type of intra pixel intra prediction mode is the DC mode
- the pixel classification method in FIG. 2( a ) is used
- the first type of intra pixel intra prediction mode is the vertical mode
- FIG. 2( d ) is used. The way pixels are classified.
- the partial processing in the decoding method should be the same as or match the processing in the encoding method, in order to obtain the same result as the encoded reconstructed image and the decoded reconstructed image.
- the pixel classification in the decoding method, the intra prediction method of the first type of pixels, the coefficient scanning method, and the interpolation method of the second type of pixels should be the same as the corresponding method of the encoding end; the inverse transform, entropy decoding, etc. in the decoding method It should be matched with the transform and entropy coding in the coding method, that is, they are the inverse of the corresponding method in the coding method.
- the encoding also includes reconstruction processing for pixels, and these reconstruction processing should also be the same as the reconstruction processing in decoding, for example, inverse quantization and inverse transformation of quantized transform coefficients in encoding should be inverse quantization of quantized transform coefficients in decoding, The inverse transform is the same.
- the method of intra-frame decoding of FIG. 6 corresponds to the method of intra-frame coding of FIG. 1 to FIG. 5, and the decoder performing FIG. 6 can implement the inverse process of each process in the method embodiments of FIG. 1 to FIG.
- the method of intra-frame decoding of FIG. 6 can be obtained according to the inverse process corresponding to the intra-frame coding method of FIG. 1 to FIG. 5. To avoid repetition, details are not described herein.
- the intra coding method and the intra decoding method of the embodiment of the present invention are described in detail with reference to FIG. 1 to FIG. 6, and the encoder and the decoder of the embodiment of the present invention are described below with reference to FIGS. 7 to 10.
- FIG. 7 is a schematic block diagram of an encoder in accordance with one embodiment of the present invention.
- the apparatus 700 shown in FIG. 7 includes a first acquisition unit 710, a second acquisition unit 720, a first determination unit 730, a transformation unit 740, a quantization unit 750, a first reconstruction unit 760, and a second reconstruction unit 770.
- the first acquiring unit 710 is configured to obtain a reference pixel value of the current image block
- the first acquiring unit 720 is configured to obtain, by using an intra prediction algorithm, the first type of pixel in the current image block according to the reference pixel value of the current image block.
- the current image block includes a first type of pixel and a second type of pixel, and the second type of pixel is a pixel other than the first type of pixel in the current image block;
- the first determining unit 730 is configured to predict according to the first type of pixel The value and the original pixel value of the first type of pixel result in a residual value of the first type of pixel;
- the transform unit 740 is configured to obtain a transform coefficient according to the residual value of the first type of pixel; and the quantization unit 750 is configured to quantize the transform coefficient.
- the first reconstructing unit 760 is configured to reconstruct the first type of pixel according to the quantized transform coefficient and the predicted value of the first type of pixel, to obtain a reconstructed value of the first type of pixel; and the second reconstructing unit 770 is configured to The reconstructed value of the reference pixel of the image block or/and the first type of pixel is obtained by interpolation to obtain the reconstructed value of the second type of pixel.
- the embodiment of the present invention obtains a code stream by transforming and quantizing only the residual values of the first type of pixels, and does not need to encode the residual values of the entire image block, and can flexibly encode, thereby improving coding efficiency.
- the first type of pixels are reconstructed according to the quantized transform coefficients and the predicted values of the first type of pixels (part of the pixels) to obtain the reconstructed values of the first type of pixels; and the second type of pixels (the other part) Pixels) are reconstructed directly using interpolation methods based on reference pixels and/or a portion of reconstructed pixels.
- the current image block can be any one or one of the current frames.
- the image blocks in the embodiments of the present invention may be image blocks of various sizes, for example, may be 3 ⁇ 3, 4 ⁇ 4, 8 ⁇ 8, 16 ⁇ 16, 32 ⁇ 32, 64 ⁇ 64, 8 ⁇ 4, 4 ⁇ 8, 16 ⁇ 12 or 9 ⁇ 9 image blocks and the like, and embodiments of the present invention are not limited thereto.
- the first type of pixels may be pixels located at any position in the current image block.
- the first type of pixels may be located at the right boundary, the lower boundary, the center, the lower left diagonal, and the lower right diagonal of the current image block.
- the equal position may also be located at other positions; the number of pixels of the first type is greater than 0 and less than the number of pixels of the entire current image block, for example, the number of pixels of the first type is 1/2, 7/16 of the total number of pixels of the current image block. , 15/32, 3/4 or 1/4, etc.
- the second type of pixel is a pixel in the image block other than the first type of pixel.
- FIG. 2 is a classification example of a first type of pixel and a second type of pixel of a 4 ⁇ 4 image block according to an embodiment of the present invention, and FIG. 2 shows eight examples, and FIG. 2(a) to FIG. 2(h) In the preferred embodiment, the classification of the first type of pixels and the second type of pixels in FIG. 2(a) can be employed.
- the classification of the first type of pixels and the second type of pixels in a larger image block can be viewed as a combination of a plurality of small image blocks, for example, an 8x8 image block or a pixel classification of a larger image block.
- Four or more pixel classification combinations of image blocks smaller than the image block size may be used, for example, the pixel classification of 8 ⁇ 8 blocks in the example of FIG. 3(a) is classified by the pixel classification of the 4 ⁇ 4 block of FIG. 2(a).
- the pixel classification of four 4 ⁇ 4 blocks in the 8 ⁇ 8 block is the pixel classification method of the 4 ⁇ 4 block illustrated in FIG.
- the pixel classification of 8 ⁇ 8 blocks or larger blocks may also be Other approaches are used, such as Figures 2b, 2c, and 2d in Figure 2. All intra prediction modes may use the same pixel classification; different intra-prediction modes may also use different pixel classifications; or several intra prediction modes may use the same pixel classification.
- the pixel processing method in FIG. 2(a) is mainly taken as a 4 ⁇ 4 image block, and a specific processing method is introduced.
- the intra prediction algorithm may include directional prediction, DC prediction or Planar prediction in H.265/HEVC or H.264/AVC (Advanced Video Coding), or may be intra prediction based on template matching.
- the embodiments of the present invention do not limit this.
- the intra prediction algorithm may also generate prediction values for the second type of pixels when generating prediction values for the first type of pixels.
- the decoding device and the encoding device may be the same device, and the decoding device and the encoding device may also be different devices, which are not limited by the embodiment of the present invention.
- the encoder 700 further includes a second determining unit; specifically, the second determining unit is configured to determine an interpolation method according to an intra prediction algorithm, where the interpolation method and the intra prediction in the interpolation method The algorithm includes the same interpolation method.
- the first determining unit 730 is specifically configured to subtract the original value of the first type of pixel and the predicted value of the first type of pixel to obtain a residual value of the first type of pixel.
- the transforming unit 740 is specifically configured to obtain a residual value of the B pixels in the second type of pixels according to the residual value of the first type of pixels, where B is a positive integer not less than 1.
- the residual values of the first type of pixels and the residual values of the B pixels are transformed to obtain transform coefficients, wherein the number of fixed zero coefficients in the transform coefficients is equal to B.
- the number of residual values of the first type of pixels is A
- the B pixels of the second type of pixels correspond to B residual values, wherein A residual values and the first type In pixels
- the pixels are in one-to-one correspondence
- the B residual values are in one-to-one correspondence with the B pixels.
- the third obtaining unit is specifically configured to determine the number A of the residual values of the first type of pixels and the B pixels of the second type of pixels.
- the B ⁇ A matrix corresponding to the number B of residual values; multiplying the B ⁇ A matrix by the column vector composed of the residual values of the A first type pixels to obtain the residual values of the B pixels in the second type of pixels
- the column vector formed; the residual value of the B pixels in the second type of pixel is obtained according to the column vector formed by the residual values of the B pixels in the second type of pixel.
- the transform unit 740 is specifically configured to subtract the predicted value of each pixel from the original value of each of the at least one of the second type of pixels to obtain the residual of each pixel. a difference, wherein the predicted value of each pixel is obtained by using an intra prediction algorithm; and the residual value of the first type of pixel and the residual value of at least one pixel of the second type of pixel are transformed to obtain a transform coefficient .
- the quantization unit 750 is specifically configured to quantize the transform coefficients according to a scan order of the transform coefficients to obtain quantized transform coefficients.
- the quantization unit 750 is specifically configured to obtain quantized transform coefficients according to the following formula:
- C m is the mth transform coefficient excluding the fixed 0 coefficient in the scanning order
- Q(*) is the quantization processing function
- ⁇ m is a correction term determined by the quantization error of the transform coefficient after C m
- b m,j is the weighting coefficient, by the transformation matrix and the scanning order
- the second reconstruction unit 770 performs inverse quantization on the quantized transform coefficients to obtain reconstructed transform coefficients, and inverse transforms the reconstructed transform coefficients to obtain reconstructed residual values of the first type of pixels;
- the reconstructed residual value is added to the predicted value of the first type of pixel to obtain a reconstructed value of the first type of pixel.
- the encoder 700 further includes a generating unit.
- the generating unit is configured to generate a code stream according to the quantized transform coefficients, so that the decoding device reconstructs the current image block according to the code stream.
- the generating unit is specifically configured to adopt an entropy encoding method for intra-frame
- the information of the prediction algorithm and the quantized transform coefficients are encoded to obtain a code stream.
- the generating unit is specifically configured to encode the information of the intra prediction algorithm, the quantized transform coefficient, and the information of the interpolation method by using an entropy coding method to obtain a code stream.
- the encoder 700 illustrated in FIG. 7 is capable of implementing the various processes performed by the encoder in the method embodiments of FIGS. 1-5. Other functions and operations of the encoder 700 may refer to the process involving the encoder in the method embodiments of FIGS. 1 and 5. To avoid repetition, it will not be detailed here.
- FIG. 8 is a schematic block diagram of a decoder in accordance with one embodiment of the present invention.
- the apparatus 800 shown in FIG. 8 includes a first acquisition unit 810, a second acquisition unit 820, an inverse quantization unit 830, an inverse transformation unit 840, a first reconstruction unit 850, and a second reconstruction unit 860.
- the first acquiring unit 810 is configured to acquire a reference pixel value of the current image block
- the second acquiring unit 820 is configured to acquire the first type of pixel in the current image block by using an intra prediction algorithm according to the reference pixel value of the current image block.
- the predicted value, the current image block includes a first type of pixel and a second type of pixel, the second type of pixel is a pixel other than the first type of pixel in the current image block;
- the inverse quantization unit 830 is used for quantization transformation of the current image block
- the coefficients are inverse quantized to obtain transform coefficients;
- the inverse transform unit 840 is configured to inverse transform the transform coefficients to obtain reconstructed residual values of the first type of pixels;
- the first reconstructing unit 850 is configured to reconstruct residual residual values of the first type of pixels.
- the second reconstructing unit 860 is configured to obtain the second by interpolation according to the reference pixels of the image block and/or the reconstructed values of the first type of pixels The reconstructed value of the class pixel.
- the reconstructed value of the first type of pixel is obtained by reconstructing the first type of pixel according to the quantized transform coefficient and the predicted value of the first type of pixel (a part of the pixel); and the second pixel (the other part of the pixel) Reconstruction is performed directly using interpolation methods based on reference pixels and/or a portion of reconstructed pixels, saving code rate.
- the current image block can be any one or one of the current frames.
- the image blocks in the embodiments of the present invention may be image blocks of various sizes, for example, may be 3 ⁇ 3, 4 ⁇ 4, 8 ⁇ 8, 16 ⁇ 16, 32 ⁇ 32, 64 ⁇ 64, 8 ⁇ 4, 4 ⁇ 8, 16 ⁇ 12 or 9 ⁇ 9 image blocks and the like, and embodiments of the present invention are not limited thereto.
- the first type of pixels may be pixels located at any position in the current image block.
- the first type of pixels may be located at the right boundary, the lower boundary, the center, the lower left diagonal, and the lower right diagonal of the current image block.
- the equal position may also be located at other positions; the number of pixels of the first type is greater than 0 and less than the number of pixels of the entire current image block, for example, the number of pixels of the first type is the number of pixels of the entire current image block. Purpose 1/2, 7/16, 15/32, 3/4 or 1/4, etc.
- the second type of pixel is a pixel in the image block other than the first type of pixel.
- FIG. 2 is a classification example of a first type of pixel and a second type of pixel of a 4 ⁇ 4 image block according to an embodiment of the present invention, and FIG. 2 shows eight examples, and FIG. 2(a) to FIG. 2(h) In the preferred embodiment, the classification of the first type of pixels and the second type of pixels in FIG. 2(a) can be employed.
- the classification of the first type of pixels and the second type of pixels in a larger image block can be viewed as a combination of a plurality of small image blocks, for example, an 8x8 image block or a pixel classification of a larger image block.
- Four or more pixel classification combinations of image blocks smaller than the image block size may be used, for example, the pixel classification of 8 ⁇ 8 blocks in the example of FIG. 3(a) is classified by the pixel classification of the 4 ⁇ 4 block of FIG. 2(a).
- the pixel classification of four 4 ⁇ 4 blocks in the 8 ⁇ 8 block is the pixel classification method of the 4 ⁇ 4 block illustrated in FIG.
- the pixel classification of 8 ⁇ 8 blocks or larger blocks may also be Other approaches are used, such as Figures 2b, 2c, and 2d in Figure 2. All intra prediction modes may use the same pixel classification; different intra-prediction modes may also use different pixel classifications; or several intra prediction modes may use the same pixel classification.
- the pixel processing method in FIG. 2(a) is mainly taken as a 4 ⁇ 4 image block, and a specific processing method is introduced.
- the intra prediction algorithm may include directional prediction, DC prediction or Planar prediction in H.265/HEVC or H.264/AVC (Advanced Video Coding), or may be intra prediction based on template matching.
- the embodiments of the present invention do not limit this.
- the intra prediction algorithm may also generate prediction values for the second type of pixels when generating prediction values for the first type of pixels.
- the decoding device and the encoding device may be the same device, and the decoding device and the encoding device may also be different devices, which are not limited by the embodiment of the present invention.
- the decoder 800 further includes a placing unit, where the placing unit is configured to place the transform coefficients in a first type of preset position in the matrix of transform coefficients according to a scanning order of the transform coefficients, where The transform coefficient of the second type of preset position in the transform coefficient matrix is set to a preset value, and the sum of the number of the second type of preset positions and the number of the first type of preset positions is equal to the total number of transform coefficients in the transform coefficient matrix.
- the decoder 800 further includes a first determining unit; specifically, the first determining unit is configured to determine an interpolation method according to an intra prediction algorithm, where the interpolation method and the intra prediction algorithm include The interpolation method is the same.
- the decoder 800 further includes a second determining unit; specifically The second determining unit is configured to determine an interpolation method according to a code stream of the image.
- the decoder 800 illustrated in FIG. 8 is capable of implementing the various processes performed by the decoder in the method embodiment of FIG.
- Other functions and operations of the decoder 800 may refer to the process involving the decoder in the method embodiment of FIG. To avoid repetition, it will not be detailed here.
- FIG. 9 is a schematic block diagram of an encoder in accordance with another embodiment of the present invention.
- the encoder 900 shown in FIG. 9 includes a processor 910, a memory 920, and a bus system 930.
- the processor 910 calls the code stored in the memory 920 by the bus system 930 to obtain the reference pixel value of the current image block; and obtains the first class in the current image block by using an intra prediction algorithm according to the reference pixel value of the current image block.
- the current image block includes a first type of pixel and a second type of pixel, and the second type of pixel is a pixel other than the first type of pixel in the current image block; according to the predicted value of the first type of pixel and the first type
- the original pixel value of the pixel obtains the residual value of the first type of pixel; the transform coefficient is obtained according to the residual value of the first type of pixel; the quantized transform coefficient is obtained to obtain the quantized transform coefficient; and the quantized transform coefficient and the predicted value of the first type of pixel are obtained according to the quantized transform coefficient Reconstructing the first type of pixels to obtain a reconstructed value of the first type of pixels; and according to the reconstructed value of the first type of pixels, using the interpolation method to obtain the reconstructed value of the second type of pixels.
- the embodiment of the present invention obtains a code stream by transforming and quantizing only the residual values of the first type of pixels, and does not need to encode the residual values of the entire image block, and can flexibly encode, thereby improving coding efficiency.
- the first type of pixels are reconstructed according to the quantized transform coefficients and the predicted values of the first type of pixels (part of the pixels) to obtain the reconstructed values of the first type of pixels; and the second type of pixels (the other part) Pixels) are reconstructed directly using interpolation methods based on reference pixels and/or a portion of reconstructed pixels.
- Processor 910 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 910 or an instruction in a form of software.
- the processor 910 may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), or an off-the-shelf programmable gate array (English Field Programmable Gate Array). , referred to as FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
- DSP digital signal processor
- ASIC application specific integrated circuit
- FPGA field Programmable Gate Array
- the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
- the steps of the method disclosed in the embodiments of the present invention may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor.
- the software module can be located in a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable read only memory or an electrically erasable programmable memory, a register, etc. In the mature storage medium of the field.
- the storage medium is located in the memory 920.
- the processor 910 reads the information in the memory 920 and completes the steps of the foregoing method in combination with hardware.
- the bus system 930 may include a power bus, a control bus, and a status signal bus in addition to the data bus. Wait. However, for clarity of description, various buses are labeled as bus system 930 in the figure.
- the current image block can be any one or one of the current frames.
- the image blocks in the embodiments of the present invention may be image blocks of various sizes, for example, may be 3 ⁇ 3, 4 ⁇ 4, 8 ⁇ 8, 16 ⁇ 16, 32 ⁇ 32, 64 ⁇ 64, 8 ⁇ 4, 4 ⁇ 8, 16 ⁇ 12 or 9 ⁇ 9 image blocks and the like, and embodiments of the present invention are not limited thereto.
- the first type of pixels may be pixels located at any position in the current image block.
- the first type of pixels may be located at the right boundary, the lower boundary, the center, the lower left diagonal, and the lower right diagonal of the current image block.
- the equal position may also be located at other positions; the number of pixels of the first type is greater than 0 and less than the number of pixels of the entire current image block, for example, the number of pixels of the first type is 1/2, 7/16 of the total number of pixels of the current image block. , 15/32, 3/4 or 1/4, etc.
- the second type of pixel is a pixel in the image block other than the first type of pixel.
- FIG. 2 is a classification example of a first type of pixel and a second type of pixel of a 4 ⁇ 4 image block according to an embodiment of the present invention, and FIG. 2 shows eight examples, and FIG. 2(a) to FIG. 2(h) In the preferred embodiment, the classification of the first type of pixels and the second type of pixels in FIG. 2(a) can be employed.
- the classification of the first type of pixels and the second type of pixels in a larger image block can be viewed as a combination of a plurality of small image blocks, for example, an 8x8 image block or a pixel classification of a larger image block.
- Four or more pixel classification combinations of image blocks smaller than the image block size may be used, for example, the pixel classification of 8 ⁇ 8 blocks in the example of FIG. 3(a) is classified by the pixel classification of the 4 ⁇ 4 block of FIG. 2(a).
- the pixel classification of four 4 ⁇ 4 blocks in the 8 ⁇ 8 block is the pixel classification method of the 4 ⁇ 4 block illustrated in FIG.
- the pixel classification of 8 ⁇ 8 blocks or larger blocks may also be Other approaches are used, such as Figures 2b, 2c, and 2d in Figure 2. All intra prediction modes can use the same pixel classification; different intra-prediction modes can be used for different pixel classifications; or several intra prediction modes can be used.
- a pixel classification For the sake of brevity, in the following embodiments, the pixel processing method in FIG. 2(a) is mainly taken as a 4 ⁇ 4 image block, and a specific processing method is introduced.
- the intra prediction algorithm may include directional prediction, DC prediction or Planar prediction in H.265/HEVC or H.264/AVC (Advanced Video Coding), or may be intra prediction based on template matching.
- the embodiments of the present invention do not limit this.
- the intra prediction algorithm may also generate prediction values for the second type of pixels when generating prediction values for the first type of pixels.
- the decoding device and the encoding device may be the same device, and the decoding device and the encoding device may also be different devices, which are not limited by the embodiment of the present invention.
- the processor 910 is further configured to determine an interpolation method according to an intra prediction algorithm, where an interpolation manner in the interpolation method is the same as an interpolation method included in the intra prediction algorithm.
- the processor 910 is specifically configured to subtract the original value of the first type of pixel and the predicted value of the first type of pixel to obtain a residual value of the first type of pixel.
- the processor 910 is specifically configured to obtain a residual value of the B pixels in the second type of pixels according to the residual value of the first type of pixels, where B is a positive integer not less than 1.
- the residual values of the first type of pixels and the residual values of the B pixels are transformed to obtain transform coefficients, wherein the number of fixed zero coefficients in the transform coefficients is equal to B.
- the number of residual values of the first type of pixels is A
- the B pixels of the second type of pixels correspond to B residual values
- a residual values and the first type of pixels The pixels in the one-to-one correspondence
- the B residual values are in one-to-one correspondence with the B pixels
- the processor 910 is specifically configured to determine the number A of the residual values of the first type of pixels and the B pixels of the second type of pixels.
- the B ⁇ A matrix corresponding to the number B of residual values; multiplying the B ⁇ A matrix by the column vector composed of the residual values of the A first type pixels to obtain the residual values of the B pixels in the second type of pixels
- the column vector formed; the residual value of the B pixels in the second type of pixel is obtained according to the column vector formed by the residual values of the B pixels in the second type of pixel.
- the processor 910 is specifically configured to subtract the predicted value of each pixel from the original value of each of the at least one of the second type of pixels to obtain a residual of each pixel. a value, wherein the predicted value of each pixel is obtained by using an intra prediction algorithm; and the residual value of the first type of pixel and the residual value of at least one of the second type of pixels are transformed to obtain a transform coefficient.
- the processor 910 is specifically configured to scan according to a transform coefficient.
- the transform coefficients are quantized to obtain quantized transform coefficients.
- processor 910 is specifically configured to obtain quantized transform coefficients according to the following formula:
- C m is the mth transform coefficient excluding the fixed 0 coefficient in the scanning order
- Q(*) is the quantization processing function
- ⁇ m is a correction term determined by the quantization error of the transform coefficient after C m
- b m,j is the weighting coefficient, by the transformation matrix and the scanning order
- the processor 910 is specifically configured to perform inverse quantization on the quantized transform coefficients to obtain reconstructed transform coefficients, and inverse transform the reconstructed transform coefficients to obtain reconstructed residual values of the first type of pixels;
- the reconstructed residual value of the pixel is added to the predicted value of the first type of pixel to obtain a reconstructed value of the first type of pixel.
- the processor 910 is further configured to generate a code stream according to the quantized transform coefficients, so that the decoding device reconstructs the current image block according to the code stream.
- the processor 910 is specifically configured to encode the information of the intra prediction algorithm and the quantized transform coefficients by using an entropy coding method to obtain a code stream.
- the processor 910 is specifically configured to encode the information of the intra prediction algorithm, the quantized transform coefficient, and the information of the interpolation method by using an entropy coding method to obtain a code stream.
- the encoder 900 illustrated in FIG. 9 corresponds to the encoder 700 illustrated in FIG. 7 and is capable of implementing the various processes performed by the encoder in the method embodiments of FIGS. 1-5.
- Other functions and operations of the encoder 900 may refer to the process involving the encoder in the method embodiments of FIGS. 1 and 5. To avoid repetition, it will not be detailed here.
- FIG. 10 is a schematic block diagram of a decoder in accordance with one embodiment of the present invention.
- the decoder 1000 shown in FIG. 10 includes a processor 1010, a memory 1020, and a bus system 1030.
- the processor 1010 calls the code stored in the memory 1020 by the bus system 1030 to acquire the reference pixel value of the current image block; and uses the intra prediction algorithm to obtain the first class in the current image block according to the reference pixel value of the current image block.
- the current image block includes a first type of pixel and a second type of pixel
- the second type of pixel is an image of the current image block other than the first type of pixel
- the predicted values of the pixels are added to obtain a reconstructed value of the first type of pixels; and according to the reconstructed values of the first type of pixels, the reconstructed values of the second type of pixels are obtained by interpolation.
- the reconstructed value of the first type of pixel is obtained by reconstructing the first type of pixel according to the quantized transform coefficient and the predicted value of the first type of pixel (a part of the pixel); and the second pixel (the other part of the pixel) Reconstruction is performed directly using interpolation methods based on reference pixels and/or a portion of reconstructed pixels, saving code rate.
- the method disclosed in the foregoing embodiments of the present invention may be applied to the processor 1010 or implemented by the processor 1010.
- the processor 1010 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 1010 or an instruction in a form of software.
- the processor 1010 may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), or an off-the-shelf programmable gate array (English Field Programmable Gate Array). , referred to as FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
- the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
- the steps of the method disclosed in the embodiments of the present invention may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor.
- the software module can be located in a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable read only memory or an electrically erasable programmable memory, a register, etc. In the mature storage medium of the field.
- the storage medium is located in the memory 1020.
- the processor 1010 reads the information in the memory 1020 and completes the steps of the foregoing method in combination with hardware.
- the bus system 1030 may include a power bus, a control bus, and a status signal bus in addition to the data bus. Wait. However, for clarity of description, various buses are labeled as the bus system 1030 in the figure.
- the current image block can be any one or one of the current frames.
- the image blocks in the embodiments of the present invention may be image blocks of various sizes, for example, may be 3 ⁇ 3, 4 ⁇ 4, 8 ⁇ 8, 16 ⁇ 16, 32 ⁇ 32, 64 ⁇ 64, 8 ⁇ 4, 4 ⁇ 8, 16 ⁇ 12 or 9 ⁇ 9 image blocks and the like, and embodiments of the present invention are not limited thereto.
- the first type of pixels may be pixels located at any position in the current image block.
- the first type of pixels may be located at the right boundary, the lower boundary, the center, the lower left diagonal, and the lower right diagonal of the current image block.
- the equal position may also be located at other positions; the number of pixels of the first type is greater than 0 and less than the number of pixels of the entire current image block, for example, the number of pixels of the first type is 1/2, 7/16 of the total number of pixels of the current image block. , 15/32, 3/4 or 1/4, etc.
- the second type of pixel is a pixel in the image block other than the first type of pixel.
- FIG. 2 is a classification example of a first type of pixel and a second type of pixel of a 4 ⁇ 4 image block according to an embodiment of the present invention, and FIG. 2 shows eight examples, and FIG. 2(a) to FIG. 2(h) In the preferred embodiment, the classification of the first type of pixels and the second type of pixels in FIG. 2(a) can be employed.
- the classification of the first type of pixels and the second type of pixels in a larger image block can be viewed as a combination of a plurality of small image blocks, for example, an 8x8 image block or a pixel classification of a larger image block.
- Four or more pixel classification combinations of image blocks smaller than the image block size may be used, for example, the pixel classification of 8 ⁇ 8 blocks in the example of FIG. 3(a) is classified by the pixel classification of the 4 ⁇ 4 block of FIG. 2(a).
- the pixel classification of four 4 ⁇ 4 blocks in the 8 ⁇ 8 block is the pixel classification method of the 4 ⁇ 4 block illustrated in FIG.
- the pixel classification of 8 ⁇ 8 blocks or larger blocks may also be Other approaches are used, such as Figures 2b, 2c, and 2d in Figure 2. All intra prediction modes may use the same pixel classification; different intra-prediction modes may also use different pixel classifications; or several intra prediction modes may use the same pixel classification.
- the pixel processing method in FIG. 2(a) is mainly taken as a 4 ⁇ 4 image block, and a specific processing method is introduced.
- the intra prediction algorithm may include directional prediction, DC prediction or Planar prediction in H.265/HEVC or H.264/AVC (Advanced Video Coding), or may be intra prediction based on template matching.
- the embodiments of the present invention do not limit this.
- the intra prediction algorithm may also generate prediction values for the second type of pixels when generating prediction values for the first type of pixels.
- the decoding device and the encoding device may be the same device, and the decoding device and the encoding device may also be different devices, which are not limited by the embodiment of the present invention.
- the processor 1010 is further configured to: place the transform coefficients in a first type of preset position in the matrix of transform coefficients according to a scan order of the transform coefficients, where the second type of pre-transform matrix The transform coefficient of the position is set to a preset value, and the sum of the number of the second type of preset positions and the number of the first type of preset positions is equal to the total number of transform coefficients in the matrix of transform coefficients.
- the processor 1010 is further configured to determine according to an intra prediction algorithm.
- Interpolation method the interpolation method in the interpolation method is the same as the interpolation method included in the intra prediction algorithm.
- the processor 1010 is further configured to determine an interpolation method according to a code stream of the image block.
- the decoder 1000 illustrated in FIG. 10 corresponds to the decoder 800 illustrated in FIG. 8 and is capable of implementing the various processes performed by the decoder in the method embodiment of FIG. 6.
- Other functions and operations of the decoder 1000 may refer to the process involving the decoder in the method embodiment of FIG. To avoid repetition, it will not be detailed here.
- system and “network” are used interchangeably herein.
- the term “and/or” in this context is merely an association describing the associated object, indicating that there may be three relationships, for example, A and / or B, which may indicate that A exists separately, and both A and B exist, respectively. B these three situations.
- the character "/" in this article generally indicates that the contextual object is an "or" relationship.
- B corresponding to A means that B is associated with A, and B can be determined according to A.
- determining B from A does not mean that B is only determined based on A, and that B can also be determined based on A and/or other information.
- the disclosed systems, devices, and methods may be implemented in other manners.
- the device embodiments described above are merely illustrative.
- the division of cells is only a logical function division.
- multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, or an electrical, mechanical or other form of connection.
- the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.
- each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
- Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another.
- a storage medium may be any available media that can be accessed by a computer.
- computer readable media may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, disk storage media or other magnetic storage device, or can be used for carrying or storing in the form of an instruction or data structure.
- Any connection may suitably be a computer readable medium.
- the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave
- the coaxial cable , fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, wireless, and microwave are included in the fixing of the associated media.
- Disks and discs include compact discs (CDs), laser discs, compact discs, digital versatile discs (DVDs), floppy discs, and Blu-rays.
- Optical discs in which discs are usually magnetically replicated, while discs use lasers to optically replicate data. Combinations of the above should also be included within the scope of the computer readable media.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Discrete Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (30)
- 一种帧内编码的方法,其特征在于,包括:获取当前图像块的参考像素值;根据所述当前图像块的参考像素值,采用帧内预测算法得到所述当前图像块中第一类像素的预测值,所述当前图像块包括第一类像素和第二类像素,所述第二类像素为所述当前图像块中除所述第一类像素之外的像素;根据所述第一类像素的预测值和所述第一类像素的原始像素值得到所述第一类像素的残差值;根据所述第一类像素的残差值,得到变换系数;量化所述变换系数,得到量化变换系数;根据所述量化变换系数和所述第一类像素的预测值,对所述第一类像素进行重建,得到所述第一类像素的重建值;根据所述第一类像素的重建值,采用插值法得到所述第二类像素的重建值。
- 根据权利要求1所述的方法,其特征在于,在根据所述第一类像素的重建值,采用插值法得到所述第二类像素的重建值之前,所述方法还包括:根据所述帧内预测算法确定所述插值法,其中,所述插值法的插值方式与所述帧内预测算法的插值方式相同。
- 根据权利要求1或2所述的方法,其特征在于,所述根据所述第一类像素的残差值,得到变换系数,包括:根据所述第一类像素的残差值得到所述第二类像素中的B个像素的残差值,B为不小于1的正整数,对所述第一类像素的残差值和所述B个像素的残差值进行变换,得到所述变换系数,其中,所述变换系数中固定0系数的数量等于B。
- 根据权利要求3所述的方法,其特征在于,所述第一类像素的残差值的数量为A个,所述第二类像素中的B个像素对应B个残差值,其中,所述A个残差值与所述第一类像素中的像素一一对应,所述B个残差值与所述B个像素一一对应,所述根据所述第一类像素的残差值得到所述第二类像素中的B个像素的残差值,包括:确定与所述第一类像素的残差值的数量A和所述第二类像素中的B个像素的残差值的数量B对应的B×A矩阵;将所述B×A矩阵与所述A个第一类像素的残差值组成的列向量相乘,得到所述第二类像素中的B个像素的残差值所构成的列向量;根据所述第二类像素中的B个像素的残差值所构成的列向量,得到所述第二类像素中的B个像素的残差值。
- 根据权利要求1或2所述的方法,其特征在于,所述根据所述第一类像素的残差值,得到变换系数,包括:将所述第二类像素中的至少一个像素中每一个像素的原始值减去所述每一个像素的预测值,得到所述每一个像素的残差值,其中,所述每一个像素的预测值是采用帧内预测算法得到的;对所述第一类像素的残差值和所述第二类像素中的至少一个像素的残差值进行变换,得到所述变换系数。
- 根据权利要求1至5中任一项所述的方法,其特征在于,所述对所述变换系数进行量化,得到量化变换系数,包括:按照变换系数的扫描顺序对所述变换系数进行量化,得到量化变换系数。
- 根据权利要求1至7中任一项所述的方法,其特征在于,所述根据所述第一类像素的预测值和所述第一类像素的原始像素值得到所述第一类像素的残差值,包括:将所述第一类像素的原始值减去所述第一类像素的预测值,得到所述第一类像素的残差值。
- 根据权利要求1至8中任一项所述的方法,其特征在于,还包括:根据所述量化变换系数生成码流,以便解码设备根据所述码流重建所述当前图像块。
- 根据权利要求9所述的方法,其特征在于,所述根据所述量化变换系数生成码流,包括:采用熵编码方法,对所述帧内预测算法的信息和所述量化变换系数进行编码,得到所述码流。
- 根据权利要求9所述的方法,其特征在于,所述根据所述量化变换系数生成码流,包括:采用熵编码方法,对所述帧内预测算法的信息、所述量化变换系数和所述插值法的信息进行编码,得到所述码流。
- 一种帧内解码的方法,其特征在于,包括:获取当前图像块的参考像素值;根据所述当前图像块的参考像素值,采用帧内预测算法得到所述当前图像块中第一类像素的预测值,所述当前图像块包括第一类像素和第二类像素,所述第二类像素为所述当前图像块中除第一类像素之外的像素;对当前图像块的量化变换系数进行反量化,得到变换系数;对所述变换系数进行反变换,得到所述第一类像素的重建残差值;将所述第一类像素的重建残差值与所述第一类像素的预测值相加,得到所述第一类像素的重建值;根据所述第一类像素的重建值,采用插值法得到所述第二类像素的重建值。
- 根据权利要求12所述的方法,其特征在于,在对所述变换系数进行反变换之前,所述方法还包括:按照变换系数的扫描顺序将所述变换系数放置在变换系数矩阵中的第一类预设位置,其中,所述变换系数矩阵中的第二类预设位置的变换系数设为预设值,所述第二类预设位置的数目与所述第一类预设位置的数目之和等于所述变换系数矩阵中变换系数的总数目。
- 根据权利要求12或13所述的方法,其特征在于,在根据所述第一类像素的重建值,通过插值法得到所述第二类像素的重建值之前,还包括:根据所述帧内预测算法确定所述插值法,所述插值法中的插值方式与所 述帧内预测算法包括的插值方式相同。
- 根据权利要求12或13所述的方法,其特征在于,在根据所述第一类像素的重建值,通过插值法得到所述第二类像素的重建值之前,还包括:根据所述图像块的码流确定所述插值法。
- 一种编码器,其特征在于,包括:第一获取单元,用于获取当前图像块的参考像素值;第二获取单元,用于根据所述当前图像块的参考像素值,采用帧内预测算法得到所述当前图像块中第一类像素的预测值,所述当前图像块包括第一类像素和第二类像素,所述第二类像素为所述当前图像块中除所述第一类像素之外的像素;第一确定单元,用于根据所述第一类像素的预测值和所述第一类像素的原始像素值得到所述第一类像素的残差值;变换单元,用于根据所述第一类像素的残差值,得到变换系数;量化单元,用于量化所述变换系数,得到量化变换系数;第一重建单元,用于根据所述量化变换系数和所述第一类像素的预测值,对所述第一类像素进行重建,得到所述第一类像素的重建值;第二重建单元,用于根据所述第一类像素的重建值,采用插值法得到所述第二类像素的重建值。
- 根据权利要求16所述的编码器,其特征在于,还包括:第二确定单元,用于根据所述帧内预测算法确定所述插值法,其中,所述插值法中的插值方式与所述帧内预测算法包括的插值方式相同。
- 根据权利要求16或17所述的编码器,其特征在于,所述变换单元具体用于根据所述第一类像素的残差值得到所述第二类像素中的B个像素的残差值,B为不小于1的正整数,对所述第一类像素的残差值和所述B个像素的残差值进行变换,得到所述变换系数,其中,所述变换系数中固定0系数的数量等于B。
- 根据权利要求18所述的编码器,其特征在于,所述第一类像素的残差值的数量为A个,所述第二类像素中的B个像素对应B个残差值,其中,所述A个残差值与所述第一类像素中的像素一一对应,所述B个残差值与所述B个像素一一对应,所述第三获取单元具体用于确定与所述第一类像素的残差值的数量A和所述第二类像素中的B个像素的残差值的数量B 对应的B×A矩阵;将所述B×A矩阵与所述A个第一类像素的残差值组成的列向量相乘,得到所述第二类像素中的B个像素的残差值所构成的列向量;根据所述第二类像素中的B个像素的残差值所构成的列向量,得到所述第二类像素中的B个像素的残差值。
- 根据权利要求16或17所述的编码器,其特征在于,所述变换单元具体用于将所述第二类像素中的至少一个像素中每一个像素的原始值减去所述每一个像素的预测值,得到所述每一个像素的残差值,其中,所述每一个像素的预测值是采用帧内预测算法得到的;对所述第一类像素的残差值和所述第二类像素中的至少一个像素的残差值进行变换,得到所述变换系数。
- 根据权利要求16至20中任一项所述的编码器,其特征在于,所述量化单元具体用于按照变换系数的扫描顺序对所述变换系数进行量化,得到量化变换系数。
- 根据权利要求16至22中任一项所述的编码器,其特征在于,所述第一确定单元具体用于将所述第一类像素的原始值和所述第一类像素的预测值相减,得到所述第一类像素的残差值。
- 根据权利要求16至23中任一项所述的编码器,其特征在于,还包括:生成单元,用于根据所述量化变换系数生成码流,以便解码设备根据所述码流重建所述当前图像块。
- 根据权利要求24所述的编码器,其特征在于,所述生成单元具体用于采用熵编码方法,对所述帧内预测算法的信息和所述量化变换系数进行 编码,得到所述码流。
- 根据权利要求24所述的编码器,其特征在于,所述生成单元具体用于采用熵编码方法,对所述帧内预测算法的信息、所述量化变换系数和所述插值法的信息进行编码,得到所述码流。
- 一种解码器,其特征在于,包括:第一获取单元,用于获取当前图像块的参考像素值;第二获取单元,用于根据所述当前图像块的参考像素值,采用帧内预测算法得到所述当前图像块中第一类像素的预测值,所述当前图像块包括第一类像素和第二类像素,所述第二类像素为所述当前图像块中除所述第一类像素之外的像素;反量化单元,用于对当前图像块的量化变换系数进行反量化,得到变换系数;反变换单元,用于对所述变换系数进行反变换,得到所述第一类像素的重建残差值;第一重建单元,用于将所述第一类像素的重建残差值与所述第一类像素的预测值相加,得到所述第一类像素的重建值;第二重建单元,用于根据所述第一类像素的重建值,采用插值法得到所述第二类像素的重建值。
- 如权利要求27所述的解码器,其特征在于,还包括:放置单元,用于按照变换系数的扫描顺序将所述变换系数放置在变换系数矩阵中的第一类预设位置,其中,所述变换系数矩阵中的第二类预设位置的变换系数设为预设值,所述第二类预设位置的数目与所述第一类预设位置的数目之和等于所述变换系数矩阵中变换系数的总数目。
- 根据权利要求27或28所述的解码器,其特征在于,还包括:第一确定单元,用于根据所述帧内预测算法确定所述插值法,所述插值法中的插值方式与所述帧内预测算法包括的插值方式相同。
- 根据权利要求27或28所述的解码器,其特征在于,还包括:第二确定单元,用于根据所述图像块的码流确定所述插值法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020177027290A KR20170122796A (ko) | 2015-03-03 | 2015-11-30 | 인트라 프레임 인코딩 방법, 인트라 프레임 디코딩 방법, 인코더, 및 디코더 |
JP2017546177A JP2018511227A (ja) | 2015-03-03 | 2015-11-30 | フレーム内符号化方法、フレーム内復号化方法、エンコーダ、及びデコーダ |
EP15883829.2A EP3258694A4 (en) | 2015-03-03 | 2015-11-30 | Intra-frame codec method, coder and decoder |
US15/694,440 US10412393B2 (en) | 2015-03-03 | 2017-09-01 | Intra-frame encoding method, intra-frame decoding method, encoder, and decoder |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510094314.7 | 2015-03-03 | ||
CN201510094314.7A CN104702962B (zh) | 2015-03-03 | 2015-03-03 | 帧内编解码方法、编码器和解码器 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/694,440 Continuation US10412393B2 (en) | 2015-03-03 | 2017-09-01 | Intra-frame encoding method, intra-frame decoding method, encoder, and decoder |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016138779A1 true WO2016138779A1 (zh) | 2016-09-09 |
Family
ID=53349673
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/096021 WO2016138779A1 (zh) | 2015-03-03 | 2015-11-30 | 帧内编解码方法、编码器和解码器 |
Country Status (6)
Country | Link |
---|---|
US (1) | US10412393B2 (zh) |
EP (1) | EP3258694A4 (zh) |
JP (1) | JP2018511227A (zh) |
KR (1) | KR20170122796A (zh) |
CN (1) | CN104702962B (zh) |
WO (1) | WO2016138779A1 (zh) |
Families Citing this family (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104702962B (zh) | 2015-03-03 | 2019-04-16 | 华为技术有限公司 | 帧内编解码方法、编码器和解码器 |
US11463689B2 (en) | 2015-06-18 | 2022-10-04 | Qualcomm Incorporated | Intra prediction and intra mode coding |
US10841593B2 (en) | 2015-06-18 | 2020-11-17 | Qualcomm Incorporated | Intra prediction and intra mode coding |
US20160373770A1 (en) * | 2015-06-18 | 2016-12-22 | Qualcomm Incorporated | Intra prediction and intra mode coding |
KR102139159B1 (ko) | 2015-11-06 | 2020-07-29 | 후아웨이 테크놀러지 컴퍼니 리미티드 | 변환 계수의 역양자화 방법 및 장치, 그리고 디코딩 기기 |
US20190037217A1 (en) * | 2016-02-16 | 2019-01-31 | Samsung Electronics Co., Ltd. | Video encoding method and apparatus, and decoding method and apparatus therefor |
WO2018119609A1 (zh) * | 2016-12-26 | 2018-07-05 | 华为技术有限公司 | 一种基于模板匹配的编解码方法及装置 |
CN106713816A (zh) * | 2017-01-09 | 2017-05-24 | 宇龙计算机通信科技(深圳)有限公司 | 图像传输的方法及装置 |
EP3535973B1 (en) * | 2017-02-02 | 2020-07-29 | Huawei Technologies Co., Ltd. | Image and video processing apparatuses and methods |
US10241481B2 (en) * | 2017-03-17 | 2019-03-26 | Fisher Controls International Llc | Methods and apparatus for controlling multiple valves as a single valve based on a coordinated control signal |
CN107181963B (zh) * | 2017-03-31 | 2019-10-22 | 武汉斗鱼网络科技有限公司 | 一种视频压缩方法及装置 |
CN109922340B (zh) | 2017-12-13 | 2021-10-15 | 华为技术有限公司 | 图像编解码方法、装置、系统及存储介质 |
WO2019157717A1 (zh) * | 2018-02-14 | 2019-08-22 | 北京大学 | 运动补偿的方法、装置和计算机系统 |
CN108600750A (zh) * | 2018-04-10 | 2018-09-28 | 山东师范大学 | 基于ksvd的多描述编码、解码方法及系统 |
US11438610B2 (en) | 2018-04-13 | 2022-09-06 | Koninklijke Kpn N.V. | Block-level super-resolution based video coding |
CN108737836A (zh) * | 2018-06-13 | 2018-11-02 | 北京奇艺世纪科技有限公司 | 一种帧间预测编码方法、装置及电子设备 |
US11277644B2 (en) | 2018-07-02 | 2022-03-15 | Qualcomm Incorporated | Combining mode dependent intra smoothing (MDIS) with intra interpolation filter switching |
CN111050176B (zh) * | 2018-10-15 | 2021-10-15 | 腾讯科技(深圳)有限公司 | 视频编码、视频解码方法、装置、计算机设备和存储介质 |
US11303885B2 (en) | 2018-10-25 | 2022-04-12 | Qualcomm Incorporated | Wide-angle intra prediction smoothing and interpolation |
CN109495745B (zh) * | 2018-11-20 | 2021-03-30 | 北京工业大学 | 一种基于逆量化/逆变换的无损压缩解码方法 |
WO2020116961A1 (ko) * | 2018-12-06 | 2020-06-11 | 엘지전자 주식회사 | 이차 변환에 기반한 영상 코딩 방법 및 그 장치 |
KR20220019232A (ko) * | 2019-06-11 | 2022-02-16 | 소니그룹주식회사 | 화상 처리 장치 및 화상 처리 방법 |
CN112154666A (zh) * | 2019-09-24 | 2020-12-29 | 深圳市大疆创新科技有限公司 | 视频编解码方法和装置 |
MX2021011036A (es) | 2019-09-24 | 2021-10-13 | Guangdong Oppo Mobile Telecommunications Corp Ltd | Procedimientos de determinacion del valor de prediccion, codificador, decodificador y medio de almacenamiento informatico. |
CN111050183B (zh) * | 2019-12-13 | 2022-04-19 | 浙江大华技术股份有限公司 | 一种帧内预测方法、编码器及存储介质 |
CN117689556B (zh) * | 2024-02-02 | 2024-05-07 | 深圳市欧冶半导体有限公司 | 直方图编码方法、直方图解码方法、装置、设备和介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1929611A (zh) * | 2005-09-06 | 2007-03-14 | 三星电子株式会社 | 用于视频帧内预测编码和解码的方法和装置 |
CN101783957A (zh) * | 2010-03-12 | 2010-07-21 | 清华大学 | 一种视频预测编码方法和装置 |
US20110243230A1 (en) * | 2010-03-31 | 2011-10-06 | Futurewei Technologies, Inc. | Multiple Predictor Sets for Intra-Frame Coding |
CN102893606A (zh) * | 2010-05-14 | 2013-01-23 | 汤姆森特许公司 | 帧内编码将像素指定给各组的块的方法和装置 |
CN104702962A (zh) * | 2015-03-03 | 2015-06-10 | 华为技术有限公司 | 帧内编解码方法、编码器和解码器 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101246294B1 (ko) | 2006-03-03 | 2013-03-21 | 삼성전자주식회사 | 영상의 인트라 예측 부호화, 복호화 방법 및 장치 |
US8630346B2 (en) * | 2007-02-20 | 2014-01-14 | Samsung Electronics Co., Ltd | System and method for introducing virtual zero motion vector candidates in areas of a video sequence involving overlays |
KR101302660B1 (ko) * | 2009-09-14 | 2013-09-03 | 에스케이텔레콤 주식회사 | 고해상도 동영상의 부호화/복호화 방법 및 장치 |
US9497472B2 (en) * | 2010-11-16 | 2016-11-15 | Qualcomm Incorporated | Parallel context calculation in video coding |
US9106913B2 (en) * | 2011-03-08 | 2015-08-11 | Qualcomm Incorporated | Coding of transform coefficients for video coding |
US20120294365A1 (en) * | 2011-05-17 | 2012-11-22 | Dong Zheng | Image and video encoding and decoding |
JP6242793B2 (ja) | 2011-09-15 | 2017-12-06 | ヴィド スケール インコーポレイテッド | 空間的予測のためのシステムおよび方法 |
CN102917226B (zh) * | 2012-10-29 | 2015-07-15 | 电子科技大学 | 一种基于自适应下采样与插值的帧内帧视频编码方法 |
-
2015
- 2015-03-03 CN CN201510094314.7A patent/CN104702962B/zh active Active
- 2015-11-30 WO PCT/CN2015/096021 patent/WO2016138779A1/zh active Application Filing
- 2015-11-30 EP EP15883829.2A patent/EP3258694A4/en not_active Ceased
- 2015-11-30 JP JP2017546177A patent/JP2018511227A/ja active Pending
- 2015-11-30 KR KR1020177027290A patent/KR20170122796A/ko not_active Application Discontinuation
-
2017
- 2017-09-01 US US15/694,440 patent/US10412393B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1929611A (zh) * | 2005-09-06 | 2007-03-14 | 三星电子株式会社 | 用于视频帧内预测编码和解码的方法和装置 |
CN101783957A (zh) * | 2010-03-12 | 2010-07-21 | 清华大学 | 一种视频预测编码方法和装置 |
US20110243230A1 (en) * | 2010-03-31 | 2011-10-06 | Futurewei Technologies, Inc. | Multiple Predictor Sets for Intra-Frame Coding |
CN102893606A (zh) * | 2010-05-14 | 2013-01-23 | 汤姆森特许公司 | 帧内编码将像素指定给各组的块的方法和装置 |
CN104702962A (zh) * | 2015-03-03 | 2015-06-10 | 华为技术有限公司 | 帧内编解码方法、编码器和解码器 |
Non-Patent Citations (3)
Title |
---|
GUO, BIN ET AL.: "A New Padding Technique for Coding of Arbitrarily-Shaped Image/ Video Segments", IMAGE PROCESSING, 1999, ICIP 99.PROCEEDINGS.1999 INTERNATIONAL CONFERENCE ON, vol. 2, 28 October 1999 (1999-10-28), pages 838 - 842, XP010369038, ISSN: 7803-5467, DOI: doi:10.1109/ICIP.1999.823015 * |
See also references of EP3258694A4 * |
ZHU, SHUYUAN ET AL.: "Constrained Quantization in the Transform Domain with Applications in Arbitrarily-Shaped Object Coding", CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, IEEE TRANSACTIONS ON, vol. 20, no. 11, 5 November 2010 (2010-11-05), pages 1385 - 1394, XP011305271, ISSN: 1051-8215 * |
Also Published As
Publication number | Publication date |
---|---|
KR20170122796A (ko) | 2017-11-06 |
JP2018511227A (ja) | 2018-04-19 |
CN104702962B (zh) | 2019-04-16 |
US10412393B2 (en) | 2019-09-10 |
CN104702962A (zh) | 2015-06-10 |
US20180007367A1 (en) | 2018-01-04 |
EP3258694A1 (en) | 2017-12-20 |
EP3258694A4 (en) | 2018-02-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2016138779A1 (zh) | 帧内编解码方法、编码器和解码器 | |
CN111819852A (zh) | 用于变换域中残差符号预测的方法及装置 | |
WO2020103800A1 (zh) | 视频解码方法和视频解码器 | |
KR102631373B1 (ko) | 비디오 코딩을 위한 방법 및 장치 | |
JP2022524916A (ja) | 適応的な数の領域を伴う幾何学的分割のための形状適応離散コサイン変換 | |
CN112543337B (zh) | 视频解码方法、装置、计算机可读介质及电子设备 | |
JP2022539937A (ja) | 画像成分予測方法、符号化器、復号化器、並びに記憶媒体 | |
KR20220077931A (ko) | 컨텍스트 적응 변환 세트 | |
WO2021134635A1 (zh) | 变换方法、编码器、解码器以及存储介质 | |
CN113596445B (zh) | 进行编码和解码的方法、解码端、编码端和系统 | |
WO2018014301A1 (zh) | 视频编码方法及装置 | |
JP2023513772A (ja) | ビデオコーディングのための方法、装置およびコンピュータプログラム | |
WO2021135856A1 (zh) | 视频编解码方法、装置、设备及存储介质 | |
WO2023082107A1 (zh) | 解码方法、编码方法、解码器、编码器和编解码系统 | |
CN111988618A (zh) | 进行解码、编码的方法、解码端和编码端 | |
CN116982262A (zh) | 视频编码中依赖性量化的状态转换 | |
CN114449277B (zh) | 用于系数代码化的上下文推导的方法和设备 | |
WO2021134303A1 (zh) | 变换方法、编码器、解码器以及存储介质 | |
US11930163B2 (en) | Methods and systems for combined lossless and lossy coding | |
WO2023131221A2 (zh) | 图像编解码的方法、装置及存储介质 | |
WO2021134637A1 (zh) | 变换方法、编码器、解码器以及存储介质 | |
WO2020000487A1 (zh) | 变换方法、反变换方法及装置 | |
CN116916033A (zh) | 一种基于随机自适应傅里叶分解的联合时空视频压缩方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15883829 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2017546177 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REEP | Request for entry into the european phase |
Ref document number: 2015883829 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 20177027290 Country of ref document: KR Kind code of ref document: A |