WO2011160251A1 - Method and apparatus for encoding/decoding image data - Google Patents

Method and apparatus for encoding/decoding image data Download PDF

Info

Publication number
WO2011160251A1
WO2011160251A1 PCT/CN2010/000901 CN2010000901W WO2011160251A1 WO 2011160251 A1 WO2011160251 A1 WO 2011160251A1 CN 2010000901 W CN2010000901 W CN 2010000901W WO 2011160251 A1 WO2011160251 A1 WO 2011160251A1
Authority
WO
WIPO (PCT)
Prior art keywords
prediction
pixels
blocks
image
residual data
Prior art date
Application number
PCT/CN2010/000901
Other languages
French (fr)
Inventor
Jiheng Yang
Hui Zhang
Original Assignee
Thomson Broadband R&D (Beijing) Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Broadband R&D (Beijing) Co., Ltd. filed Critical Thomson Broadband R&D (Beijing) Co., Ltd.
Priority to EP10853395.1A priority Critical patent/EP2583457A4/en
Priority to CN2010800676207A priority patent/CN103141091A/en
Priority to US13/805,195 priority patent/US9036932B2/en
Priority to PCT/CN2010/000901 priority patent/WO2011160251A1/en
Publication of WO2011160251A1 publication Critical patent/WO2011160251A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/11Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/436Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques

Definitions

  • This invention relates to a method and an apparatus for encoding image data, and a method and an apparatus for decoding image data.
  • Various video coding standards e.g. MPEG-4 Part 10/AVC, apply a spatial based intra prediction algorithm for taking advantage of spatial redundancy within images.
  • the intra prediction is done for various block sizes (e.g. 4x4, 8x8 and 16x16) .
  • 4x4 block intra prediction as an example, there are in AVC nine pre-defined spatial predictors and the prediction directions for predicting.
  • One of the biggest issues of intra prediction schemes employed in AVC is its complexity. In order to make a correct prediction of the current block, the blocks that are located on the left and upper side of a current block are reconstructed first, after their own encoding and before serving as predictors. Therefore, image encoding can only be performed sequentially, in left-to-right and up-down directions.
  • invention provides such solution, and is suitable for improving the efficiency of intra prediction at least on the encoder side. In various embodiments, also an improvement on the decoder side is achieved.
  • the present invention is based on the recognition of the fact that image prediction can be based on estimated
  • predictors instead of exactly reconstructed predictors, while yielding good prediction results and therefore high compression efficiency.
  • a method for encoding image data where the image data are structured in blocks comprises for each block in (at least a portion of) the image a first prediction step of predicting the pixels of two edges of a block, based on original pixels of neighbouring blocks, wherein estimated predictor pixels are obtained, and a second prediction step of predicting remaining pixels of the block from the
  • a method for encoding image data comprises for each block in (at least a portion of) the image steps of predicting the pixels of two edges of a block in a first prediction step, wherein the prediction is based on pixels of neighbouring . blocks from the original image, and wherein estimated predictor pixels are obtained, determining residual data for the estimated predictor pixels, performing quantization and inverse quantization on the determined residual data for the estimated predictor pixels, wherein reconstructed residual data for estimated predictor pixels are obtained, reconstructing predictor pixels,
  • reconstructed residual data for estimated predictor pixels is obtained, in a second prediction step, predicting
  • a device for encoding image data which are structured in blocks, comprises first and second prediction means, first and second residual determining means, quantizer and inverse quantizer means, reconstruction means, and entropy coding means.
  • the apparatus performs for each block in at least a portion of the image the steps of
  • the first prediction means predicting the pixels of two edges of a block in a first prediction step, wherein the prediction is based on pixels of neighbouring blocks from the original image, and wherein estimated predictor pixels are obtained;
  • the residual determining means determining residual data for the estimated predictor pixels
  • the reconstruction means reconstructing predictor pixels, wherein the difference between original pixels and
  • residual data for each predicted pixel resulting from the first or second prediction step the residual data being the difference between the predicted pixel and its corresponding original pixel
  • the encoder can perform intra prediction for all blocks of at least a portion of an image simultaneously, based on the estimated predictors, instead of relying on the reconstructed exact predictors from the conventional
  • Fig.3 a 4x4 block with its boundary pixels and nine intra prediction modes (9 th mode is DC mode, not shown) ;
  • Fig.6 a frame that is divided into NxM portions, each of
  • Fig.7 a flow-diagram of the encoding procedure
  • Fig.8 an overview of an encoder structure
  • Fig.9 an overview of a decoder structure.
  • Fig.l shows a video frame or image 100, which is structured into blocks of 4x4 pixels each, and the predictors 110,120 for all 4x4 blocks in the current frame.
  • the frame is intra- predicted, i.e. all prediction is done from other pixel data of the same frame.
  • the predictors 110,120 for all 4x4 blocks in the current coding frame are the lower and right edges of each 4x4 block (only if the edge has a neighbour block), and are shown shaded.
  • FIG.2 In more detail, four 4x4 blocks B0-B3 and BO's neighbouring pixels X,A-L in the original frame are shown in Fig.2.
  • reconstructed predictors are required. That is, in a conventional encoder right edge pixels d,h,l,p of a current block B0 are predicted, reconstructed and then used to predict pixels of a horizontally adjacent block Bl. Lower edge pixels m,n,o,p of a current block B0 in a conven- tional encoder are predicted, reconstructed and then used to predict pixels of a vertically adjacent block B2.
  • the predictors are reconstructed and usable not before the macroblocks (MBs) located in the top and left have been reconstructed.
  • the reconstructed predictors are generated by estimation before actually coding the MBs, i.e. fast approximation of the reconstructed predictors is possible as a separate step. This has the advantage that all predictors are available simultaneously before actually encoding the image. Therefore the actual intra-prediction, which also takes a long time, can be made for some or all blocks of at least a portion of the image, or the complete image, simultaneously.
  • the invention uses the neighbouring pixels in the original frame to make the prediction directly. Then, e.g. for block B0 in Fig.2, the prediction is directly done using original pixels X,A,...,L and using a spatial prediction mode (e.g. one of the nine spatial prediction modes of AVC). This generates a predicted block per spatial prediction mode.
  • a spatial prediction mode e.g. one of the nine spatial prediction modes of AVC.
  • error_func is an error measuring method. It can in principle be any known error measuring method ( sum-of-absolute- differences SAD, sum-of-absolute-transformed-differences
  • all the predictors for the blocks are estimated.
  • the predictors are the edge pixels of two edges of each block. Note that this need not necessarily be the lower and right edges of a block: it depends on the possible prediction direction. Using lower and right edge pixels of a block is suitable for left-to-right and up-to- down prediction directions, e.g. line-wise or column-wise.
  • all chosen best prediction modes for each block and the estimated predictors are used to perform intra prediction for all 4x4 blocks (of at least a portion of the image) simultaneously. That is, the intra prediction within the encoding process is based not on reconstructed pixels, but on estimated reconstructed pixels that are obtained from the original pixels. This simplifies the encoding process and encoder, and accelerates it.
  • all possible prediction modes are checked in order to decide the best prediction mode.
  • the complexity of this approach can be reduced.
  • the pixels m,n,o,p,d,h and 1 that shall be used as estimated predictors are relatively far away from their own predictor pixels X,A,B,...,L. Therefore, the mode selection can be simplified by using only major prediction directions to perform a prediction specifically for m,n,o,p,d,h and 1 to make the below-described estimation.
  • the simplified mode selection only the DC mode, vertical intra-prediction mode and horizontal intra-prediction mode are used to esti- mate m,n,o,p,d,h and 1.
  • the prediction error ERROR DC , ERROR V er and ERRORhor between these pixels and the estimated pixels is calculated.
  • the ERROR function can be any known error measurement function (SAD, SATD, MSE, etc.) Choose the smallest ERROR from all major directions to estimate the reconstructed predictors, using equation (2).
  • the estimated predictors are used to perform intra prediction based on all allowed prediction modes.
  • the nine above-shown intra-prediction modes of AVC can be used.
  • the intra prediction modes, and corresponding mode selection, for estimating the predictors are in principle independent from the intra prediction modes, and correspon- ding mode selection, for the actual intra-prediction of all the pixels. Then, all 4x4 blocks can be predicted
  • the encoding process is described in more detail.
  • the encoding is a process that has two phases.
  • the first phase of the encoding procedure is shown in Fig.4.
  • lower-edge pixels m 0 ,n 0 ,oo,po and right-edge pixels d 0 ,h 0 ,lo,po of each block are predicted from pixels of neighbouring blocks of the original image A-L.
  • Edge pixels of the leftmost or uppermost blocks can be predicted using the same modes as for conventional intra-coding, e.g. DC mode, since these blocks have no left or upper neighbours.
  • all predictors of all blocks are estimated.
  • each block has estimated predictors in neighbouring blocks in two directions available (left and upper direction in Fig.4), before any block is actually encoded. This is possible because the estimated predictors are predicted from pixels of the original image.
  • a second step which may be considered as part of the first phase or the second phase or as separate intermediate phase, the residuals between the estimated predictors and their original pixels are determined, e.g. m-m p , n-n p etc. These residuals are then quantized and inverse quantized, in order to make them more similar to the predictors that will be available at the decoder. This results in reconstructed predictor residuals for all blocks (in the concerned portion of the image) , according to
  • each block has estimated predictors in two neighbouring blocks, as shown in Fig.4 b) .
  • Accelerated intra-prediction can be applied to one or more portions of an image simultaneously. Other portions may use other, e.g. conventional, intra prediction.
  • conventional intra prediction may be applied in a region-of-interest (ROI), while accelerated intra prediction according to the invention is used in remaining portions of the image
  • ROI region-of-interest
  • accelerated intra prediction according to the invention is used in remaining portions of the image
  • the second phase of the encoding process is shown in Fig.5. It comprises prediction and reconstruction of remaining pixels, i.e.
  • pixels a 3 , b 3 , k 3 of a block B3 are predicted using intra- prediction, which uses the actual estimated predictor pixels of neighbouring blocks B0, Bl and B2.
  • intra- prediction uses the actual estimated predictor pixels of neighbouring blocks B0, Bl and B2.
  • any combination of upper edge, lower edge, left edge and right edge pixels of adjacent blocks can be used as predictors, depending on the prediction direction.
  • step 4 shown in Fig.5 the predicted remaining pixels a 3 , b 3 , k 3 of a block B3 and the original pixels A 3 ,B 3 ,...,K 3 of said block are used to determine prediction residuals
  • the encoded image data Since the estimated predictors are slightly different from the exact predictors that would be used by conventional sequential intra-prediction, the encoded image data
  • encoder and decoder do not use exactly the same predictors, since an encoder uses the estimated predictors and a decoder uses conventionally reconstructed predictors.
  • the different predictors of encoder and decoder are so similar that the difference is not visible in the image. It has been found that the simplified prediction based on estimated predictors, as employed by the invention, is not only faster and less computational expensive, but also in terms of quality yields much better results than could be expected.
  • Embodiments of the present invention comprise at least the following:
  • a method for encoding image data the image data being structured in blocks, comprises for each block in at least a portion of the image the steps of
  • m' m - Q ' ⁇ Qdn-m p ) ,QP) ,QP) ;
  • the residual data being the difference between the predicted pixel and its corresponding original pixel; and entropy encoding the residual data.
  • the second prediction step is executed in parallel for at least two blocks of the image simultaneously, and the step of
  • the first prediction step is executed in parallel for at least two blocks of the image simultaneously. This is possible because there are no dependency issues among blocks, since the original pixel values are used in the first prediction step.
  • the first prediction step further comprises determining for each of the estimated predictor pixels a best prediction mode from a given group of spatial intra prediction modes.
  • the given group of spatial intra prediction modes comprises DC mode, horizontal prediction mode and vertical prediction mode.
  • the given group of spatial intra prediction modes consists of only DC mode, horizontal prediction and vertical prediction.
  • the image is structured into at least two portions, wherein the method is executed in parallel for at least two portions of the image simultaneously and independently.
  • the at least one portion of the image is not square, wherein if there is more than one portion, all portions have the same shape and same amount of blocks.
  • a method for decoding image data comprises, in all portions of the image
  • a device for encoding image data the image data being structured in blocks, comprises
  • first and second prediction means first and second residual determining means; quantizer and inverse quantizer;
  • the first prediction means predicting the pixels of two edges of a block in a first prediction step, wherein the prediction is based on pixels of neighbouring blocks from the original image, and wherein estimated predictor pixels are obtained;
  • the residual determining means determining residual data for the estimated predictor pixels
  • the second residual determining means determining residual data for each predicted pixel resulting from the first or second prediction step, the residual data being the difference between the predicted pixel and its corresponding original pixel; and in the entropy coding means, entropy encoding the residual data.
  • the encoding device further comprises at least a second set of second prediction means and residual determining means, wherein the second prediction step is executed in parallel in the at least two second prediction means for at least two blocks of the image simultaneously, and the step of determining residual data is executed in parallel in the at least two residual prediction means for at least two blocks of the image simultaneously.
  • the encoding device further comprises at least two of the first prediction means, wherein the first prediction step is executed in the at least two first prediction means in parallel for at least two blocks of the image simultaneously.
  • the first prediction step is executed in the at least two first prediction means in parallel for at least two blocks of the image simultaneously.
  • prediction means comprises a prediction mode selector for determining for each of the estimated predictor pixels a best prediction mode from a given group of spatial intra prediction modes.
  • the image is structured into at least two portions, and the device operates in parallel for at least two portions of the image simultaneously and independently.
  • a device for decoding image data comprises decoder data receiving means DDR, decoder pixel reconstruction means DPR, and decoder pixel prediction means DPP.
  • the device After receiving pixel data, prediction mode data and residual data in the decoder data receiving means DDR, the device performs in all portions of the image independently and simultaneously the following steps: in the decoder pixel reconstruction means DPR, reconstructing pixels based on received pixel data; in the decoder pixel prediction means DPP, predicting pixels in the blocks from said reconstructed pixels of the block or from reconstructed pixels of neighbouring blocks; and further in the decoder pixel reconstruction means DPR, reconstructing the predicted pixels based on reconstructed predictors and received residual data. For parallel decoding two or more sets of decoder pixel reconstruction means DPR and decoder pixel prediction means DPP may be employed in the decoder.
  • intra 4x4 prediction is used as an example. It is clear that the same mechanism can seamlessly be applied to other intra predictions, e.g. intra 16x16 prediction. Usually, the processing of a block is independent from its relative position in a MB.
  • the at least one portion of the image is not square, and if there is more than one portion, all portions have the same shape and same amount of blocks.
  • the dividing images into more than one portion and processing the portions simultaneously has the lowest measurable impact on prediction quality.
  • the usage of estimated predictors with limited set of prediction directions yields the highest performance improvement.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

Several attempts have been tried to improve the performance of intra-prediction in video encoding and decoding, which are targeting at pixel level parallelization. However, the prior art methods provide no solution for implementing an improved intra-prediction method on a parallel processing platform. The present invention uses estimated predictors instead of reconstructed exact predictors. This enables faster estimation of predictors, and allows an encoder to perform intra-prediction for all blocks of at least a portion of an image simultaneously. A method for encoding image data, a device for encoding image data, a method for decoding image data and a device for decoding image data are disclosed.

Description

METHOD AND APPARATUS FOR ENCODING/DECODING IMAGE DATA
Field of the invention This invention relates to a method and an apparatus for encoding image data, and a method and an apparatus for decoding image data.
Background
This section is intended to introduce the reader to various aspects of art, which may be related to various aspects of the present invention that are described and/or claimed below. This discussion is believed to be helpful in
providing the reader with background information to
facilitate a better understanding of the various aspects of the present invention. Accordingly, it should be understood that the statements in this section are to be read in this light, and not as admissions of prior art.
Various video coding standards, e.g. MPEG-4 Part 10/AVC, apply a spatial based intra prediction algorithm for taking advantage of spatial redundancy within images. The intra prediction is done for various block sizes (e.g. 4x4, 8x8 and 16x16) . Taking 4x4 block intra prediction as an example, there are in AVC nine pre-defined spatial predictors and the prediction directions for predicting. One of the biggest issues of intra prediction schemes employed in AVC is its complexity. In order to make a correct prediction of the current block, the blocks that are located on the left and upper side of a current block are reconstructed first, after their own encoding and before serving as predictors. Therefore, image encoding can only be performed sequentially, in left-to-right and up-down directions. Nowadays, the processing architectures are evolving from high performance sequential processor architecture to parallel processor architectures (e.g. IBM's cell processor, Intel's Larabee processor, and nVidia or AMD's GPUs etc.) The introduction of these processors is changing the way computation is done with computers. The more parallelism an application has, the better the application will perform on the processors. However, in AVC encoding, intra prediction cannot be efficiently be performed using these processors, due to the fact that intra prediction is a natural born sequential processing problem.
Several attempts have been tried to improve the performance of intra prediction in video encoding and decoding, which are targeted at pixel level parallelization . This approach can make prediction for a line of pixels according to the prediction mode. These methods are efficient on DSP or FPGA implementations, but the above-mentioned parallel processor architectures cannot take advantage of those proposed schemes.
Summary of the Invention
In light of the above, a solution for implementing an improved intra prediction method on a parallel processing platform remains a problem to be solved. The present
invention provides such solution, and is suitable for improving the efficiency of intra prediction at least on the encoder side. In various embodiments, also an improvement on the decoder side is achieved.
The present invention is based on the recognition of the fact that image prediction can be based on estimated
predictors instead of exactly reconstructed predictors, while yielding good prediction results and therefore high compression efficiency.
In principle, a method for encoding image data where the image data are structured in blocks comprises for each block in (at least a portion of) the image a first prediction step of predicting the pixels of two edges of a block, based on original pixels of neighbouring blocks, wherein estimated predictor pixels are obtained, and a second prediction step of predicting remaining pixels of the block from the
predicted predictor pixels of at least neighbouring blocks.
According to one embodiment of the invention, a method for encoding image data, the image data being structured in blocks, comprises for each block in (at least a portion of) the image steps of predicting the pixels of two edges of a block in a first prediction step, wherein the prediction is based on pixels of neighbouring . blocks from the original image, and wherein estimated predictor pixels are obtained, determining residual data for the estimated predictor pixels, performing quantization and inverse quantization on the determined residual data for the estimated predictor pixels, wherein reconstructed residual data for estimated predictor pixels are obtained, reconstructing predictor pixels,
wherein the difference between original pixels and
reconstructed residual data for estimated predictor pixels is obtained, in a second prediction step, predicting
remaining pixels of the block from the predicted predictor pixels of at least neighbouring blocks, determining residual data for each predicted pixel resulting from the first or second prediction step, the residual data being the
difference between the predicted pixel and its corresponding original pixel, and entropy encoding the residual data. Further, according to another embodiment of the invention, a device for encoding image data, which are structured in blocks, comprises first and second prediction means, first and second residual determining means, quantizer and inverse quantizer means, reconstruction means, and entropy coding means. The apparatus performs for each block in at least a portion of the image the steps of
in the first prediction means, predicting the pixels of two edges of a block in a first prediction step, wherein the prediction is based on pixels of neighbouring blocks from the original image, and wherein estimated predictor pixels are obtained;
in the residual determining means, determining residual data for the estimated predictor pixels;
in the quantizer and inverse quantizer, performing
quantization and inverse quantization on the determined residual data for the estimated predictor pixels, wherein reconstructed residual data for estimated predictor pixels are obtained;
in the reconstruction means, reconstructing predictor pixels, wherein the difference between original pixels and
reconstructed residual data for estimated predictor pixels is obtained;
in the second prediction means, in a second prediction step, predicting remaining pixels of the block from the predicted predictor pixels of at least neighbouring blocks;
in the second residual determining means, determining
residual data for each predicted pixel resulting from the first or second prediction step, the residual data being the difference between the predicted pixel and its corresponding original pixel; and
in the entropy coding means, entropy encoding the residual data . One advantage of the invention is that it enables faster estimation of reconstructed predictors. Another advantage is that that the encoder can perform intra prediction for all blocks of at least a portion of an image simultaneously, based on the estimated predictors, instead of relying on the reconstructed exact predictors from the conventional
sequential encoding process. Thus, encoding is accelerated.
Advantageous embodiments of the invention are disclosed in the dependent claims, the following description and the figures .
Brief description of the drawings
Exemplary embodiments of the invention are described with reference to the accompanying drawings, which show in
Fig.l predictors for all 4x4 blocks in a current frame;
Fig.2 predictors for neighbouring blocks in an exemplary 4x4 block;
Fig.3 a 4x4 block with its boundary pixels and nine intra prediction modes (9th mode is DC mode, not shown) ;
Fig. pixels in the first phase of the encoding procedure;
Fig.5 pixels in the second phase of the encoding procedure;
Fig.6 a frame that is divided into NxM portions, each of
which being predicted independently;
Fig.7 a flow-diagram of the encoding procedure;
Fig.8 an overview of an encoder structure; and
Fig.9 an overview of a decoder structure.
Detailed description of the invention
Fig.l shows a video frame or image 100, which is structured into blocks of 4x4 pixels each, and the predictors 110,120 for all 4x4 blocks in the current frame. The frame is intra- predicted, i.e. all prediction is done from other pixel data of the same frame. The predictors 110,120 for all 4x4 blocks in the current coding frame are the lower and right edges of each 4x4 block (only if the edge has a neighbour block), and are shown shaded.
In more detail, four 4x4 blocks B0-B3 and BO's neighbouring pixels X,A-L in the original frame are shown in Fig.2. To make conventional intra prediction to all 4x4 blocks in the current coding frame, reconstructed predictors are required. That is, in a conventional encoder right edge pixels d,h,l,p of a current block B0 are predicted, reconstructed and then used to predict pixels of a horizontally adjacent block Bl. Lower edge pixels m,n,o,p of a current block B0 in a conven- tional encoder are predicted, reconstructed and then used to predict pixels of a vertically adjacent block B2. In the AVC coding standard, the predictors are reconstructed and usable not before the macroblocks (MBs) located in the top and left have been reconstructed. According to the present invention, the reconstructed predictors are generated by estimation before actually coding the MBs, i.e. fast approximation of the reconstructed predictors is possible as a separate step. This has the advantage that all predictors are available simultaneously before actually encoding the image. Therefore the actual intra-prediction, which also takes a long time, can be made for some or all blocks of at least a portion of the image, or the complete image, simultaneously.
Instead of using the reconstructed predictors to perform intra prediction, the invention uses the neighbouring pixels in the original frame to make the prediction directly. Then, e.g. for block B0 in Fig.2, the prediction is directly done using original pixels X,A,...,L and using a spatial prediction mode (e.g. one of the nine spatial prediction modes of AVC). This generates a predicted block per spatial prediction mode. For the AVC example, there are nine candidate predicted blocks B01,B02, ,B09 possible, according to the nine
prediction modes shown in Fig.3. In one embodiment, more than one prediction mode is' checked, and the best mode to perform the prediction is determined by selecting the one with optimal rate-distortion. mode = i, (i = min (error_func (B0-B0i) ) ) (Eq.l) error_func is an error measuring method. It can in principle be any known error measuring method ( sum-of-absolute- differences SAD, sum-of-absolute-transformed-differences
SATD, mean-square-error SE, etc.).
For the predictor pixels m, n, o, p, d, h, 1 in a current block BO, its reconstruction can be estimated according to the best prediction mode and selected or given quantization
parameters (QP) . Taking a pixel m as an example, the
estimation reconstruction m' is calculated as follows: m' = m - Q-1(Q(m-mp), QP) , QP) (Eq.2) where Q(A, QP) means the quantization of a value A using a quantization parameter QP, and Q-1 (A, QP) means the inverse quantization of a value A using the quantization parameter QP, and mp means the prediction value of m using the best prediction mode. In this way, in one embodiment, all the predictors for the blocks are estimated. The predictors are the edge pixels of two edges of each block. Note that this need not necessarily be the lower and right edges of a block: it depends on the possible prediction direction. Using lower and right edge pixels of a block is suitable for left-to-right and up-to- down prediction directions, e.g. line-wise or column-wise.
In the next step, all chosen best prediction modes for each block and the estimated predictors are used to perform intra prediction for all 4x4 blocks (of at least a portion of the image) simultaneously. That is, the intra prediction within the encoding process is based not on reconstructed pixels, but on estimated reconstructed pixels that are obtained from the original pixels. This simplifies the encoding process and encoder, and accelerates it.
In one embodiment, all possible prediction modes are checked in order to decide the best prediction mode.
However, the complexity of this approach can be reduced. In block BO, the pixels m,n,o,p,d,h and 1 that shall be used as estimated predictors are relatively far away from their own predictor pixels X,A,B,...,L. Therefore, the mode selection can be simplified by using only major prediction directions to perform a prediction specifically for m,n,o,p,d,h and 1 to make the below-described estimation. In the simplified mode selection, only the DC mode, vertical intra-prediction mode and horizontal intra-prediction mode are used to esti- mate m,n,o,p,d,h and 1. Then, the prediction error ERRORDC , ERRORVer and ERRORhor between these pixels and the estimated pixels is calculated. The ERROR function can be any known error measurement function (SAD, SATD, MSE, etc.) Choose the smallest ERROR from all major directions to estimate the reconstructed predictors, using equation (2).
For the intra-prediction of remaining pixels of a block, the estimated predictors are used to perform intra prediction based on all allowed prediction modes. For example, the nine above-shown intra-prediction modes of AVC can be used. Note that the intra prediction modes, and corresponding mode selection, for estimating the predictors are in principle independent from the intra prediction modes, and correspon- ding mode selection, for the actual intra-prediction of all the pixels. Then, all 4x4 blocks can be predicted
simultaneously, using the estimated predictors.
In the following, the encoding process is described in more detail. The encoding is a process that has two phases.
The first phase of the encoding procedure is shown in Fig.4. In a first step, lower-edge pixels m0,n0,oo,po and right-edge pixels d0,h0,lo,po of each block are predicted from pixels of neighbouring blocks of the original image A-L. Edge pixels of the leftmost or uppermost blocks can be predicted using the same modes as for conventional intra-coding, e.g. DC mode, since these blocks have no left or upper neighbours. At the end of the first phase, as shown in Fig.4 b) , all predictors of all blocks (of at least that portion of the image to which accelerated intra-prediction is applied) are estimated. Thus, each block has estimated predictors in neighbouring blocks in two directions available (left and upper direction in Fig.4), before any block is actually encoded. This is possible because the estimated predictors are predicted from pixels of the original image.
In a second step, which may be considered as part of the first phase or the second phase or as separate intermediate phase, the residuals between the estimated predictors and their original pixels are determined, e.g. m-mp, n-np etc. These residuals are then quantized and inverse quantized, in order to make them more similar to the predictors that will be available at the decoder. This results in reconstructed predictor residuals for all blocks (in the concerned portion of the image) , according to
Q-1(Q(m-mp) ,QP) ,QP) , Q_1 (Q (n-np) , QP) , QP) , etc.
The actual estimated predictors m',n',... for each of these blocks are then calculated according to eq.2.
At the end of the first phase and after the quantization and inverse quantization, all predictors of all blocks (of at least that portion of the image to which accelerated intra- prediction is applied) are estimated. Thus, each block has estimated predictors in two neighbouring blocks, as shown in Fig.4 b) . Accelerated intra-prediction can be applied to one or more portions of an image simultaneously. Other portions may use other, e.g. conventional, intra prediction. For example, conventional intra prediction may be applied in a region-of-interest (ROI), while accelerated intra prediction according to the invention is used in remaining portions of the image The second phase of the encoding process is shown in Fig.5. It comprises prediction and reconstruction of remaining pixels, i.e. other than predictor pixels, based on the predictor pixels that result from the first phase. In step 3, pixels a3, b3, k3 of a block B3 are predicted using intra- prediction, which uses the actual estimated predictor pixels of neighbouring blocks B0, Bl and B2. In detail, the
following estimated predictors are used: p from upper left adjacent (i.e. neighbouring) block B0, lower edge pixels m' i~P'i from upper adjacent block Bl, and right-edge pixels d' 2, h' 2 , 1' 2 p' 2 from left adjacent block B2. In another
embodiment, any combination of upper edge, lower edge, left edge and right edge pixels of adjacent blocks can be used as predictors, depending on the prediction direction. In step 4, shown in Fig.5, the predicted remaining pixels a3, b3, k3 of a block B3 and the original pixels A3,B3,...,K3 of said block are used to determine prediction residuals
¾,resf B3,resi-f 3,res of said block. The prediction residuals are then entropy-encoded, as usual.
Since the estimated predictors are slightly different from the exact predictors that would be used by conventional sequential intra-prediction, the encoded image data
resulting from the two methods are slightly different. In other words, encoder and decoder do not use exactly the same predictors, since an encoder uses the estimated predictors and a decoder uses conventionally reconstructed predictors. However, the different predictors of encoder and decoder are so similar that the difference is not visible in the image. It has been found that the simplified prediction based on estimated predictors, as employed by the invention, is not only faster and less computational expensive, but also in terms of quality yields much better results than could be expected.
Embodiments of the present invention comprise at least the following: In one embodiment, a method for encoding image data, the image data being structured in blocks, comprises for each block in at least a portion of the image the steps of
predicting the pixels of two edges of a block in a first prediction step, wherein the prediction is based on pixels of neighbouring blocks from the original image, and wherein estimated predictor pixels are obtained;
determining residual data for the estimated predictor pixels; performing quantization and inverse quantization on the determined residual data for the estimated predictor pixels, wherein reconstructed residual data for estimated predictor pixels are obtained, according to Q_1 (Q (m-mp) , QP) , QP) ;
reconstructing predictor pixels, wherein the difference between original pixels and reconstructed residual data for estimated predictor pixels is obtained, according to
m' = m - Q'^Qdn-mp) ,QP) ,QP) ;
in a second prediction step, predicting remaining pixels of the block from the predicted predictor pixels of at least neighbouring blocks;
determining residual data for each predicted pixel resulting from the first or second prediction step, the residual data being the difference between the predicted pixel and its corresponding original pixel; and entropy encoding the residual data.
In one embodiment of the method for encoding, the second prediction step is executed in parallel for at least two blocks of the image simultaneously, and the step of
determining residual data is executed in parallel for at least two blocks of the image simultaneously. This is
possible because there are no dependency issues among blocks, since the original pixel values are used.
In one embodiment of the method for encoding, the first prediction step is executed in parallel for at least two blocks of the image simultaneously. This is possible because there are no dependency issues among blocks, since the original pixel values are used in the first prediction step. In one embodiment of the method for encoding, the first prediction step further comprises determining for each of the estimated predictor pixels a best prediction mode from a given group of spatial intra prediction modes. In one embodiment of the method for encoding, the given group of spatial intra prediction modes comprises DC mode, horizontal prediction mode and vertical prediction mode. In one embodiment of the method for encoding, the given group of spatial intra prediction modes consists of only DC mode, horizontal prediction and vertical prediction.
In one embodiment of the method for encoding, the image is structured into at least two portions, wherein the method is executed in parallel for at least two portions of the image simultaneously and independently.
In one embodiment of the method for encoding, the at least one portion of the image is not square, wherein if there is more than one portion, all portions have the same shape and same amount of blocks.
In one embodiment a method for decoding image data, the image data being structured in blocks and having at least two portions, comprises, in all portions of the image
independently and simultaneously, the steps of
reconstructing pixels of the blocks from received pixel data; predicting pixels in the blocks from said reconstructed pixels of the block or from reconstructed pixels of
neighboring blocks; and
reconstructing the predicted pixels based on received
residual data.
In one embodiment, a device for encoding image data, the image data being structured in blocks, comprises
first and second prediction means; first and second residual determining means; quantizer and inverse quantizer;
reconstruction means; and entropy coding means; wherein the apparatus performs for each block in at least a portion of the image the steps of
in the first prediction means, predicting the pixels of two edges of a block in a first prediction step, wherein the prediction is based on pixels of neighbouring blocks from the original image, and wherein estimated predictor pixels are obtained;
in the residual determining means, determining residual data for the estimated predictor pixels;
in the quantizer and inverse quantizer, performing
quantization and inverse quantization on the determined residual data for the estimated predictor pixels, wherein reconstructed residual data for estimated predictor pixels are obtained, according to Q"1 (Q (m-mp) , QP) , QP) , Q"1 (Q (n-np) , ...; in the reconstruction means, reconstructing predictor pixels m' , wherein the difference between original pixels and reconstructed residual data for estimated predictor pixels is obtained, according to m' = m - Q"1 (Q (m-mp) , QP) , QP) , n' =...; in the second prediction means, in a second prediction step, predicting remaining pixels of the block from the predicted predictor pixels of at least neighbouring blocks;
in the second residual determining means, determining residual data for each predicted pixel resulting from the first or second prediction step, the residual data being the difference between the predicted pixel and its corresponding original pixel; and in the entropy coding means, entropy encoding the residual data.
In one embodiment, the encoding device further comprises at least a second set of second prediction means and residual determining means, wherein the second prediction step is executed in parallel in the at least two second prediction means for at least two blocks of the image simultaneously, and the step of determining residual data is executed in parallel in the at least two residual prediction means for at least two blocks of the image simultaneously.
In one embodiment, the encoding device further comprises at least two of the first prediction means, wherein the first prediction step is executed in the at least two first prediction means in parallel for at least two blocks of the image simultaneously. In one embodiment of the encoding device, the first
prediction means comprises a prediction mode selector for determining for each of the estimated predictor pixels a best prediction mode from a given group of spatial intra prediction modes.
In one embodiment of the encoding device, the image is structured into at least two portions, and the device operates in parallel for at least two portions of the image simultaneously and independently.
For most of the above embodiments, the resulting data stream can be decoded conventionally. However, where the image is split into portions, it is also possible to decode each portion independently, and thus in parallel simultaneously. In one embodiment, as shown in Fig.9, a device for decoding image data is concerned: The device for decoding image data, the image data being structured in blocks and having at least two independent portions, comprises decoder data receiving means DDR, decoder pixel reconstruction means DPR, and decoder pixel prediction means DPP. After receiving pixel data, prediction mode data and residual data in the decoder data receiving means DDR, the device performs in all portions of the image independently and simultaneously the following steps: in the decoder pixel reconstruction means DPR, reconstructing pixels based on received pixel data; in the decoder pixel prediction means DPP, predicting pixels in the blocks from said reconstructed pixels of the block or from reconstructed pixels of neighbouring blocks; and further in the decoder pixel reconstruction means DPR, reconstructing the predicted pixels based on reconstructed predictors and received residual data. For parallel decoding two or more sets of decoder pixel reconstruction means DPR and decoder pixel prediction means DPP may be employed in the decoder.
In the above illustrative embodiments, intra 4x4 prediction is used as an example. It is clear that the same mechanism can seamlessly be applied to other intra predictions, e.g. intra 16x16 prediction. Usually, the processing of a block is independent from its relative position in a MB.
In one embodiment of the encoding device or the decoding device, the at least one portion of the image is not square, and if there is more than one portion, all portions have the same shape and same amount of blocks.
Different embodiments described above can be used in
combination. For example, the dividing images into more than one portion and processing the portions simultaneously has the lowest measurable impact on prediction quality. The usage of estimated predictors with limited set of prediction directions yields the highest performance improvement. Thus, it is possible to choose among different combinations of the disclosed features, depending on different requirements and conditions .
Further, the spirit of the idea can be extended to design an efficient loop filter implementation, where the pixel values to be filtered can be predicted using the methods described above. Also any product that uses parallel intra prediction mode decisions may use features described above.
It will be understood that the present invention has been described purely by way of example, and modifications of detail can be made without departing from the scope of the invention. While there has been shown, described, and pointed out fundamental novel features of the present invention as applied to preferred embodiments thereof, it will be under-. stood that various omissions and substitutions and changes in the apparatus and method described, in the form and details of the devices disclosed, and in their operation, may be made by those skilled in the art without departing from the spirit of the present invention. Although the present invention has been disclosed with regard to AVC, one skilled in the art would recognize that the method and devices described herein may be applied to any coding standard that uses intra-prediction . It is expressly intended that all combinations of those elements that perform
substantially the same function in substantially the same way to achieve the same results are within the scope of the invention. Substitutions of elements from one described embodiment to another are also intended and contemplated. Each feature disclosed in the description and (where
appropriate) the claims and drawings may be provided
independently or in any appropriate combination. Features may, where appropriate be implemented in hardware, software, or a combination of the two. Reference numerals appearing in the claims are by way of illustration only and shall have no limiting effect on the scope of the claims.

Claims

Claims
1. A method for encoding image data, the image data being
structured in blocks, the method comprising for each block in at least a portion of the image the steps of
predicting the pixels of two edges of a block in a first prediction step, wherein the prediction is based on pixels of neighbouring blocks from the original image (X,A-L), and wherein estimated predictor pixels (dp, hp, lp,mp, np, Op, pp) are obtained;
determining residual data (m-mp) for the estimated predictor pixels;
performing quantization (Q) and inverse quantization (Q_1) on the determined residual data for the estimated predictor pixels, wherein reconstructed residual data for estimated predictor pixels are obtained, according to Q_1(Q (m-mp) ,QP) ,QP) ;
reconstructing predictor pixels (m' ) , wherein the difference between original pixels and reconstructed residual data for estimated predictor pixels is
obtained, according to m' = m - Q-1 (Q (m-mp) , QP) , QP) ;
in a second prediction step, predicting remaining pixels (a3, b3, k3) of the block from the predicted predictor pixels (p'0, d' 2, h' 2, 1' 2, p' 21 m' 1, p' 1) of at least neighbouring blocks;
determining residual data for each predicted pixel resulting from the first or second prediction step, the residual data being the difference between the
predicted pixel and its corresponding original pixel; and
entropy encoding the residual data.
2. Method according to claim 1, wherein the second prediction step is executed in parallel for at least two blocks of the image simultaneously, and the step of determining residual data is executed in parallel for at least two blocks of the image simultaneously.
3. Method according to claim 1 or 2, wherein the first
prediction step is executed in parallel for at least two blocks of the image simultaneously.
4. Method according to any of claims 1-3, wherein the first prediction step further comprises determining for each of the estimated predictor pixels (dp, hp, lp,mp, np, op, pp) a best prediction mode from a given group of spatial intra
prediction modes.
5. Method according to claim 4, wherein the given group of
spatial intra prediction modes comprises DC mode,
horizontal prediction and vertical prediction.
6. Method according to claim 4 or 5, wherein the given group of spatial intra prediction modes consists of DC mode, horizontal prediction and vertical prediction only.
7. Method according to one of the claims 1-6, wherein the
image is structured into at least two portions, and
wherein the method is executed in parallel for at least two portions of the image simultaneously and independently.
8. Method according to any of the claims 1-7, wherein the at least one portion of the image is not square, and wherein if there is more than one portion, all portions have the same shape and same amount of blocks.
9. Method for decoding image data, the image data being
structured in blocks and having at least two portions, the method comprising, in all portions of the image independently and simultaneously, the steps of
reconstructing pixels of the blocks from received pixel data;
- predicting pixels in the blocks from said reconstructed pixels of the block or from reconstructed pixels of neighboring blocks; and
reconstructing the predicted pixels based on received residual data.
10. A device for encoding image data, the image data being structured in blocks, the device comprising
first and second prediction means (Pi,P2) ;
first and second residual determining means (RDi,RD2); - quantizer (Q) and inverse quantizer (Q_1) ;
reconstruction means (RE) ; and
entropy coding means (EC) ;
wherein the apparatus performs for each block in at least a portion of the image the steps of
- in the first prediction means, predicting the pixels of two edges of a block in a first prediction step, wherein the prediction is based on pixels of
neighbouring blocks from the original image (X,A-L), and wherein estimated predictor pixels (dp, hp, lp, mp, np, Op,pp) are obtained;
in the first residual determining means (RDi) ,
determining residual data (m-mp) for the estimated predictor pixels;
in the quantizer (Q) and inverse quantizer (Q_1) , performing quantization and inverse quantization on the determined residual data for the estimated predictor pixels, wherein reconstructed residual data for estimated predictor pixels are obtained, according to Q-^Qim-mp) ,QP) ,QP) ;
in the reconstruction means (RE) , reconstructing predictor pixels (m' ) , wherein the difference between original pixels and reconstructed residual data for estimated predictor pixels is obtained, according to m' = m - Q_1(Q(m-mp) ,QP) ,QP) ;
in the second prediction means (P2), in a second prediction step, predicting remaining pixels (a3,b3,..., k3) of the block from the predicted predictor pixels (p' o, d' 2, h' 2, 1' 2i p' 2, m' p' I) of at least neighbouring blocks ;
in the second residual determining means (RD2) ,
determining residual data for each predicted pixel resulting from the first or second prediction step, the residual data being the difference between the
predicted pixel and its corresponding original pixel; and
in the entropy coding means (EC) , entropy encoding the residual data.
11. Device according to claim 10, further comprising at
least a second set of second prediction means (P2,P2')and second residual determining means (RD2,RD2'), wherein the second prediction step is executed in parallel in the at least two second prediction means for at least two blocks of the image simultaneously, and the step of determining residual data is executed in parallel in the at least two residual prediction means for at least two blocks of the image simultaneously.
12. Device according to claim 10 or 11, further comprising at least two of the first prediction means (Pi, Pi'), wherein the first prediction step is executed in the at least two first prediction means in parallel for at least , two blocks of the image simultaneously.
13. Device according to any of claims 10-12, wherein the first prediction means comprises a prediction mode selector (PS, PS') for determining for each of the
estimated predictor pixels (dp, hp, lp, mp, np, op, pp) a best prediction mode from a given group of spatial intra prediction modes.
14. Device according to one of the claims 10-12, wherein the image is structured into at least two portions, and wherein the device operates in parallel for at least two portions of the image simultaneously and independently.
15. Device according to any of the claims 10-14, wherein the at least one portion of the image is not square, and wherein if there is more than one portion, all portions have the same shape and same amount of blocks.
PCT/CN2010/000901 2010-06-21 2010-06-21 Method and apparatus for encoding/decoding image data WO2011160251A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP10853395.1A EP2583457A4 (en) 2010-06-21 2010-06-21 Method and apparatus for encoding/decoding image data
CN2010800676207A CN103141091A (en) 2010-06-21 2010-06-21 Method and apparatus for encoding/decoding image data
US13/805,195 US9036932B2 (en) 2010-06-21 2010-06-21 Method and apparatus for encoding/decoding image data
PCT/CN2010/000901 WO2011160251A1 (en) 2010-06-21 2010-06-21 Method and apparatus for encoding/decoding image data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2010/000901 WO2011160251A1 (en) 2010-06-21 2010-06-21 Method and apparatus for encoding/decoding image data

Publications (1)

Publication Number Publication Date
WO2011160251A1 true WO2011160251A1 (en) 2011-12-29

Family

ID=45370801

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/000901 WO2011160251A1 (en) 2010-06-21 2010-06-21 Method and apparatus for encoding/decoding image data

Country Status (4)

Country Link
US (1) US9036932B2 (en)
EP (1) EP2583457A4 (en)
CN (1) CN103141091A (en)
WO (1) WO2011160251A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103248885A (en) * 2012-02-14 2013-08-14 乐金电子(中国)研究开发中心有限公司 Intra frame image prediction coding and decoding methods, video coder and video decoder
WO2013172984A1 (en) * 2012-05-14 2013-11-21 Qualcomm Incorporated Systems and methods for intra prediction video coding

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2583457A4 (en) * 2010-06-21 2015-07-29 Thomson Licensing Method and apparatus for encoding/decoding image data
WO2013006386A1 (en) * 2011-07-01 2013-01-10 General Instrument Corporation Motion vector prediction design simplification
CN104041041B (en) 2011-11-04 2017-09-01 谷歌技术控股有限责任公司 Motion vector scaling for the vectorial grid of nonuniform motion
JP2013150215A (en) * 2012-01-20 2013-08-01 Fujitsu Ltd Moving image decoding device, moving image encoding device, moving image decoding method, moving image encoding method, moving image decoding program, and moving image encoding program
KR101885885B1 (en) * 2012-04-10 2018-09-11 한국전자통신연구원 Parallel intra prediction method for video data
US11317101B2 (en) 2012-06-12 2022-04-26 Google Inc. Inter frame candidate selection for a video encoder
US9485515B2 (en) 2013-08-23 2016-11-01 Google Inc. Video coding using reference motion vectors
US9503746B2 (en) 2012-10-08 2016-11-22 Google Inc. Determine reference motion vectors
US11109036B2 (en) 2013-10-14 2021-08-31 Microsoft Technology Licensing, Llc Encoder-side options for intra block copy prediction mode for video and image coding
MX2016004705A (en) 2013-10-14 2016-07-18 Microsoft Technology Licensing Llc Features of intra block copy prediction mode for video and image coding and decoding.
WO2015100726A1 (en) 2014-01-03 2015-07-09 Microsoft Corporation Block vector prediction in video and image coding/decoding
US10390034B2 (en) * 2014-01-03 2019-08-20 Microsoft Technology Licensing, Llc Innovations in block vector prediction and estimation of reconstructed sample values within an overlap area
US11284103B2 (en) 2014-01-17 2022-03-22 Microsoft Technology Licensing, Llc Intra block copy prediction with asymmetric partitions and encoder-side search patterns, search ranges and approaches to partitioning
JP2017512026A (en) 2014-03-04 2017-04-27 マイクロソフト テクノロジー ライセンシング,エルエルシー Block inversion and skip mode in intra block copy prediction
CN105493505B (en) 2014-06-19 2019-08-06 微软技术许可有限责任公司 Unified intra block duplication and inter-frame forecast mode
EP3202150B1 (en) 2014-09-30 2021-07-21 Microsoft Technology Licensing, LLC Rules for intra-picture prediction modes when wavefront parallel processing is enabled
US10200716B2 (en) * 2015-06-25 2019-02-05 Sony Interactive Entertainment Inc. Parallel intra-prediction encoding/decoding process utilizing PIPCM and/or PIDC for selected sections
CN107277508B (en) * 2017-07-25 2020-04-24 哈尔滨工业大学 Pixel-level bidirectional intra-frame prediction method adopting self-adaptive mode selection
US10986349B2 (en) 2017-12-29 2021-04-20 Microsoft Technology Licensing, Llc Constraints on locations of reference blocks for intra block copy prediction
WO2020263472A1 (en) * 2019-06-24 2020-12-30 Alibaba Group Holding Limited Method and apparatus for motion vector refinement

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1127855C (en) * 1995-12-06 2003-11-12 汤姆森多媒体公司 Method for encording digital videosignal and apparatus thereof
US20080219576A1 (en) * 2007-03-07 2008-09-11 Samsung Electronics Co., Ltd. Method and apparatus for encoding/decoding image
CN101383972A (en) * 2008-09-28 2009-03-11 北京航空航天大学 Remote sensed image compression method based on space prediction and transformation
EP2081386A1 (en) * 2008-01-18 2009-07-22 Panasonic Corporation High precision edge prediction for intracoding

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100481732B1 (en) * 2002-04-20 2005-04-11 전자부품연구원 Apparatus for encoding of multi view moving picture
US7145948B2 (en) * 2002-05-29 2006-12-05 Koninklijke Philips Electronics N.V. Entropy constrained scalar quantizer for a Laplace-Markov source
JP2007150913A (en) * 2005-11-29 2007-06-14 Matsushita Electric Ind Co Ltd Image encoding device
JP2008252176A (en) * 2007-03-29 2008-10-16 Toshiba Corp Motion picture encoder and encoding method
US20090274213A1 (en) * 2008-04-30 2009-11-05 Omnivision Technologies, Inc. Apparatus and method for computationally efficient intra prediction in a video coder
JP5401071B2 (en) * 2008-10-09 2014-01-29 株式会社Nttドコモ Moving picture encoding apparatus, moving picture decoding apparatus, moving picture encoding method, moving picture decoding method, moving picture encoding program, moving picture decoding program, moving picture processing system, and moving picture processing method
KR20110071231A (en) * 2009-12-21 2011-06-29 엠텍비젼 주식회사 Encoding method, decoding method and apparatus thereof
US9100661B2 (en) * 2010-04-05 2015-08-04 Samsung Electronics Co., Ltd. Method and apparatus for encoding video by using dynamic-range transformation, and method and apparatus for decoding video by using dynamic-range transformation
US8503534B2 (en) * 2010-04-22 2013-08-06 Maxim Integrated Products, Inc. Multi-bus architecture for a video codec
EP2583457A4 (en) * 2010-06-21 2015-07-29 Thomson Licensing Method and apparatus for encoding/decoding image data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1127855C (en) * 1995-12-06 2003-11-12 汤姆森多媒体公司 Method for encording digital videosignal and apparatus thereof
US20080219576A1 (en) * 2007-03-07 2008-09-11 Samsung Electronics Co., Ltd. Method and apparatus for encoding/decoding image
EP2081386A1 (en) * 2008-01-18 2009-07-22 Panasonic Corporation High precision edge prediction for intracoding
CN101383972A (en) * 2008-09-28 2009-03-11 北京航空航天大学 Remote sensed image compression method based on space prediction and transformation

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2583457A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103248885A (en) * 2012-02-14 2013-08-14 乐金电子(中国)研究开发中心有限公司 Intra frame image prediction coding and decoding methods, video coder and video decoder
CN103248885B (en) * 2012-02-14 2018-01-26 乐金电子(中国)研究开发中心有限公司 Intra-frame image prediction decoding method and Video Codec
WO2013172984A1 (en) * 2012-05-14 2013-11-21 Qualcomm Incorporated Systems and methods for intra prediction video coding

Also Published As

Publication number Publication date
CN103141091A (en) 2013-06-05
EP2583457A4 (en) 2015-07-29
US20130089266A1 (en) 2013-04-11
US9036932B2 (en) 2015-05-19
EP2583457A1 (en) 2013-04-24

Similar Documents

Publication Publication Date Title
US9036932B2 (en) Method and apparatus for encoding/decoding image data
JP6724198B2 (en) Video decoding method
JP6518274B2 (en) Video decoding method and video coding method
US11197022B2 (en) Method for encoding and/or decoding images on macroblock level using intra-prediction
JP2023052531A (en) Video image coding and decoding method and device
KR101517768B1 (en) Method and apparatus for encoding video and method and apparatus for decoding video
KR101947658B1 (en) Method and apparatus for decoding image
KR101292091B1 (en) Method for encoding/decoding with adaptive intra prediction
KR101611409B1 (en) Method for encoding/decoding an intra prediction mode and apparatus for the same
KR102264446B1 (en) Method of encoding intra mode by choosing most probable mode with high hit rate and apparatus for the same, and method of decoding and apparatus for the same
RU2537803C2 (en) Method and apparatus for encoding and decoding images
CN103548356B (en) Picture decoding method using dancing mode and the device using this method
WO2008117931A1 (en) Image encoding/decoding method and apparatus
WO2011088594A1 (en) Video encoder, video decoder, method for video encoding and method for video decoding, separately for each colour plane
KR101924089B1 (en) Apparatus and method for video encoding and decoding using adaptive prediction block filtering
WO2008056931A1 (en) Method and apparatus for encoding and decoding based on intra prediction
KR101885885B1 (en) Parallel intra prediction method for video data
KR102419589B1 (en) Method and apparatus for deciding boundary filtering strength of deblocking filtering
KR101902933B1 (en) Apparatus for image coding/decoding and the method thereof
JP6409400B2 (en) Video encoding apparatus, method and program
WO2012167419A2 (en) Method for encoding and/or decoding images on macroblock level using intra-prediction
Do et al. An early block type decision method for intra prediction in H. 264/AVC
KR20130107611A (en) Methods of encoding and decoding using bottom-up prediction mode decision and apparatuses for using the same

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080067620.7

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10853395

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2010853395

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2010853395

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 13805195

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE