EP2036351A1 - Image encoding/decoding method and apparatus - Google Patents
Image encoding/decoding method and apparatusInfo
- Publication number
- EP2036351A1 EP2036351A1 EP07807930A EP07807930A EP2036351A1 EP 2036351 A1 EP2036351 A1 EP 2036351A1 EP 07807930 A EP07807930 A EP 07807930A EP 07807930 A EP07807930 A EP 07807930A EP 2036351 A1 EP2036351 A1 EP 2036351A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- color component
- residue
- block
- component image
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000012417 linear regression Methods 0.000 claims description 5
- 241001362574 Decodes Species 0.000 claims description 2
- 230000009466 transformation Effects 0.000 description 20
- 238000013139 quantization Methods 0.000 description 14
- 230000000875 corresponding effect Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 230000002596 correlated effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 102220047090 rs6152 Human genes 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/37—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability with arrangements for assigning different transmission priorities to video input data or to video coded data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
Definitions
- Methods and apparatuses consistent with t he present invention relate to image encoding and decoding, and more particularly, to an image encoding/decoding method and apparatus, in which using correlation between residues of a plurality of color component images, a residue of one of the color component images is predicted from a residue of another color component image, thereby improving encoding efficiency.
- Background Art
- the captured original image is in a red, green, and blue (RGB) color format.
- RGB red, green, and blue
- the RGB color format image is transformed into a YUV (or YCbCr) color format.
- Y is a black- white image and has a luminance component and U (or Cb) and V (or Cr) have color components.
- Information is uniformly distributed over R, G, and B components in an RGB image, but information is concentrated in a Y component and the amount of information in U (or Cb) and V (or Cr) components is small in a YUV (or YCbCr) image.
- the YUV (or YCbCr) image can be compressed with high compression efficiency.
- a YUV (or YCbCr) 4:2:0 image obtained by sampling color components U (or Cb) and V (or Cr) of an YUV (or YCbCr) image at a ratio of 1:4 is generally used.
- YCbCr 4:2:0 image causes color distortion, it is not suitable for providing high display quality.
- a method for effectively encoding a YUV (or YCbCr) 4:4:4 image without sampling U (or Cb) and V (or Cr) is required.
- residual color transform (RCT) which directly encodes an RGB 4:4:4 image to remove color distortion occurring in transformation of an RGB image to a YUV (or YCbCr) image, or inter-plane prediction (IPP) has been suggested.
- the present invention provides an image encoding/decoding method and apparatus, in which a residue of one of a plurality of color component images constituting a color image is predicted from another color component image using a correlation between the residues of the color component images, without transforming a n RGB color format to another color format, thereby improving encoding efficiency.
- predictive encoding is performed using correlation between a plurality of color component images constituting a single image, thereby improving encoding efficiency.
- encoding is performed on an RGB input image in an RGB domain without transformation into a YUV domain, thereby preventing color distortion during transformation of the RGB image into another color format, and thus improving display quality.
- FIGS. IA through 1C respectively illustrate a red (R) color component image, a green (G) color component image, and a blue (B) color component image of a single color image;
- FIG. 2A is a graph showing correlation between the G color component image of
- FIG. IB and the B color component image of FIG. 1C according to an exemplary embodiment of the present invention ;
- FIG. 2B is a graph showing correlation between the R color component image of
- FIG. IA and the G color component image of FIG. IB according to an exemplary embodiment of the present invention ;
- FIG. 3 is a block diagram of an image encoding apparatus according to an exemplary embodiment of the present invention.
- FIG. 4 is a block diagram of a residue generating unit 320 in FIG. 3 according to an exemplary embodiment of the present invention ;
- FIG. 5 is a flowchart illustrating an image encoding method according to an exemplary embodiment of the present invention
- FIG. 6A illustrates a 16x16 first residue block of a G color component image according to an exemplary embodiment of the present invention
- FIG. 6B illustrates a 16x16 first residue block of a B color component image according to an exemplary embodiment of the present invention
- FIG. 6C illustrates a 16x16 first residue block of a n R color component image according to an exemplary embodiment of the present invention
- FIG. 7 A illustrates the processing order of 8x8 residue blocks in an image encoding method and method according to an exemplary embodiment of the present invention
- FIG. 7B illustrates the processing order of 4x4 residue blocks in an image encoding method and apparatus according an exemplary embodiment of to the present invention
- FIG. 8 is a block diagram of an image decoding apparatus according to another exemplary embodiment of the present invention.
- FIG. 9 is a flowchart illustrating an image decoding method according to another exemplary embodiment of the present invention. Best Mode
- an image encoding method comprising: generating a first residue block of each of a plurality of color component images of an input image, the first residue block corresponding to a difference between an input pixel block and a prediction pixel block of the each of the color component images; encoding the first residue block of a first color component image among the color component images; reconstructing the encoded first residue block of the first color component image; generating a second residue block of each of at least one of remaining color component images which does not comprise the first color component image by predicting a residue of the each of the at least one of the remaining color component image s using the reconstructed first residue block of the first color component image; and generating a third residue block of the each of the at least one of the remaining color component images by calculating a difference between the first and second residue blocks of the each of the at least one of the remaining color component images .
- an image encoding apparatus comprising: a prediction pixel block generating unit which generat es a prediction pixel block of an input pixel block of each of a plurality of color component images constituting an input image; a residue generating unit which generat es a first residue block of each of the color component images that correspond s to a difference between the input pixel block and the prediction pixel block of the each of the color component images, a second residue block of each of at least one of remaining color component images which does not comprise a first color component image among the color component images by predicting a residue of the each of the at least one of the remaining color component image s using a reconstructed first residue block of the first color component image , and a third residue block of the each of the at least one of the remaining color component images, that corresponds to a difference between the first and second residue blocks of the each of the at least one of the remaining color component image s ; and an encoding unit which encod
- an image decoding method comprising: receiving a bitstream comprising a first residue block of each of a plurality of color component images of an input image , the first residue block corresponding to a difference between an input pixel block and a prediction pixel block of the each of the color component image s , and a third residue block of each of at least one of remaining color component images which does not comprise a first color component image among the color component images, the third residue block corresponding to a difference between a second residue block of the each of the at least one of the remaining color component image s predicted using the first residue block of the first color component image , and the first residue block of the each of the at least one of the remaining color component image s ; decoding the first residue block of the first color component image and the third residue block of the each of the at least one of the remaining color component image s ; generating the second residue block of the each of the at least one of the remaining color component image s by predicting a residue of the each
- an image decoding apparatus comprising: a decoding unit which receiv es comprising a first residue block of each of a plurality of color component images of an input image , the first residue block corresponding to a difference between an input pixel block and a prediction pixel block of the each of the color component image s; and a third residue block of each of at least one of remaining color component images which does not comprise a first color component image among the color component images, the third residue block corresponding to a difference between a second residue block of the each of the at least one of the remaining color component image s predicted using the first residue block of the first color component image , and the first residue block of the each of the at least one of the remaining color component image s , and decod es the first residue block of the first color component image and the third residue block of the each of the at least one of the remaining color component image s ; a residue generating unit which generat es the second residue block of the each of
- a residue is defined as a difference between an original input image and a predicted image.
- a color image comprises a n R color component image, a G color component image, and a G color component image
- residues of the color component images, ⁇ R, ⁇ G, and ⁇ B are defined as follows;
- R, G and B represent original input images of the color components, and R , G and B represent predicted images of the color components.
- a first residue block is defined as a block of which pixels are comprised of differences between the original input block and the predicted block. Actually, the first residue block is identical with the residue block in a related art.
- a second residue block is defined as a block of which pixels are predicted from reconstructed first residue blocks of a first color component image according to an exemplary embodiment of the present invention.
- a third residue block is defined as a block of which pixels are comprised of differences between the first residue block and the second residue block.
- FIGS. IA through 1C respectively illustrate an R color component image, a G color component image, and a B color component image of a single color image
- FIG. 2A is a graph showing correlation between the G color component image of FIG. IB and the B color component image of FIG. 1C
- FIG. 2B is a graph showing correlation between the R color component image of FIG. IA and the G color component image of FIG. IB.
- the present invention provides an image encoding/decoding method and apparatus in which a residue of a first color component image among a plurality of color component images is used to predict a residue of a remaining color component image, and instead of encoding the residue of the remaining color component image as in a related art, only a difference between a predicted residue of the remaining color component image and an original residue of the remaining color component image is encoded.
- 4:4:4 domain according to exemplary embodiments of the present invention will be described.
- the following description is focused on the encoding of a single macroblock in a current frame.
- encoding is performed in the order of a G color component image, a B color component image, and a n R color component image, but not limited to this order.
- FIG. 3 is a block diagram of an image encoding apparatus according to an exemplary embodiment of the present invention.
- the image encoding apparatus is assumed to comply with the H.264 standard for the convenience of explanation, it may also be applied to other image encoding apparatuses for performing residue coding.
- an image encoding apparatus 300 includes a prediction pixel block generating unit 310, a residue generating unit 320, a transformation/quantization unit 330, an entropy- coding unit 340, an inverse quantization/inverse transformation unit 350, and a recon- structing unit 360.
- the prediction pixel block generating unit 310 performs intra or inter prediction on each color component image of an input image in units of an input pixel block having a predetermined size.
- prediction according to, for example, the H.264 standard, or other modified intra or inter prediction methods can be used for the intra or inter prediction.
- the residue generating unit 320 generates first residue blocks of color component images by calculating a difference between an input pixel block and a prediction pixel block of each color component image generated in the prediction pixel block generating unit 310 .
- the residue generating unit 320 also generates a second residue block by predicting a residue of a remaining color component image using a reconstructed first residue block of a first color component image .
- t he residue generating unit 320 generates a third residue block that is a difference between the first and second residue blocks of the remaining color component block.
- FIG. 4 is a detailed block diagram of the residue generating unit 320 in FIG. 3.
- the residue generating unit 320 comprises a first residue block generating portion 321, a second residue block generating portion 322, and a third residue block generating portion 323.
- the first residue block generating portion 321 generates first residue blocks of the color component images by calculating a difference between an input pixel block and a prediction pixel block of each color component image generated in the prediction pixel block generating unit 310.
- the first residue generating unit 320 generates a first residue block of a G color component image, a first residue block of a B color component image, and a first residue block of a n R color component image by calculating a difference between an input pixel block and a prediction pixel block of each of the R, G, and B color component images.
- the second residue block generating portion 322 generates a second residue block of a remaining color component image using a reconstructed first residue block of a first color component image.
- the second residue block generating portion 322 generates a second residue block of the remaining color component image by predicting a residue of the remaining color component image using a residue value, which is used as a parameter, of the reconstructed first residue block of the first color component image and a predictor generated by a linear modeling process.
- the second residue block generating portion 322 generates a second residue block of each of the B and R color component images by predicting residue blocks of the B and R color component images using a reconstructed first residue block of the G color component image that has been transformed and quantized by the transformation/quantization unit 330 , and inversely quantized and inversely transformed by the inverse quantization/inverse transformation unit 350.
- the linear modeling process for predicting residue blocks of the remaining color components image using the first residue block of the first color component image will be described later.
- the third residue block generating portion 323 generates a third residue block by calculating a difference between the first and second residue blocks of the remaining color component image.
- the first residue block of the first color component image among the residue blocks of the color component images is transformed, quantized, and entropy-coded.
- the third residue block that is a difference between the first and second residue blocks of the remaining color component image, not the first residue block are encoded.
- the third residue block of the remaining color component image is smaller than the first residue block, which corresponds to the original residue block, so that a smaller amount of bits can be allocated to the residue block of the remaining color component image, thereby improving the encoding efficiency.
- the transformation/quantization unit 330 transforms and quantizes the first residue block of the first color component image and the third residue block of the remaining color component image, which is generated in the residue generating unit 320.
- the entropy-coding unit 340 entropy-codes the transformed and quantized residue blocks and outputs a bitstream.
- Orthogonal transform coding can be used for the transformation. Commonly used orthogonal transform coding methods include fast Fourier transform (FFT), discrete cosine transform (DCT), Karhunen-Loeve Transform (KLT), Hadamard transform, slant transform, etc.
- the inverse quantization/inverse transformation unit 350 inversely quantizes and inversely transforms the first residue block of the first color component image, which has been transformed and quantized by the transformation/quantization unit 330, and outputs the inverse-quantized and inverse-transformed first residue block to the residue generating unit 320 to allow generation of the second residue block, which is a prediction residue block of the remaining color component image.
- the reconstructing unit 360 reconstructs a pixel block of each of the color component images by adding the prediction pixel block of each of the color component images, which are generated by the prediction pixel block generating unit 310, and the first residue block of each of the color component images.
- the first residue block of the remaining color component image can be the first residue block of the remaining color component image generated in the residue generating unit 320 , or the result of adding the second residue block of the remaining color component image generated in the residue generating unit 320 and the third residue block of the remaining color component image reconstructed in the inverse quantization/inverse transformation unit 350.
- the pixel block of each of the color component images reconstructed in the reconstructing unit 360 is input to the prediction pixel block generating unit 310 for prediction coding of another pixel block.
- FIG. 5 is a flowchart of an image encoding method according to an exemplary embodiment of the present invention.
- the operation of the image encoding apparatus and the image encoding method according to exemplary embodiments of the present invention will be described with reference to FIGS. 3 through 5.
- the first residue block generating portion 321 generates a first residue block of each color component image by calculating a difference between an input pixel block having a predetermined size of each color component image forming an input color image , and a prediction pixel block of each color component image generated in the prediction pixel block generating unit 310.
- a first residue block of a first color component image is encoded by transformation, quantization, and then entropy-coding.
- the transformed and quantized first residue block of the first color component image is reconstructed by inverse quantization and inverse transformation.
- the second residue block generating portion 322 generates a second residue block of the remaining color component image using the reconstructed first residue block of the first color component image.
- an input image include s R, G, and B color component images, and the G, B, and R color component images are sequentially coded
- a process of predicting second residue blocks of the B and R color component images using the reconstructed first residue block of the G color component image will be described in detail.
- FIG. 6A illustrates a 16 x 16 first residue block of a G color component image
- FIG. 6B illustrates a 16 x 16 first residue block of a B color component image
- FIG. 6C illustrates a 16 x 16 first residue block of a n R color component image
- g , b , th th 1J 1J and r indicate first residue values in an i row and a j column of a 16 x 16 pixel block of the respective G, B, and R color component images.
- hatched residues indicate reconstructed residues of a neighbor residue block processed prior to the current residue block.
- g ' denotes a residue value in an i row and a j column of the re- constructed first residue block of the G color component image
- a denotes a predetermined weight
- b denotes a predetermined offset value.
- the second residue block generating portion 322 models correlation between the reconstructed first res idue block of the G color component image and the first residue block of the B color component image as a first-order function expressed by Equation 2 below.
- the second residue block generating portion 322 generates prediction residue values
- a residue block of the B color component image having the prediction residue values obtained using Equation (2) is defined as the second residue block of the B color component image.
- the prediction residue values of the B color component image obtained using Equation (2) i.e., the residue values of the second residue block, are clipped to integers between -255 and 255.
- a and b in Equation (2) may change according to the position (i, j) of a pixel, and are assumed to be constant within a predetermined block in an exemplary embodiment of the present invention.
- Equation (2) may be determined as functions of the residue values of a reconstructed neighbor residue block of the G color component image and the residue values of a reconstructed neighbor residue block of the B color component image, as in Equations (3) and (4).
- Equation (2) can be defined in various manners.
- a and b satisfying Equation (2) may be determined by applying a linear regression model, which is widely used in the field of statistics, to pairs of residues of a reconstructed neighbor residue block of the G color component image and a corresponding reconstructed neighbor residue block of the B color component image.
- a and b satisfying Equation (2) may be determined to be values that minimize differences between prediction residue values of a neighbor pixel block of the B color component image, which is obtained by substituting the residue values of the reconstructed neighbor residue block of the G color component image into Equation (2), and residue values of a reconstructed neighbor residue block of the B color component image.
- a may be determined as 1
- b may be determined as the average of differences between residue values of a reconstructed neighbor pixel block of the B color component image and residue values of a reconstructed neighbor pixel block of the G color component image using Equation (5) below:
- residue values of a reconstructed neighbor residue block adjacent to the current residue block are used to determine a and b satisfying Equation (2).
- the residue values of a neighbor residue block used to determine a and b satisfying Equation (2) may include residue values of at least one neighbor residue block including a residue block adjacent to an upper or left side of the current residue block.
- FIG. 7A illustrates the processing order of 8x8 pixel blocks in an image encoding method and apparatus according to an exemplary embodiment of the present invention
- FIG. 7B illustrates the processing order of 4x4 pixel blocks in an image encoding method and apparatus according to an exemplary embodiment of the present invention
- the second residue block generating portion 322 can generate second residue blocks of the remaining color component image by dividing a 16x16 residue block into 8x8 residue blocks or 4x4 residue blocks.
- 8x8 residue blocks of the B color component image are sequentially predicted left-to-right and top-to-bottom.
- residue values of each 8x8 first residue block of the B color component image can be predicted using Equation 2 in a similar manner to the above-described process of predicting the residue value of the 16x16 first residue block of the B color component image.
- a may be determined as 1, and b may be determined as the average of differences between residue values of a reconstructed neighbor residue block of the B color component image , and residue values of a reconstructed neighbor residue block of the G color component image as follows: [71] [Math.6]
- each 4x4 residue block of the B color component image is sequentially predicted left-to-right and top-to-bottom.
- Residue values of each 4x4 residue block of the B color component image can be predicted using Equation 2 in a similar manner to the above-described process of generating a second residue block by predicting a 16x16 first residue block or 8x8 first residue block of the B color component image.
- Equation 2 a of Equation 2 may be determined as 1, and b of Equation 2 may be determined as the average of differences between residue values of a reconstructed neighbor residue block of the B color component image , and residue values of a reconstructed neighbor pixel block of the G color component image as in Equation (10) below:
- Equation (2) (10) [74] As described above, once a and b of Equation (2) are determined in various manners as described above, a second residue block of the B color component image can be generated by substituting the residue values of the reconstructed first residue block of the G color component image into Equation (2).
- the second residue block of the B color component image may be generated in units of 16x16 blocks, 8x8 blocks, or 4x4 blocks.
- prediction for each macroblock may be performed in units of a block in one of the three block modes.
- residue values of the second residue block of the R color component image may be predicted using residue values of the first residue block of the G color component image in a similar manner to the above-described process of generating the second residue block of the B color component image.
- the third residue block generating portion 323 generates a third residue block of each of the remaining color component images by calculating a difference between the first and second residue blocks of the corresponding color component im age in operation 550.
- the third residue block generating portion 323 generates a third residue block of the B color component image by subtracting the second residue block of the B color component image from the first residue block of the B color component image , and generates a third residue block of the R color component image by subtracting the second residue block of the R color component image from the first residue block of the R color component image.
- the third residue block of each of the remaining color component images is transformed, quantized, and entropy-encoded and is output as a bitstream.
- the second residue block generating portion 322 may generate the second residue block of the R color component image using the reconstructed first residue block of the previously processed B color component image, instead of using the reconstructed first residue block of the G color component image.
- the second residue block of the R color component image can be generated using the reconstructed first residue block of the B color component image in a similar manner to the above-described process of generating the second residue block of the B color component image.
- the second residue block generating portion 322 predicts corresponding residue values of the R color component image by substituting the reconstructed residue values of the B color component image into Equation (11) below: [81] [Math.8]
- Equation (11) may be determined in a similar manner as used to determine a and b.
- the third residue block generating portion 323 generates a third residue block by calculating a difference between the first and second residue blocks of the R color component image.
- a bitstream of a color image encoded using the above-described image encoding method includes encoded first residue block information of a first color component image and third residue block information of the remaining color component image.
- the encoded bitstream may include predictor information, for example, a and b of Equation (2) or c and d of Equation (11), which are used to generate the second residue block.
- predictor information for example, a and b of Equation (2) or c and d of Equation (11)
- a and b of Equation (2) or c and d of Equation (11) are generated using reconstructed neighbor pixel block information in a decoding unit in the same manner as used in an encoding unit, there is no need to insert a and b or c and d into the bitstream.
- the pixel block of the first color component image can be reconstructed by decoding the first residue block of the first color component image , and adding the decoded first residue block and a prediction pixel block of the first color component image.
- the decoded first residue blocks of the remaining color component image is added to a prediction pixel block of the remaining color component image, thereby reconstructing a pixel block of the remaining color component image.
- FIG. 8 is a block diagram of an image decoding apparatus according to an exemplary embodiment of the present invention.
- an image decoding apparatus 800 includes an entropy-decoding unit 810, an inverse quantization/inverse transformation unit 820, a residue generating unit 830, a prediction pixel block generating unit 840, and a reconstructing unit 850.
- the entropy-decoding unit 810 receives a bitstream and performs entropy-decoding on the bitstream.
- the inverse quantization/inverse transformation unit 820 performs inverse quantization and inverse transformation in order to extract residue information, motion vector information, and prediction mode information for each color component image.
- the residue information included in the bitstream of a color image encoded according to an exemplary embodiment of the present invention may include encoded first residue block information of the first color component image and third residue block information of other color component images.
- the prediction mode information may include a predetermined syntax indicating whether the bitstream has been encoded according to an exemplary embodiment of the present invention, and predictor information used to generate a second residue block for the prediction of the second residue blocks of the remaining color component images.
- the prediction mode information may include the constants of Equations (2) and (11) described above.
- the prediction pixel block generating unit 840 generates a prediction pixel block of a pixel block having a predetermined size of each color component image using the prediction mode information included in the bitstream. In other words, the prediction pixel block generating unit 840 performs inter prediction or intra prediction according to a prediction mode of the current pixel block to generate a prediction pixel block of the current pixel block.
- the residue generating unit 830 generates a second residue block of the remaining color component image by predicting a residue of the remaining color component image using the decoded first residue block of the first color component image output from the inverse quantization/inverse transformation unit 820.
- the process of generating the second residue block of the remaining color component image is the same as the process of generating the second residue blocks in the second residue block generating portion 322 of FIG. 4, and thus a detailed description thereof will not be repeated here.
- the residue generating unit 830 decodes a first residue block of the remaining color component image by adding the second residue block and the decoded third residue block of the remaining color component image.
- the residue generating unit 830 If a third residue block of a third color component image is predicted using the reconstructed first residue block of a second color component image, the residue generating unit 830 generates the second residue block of the third color component image by substituting the residue value of the reconstructed second residue block of the second color component into Equation (11) and decodes the first residue block of the third color component image by adding the generated second residue block and the decoded third residue block of the third color component image.
- the reconstructing unit 850 reconstructs a pixel block of the remaining color component image by adding the generated first color component image of the remaining color component image and a prediction pixel block of the remaining color component image generated in the prediction pixel block generating unit 840.
- a pixel block of the first color component image may be decoded without an additional second residue block prediction process by decoding the first residue block included in the bitstream , and adding the decoded first residue block and a prediction pixel block of the first color component image generated in the prediction pixel block generating unit 840.
- FIG. 9 is a flowchart of an image decoding method according to an exemplary embodiment of the present invention.
- a first residue block of the first color component images and a third residue block of the remaining color component image, which is included in a bitstream, are decoded in operation 910.
- a second residue block of the remaining color component image is generated using the decoded first residue block of the first color component image.
- the second residue block of the remaining color component image may be generated by substituting a residue value of the decoded first residue block of the first color component image into Equation (2).
- a first residue block of the remaining color component image is re- constructed by adding the second residue block of the remaining color component image and a decoded third residue block of the remaining color component image.
- a pixel block of each color component image is reconstructed by adding the prediction pixel block and the first residue of each color component image.
- the above-described processes are performed on each of pixel blocks constituting a frame to decode all the color component images.
- the present invention can also be embodied as a computer-readable code on a computer-readable recording medium.
- the computer-readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of computer-readable recording media include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.
- ROM read-only memory
- RAM random-access memory
- CD-ROMs compact discs, digital versatile discs, and Blu-rays, and Blu-rays, and Blu-rays, and Blu-rays, and Blu-rays, etc.
- the computer-readable recording medium can also be distributed over a network of coupled computer systems so that the computer-readable code is stored and executed in a decentralized fashion.
- predictive encoding is performed using correlation between a plurality of color component images constituting a single image, thereby improving encoding efficiency.
- encoding is performed on an RGB input image in an RGB domain without transformation into a YUV domain, thereby preventing color distortion during transformation of the RGB image into another color format, and thus improving display quality.
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020060062441A KR101261526B1 (en) | 2006-07-04 | 2006-07-04 | An video encoding/decoding method and apparatus |
PCT/KR2007/002714 WO2008004769A1 (en) | 2006-07-04 | 2007-06-05 | Image encoding/decoding method and apparatus |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2036351A1 true EP2036351A1 (en) | 2009-03-18 |
EP2036351A4 EP2036351A4 (en) | 2011-10-05 |
Family
ID=38894706
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP07807930A Ceased EP2036351A4 (en) | 2006-07-04 | 2007-06-05 | Image encoding/decoding method and apparatus |
Country Status (6)
Country | Link |
---|---|
US (1) | US8126053B2 (en) |
EP (1) | EP2036351A4 (en) |
JP (1) | JP2009543423A (en) |
KR (1) | KR101261526B1 (en) |
CN (1) | CN101356818B (en) |
WO (1) | WO2008004769A1 (en) |
Families Citing this family (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101403338B1 (en) * | 2007-03-23 | 2014-06-09 | 삼성전자주식회사 | Method and apparatus for image encoding, decoding |
KR101362757B1 (en) * | 2007-06-11 | 2014-02-14 | 삼성전자주식회사 | Method and apparatus for image encoding and decoding using inter color compensation |
US7996045B1 (en) * | 2007-11-09 | 2011-08-09 | Google Inc. | Providing interactive alert information |
US20090154567A1 (en) * | 2007-12-13 | 2009-06-18 | Shaw-Min Lei | In-loop fidelity enhancement for video compression |
US9154606B2 (en) | 2008-01-30 | 2015-10-06 | Google Inc. | Notification of mobile device events |
KR20100018810A (en) | 2008-08-07 | 2010-02-18 | 전자부품연구원 | High fidelity video encoding and decoding method and apparatus, and computer-readable storage medium |
PL2449782T3 (en) | 2009-07-01 | 2018-04-30 | Thomson Licensing | Methods and apparatus for signaling intra prediction for large blocks for video encoders and decoders |
KR101633459B1 (en) | 2009-08-10 | 2016-06-24 | 삼성전자주식회사 | Apparatus and method for encoding and decoding image data using correlation between colors |
EP2302845B1 (en) | 2009-09-23 | 2012-06-20 | Google, Inc. | Method and device for determining a jitter buffer level |
KR101767950B1 (en) * | 2009-11-24 | 2017-08-14 | 에스케이텔레콤 주식회사 | Apparatus and Method for extracting correlation parameters between color planes to make prediction image in video codec, and Video Encoding/Decoding Apparatus and Method using the same |
JP5547301B2 (en) | 2010-01-25 | 2014-07-09 | トムソン ライセンシング | Separate video encoder, video decoder, video encoding method and video decoding method for each color plane |
US8630412B2 (en) | 2010-08-25 | 2014-01-14 | Motorola Mobility Llc | Transport of partially encrypted media |
US8477050B1 (en) | 2010-09-16 | 2013-07-02 | Google Inc. | Apparatus and method for encoding using signal fragments for redundant transmission of data |
US8751565B1 (en) | 2011-02-08 | 2014-06-10 | Google Inc. | Components for web-based configurable pipeline media processing |
JP5854612B2 (en) * | 2011-02-18 | 2016-02-09 | ソニー株式会社 | Image processing apparatus and method |
US9363509B2 (en) * | 2011-03-03 | 2016-06-07 | Electronics And Telecommunications Research Institute | Method for determining color difference component quantization parameter and device using the method |
WO2012118359A2 (en) * | 2011-03-03 | 2012-09-07 | 한국전자통신연구원 | Method for determining color difference component quantization parameter and device using the method |
ES2715782T3 (en) * | 2011-04-21 | 2019-06-06 | Hfi Innovation Inc | Procedure and apparatus for improved loop filtering |
CN104023238B (en) * | 2011-11-07 | 2018-11-16 | 英特尔公司 | Across channel residual prediction |
EP2777250B1 (en) * | 2011-11-07 | 2017-05-31 | Intel Corporation | Cross-channel residual prediction |
JP5753062B2 (en) * | 2011-11-16 | 2015-07-22 | Kddi株式会社 | Color component prediction type image encoding apparatus and decoding apparatus |
US8819525B1 (en) | 2012-06-14 | 2014-08-26 | Google Inc. | Error concealment guided robustness |
CN104322068A (en) | 2012-06-27 | 2015-01-28 | 英特尔公司 | Cross-layer cross-channel residual prediction |
WO2014007514A1 (en) * | 2012-07-02 | 2014-01-09 | 엘지전자 주식회사 | Method for decoding image and apparatus using same |
JP5667269B2 (en) * | 2013-10-18 | 2015-02-12 | 株式会社Kddi研究所 | Image encoding device, image decoding device, image encoding / decoding device, image encoding / decoding method, and image encoding / decoding program |
JP2014222936A (en) * | 2014-07-23 | 2014-11-27 | 株式会社Kddi研究所 | Image decoding device, image decoding method, image encoding/decoding method and image decoding program |
JP6227698B2 (en) * | 2016-04-14 | 2017-11-08 | インテル コーポレイション | Cross channel residual prediction |
JP6177966B2 (en) * | 2016-06-15 | 2017-08-09 | インテル コーポレイション | Cross channel residual prediction |
CN113676732B (en) * | 2019-03-18 | 2023-06-20 | Oppo广东移动通信有限公司 | Image component prediction method, encoder, decoder, and storage medium |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1478189A3 (en) * | 2003-05-16 | 2004-12-22 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding/decoding image using image residue prediction |
EP1507415A3 (en) * | 2003-07-16 | 2005-05-04 | Samsung Electronics Co., Ltd. | Video encoding/decoding apparatus and method for color image |
EP1538844A3 (en) | 2003-11-26 | 2006-05-31 | Samsung Electronics Co., Ltd. | Color image residue transformation and encoding method |
KR100754388B1 (en) | 2003-12-27 | 2007-08-31 | 삼성전자주식회사 | Residue image down/up sampling method and appratus, image encoding/decoding method and apparatus using residue sampling |
CN100461867C (en) * | 2004-12-02 | 2009-02-11 | 中国科学院计算技术研究所 | Inage predicting encoding method in frame |
KR100750128B1 (en) * | 2005-09-06 | 2007-08-21 | 삼성전자주식회사 | Method and apparatus for intra prediction of video |
KR101256548B1 (en) * | 2005-12-30 | 2013-04-19 | 삼성전자주식회사 | Image encoding and decoding apparatuses and methods |
KR101246294B1 (en) * | 2006-03-03 | 2013-03-21 | 삼성전자주식회사 | Method of and apparatus for video intraprediction encoding/decoding |
KR101200865B1 (en) * | 2006-03-23 | 2012-11-13 | 삼성전자주식회사 | An video encoding/decoding method and apparatus |
KR101311402B1 (en) * | 2006-03-23 | 2013-09-25 | 삼성전자주식회사 | An video encoding/decoding method and apparatus |
KR101311403B1 (en) * | 2006-07-04 | 2013-09-25 | 삼성전자주식회사 | An video encoding/decoding method and apparatus |
KR101266168B1 (en) * | 2006-08-16 | 2013-05-21 | 삼성전자주식회사 | Method and apparatus for encoding, decoding video |
-
2006
- 2006-07-04 KR KR1020060062441A patent/KR101261526B1/en not_active IP Right Cessation
-
2007
- 2007-04-20 US US11/785,788 patent/US8126053B2/en not_active Expired - Fee Related
- 2007-06-05 WO PCT/KR2007/002714 patent/WO2008004769A1/en active Application Filing
- 2007-06-05 CN CN2007800012702A patent/CN101356818B/en not_active Expired - Fee Related
- 2007-06-05 JP JP2009517958A patent/JP2009543423A/en active Pending
- 2007-06-05 EP EP07807930A patent/EP2036351A4/en not_active Ceased
Non-Patent Citations (4)
Title |
---|
ASHOK K RAO ET AL: "Multispectral Data Compression Using Bidirectional Interband Prediction", IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 34, no. 2, 1 March 1996 (1996-03-01), XP011020707, ISSN: 0196-2892 * |
BENIERBAH S ET AL: "Compression of colour images by inter-band compensated prediction", IEE PROCEEDINGS: VISION, IMAGE AND SIGNAL PROCESSING, INSTITUTION OF ELECTRICAL ENGINEERS, GB, vol. 153, no. 2, 6 April 2006 (2006-04-06) , pages 237-243, XP006026172, ISSN: 1350-245X, DOI: 10.1049/IP-VIS:20050129 * |
See also references of WO2008004769A1 * |
XIAOLIN WU ET AL: "Context-Based Lossless Interband Compression-Extending CALIC", IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 9, no. 6, 1 June 2000 (2000-06-01), XP011025613, ISSN: 1057-7149 * |
Also Published As
Publication number | Publication date |
---|---|
EP2036351A4 (en) | 2011-10-05 |
KR20080004013A (en) | 2008-01-09 |
WO2008004769A1 (en) | 2008-01-10 |
CN101356818B (en) | 2012-02-08 |
JP2009543423A (en) | 2009-12-03 |
US8126053B2 (en) | 2012-02-28 |
US20080008239A1 (en) | 2008-01-10 |
CN101356818A (en) | 2009-01-28 |
KR101261526B1 (en) | 2013-05-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8126053B2 (en) | Image encoding/decoding method and apparatus | |
US8553768B2 (en) | Image encoding/decoding method and apparatus | |
US8150178B2 (en) | Image encoding/decoding method and apparatus | |
US7925107B2 (en) | Adaptive variable block transform system, medium, and method | |
US8170355B2 (en) | Image encoding/decoding method and apparatus | |
EP2241112B1 (en) | Encoding filter coefficients | |
US8111914B2 (en) | Method and apparatus for encoding and decoding image by using inter color compensation | |
KR101256548B1 (en) | Image encoding and decoding apparatuses and methods | |
EP2520093B1 (en) | Data compression for video | |
EP2153655B1 (en) | Method and apparatus for encoding and decoding image using modification of residual block | |
KR101348365B1 (en) | An video encoding/decoding method and apparatus | |
EP2582140A2 (en) | System and method for encoding/decoding videos using edge-adaptive transform | |
US20100034265A1 (en) | Apparatus and method for encoding and decoding high fidelity video, and computer-readable storage medium | |
EP2068567A2 (en) | Method, medium, and apparatus encoding/decoding image hierarchically | |
US20120128064A1 (en) | Image processing device and method | |
EP2635030A2 (en) | Adaptive intra-prediction encoding and decoding method | |
CN103782598A (en) | Fast encoding method for lossless coding | |
WO2008020687A1 (en) | Image encoding/decoding method and apparatus | |
KR20200112964A (en) | Method and apparatus for predicting residual code in transform domain | |
EP3066832B1 (en) | Adaptive prediction of coefficients of a video block | |
KR20080018469A (en) | Method and apparatus for transforming and inverse-transforming image | |
KR101244309B1 (en) | Method and apparatus for encoding/decoding video data | |
CN114245989A (en) | Encoder and method of encoding a sequence of frames | |
KR20140004018A (en) | The method of encoding and decoding of quantization matrix and the apparatus for using the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20080328 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK RS |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20110902 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 7/34 20060101ALI20110829BHEP Ipc: H04N 7/32 20060101ALI20110829BHEP Ipc: H04N 7/26 20060101ALI20110829BHEP Ipc: H04N 7/24 20110101AFI20110829BHEP |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SAMSUNG ELECTRONICS CO., LTD. |
|
17Q | First examination report despatched |
Effective date: 20120914 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R003 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
18R | Application refused |
Effective date: 20131002 |