Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/103—Selection of coding mode or of prediction mode
  • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
  • H04N19/122—Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/18—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
  • H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain

Definitions

• Apparatuses and methods consistent with the present invention relate to video compression, and more particularly, to more efficiently upsampling a base layer to perform interlayer prediction during multi-layer video coding.
• multimedia data requires storage media that have a large capacity and a wide bandwidth for transmission since the amount of multimedia data is usually large. Accordingly, a compression coding method is required for transmitting multimedia data including text, video, and audio.
• a basic principle of data compression is removing data redundancy.
• Data can be compressed by removing spatial redundancy in which the same color or object is repeated in an image, temporal redundancy in which there is little change between adjacent frames in a moving image or the same sound is repeated in audio, or mental visual redundancy which takes into account human eyesight and its limited perception of high frequency.
• temporal redundancy is removed by temporal filtering based on motion compensation
• spatial redundancy is removed by spatial transformation.
• transmission media are required. Different types of transmission media for multimedia have different performance. Currently used transmission media have various transmission rates. For example, an ultrahigh-speed communication network can transmit data of several tens of megabits per second while a mobile communication network has a transmission rate of 384 kilobits per second. To support transmission media having various speeds or to transmit multimedia, data coding methods having scalability may be suitable to a multimedia environment.
• Scalability indicates the ability to partially decode a single compressed bitstream.
• Scalability includes spatial scalability indicating a video resolution, signal-to-noise ratio (SNR) scalability indicating a video quality level, and temporal scalability indicating a frame rate.
• SNR signal-to-noise ratio
• temporal scalability indicating a frame rate.
• MPEG Moving Picture Experts Group
• a bitstream may consist of multiple layers, i.e., a base layer, enhanced layer 1, and enhanced layer 2 with different resolutions (QCIF, CIF, and 2CIF) or frame rates.
• FIG. 1 shows an example of a scalable video codec using a multi-layer structure.
• a base layer has a Quarter Common Intermediate Format (QCIF) resolution and a frame rate of 15 Hz
• a first enhancement layer has a Common Intermediate Format (CIF) resolution and a frame rate of 30 Hz
• a second enhancement layer has a Standard Definition (SD) resolution and a frame rate of 60 Hz.
• QCIF Quarter Common Intermediate Format
• CIF Common Intermediate Format
• SD Standard Definition
• Interlayer correlation may be used in encoding a multi-layer video frame.
• a region 12 in a first enhancement layer video frame may be efficiently encoded using prediction from a corresponding region 13 in a base layer video frame.
• a region 11 in a second enhancement layer video frame can be efficiently encoded using prediction from the region 12 in the first enhancement layer.
• FIG. 2 illustrates a conventional upsampling process for predicting an enhancement layer from a base layer.
• a current block 40 in an enhancement layer frame 20 corresponds to a predetermined block 30 in a base layer frame 10.
• the block 30 in the base layer frame 10 is upsampled to twice its resolution.
• half-pel interpolation or bi-linear interpolation provided by H.264 is used for upsampling.
• the conventional upsampling technique may offer good visual quality when being used to magnify an image for detailed observation because it smoothes the quality of an image. Disclosure of Invention
• this technique when being used to predict an enhancement layer, this technique may cause a mismatch between a discrete cosine transform (DCT) block 37 generated by performing DCT on an upsampled block 35 and a DCT block 45 generated by performing DCT on the current block 40. That is, since upsampling followed by DCT results in loss of partial information in the DCT block 37 due to failure to reconstruct a low-pass component of the original block 30, the conventional upsampling technique may be inefficient for use in an H.264 or MPEG-4 codec utilizing DCT for spatial transform.
• DCT discrete cosine transform
• the present invention provides a method for preserving the low-pass component of a base layer region as much as possible when the base layer region is upsampled to predict an enhancement layer.
• the present invention also provides a method for reducing a mismatch between the result of performing DCT and the result of upsampling a base layer when the DCT is used to perform spatial transform on an enhancement layer.
• a method for encoding a multi-layer video including the operations of: encoding and reconstructing a base layer frame, performing DCT upsampling on a second block of a predetermined size in the reconstructed frame corresponding to a first block in an enhancement layer frame, calculating a difference between the first block and a third block generated by the DCT upsampling, and encoding the difference.
• a method for encoding a multi-layer video including reconstructing a base layer residual frame from an encoded base layer frame, performing DCT upsampling on a second block of a predetermined size in the reconstructed base layer residual frame corresponding to a first residual block in an enhancement layer residual frame, calculating a difference between the first residual block and a third block generated by the DCT upsampling, and encoding the difference.
• a method for encoding a multi-layer video including encoding and inversely quantizing a base layer frame, performing DCT upsampling on a second block of a predetermined size in the inversely quantized frame corresponding to a first block in an enhancement layer frame, calculating a difference between the first block and a third block generated by the DCT upsampling, and encoding the difference.
• a method for decoding a multi-layer video including reconstructing a base layer frame from a base layer bitstream, reconstructing a difference frame from an enhancement layer bitstream, performing DCT upsampling on a second block of a predetermined size in the reconstructed base layer frame corresponding to a first block in the difference frame, and adding a third block generated by the DCT upsampling to the first block.
• a method for decoding a multi-layer video including reconstructing a base layer frame from a base layer bitstream, reconstructing a difference frame from an enhancement layer bitstream, performing DCT upsampling on a second block of a predetermined size in the reconstructed base layer frame corresponding to a first block in the difference frame, adding a third block generated by the DCT upsampling to the first block, and adding a fourth block generated by adding the third block to the first block to a block in a motion-compensated frame corresponding to the fourth block.
• a method for decoding a multi-layer video including extracting texture data from a base layer bitstream and inversely quantizing the extracted texture data, reconstructing a difference frame from an enhancement layer bitstream, performing Discrete Cosine Transform (DCT) upsampling on a second block of a predetermined size in the inversely quantized result corresponding to a first block in the difference frame, and adding a third block generated by the DCT upsampling to the first block.
• DCT Discrete Cosine Transform
• a multi- layered video encoder including means for encoding and reconstructing a base layer frame, means for performing Discrete Cosine Transform (DCT) upsampling on a second block of a predetermined size in the reconstructed frame corresponding to a first block in an enhancement layer frame, means for calculating a difference between the first block and a third block generated by the DCT upsampling, and means for encoding the difference.
• DCT Discrete Cosine Transform
• a multi-layered video decoder including means for reconstructing a base layer frame from a base layer bitstream, means for reconstructing a difference frame from an enhancement layer bitstream, means for performing Discrete Cosine Transform (DCT) upsampling on a second block of a predetermined size in the reconstructed base layer frame corresponding to a first block in the difference frame, and means for adding a third block generated by the DCT upsampling to the first block.
• DCT Discrete Cosine Transform
• FlG. 1 shows an example of a typical scalable video codec using a multi-layer structure
• FlG. 2 shows a conventional upsampling process used for predicting an enhancement layer from a base layer
• FlG. 3 schematically shows a Discrete Cosine Transform (DCT) upsampling process used in the present invention
• FlG. 4 shows an example of a zero-padding process
• FlG. 5 shows an example of performing interlayer prediction for each hierarchical variable-size motion block
• FlG. 6 is a block diagram of a video encoder according to a first exemplary embodiment of the present invention
• FlG. 7 is a block diagram of a DCT upsampler according to an exemplary embodiment of the present invention
• FlG. 8 is a block diagram of a video encoder according to a second exemplary embodiment of the present invention.
• FlG. 9 is a block diagram of a video encoder according to a third exemplary embodiment of the present invention.
• FlG. 10 is a block diagram of a video decoder corresponding to the video encoder of FIG. 6;
• FlG. 11 is a block diagram of a video decoder corresponding to the video encoder of FIG. 8;
• FlG. 12 is a block diagram of a video decoder corresponding to the video encoder of FIG. 9.
• FlG. 3 schematically shows a DCT upsampling process used in the present invention.
• DCT Discrete Cosine Transform
• operation S2 Discrete Cosine Transform
• zero-padding is added to the DCT block 31 to generate a block 50 enlarged to that of a current block 40 in an enhancement layer frame 20.
• the zero-padding is the process of filling the upper left corner of the block 50 whose size is enlarged by the ratio of the resolution of an enhancement layer to the resolution of a base layer with DCT coefficients y through y of the block 30 while
• an inverse DCT is performed on the enlarged block 50 according to a predetermined transform size to generate a predicted block 60 in operation S3 and predict the current block 40 using the predicted block 60 in operation S4 (hereinafter referred to as 'interlay er prediction').
• the DCT performed in the operation Sl has a different transform size than the IDCT performed in the operation S3. That is, when a base layer block 30 has a size of 4x4 pixels, the DCT is 4x4 DCT.
• the IDCT has a 8x8 transform size.
• the present invention includes an example of performing interlayer prediction for each DCT block in a base layer as shown in FlG. 3 as well as an example of performing interlayer prediction for each hierarchical variable-size motion block used in motion estimation for H.264 as shown in FlG. 5.
• the interlayer prediction may also be performed for each fixed-size motion block.
• a block for which motion estimation for calculating a motion vector is performed is hereinafter referred to as a 'motion block,' regardless of whether the block is of variable or fixed size.
• a macroblock 90 is segmented into optimum motion block modes and motion estimation and motion compensation are performed for each motion block.
• DCT transform operation SIl
• zero padding operation S 12
• IDCT transform operation S 13
• 8x4 DCT is performed on the block 70 to generate a DCT block 71.
• zero padding is added to the DCT block 71 to generate a block 80 of a size enlarged to the size of 16x8.
• 16x8 IDCT is performed on the block 80 to generate a predicted block 90. Then, the predicted block 90 is used to predict a current block.
• the present invention proposes three exemplary approaches to performing upsampling for predicting a current block.
• a predetermined block in a reconstructed base layer video frame is upsampled and the upsampled block is used to predict a current block in an enhancement layer.
• a predetermined block in a reconstructed temporal base layer residual frame ('residual frame') is upsampled and the upsampled block is used for predicting a temporal current enhancement layer block ('residual block').
• an upsampling is performed on the result of performing DCT on a block in a base layer frame.
• a residual frame is defined as a difference between frames at different positions in the same layer while a difference frame is defined as a difference between a current layer frame and a lower layer frame at the same temporal position when interlayer prediction is used.
• a block in a residual frame can be called a residual block while a block in a difference frame can be called a difference block.
• FlG. 6 is a block diagram of a video encoder 1000 according to a first exemplary embodiment of the present invention.
• the video encoder 1000 includes a DCT upsampler 900, an enhancement layer encoder 200, and a base layer encoder 100.
• FlG. 7 shows the configuration of the DCT upsampler 900 according to an exemplary embodiment of the present invention.
• the DCT upsampler 900 includes a DCT unit 910, a zero padding unit 920, and an IDCT unit 930. While FlG. 7 shows first and second inputs In and In , only the first input In is used in the first exemplary embodiment.
• the DCT unit 910 receives an image of a block of a predetermined size in a video frame reconstructed by the base layer encoder 100 and performs DCT of the predetermined size (e.g., 4x4).
• the predetermined block size may be equal to the transform size of the DCT unit 120.
• the predetermined block size may be equal to the size of a motion block considering matching to the motion block. For example, in H. 264, a motion block may have a block size of 16x16, 16x8, 8x16, 8x8, 8x4, 4x8, or 4x4.
• the zero padding unit 920 fills the upper left corner of a block enlarged by the ratio
• the IDCT unit 930 performs IDCT on a block generated by the zero padding according to a transform size equal to the size of the block (e.g., 8x8).
• a transform size equal to the size of the block (e.g., 8x8).
• the inversely DCT-transformed result is then provided to the enhancement layer encoder 200.
• the configuration of the enhancement layer encoder 200 will now be described.
• a selector 280 selects one of a signal received from the DCT upsampler 900 and a signal received from a motion compensator 260 and outputs the selected signal. The selection is performed by selecting a more efficient one of interlayer prediction and temporal prediction.
• a motion estimator 250 performs motion estimation on a current frame among input video frames using a reference frame to obtain motion vectors.
• a block matching algorithm (BMA) is most frequently used. That is, the BMA is a method of estimating a displacement, in which an error is minimum, as a motion vector while moving over a given block in units of pixels within a specific search region of a reference frame.
• Motion estimation may be performed using not only a fixed motion block size but also a variable motion block size based on a hierarchical search block matching algorithm (HSBMA).
• the motion estimator 250 provides motion data, including the motion vector obtained by motion estimation, a motion block mode, a reference frame number, and so on, to an entropy coding unit 240.
• a motion compensator 260 performs motion compensation on a reference frame using the motion vectors calculated by the motion estimator 250 and generates a temporally predicted frame for the current frame.
• a subtracter 215 subtracts the signal selected by the selector 280 from a current input frame signal in order to remove temporal redundancy within the current input frame.
• the DCT unit 220 performs DCT of a predetermined size on the frame in which the temporal redundancy has been removed by the subtractor 215 and creates DCT coefficients that will be defined by Equation (1): [54]
• Y is a coefficient generated by DCT ( 1 DCT coefficient')
• X is a pixel value for a block input to the DCT unit 120
• M and N denote horizontal and vertical DCT transform size (MxN).
• the transform size of the DCT unit 220 may be equal to or different from that in the IDCT performed by the DCT upsampler 900.
• the quantizer 230 performs quantization on the DCT coefficient to produce a quantization coefficient.
• quantization is a methodology to express the transformation coefficient expressed in an arbitrary real number as a finite number of bits.
• Known quantization techniques include scalar quantization, vector quantization, and the like. However, the present invention will be described with respect to scalar quantization by way of example.
• round (.) and S denote a function rounding to the nearest integer and a xy operation size, respectively.
• the operation size is determined by a MxN quantization table defined by JPEG, MPEG, or other standards.
• the entropy coding unit 240 losslessly encodes the quantization coefficients generated by the quantizer 230 and the motion data provided by the motion estimator 250 into an output bitstream.
• Examples of the lossless encoding include arithmetic coding, variable length coding, and so on.
• the video encoder 1000 further includes an inverse quantizer 271 and an IDCT unit 272.
• the inverse quantizer 271 performs inverse quantization on the coefficient quantized by the quantizer 232.
• the inverse quantization is the inverse of quantization.
• the IDCT unit 272 performs IDCT on the inversely quantized result and transmits the result to an adder 225.
• the adder 225 adds the inversely DCT-transformed result provided by the IDCT unit 172 to the previous frame provided by the motion compensator 260 and stored in a frame buffer (not shown) to reconstruct a video frame and transmits the reconstructed video frame to the motion estimator as a reference frame.
• the base layer encoder 100 includes a DCT unit 120, a quantizer 130, an entropy coding unit 140, a motion estimator 150, a motion compensator 160, an inverse quantizer 171, an IDCT unit 172, and a downsampler 105.
• a downsampler 105 downsamples an original input frame to the resolution of the base layer. While various techniques can be used for the downsampling, the downsampler 105 may be a DCT downsampler that is matched to the DCT upsampler 900. The DCT downsampler performs DCT on an input image block, followed by IDCT on DCT coefficients in the upper left corner of the block, thereby reducing the scale of the image block to one half.
• upsampling for interlayer prediction may apply to a full image as well as a residual image. That is, interlayer prediction may be performed between an enhancement layer residual image generated using temporal prediction and a corresponding base layer residual image. In this case, a predetermined block in a base layer needs to be upsampled before being used for predicting a current block in an enhancement layer.
• FIG. 8 is a block diagram of a video encoder 2000 according to a second exemplary embodiment of the present invention.
• a DCT upsampler 900 receives a reconstructed base layer residual frame as an input instead of a reconstructed base layer video frame.
• a signal (reconstructed residual frame signal) obtained before passing through an adder 125 of a base layer encoder 100 is fed into the DCT upsampler 900.
• the first input In shown in FlG. 7 is used in the second exemplary embodiment.
• the DCT upsampler 900 receives an image of a block of a predetermined size in a residual frame reconstructed by the base layer encoder 100 to perform DCT, zero padding, and IDCT as shown in FlG. 7.
• a signal upsampled by the DCT upsampler 900 is fed into a second subtractor 235 of an enhancement layer encoder 300.
• a predicted frame provided by the motion compensator 260 is fed into a first subtractor 215 that then subtract the predicted frame signal from a current input frame signal to generate a residual frame.
• the second subtractor 235 subtracts an upsampled block output from the DCT upsampler 900 from a corresponding block in the residual frame and transmits the result to a DCT unit 220.
• the remaining elements in the enhancement layer encoder 300 perform the same operations as their counterparts in the enhancement layer encoder 200 of FlG. 6, a detailed explanation thereof will not be given.
• Elements in the base layer encoder 100 also perform the same operations as their counterparts in the base layer encoder 100 except that a signal obtained before passing through an adder 125 of a base layer encoder 100, that is, after passing through an IDCT unit 172, is fed into the DCT upsampler 900.
• a DCT process may be skipped.
• a signal inversely quantized by the base layer encoder 100 is subjected to IDCT without being subjected to temporal prediction to reconstruct a video frame.
• FlG. 9 is a block diagram of a video encoder 3000 according to a third exemplary embodiment of the present invention. Referring to FlG. 9, the output of an inverse quantizer 171 for a frame that has not undergone temporal prediction is fed into the DCT upsampler 900.
• a switch 135 disconnects or connects signal passing from a motion compensator
• the third exemplary embodiment of the present invention is applied to a frame encoded without being subjected to temporal prediction when the switch 135 blocks the signal in a base layer.
• an input frame is subjected to downsampling, DCT, quantization, and inverse quantization by a downsampler 105, a DCT unit 120, a quantizer 130, and an inverse quantizer 171, respectively, before being fed into the DCT upsampler 900.
• the DCT upsampler 900 receives coefficients of a predetermined block in a frame subjected to the inverse quantization as input In (see FlG. 7).
• the zero padding unit 920 fills the upper left corner of the block whose size is enlarged by the ratio of the resolution of the enhancement layer to the resolution of the base layer with coefficients of a predetermined block while filling the remaining region of the enlarged block with zeros.
• the IDCT unit 930 performs IDCT on the enlarged block generated using the zero padding according to the transform size that is equal to the size of the enlarged block.
• the inversely DCT-transformed result is then provided to a selector 280 of the enhancement layer encoder 200.
• the enhancement layer encoder 200 performs the same processes as its counterpart shown in FlG. 6, so a detailed explanation thereof will be omitted.
• the upsampling process in the third exemplary embodiment of the present invention is efficient because of the use of the DCT-transformed result obtained by the base layer encoder 100.
• FlG. 10 is a block diagram of a video decoder 1500 corresponding to the video encoder 1000 of FlG. 6.
• the video decoder 1500 mainly includes a DCT upsampler 900, an enhancement layer decoder 500, and a base layer decoder 400.
• the DCT upsampler 900 has the same configuration as shown in FlG. 7 and receives a base layer frame reconstructed by the base layer decoder 400 as an input In .
• a DCT unit 910 receives an image of a block of a predetermined size in the base layer frame and performs DCT of the predetermined size.
• the predetermined block size may be equal to the transform size of the DCT unit 120 in the DCT upsampler 900 of the video encoder 1000.
• a decoding process performed by the video decoder 1500 is matched to the encoding process performed by the video encoder 1000 in this way, thereby reducing a drifting error that may occur due to a mismatch between an encoder and a decoder.
• the predetermined block size may be equal to the size of a motion block considering matching to the motion block.
• a zero padding unit 920 fills the upper left corner of a block enlarged by the ratio of the resolution of an enhancement layer to the resolution of a base layer with DCT coefficients generated by the DCT while padding zeros to the remaining region of the enlarged block.
• An IDCT unit 930 performs IDCT on a block generated using the zero padding according to a transform size equal to the size of the block.
• the inversely DCT-transformed result i.e., the DCT-upsampled result is then provided to a selector 560.
• the enhancement layer decoder 500 includes an entropy decoding unit 510, an inverse quantizer 520, an IDCT unit 530, a motion compensator 550, and a selector 560.
• the entropy decoding unit 510 performs lossless decoding that is the inverse of entropy encoding to extract texture data and motion data that are then fed to the inverse quantizer 520 and the motion compensator 550, respectively.
• the inverse quantizer 520 performs inverse quantization on the texture data received from the entropy decoding unit 510 using the same quantization table that used in the video encoder 1000.
• Equation (3) A coefficient generated by inverse quantization is calculated using Equation (3) below.
• the coefficient Y xy is different from Y xy calculated using the Equation (1) because lossy encoding employing a round (.) function is used in the Equation (1).
• the IDCT unit 530 performs IDCT on the coefficient Y obtained by the inverse quantization.
• the inversely DCT-transformed result X is calculated using
• Equation (4) [90]
• the motion compensator 550 performs motion compensation on a previously reconstructed video frame using the motion data received from the entropy decoding unit 510, generates a motion-compensated frame, and the generated frame signal is transmitted to the selector 560.
• the selector 560 selects one of the signal received from the DCT upsampler 900 and the signal received from the motion compensator 550 and outputs the selected signal to an adder 515.
• the signal received from the DCT upsampler 900 is output.
• the signal received from the motion compensator 550 is output.
• the adder 515 adds the signal chosen by the selector 560 to the signal output from the IDCT unit 530, thereby reconstructing an enhancement layer video frame. [95] Because elements in the base layer decoder 400 perform the same operations as those of their counterparts in the enhancement layer decoder 500 except that the base layer decoder 400 does not include the selector 560, a detailed explanation thereof will not be given.
• FlG. 11 is a block diagram of a video decoder 2500 corresponding to the video encoder 2000 of FlG. 8.
• the video decoder 2500 mainly includes a DCT upsampler 900, an enhancement layer decoder 600, and a base layer decoder 400.
• the DCT upsampler 900 receives a base layer frame reconstructed by the base layer decoder 400 as an input In to perform upsampling and transmits the upsampled result to a first adder 525.
• the first adder 525 adds a residual frame signal output from an IDCT unit 530 to the signal provided by the DCT upsampler 900 in order to reconstruct a residual frame signal that is then fed into a second adder 515.
• the second adder 515 adds the reconstructed residual frame signal to a signal received from a motion compensator 550, thereby reconstructing an enhancement layer frame.
• FlG. 12 is a block diagram of a video decoder 3500 corresponding to the video encoder 3000 of FlG. 9.
• the video decoder 3500 mainly includes a DCT upsampler 900, an enhancement layer decoder 500, and a base layer decoder 400.
• the DCT upsampler 900 receives a signal output from an inverse quantizer 420 to perform DCT upsampling.
• the DCT upsampler 900 receives an input In (see FlG. 7) as the signal to perform zero padding by skipping a DCT process.
• a zero padding unit 920 fills the upper left corner of a block enlarged by the ratio of the resolution of an enhancement layer to the resolution of a base layer with coefficients of a predetermined block received from the inverse quantizer 420 while padding zeros to the remaining region of the enlarged block.
• An IDCT unit 930 performs IDCT on the enlarged block generated using the zero padding according to the transform size equal to the size of the enlarged block.
• the inversely DCT- transformed result is then provided to a selector 560 of the enhancement layer decoder 500.
• the enhancement layer decoder 500 performs the same processes as its counterpart shown in FlG. 10, and thus their description will be omitted.
• various functional components mean, but are not limited to, software or hardware components, such as a Field Programmable Gate Arrays (FPGAs) or Application Specific Integrated Circuits (ASICs), which perform certain tasks.
• the components may advantageously be configured to reside on the addressable storage media and configured to execute on one or more processors.
• the functionality provided for in the components and modules may be combined into fewer components and modules or further separated into additional components and modules.
• the present invention can preserve low-pass component of the base layer region as much as possible.
• the present invention can reduce a mismatch between the result of performing

Applications Claiming Priority (3)

Publications (1)

Family

ID=36565262

Family Applications (1)

Country Status (2)

Families Citing this family (4)

Family Cites Families (1)

• 2005
  • 2005-11-18 WO PCT/KR2005/003914 patent/WO2006059847A1/en active Application Filing
  • 2005-11-18 EP EP05820695A patent/EP1817918A1/de not_active Withdrawn

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events