KR20110036401A - Method and apparatus for encoding video, and method and apparatus for decoding video - Google Patents

Abstract

PURPOSE: An image coding method, image encoding method, and apparatus thereof are provided to increase the efficiency of image compression through the process of predicted image data. CONSTITUTION: A first predictive encoding unit is generated by a current encoding unit(2110). A second predictive encoding unit is generated by changing a pixel value of each pixel that consists of a first predictive encoding unit. The difference between a current encoding unit and a second predictive encoding unit is encoded.

Description

Method and apparatus for encoding video, method and apparatus for decoding thereof {Method and apparatus for encoding video, and method and apparatus for decoding video}

The present invention relates to a video encoding method and apparatus for improving the compression efficiency of an image through post-processing of predicted image data, and a decoding method and apparatus thereof.

In video compression schemes such as MPEG-1, MPEG-2, MPEG-4, and H.264 / MPEG-4 Advanced Video Coding (AVC), a picture is divided into macro blocks to encode an image. Each macroblock is encoded in all encoding modes available for inter prediction and intra prediction, and then one encoding mode is selected according to the bit rate required for encoding the macro block and the degree of distortion of the original macro block and the decoded macro block. Select to encode the macro block.

With the development and dissemination of hardware capable of playing and storing high resolution or high definition video content, there is an increasing need for a video codec for efficiently encoding or decoding high resolution or high definition video content. According to the existing video codec, video is encoded according to a limited prediction mode based on a macroblock of a predetermined size.

The problem to be solved by the present invention is to encode a video encoding method and apparatus for improving the compression efficiency of the image by changing the pixel value of each pixel in the prediction block through post-processing on the prediction block, decoding It is to provide a method and apparatus.

An image encoding method according to an embodiment of the present invention includes generating a first prediction coding unit for a current coding unit to be encoded; Generating a second prediction coding unit by changing a pixel value of each pixel by using each pixel constituting the first prediction coding unit and at least one neighboring pixel; And encoding a difference value between the current coding unit and the second prediction coding unit.

An image encoding apparatus according to an embodiment of the present invention includes a prediction unit generating a first prediction coding unit for a current coding unit to be encoded; A post processor configured to generate a second prediction coding unit by changing a pixel value of each pixel by using each pixel constituting the first prediction coding unit and at least one neighboring pixel; And an encoder which encodes a difference between the current coding unit and the second prediction coding unit.

An image decoding method according to an embodiment of the present invention includes extracting prediction mode information of a current decoding unit to be decoded from a received bitstream; Generating a first prediction decoding unit for the current decoding unit according to the extracted prediction mode information; Extracting operation information using each pixel constituting the first prediction decoding unit and neighboring pixels of the pixel from the bitstream; Generating a second prediction decoding unit by changing a pixel value of each pixel using each pixel constituting the first prediction decoding unit and peripheral pixels of each pixel according to the extracted operation information; Extracting and reconstructing a residual corresponding to a difference between the current decoding unit and the second prediction decoding unit from the bitstream; And decoding the current decoding unit by adding the residual and the second prediction decoding unit.

An image decoding apparatus according to an embodiment of the present invention includes each pixel constituting prediction mode information of a current decoding unit decoded from a received bitstream and a first prediction decoding unit for the current decoding unit, and neighboring pixels of each pixel. An entropy decoder for extracting operation information using the apparatus; A prediction unit generating the first prediction decoding unit according to the extracted prediction mode information; A post processor configured to generate a second prediction decoding unit by changing a pixel value of each pixel using each pixel constituting the first prediction decoding unit and peripheral pixels of each pixel according to the extracted operation information; An inverse transform and inverse quantizer for restoring a residual corresponding to a difference between the current decoding unit and the second prediction decoding unit from the bitstream; And an adder configured to add the residual and the second prediction decoding unit to decode the current decoding unit.

Hereinafter, an image encoding apparatus, an image decoding apparatus, an image encoding method, and an image decoding method according to exemplary embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a block diagram of an image encoding apparatus according to an embodiment of the present invention.

Referring to FIG. 1, an image encoding apparatus 100 according to an embodiment of the present invention may include a maximum coding unit splitter 110, a coded depth determiner 120, an image data encoder 130, and an encoding information encoder. 140.

The maximum coding unit splitter 110 splits the current picture or the current slice based on the maximum coding unit that is the largest coding unit. The current picture or the current slice is split into at least one maximum coding unit. The divided image data may be output to the coded depth determiner 120 for at least one maximum coding unit.

According to an embodiment of the present invention, a coding unit may be expressed using a maximum coding unit and a depth. The maximum coding unit represents a coding unit having the largest size among the coding units of the current picture, and the depth represents the size of a sub coding unit in which the coding unit is hierarchically reduced. As the depth increases, the coding unit may be reduced from the maximum coding unit to the minimum coding unit, the depth of the maximum coding unit may be defined as the minimum depth, and the depth of the minimum coding unit may be defined as the maximum depth. As the maximum coding unit decreases as the depth increases, the size of the coding unit for each depth decreases, and thus, a sub-coding unit having a depth of k may include a plurality of sub-coding units having a depth of k + 1 or more.

As described above, the image data of the current picture is divided into the largest coding units according to the maximum size of the coding units, and each maximum coding unit may include coding units reduced by depth. Since the maximum coding unit is reduced for each depth according to an embodiment of the present invention, image data of a spatial domain included in the maximum coding unit may be hierarchically classified according to the depth.

The maximum depth and the maximum size of the coding unit that limit the total number of hierarchically reduced heights and widths of the current coding unit from the maximum coding unit to the highest coding unit may be preset. The maximum coding unit and the maximum depth may be set in picture or slice units. That is, each picture or slice may have a different maximum coding unit and maximum depth, and the minimum coding unit size included in the maximum image coding unit may be variably set according to the maximum depth. In this way, the maximum coding unit and the maximum depth can be variably set for each picture or slice, so that a flat area image is encoded using a larger maximum coding unit, thereby improving the compression rate, and a large complexity image is encoded with a smaller size. By using the unit, the compression efficiency of the image can be improved.

The coding depth determiner 120 determines a different maximum depth for each maximum coding unit. The maximum depth may be determined based on the rate-distortion cost calculation. The determined maximum depth is output to the encoding information encoder 140, and the image data for each maximum coding unit is output to the image data encoder 130.

Image data in the largest coding unit is encoded based on coding units according to depths according to at least one depth less than or equal to the maximum depth, and encoding results based on the coding units for each depth are compared. As a result of comparing the encoding error of the coding units according to depths, a depth having the smallest encoding error may be selected. At least one coding depth may be determined for each maximum coding unit.

As the depth of the maximum coding unit increases, the coding unit is hierarchically divided and reduced, and the number of coding units increases. In addition, even if the coding units of the same depth included in one maximum coding unit, the coding error for each data is measured and it is determined whether to reduce to the higher depth. Therefore, even in the data included in one largest coding unit, since the encoding error for each depth is different according to the position, the coding depth may be differently determined according to the position. In other words, the maximum coding unit may be divided into sub-coding units having different sizes according to different depths. One or more coding depths may be set for one maximum coding unit, and the data of the maximum coding unit may have one or more coding depths. It may be divided according to coding units of.

In addition, sub-coding units of different sizes included in the largest coding unit may be predicted or frequency-converted based on processing units of different sizes. In other words, the image encoding apparatus 100 may perform a plurality of processing steps for image encoding based on various sizes and various types of processing units. In order to encode image data, processing steps such as prediction, frequency conversion, and entropy encoding are performed. Processing units having the same size may be used in all stages, and processing units having different sizes may be used in stages.

For example, the image encoding apparatus 100 may select a processing unit different from the coding unit to predict the coding unit. For example, when the size of the coding unit is 2Nx2N (where N is a positive integer), the processing unit for prediction may be 2Nx2N, 2NxN, Nx2N, NxN, or the like. In other words, motion prediction may be performed based on a processing unit of half of at least one of a height or a width of a coding unit. Hereinafter, the data unit on which the prediction is based is called a 'prediction unit'.

The prediction mode may be at least one of an intra mode, an inter mode, and a skip mode, and the specific prediction mode may be performed only for a prediction unit of a specific size or shape. For example, the intra mode may be performed only for a prediction unit having a square size of 2N × 2N or N × N. In addition, the skip mode may be performed only for a prediction unit having a size of 2N × 2N. If there are a plurality of prediction units in the coding unit, a prediction mode having the smallest encoding error may be selected by performing prediction for each prediction unit.

In addition, the image encoding apparatus 100 may frequency-convert the image data based on a processing unit having a size different from that of the coding unit. Frequency conversion may be performed based on a data unit having a size smaller than or equal to the coding unit for frequency conversion of the coding unit. Hereinafter, the processing unit which becomes the basis of frequency conversion is called a "conversion unit."

The coding depth determiner 120 measures a coding error of coding units according to depths using a Lagrangian Multiplier-based rate-distortion optimization technique to have an optimal coding error. The partition form of can be determined. In other words, the coded depth determiner 120 may determine which type of sub-coding unit is divided into a maximum coding unit, wherein the plurality of sub-coding units vary in size according to depth.

The image data encoder 130 encodes image data of a maximum coding unit based on at least one coded depth determined by the coded depth determiner 120, and outputs a bitstream. Since the encoding depth determiner 120 has already performed encoding to measure the minimum encoding error, the encoded depth determiner 120 may output the encoded data stream.

The encoding information encoder 140 outputs a bitstream by encoding information about an encoding mode according to depths for each largest coding unit, based on at least one coded depth determined by the coded depth determiner 120. The information about the encoding modes for each depth may include coded depth information, split type information of a prediction unit of a coding unit of a coding depth, prediction mode information for each prediction unit, size information of a transformation unit, and the like.

The coded depth information may be defined using depth-specific reduction information indicating whether to encode in a coding unit of a higher depth without encoding to the current depth. If the current depth of the current coding unit is a coded depth, since the current coding unit is encoded in a coding unit of the current depth, the reduced information of the current depth may no longer be reduced to a higher depth. On the contrary, if the current depth of the current coding unit is not the coding depth, encoding should be attempted using the coding unit of the higher depth, and thus the reduced information of the current depth may be defined to be reduced to the coding unit of the higher depth.

If the current depth is not the coded depth, encoding is performed on the coding unit reduced to the coding unit of the higher depth. Since at least one coding unit of the higher depth exists in the coding unit of the current depth, encoding may be repeatedly performed for each coding unit of each higher depth, and recursive coding may be performed for each coding unit of the same depth.

Since at least one coding depth is determined in one maximum coding unit and information about at least one coding mode should be determined for each coding depth, information about at least one coding mode may be determined for one maximum coding unit. In addition, since the data of the largest coding unit is hierarchically divided according to the depth, the coding depth may be different for each location, and thus information about the coded depth and the coding mode may be set for the data.

Therefore, the encoding information encoder 140 according to an embodiment may set corresponding encoding information for each minimum coding unit included in the maximum coding unit. That is, the coding unit of the coded depth includes at least one minimum coding unit having the same coding information. By using this, if the neighboring minimum coding units have the same depth-specific encoding information, it may be the minimum coding unit included in the same maximum coding unit.

According to an embodiment of the simplest form of the image encoding apparatus 100, a coding unit for each depth is a coding unit having a size in which a height and a width of a coding unit of one layer lower depth are divided by half. That is, if the size of the coding unit of the current depth k is 2Nx2N, the size of the coding unit of the higher depth k + 1 is NxN. Therefore, a current coding unit having a size of 2Nx2N may include at most four higher depth coding units having a size of NxN.

Accordingly, the image decoding apparatus 100 according to an embodiment may determine an optimal shape division form for each maximum coding unit based on the size and the maximum depth of the maximum coding unit determined in consideration of the characteristics of the current picture. In addition, since each of the maximum coding units may be encoded in various prediction modes, frequency transform schemes, or the like, an optimal coding mode may be determined in consideration of image characteristics of coding units having various image sizes.

If an image having a very high resolution or a very large data amount is encoded in a conventional 16 × 16 macroblock unit, the number of macroblocks per picture becomes excessively large. Accordingly, since the compressed information generated for each macroblock increases, the transmission burden of the compressed information increases, and the data compression efficiency tends to decrease. Accordingly, the image encoding apparatus according to an embodiment of the present invention may adjust the coding unit in consideration of the image characteristics while increasing the maximum size of the coding unit in consideration of the size of the image, thereby increasing image compression efficiency. .

2 is a block diagram of an image decoding apparatus according to an embodiment of the present invention.

Referring to FIG. 2, the image decoding apparatus 200 according to an embodiment of the present invention includes an image data acquisition unit 210, an encoding information extractor 220, and an image data decoder 230.

The image related data obtaining unit 210 parses the bit string received by the image decoding apparatus 200, obtains image data for each maximum coding unit, and outputs the image data to the image data decoding unit 230. The image-related data acquisition unit 210 may extract information on the maximum coding unit of the current picture or slice from the header for the current picture or slice. The image decoding apparatus 200 according to an embodiment of the present invention decodes image data for each largest coding unit.

The encoding information extracting unit 220 parses the bit string received by the image decoding apparatus 200 and extracts information about a coded depth and an encoding mode for each maximum coding unit from a header for the current picture. The extracted information about the coded depth and the coding mode is output to the image data decoder 230.

The information about the coded depth and the encoding mode for each largest coding unit may be set for one or more coded depth information, and the information about the coding mode for each coded depth may include split type information of a prediction unit for each coding unit, prediction mode information, and the like. The size information of the transformation unit may be included. In addition, reduced coded information for each depth may be extracted as the coded depth information.

The information about the split form of the largest coding unit may include information about sub-coding units having different sizes according to the depth included in the maximum coding unit, and the information about the encoding mode may include information about a prediction unit for each sub-coding unit, Information on the prediction mode and information on the transformation unit may be included.

The image data decoder 230 reconstructs the current picture by decoding image data of each maximum coding unit based on the information extracted by the encoding information extractor. The image data decoder 230 may decode the sub coding unit included in the maximum coding unit based on the information about the split form of the maximum coding unit. The decoding process may include a motion prediction process including intra prediction and motion compensation, and a frequency inverse transform process.

The image data decoder 230 reconstructs the current picture by decoding image data of each maximum coding unit based on the information about the coded depth and the encoding mode for each maximum coding unit. Based on the coded depth information for each largest coding unit, the image data decoder 230 may decode the image data for each coding unit of at least one coded depth. The decoding process may include a prediction process including an intra prediction and motion compensation and an inverse transform process.

The image data decoder 230 performs intra prediction or motion in each prediction unit and prediction mode for each coding unit, based on the split type information and the prediction mode information of the prediction unit of the coding unit according to the coding depths, for the prediction of each coding unit. Compensation can be performed. In addition, the image data decoder 230 may perform inverse transformation in each transformation unit for each coding unit based on size information of the transformation unit of the coding unit for each coding depth, for inverse transformation for each maximum coding unit.

The image data decoder 230 may determine the coded depth of the current maximum coding unit using the reduced information for each depth. If the reduced information indicates decoding to the current depth, the current depth is the coded depth. Therefore, the image data decoder 230 may decode the coding unit of the current depth with respect to the image data of the current maximum coding unit by using the partition type, the prediction mode, and the transformation unit size information of the prediction unit. In other words, by observing the encoding information set for the minimum coding unit, the minimum coding unit holding the encoding information including the same reduced information can be collected and decoded into one data unit.

The image decoding apparatus 200 according to an exemplary embodiment may obtain information about a coding unit that generates a minimum coding error by recursively encoding each maximum coding unit in an encoding process, and use the same to decode the current picture. have. That is, the image data can be decoded in an optimal coding unit for each maximum coding unit. Therefore, even if a high resolution image or an excessively large amount of data is used, the image data can be efficiently used according to the coding unit size and the encoding mode that are adaptively determined according to the characteristics of the image by using the information about the optimum encoding mode transmitted from the encoding end. Can be decoded and restored.

3 illustrates a hierarchical coding unit according to an embodiment of the present invention.

Referring to FIG. 3, the hierarchical coding unit according to the present invention may include 32x32, 16x16, 8x8, and 4x4 starting from a coding unit having a width x height of 64x64. In addition to the square coding units, there may be coding units having a width x height of 64x32, 32x64, 32x16, 16x32, 16x8, 8x16, 8x4, and 4x8.

In FIG. 3, the video data 310 has a resolution of 1920x1080, a maximum coding unit size of 64, and a maximum depth of 2. In the video data 320, the resolution is set to 1920x1080, the maximum size of the coding unit is 64, and the maximum depth is set to 4. For the video data 330, the resolution is set to 352x288, the maximum size of the coding unit is 16, and the maximum depth is 2.

When the resolution is high or the amount of data is large, it is desirable that the maximum size of the coding size be relatively large in order to not only improve the compression ratio but also accurately reflect the image characteristics. Accordingly, the video data 310 or 320 having a higher resolution than the video data 330 may be selected to have a maximum size of 64.

The maximum depth represents the total number of layers in the hierarchical coding unit. Accordingly, since the maximum depth of the video data 310 is 2, the coding unit 315 of the video data 310 is encoded from the largest coding unit having a long axis size of 64 by two layers of depth, and has a long axis size of 32 or 16. It can include up to units. On the other hand, since the maximum depth of the video data 330 is 2, the coding unit 335 of the video data 330 has two long depths of encoding from the coding units having the long axis size of 16, so that the long axis sizes are 8 and 4 It can include up to units.

Since the maximum depth of the video data 320 is 4, the coding unit 325 of the video data 320 increases the depth by four layers from the maximum coding unit having the long axis size of 64, so that the long axis size is 32, 16, 8, 4 It is possible to include even coding units. As the depth is increased, the image is encoded based on a smaller sub-coding unit, thereby making it suitable for encoding an image including a finer scene.

4 is a block diagram of an image encoder based on coding units, according to an embodiment of the present invention.

Referring to FIG. 4, the intra predictor 410 performs intra prediction on the prediction unit of the intra mode in the current frame 405, and the motion estimator 420 and the motion compensator 425 predict the inter mode. Inter prediction and motion compensation are performed using the current frame 405 and the reference frame 495 for the unit.

Residual values are generated based on the prediction unit output from the intra predictor 410, the motion estimator 420, and the motion compensator 425, and the generated residual values are the frequency converter 430 and the quantizer. 440 is output as a quantized transform coefficient. In particular, as described below with reference to FIG. 12, the intra prediction unit 410 according to an embodiment of the present invention performs post-processing for changing each pixel of an intra-predicted coding unit by using neighboring pixels, and then post-processing. The residual values, which are the difference between the encoded coding unit and the original coding unit, may be output as quantized transform coefficients through the frequency transformer 430 and the quantizer 440.

The quantized transform coefficients are restored to the residual values through the inverse quantizer 460 and the frequency inverse transformer 470, and the restored residual values are passed through the deblocking unit 480 and the loop filtering unit 490. Processed and output to the reference frame 495. The quantized transform coefficients may be output to the bitstream 455 via the entropy encoder 450.

In order to encode according to an image encoding method according to an embodiment of the present invention, the components of the image encoder 400, an intra predictor 410, a motion estimator 420, a motion compensator 425, and a frequency transform The unit 430, the quantizer 440, the entropy encoder 450, the inverse quantizer 460, the frequency inverse transformer 470, the deblocking unit 480, and the loop filter 490 are all the maximum coding units. The image encoding processes are processed based on a sub coding unit, a prediction unit, and a transformation unit according to the depth. In particular, the intra predictor 410, the motion estimator 420, and the motion compensator 425 determine the prediction unit and the prediction mode in the coding unit in consideration of the maximum size and the depth of the coding unit, and the frequency converter 430. ) Should consider the size of the transform unit in consideration of the maximum size and depth of the coding unit.

5 is a block diagram of an image decoder based on coding units, according to an embodiment of the present invention.

Referring to FIG. 5, the bitstream 505 is parsed through the parser 510 to encode encoded image data and encoding information necessary for decoding. The encoded image data is output as inverse quantized data through an entropy decoder 520 and an inverse quantizer 530, and reconstructed into residual values through a frequency inverse transformer 540. The residual values are added to the result of the intra prediction of the intra predictor 550 or the result of the motion compensation of the motion compensator 560 and reconstructed for each coding unit. The reconstructed coding unit is used for prediction of the next coding unit or the next picture through the deblocking unit 570 and the loop filtering unit 580.

Parsing unit 510, entropy decoding unit 520, inverse quantization unit 530, frequency inverse transform unit (components) of the image decoding unit 400 to decode according to the image decoding method according to an embodiment of the present invention 540, the intra prediction unit 550, the motion compensator 560, the deblocking unit 570, and the loop filtering unit 580 all include a maximum coding unit, a sub-encoding unit according to depth, a prediction unit, and a transformation unit. Based on the video decoding processes. In particular, the intra predictor 550 and the motion compensator 560 determine the prediction unit and the prediction mode in the coding unit in consideration of the maximum size and the depth of the coding unit, and the frequency inverse transformer 540 determines the maximum size of the coding unit. Considering the depth and depth, the size of the transform unit should be considered.

6 is a diagram of deeper coding units according to depths, and prediction units, according to an embodiment of the present invention.

The image encoding apparatus 100 and the image decoding apparatus 200 according to an embodiment use hierarchical coding units to consider image characteristics. The maximum height, width, and maximum depth of the coding unit may be adaptively determined according to the characteristics of the image, and may be variously set according to a user's request. According to the maximum size of the preset coding unit, the size of the coding unit for each depth may be determined.

The hierarchical structure 600 of a coding unit according to an embodiment of the present invention illustrates a case in which the maximum height and width of the coding unit are 64 and the maximum depth is four. Since the depth increases along the vertical axis of the hierarchical structure 600 of the coding unit, the height and the width of the coding unit for each depth are reduced. Also, a prediction unit that is a partial data unit that is a prediction base of each deeper coding unit is illustrated along the horizontal axis of the hierarchical structure 600 of the coding unit.

The maximum coding unit 610 has a depth of 0 as a maximum coding unit of the hierarchical structure 600 of the coding unit, and a size, that is, a height and a width, of the coding unit is 64x64. The depth increases along the vertical axis and includes a coding unit 620 of depth 1 having a size of 32x32, a coding unit 630 of depth 2 having a size of 16x16, a coding unit 640 of depth 3 having a size of 8x8, and a depth of 4 having a depth of 4x4. The coding unit 650 exists. A coding unit 650 having a depth of 4 having a size of 4 × 4 is a minimum coding unit.

Referring to FIG. 6, partial data units are shown as prediction units of coding units along a horizontal axis for each depth. That is, the prediction unit of the largest coding unit 610 of size 64x64 having a depth of 0 is a partial data unit 610 of size 64x64 included in the coding unit 610 of size 64x64, and partial data units 612 of size 64x32. , Partial data units 614 of size 32x64 and partial data units 616 of size 32x32.

The prediction unit of the coding unit 620 having a size of 32x32 having a depth of 1 may be a partial data unit 620 having a size of 32x32, the partial data units 622 having a size of 32x16, and a size of 16x32 included in the coding unit 620 having a size of 32x32. May be partial data units 624 of, partial data units 626 of size 16x16.

The prediction unit of the coding unit 630 of size 16x16 having a depth of 2 is a partial data unit 630 of size 16x16 included in the coding unit 630 of size 16x16, partial data units 632 of size 16x8, and size 8x16. May be partial data units 634 of, partial data units 636 of size 8x8.

The prediction unit of the coding unit 640 of size 8x8 having a depth of 3 includes a partial data unit 640 of size 8x8 included in the coding unit 640 of size 8x8, partial data units 642 of size 8x4, and size 4x8 partial data units 644, size 4x4 partial data units 646.

Finally, the coding unit 650 having a depth of 4 has a minimum coding unit, the coding unit having the highest depth, and the prediction unit is also a data unit 650 having a size of 4 × 4.

In order to determine the coded depth of the maximum coding unit 610, the coded depth determiner 120 of the image encoding apparatus according to an embodiment performs encoding on each coding unit of each depth included in the maximum coding unit 610. It must be done.

As the number of deeper coding units includes data of the same range and size, the number of deeper coding units increases as the depth increases. For example, four coding units of depth 2 are required for data included in one coding unit of depth 1. Therefore, in order to compare the encoding results of the same data for each depth, each of the coding units having one depth 1 and four coding units having four depths 2 should be encoded.

For each depth coding, encoding may be performed for each prediction unit of a coding unit according to depths along a horizontal axis of the hierarchical structure 600 of the coding unit, and a representative coding error, which is the smallest coding error at a corresponding depth, may be selected. . In addition, the depth may be increased along the vertical axis of the hierarchical structure 600 of the coding unit, the encoding may be performed for each depth, and the minimum coding error may be searched by comparing the representative coding error for each depth. The depth in which the minimum coding error occurs in the maximum coding unit 610 may be selected as the coding depth and the split type of the maximum coding unit 610.

7 illustrates a relationship between coding units and transformation units, according to an embodiment of the present invention.

The image encoding apparatus 100 and the image decoding apparatus 200 according to an embodiment of the present invention divide and encode or decode an image into coding units having a size smaller than or equal to the maximum coding unit for each maximum coding unit. The size of a transform unit for frequency transformation during the encoding process may be selected based on a data unit that is not larger than each coding unit. For example, when the current coding unit 710 is 64x64 size, frequency conversion may be performed using the 32x32 size transform unit 720. In addition, the data of the 64x64 coding unit 710 is encoded by performing frequency transformation on the 32x32, 16x16, 8x8, and 4x4 transform units having a size of 64x64 or less, and the transform unit having the least error with the original is obtained. Can be selected.

8 illustrates encoding information according to depths, according to an embodiment of the present invention.

The encoding information encoder of the image encoding apparatus 100 according to an exemplary embodiment of the present invention is information about an encoding mode. Information 800 about a partition type and information about a prediction mode 810 for each coding unit of each coded depth. Information 820 about the size of the transform unit may be encoded and transmitted.

The information about the split type 800 represents information about a type in which the current coding unit is split as a prediction unit for motion prediction of the current coding unit. For example, the current coding unit CU_0 of depth 0 and size 2Nx2N includes a prediction unit 802 of size 2Nx2N, a prediction unit 804 of size 2NxN, a prediction unit 806 of size Nx2N, and a prediction unit of size NxN ( 808 may be divided into any one type and used as a prediction unit. In this case, the information 800 about the split type of the current coding unit includes a prediction unit 802 of size 2Nx2N, a prediction unit 804 of size 2NxN, a prediction unit 806 of size Nx2N, and a prediction unit 808 of size NxN. It is set to indicate one of the.

The information 810 about the prediction mode indicates a motion prediction mode of each prediction unit. For example, through the information 810 about the prediction mode, the prediction unit indicated by the information 800 about the partition type is performed by the motion prediction as one of the intra mode 812, the inter mode 814, and the skip mode 816. Can be set.

In addition, the information about the transform unit size 820 indicates whether to transform the current coding unit based on the transform unit. For example, the transform unit may be one of a first intra transform unit size 822, a second intra transform unit size 824, a first inter transform unit size 826, and a second intra transform unit size 828. have.

The encoding information extracting unit of the image decoding apparatus 200 according to an embodiment of the present invention may include information about a partition type 800, information 810 about a prediction mode, and a transform unit size for each depth-based coding unit. The information 820 may be extracted and used for decoding.

9 is a diagram of deeper coding units according to depths, according to an embodiment of the present invention.

Reduced information may be used to indicate whether the depth is increased. The reduced information indicates whether the coding unit of the current depth is reduced to the coding unit of the higher depth.

The prediction unit 910 for motion prediction of a coding unit having a depth of 0 and 2N_0x2N_0 size includes a division type 912 having a size of 2N_0x2N_0, a division type 914 having a size of 2N_0xN_0, a division type 916 having a size of N_0x2N_0, and a division having a size of N_0xN_0 Type 918 may be included.

For each split type, coding through motion prediction should be performed repeatedly for one prediction unit of 2N_0xN_0 size, two prediction units of 2N_0xN_0 size, two prediction units of N_0x2N_0 size, and four prediction units of N_0xN_0 size. For prediction units of size 2N_0xN_0 and size N_0xN_0, motion prediction may be performed in intra mode and inter mode, and motion prediction may be performed only in inter mode as prediction units of size N_0x2N_0 and size N_0xN_0. The skip mode may be performed only for prediction units of size 2N_0xN_0.

If the encoding error due to the split type 918 having the size N_0xN_0 is the smallest, the depth 0 is increased to 1 (920), and the coding units 922, 924, 926, and 928 have the depth 2 and the split type coding units having the size N_0xN_0. We can repeatedly search for the minimum coding error.

Since encoding is repeatedly performed on coding units 922, 924, 926, and 928 having the same depth, only one of them will be described, for example, encoding of a coding unit having a depth of 1. The prediction unit 930 for motion prediction of a coding unit having a depth of 1 and a size of 2N_1x2N_1 (= N_0xN_0) includes a split type 932 of size 2N_1x2N_1, a split type 934 of size 2N_1xN_1, and a split type 936 of size N_1x2N_1. ), A split type 938 of size N_1xN_1. For each split type, encoding through motion prediction must be performed repeatedly for one prediction unit of size 2N_1x2N_1, two prediction units of size 2N_1xN_1, two prediction units of size N_1x2N_1, and four prediction units of size N_1xN_1.

In addition, if the encoding error due to the split type 938 having the size N_1xN_1 is the smallest, the coding units 942, 944, 946, and 948 of the depth 2 and the size N_2xN_2 are increased while increasing the depth 1 to the depth 2 (940). We can repeatedly search for the minimum coding error.

When the maximum depth is d, depth reduction information for each depth may be set until the depth d-1. That is, the prediction unit 950 for the motion prediction of the coding unit having the depth d-1 and the size 2N_ (d-1) x2N_ (d-1) is divided by the size 2N_ (d-1) x2N_ (d-1). Type 952, Split Type 954 of Size 2N_ (d-1) xN_ (d-1), Split Type 956 of Size N_ (d-1) x2N_ (d-1), Size N_ (d- 1) xN_ (d-1) may include a partition type 958.

For each split type, one prediction unit of size 2N_ (d-1) x2N_ (d-1), two prediction units of size 2N_ (d-1) xN_ (d-1), two sizes N_ (d-1) For each prediction unit of) x2N_ (d-1) and prediction units of four sizes N_ (d-1) xN_ (d-1), encoding through motion prediction should be performed repeatedly. Since the maximum depth is d, the coding unit 952 of the depth d-1 no longer undergoes a reduction process.

The image encoding apparatus 100 according to an embodiment of the present invention selects a depth at which the smallest encoding error occurs by comparing encoding errors for each depth to determine a coding depth for the coding unit 912. For example, a coding error of a coding unit having a depth of 0 is encoded by performing motion prediction for each division type 912, 914, 916, and 918, and then a prediction unit in which the smallest coding error occurs is determined. Similarly, prediction units having the smallest coding error may be searched for depths 0, 1, ..., d-1. In the depth d, a coding error may be determined through motion prediction based on the prediction unit 960 while being a coding unit having a size of 2N_dx2N_d. As described above, the depth with the smallest error is selected by comparing the minimum coding errors for all depths of depths 0, 1, ..., d-1, and d, and thus the coding depth may be determined. The coded depth and the prediction unit of the corresponding depth may be encoded and transmitted as information about an encoding mode. In addition, since the coding unit must be reduced from the depth 0 to the coded depth, only reduced information of the coded depth is set to '0', and reduced information for each depth except the coded depth should be set to '1'.

The encoding information extracting unit 220 of the image decoding apparatus 200 according to an embodiment of the present invention extracts information about a coding depth and a prediction unit for the coding unit 912 and uses the same to decode the coding unit 912. Can be. The image decoding apparatus 200 according to an exemplary embodiment may identify a depth of which the reduction information is '0' as an encoding depth by using the reduction information for each depth, and use the decoding information by using information about an encoding mode for the corresponding depth. have.

10A and 10B illustrate a relationship between a coding unit, a prediction unit, and a frequency transformation unit, according to an embodiment of the present invention.

The coding units 1010 are coding units according to coding depths determined by the image encoding apparatus 100 according to an embodiment with respect to the maximum coding unit 1000. The prediction unit 1060 is prediction units of coding units of respective coding depths of the coding unit 1010, and the transformation unit 1070 is transformation units of coding units of each coding depth.

If the depth-based coding units 1010 have a depth of 0, the coding units 1012 and 1054 have a depth of 1 and the coding units 1014, 1016, 1018, 1028, 1050, and 1052. ) Has a depth of 2, coding units 1020, 1022, 1024, 1026, 1030, 1032, and 1038 have a depth of 3, and coding units 1040, 1042, 1044, and 1046 have a depth of 4.

Some of the prediction units 1060 1014, 1016, 1022, 1032, 1048, 1050, 1052, and 1054 are types in which coding units are split. That is, the prediction units 1014, 1022, 1050, and 1054 are split types of 2N × N, the prediction units 1016, 1048, and 1052 are split types of N × 2N, and the prediction units 1032 are split types of N × N. That is, the prediction unit of the deeper coding units 1010 is smaller than or equal to each coding unit.

For the image data of some of the transformation units 1070 1052 and 1054, frequency conversion or frequency inverse transformation is performed in a data unit having a smaller size than the coding unit. In addition, the transformation units 1014, 1016, 1022, 1032, 1048, 1050, 1052, and 1054 are data units having different sizes or shapes when compared to the corresponding prediction unit among the prediction units 1060. That is, even if the image encoding apparatus 100 and the image decoding apparatus 200 according to an embodiment of the present invention are predicted and frequency transformed / inverse transformed for the same coding unit, they may be performed based on separate data units. Can be.

11 is a diagram of encoding information according to coding units, according to an embodiment of the present invention.

The encoding information encoder 140 of the image encoding apparatus 100 according to an embodiment of the present invention encodes encoding information for each coding unit, and extracts encoding information of the image decoding apparatus 200 according to an embodiment of the present invention. The unit 220 may extract encoding information for each coding unit.

The encoding information may include reduction information about the coding unit, split type information, prediction mode information, and transformation unit size information. The encoding information illustrated in FIG. 11 is only an example that may be set in the image encoding apparatus 100 and the image decoding apparatus 200 according to an embodiment of the present disclosure, and is not limited to the illustrated example.

The reduced information may indicate a coded depth of the corresponding coding unit. That is, since the depth that is no longer reduced according to the reduced information is a coded depth, split type information, a prediction mode, and transform unit size information may be defined for the coded depth. If it is necessary to further reduce the size according to the reduced information, encoding should be performed independently for each coding unit of the reduced four higher depths.

The split type information may indicate the split type of the transform unit of the coding unit of the coded depth as one of 2Nx2N, 2NxN, Nx2N, and NxN. The prediction mode may indicate the motion prediction mode as one of an intra mode, an inter mode, and a skip mode. Intra mode can be defined only in split type 2Nx2N and NxN, and skip mode can be defined only in split type 2Nx2N. The conversion unit size may be set to two kinds of sizes in the intra mode and two kinds of sizes in the inter mode.

For each of the minimum coding units in the coding unit, encoding information for each coding unit of the coded depth to which they belong may be stored. Therefore, when the encoding information held by the adjacent minimum coding units are respectively checked, it may be determined whether the information is included in the coding unit having the same coding depth. In addition, since the coding unit of the corresponding coding depth may be identified by using the encoding information held by the minimum coding unit, the distribution of the coded depths within the maximum coding unit may be inferred.

Hereinafter, intra prediction performed by the intra prediction unit 410 of the image encoding apparatus 100 and the intra prediction unit 550 of the image decoding apparatus 200 of FIG. 5 according to an embodiment of the present invention of FIG. 4. It demonstrates concretely. In the following description, a coding unit is a term referred to in an encoding step of an image, and a coding unit may be defined as a decoding unit in terms of a decoding step of an image. That is, the terms coding unit and decoding unit may only be different in which step is referred to in the encoding and decoding steps of the image, and the coding unit in the encoding step may be called a decoding unit in the decoding step. For the sake of unity of terminology, except in a special case, the encoding unit and the decoding unit will be uniformly called as coding units.

12 is a block diagram illustrating a configuration of an intra prediction apparatus 1200 according to an embodiment of the present invention.

Referring to FIG. 12, an intra prediction apparatus 1200 according to an embodiment of the present invention includes a predictor 1210 and a post processor 1220. The prediction unit 1210 performs intra prediction on the current coding unit by applying intra prediction modes determined according to the size of the current coding unit, and outputs the first prediction coding unit. The post-processing unit 1200 performs post-processing by changing the pixel value of each pixel of the first prediction coding unit by using the neighboring pixels of each pixel constituting the first prediction coding unit to perform the post-processing second prediction coding unit. Output

13 illustrates the number of intra prediction modes according to the size of a coding unit, according to an embodiment of the present invention.

According to an embodiment of the present invention, the number of intra prediction modes to be applied to the coding unit may be variously set according to the size of the coding unit (the decoding unit in the decoding step). As an example, referring to FIG. 13, when the size of an intra prediction coding unit is NxN, the number of intra prediction modes that are actually performed on each of coding units having a size of 2x2, 4x4, 8x8, 16x16, 32x32, 64x64, and 128x128 may be respectively. 5, 9, 9, 17, 33, 5, 5 (in the case of Example 2) can be set. The reason for differentiating the number of intra prediction modes that are actually performed according to the size of the coding unit is that the overhead for encoding the prediction mode information varies according to the size of the coding unit. In other words, although a small coding unit occupies a small portion of the entire image, overhead for transmitting additional information such as a prediction mode of the small coding unit may increase. Therefore, when a small coding unit is encoded in too many prediction modes, the bit amount may increase, thereby reducing the compression efficiency. In addition, a coding unit having a large size, for example, a coding unit having a size of 64x64 or more is generally selected as a coding unit for a flat region of an image, and thus a large size that is frequently selected for encoding such a flat region. Encoding the coding unit of in too many prediction modes may also be inefficient in terms of compression efficiency.

Therefore, according to an embodiment of the present invention, the coding unit is largely N1xN1 (2≤N1≤8, N1 is an integer), N2xN2 (16≤N2≤32, N2 is an integer), N3xN3 (64≤N3, N3 is an integer) The number of intra prediction modes to be performed for each coding unit having an N1xN1 size, A1 (A1 is a positive integer), and the number of intra prediction modes to be performed for each coding unit having an N2xN2 size. When A2 (A2 is a positive integer) and the number of intra prediction modes to be performed for each coding unit having the size of N3xN3 is A3 (A3 is a positive integer), the size of each coding unit is satisfied to satisfy the relationship A3≤A1≤A2. It is preferable to set the number of intra prediction modes to be performed according to. That is, assuming that the current picture is largely classified into a small coding unit, a medium coding unit, and a large coding unit, the medium coding unit has the largest number of prediction modes and the small coding unit. And a coding unit having a large size is preferably set to have a relatively smaller number of prediction modes. However, the present invention is not limited thereto and may have a larger number of prediction modes for smaller and larger coding units. The number of prediction modes according to the size of each coding unit illustrated in FIG. 13 is only an embodiment, and the number of prediction modes according to the size of each coding unit may be changed.

14A is a diagram illustrating an example of an intra prediction mode applied to a coding unit of a predetermined size, according to an embodiment of the present invention.

13 and 14A, for example, a vertical mode (mode 0), a horizontal mode (mode 1), and a direct current (DC) mode during intra prediction of a coding unit having a size of 4 × 4. (Mode 2), Diagonal Down-Left Mode (Mode 3), Diagonal Down-Right Mode (Mode 4), Vertical-Right Mode (Mode 5), Horizontal Down (Horizontal) -Down mode (mode 6), vertical left (Right-Left) mode (mode 7) and horizontal-up (Horizontal-Up) mode (mode 8).

14B is a diagram illustrating the directions of intra prediction modes of FIG. 14A. In FIG. 14B, the number at the end of the arrow indicates the mode value when the prediction is performed in the direction. Mode 2 is not shown here as a DC prediction mode without direction.

FIG. 14C illustrates an intra prediction method for the coding unit illustrated in FIG. 14A.

Referring to FIG. 14C, a prediction coding unit is generated using A-M which is a neighboring pixel of the current coding unit according to an available intra prediction mode determined by the size of the coding unit. For example, an operation of predictively encoding the current coding unit having a size of 4x4 according to mode 0 of FIG. 14A, that is, the vertical mode will be described. First, a pixel value of pixels A to D adjacent to a current coding unit having a 4 × 4 size is predicted as a pixel value of a 4 × 4 current coding unit. That is, the pixel A values are four pixel values included in the first column of the 4 × 4 current coding unit, and the pixel B values are four pixel values included in the second column of the 4 × 4 current coding unit. The value of C is predicted as four pixel values included in the third column of the 4x4 current coding unit, and the value of pixel D is predicted as four pixel values included in the fourth column of the 4x4 current coding unit. Next, an error value is obtained by subtracting the actual values of the 4x4 current coding unit predicted using the pixels A to D and the pixels included in the original 4x4 current coding unit, and then encoding the error value.

FIG. 15 illustrates another example of an intra prediction mode applied to a coding unit of a predetermined size, according to an embodiment of the present invention.

13 and 15, for example, in an intra prediction of a coding unit having a size of 2 × 2, a vertical mode, a horizontal mode, a direct current mode, a plane mode, and a diagonal line There may be a total of five modes of Diagonal Down-Right mode.

Meanwhile, as illustrated in FIG. 13, when a coding unit having a size of 32x32 has 33 intra prediction modes, it is necessary to set 33 intra prediction modes. According to an embodiment of the present invention, in addition to the intra prediction modes as shown in FIGS. 14 and 15, a peripheral pixel to be used as a reference pixel to be used as a reference pixel centered on pixels in a coding unit to set intra prediction modes in various directions. The prediction direction is set using the dx and dy parameters. For example, when 33 prediction modes are defined as mode N (N is an integer from 0 to 32), mode 0 is a vertical mode, mode 1 is a horizontal mode, mode 2 is a DC mode, and mode 3 is a plain mode. Mode 4 to mode31, respectively, (1, -1), (1,1), (1,2), (2,1), (1, -2), (2) as shown in Table 1 below. , 1), (1, -2), (2, -1), (2, -11), (5, -7), (10, -7), (11,3), (4,3) , (1,11), (1, -1), (12, -3), (1, -11), (1, -7), (3, -10), (5, -6), ( 7, -6), (7, -4), (11,1), (6,1), (8,3), (5,3), (5,7), (2,7), ( By using (dx, dy) represented by one of 5, -7) and (4, -3), a prediction mode having a directionality of tan ⁻¹ (dy / dx) may be defined.

mode # dx dy mode # dx dy mode 4 One -One mode 18 One -11 mode 5 One One mode 19 One -7 mode 6 One 2 mode 20 3 -10 mode 7 2 One mode 21 5 -6 mode 8 One -2 mode 22 7 -6 mode 9 2 -One mode 23 7 -4 mode 10 2 -11 mode 24 11 One mode 11 5 -7 mode 25 6 One mode 12 10 -7 mode 26 8 3 mode 13 11 3 mode 27 5 3 mode 14 4 3 mode 28 5 7 mode 15 One 11 mode 29 2 7 mode 16 One -One mode 30 5 -7 mode 17 12 -3 mode 31 4 -3 mode 0 is vertical mode, mode 1 is horizontal mode, mode 2 is DC mode, mode 3 is plain mode, and mode 32 is bi-linear mode.

The last mode 32 may be set to a bilinear mode using bilinear interpolation as described below with reference to FIG. 17.

16 is a reference diagram for explaining intra prediction modes having various directions according to an embodiment of the present invention.

As described above with reference to Table 1, intra prediction modes according to an embodiment of the present invention may have various directionalities of tan ⁻¹ (dy / dx) using a plurality of (dx, dy) parameters.

Referring to FIG. 16, an angle of tan ⁻¹ (dy / dx) determined according to values of (dx, dy) for each mode shown in Table 1 around the current pixel P to be predicted in the current coding unit is determined. Peripheral pixels A and B positioned on the extension line 150 may be used as predictors of the current pixel P. In this case, the neighboring pixel used as the predictor is preferably a pixel of the previous coding unit on the left side and the current coding unit, which has been previously encoded and reconstructed. In addition, when the extension line 160 passes between the integer position peripheral pixels instead of the peripheral pixel at the integer position, the neighboring pixel closer to the extension line 160 may be used as the predictor of the current pixel P. In addition, when there are two peripheral pixels of the upper peripheral pixel A and the left peripheral pixel B that meet the extension line 160 as shown, the upper peripheral pixel A and the left peripheral pixel B are present. ) Is used as a predictor of the current pixel P, or when the dx * dy value is positive, the upper peripheral pixel A is used, and when the dx * dy value is negative, the left peripheral pixel B is negative. Can be used.

The intra prediction modes having various directionalities as shown in Table 1 are preferably set in the encoding end and the decoding end so that only corresponding indexes of the intra prediction modes set for each coding unit are transmitted.

17 is a reference diagram for describing a bilinear mode according to an embodiment of the present invention.

Referring to FIG. 17, in the bi-linear mode, the pixel value of the current pixel P, the upper, lower, left, and right boundaries of the current pixel P within the current coding unit, and the current pixel P The geometric mean value is calculated by considering the distance to the top, bottom, left, and right edges of and used as the predictor of the current pixel P. That is, in the bilinear mode, as a predictor of the current pixel P, pixels A 171, pixel B 172, pixel D 176, and pixel E 177, which are located on the top, bottom, left and right boundaries of the current pixel P, The geometric mean value of the distance to the top, bottom, left, and right boundaries of the current pixel P is used. At this time, since the bilinear mode is also one of the intra prediction modes, the upper and left neighboring pixels that have been previously encoded and then reconstructed as reference pixels in prediction should be used. Therefore, the pixel A 161 and the pixel B use virtual pixel values generated by using the upper and left peripheral pixels instead of using the corresponding pixel values in the current coding unit as they are.

Specifically, first, by calculating the average value of the upper leftmost peripheral pixel (RightUpPixel, 174) and the left lowermost peripheral pixel (LeftDownPixel, 175) adjacent to the current coding unit, as shown in the following equation, The virtual pixel C 173 is calculated.

C = 0.5 (LeftDownPixel + RightUpPixel)

The virtual pixel A 171 positioned at the lowermost boundary when the current pixel P is extended to the lower side in consideration of the distance W1 to the left boundary of the next current pixel P and the distance W2 to the right boundary. ) Is calculated as in the following equation.

A = (C * W1 + LeftDownPixel * W2) / (W1 + W2)

Similarly, when the current pixel P is extended to the right in consideration of the distance h1 to the upper boundary of the current pixel P and the distance h2 to the lower boundary, the virtual pixel B located at the rightmost boundary line ( The value of 172 is calculated as in the following equation.

B = (C * h1 + RightUpPixel * h2) / (h1 + h2)

When the values of the virtual pixel A 171 on the lower boundary line of the current pixel P 170 and the virtual pixel B 172 on the right boundary line are determined using the above equations, the average value of A + B + D + E is determined. It can be used as a predictor of the pixel P 170. The bilinear prediction process is applied to all pixels in the current coding unit, thereby generating a prediction coding unit of the current coding unit according to the bilinear prediction mode.

According to an embodiment of the present invention, the prediction encoding is performed according to intra prediction modes that are variously set according to the size of a coding unit, thereby enabling more efficient compression according to the characteristics of an image.

As described above, the prediction coding unit output by applying the intra prediction modes that are variously set according to the size of the coding unit from the prediction unit 1210 of the intra prediction unit 1200 of FIG. 12 has a constant directionality according to the applied intra prediction mode. Has The directionality inside the prediction coding unit may improve the prediction efficiency when the pixels of the current coding unit to be encoded have a constant directionality, but may decrease the prediction efficiency when the pixels of the current coding unit do not have the directionality. Accordingly, the post-processor 1220 is a post-processing operation for the prediction coding unit generated through intra prediction and uses pixel values of each pixel in the prediction coding unit by using each pixel in the prediction coding unit and at least one peripheral pixel. By generating a new predictive coding unit to improve the prediction efficiency of the image.

Hereinafter, the post processing operation of the prediction coding unit performed by the post processing unit 1220 of FIG. 12 will be described.

The post processor 1220 changes the pixel value of each pixel constituting the first prediction coding unit by performing calculation using each pixel constituting the first prediction coding unit generated by the prediction unit 1210 and at least one neighboring pixel. To generate a second prediction coding unit. As described above, the prediction unit 1220 generates the first prediction coding unit by applying the available intra prediction modes according to the size of the coding unit.

18 is a reference diagram for explaining a post-processing operation of a first prediction coding unit according to an embodiment of the present invention. In FIG. 18, reference numerals 1810 to 1860 indicate a process of changing each pixel value in the first prediction coding unit processed by the post processor 1220 in time order.

Referring to FIG. 18, the post-processor 1220 according to an embodiment of the present invention calculates a weighted average value of pixel values of pixels to be changed in the first prediction coding unit and pixels of the neighboring pixels to determine a weighted average value of the first prediction coding unit. Change the pixel value of each pixel. For example, in FIG. 18, f [1] [1] is the pixel value of the pixel 1821 to be changed in the first prediction coding unit 1810, and f [0] is the pixel value of the pixel 1822 located above. [1] If the pixel value of the pixel 1823 located on the left is f [1] [0], the value of the pixel value f [1] [1] of the pixel 1821 is changed to f '[1] [. 1], f '[1] [1] may be calculated as in Equation 1 below.

As illustrated in FIG. 18, the post-processor 1220 according to an embodiment of the present invention may include pixels to be changed from the upper left side to the lower right side with respect to each pixel in the first prediction coding unit, and upper and lower sides thereof. The pixel value of each pixel of the first prediction coding unit is changed by calculating a weighted average value of pixels located on the left side. However, the post-processing operation of the prediction coding unit according to the present invention is not limited to the left-most side from the left-most side, but is from the right-most side to the left-most side, or from the right-most side to the left-most side, or the left-most side. From each of the pixels of the first prediction coding unit may be sequentially performed in the top-right direction. For example, when the post processor 1220 changes the pixels of the first prediction coding unit from the rightmost side to the leftmost side in the reverse order of the processing sequence illustrated in FIG. 18, the post-processing unit 1220 and the pixels positioned below and to the right of the first prediction coding unit are to be changed. The pixel value of each pixel of the first prediction coding unit is changed by calculating a weighted average of these.

19 and 20 are reference diagrams for describing an operation of the post-processing unit 1220 according to an embodiment of the present invention. In FIG. 19, reference numeral 1910 denotes a first pixel of a first prediction coding unit to be changed, and reference numerals 1911 to 1918 denote peripheral pixels located around the first pixel 1910.

Referring to FIG. 19, the post-processing unit 1220 according to an embodiment of the present invention is not limited to neighboring pixels located above and to the left of the first prediction coding unit, as shown in FIG. 18, and surrounding pixels 1911. Post processing may be performed on the first pixel 1910 using a predetermined number of peripheral pixels selected from 1918 to 1918. That is, referring to FIG. 20, a predetermined number of peripheral pixels are selected from the peripheral pixels P1 to P8 around the first pixel c of the current coding unit, and the selected peripheral pixel and the first pixel c are selected. The pixel value of the first pixel c is changed through a predetermined operation using. For example, the size of the first prediction coding unit is mxn (m and n are positive integers), the i th column (i is an integer from 0 to m-1) and j to be changed inside the first prediction coding unit, and j (j is an integer from 0 to n-1). The pixel value of the first pixel 1910 located in the th row is f [i] [j], and among the peripheral pixels 1911 to 1918 of the first pixel 1910. If the values of n pixels (n is 2 or 3) selected for post-processing of the first pixel 1910 are f1 to fn, respectively, the post-processor 1220 uses the first pixel (2) as shown in Equation 2 below. The pixel value f [i] [j] of 1910 is changed to f '[i] [j].

The post processor 1220 generates the second prediction coding unit by changing the pixel value by applying the above equation 2 to all the pixels in the first prediction coding unit 1900. In the above Equation 2, the case of using up to three peripheral pixels is illustrated. However, the present invention is not limited thereto, and the post-processor 1220 may perform post-processing operations using four or more peripheral pixels.

The post-processing unit 1220 according to the second embodiment of the present invention uses the pixels of each pixel of the first prediction coding unit through the weighted harmonic mean value of each pixel that is changed in the first prediction coding unit and pixels positioned around each pixel. The second prediction block is generated by changing the value.

For example, the post-processing unit 1220 according to the second embodiment of the present invention is located in the i-th column and the j-th row of the first prediction coding unit by using the upper and left peripheral pixels as shown in Equation 3 below. The pixel value f [i] [j] of the pixel is changed to f '[i] [j].

In Equation 3, α, β, and γ may have any positive integer values, and for example, α = 2, β = 2, and γ = 1.

The post-processing unit 1220 according to the third embodiment of the present invention changes the pixel value of each pixel of the first prediction coding unit through the weighted geometric mean value of each pixel that is changed in the first prediction coding unit and the neighboring pixels of each pixel. Thus, a second prediction coding unit is generated.

For example, the post-processor 1220 according to the third embodiment of the present invention is located in the i-th column and the j-th row of the first prediction coding unit by using the upper and left peripheral pixels as shown in Equation 4 below. The pixel value f [i] [j] of the pixel is changed to f '[i] [j].

In Equation 4, α, β, and γ may have any positive integer values, and for example, α = 1, β = 1, and γ = 2. In Equations 2 to 4, all of them are given relatively large weights to pixels f [i] [j].

As described above, in the first to third embodiments of the present invention, the post-processing unit 1220 is not limited to the upper and left peripheral pixels of the pixel to be changed, but the peripheral pixels 1911 as shown in FIG. 19. The post-processing operation may be performed using a predetermined number of peripheral pixels selected from 1918 to 1918.

The post-processing unit 1220 according to the fourth embodiment of the present invention is a pixel value of each pixel of the first prediction coding unit as an average value of one peripheral pixel selected from among pixels to be changed in the first prediction coding unit and neighboring pixels thereof. By generating the second predictive coding unit.

For example, the post-processing unit 1220 according to the fourth embodiment of the present invention uses pixels of the pixels located in the i-th column and the j-th row of the first prediction coding unit by using the upper peripheral pixel as shown in Equation 5 below. The pixel value f [i] [j] can be changed to f '[i] [j].

Similarly, the post-processing unit 1220 according to the fifth embodiment of the present invention changes the pixel value of each pixel of the first prediction code unit to an average value of pixels that are changed in the first prediction coding unit and neighboring pixels located to the left of the first prediction coding unit. Thus, a second prediction coding unit is generated.

That is, the post-processor 1220 according to the fifth embodiment of the present invention performs pixel values f [i] [j] of pixels located in the i th column and the j th row of the first prediction coding unit as shown in Equation 6 below. To f '[i] [j].

The post processor 1220 according to the sixth embodiment of the present invention generates the second prediction coding unit by changing the pixel value to a median between the pixels to be changed in the first prediction coding unit and neighboring pixels. do. For example, referring back to FIG. 19, the pixel values f [i] [j] of the first pixel 1910 located in the i-th column and the j-th row of the first prediction coding unit 1900, and the second pixel ( Pixel values f [i] [j-1] of 1912 and pixel values f [i-1] [j] of third pixel 1911 are in the following magnitude order; Assume that f [i] [j-1]> f [i-1] [j]> f [i] [j]. In this case, the post-processing unit 1220 according to the sixth embodiment of the present invention sets the pixel value f [i] [j] of the first pixel 510 to be changed to an intermediate value f [i-1] [j]. Change it.

The post-processing unit 1220 according to the seventh to ninth embodiments of the present invention uses the pixel values of adjacent coding units that are encoded before and reconstructed before the current coding unit, instead of using the neighboring pixels of the changed pixel. 2 Generate a predictive coding unit.

Referring back to FIG. 19, the post-processor 1220 according to the seventh embodiment of the present invention may include the first pixel 1910 located in the i-th column and the j-th row to be changed in the first prediction coding unit 1900. The pixel value of the first pixel 1910 is calculated as f '[i] [j] by calculating an average value of the pixel 1921 located in the same column as the upper coding unit adjacent to the current coding unit as shown in Equation 7 below. Change it.

In Equation 7, f [-1] [j] represents a pixel value of a pixel 1921 located in the same column as the first pixel 1910 and positioned in an upper neighboring coding unit of the current coding unit.

Similarly, the post processor 1220 according to the eighth embodiment of the present invention is positioned in the same row as the first pixel 1910 located in the i th column and the j th row to be changed in the first prediction coding unit 1900. The average value of the pixels 1922 located in the left neighboring coding unit of the current coding unit is calculated as shown in Equation 8 to change the pixel value of the first pixel 1910 to f '[i] [j].

In Equation 8, f [i] [-1] represents a pixel value of a pixel 1922 positioned in the same row as the first pixel 1910 and positioned in a left neighboring coding unit of the current coding unit.

The post-processor 1220 according to the ninth embodiment of the present invention may include the first pixel 1910 and the first pixel 1910 located in the i-th column and the j-th row to be changed in the first prediction coding unit 1900. The weighted average of the pixels 1921 located in the same column as the upper coding unit of the current coding unit and the pixels 1922 located in the left neighboring coding unit of the current coding unit in the same row as shown in Equation 9 below. By calculating, the pixel value of the first pixel 1910 is changed to f '[i] [j].

The post-processing unit 1220 according to the tenth embodiment of the present invention selects the pixel value f [i] [j] of the first pixel to be changed in the first prediction coding unit 1900 from the following equations 10 to 13. Change f '[i] [j] using one.

Equation 10 changes pixel values to a value gradually increasing in a downward direction in units of columns of a first prediction coding unit, and Equation 11 gradually increases pixel values to a right direction in a row unit of a first prediction coding unit. To change it to a value. Equation 12 changes each pixel value to a value gradually decreasing downward in the column unit of the first prediction coding unit, and Equation 13 gradually shifts each pixel value to the right direction in the row unit of the first prediction coding unit. Change it to a decreasing value.

라고 할 때, 다음의 수학식 14와 같이 제 1 픽셀의 픽셀값을 f'[i][j]로 변경한다.The post-processing unit 1220 according to the eleventh embodiment of the present invention performs the f [i] [j] and the pixel values of the first pixel located in the i th column and the j th row to be changed in the first prediction coding unit. 1 f [0] [0] is the pixel value of the pixel located at the leftmost top of the prediction coding unit, and f [is the pixel value of the pixel located at the top row of the first prediction coding unit, and f [ 0] [j], and the pixel value of the pixel located in the leftmost column of the first prediction coding unit in the same i-th row as the first pixel, f [i] [0],

In this case, the pixel value of the first pixel is changed to f '[i] [j] as shown in Equation 14 below.

Equation (14) is based on a kind of wave equation, which is a boundary condition between the pixel value of the leftmost column and the pixel value of the leftmost column of the first prediction coding unit in order to smooth the pixel value inside the first prediction coding. By calculating G [i] [j] and calculating the average value of G [i] [j] and f [i] [j], the pixel values of the pixels of the first prediction coding unit are changed.

As in the first to eleventh embodiments of the present invention, the costs of bitstreams encoding the second prediction coding units generated by applying various operation modes are compared to generate a second prediction coding unit having a minimum cost. The operation information used to add is added to the header area of the bitstream. When the operation information is added to the bitstream, the variable length coding scheme of allocating a small bit to the operation information that is frequently used is different based on the distribution of the operation information determined after the encoding of the predetermined number of coding units is completed. Operations can be displayed separately. For example, when an operation according to the first embodiment of the present invention is an optimal operation that generates the smallest cost in most coding units, the smallest bit is assigned to the index representing the operation according to the first embodiment. The operation according to the first embodiment may be distinguished from the operations according to the other embodiments.

On the other hand, when performing prediction by dividing a coding unit into smaller sub-coding units, a second prediction coding unit may be generated by applying a different operation to each sub-coding unit, simplifying the calculation and reducing the overhead ratio. In order to decrease, the same operation may be applied to sub-coding units included in the same coding unit.

A rate-distortion optimization method may be used as a cost for determining an optimal operation mode. Since the encoding method according to an embodiment of the present invention is applied to an intra prediction coding unit used as reference data of another coding unit, it is preferable to calculate the cost by giving a high weight to the distortion value in the rate-distortion optimization method. Do. That is, the conventional rate-distortion optimization method calculates the cost based on the distortion value and the generated bit rate, which are the difference between the encoded image and the original image, as shown in Equation 15 below.

Cost = distortion + bit-rate

In contrast, in the encoding method according to the embodiment of the present invention, it is preferable to assign the higher weight to the distortion value to determine the optimal operation mode as compared with the conventional rate-distortion optimization method as shown in Equation 16 below.

Cost = α * distortion + bit-rate (α is a real value of 2 or more)

21 is a flowchart illustrating an image encoding method according to an embodiment of the present invention.

Referring to FIG. 21, a first prediction coding unit for the current coding unit encoded in operation 2110 is generated. Here, the first prediction coding unit is an intra prediction block generated by applying a general intra prediction method and intra prediction modes having various directions according to the size of the coding unit as described above.

In operation 2120, a pixel value of each pixel of the first prediction coding unit is changed by using each pixel constituting the first prediction coding unit and at least one neighboring pixel to generate a second prediction coding unit. As described in the first to eleventh embodiments of the post-processing unit 1220, the first prediction encoding is performed by applying various operation modes to the pixels around the pixel to be changed in the first prediction coding unit. The second prediction coding unit is generated by changing the pixel value of each pixel of the unit.

In operation 2130, a bitstream is generated by transforming, quantizing, and entropy encoding a residual, which is a difference between a current coding unit and a second prediction coding unit. By adding operation information used to generate the second prediction coding unit to the predetermined region of the generated bitstream, the decoding apparatus may generate the second prediction coding unit for the current coding unit.

22 is a flowchart illustrating an image decoding method according to an embodiment of the present invention.

Referring to FIG. 22, prediction mode information of a current decoding unit decoded from a bitstream received in step 2210 is extracted.

In operation 2220, a first prediction decoding unit for the current decoding unit is generated according to the extracted prediction mode information.

In operation 2230, operation information using each pixel constituting the first prediction decoding unit and neighboring pixels of each pixel is extracted from the bitstream.

In operation 2240, the pixel value of each pixel is changed using each pixel constituting the first prediction decoding unit and neighboring pixels of each pixel according to the extracted operation information to generate a second prediction decoding unit.

In operation 2250, a residual corresponding to a difference between the current decoding unit and the second prediction decoding unit is extracted from the bitstream and reconstructed.

In operation 2260, the residual and the second prediction decoding unit are added to decode the current decoding unit.

The video encoding and decoding method according to the present invention can also be embodied as computer readable codes on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

So far I looked at the center of the preferred embodiment for the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

1 is a block diagram of an image encoding apparatus according to an embodiment of the present invention.

2 is a block diagram of an image decoding apparatus according to an embodiment of the present invention.

3 illustrates a hierarchical coding unit according to an embodiment of the present invention.

4 is a block diagram of an image encoder based on coding units, according to an embodiment of the present invention.

5 is a block diagram of an image decoder based on coding units, according to an embodiment of the present invention.

6 is a diagram of deeper coding units according to depths, and prediction units, according to an embodiment of the present invention.

7 illustrates a relationship between coding units and transformation units, according to an embodiment of the present invention.

8 illustrates encoding information according to depths, according to an embodiment of the present invention.

9 is a diagram of deeper coding units according to depths, according to an embodiment of the present invention.

10A and 10B illustrate a relationship between a coding unit, a prediction unit, and a frequency transformation unit, according to an embodiment of the present invention.

11 is a diagram of encoding information according to coding units, according to an embodiment of the present invention.

12 is a block diagram illustrating a configuration of an intra prediction apparatus 1200 according to an embodiment of the present invention.

13 illustrates the number of intra prediction modes according to the size of a coding unit, according to an embodiment of the present invention.

14A to 14C illustrate an example of an intra prediction mode applied to a coding unit having a predetermined size, according to an embodiment of the present invention.

FIG. 15 illustrates another example of an intra prediction mode applied to a coding unit of a predetermined size, according to an embodiment of the present invention.

16 is a reference diagram for explaining intra prediction modes having various directions according to an embodiment of the present invention.

17 is a reference diagram for describing a bilinear mode according to an embodiment of the present invention.

18 is a reference diagram for explaining a post-processing operation of a first prediction coding unit according to an embodiment of the present invention.

19 is a reference diagram for explaining an operation of the post-processing unit 1220 according to an embodiment of the present invention.

20 is a reference diagram for explaining peripheral pixels used in the post processor 1220 according to an exemplary embodiment.

21 is a flowchart illustrating an image encoding method according to an embodiment of the present invention.

22 is a flowchart illustrating an image decoding method according to an embodiment of the present invention.

Claims (37)

In the video encoding method, Generating a first prediction coding unit for the current coding unit to be encoded; Generating a second prediction coding unit by changing a pixel value of each pixel by using each pixel constituting the first prediction coding unit and at least one neighboring pixel; And And encoding a difference value between the current coding unit and the second prediction coding unit. The method of claim 1, Generating the first prediction coding unit Dividing the current picture into at least one coding unit based on a maximum coding unit that is a coding unit having a maximum size and a depth that is hierarchical division information of the maximum coding unit; And And generating the first prediction coding unit by performing intra prediction on the split coding unit. The method of claim 1, Generating the second prediction coding unit And encoding the second prediction coding unit by changing a value of each pixel of the first prediction coding unit through at least one neighboring pixel of the changed pixel and a weighted average value of each pixel. Way. The method of claim 3, wherein Generating the second prediction coding unit The size of the first prediction coding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction coding unit is f [i. ] [j], peripheral pixels f [i] [j-1], f [i-1] [j], f [i + 1] [j], f [i] [j + of the first pixel 1], f [i-1] [j + 1], f [i + 1] [j-1], f [i-1] [j-1], f [i + 1] [j + 1] When two neighboring pixels selected from among are called f1 and f2, the following equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image encoding method. The method of claim 3, wherein Generating the second prediction coding unit The size of the first prediction coding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction coding unit is f [i. ] [j], peripheral pixels f [i] [j-1], f [i-1] [j], f [i + 1] [j], f [i] [j + of the first pixel 1], f [i-1] [j + 1], f [i + 1] [j-1], f [i-1] [j-1], f [i + 1] [j + 1] When three neighboring pixels selected from among are called f1, f2, and f3, the following equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image encoding method. The method of claim 1, Generating the second prediction coding unit The second prediction coding unit is generated by changing a value of each pixel of the first prediction coding unit through at least one neighboring pixel of the changed pixel and a weighted harmonic mean value of each pixel. Coding method. The method of claim 6, Generating the second prediction coding unit The size of the first prediction coding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed inside the first prediction coding unit is f [ i] [j], f [i] [j-1] for the pixel value of the second pixel located to the left of the first pixel, and f [i− for the pixel value of the third pixel located above the first pixel; 1] [j], the following equation;

(α, β, γ are positive integers), wherein the pixel value of the first pixel is changed to f '[i] [j]. The method of claim 1, Generating the second prediction coding unit And changing a value of each pixel through at least one neighboring pixel of the changed pixel and a weighted geometric mean value of each pixel. The method of claim 8, Generating the second prediction coding unit The size of the first prediction coding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction coding unit is f [i. ] [j], f [i] [j-1] of pixel values of the second pixel located to the left of the first pixel, and f [i-1 of pixel values of third pixel located above the first pixel; ] [j], the following equation;

(α, β, γ are positive integers), wherein the pixel value of the first pixel is changed to f '[i] [j]. The method of claim 1, Generating the second prediction coding unit And changing the value of each pixel to an average value of at least one of the pixels located above and to the left of each pixel and the value of each pixel. The method of claim 1, Generating the second prediction coding unit And changing a value of each pixel to an intermediate value among the changed pixels and neighboring pixels of each pixel. The method of claim 1, Generating the second prediction coding unit The size of the first prediction coding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed inside the first prediction coding unit is f [ i] [j], when the pixel value of the pixel of the jth column equal to the first pixel among the pixels in the boundary region of the block adjacent to the current coding unit is f [-1] [j], Equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image encoding method. The method of claim 1, Generating the second prediction coding unit The size of the first prediction coding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction coding unit is f [i. ] [j], when the pixel value of the pixel of the i-th row equal to the first pixel among the pixels in the boundary region of the coding unit adjacent to the left of the current coding unit is f [i] [-1], Equation of;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image encoding method. The method of claim 1, Generating the second prediction coding unit The size of the first prediction coding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction coding unit is f [i. ] [j], f [-1] [j] of the pixel of the jth column equal to the first pixel among the pixels in the boundary region of the coding unit adjacent to the current coding unit, f [-1] [j] When the pixel value of the pixel of the i-th row identical to the first pixel among the pixels in the boundary region of the coding unit adjacent to the left is f [i] [-1], the following equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image encoding method. The method of claim 1, Generating the second prediction coding unit The size of the first prediction coding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction coding unit is f [i. ] [j], the following equations;

,

,

And

And the pixel value of the first pixel is changed to f '[i] [j] by using one of the following methods. The method of claim 1, Generating the second prediction coding unit The size of the first prediction coding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction coding unit is f [i. ] [j], f [0] [0], the pixel value of the pixel located on the leftmost top side of the first prediction coding unit, located in the same jth column as the first pixel and in the top row of the first prediction block. The pixel value of the located pixel is f [0] [j], and the pixel value of the pixel located in the leftmost column of the first prediction coding unit is positioned in the same i-th row as the first pixel and f [i] [0],

Suppose, the following equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using. The method of claim 1, Encoding a difference value between the current coding unit and the second prediction coding unit may include Comparing a cost of a bitstream encoded using the second prediction coding units generated through different operations, and calculating operation information used to generate the second prediction coding unit having a minimum cost, the predetermined region of the bitstream. The video encoding method further comprises the step of adding to. The method of claim 16, Encoding a difference value between the current coding unit and the second prediction coding unit may include And dividing the different operations by displaying a small number of bits in the operation information that is used in a large number, based on a distribution of operation information determined at the time of encoding a predetermined number of coding units. In the video encoding apparatus, A prediction unit generating a first prediction coding unit for the current coding unit to be encoded; A post processor configured to generate a second prediction coding unit by changing a pixel value of each pixel by using each pixel constituting the first prediction coding unit and at least one neighboring pixel; And And an encoder which encodes a difference between the current coding unit and the second prediction coding unit. In the video decoding method, Extracting prediction mode information of a current decoding unit to be decoded from the received bitstream; Generating a first prediction decoding unit for the current decoding unit according to the extracted prediction mode information; Extracting operation information using each pixel constituting the first prediction decoding unit and neighboring pixels of the pixel from the bitstream; Generating a second prediction decoding unit by changing a pixel value of each pixel using each pixel constituting the first prediction decoding unit and peripheral pixels of each pixel according to the extracted operation information; Extracting and reconstructing a residual corresponding to a difference between the current decoding unit and the second prediction decoding unit from the bitstream; And And decoding the current decoding unit by adding the residual and the second prediction decoding unit. The method of claim 20, Generating the second prediction decoding unit The second prediction decoding unit is generated by changing a value of each pixel of the first prediction decoding unit through at least one neighboring pixel of the changed pixel and a weighted average value of each pixel. Way. The method of claim 21, Generating the second prediction decoding unit The size of the first prediction decoding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction decoding unit is f [i. ] [j], peripheral pixels f [i] [j-1], f [i-1] [j], f [i + 1] [j], f [i] [j + of the first pixel 1], f [i-1] [j + 1], f [i + 1] [j-1], f [i-1] [j-1], f [i + 1] [j + 1] When two neighboring pixels selected from among are called f1 and f2, the following equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image decoding method. The method of claim 21, Generating the second prediction decoding unit The size of the first prediction decoding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction decoding unit is f [i. ] [j], peripheral pixels f [i] [j-1], f [i-1] [j], f [i + 1] [j], f [i] [j + of the first pixel 1], f [i-1] [j + 1], f [i + 1] [j-1], f [i-1] [j-1], f [i + 1] [j + 1] When the three peripheral pixels selected from among are called f1, f2, and f3, the following equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image decoding method. The method of claim 20, Generating the second prediction decoding unit The second prediction decoding unit is generated by changing a value of each pixel of the first prediction decoding unit through at least one neighboring pixel of the changed pixel and a weighted harmonic mean value of each pixel. Decryption method. The method of claim 24, Generating the second prediction decoding unit The size of the first prediction decoding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction decoding unit is f [i. ] [j], f [i] [j-1] of pixel values of the second pixel located to the left of the first pixel, and f [i-1 of pixel values of third pixel located above the first pixel; ] [j], the following equation;

(α, β, and γ are positive integers), wherein the pixel value of the first pixel is changed to f '[i] [j]. The method of claim 20, Generating the second prediction decoding unit The second prediction coding unit is generated by changing a value of each pixel of the first prediction coding unit through at least one neighboring pixel of the changed pixel and a weighted geometric mean value of each pixel. Decryption method. The method of claim 26, Generating the second prediction decoding unit The size of the first prediction decoding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction decoding unit is f [i. ] [j], f [i] [j-1] of pixel values of the second pixel located to the left of the first pixel, and f [i-1 of pixel values of third pixel located above the first pixel; ] [j], the following equation;

(α, β, and γ are positive integers), wherein the pixel value of the first pixel is changed to f '[i] [j]. The method of claim 20, Generating the second prediction decoding unit And changing the value of each pixel to an average value of at least one of the pixels located above and to the left of each pixel and the value of each pixel. The method of claim 20, Generating the second prediction decoding unit And changing a value of each pixel to an intermediate value among the changed pixels and neighboring pixels of each pixel. The method of claim 20, Generating the second prediction decoding unit The size of the first prediction decoding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction decoding unit is f [i. ] [j], when the pixel value of the pixel of the jth column equal to the first pixel among the pixels in the boundary region of the decoding unit adjacent to the current decoding unit is f [-1] [j], Equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image decoding method. The method of claim 20, Generating the second prediction decoding unit The size of the first prediction decoding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction decoding unit is f [i. ] [j], when the pixel value of the pixel of the i-th row equal to the first pixel among the pixels in the boundary region of the decoding unit adjacent to the left of the current decoding unit is f [i] [-1], Equation of;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image decoding method. The method of claim 20, Generating the second prediction decoding unit The size of the first prediction decoding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction decoding unit is f [i. ] [j], f [-1] [j] of the pixel of the jth column equal to the first pixel among the pixels of the boundary region of the decoding unit adjacent to the upper side of the current decoding unit, and When the pixel value of the pixel of the i th row identical to the first pixel among the pixels in the boundary region of the decoding unit adjacent to the left is f [i] [-1], the following equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using a second image decoding method. The method of claim 20, Generating the second prediction decoding unit The size of the first prediction decoding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction decoding unit is f [i. ] [j], the following equations;

,

,

And

And the pixel value of the first pixel is changed to f '[i] [j] by using one of the following methods. The method of claim 20, Generating the second prediction decoding unit The size of the first prediction decoding unit is mxn (m and n are positive integers), and the pixel value of the first pixel located in the i th column and the j th row to be changed in the first prediction decoding unit is f [i. ] [j], the pixel value of the pixel located at the leftmost top of the first prediction decoding unit, f [0] [0], is located in the same jth column as the first pixel, and is the top row of the first prediction decoding unit The pixel value of the pixel located at is f [0] [j], and the pixel value of the pixel located at the leftmost column of the first prediction decoding unit at the same i th row as the first pixel is f [i] [0]. ,

Suppose, the following equation;

And the pixel value of the first pixel is changed to f '[i] [j] by using. In the video decoding apparatus, An entropy decoder for extracting prediction mode information of a current decoding unit decoded from a received bitstream and operation information using each pixel constituting a first prediction decoding unit for the current decoding unit and neighboring pixels of the pixel; A prediction unit generating the first prediction decoding unit according to the extracted prediction mode information; A post processor configured to generate a second prediction decoding unit by changing a pixel value of each pixel using each pixel constituting the first prediction decoding unit and peripheral pixels of each pixel according to the extracted operation information; An inverse transform and inverse quantizer for restoring a residual corresponding to a difference between the current decoding unit and the second prediction decoding unit from the bitstream; And And an adder configured to add the residual and the second prediction decoding unit to decode the current decoding unit. 19. A recording medium on which a computer executable program code for executing the video encoding method according to any one of claims 1 to 18 is recorded. A recording medium on which computer-executable program code for executing the video decoding method according to any one of claims 20 to 34 is recorded.

Images