JP2018535607A - Method and apparatus for encoding / decoding video - Google Patents

Abstract

  Determining a data unit for intra prediction from a video picture, predicting the data unit according to a first intra prediction type predicted using predetermined prediction information, or using a data unit adjacent to the data unit Obtaining intra-prediction type information indicating whether to predict using a second intra-prediction type to be predicted, a first data unit predicted by the first intra-prediction type based on the intra-prediction type information, and a second Determining a second data unit to be predicted by the intra prediction type, generating a first prediction value related to the first data unit by the first intra prediction type using the prediction information, and adjacent to the data unit A step of generating a second predicted value related to the second data unit according to the second intra prediction type using the data unit. Video decoding method comprising is provided.

Description

  The present invention relates to encoding or decoding video using various data units included in the video.

  Video data is encoded by a codec according to a predetermined data compression standard, for example, the MPEG (Moving Picture Experts Group) standard, and then stored in a recording medium in a bit stream form or transmitted via a communication channel. Or

  With the development and popularization of hardware that can play and store high-resolution or high-quality video content, the need for codecs that effectively encode or decode high-resolution or high-quality video content is increasing. . The encoded video content is reproduced by being decoded. Recently, a method for effectively compressing such high-resolution or high-quality video content has been implemented. For example, an efficient video compression method is implemented through a process of processing a video to be encoded by an arbitrary method.

  In order to compress a video, various data units are used, and an inclusive relationship exists between such data units. In order to determine the size of the data unit used for video compression, the data unit is divided by various methods, and the optimized data unit is determined according to the characteristics of the video. Or decoding.

  In the case of the conventional compression method, the compression order is advanced from the upper left end to the lower right end, and when performing intra prediction, prediction is performed using only the encoded values of the left and upper ends. In this case, since the entire area is predicted with the left and upper end values, there is a problem that the prediction accuracy of the right and lower end areas is lowered.

  In a video decoding method according to an embodiment, determining a data unit for intra prediction from a video picture, predicting a data unit from a bitstream using a first intra prediction type for predicting data using predetermined prediction information. Or obtaining intra prediction type information indicating whether to predict using a second intra prediction type that is predicted using a data unit adjacent to the data unit, based on intra prediction type information acquired from the bitstream Determining a first data unit predicted by the first intra prediction type and a second data unit predicted by the second intra prediction type, and using the predetermined prediction information, the first data unit predicted by the first intra prediction type Generating a first predicted value for one data unit and adjacent to the data unit Using data units, a video decoding method comprising the step of generating a second prediction value according to the second data unit by the second intra prediction type is provided.

  In the video encoding method according to an embodiment, a second intra prediction is predicted using a first data unit based on a first intra prediction type that is predicted using predetermined prediction information and a data unit adjacent to the second data unit. Determining a second data unit according to a type, generating a first predicted value related to the first data unit according to a first intra prediction type using predetermined prediction information, and using a data unit adjacent to the data unit. Generating a second prediction value related to the second data unit according to the second intra prediction type, and a bit including coding information determined based on at least one of the first prediction value and the second prediction value A method of encoding a video picture by generating a stream is provided, wherein the bitstream includes predetermined prediction information.

  In a video decoding apparatus according to an embodiment, a data unit determination unit that determines a data unit for intra prediction from a video picture, and a first intra prediction type that predicts a data unit from a bitstream using predetermined prediction information Or a bitstream acquisition unit that acquires intra prediction type information indicating whether to predict using a second intra prediction type that is predicted using a data unit adjacent to the data unit, or obtained from the bitstream. The first data unit predicted by the first intra prediction type and the second data unit predicted by the second intra prediction type are determined based on the intra prediction type information, and the predetermined prediction information is used to determine the first data unit. A first prediction value related to the first data unit according to one intra prediction type is generated. Using data units adjacent to the data unit, the video decoding apparatus is provided including a decoder for generating a second prediction value according to the second data unit by the second intra prediction types.

  In the video encoding apparatus according to the embodiment, the second intra prediction is predicted using the first data unit based on the first intra prediction type that is predicted using the predetermined prediction information and the data unit adjacent to the second data unit. A data unit determining unit that determines a second data unit according to a type, and using a predetermined prediction information, generates a first prediction value related to the first data unit according to a first intra prediction type, and selects a data unit adjacent to the data unit. A bit including encoding information generated based on at least one of the first predicted value and the second predicted value by generating a second predicted value related to the second data unit using the second intra prediction type A bit stream generation unit that generates a stream and encodes a video picture, and an encoding unit, and the bit stream includes a video code including predetermined prediction information. Apparatus is provided.

  By expanding the available reference values, it is possible to use data units that are adaptive to the characteristics of the video, thereby enabling efficient video encoding and decoding, and the quality of the restored video. Improvement is possible.

1 is a block diagram of a video decoding apparatus capable of decoding video based on at least one of block configuration information and division configuration information according to an embodiment. 1 is a block diagram of a video encoding apparatus capable of encoding a video based on at least one of block configuration information and division configuration information according to an embodiment. 4 is a diagram illustrating a process of determining a first data unit predicted by a first intra prediction type and a second data unit predicted by a second intra prediction type according to an embodiment. 6 is a diagram illustrating a process of predicting a first data unit according to a first intra prediction type based on predetermined prediction information according to an exemplary embodiment. 6 is a diagram illustrating a process of predicting a second data unit according to a second intra prediction type that predicts using adjacent data units according to an exemplary embodiment. 6 is a diagram illustrating a process of predicting a second data unit according to a second intra prediction type predicted using a data unit adjacent to a left side and an upper end and a data unit adjacent to a right side and a lower end according to an exemplary embodiment. . 4 is a diagram illustrating a process of determining a first intra prediction type and a second intra prediction type for a data unit according to an embodiment. 5 is a flowchart of a video decoding method using intra prediction type information according to an embodiment. 4 is a flowchart of a video encoding method using intra prediction type information according to an embodiment. According to an embodiment, when the non-square-shaped second coding unit determined by dividing the first coding unit satisfies a predetermined condition, the form in which the second coding unit is divided is limited. It is drawing to illustrate. 6 is a diagram illustrating a process of dividing a square-shaped coding unit when the division pattern information cannot indicate that it is divided into four square-shaped coding units according to an exemplary embodiment. 6 is a diagram illustrating a processing order between a plurality of encoding units according to an embodiment, which may vary according to a division process of the encoding units. According to an embodiment, when a coding unit is recursively divided to determine a plurality of coding units, a process of determining a coding unit depth by changing a shape and size of the coding unit. It is drawing to illustrate. 6 is a diagram illustrating a depth and an index (PID) for a coding unit partition determined by a coding unit type and size according to an exemplary embodiment; 6 is a diagram illustrating a plurality of encoding units determined by a plurality of predetermined data units included in a picture according to an exemplary embodiment. 6 is a diagram illustrating a processing block serving as a reference for determining a determination order of reference coding units included in a picture according to an exemplary embodiment. 6 is a diagram illustrating a coding unit determined for each picture when combinations of modes in which the coding unit is divided are different for each picture according to an embodiment. 4 is a diagram illustrating various forms of a coding unit determined based on partition form information represented by a binary code according to an exemplary embodiment. 6 is a diagram illustrating another form of a coding unit determined based on division form information expressed in binary code according to an embodiment. 1 is a block diagram of a video encoding / decoding system that performs loop filtering. FIG. 6 is a diagram illustrating an example of a filtering unit included in a maximum coding unit and filtering performance information of the filtering unit according to an embodiment. 6 is a diagram illustrating a process of merging or splitting between coding units determined by a predetermined coding method according to an embodiment. 6 is a diagram illustrating an index according to a Z-scan order of encoding units according to an exemplary embodiment. 2 is a diagram illustrating reference samples for intra prediction of a coding unit according to an embodiment.

  The advantages, features, and methods of achieving the same of the present invention will become apparent with reference to the embodiments described in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, and may be embodied in various forms different from each other. However, the present embodiments complete the disclosure of the present invention, and It is provided to provide those skilled in the art with full knowledge of the scope of the invention.

  The terms used in this specification will be briefly described, and the present invention will be specifically described.

  The terms used in the present invention have been selected as general terms that are currently widely used as much as possible in view of the functions of the present invention, but they are not intended by those skilled in the relevant arts. It depends on the appearance of technology. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in that case, the meaning is described in detail in the explanation part of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms, not the simple term names, and the contents of the present invention in general.

  As used herein, the singular forms include the plural unless the context clearly dictates otherwise.

  Throughout the specification, when a part “includes” a component, it does not exclude other components and may further include other components unless specifically stated to the contrary. It means that. Further, the term “part” used in the specification means a hardware component such as a software component, a field-programmable gate array (FPGA) or an application specific integrated circuit (ASIC). Play a role. However, the “unit” is not limited to software or hardware. The “part” is also configured to be in a recording medium that can be addressed, but is also configured to play back one or more processors. Thus, by way of example, “parts” are software components, object-oriented software components, components such as class components and task components, as well as processes, functions, attributes, procedures, subroutines, program code segments, drivers. , Firmware, microcode, circuits, data, databases, data structures, tables, arrays and variables. The functions provided among the components and “parts” may be combined into a smaller number of components and “parts”, or may be further separated into further components and “parts”.

  Hereinafter, “video” can be a static image, such as a still video of a video, or a dynamic image, such as a video, ie, the video itself.

  Hereinafter, “sample” is data assigned to a sampling position of a video and means data to be processed. For example, the pixel value in the image in the spatial domain and the conversion coefficient on the conversion domain are also samples. Such a unit including at least one sample can be defined as a block.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the embodiments of the present invention. In the drawings, portions that are not related to the description are omitted in order to clearly describe the present invention.

  FIG. 1 illustrates a block diagram of a video decoding apparatus 100 capable of decoding a video based on at least one of block form information and division form information according to an embodiment.

  Referring to FIG. 1, according to an embodiment, the video decoding apparatus 100 performs prediction using a predetermined prediction information from a data unit determining unit 110 that determines a data unit for intra prediction from a video picture, and a bit stream. A bitstream acquisition unit 120 that acquires intra prediction type information indicating whether to perform prediction based on a first intra prediction type to be predicted or prediction based on a second intra prediction type that is predicted using a data unit adjacent to the data unit. Determining a first data unit predicted by the first intra prediction type and a second data unit predicted by the second intra prediction type based on the acquired intra prediction type information, and using the predetermined prediction information Generating a first predicted value related to the first data unit according to the first intra prediction type, Using data units adjacent to the position, it may include a decoding unit 130 for generating a second prediction value according to the second data unit by the second intra prediction types. When the intra prediction type information is acquired in the bitstream acquisition unit 120 of the video decoding device 100 according to an embodiment, the decoding unit 130 of the video decoding device 100 performs the first intra prediction type based on the intra prediction type information. The first predicted value related to the first data unit can be generated.

  According to an embodiment, the data unit determination unit 110 of the video decoding device 100 may determine a data unit for intra prediction. For example, the data unit may be one of a coding unit, a prediction unit, or a transform unit.

  According to an exemplary embodiment, the bitstream acquisition unit 120 of the video decoding apparatus 100 may predict whether the determined data unit is predicted based on the first intra prediction type or the second intra prediction type. Type information can be acquired. Prediction based on the first intra prediction type is to perform intra prediction using other information that is not a peripheral data unit. Prediction based on the second intra prediction type is to perform intra prediction using peripheral data units.

  According to an embodiment, the decoding unit 130 of the video decoding device 100 may generate a first prediction value related to a first data unit according to the first intra prediction type based on the intra prediction type information. The decoding unit 130 can generate a second predicted value related to the second data unit according to the second intra prediction type. For example, the decoding unit 130 may generate the prediction value using the left and upper data units or the right and lower data units among the data units adjacent to the second data unit.

  FIG. 3 illustrates a process of determining a first data unit predicted by a first intra prediction type and a second data unit predicted by a second intra prediction type according to an embodiment.

  According to an embodiment, the decoding unit 130 determines the first data unit 310 predicted by the first intra prediction type and the second data unit 320 predicted by the second intra prediction type based on the intra prediction type information. can do. For example, it is determined whether the predicted data unit is predicted using the peripheral data unit or whether the predicted data unit is predicted using other information that is not information related to the peripheral data unit.

  According to an exemplary embodiment, the decoding unit 130 may predict a data unit using other information that is not information related to a peripheral data unit. For example, the decoding unit 130 may perform prediction using a specified value stored in a slice header, a PPS (picture parameter set), or an SPS (sequence parameter set). For example, a predetermined value can be assigned in advance for each area in the data unit.

  Referring to FIG. 3, when the decoding unit 130 performs prediction for the first data unit 310 according to the first intra prediction type, the decoding unit 130 predicts for the second data unit 320 according to the second intra prediction type. It can be performed. For example, the prediction for the second data unit 320 is performed using information related to the first data unit 310 predicted by the first intra prediction type. For example, the second data unit 320 is predicted using at least one of data units adjacent to the right side or the lower end.

  According to an exemplary embodiment, the decoding unit 130 may generate a predicted value of the second data unit 320 using an average value of sample values of the first data unit 310 adjacent to the second data unit 320. Alternatively, for the right prediction sample in the second data unit 320, the decoding unit 130 generates a prediction value using the sample value of the first data unit adjacent to the right side, and lower end prediction in the second data unit 320. About a sample, a predicted value can be produced | generated using the sample value of the 1st data unit adjacent to a lower end.

  According to an embodiment, the decoding unit 130 may generate a prediction value for a prediction sample in the second data unit 320 based on a relative directionality with an adjacent data unit. For example, the decoding unit 130 can generate a predicted value of the second data unit 320 by applying a weight value for the relative distance to the sample value.

  According to an embodiment, the decoding unit 130 generates a prediction value of the second data unit 320 using the reference sample of the first data unit adjacent to the right side and the reference sample of the second data unit adjacent to the upper end. be able to. For example, the decoding unit 130 may apply the same Intra_angular mode to the reference samples of the first data unit and the second data unit that are predicted by different intra prediction types, and generate a prediction value of the data unit to be predicted. it can. For example, even if the same Intra_angular mode is applied, the decoding unit 130 performs weighting according to the type of reference sample, that is, whether the reference sample is the first data unit or the second data unit. The value can be applied to generate a predicted value in data units.

  FIG. 4 illustrates a process of predicting a first data unit according to a first intra prediction type based on predetermined prediction information according to an embodiment.

  According to an embodiment, the decoding unit 130 may predict the first data unit 420 predicted by the first intra prediction type using other information that is not information related to the peripheral data unit. For example, the first data unit 420 is also predicted by using the sample value 410 adjacent to the upper layer data unit in which the first data unit 420 is included. A sample value 410 adjacent to an upper layer data unit including the first data unit 420 includes information about pixels around a CTU (coding tree unit) boundary or information about pixels around a CU (coding unit) boundary. May be included. When prediction is performed using information related to pixels around the CTU boundary, the prediction target unit may be a CU, a PU (prediction unit), a TU (transform unit), or a CTU. When prediction is performed using information related to neighboring pixels at the CU boundary, the prediction target unit is also PU, TU, or CU.

  According to an exemplary embodiment, the decoding unit 130 generates a predicted value of the first data unit 420 using an average value of the sample values 410 of the reference samples adjacent to the upper-layer data unit including the first data unit 420. be able to. For example, the decoding unit 130 may perform filtering on a sample adjacent to a data unit in an upper layer in order to remove discontinuity from the first data unit 420 reference sample. For example, the decoding unit 130 may apply different filters to the upper left sample and the left sample or the right sample of the upper layer data unit.

  According to an exemplary embodiment, the decoding unit 130 may apply the intra_angular mode based on a relative direction with a reference sample adjacent to a data unit of an upper layer including the first data unit 420 to obtain a predicted value. Can be generated. In addition, for example, the decoding unit 130 can generate a predicted value of the first data unit 420 by applying a weight value related to the relative distance to the sample value.

  FIG. 5 illustrates a process of predicting a second data unit according to a second intra prediction type that predicts using adjacent data units according to an exemplary embodiment.

  According to an exemplary embodiment, the decoding unit 130 may perform prediction using a second intra prediction type using a data unit adjacent to the data unit. For example, when prediction is performed on the data unit 510, information 511 related to the data unit 530 encoded by the first intra prediction type adjacent to the lower end of the data unit 510 can be used. For example, when performing prediction on the data unit 520, the information 521 related to the data unit 530 encoded by the first intra prediction type adjacent to the right side of the data unit 520 can be used.

  According to an exemplary embodiment, the decoding unit 130 may perform prediction using the left and upper sample values when the distance between the left and upper ends is short depending on the position of the predicted sample in the data unit 510. Alternatively, according to an exemplary embodiment, the decoding unit 130 may perform prediction using the right and bottom sample values when the distance between the right side and the bottom end is short depending on the predicted pixel position in the data unit 510.

  According to an embodiment, the decoding unit 130 may generate a predicted value of the data unit 510 with an average value of the peripheral reference samples of the data unit 510. For example, the decoding unit 130 uses the average value of the reference sample adjacent to the left side and the reference sample adjacent to the upper end, the reference sample adjacent to the lower end, and the average value of the reference sample adjacent to the right side, to a data unit. The predicted value of the reference sample in can be generated. For example, the decoding unit 130 may apply a weight value related to the distance between the prediction sample in the data unit 510 and the peripheral reference sample to each average value to generate a prediction value of the prediction sample in the data unit. .

  According to an embodiment, the decoding unit 130 may generate a prediction value of a prediction sample in consideration of the data unit 510 and the directionality of the data unit peripheral reference sample. A method for considering the data unit 510 and the directionality of the data unit peripheral reference sample will be described later with reference to FIG.

  According to an embodiment, the decoding unit 130 may use one reference sample among reference samples adjacent to the prediction sample in the data unit 520 as a prediction sample value for one row. For example, the decoding unit 130 can use one reference sample among the reference samples adjacent to the lower end of the data unit 510 as a predicted sample value for the entire row in the data unit 520 in the vertical direction. For example, the decoding unit 130 may use one reference sample among reference samples adjacent to the right side of the data unit 520 as a predicted sample value for the entire horizontal row in the data unit 520.

  FIG. 6 illustrates a process of predicting a second data unit according to a second intra prediction type using a data unit adjacent to a left side and an upper end and a data unit adjacent to a right side and a lower end according to an embodiment. To do.

  Referring to FIG. 6, when generating the second prediction value related to the second data unit according to the second intra prediction type, the decoding unit 130 uses at least one of the left data unit and the upper data unit, Predicted values can be generated. Alternatively, the decoding unit 130 can generate a prediction value using at least one of the right data unit and the lower data unit. The decoding unit 130 interpolates a prediction value generated using at least one of the left data unit and the upper data unit in a bi-linear manner according to the distance using the same prediction mode 631. A new predicted value 611 can be generated.

  According to an embodiment, the decoding unit 130 generates the prediction value 621 using at least one of the right data unit and the lower data unit based on the new prediction mode 642 in addition to the existing prediction mode 641. Can do. For example, in the existing 35 prediction modes 640, the decoding unit 130 uses the new 67 prediction modes 640 obtained by adding 32 prediction modes, and uses the sample values adjacent to the right and bottom data units. can do.

  According to an exemplary embodiment, the decoding unit 130 may generate a prediction value generated using at least one of the left data unit and the upper data unit, and at least one of the right data unit and the lower data unit. Filtering can be performed on the predicted value to reduce the boundary portion. For example, the decoding unit 130 may perform filtering to remove discontinuity between adjacent samples and prediction samples that are not referenced in the two modes.

  FIG. 7 illustrates a process of determining a first intra prediction type and a second intra prediction type for a data unit according to an embodiment.

  According to one embodiment, the decoding unit 130 generates a prediction value according to the first intra prediction type for each CU, PU, or TU based on the intra prediction type information, or predicts according to the second intra prediction type. It can be decided whether to generate a value.

  According to an embodiment, the decoding unit 130 may determine to perform prediction based on the first intra prediction type for the Intra_DC mode, and to perform prediction based on the second intra prediction type for other modes besides the Intra_DC mode. it can.

  According to an embodiment, the decoding unit 130 acquires a flag indicating whether the data unit is classified as one of the first data unit and the second data unit, and the acquired flag is the first data unit. When it is indicated that the data unit is classified into one of the data unit and the second data unit, a prediction value for the data unit can be generated according to the first intra prediction type or the second intra prediction type.

  FIG. 8 illustrates a flowchart of a video decoding method using intra prediction type information according to an embodiment.

  In step S810, the data unit determination unit 110 of the video decoding apparatus 100 can determine a data unit for intra prediction from a video picture.

  In step S820, the bitstream acquisition unit 120 of the video decoding apparatus 100 predicts a data unit from the bitstream using a first intra prediction type that is predicted using predetermined prediction information, or is adjacent to the data unit. It is possible to acquire intra prediction type information indicating whether to predict using the second intra prediction type that is predicted using a data unit.

  In step S830, the decoding unit 130 of the video decoding apparatus 100 performs prediction based on the first intra prediction type and the second intra prediction type based on the intra prediction type information acquired from the bitstream. The second data unit to be performed can be determined.

  In step S840, the decoding unit 130 of the video decoding apparatus 100 may generate a first prediction value related to a first data unit according to a first intra prediction type using predetermined prediction information.

  In step S850, the decoding unit 130 of the video decoding apparatus 100 may generate a second predicted value related to the second data unit according to the second intra prediction type using a data unit adjacent to the data unit.

  FIG. 10 illustrates that, according to an embodiment, the video decoding apparatus 100 may use the second coding unit when the non-square second coding unit determined by dividing the first coding unit 1000 satisfies a predetermined condition. It is illustrated that the form in which is divided is limited.

  According to an embodiment, the decoding unit 130 may convert the square-shaped first coding unit 1000 into a non-square shape based on at least one of the block form information and the division form information acquired through the bitstream acquisition unit 120. Can be determined to be divided into second encoding units 1010a, 1010b, 1020a, and 1020b. The second coding units 1010a, 1010b, 1020a, 1020b are divided even if they are independent. Accordingly, the decoding unit 130 may divide into a plurality of coding units based on at least one of block form information and division form information related to the second coding units 1010a, 1010b, 1020a, and 1020b, or It can be decided not to divide. According to an exemplary embodiment, the decoding unit 130 may horizontally divide the second non-square second coding unit 1010a determined by dividing the first coding unit 1000 in the vertical direction, and may perform third coding unit 1012a. , 1012b can be determined. However, when the decoding unit 130 divides the left second coding unit 1010a in the horizontal direction, the right second coding unit 1010b has the same horizontal direction as the left second coding unit 1010a. It can be limited so that it is not divided. If the right second coding unit 1010b is divided in the same direction and the third coding units 1014a and 1014b are determined, the left second coding unit 1010a and the right second coding unit 1010b are independent in the horizontal direction. Thus, the third encoding units 1012a, 1012b, 1014a, and 1014b are determined. However, the decoding unit 130 converts the first coding unit 1000 into four square-shaped second coding units 1030a, 1030b, 1030c, and 1030d based on at least one of the block form information and the division form information. This is the same result as the division, which is inefficient on the video decoding side.

  According to one embodiment, the decoding unit 130 divides the second encoding unit 1020a or 1020b having a non-square shape determined by dividing the first coding unit 900 in the horizontal direction in the vertical direction, and performs third coding. Units 1022a, 1022b, 1024a, and 1024b can be determined. However, when the decoding unit 130 divides one of the second coding units (for example, the upper-end second coding unit 1020a) in the vertical direction, the decoding unit 130 has another second coding unit (for example, The lower end coding unit 1020b) may be limited so that it is not divided in the vertical direction in the same direction as the upper end second coding unit 1020a is divided.

  FIG. 11 illustrates a process in which the video decoding apparatus 100 divides a square-shaped coding unit when the division-type information cannot indicate that it is divided into four square-shaped coding units according to an embodiment. Illustrated.

  According to an embodiment, the decoding unit 130 divides the first coding unit 1100 based on at least one of the block form information and the division form information, and obtains the second coding units 1110a, 1110b, 1120a, 1120b, and the like. Can be determined. The division form information may include information related to various forms in which the coding unit is divided, but the information related to various forms includes the information for dividing into four square-shaped coding units. Information may not be included. According to such division form information, the decoding unit 130 cannot divide the square first coding unit 1100 into four square second coding units 1130a, 1130b, 1130c, and 1130d. . Based on the division form information, the decoding unit 130 can determine non-square second coding units 1110a, 1110b, 1120a, 1120b, and the like.

  According to an embodiment, the decoding unit 130 may divide the non-square second encoding units 1110a, 1110b, 1120a, 1120b, and the like independently. Through a recursive method, the second coding units 1110a, 1110b, 1120a, 1120b, etc. are each divided in a predetermined order, which is based on at least one of block form information and division form information. It is also a division method similar to the method in which the unit 1100 is divided.

  For example, the decoding unit 130 may determine the third encoding units 1112a and 1112b having a square shape by dividing the left second encoding unit 1110a in the horizontal direction, and the right second encoding unit 1110b in the horizontal direction. Divided and square third encoding units 1114a and 1114b can be determined. Furthermore, the decoding unit 130 divides the left second encoding unit 1110a and the right second encoding unit 1110b in the horizontal direction, and determines square third encoding units 1116a, 1116b, 1116c, and 1116d. You can also. In such a case, the coding unit is determined in the same form as when the first coding unit 1100 is divided into four square-shaped second coding units 1130a, 1130b, 1130c, and 1130d.

  As another example, the decoding unit 130 may determine the square third encoding units 1122a and 1122b by dividing the upper end second encoding unit 1120a in the vertical direction, and the lower end second encoding unit. 1120b is divided in the vertical direction, and square third coding units 1124a and 1124b can be determined. Further, the decoding unit 130 divides the upper-end second encoding unit 1120a and the lower-end second encoding unit 1120b in the vertical direction, and determines square-shaped third encoding units 1122a, 1122b, 1124a, and 1124b. You can also. In such a case, the coding unit is determined in the same form as when the first coding unit 1100 is divided into four square-shaped second coding units 1130a, 1130b, 1130c, and 1130d.

  FIG. 12 illustrates that the processing order between a plurality of coding units may vary depending on the process of dividing the coding units according to an embodiment.

  According to an embodiment, the decoding unit 130 may divide the first coding unit 1200 based on the block form information and the division form information. When the block form information indicates a square shape and the division form information indicates that the first coding unit 1200 is divided in at least one of a horizontal direction and a vertical direction, the decoding unit 130 may For example, the second encoding unit 1210a, 1210b, 1220a, 1220b, 1230a, 1230b, 1230c, and 1230d may be determined by dividing the encoding unit 1200. Referring to FIG. 12, the non-square-shaped second coding units 1210a, 1210b, 1220a, and 1220b determined by dividing the first coding unit 1200 in only the horizontal direction or the vertical direction are related to each other. Based on the block form information and the division form information, it is divided even independently. For example, the decoding unit 130 divides the second coding units 1210a and 1210b generated by dividing the first coding unit 1200 in the vertical direction in the horizontal direction, and generates third coding units 1216a, 1216b, 1216c, 1216d can be determined, and the second encoding units 1220a and 1220b generated by dividing the first encoding unit 1200 in the horizontal direction are respectively divided in the horizontal direction to obtain third encoding units 1226a, 1226b, and 1226c. , 1226d can be determined. Since the division process of the second coding units 1210a, 1210b, 1220a, and 1220b has been described with reference to FIG. 10, detailed description thereof will be omitted.

  According to an embodiment, the decoding unit 130 may process the coding units in a predetermined order. Since the features related to the processing of the coding units in the predetermined order have been described with reference to FIG. 7, detailed description thereof will be omitted. Referring to FIG. 12, the decoding unit 130 divides the square-shaped first coding unit 1200 into four square-shaped third coding units 1216a, 1216b, 1216c, 1216d, 1226a, 1226b, 1226c, 1226d can be determined. According to one embodiment, the decoding unit 130 determines the processing order of the third coding units 1216a, 1216b, 1216c, 1216d, 1226a, 1226b, 1226c, and 1226d according to the form in which the first coding unit 1200 is divided. Can do.

  According to an embodiment, the decoding unit 130 divides the second coding units 1210a and 1210b generated by dividing in the vertical direction in the horizontal direction, and determines third coding units 1216a, 1216b, 1216c, and 1216d. The decoding unit 130 first processes the third coding units 1216a and 1216b included in the left second coding unit 1210a in the vertical direction, and then performs the third coding included in the right second coding unit 1210b. The third encoding units 1216a, 1216b, 1216c, and 1216d can be processed according to the order (1217) of processing the units 1216c and 1216d in the vertical direction.

  According to an embodiment, the decoding unit 130 divides the second coding units 1220a and 1220b generated by dividing in the horizontal direction in the vertical direction, and determines third coding units 1226a, 1226b, 1226c, and 1226d. The decoding unit 130 first processes the third coding units 1226a and 1226b included in the upper end second encoding unit 1220a in the horizontal direction, and then performs the third encoding included in the lower end second encoding unit 1220b. The third encoding units 1226a, 1226b, 1226c, and 1226d can be processed according to the order (1227) in which the units 1226c and 1226d are processed in the horizontal direction.

  Referring to FIG. 12, the second encoding units 1210a, 1210b, 1220a, and 1220b are respectively divided, and square-shaped third encoding units 1216a, 1216b, 1216c, 1216d, 1226a, 1226b, 1226c, and 1226d are determined. The The second coding units 1210a and 1210b determined by being divided in the vertical direction and the second coding units 1220a and 1220b determined by being divided in the horizontal direction are divided into different forms. According to the third coding units 1216a, 1216b, 1216c, 1216d, 1226a, 1226b, 1226c, and 1226d determined thereafter, the first coding unit 1200 is eventually divided into coding units having the same form. Become. Accordingly, the decoding unit 130 recursively divides the coding unit through different processes based on at least one of the block form information and the division form information, and as a result, the same form coding unit. However, it is possible to process a plurality of coding units determined in the same form in different orders.

  FIG. 13 illustrates that when a coding unit is recursively divided and a plurality of coding units are determined according to an embodiment, the coding unit depth and the size of the coding unit may be changed, thereby reducing the depth of the coding unit. Figure 3 illustrates the process to be determined.

  According to an embodiment, the decoding unit 130 may determine the depth of a coding unit according to a predetermined criterion. For example, the predetermined standard is also the long side length of the coding unit. When the long side length of the current coding unit is divided by 2n (n> 0) times the long side length of the previous coding unit, the decoding unit 130 determines that the depth of the current coding unit is divided. It can be determined that the depth has increased by n over the depth of the previous coding unit. Hereinafter, a coding unit with an increased depth is expressed as a coding unit with a lower depth.

Referring to FIG. 13, according to one embodiment, based on block form information indicating that it has a square shape (eg, the block form information may indicate “0: SQUARE”), the decoding unit 130 may The square-shaped first coding unit 1300 can be divided to determine the second coding unit 1302, the third coding unit 1304, etc. of the lower depth. If the 2Nx2N the size of the first coding unit 1300 square, the second coding unit 1302 which is determined by dividing the width and height of the first coding unit 1300 1/2 ¹ times , NxN size. Further, the third coding unit 1304 determined by dividing the width and height of the second coding unit 1302 by ½ size may have an N / 2 × N / 2 size. In that case, the width and height of the third coding unit 1304 corresponds to 1/2 ² times the first coding unit 1300. If the depth of the first coding unit 1300 is D, the depth of the second coding unit 1302 is 1/2 ¹ times the width and height of the first coding unit 1300, a D + 1, the first code is 1/2 ² times the width and height of the reduction unit 1300 depth of the third coding unit 1304 is also the D + 2.

  According to one embodiment, block configuration information indicating a non-square shape (eg, the block configuration information is “1: NS_VER” indicating that the height is a non-square greater than the width, or a non-square having a width greater than the height. The decoding unit 130 divides the first coding unit 1310 or 1320 that is non-square shape, and the second coding unit of the lower depth, based on “2: NS_HOR” indicating that there is 1312 or 1322, the third coding unit 1314 or 1324, etc. can be determined.

  The decoding unit 130 may divide at least one of the width and height of the first coding unit 1310 having an Nx2N size, and determine, for example, the second coding units 1302, 1312, and 1322. That is, the decoding unit 130 can divide the first coding unit 1310 in the horizontal direction and determine a second coding unit 1302 having an NxN size or a second coding unit 1322 having an NxN / 2 size. The second coding unit 1312 having an N / 2 × N size can be determined by dividing the image into the vertical direction and the vertical direction.

  According to an exemplary embodiment, the decoding unit 130 may divide at least one of the width and height of the first encoding unit 1320 having a 2NxN size, and determine the second encoding units 1302, 1312, 1322, and the like. You can also. That is, the decoding unit 130 can divide the first coding unit 1320 in the vertical direction and determine the second coding unit 1302 having an NxN size or the second coding unit 1312 having an N / 2xN size. The second coding unit 1322 having a size of N × N / 2 can be determined by dividing the image into the vertical direction and the vertical direction.

According to an exemplary embodiment, the decoding unit 130 may divide at least one of the width and height of the second coding unit 1302 having an NxN size and determine, for example, third coding units 1304, 1314, and 1324. You can also. That is, the decoding unit 130 divides the second coding unit 1302 in the vertical direction and the horizontal direction and determines a third coding unit 1304 having an N / 2 × N / 2 size or an N / 2 ² × N / 2 size. A third coding unit 1314 can be determined, or a third coding unit 1324 of size N / 2 × N / 2 ² can be determined.

According to an embodiment, the decoding unit 130 divides at least one of the width and height of the second coding unit 1312 having an N / 2 × N size, and determines, for example, third coding units 1304, 1314, and 1324. You can also That is, the decoding unit 130 divides the second coding unit 1312 in the horizontal direction, and generates a third coding unit 1304 having an N / 2 × N / ² size or a third coding unit 1324 having an N / 2 × N / 2 ² size. The third coding unit 1314 having a size of N / 2 ² × N / 2 can be determined by determining or dividing in the vertical direction and the horizontal direction.

According to one embodiment, the decoding unit 130 divides at least one of the width and height of the second coding unit 1314 having an NxN / 2 size, and determines, for example, third coding units 1304, 1314, and 1324. You can also That is, the decoding unit 130 divides the second coding unit 1312 in the vertical direction, and the third coding unit 1304 having an N / 2 × N / 2 size or the third coding unit 1314 having an N / 2 ² × N / 2 size. Or divided in the vertical and horizontal directions to determine a third coding unit 1324 of size N / 2 × N / 2 ² .

  According to an embodiment, the decoding unit 130 may divide, for example, square-shaped coding units 1300, 1302, and 1304 in the horizontal direction or the vertical direction. For example, the first encoding unit 1300 of 2Nx2N size is divided in the vertical direction and the first encoding unit 1310 of Nx2N size is determined, or is divided in the horizontal direction and the first encoding unit 1320 of 2NxN size is determined. can do. According to one embodiment, when the depth is determined based on the longest side length of a coding unit, a code in which a first coding unit 1300, 1302 or 1304 having a 2Nx2N size is divided in the horizontal direction or the vertical direction is determined. The depth of the encoding unit is also the same as the depth of the first encoding unit 1300, 1302 or 1304.

According to an exemplary embodiment, the width and height of the third coding unit 1314 or 1324 corresponds to 1/2 ² times the first coding unit 1310 or 1320. When the depth of the first coding unit 1310 or 1320 is D, the depth of the second coding unit 1312 or 1314 that is ½ times the width and height of the first coding unit 1310 or 1320 is D + 1. There, the depth of the third coding unit 1314 or 1324 is 1/2 ² times the width and height of the first coding unit 1310 or 1320 is also D + 2.

  FIG. 14 illustrates a depth and an index for a coding unit partition (PID) determined by a coding unit form and size according to an embodiment.

  According to an embodiment, the decoding unit 130 may divide the square first coding unit 1400 and determine various types of second coding units. Referring to FIG. 14, the decoding unit 130 divides the first coding unit 1400 into at least one of a vertical direction and a horizontal direction according to the division form information, and generates second coding units 1402a, 1402b, 1404a, 1404b, 1406a, 1406b, 1406c, 1406d can be determined. That is, the decoding unit 130 can determine the second coding units 1402a, 1402b, 1404a, 1404b, 1406a, 1406b, 1406c, and 1406d based on the division form information related to the first coding unit 1400.

  According to one embodiment, the second coding units 1402a, 1402b, 1404a, 1404b, 1406a, 1406b, 1406c, and 1406d determined by the division form information related to the square-shaped first coding unit 1400 are based on the long side length. The depth is determined. For example, since the one side length of the square-shaped first coding unit 1400 and the long side lengths of the non-square-shaped second coding units 1402a, 1402b, 1404a, and 1404b are the same, the first coding unit 1400 is used. And the depths of the non-square-shaped second encoding units 1402a, 1402b, 1404a, and 1404b can be regarded as being the same as D. On the other hand, when the decoding unit 130 divides the first coding unit 1400 into four square-shaped second coding units 1406a, 1406b, 1406c, and 1406d based on the division form information, the square-shaped second Since one side length of the coding units 1406a, 1406b, 1406c, and 1406d is ½ times the one side length of the first coding unit 1400, the depth of the second coding units 1406a, 1406b, 1406c, and 1406d is Also, the depth is D + 1, which is one depth lower than D, which is the depth of the first coding unit 1400.

  According to one embodiment, the decoding unit 130 divides the first coding unit 1410 having a height greater than the width in the horizontal direction according to the division form information, and includes a plurality of second coding units 1412a, 1412b, 1414a, It can be divided into 1414b and 1414c. According to one embodiment, the decoding unit 130 divides the first coding unit 1420 having a width greater than the height in the vertical direction according to the division form information, and includes a plurality of second coding units 1422a, 1422b, 1424a, 1424b, It can be divided into 1424c.

  According to an exemplary embodiment, the second coding units 1412a, 1412b, 1414a, 1414b, 1416a, 1416b, 1416c, and 1416d determined by the division type information related to the non-square-shaped first coding unit 1410 or 1420 are long sides. Based on the length, the depth is determined. For example, the length of one side of the square-shaped second coding units 1412a and 1412b is ½ times the length of one side of the non-square-shaped first coding unit 1410 whose height is larger than the width. The depths of the second coding units 1402a, 1402b, 1404a, and 1404b are D + 1, which is a depth one depth lower than the depth D of the non-square-shaped first coding unit 1410.

  Furthermore, the decoding unit 130 can divide the non-square-shaped first coding unit 1410 into an odd number of second coding units 1414a, 1414b, and 1414c based on the division form information. The odd number of second encoding units 1414a, 1414b, and 1414c may include non-square second encoding units 1414a and 1414c and a square second encoding unit 1414b. In that case, the long side lengths of the non-square-shaped second coding units 1414a and 1414c and the one-side length of the square-shaped second coding unit 1414b are ½ of the one-side length of the first coding unit 1410. Therefore, the depth of the second coding units 1414a, 1414b, and 1414c is also the depth of D + 1, which is one depth lower than D that is the depth of the first coding unit 1410. The decoding unit 130 is a method similar to the method for determining the depth of the coding unit related to the first coding unit 1410, and the coding unit related to the non-square-shaped first coding unit 1420 whose width is larger than the height. Depth can be determined.

  According to an exemplary embodiment, the decoding unit 130 may determine an index (PID) for dividing divided coding units when the coding units divided into odd numbers are not the same size. An index can be determined based on the size ratio. Referring to FIG. 14, the coding unit 1414b located in the middle of the odd-numbered coding units 1414a, 1414b, and 1414c has the same width as the other coding units 1414a and 1414c, but has a height. It is also twice the height of the different encoding units 1414a, 1414c. That is, in this case, the coding unit 1414b located in the middle may include two of the other coding units 1414a and 1414c. Therefore, if the index (PID) of the coding unit 1414b located in the middle according to the scan order is 1, the coding unit 1414c located in the next order is also 3 in which the index is increased by 2. That is, there is a discontinuity in the index value. According to an exemplary embodiment, the decoding unit 130 may determine that odd-numbered coding units have the same size based on the presence of index discontinuity for partitioning between the coded units. It can be decided whether or not.

(Tri-split determination using PID)
According to one embodiment, the video decoding apparatus 100 is divided into specific division forms based on index values for dividing a plurality of coding units determined by dividing from the current coding unit. It can be determined whether or not. Referring to FIG. 14, the video decoding apparatus 100 divides a rectangular first coding unit 1410 whose height is larger than a width and determines an even number of coding units 1412a and 1412b or an odd number of coding units 1412a and 1412b. Coding units 1414a, 1414b, 1414c can be determined. The video decoding apparatus 100 can use an index (PID) indicating each coding unit in order to classify each of the plurality of coding units. According to one embodiment, the PID is also obtained from a sample in a predetermined position of each coding unit (eg, left top sample).

  According to an embodiment, the video decoding apparatus 100 may determine a coding unit at a predetermined position among coding units that are divided and determined using an index for coding unit division. According to one embodiment, when the division form information related to the first encoding unit 1410 having a rectangular shape whose height is greater than the width is divided into three encoding units, the video decoding apparatus 100 may The coding unit 1410 can be divided into three coding units 1414a, 1414b, 1414c. The video decoding apparatus 100 can assign indexes related to the three encoding units 1414a, 1414b, and 1414c. The video decoding apparatus 100 can compare indexes related to the respective coding units in order to determine the middle coding unit among the odd-numbered coding units. Based on the index of the coding unit, the video decoding apparatus 100 selects the coding unit 1414b having the index corresponding to the middle value from among the coding units determined by dividing the first coding unit 1410. It can be determined as an encoding unit at the middle position. According to an embodiment, the video decoding apparatus 100 may determine an index based on a size ratio between coding units when the coding units are not the same size in determining an index for dividing the divided coding units. Can be determined. Referring to FIG. 14, a coding unit 1414b generated by dividing the first coding unit 1410 has the same width as the other coding units 1414a and 1414c, but has different heights. It is also twice the height of 1414c. In this case, if the index (PID) of the coding unit 1414b located in the middle is 1, the coding unit 1414c located in the next order is also the index 3 increased by 2. In such a case, when the index is uniformly increased and the increment is different, the video decoding apparatus 100 includes a plurality of coding units including a coding unit having a size different from that of the other coding units. When the division form information indicates that the division form information is divided into an odd number of coding units according to an embodiment, the video decoding apparatus 100 may select a predetermined position among the odd number of coding units. The current coding unit can be divided into a form in which the coding unit (for example, the middle coding unit) is different in size from the other coding units. In this case, the video decoding apparatus 100 can determine a middle coding unit having a different size using an index (PID) related to the coding unit. However, since the above-described index and the size or position of the encoding unit at the predetermined position to be determined are specified for describing one embodiment, the present invention is not construed as being limited thereto. It must be construed that the correct index, coding unit position and size are used.

  According to an exemplary embodiment, the decoding unit 130 may use a predetermined data unit where a recursive division of a coding unit starts.

  FIG. 15 illustrates a plurality of encoding units determined according to a plurality of predetermined data units included in a picture according to an embodiment.

  According to an exemplary embodiment, the predetermined data unit is defined as a data unit in which an encoding unit starts to be recursively divided using at least one of block form information and division form information. That is, this corresponds to the highest-depth coding unit used in the process of determining a plurality of coding units for dividing the current picture. Hereinafter, for convenience of explanation, such a predetermined data unit is referred to as a reference data unit.

  According to an embodiment, the reference data unit may indicate a predetermined size and a predetermined form. According to one embodiment, the reference coding unit may include M × N samples. Here, M and N are the same as each other and are integers expressed by a multiplier of 2. That is, the reference data unit can indicate a square or non-square form and is then divided into an integer number of coding units.

  According to an embodiment, the decoding unit 130 of the video decoding apparatus 100 may divide the current picture into a plurality of reference data units. According to an exemplary embodiment, the decoding unit 130 may divide a plurality of reference data units that divide a current picture using division information related to each reference data unit. The division process of the reference data unit corresponds to a division process using a quad-tree structure.

  According to an embodiment, the decoding unit 130 may determine in advance a minimum size that the reference data unit included in the current picture can have. Accordingly, the decoding unit 130 can determine reference data units of various sizes having a size equal to or larger than the minimum size, and uses the block form information and the division form information based on the determined reference data unit. Thus, at least one coding unit can be determined.

  Referring to FIG. 15, the video decoding apparatus 100 may use a square reference coding unit 1500, or may use a non-square reference coding unit 1502. According to one embodiment, the format and size of the reference coding unit may be various data units including at least one reference coding unit (e.g., sequence, picture, slice, slice segment ( slice segment), maximum coding unit, etc.).

  According to an exemplary embodiment, the bitstream acquisition unit 120 of the video decoding apparatus 100 may receive at least one of the information related to the reference coding unit type and the information related to the size of the reference coding unit as the various data units. For each bitstream. The process of determining at least one coding unit included in the square reference coding unit 1500 will be described through the process of dividing the current coding unit 300 of FIG. Since the process of determining at least one coding unit included in the unit 1500 has been described through the process of dividing the current coding unit 400 or 450 of FIG. 4, detailed description thereof will be omitted.

  According to an exemplary embodiment, the decoding unit 130 may determine the size and form of the reference coding unit according to a predetermined data unit according to a predetermined data unit. An index for identifying can be used. That is, the bitstream acquisition unit 120 has a predetermined condition (for example, a size equal to or less than a slice) from the various data units (for example, a sequence, a picture, a slice, a slice segment, and a maximum coding unit) from the bitstream. As a data unit satisfying (data unit), only the index for identifying the size and form of the reference coding unit can be obtained for each slice, slice segment, maximum coding unit, and the like. The decoding unit 130 can determine the size and form of the reference data unit for each data unit that satisfies the predetermined condition by using the index. When the information related to the form of the reference coding unit and the information related to the size of the reference coding unit are acquired from the bit stream for each relatively small data unit and used, the bit stream utilization efficiency Therefore, instead of directly acquiring the information related to the form of the reference coding unit and the information related to the size of the reference coding unit, only the index can be obtained and used. In this case, at least one of the size and form of the reference coding unit related to the index indicating the size and form of the reference coding unit is determined in advance. That is, the decoding unit 130 selects at least one of the predetermined size and form of the reference coding unit based on the index, thereby determining the size of the reference coding unit included in the data unit serving as a reference for index acquisition. At least one of the size and the form can be determined.

  According to an embodiment, the decoding unit 130 may use at least one reference coding unit included in one maximum coding unit. That is, the maximum coding unit for dividing a video includes at least one reference coding unit, and the coding unit is determined through a recursive division process of each reference coding unit. According to an embodiment, at least one of the width and height of the largest coding unit corresponds to at least one integer multiple of the width and height of the reference coding unit. According to an embodiment, the size of the reference coding unit may be a size obtained by dividing the maximum coding unit n times by a quadtree structure. That is, the decoding unit 130 can determine the reference coding unit by dividing the maximum coding unit n times by a quadtree structure, and the reference coding unit can be divided into the block form information and the partition according to various embodiments. Division can be performed based on at least one of the form information.

  FIG. 16 illustrates a processing block serving as a reference for determining a determination order of reference coding units included in the picture 1600 according to an embodiment.

  According to an embodiment, the decoding unit 130 may determine at least one processing block that divides a picture. A processing block is a data unit including at least one reference coding unit for dividing a video, and at least one reference coding unit included in the processing block is determined in a specific order. That is, the determination order of at least one reference coding unit determined in each processing block corresponds to one of various types of order in which the reference coding unit is determined, and is determined in each processing block. The reference coding unit determination order may vary from processing block to processing block. The order of determination of the reference coding units determined for each processing block is as follows: raster scan, Z-scan, N-scan, N-scan, and upper-right diagonal scan. ), Horizontal scan, vertical scan, and the like, but the determined order is not limited to the scan order.

  According to an exemplary embodiment, the decoding unit 130 may obtain information related to a processing block size and determine a size of at least one processing block included in the video. The decoding unit 130 can acquire information related to the size of the processing block from the bitstream and determine the size of at least one processing block included in the video. The size of such a processing block is also a predetermined size of a data unit indicated by information related to the size of the processing block.

  According to an embodiment, the bitstream acquisition unit 120 of the video decoding apparatus 100 can acquire information regarding the size of a processing block from a bitstream for each specific data unit. For example, information related to the size of the processing block is acquired from the bit stream in units of data such as video, sequence, picture, slice, slice segment, and the like. That is, the bitstream acquisition unit 120 can acquire information related to the size of the processing block from the bitstream for each of the various data units described above, and the decoding unit 130 determines the size of the acquired processing block. The size of at least one processing block that divides a picture can be determined using information related to the above, and the size of such a processing block is also an integer multiple of the reference coding unit.

  According to one embodiment, the decoding unit 130 may determine the size of the processing blocks 1602 and 1612 included in the picture 1600. For example, the decoding unit 130 can determine the size of the processing block based on information regarding the size of the processing block acquired from the bitstream. Referring to FIG. 16, according to an embodiment, the decoding unit 130 sets the horizontal size of the processing blocks 1602 and 1612 to four times the horizontal size of the reference coding unit, and sets the vertical size to 4 of the vertical size of the reference coding unit. Can be determined as double. The decoding unit 130 can determine the order in which at least one reference coding unit is determined in at least one processing block.

  According to an embodiment, the decoding unit 130 may determine the processing blocks 1602 and 1612 included in the picture 1600 based on the size of the processing block, and the reference coding unit determination unit 12 may determine the processing block 1602. , 1612 can determine the order of determination of at least one reference coding unit. According to one embodiment, determining the reference coding unit may include determining the reference coding unit size.

  According to an embodiment, the decoding unit 130 may obtain information related to the determination order of at least one reference coding unit included in at least one processing block from the bitstream, and the information related to the acquired determination order may be obtained. Based on this, the order in which at least one reference coding unit is determined can be determined. The information related to the determination order is defined as the order or direction in which the reference coding unit is determined in the processing block. That is, the order in which the reference coding units are determined is determined independently for each processing block.

  According to one embodiment, the video decoding apparatus 100 can acquire information related to the determination order of the reference coding unit for each specific data unit from the bitstream. For example, the bitstream acquisition unit 120 can acquire information related to the determination order of the reference coding unit from the bitstream for each data unit such as a video, a sequence, a picture, a slice, a slice segment, and a processing block. Since the information related to the determination order of the reference coding unit indicates the reference coding unit determination order in the processing block, the information related to the determination order is also acquired for each specific data unit including an integer number of processing blocks. The

  The video decoding apparatus 100 may determine at least one reference coding unit based on the determined order according to an embodiment.

  According to an exemplary embodiment, the bitstream acquisition unit 120 may acquire information related to a reference coding unit determination order from the bitstream as information related to the processing blocks 1602 and 1612, and the decoding unit 130 may acquire the processing block The order in which at least one reference coding unit included in 1602 and 1612 is determined can be determined, and at least one reference coding unit included in the picture 1600 can be determined according to the order in which the coding units are determined. Referring to FIG. 16, the decoding unit 130 may determine a determination order (1604, 1614) of at least one reference coding unit related to each processing block 1602, 1612. For example, when the information related to the determination order of the reference coding units is acquired for each processing block, the reference coding unit determination order related to the processing blocks 1602 and 1612 may be different for each processing block. When the reference coding unit determination order (1604) related to the processing block 1602 is a raster scan order, the reference coding units included in the processing block 1602 are determined according to the raster scan order. On the other hand, when the reference coding unit determination order (1614) related to the other processing block 1612 is the reverse order of the raster scan order, the reference coding unit included in the processing block 1612 is also determined by the reverse order of the raster scan order. The

  The decoding unit 130 may decode the determined at least one reference coding unit according to an embodiment. The decoding unit 130 can decode the video based on the reference coding unit determined through the above-described embodiment. The method for decoding the reference coding unit may include various methods for decoding video.

  According to an embodiment, the video decoding apparatus 100 may acquire and use block form information indicating a form of a current coding unit or division form information indicating a method of dividing a current coding unit from a bitstream. The block form information or the division form information may be included in a bit stream related to various data units. For example, the video decoding apparatus 100 includes a sequence parameter set, a picture parameter set, a video parameter set, a slice header, and a slice segment header. Block form information or division form information included in the. Furthermore, the video decoding apparatus 100 can acquire and use the syntax related to the block form information or the division form information from the bitstream for each maximum coding unit, reference coding unit, and processing block. .

  According to an embodiment, the decoding unit 130 may determine the type of division form in which the coding unit is divided differently for each predetermined data unit. The decoding unit 130 of the video decoding apparatus 100 may determine different combinations of forms in which coding units are divided for each predetermined data unit (for example, sequence, picture, slice, etc.) according to an embodiment. .

  FIG. 17 illustrates coding units determined for each picture when combinations of forms in which the coding units are divided are different for each picture according to an embodiment.

  Referring to FIG. 17, the decoding unit 130 can determine different combinations of division forms in which the coding unit is divided for each picture. For example, the decoding unit 130 may include a picture 1700 divided into four coding units out of at least one picture included in the video, two pictures 1710 divided into four or four coding units, and two, A picture can be decoded using a picture 1720 divided into three or four coding units. In order to divide the picture 1700 into a plurality of coding units, the decoding unit 130 can use only division form information indicating that the picture 1700 is divided into four square coding units. In order to divide the picture 1710, the decoding unit 130 can use only division form information indicating that the picture 1710 is divided into two or four coding units. In order to divide the picture 1720, the decoding unit 130 can use only division form information indicating that it is divided into two, three, or four coding units. Since the combination of the above-described division forms is merely an embodiment for explaining the operation of the video decoding apparatus 100, the combination of the above-described division forms is not interpreted as being limited to the above-described embodiment, and predetermined data It should be construed that a combination of various forms of divisions is used for each unit.

  According to an embodiment, the bitstream acquisition unit 120 of the video decoding apparatus 100 may acquire a bitstream including an index indicating a combination of division form information for each predetermined data unit (eg, sequence, picture, slice, etc.). it can. For example, the bitstream acquisition unit 120 may acquire an index indicating a combination of division form information in a sequence parameter set, a picture parameter set, or a slice header. Using the acquired index, the decoding unit 130 of the video decoding device 100 can determine a combination of division forms in which the encoding unit is divided for each predetermined data unit, and thereby, for each predetermined data unit. Combinations of different division forms can be used.

  FIG. 18 illustrates various forms of a coding unit determined based on partition form information represented by a binary code according to an embodiment.

  According to an embodiment, the video decoding apparatus 100 may divide the coding unit into various forms using the block form information and the division form information acquired through the bitstream acquisition unit 120. The form of the coding unit to be divided corresponds to various forms including the form described through the above-described embodiment.

  Referring to FIG. 18, the decoding unit 130 can divide a square-shaped coding unit into at least one of a horizontal direction and a vertical direction based on the division form information. The unit can be divided horizontally or vertically.

  According to one embodiment, when the decoding unit 130 can divide a square-shaped coding unit in the horizontal direction and the vertical direction and divide the square-shaped coding unit into four square coding units, the division related to the square coding unit may be performed. There are four types of divisions that the form information can indicate. According to an embodiment, the division form information is expressed as a two-digit binary code, and a binary code is assigned to each division form. For example, when the coding unit is not divided, the division form information is expressed as (00) b, and when the coding unit is divided in the horizontal direction and the vertical direction, the division form information is (01) b. When the coding unit is divided in the horizontal direction, the division form information is expressed as (10) b, and when the coding unit is divided in the vertical direction, the division form information is (11) ) B.

  According to one embodiment, when the decoding unit 130 divides a non-square coding unit in the horizontal direction or the vertical direction, the type of division form that the division form information can indicate is divided into how many coding units. It is decided by whether or not. Referring to FIG. 18, the decoding unit 130 may divide up to three non-square coding units according to an embodiment. The decoding unit 130 can divide the coding unit into two coding units. In this case, the division form information is expressed as (10) b. The decoding unit 130 can divide the coding unit into three coding units. In this case, the division form information is expressed as (11) b. The decoding unit 130 can determine that the coding unit is not divided, and in this case, the division form information is expressed as (0) b. That is, the decoding unit 130 can use variable length coding (VLC) instead of fixed length coding (FLC) in order to use a binary code indicating division form information.

  Referring to FIG. 18 according to an embodiment, a binary code of division form information indicating that a coding unit is not divided is expressed as (0) b. If the binary code of the division form information indicating that the coding unit is not divided is set to (00) b, the division form information is set to 2 even though there is no division form information set to (01) b. Any binary code of bit division form information must be used. However, as illustrated in FIG. 18, if three types of division forms related to a non-square coding unit are used, the decoding unit 130 uses a 1-bit binary code (0) as the division type information. ) Even if b is used, since it can be determined that the coding unit is not divided, the bit stream can be used efficiently. However, the division form of the non-square coding unit indicated by the division form information is not limited to the three kinds of forms illustrated in FIG. 18, and is in various forms including the above-described embodiment. Must be interpreted.

  FIG. 19 illustrates another form of a coding unit determined based on division form information expressed in binary code according to an embodiment.

  Referring to FIG. 19, the decoding unit 130 can divide a square coding unit in the horizontal direction or the vertical direction based on the division form information, and can convert the non-square coding unit in the horizontal direction. Or it can be divided vertically. That is, the division form information can indicate that a square-shaped coding unit is divided in one direction. In such a case, the binary code of the division form information indicating that the square-shaped coding unit is not divided is expressed as (0) b. If the binary code of the division form information indicating that the coding unit is not divided is set to (00) b, the division form information is set to 2 even though there is no division form information set to (01) b. Any binary code of bit division form information must be used. However, as illustrated in FIG. 19, if three types of division forms related to a square-shaped encoding unit are used, the decoding unit 130 uses a 1-bit binary code (0) as the division type information. Even if b is used, since it can be determined that the coding unit is not divided, the bit stream can be used efficiently. However, the division form of the square coding unit indicated by the division form information is not limited to the three types shown in FIG. 19, but is interpreted in various forms including the above-described embodiment. There must be.

  According to one embodiment, the block form information or the division form information is expressed using a binary code, and such information is immediately generated into a bit stream. In addition, block form information or division form information expressed in binary code is not immediately generated in a bitstream, but is also used as binary code input by CABAC (context-adaptive binary array coding).

  According to an exemplary embodiment, the video decoding apparatus 100 will be described with reference to a process of acquiring syntax related to block form information or division form information via CABAC. A bitstream including a binary code related to the syntax can be acquired via the bitstream acquisition unit 120. The decoding unit 130 can inverse binarize a bin string included in the acquired bitstream and detect a syntax element indicating block form information or division form information. According to an exemplary embodiment, the decoding unit 130 may obtain a set of binary bin strings corresponding to syntax elements to be decoded, and may decode each bin using probability information. It is possible to iterate until the bin string constituted by the decoded bins is the same as one of the previously obtained bin strings. The decoding unit 130 can perform binarization inverse binarization and determine syntax elements.

  According to an embodiment, the decoding unit 130 may perform a decoding process of adaptive binary arithmetic coding to determine a syntax for a bin string, and the decoding unit 130 may determine a bitstream acquisition unit. The probability model for the bin acquired via 120 can be updated. Referring to FIG. 18, the bitstream acquisition unit 120 of the video decoding apparatus 100 may acquire a bitstream indicating a binary code indicating division form information according to an embodiment. The decoding unit 130 can determine the syntax related to the division form information using the obtained binary code having a size of 1 bit or 2 bits. The decoding unit 130 can update the probability related to each bit of the 2-bit binary code in order to determine the syntax related to the division form information. That is, the decoding unit 130 has a probability of having a value of 0 or 1 when decoding the next bin depending on whether the value of the first bin of the 2-bit binary code is 0 or 1 Can be updated.

  According to an exemplary embodiment, the decoding unit 130 may update the probability related to the bin used in the process of decoding the bin string related to the syntax in the process of determining the syntax. It is possible to determine that a specific bit in the bin string has the same probability without updating the probability.

  Referring to FIG. 18, the decoding unit 130 does not divide the non-square coding unit in the process of determining the syntax using the bin string indicating the division form information related to the non-square coding unit. In this case, one bin having a value of 0 can be used to determine the syntax related to the division form information. That is, if the block form information indicates that the current coding unit is non-square, the first bin of the bin string related to the division form information is 0 if the non-square coding unit is not divided. Yes, it is also 1 if it is divided into 2 or 3 coding units. Thereby, the probability that the first bin of the bin string of the division form information related to the non-square coding unit is 0 is 1/3, and the probability that it is 1 is also 2/3. As described above, the decoding unit 130 represents only the 1-bit bin string having a value of 0 in the division form information indicating that the non-square coding unit is not divided. Only when the first bin of the division form information is 1, it can be determined whether the second bin is 0 or 1, and the syntax related to the division form information can be determined. According to an exemplary embodiment, when the first bin related to the division form information is 1, the decoding unit 130 may decode the bins assuming that the probability that the second bin is 0 or 1 is the same probability. .

  According to an exemplary embodiment, the video decoding apparatus 100 may use various probabilities associated with each bin in the process of determining bin strings related to the division form information. According to an embodiment, the decoding unit 130 may determine different bin probabilities related to the division form information depending on the non-square block direction. According to an embodiment, the decoding unit 130 may determine the bin probabilities related to the division form information differently according to the width or the long side length of the current coding unit. According to an exemplary embodiment, the decoding unit 130 may determine different bin probabilities related to the division type information according to at least one of the current coding unit type and the long side length.

  According to an embodiment, the decoding unit 130 may determine that the probability of bins related to the division form information is the same for coding units of a predetermined size or larger. For example, it is possible to determine that the probability of bins related to the division form information is the same for an encoding unit having a size of 64 samples or more based on the long side length of the encoding unit.

  According to an exemplary embodiment, the decoding unit 130 may determine an initial probability associated with bins constituting the bin string of the division form information based on a slice type (eg, I slice, P slice, or B slice).

  FIG. 20 is a block diagram of a video encoding / decoding system that performs loop filtering.

  The encoding end 2010 of the video encoding / decoding system 2000 transmits the encoded bit stream of the video, and the decoding end 2050 outputs the restored video by receiving and decoding the bit stream. Here, the encoding end 2010 has a configuration similar to the video encoding device 200 described later, and the decoding end 2050 has a configuration similar to the video decoding device 100.

  At the encoding end 2010, the predictive encoding unit 2015 outputs a reference video through inter prediction and intra prediction, and the transform and quantization unit 2020 quantizes residual data of the reference video and the current input video. Quantize the converted transform coefficient and output. The entropy encoding unit 2025 encodes and transforms the quantized transform coefficient and outputs it as a bit stream. The quantized transform coefficient is restored to the spatial domain data through the inverse quantization and inverse transformation unit 2030, and the restored spatial domain data is restored to the restored video through the deblocking filtering unit 2035 and the loop filtering unit 2040. Is output as The restored video is also used as a reference video for the next input video via the predictive coding unit 2015.

  The video data encoded in the bit stream received by the decoding end 2050 is restored to spatial domain residual data through the entropy decoding unit 2055 and the inverse quantization and inverse transform unit 2060. The spatial video data is configured by combining the reference video and residual data output from the predictive decoding unit 2075, and the deblocking filtering unit 2065 and the loop filtering unit 2070 perform filtering on the spatial domain video data. Therefore, it is possible to output a restored image related to the current original image. The restored video is also used as a reference video related to the next original video by the predictive decoding unit 2075.

  The loop filtering unit 2040 of the encoding end 2010 performs loop filtering using filter information input by user input or system setting. The filter information used by the loop filtering unit 2040 is output to the entropy encoding unit 2010 and transmitted to the decoding end 2050 together with the encoded video data. The loop filtering unit 2070 of the decoding end 2050 can perform loop filtering based on the filter information input from the decoding end 2050.

  FIG. 21 is a diagram illustrating an example of a filtering unit included in the maximum coding unit and filtering performance information of the filtering unit according to an embodiment.

  The filtering units of the loop filtering unit 2040 of the encoding end 2010 and the loop filtering unit 2070 of the decoding end 2050 are composed of data units similar to the encoding unit according to the embodiment described with reference to FIGS. In other words, the filter information may include block form information and division form information of a data unit for indicating a filtering unit, and loop filtering performance information indicating loop filtering performance for the filtering unit.

  The filtering unit included in the maximum coding unit 2100 according to an embodiment may have the same block form and division form as the coding unit included in the maximum coding unit 2100. Also, the filtering unit included in the maximum coding unit 2100 according to an embodiment is divided based on the size of the coding unit included in the maximum coding unit 2100. Referring to FIG. 21, for example, the filtering unit is a square filtering unit 2140 having a depth D, a non-square filtering unit 2132, 2134 having a depth D, and a square filtering unit 2112, 2114, 2116 having a depth D + 1. 2152, 2154, 2164, non-square filtering units 2162, 2166 with depth D + 1, and square filtering units 2122, 2124, 2126, 2128 with depth D + 2.

  Block form information, division form information (depth) and loop filtering performance information of the filtering unit included in the maximum coding unit 2100 are encoded as shown in Table 1 below.

The process of recursively dividing the coding unit according to the block form information and the block division information according to the embodiment and determining a plurality of coding units is as described with reference to FIG. In the filtering unit loop filtering performance information according to an embodiment, when the flag value is 1, it indicates that loop filtering is performed on the filtering unit, and when the flag value is 0, loop filtering is not performed. . Referring to Table 1, data unit information for determining a filtering unit to be filtered is encoded and transmitted as filter information by the loop filtering units 2040 and 2070.

  According to an embodiment, the configured coding unit is a coding unit configured to minimize an error from the original video, and therefore, a spatial correlation degree is expected to be high in the coding unit. The Therefore, by determining the filtering unit based on the encoding unit according to the embodiment, the operation of determining the filtering unit separately from the determination of the encoding unit is omitted. Also, by determining the filtering unit based on the coding unit according to one embodiment, information for determining the division form of the filtering unit can be omitted, so the transmission bit rate of the filter information can be reduced. Can be saved.

  In the above-described embodiment, it has been described that the filtering unit is determined based on the coding unit according to one embodiment, but the filtering unit is divided based on the coding unit, and at an arbitrary depth, The form of the filtering unit may be determined only up to the depth without further division.

  The determination of the filtering unit disclosed in the above embodiment is applied not only to loop filtering but also to various embodiments such as deblocking filtering and adaptive loop filtering.

  According to an embodiment, the video decoding apparatus 100 may divide a current coding unit using at least one of block form information and division form information, and the block form information uses only a square shape. Then, it is determined in advance, and it is determined in advance that the division form information can indicate that it is not divided or is divided into four square-shaped coding units. That is, according to the block form information, the current coding unit has a square shape at all times, and is not divided based on the division form information, or is encoded into four square shapes. It is also divided into units. The video decoding apparatus 100 can acquire a bitstream generated using a predetermined encoding method determined in advance using only the block form and the division form via the bitstream acquisition unit 110. The decoding unit 120 can use only a predetermined block form and division form. In such a case, the video decoding apparatus 100 can solve the compatibility problem with the predetermined encoding method by using a predetermined decoding method similar to the above-described predetermined encoding method. According to an embodiment, the video decoding apparatus 100 uses the above-described predetermined decoding method that uses only a predetermined block form and division form among various forms that can be indicated by the block form information and the division form information. In this case, since the block form information indicates only a square shape, the video decoding apparatus 100 can omit the process of acquiring the block form information from the bit stream. A syntax indicating whether or not to use the above-described predetermined decoding method is used. Such syntax includes various coding units including a plurality of coding units such as a sequence, a picture, a slice unit, and a maximum coding unit. For each data unit of the form, it is obtained from the bitstream. That is, the bitstream acquisition unit 110 can determine whether or not to acquire the syntax indicating the block form information from the bitstream based on the syntax indicating the usage of the predetermined decoding method.

  FIG. 23 illustrates an index according to a Z-scan order of coding units according to one embodiment.

  The video decoding apparatus 100 according to an embodiment may scan the lower data unit included in the upper data unit according to the Z scan order. In addition, the video decoding apparatus 100 according to an embodiment can sequentially access data using a Z scan index within a maximum coding unit or within a coding unit included in a processing block.

  As described with reference to FIGS. 3 and 4, the video decoding apparatus 100 according to an embodiment may divide the reference coding unit into at least one coding unit. At this time, a square coding unit and a non-square coding unit are mixed in the reference coding unit. The video decoding apparatus 100 according to an embodiment may perform data access using a Z scan index included in each coding unit in the reference coding unit. At this time, the method of applying the Z scan index differs depending on whether or not a non-square coding unit exists in the reference coding unit.

  According to an embodiment, when there are no non-square-shaped coding units in the reference coding unit, coding units at lower depths in the reference coding unit may have a continuous Z scan index. For example, according to an embodiment, the upper depth coding unit may include four lower depth coding units. Here, the four sub-depth coding units have continuous adjacent boundaries, and each sub-depth coding unit is scanned in the Z scan order by an index indicating the Z scan order. The The index indicating the Z scan order according to an embodiment is also set to a number that increases with the Z scan order for each coding unit. In this case, scanning can be performed according to the Z scanning order between coding units by depth of the same depth.

  According to an embodiment, when there are at least one non-square coding unit in the reference coding unit, the video decoding apparatus 100 divides each coding unit in the reference coding unit into sub-blocks. The divided sub-blocks can be scanned in the Z scan order. For example, when there is a non-square coding unit in the vertical direction or the horizontal direction in the reference coding unit, Z scanning can be performed using the divided sub-blocks. Further, for example, when division is performed into an odd number of coding units in the reference coding unit, Z scanning can be performed using sub-blocks. The sub-block is obtained by dividing a coding unit that is not divided any further, or an arbitrary coding unit, and also has a square shape. For example, four square sub-blocks are divided from a square coding unit. For example, two square sub-blocks are divided from a non-square coding unit.

  Referring to FIG. 23, for example, the video decoding apparatus 100 according to an embodiment may scan the lower-depth coding units 2302, 2304, 2306, 2308, and 2310 in the coding unit 2300 according to the Z scan order. it can. The coding unit 2300 and the coding units 2302, 2304, 2306, 2308, and 2310 are relatively higher coding units and lower coding units, respectively. Coding unit 2300 includes non-square coding units 2306 and 2310 in the horizontal direction. These non-square coding units 2306 and 2310 have discontinuous boundaries with adjacent square coding units 2302 and 2304. Also, the coding unit 2308 has a square shape, an odd number of non-square coding units, and is a coding unit positioned in the middle when divided. Similar to the non-square coding units 2306 and 2310, the coding unit 2308 has a discontinuous boundary with the adjacent square coding units 2302 and 2304. The coding unit 2300 includes non-square coding units 2306 and 2310, or there are an odd number of non-square coding units and includes a coding unit 2308 located in the middle at the time of division. In this case, since the adjacent boundary between coding units is discontinuous, a continuous Z scan index is not set. Accordingly, the video decoding apparatus 100 can continuously set the Z scan index by dividing the coding unit into sub-blocks. Also, the video decoding apparatus 100 performs continuous Z scan on the non-square coding units 2306 and 2310 or the coding unit 2308 located in the middle of the odd-numbered non-square coding units. It can be performed.

  The coding unit 2320 illustrated in FIG. 23 is obtained by dividing the coding units 2302, 2304, 2306, 2308, and 2310 in the coding unit 2300 into sub-blocks. A Z-scan index is set for each of the sub-blocks, and adjacent boundaries between the sub-blocks are continuous. Therefore, scanning can be performed according to the Z-scan order of the sub-blocks. For example, in the decoding apparatus according to an embodiment, the coding unit 2308 is also divided into sub-blocks 2322, 2324, 2326, and 2328. At this time, the sub-blocks 2322 and 2324 are scanned after data processing on the sub-block 2330, and the sub-blocks 2326 and 2328 are scanned after data processing on the sub-block 2332. Further, each sub-block is scanned in the Z-scan order.

  In the above-described embodiment, scanning the data unit in the Z scan order is also for data storage, data loading, data access, and the like.

  In the above-described embodiment, it has been described that data units can be scanned in the Z scan order. However, the scan order of data units is raster scan, N scan, upper right diagonal scan, horizontal scan, and vertical scan. It is performed by various scan orders such as scans, and is not limited to the Z scan order.

  Further, in the above-described embodiment, it has been described that the scanning is performed on the coding unit in the reference coding unit. However, the present invention is not limited to this, and the target of scanning is the maximum coding unit, Or any block within the processing block.

  Further, in the above-described embodiment, it has been described that the block is divided into sub-blocks only when at least one non-square block exists, and scanning is performed according to the Z-scan order. However, for simplified implementation. Even when there is no non-square block, it is possible to divide the sub-block and perform scanning in the Z scan order.

  The video decoding apparatus 100 according to an embodiment performs inter prediction or intra prediction on a coding unit to generate prediction data, performs inverse conversion on a conversion unit included in the current coding unit, and converts residual data into The current encoding unit can be restored using the generated prediction data and residual data.

  The prediction mode of a coding unit according to an embodiment is at least one of an intra mode, an inter mode, and a skip mode. According to one embodiment, the prediction mode is selected independently for each coding unit.

  When a 2Nx2N-type coding unit according to an embodiment is divided and divided into two 2NxN-type or two Nx2N-type coding units, inter-mode prediction and intra mode are performed for each of the coding units. Prediction is also made separately. In addition, the skip mode may be applied to a 2NxN or Nx2N coding unit according to an embodiment.

  On the other hand, the video decoding apparatus 100 according to an embodiment is allowed to perform bi-prediction in the 8 × 4 or 4 × 8 coding unit skip mode. In the skip mode, since only the skip mode information is transmitted for the coding unit, use of residual data for the coding unit is omitted. Therefore, in that case, overhead for inverse quantization and inverse transform can be saved. Instead, the video decoding apparatus 100 according to an embodiment may allow bi-directional prediction for a coding unit to which the skip mode is applied, and increase decoding efficiency. Also, the video decoding apparatus 100 according to an embodiment allows bi-directional prediction for an 8 × 4 or 4 × 8 coding unit, but relatively reduces the number of interpolation taps in the motion compensation stage. Set and use memory bandwidth efficiently. As an example, instead of using an 8-tap interpolation filter, an interpolation filter having a tap number of less than 8 (for example, a 2-tap interpolation filter) may be used.

  In addition, the video decoding apparatus 100 according to an embodiment divides a region included in a current coding unit in a preset manner (for example, diagonally-based division), and intra prediction information or inter prediction for each divided region. Information can also be signaled.

  The video decoding apparatus 100 according to an embodiment may obtain a prediction sample of a current coding unit using an intra mode using a peripheral sample of the current coding unit. At this time, in intra prediction, prediction is performed by using already reconstructed samples in the vicinity, and such samples are referred to as reference samples.

  FIG. 24 is a diagram illustrating reference samples for intra prediction of a coding unit according to an embodiment. Referring to FIG. 24, the reference sample 2302 at the upper end of the current coding unit 2300 in which the block form is a non-square form, the horizontal length is w, and the vertical length is h. However, there are w + h, left reference samples 2304, w + h, one upper left reference sample 2306, and a total of 2 (w + h) +1 reference samples are required. In order to reduce the quantization error included in the reconstructed reference sample, the reference sample filtering process according to the prediction mode is performed in order to reduce the quantization error included in the reconstructed reference sample through the step of performing padding on the portion where the reference sample does not exist. You can also.

  In the above embodiment, the number of reference samples when the block form of the current coding unit is a non-square shape has been described. The same applies to the block form.

  The various embodiments described above describe operations related to the video decoding method performed by the video decoding apparatus 100. Hereinafter, the operation of the video encoding apparatus 200 that performs the video encoding method corresponding to the reverse process of the video decoding method will be described through various embodiments.

  FIG. 2 illustrates a block diagram of a video encoding apparatus 200 that can encode a video based on at least one of block configuration information and division configuration information according to an exemplary embodiment.

  Referring to FIG. 2, according to an embodiment, the video encoding apparatus 200 includes a bitstream generation unit 210 for generating a bitstream including predetermined information such as division form information and block form information, and the predetermined information. It may include an encoding unit 220 for encoding video. According to an embodiment, the encoding unit 220 of the video encoding apparatus 200 may determine at least one encoding unit for dividing a video based on at least one of block form information and division form information. The bit stream generation unit 210 of the video encoding device 200 can generate a bit stream including at least one of such block form information and division form information. Here, the block form information means information or syntax indicating the form of the coding unit, and the division form information means information or syntax indicating the form in which the coding unit is divided.

According to an exemplary embodiment, the encoding unit 220 of the video encoding apparatus 200 may determine the encoding unit form. For example, the encoding unit may be square or may have a non-square form, and information indicating such form may be included in the block form information. According to one embodiment, the encoding unit 220 may It can be determined what form the coding unit is divided into. The encoding unit 220 can determine the form of at least one encoding unit included in the encoding unit, and the bitstream generation unit 210 can determine the division form information including information related to the form of the encoding unit. Can be generated.

  According to an embodiment, the encoding unit 220 may determine whether an encoding unit is divided or not divided. When the coding unit 220 determines that the coding unit includes only one coding unit or that the coding unit is not divided, the bit stream generation unit 210 performs division indicating that the coding unit is not divided. A bitstream containing morphological information can be generated. Also, the encoding unit 220 can be divided into a plurality of encoding units included in the encoding unit, and the bitstream generation unit 210 can be divided into a plurality of encoding units. Can be generated.

  According to an embodiment, information indicating whether the coding unit is divided into how many coding units or in which direction the coding unit is divided may be included in the division form information. For example, the division form information can indicate that the image is divided in at least one of the vertical direction and the horizontal direction, or can indicate that the image is not divided.

  FIG. 3 illustrates a process in which the video encoding apparatus 200 divides a current encoding unit and determines at least one encoding unit according to an exemplary embodiment.

  According to an embodiment, the encoding unit 220 may determine a coding unit type. For example, the encoding unit 220 may determine the form of the encoding unit having the optimal RD cost in consideration of the RD (rate distortion) cost.

  According to an embodiment, the encoding unit 220 may determine that the current encoding unit is a square shape, and thereby determine a form in which the square encoding unit is divided. For example, the encoding unit 220 can determine whether the square encoding unit is not divided, divided vertically, divided horizontally, or divided into four encoding units. . Referring to FIG. 3, the encoding unit 220 does not divide the encoding unit 310a having the same size as the current encoding unit 300, or the encoding unit is divided based on the division form information indicating a predetermined division method. 310b, 310c, 310d, etc. can be determined.

  Referring to FIG. 3, the encoding unit 220 may determine two encoding units 310b obtained by dividing the current encoding unit 300 in the vertical direction according to an embodiment. The encoding unit 220 can determine two encoding units 310c obtained by dividing the current encoding unit 300 in the horizontal direction. The encoding unit 220 can determine four encoding units 310d obtained by dividing the current encoding unit 300 in the vertical direction and the horizontal direction. However, the division form in which the square coding unit is divided is not limited to the above-described form, and may include various forms that can be indicated by the division form information. The predetermined division form in which the square coding unit is divided will be described in detail below through various embodiments.

  According to an exemplary embodiment, the bitstream generation unit 210 of the video encoding apparatus 200 may generate a bitstream including division form information indicating a form in which the current encoding unit 300 is divided by the encoding unit 220.

  FIG. 4 illustrates a process in which the video encoding apparatus 200 divides a coding unit having a non-square shape and determines at least one coding unit according to an embodiment.

  According to an embodiment, the encoding unit 220 may determine whether to divide a non-square current encoding unit or to divide it in a predetermined manner. Referring to FIG. 4, the encoding unit 220 of the current coding unit 400 or 450 does not divide the coding unit 410 or 460 having the same size as the current coding unit 400 or 450, or divides it by a predetermined division method. The encoded units 420a, 420b, 430a, 430b, 430c, 470a, 470b, 480a, 480b, and 480c can be determined. The bit stream generation unit 210 of the video encoding device 200 can generate a bit stream including division form information indicating such a division form. A predetermined division method for dividing a non-square coding unit will be described in detail below through various embodiments.

  According to an embodiment, the encoding unit 220 may determine a form in which the encoding unit is divided. Referring to FIG. 4, the encoding unit 220 may divide the current encoding unit 400 or 450 and determine two encoding units 420a and 420b or 470a and 470b included in the current encoding unit. The bit stream generation unit 210 can generate a bit stream including division form information indicating such a division form.

  When the encoding unit 220 divides the current encoding unit 400 or 450 in a non-square form according to an embodiment, the current encoding unit is considered in consideration of the position of the long side of the non-square current encoding unit 400 or 450. Can be divided. For example, the encoding unit 220 considers the form of the current coding unit 400 or 450, divides the current coding unit 400 or 450 in the direction of dividing the long side of the current coding unit 400 or 450, and Can be determined, and the bitstream generation unit 210 can generate a bitstream including division form information indicating such a division form.

  According to an embodiment, the encoding unit 220 may determine an odd number of encoding units included in the current encoding unit 400 or 450. For example, the encoding unit 220 may divide the current encoding unit 400 or 450 into three encoding units 430a, 430b, 430c, 480a, 480b, and 480c. According to an embodiment, the encoding unit 220 may determine an odd number of encoding units included in the current encoding unit 400 or 450, and the sizes of the determined encoding units are not the same. Sometimes. For example, in the determined odd number of coding units 430a, 430b, 430c, 480a, 480b, and 480c, the size of the predetermined coding unit 430b or 480b is different from the other coding units 430a, 430c, 480a, and 480c. It can also have different sizes. That is, the coding unit determined by dividing the current coding unit 400 or 450 may have a plurality of types of sizes, and in some cases, an odd number of coding units 430a, 430b, 430c, and 480a. , 480b and 480c can have different sizes.

  According to an embodiment, the encoding unit 220 may determine an odd number of encoding units included in the current encoding unit 400 or 450, and further, the encoding unit 220 may generate an odd number of divided units. A predetermined restriction can be placed on at least one of the coding units. Referring to FIG. 4, the encoding unit 220 is located at the center of the three encoding units 430a, 430b, 430c, 480a, 480b, and 480c generated by dividing the current encoding unit 400 or 450. The decoding process for the coding units 430b and 480b may be different from those of the other coding units 430a, 430c, 480a, and 480c. For example, the encoding unit 220 limits the encoding units 430b and 480b located in the center so that the encoding units 430b and 480b are not further divided unlike the other encoding units 430a, 430c, 480a, and 480c, or about a predetermined number of times. Can be limited to only be divided.

  FIG. 5 illustrates a process in which the video encoding apparatus 200 divides a coding unit according to an embodiment.

  According to an embodiment, the encoding unit 220 may determine that the square first encoding unit 500 is divided into encoding units or not. According to an embodiment, the encoding unit 220 may divide the first encoding unit 500 in the horizontal direction and determine the second encoding unit 510, and the first code used by the embodiment that is a bitstream. The encoding unit, the second encoding unit, and the third encoding unit are terms used for understanding the divisional order relationship between the encoding units. For example, if the first coding unit is divided, the second coding unit is determined, and if the second coding unit is divided, the third coding unit is determined. In the following, it will be understood that the relationship between the first coding unit, the second coding unit, and the third coding unit used is due to the above-described characteristics.

  According to an embodiment, the video encoding apparatus 200 may or may not divide the determined second encoding unit 510 into encoding units based on at least one of block form information and division form information. Can be determined. Referring to FIG. 5, the encoding unit 220 may determine a second code having a non-square shape determined by dividing the first coding unit 500 based on at least one of block form information and division form information. The encoding unit 510 may be divided into at least one third encoding unit 520a, 520b, 520c, 520d or the like, or the second encoding unit 510 may not be divided. The bit stream generation unit 210 of the video encoding device 200 can generate a bit stream including at least one of block form information and division form information, and the encoding unit 220 includes block form information and division form information. The first coding unit 500 may be divided based on at least one of them, and a plurality of various types of, for example, the second coding unit 510 may be divided. The second coding unit 510 may be a block. Based on at least one of the form information and the divided form information, the first coding unit 500 is also divided by the divided method. According to an exemplary embodiment, when the first coding unit 500 is divided into the second coding unit 510 based on at least one of block form information and division form information related to the first coding unit 500, The two coding units 510 are also divided into, for example, third coding units 520a, 520b, 520c, and 520d based on at least one of the block form information and the division form information related to the second coding unit 510. The Therefore, in the non-square coding unit, a square coding unit is determined, and such a square coding unit is recursively divided to determine a non-square coding unit. Referring to FIG. 5, an odd number of third coding units 520b, 520c, and 520d determined by dividing a non-square-shaped second coding unit 510 is a predetermined coding unit (for example, a code located in the middle). (A coding unit or a square-shaped coding unit) is also recursively divided. According to an exemplary embodiment, the square-shaped third coding unit 520c, which is one of the odd number of the third coding units 520b, 520c, and 520d, is divided in the horizontal direction and is divided into a plurality of fourth coding units. Is also divided. The non-square-shaped fourth coding unit 540 that is one of the plurality of fourth coding units is further divided into a plurality of coding units. For example, the non-square fourth encoding unit 540 is further divided into an odd number of encoding units 550a, 550b, and 550c.

  The coding unit is also recursively divided based on at least one of division form information and block form information related to each coding unit. A method used for the recursive division of the coding unit will be described later through various embodiments.

  According to an exemplary embodiment, the encoding unit 220 may divide each of the third encoding units 520a, 520b, 520c, and 520d into encoding units based on at least one of the block configuration information and the partition configuration information. Alternatively, it can be determined that the second coding unit 510 is not divided. The encoding unit 220 may divide the non-square second encoding unit 510 into an odd number of third encoding units 520b, 520c, and 520d according to an embodiment. The video encoding apparatus 200 can place a predetermined restriction on a predetermined third encoding unit among the odd number of third encoding units 520b, 520c, and 520d. For example, the video encoding apparatus 200 restricts the encoding unit 520c located in the middle among the odd number of third encoding units 520b, 520c, and 520d to be not divided any more or to a settable number of times. It can be restricted that it must be split. Referring to FIG. 5, the video encoding apparatus 200 includes a coding unit located in the middle of the odd number of third coding units 520b, 520c, and 520d included in the non-square second coding unit 510. 520c is not further divided or divided into a predetermined division form (for example, divided into only four coding units, or divided into a form corresponding to a form in which the second coding unit 510 is divided). Or may be limited to be divided only a predetermined number of times (for example, divided only n times, n> 0). However, the restriction on the encoding unit 520c located in the middle is merely an embodiment, and is not interpreted as being limited to the above-described embodiment. The coding unit 520c located in the middle is different in code. It should be construed to include various restrictions that are decoded differently from the quantization units 520b and 520d.

  According to an exemplary embodiment, the bitstream generation unit 210 of the video encoding device 200 may use the block configuration information used to divide the current coding unit together with the bitstream related to the sample at a predetermined position in the current coding unit, and A bitstream including at least one of the division form information can be generated.

  FIG. 6 illustrates a method for the encoding unit 220 to determine a predetermined encoding unit among an odd number of encoding units according to an exemplary embodiment. The encoding unit 220 of the video encoding apparatus 200 can determine whether or not to divide the current encoding unit into encoding units of various forms and sizes, or not to divide. Referring to FIG. 6, the bitstream generation unit 210 includes a current code together with a bitstream related to a sample at a predetermined position (for example, the sample 640 located in the middle) among a plurality of samples included in the current encoding unit 600. A bitstream including at least one of the block form information and the division form information of the unit 600 can be generated. However, the predetermined position in the current coding unit 600 related to at least one of the block form information and the division form information is not interpreted as being limited to the middle position illustrated in FIG. Includes various positions (for example, the uppermost end, the lowermost end, the left side, the right side, the upper left side, the lower left side, the upper right side, or the lower right side) included in the current encoding unit 600. There must be.

  According to an embodiment, the video encoding apparatus 200 may select one of the encoding units when the current encoding unit is divided into a predetermined number of encoding units. There are various methods for selecting one of the plurality of coding units, and the description of such a method will be described later through various embodiments below.

  According to an embodiment, the encoding unit 220 of the video encoding apparatus 200 may divide a current encoding unit into a plurality of encoding units and determine an encoding unit at a predetermined position.

  FIG. 6 illustrates a method for the video encoding apparatus 200 to determine an encoding unit at a predetermined position among an odd number of encoding units according to an exemplary embodiment.

  According to an embodiment, the encoding unit 220 may use information indicating positions of the odd number of coding units to determine a coding unit located in the middle among the odd number of coding units. it can. Referring to FIG. 6, the encoding unit 220 may divide the current encoding unit 600 and determine an odd number of encoding units 620a, 620b, and 620c. The encoding unit 220 can determine the middle encoding unit 620b using information regarding the positions of the odd number of encoding units 620a, 620b, and 620c. For example, the encoding unit 220 is positioned in the middle by determining the positions of the encoding units 620a, 620b, and 620c based on information indicating the positions of predetermined samples included in the encoding units 620a, 620b, and 620c. A coding unit 620b can be determined. Specifically, the encoding unit 220 determines the positions of the encoding units 620a, 620b, and 620c based on information indicating the positions of the upper left samples 630a, 630b, and 630c of the encoding units 620a, 620b, and 620c. By doing so, the encoding unit 620b located in the middle can be determined.

  According to one embodiment, information indicating the position of the upper left samples 630a, 630b, and 630c included in the encoding units 620a, 620b, and 620c is the position or coordinates in the picture of the encoding units 620a, 620b, and 620c, respectively. Related information may be included. According to one embodiment, information indicating the positions of the upper left samples 630a, 630b, and 630c included in the encoding units 620a, 620b, and 620c may be stored in the encoding units 620a, 620b, and 620c included in the current encoding unit 600, respectively. Information indicating the width or height may be included, and such width or height corresponds to information indicating a difference between coordinates in the picture of the coding units 620a, 620b, and 620c. That is, the video encoding apparatus 200 directly uses information related to the position or coordinates in the picture of the encoding units 620a, 620b, and 620c, or the width or height of the encoding unit indicating the difference value between the coordinates. By using the information concerning the coding unit 620b, the coding unit 620b located in the middle can be determined.

  According to one embodiment, the information indicating the position of the upper left sample 630a of the upper coding unit 620a may indicate a (xa, ya) coordinate and indicates the position of the upper left sample 630b of the middle coding unit 620b. The information can indicate (xb, yb) coordinates, and the information indicating the position of the upper left sample 630c of the lower end encoding unit 620c can indicate (xc, yc) coordinates. The video encoding apparatus 200 can determine the middle encoding unit 620b using the coordinates of the upper left samples 630a, 630b, and 630c included in the encoding units 620a, 620b, and 620c, respectively. For example, when the coordinates of the samples 630a, 630b, and 630c on the upper left are aligned in ascending or descending order, the encoding unit 620b including (xb, yb) that is the coordinates of the sample 630b located in the middle is used as the current encoding unit. In the coding units 620a, 620b, and 620c determined by dividing 600, the coding unit located in the middle can be determined. However, the coordinates indicating the positions of the upper left samples 630a, 630b, and 630c can indicate the coordinates indicating the absolute position in the picture, and further, the coordinates of the upper left sample 630a of the upper end encoding unit 620a. (Dxb, dyb) coordinates indicating the relative position of the upper left sample 630b of the middle encoding unit 620b, and the relative position of the upper left sample 630c of the lower encoding unit 620c with respect to the position. (Dxc, dyc) coordinates can also be used. In addition, the method for determining the coding unit at the predetermined position by using the coordinates of the sample as information indicating the position of the sample included in the coding unit is not limited to the above-described method. And must be interpreted by a variety of arithmetic methods that can utilize sample coordinates.

  According to an exemplary embodiment, the video encoding apparatus 200 may divide the current encoding unit 600 into a plurality of encoding units 620a, 620b, and 620c, and a predetermined reference among the encoding units 620a, 620b, and 620c. Can select the encoding unit. For example, the encoding unit 220 can select encoding units 620b having different sizes in the encoding units 620a, 620b, and 620c.

  According to an embodiment, the video encoding apparatus 200 may be (xa, ya) coordinates indicating the position of the upper left sample 630a of the upper coding unit 620a, and the position of the upper left sample 630b of the middle coding unit 620b. (Xb, yb) coordinates, which are information indicating the position, and (xc, yc) coordinates, which are information indicating the position of the upper left sample 630c, of the lower end encoding unit 620c. The width or height can be determined. The video encoding apparatus 200 uses (xa, ya), (xb, yb), and (xc, yc), which are coordinates indicating the position of the encoding units 620a, 620b, and 620c, to encode the units 620a, 620b, The size of each of 620c can be determined.

  According to an embodiment, the video encoding apparatus 200 may determine the width of the top coding unit 620a as xb-xa and the height as yb-ya. According to an embodiment, the encoding unit 220 may determine the width of the middle encoding unit 620b as xc-xb and the height as yc-yb. According to one embodiment, the encoding unit 220 uses the width or height of the lower coding unit as the width or height of the current coding unit and the width and height of the upper coding unit 620a and the middle coding unit 620b. Can be determined. The encoding unit 220 can determine an encoding unit having a size different from other encoding units based on the determined width and height of the encoding units 620a, 620b, and 620c. Referring to FIG. 6, the video encoding apparatus 200 determines a middle coding unit 620b having a size different from the size of the upper end coding unit 620a and the lower end coding unit 620c as a coding unit at a predetermined position. Can do. However, the process in which the video encoding apparatus 200 determines a coding unit having a size different from that of other coding units is performed using a size of the coding unit determined based on the sample coordinates. Since this is merely an embodiment for determining the encoding unit of the position, various processes for determining the encoding unit of the predetermined position by comparing the size of the encoding unit determined by the predetermined sample coordinates are used.

  However, the position of the sample considered for determining the position of the coding unit is not limited to the upper left end described above, and information on the position of any sample included in the coding unit is used. To be interpreted.

  According to an embodiment, the video encoding apparatus 200 may select a coding unit at a predetermined position from among an odd number of coding units determined by dividing the current coding unit in consideration of the form of the current coding unit. be able to. For example, if the current coding unit is a non-square shape whose width is greater than the height, the coding unit 220 may determine a coding unit at a predetermined position along the horizontal direction. That is, the encoding unit 220 can determine one of the encoding units whose positions are different in the horizontal direction and place a restriction on the encoding unit. If the current encoding unit is a non-square shape whose height is greater than the width, the encoding unit 220 can determine the encoding unit at a predetermined position along the vertical direction. That is, the encoding unit 220 can determine one of the encoding units whose positions are different in the vertical direction and place a restriction on the encoding unit.

  According to an exemplary embodiment, the video encoding apparatus 200 may use information indicating positions of even number of coding units to determine a coding unit at a predetermined position among even number of coding units. . The encoding unit 220 can divide the current encoding unit and determine an even number of encoding units, and use information related to the positions of the even number of encoding units to determine an encoding unit at a predetermined position. can do. A specific process related to this is similar to the process of determining the coding unit at a predetermined position (for example, the middle position) among the odd number of coding units described in FIG.

  According to an embodiment, when a non-square-shaped current coding unit is divided into a plurality of coding units, a current coding unit is determined to determine a coding unit at a predetermined position among the plurality of coding units. The predetermined information used in the dividing process can be used. For example, the encoding unit 220 of the video encoding device 200 may determine a current encoding unit division process in order to determine an encoding unit located in the middle of the encoding units obtained by dividing the current encoding unit into a plurality of units. As the predetermined information used in the above, at least one of the block form information and the division form information can be used.

  Referring to FIG. 6, the encoding unit 220 of the video encoding apparatus 200 may divide the current encoding unit 600 into a plurality of encoding units 620a, 620b, and 620c. In 620a, 620b, and 620c, the coding unit 620b located in the middle can be determined, and the bitstream generation unit 210 can use the block form information and the division form information used in the division process of the current coding unit 600. A bitstream including at least one can be generated. The encoding unit 220 considers the position of a sample related to at least one bitstream among the block form information and the division form information used in the process of dividing the current encoding unit 600, and determines the coding unit 620b located in the middle. Can be determined. That is, a bit stream including at least one of the block form information and the division form information of the current coding unit 600 is generated together with the bit stream related to the sample 640 located in the middle of the current coding unit 600. The encoding unit 220 may determine the encoding unit 620b including the sample 640 as an encoding unit located in the middle among the plurality of encoding units 620a, 620b, and 620c. However, the information used to determine the coding unit located in the middle among the plurality of coding units determined by dividing the current coding unit was used in the process of dividing the current coding unit. It is not interpreted as being limited to at least one of the block form information and the division form information, and various types of information can be used. In connection with this, the process in which the video encoding apparatus 200 determines the encoding unit at the predetermined position is performed by selecting the encoding unit at the predetermined position among the plurality of encoding units determined by the video decoding apparatus 100 from the current encoding unit. Since it is also a process opposite to the process of determining, detailed description is omitted.

  According to an embodiment, the video encoding apparatus 200 may divide a current encoding unit and determine at least one encoding unit, and may determine a predetermined order in which at least one encoding unit is decoded. It can be determined by block (eg, current coding unit).

  FIG. 7 illustrates an order in which a plurality of coding units are processed when the video coding apparatus 200 divides a current coding unit and determines a plurality of coding units according to an exemplary embodiment. 7 is a process similar to the operation of the video decoding apparatus 100 described with reference to FIG. 7, and thus detailed description thereof is omitted. .

  FIG. 8 illustrates a process in which the video encoding apparatus 200 determines that a current encoding unit is divided into an odd number of encoding units when the encoding units are not processed in a predetermined order according to an embodiment. .

  According to an embodiment, the encoding unit 220 of the video encoding device 200 may determine that the current encoding unit is divided into an odd number of encoding units, and the bitstream generation unit 210 may It is possible to generate a bitstream including block form information indicating the form of the encoding unit and division form information indicating the division form (divided into odd numbers) of the current coding unit. Referring to FIG. 8, a square-shaped first coding unit 800 is divided into non-square-shaped second coding units 810a and 810b, and the second coding units 810a and 810b are each independently It is also divided into encoding units 820a, 820b, 820c, 820d, and 820e. According to an exemplary embodiment, the encoding unit 220 may determine a plurality of third encoding units 820a and 820b by dividing the left encoding unit 810a among the second encoding units in the horizontal direction, and determining a plurality of third encoding units 820a and 820b. The coding unit 810b can be divided into an odd number of third coding units 820c, 820d, and 820e. The process in which the video encoding apparatus 200 according to FIG. 8 determines that the current encoding unit is divided into an odd number of encoding units is a process opposite to the operation of the video decoding apparatus 100 described with reference to FIG. However, detailed description is omitted.

  FIG. 9 illustrates that the video encoding apparatus 200 divides the first encoding unit 900 and determines at least one encoding unit according to an embodiment. According to an embodiment, the encoding unit 220 may divide the first encoding unit 900, and the bitstream generation unit 210 may include block configuration information indicating the form of the first encoding unit 900, and the first encoding unit. It is possible to generate a bitstream including at least one piece of division form information indicating a form in which the unit 900 is divided. The square-shaped first coding unit 900 may be divided into four square-shaped coding units, or may be divided into a plurality of non-square-shaped coding units. For example, referring to FIG. 9, the encoding unit 220 may divide the first encoding unit 900 into a plurality of non-square encoding units. In this case, the bitstream generation unit 210 may Generating a bitstream including block form information indicating that the coding unit 900 is a square and division form information indicating that the first coding unit 900 is divided into non-square coding units; Can do. Specifically, the encoding unit 220 may determine the second encoding units 910a, 910b, 910c determined by dividing the first encoding unit 900 having a square shape into an odd number of encoding units in the vertical direction. Alternatively, it may be divided into second encoding units 920a, 920b, and 920c determined by being divided in the horizontal direction. In this case, the bitstream generation unit 210 converts the first encoding unit 900 into the horizontal direction or the vertical direction. It is possible to generate a bit stream including division form information indicating that an odd number of coding units are determined. The process in which the video encoding apparatus 200 according to FIG. 9 divides the first encoding unit 900 and determines at least one encoding unit is opposite to the operation of the video decoding apparatus 100 described with reference to FIG. Since it is also a process, detailed description is omitted.

  FIG. 10 illustrates a case where the video encoding apparatus 200 performs the second encoding when the non-square second encoding unit determined by dividing the first encoding unit 1000 satisfies a predetermined condition according to an embodiment. FIG. 6 illustrates that the form in which a unit is divided is limited.

  According to an exemplary embodiment, the encoding unit 220 may determine that the square first encoding unit 1000 is divided into non-square second encoding units 1010a, 1010b, 1020a, and 1020b. The second coding units 1010a, 1010b, 1020a, 1020b are divided even if they are independent. Accordingly, the encoding unit 220 can determine that each of the second encoding units 1010a, 1010b, 1020a, and 1020b is divided into a plurality of encoding units or not. When the video encoding apparatus 200 according to FIG. 10 satisfies the predetermined condition for the non-square second encoding unit, the operation of limiting the form of division is the same as that of the video decoding apparatus 100 described with reference to FIG. Since this is also the opposite of the operation, detailed description is omitted.

  FIG. 11 illustrates that the video coding apparatus 200 divides a square-shaped coding unit when the division pattern information cannot indicate that it is divided into four square-shaped coding units according to an embodiment. The process is illustrated. Since the operation of the video encoding apparatus 200 related thereto is also the opposite of the operation of the video decoding apparatus 100 described with reference to FIG. 11, detailed description thereof will be omitted.

  FIG. 12 illustrates that the processing order between a plurality of coding units may vary depending on the division process of the coding units according to an embodiment.

  According to an embodiment, the encoding unit 220 may divide the square first encoding unit 1200 in at least one of a horizontal direction and a vertical direction. According to an exemplary embodiment, the bitstream generation unit 210 may include block form information indicating that the first coding unit 1200 is square, and at least one of the horizontal and vertical directions. It is possible to generate a bit stream including division form information indicating that the data is divided into two.

  According to an embodiment, the encoding unit 220 may divide the first encoding unit 1200 and determine, for example, the second encoding units 1210a, 1210b, 1220a, 1220b, 1230a, 1230b, 1230c, and 1230d. . Referring to FIG. 12, the non-square second encoding units 1210a, 1210b, 1220a, and 1220b, which are determined by dividing the first encoding unit 1200 only in the horizontal direction or the vertical direction, are divided even if they are independent. Is done. For example, the encoding unit 220 divides the second encoding units 1210a and 1210b generated by dividing the first encoding unit 1200 in the vertical direction in the horizontal direction, and generates third encoding units 1216a, 1216b, and 1216c. , 1216d can be determined, and the second encoding units 1220a and 1220b generated by dividing the first encoding unit 1200 in the horizontal direction can be divided in the horizontal direction to obtain third encoding units 1226a, 1226b, 1226c and 1226d can be determined. The operation of the video encoding apparatus 200 according to FIG. 10 is also the opposite of the operation of the video decoding apparatus 100 described with reference to FIG.

  FIG. 13 illustrates that when a coding unit is recursively divided and a plurality of coding units are determined according to an exemplary embodiment, the coding unit depth and the size of the coding unit may be changed. Figure 3 illustrates the process to be determined. The process in which the encoding unit 220 of the video encoding apparatus 200 determines the depth of the encoding unit is the process in which the decoding unit 120 of the video decoding apparatus 100 described in connection with FIG. 13 determines the depth of the encoding unit. Since it is also the opposite, detailed description is omitted.

  According to one embodiment, the video encoding apparatus 200 is divided into specific division forms based on index values for dividing a plurality of encoding units determined by dividing from the current encoding unit. It can be determined whether or not there is. Referring to FIG. 14, the video encoding apparatus 200 divides a rectangular first encoding unit 1410 whose height is larger than a width and determines an even number of encoding units 1412a and 1412b or an odd number. Encoding units 1414a, 1414b, and 1414c can be determined. The video encoding apparatus 200 can use an index (PID) indicating each encoding unit in order to classify each of the plurality of encoding units. According to one embodiment, the PID is obtained from a sample in a predetermined position of each coding unit (eg, left top sample). The operation of the video encoding apparatus 200 according to FIG. 14 is also the opposite of the operation of the video decoding apparatus 100 described with reference to FIG.

  FIG. 15 illustrates a plurality of encoding units determined according to a plurality of predetermined data units included in a picture according to an embodiment. According to an exemplary embodiment, the encoding unit 220 may use the above-described reference encoding unit as a predetermined data unit where recursive division of the encoding unit starts. The operation of the video coding apparatus 200 using the reference coding unit in connection with FIG. 15 is also opposite to the operation of the video decoding apparatus 100 described with reference to FIG. 15 using the reference coding unit. Detailed description will be omitted.

  According to an exemplary embodiment, the bitstream generation unit 210 of the video encoding apparatus 200 may include a bitstream including at least one of information related to a reference coding unit format and information related to a reference coding unit size. It can be generated for each of the various data units. The process of determining at least one coding unit included in the square reference coding unit 1500 will be described through the process of dividing the current coding unit 300 of FIG. Since the process of determining at least one coding unit included in the unit 1500 has been described through the process of dividing the current coding unit 400 or 450 of FIG. 4, detailed description thereof will be omitted.

  According to one embodiment, the encoding unit 220 determines the size and form of the reference coding unit according to the predetermined partial data unit based on a predetermined condition. An index for identifying the form can be used. That is, the bitstream generation unit 210 sets a predetermined condition (for example, a data unit having a size equal to or smaller than a slice) among the various data units (for example, a sequence, a picture, a slice, a slice segment, a maximum coding unit, and the like). For each satisfied data unit, a bitstream can be generated that includes an index for identifying the size and form of the reference coding unit. The encoding unit 220 can determine the size and form of the reference data unit for each data unit that satisfies the predetermined condition by using the index. According to an embodiment, at least one of the size and form of the reference coding unit related to the index indicating the size and form of the reference coding unit is determined in advance. That is, the encoding unit 220 selects at least one of the predetermined size and form of the reference coding unit by using an index, so that the reference coding unit included in the data unit serving as a reference for index acquisition can be selected. At least one of size and shape can be determined. Since the operation of the encoding unit 220 using the index for identifying the size and form of the reference encoding unit is similar to the operation of the decoding unit 120 described above, detailed description thereof is omitted.

  FIG. 16 illustrates a processing block serving as a reference for determining a determination order of reference coding units included in the picture 1600 according to an embodiment.

  According to an exemplary embodiment, the encoding unit 220 may obtain information on the size of a processing block and determine the size of at least one processing block included in the video. The encoding unit 220 can determine the size of at least one processing block included in the video, and the bit stream generation unit 210 can generate a bit stream including information related to the size of the processing block. . The size of such a processing block is also a predetermined size of a data unit indicated by information related to the size of the processing block.

  According to an exemplary embodiment, the bitstream generation unit 210 of the video encoding device 200 can generate a bitstream including information related to the size of a processing block for each specific data unit. For example, a bit stream including information related to the size of a processing block can be generated for each data unit such as a video, a sequence, a picture, a slice, and a slice segment. That is, the bitstream generation unit 210 can generate a bitstream including information related to the size of the processing block for each of the many data units, and the encoding unit 220 relates to the size of the processing block. Information can be used to determine the size of at least one processing block that divides a picture, and the size of such a processing block is also an integer multiple of the reference coding unit.

  According to an embodiment, the encoding unit 220 may determine the size of the processing blocks 1602 and 1612 included in the picture 1600. For example, the encoding unit 220 can determine the size of the processing block based on information related to the size of the processing block. Referring to FIG. 16, the encoding unit 220 may set the horizontal size of the processing blocks 1602 and 1612 to four times the reference coding unit horizontal size, the vertical size, and the vertical size of the reference coding unit according to an exemplary embodiment. It can be determined as 4 times. The encoding unit 220 can determine the order in which at least one reference encoding unit is determined in at least one processing block. Since the operation of the encoding unit 220 related to the processing block is similar to the operation of the decoding unit 120 described with reference to FIG. 16, detailed description thereof is omitted.

  According to an embodiment, the bitstream generation unit 210 of the video encoding apparatus 200 generates a bitstream including block form information indicating the form of the current coding unit or division form information indicating a method of dividing the current coding unit. be able to. The block form information or the division form information may be included in a bit stream related to various data units. For example, the bit stream generation unit 210 of the video encoding device 200 includes a sequence parameter set, a picture parameter set, a video parameter set, a slice header, and a slice. Block form information or division form information included in a segment header can be used. Further, the bit stream generation unit 210 of the video encoding device 200 may generate a bit stream including syntax indicating block form information or division form information for each maximum coding unit, reference coding unit, and processing block. it can.

  According to an exemplary embodiment, the encoding unit 220 may determine the type of division form in which the encoding unit is divided so as to be different for each predetermined data unit. The encoding unit 220 of the video encoding device 200 determines, in one embodiment, different combinations of forms in which the encoding units are divided for each predetermined data unit (eg, sequence, picture, slice, etc.). be able to.

  FIG. 17 illustrates coding units determined for each picture when combinations of forms in which the coding units are divided are different for each picture according to an embodiment.

  Referring to FIG. 17, the encoding unit 220 can determine different combinations of division forms in which encoding units are divided for each picture. For example, the encoding unit 220 may include a picture 1700 that is also divided into four coding units of at least one picture included in the video, a picture 1710 that is also divided into two or four coding units, and Video can be decoded using a picture 1720 that is also divided into two, three, or four coding units. The encoding unit 220 can divide the picture 1700 into four square encoding units. The encoding unit 220 can divide the picture 1710 into two or four encoding units. The encoding unit 220 can divide the picture 1720 into two, three, or four encoding units. Since the combination of the above-described division forms is merely an embodiment for explaining the operation of the video encoding device 200, the combination of the above-described division forms is not interpreted as being limited to the above-described embodiment, For each data unit, it must be interpreted that a combination of various forms of division is used.

  According to an embodiment, the encoding unit 220 of the video encoding apparatus 200 uses an index indicating a combination of division form information to determine a combination of division forms into which the encoding unit is divided for each predetermined data unit. Accordingly, combinations of different division forms can be used for each predetermined data unit. Furthermore, the bit stream generation unit 210 of the video encoding device 200 may generate a bit stream including an index indicating a combination of division form information for each predetermined data unit (for example, sequence, picture, slice, etc.). it can. For example, the bitstream generation unit 210 can generate a sequence parameter set, a picture parameter set, or a slice header including an index indicating a combination of division form information.

  FIG. 18 and FIG. 19 illustrate various forms of coding units determined based on partition form information represented by a binary code according to an embodiment.

  According to an exemplary embodiment, the encoding unit 220 of the video encoding apparatus 200 may divide the encoding unit into various forms, and the bit including the block form information and the division form information via the bit stream generation unit 210. A stream can be generated. The form of the coding unit to be divided corresponds to various forms including the form described through the above-described embodiment. Referring to FIG. 18, the encoding unit 220 may divide a square-shaped encoding unit into at least one of a horizontal direction, a horizontal direction, and a vertical direction based on the division form information. Can be divided horizontally or vertically. Since the characteristics related to the binary code of the division form information that can be used by the video encoding apparatus 200 correspond to the characteristics of the video decoding apparatus 100 described with reference to FIGS. 18 and 19, detailed description thereof will be omitted.

  The video encoding apparatus 200 according to an embodiment performs inter prediction or intra prediction on a coding unit, generates prediction data, performs inverse conversion on a conversion unit included in the current coding unit, and stores residual data. And the current encoding unit can be encoded using the generated prediction data and residual data.

  The prediction mode of a coding unit according to an embodiment is at least one of an intra mode, an inter mode, and a skip mode. According to one embodiment, prediction is performed independently for each coding unit, and the smallest prediction mode is selected.

  When a 2Nx2N-type coding unit according to an embodiment is divided and divided into two 2NxN or two Nx2N-type coding units, inter-mode prediction and intra-mode prediction are performed for each of the coding units. Are performed separately. Also, according to an embodiment, the encoding unit 220 of the video encoding apparatus 200 uses the CU skip mode not only when the encoding unit is a square shape but also when the encoding unit is a non-square shape. Thus, the encoding unit can be encoded. Video is decoded using the CU skip mode not only in the case of a square coding unit determined based on at least one of block form information and division form information but also in a non-square coding unit. This makes it possible to use a relatively more adaptive skip mode, thereby improving video encoding / decoding efficiency. The characteristics of the video encoding apparatus 200 using the skip mode in such a non-square encoding unit are similar to the characteristics described in connection with the use of the skip mode of the video encoding apparatus 200. The detailed explanation is omitted.

  FIG. 22 illustrates a process of merging or splitting between coding units determined by a predetermined coding method according to an embodiment.

  According to an embodiment, the video encoding apparatus 200 may determine a coding unit for dividing a picture using the predetermined coding method described above. For example, the video encoding apparatus 200 can determine the encoding unit of the current depth based on the division information of the encoding unit, or can divide into four encoding units of the lower depth. As described above, the video encoding apparatus 200 may indicate that the current coding unit always has a square shape, block form information indicating that the current coding unit is not divided, or 4 according to an embodiment. The encoding unit can be determined using the division form information that can indicate that the unit is to be divided into square-shaped encoding units. Referring to FIG. 22, pictures 2200 and 2220 are divided by a square coding unit determined by the above-described predetermined coding method.

  However, in the case of the above-described predetermined decoding unit, whether or not the current coding unit is divided is suitable for expressing a relatively small object (object) included in the current coding unit. Because of this, it may not be possible for large objects and small objects in a picture to be encoded through one encoding unit. Here, an object is a set of samples included in a picture, and means a sample area that is distinguished from other areas by having similar sample values. Referring to FIG. 22, the video encoding apparatus 200 divides the first encoding unit 2222 into four sub-depth encoding units to restore the small object 2221, thereby reducing the small object 2221. A coding unit for decoding can be determined. However, since the large object 2223 is not included in the current encoding unit 2222, the large object 2223 is not suitable for decoding using the current encoding unit 2222, and furthermore, for decoding the small object 2221. Since the current encoding unit 2222 is divided, an unnecessary encoding unit division process must be performed for decoding the large object 2223, which is inefficient. That is, if the video encoding apparatus 200 can use one encoding unit to encode the portion for the large object 2223, video encoding can be performed efficiently.

  According to an embodiment, the encoding unit 220 of the video encoding apparatus 200 may divide a current coding unit using at least one of block form information and division form information, and the block form information may be square. It is determined in advance that only the shape is used, and it is determined in advance that the division form information can indicate that the image is not divided or is divided into four square coding units. This corresponds to a coding unit determination process used in the predetermined coding method described through various embodiments. In this case, the encoding unit 220 merges the coding units determined using the predetermined encoding method, or splits the determined coding unit into pictures. The sample values included in can be used. For example, the encoding unit 220 can examine portions having similar sample values and detect various objects included in the picture. Based on the portions related to the detected objects, the encoding unit 220 can detect a variety of objects. The merge / split process can be performed.

  Referring to FIG. 22, according to an embodiment, the encoding unit 220 may determine a plurality of encoding units for dividing the picture 2200 using the predetermined encoding method described above. However, there is a case where a process of dividing a similar region into a plurality of coding units that are not one coding unit may be performed even though there is a portion 2201 having a similar sample value included in the picture. obtain. In this case, the encoding unit 220 merges such an encoding unit into one encoding unit 2202 and encodes it as one encoding unit even if the encoding unit is determined through a predetermined encoding method. Can be Referring to FIG. 22, as another embodiment, the encoding unit 220 uses the predetermined encoding method described above to change the encoding unit 2222 for encoding the small object 2221 into four encoding units. Can be divided into In the case of the coding unit thus divided, since none of the detected large objects 2223 is included, the coding unit 220 performs coding unit into one coding unit including a part having a similar sample value. Can be merged (2225).

  According to one embodiment, the encoding unit 220 uses the encoding unit division information and does not divide the encoding unit or uses a predetermined encoding method that divides the encoding unit into four encoding units. After determining the encoding unit, the encoding unit can be further divided in consideration of the sample value of the sample included in the picture. That is, the encoding unit 120 can divide the already determined encoding unit as well as the merge between the encoding units in order to determine the encoding unit for each object. Referring to FIG. 22, the encoding unit 120 may merge the encoding units for the object 2223, and for the object 2223 to determine the encoding unit optimized for the object 2223. Can be further divided (2226). That is, the encoding unit 220 can determine a part that does not include the object 2223 as an encoding unit 2227 that is separate from the object 2223 through the division (2226) process.

  The process of recursively dividing the coding unit according to the block form information and the block division information according to the embodiment and determining a plurality of coding units is as described with reference to FIG. In the filtering unit loop filtering performance information according to an embodiment, when the flag value is 1, it indicates that loop filtering is performed on the filtering unit, and when the flag value is 0, loop filtering is not performed. . Referring to Table 1, data unit information for determining a filtering unit to be filtered by the loop filtering units 2040 and 2070 is encoded and transmitted as filter information.

  According to an embodiment, the configured encoding unit is an encoding unit configured to minimize an error from the original image, and thus, a spatial correlation degree is expected to be high in the encoding unit. . Therefore, by determining the filtering unit based on the encoding unit according to the embodiment, the operation of determining the filtering unit separately from the determination of the encoding unit may be omitted. Also, by determining the filtering unit based on the coding unit according to one embodiment, information for determining the division form of the filtering unit can be omitted, so the transmission bit rate of the filter information can be reduced. Can be saved.

  In the above-described embodiment, it has been described that the filtering unit is determined based on the coding unit according to one embodiment. However, the filtering unit is divided based on the coding unit, and further at an arbitrary depth. Without dividing, the form of the filtering unit may be determined only up to the depth.

  The determination of the filtering unit disclosed in the above embodiment is applied not only to loop filtering but also to various embodiments such as deblocking filtering and adaptive loop filtering.

  According to an embodiment, the video decoding apparatus 100 may divide a current coding unit using at least one of block form information and division form information, and the block form information may use only a square shape. It is determined in advance, and the division form information is determined in advance so as to indicate that it is not divided or divided into four square-shaped coding units. That is, according to the block form information, the current coding unit always has a square shape, and is not divided based on the division form information, or four square shaped coding units. Also divided into. The video decoding apparatus 100 can acquire a bitstream generated using a predetermined encoding method determined in advance using only the block form and the division form via the bitstream acquisition unit 120. The decoding unit 130 can use only a predetermined block form and division form. In such a case, the video decoding apparatus 100 can solve the compatibility problem with the predetermined encoding method by using a predetermined decoding method similar to the above-described predetermined encoding method. According to an embodiment, the video decoding apparatus 100 uses the above-described predetermined decoding method that uses only a predetermined block form and division form among various forms that can be indicated by the block form information and the division form information. In this case, since the block form information indicates only a square shape, the video decoding apparatus 100 can omit the process of acquiring the block form information from the bit stream. A syntax indicating whether or not to use the above-described predetermined decoding method is used. Such syntax includes various coding units including a plurality of coding units such as a sequence, a picture, a slice unit, and a maximum coding unit. For each form of data unit, it can be obtained from the bitstream. That is, the bitstream acquisition unit 120 can determine whether to acquire the syntax indicating the block form information from the bitstream based on the syntax indicating the usage of the predetermined decoding method.

  FIG. 23 illustrates an index according to a Z-scan order of coding units according to one embodiment.

  The video decoding apparatus 100 according to an embodiment may scan the lower data unit included in the upper data unit according to the Z scan order. In addition, the video decoding apparatus 100 according to an embodiment can sequentially access data using a Z scan index in a maximum coding unit or a coding unit included in a processing block.

  As described with reference to FIGS. 3 and 4, the video decoding apparatus 100 according to an embodiment can divide the reference coding unit into at least one coding unit. At this time, a square-shaped coding unit and a non-square-shaped coding unit are mixed in the reference coding unit. The video decoding apparatus 100 according to an embodiment can perform data access using a Z scan index included in each coding unit in the reference coding unit. At this time, the method of applying the Z scan index may differ depending on whether or not a non-square-shaped coding unit exists in the reference coding unit.

  According to an embodiment, when there are no non-square-shaped coding units in the reference coding unit, coding units at lower depths in the reference coding unit may have a continuous Z scan index. For example, according to an embodiment, the upper depth coding unit may include four lower depth coding units. Here, the four sub-depth coding units have continuous adjacent boundaries, and each sub-depth coding unit is scanned in the Z scan order by an index indicating the Z scan order. The The index indicating the Z scan order according to an embodiment is set to a number that increases with the Z scan order for each coding unit. In that case, scanning can be performed in the Z scanning order between the coding units by depth of the same depth.

  According to an embodiment, when there are at least one or more non-square coding units in the reference coding unit, the video decoding apparatus 100 divides each coding unit in the reference coding unit into sub-blocks, The divided sub-blocks can be scanned in the Z scan order. For example, when there is a non-square coding unit in the vertical direction or the horizontal direction in the reference coding unit, Z scanning can be performed using the divided sub-blocks. Further, for example, when division is performed into an odd number of coding units in the reference coding unit, Z scanning can be performed using sub-blocks. The sub-block is obtained by dividing a coding unit that is not divided any further, or an arbitrary coding unit, and also has a square shape. For example, four square sub-blocks are divided from a square coding unit. For example, two square sub-blocks are divided from a non-square coding unit.

  Referring to FIG. 23, for example, the video decoding apparatus 100 according to an embodiment may scan lower depth coding units 2302, 2304, 2306, 2308, and 2310 in the coding unit 2300 according to the Z scan order. . The coding unit 2300 and the coding units 2302, 2304, 2306, 2308, and 2310 are relatively higher coding units and lower coding units, respectively. Coding unit 2300 includes non-square coding units 2306 and 2310 in the horizontal direction. These non-square coding units 2306 and 2310 have discontinuous boundaries with adjacent square coding units 2302 and 2304. Also, the coding unit 2308 has a square shape, an odd number of non-square coding units, and is a coding unit positioned in the middle when divided. Similar to the non-square coding units 2306 and 2310, the coding unit 2308 has a discontinuous boundary with the adjacent square coding units 2302 and 2304. The encoding unit 2300 includes non-square encoding units 2306 and 2310, or there are an odd number of non-square encoding units and includes an encoding unit 2308 located in the middle during division. In this case, since the adjacent boundary between coding units is discontinuous, a continuous Z scan index is not set. Accordingly, the video decoding apparatus 100 can continuously set the Z scan index by dividing the coding unit into sub-blocks. In addition, the video decoding apparatus 100 performs continuous Z scans on the non-square coding units 2306 and 2310 or the coding unit 2308 located in the middle of the odd-numbered non-square coding units. It can be carried out.

  The coding unit 2320 illustrated in FIG. 23 is obtained by dividing the coding units 2302, 2304, 2306, 2308, and 2310 in the coding unit 2300 into sub-blocks. A Z scan index is set for each sub-block, and adjacent boundaries between sub-blocks are continuous. Therefore, scanning can be performed according to the Z-scan order between sub-blocks. For example, in the decoding apparatus according to an embodiment, the coding unit 2308 is also divided into sub-blocks 2322, 2324, 2326, and 2328. At this time, the sub-blocks 2322 and 2324 can be scanned after data processing on the sub-block 2330, and the sub-blocks 2326 and 2328 can be scanned after data processing on the sub-block 2332. Further, each sub-block is scanned in the Z-scan order.

  In the above-described embodiment, scanning the data unit according to the Z scan order is also for data storage, data loading, data access, and the like.

  In the above-described embodiment, it has been described that the data unit can be scanned in the Z scan order. However, the scan order of the data unit is raster scan, N scan, upper right diagonal scan, horizontal scan, vertical scan. It is performed by various scan orders such as scans, and is not interpreted as being limited to the Z scan order.

  Further, in the above-described embodiment, it has been described that the scanning is performed on the coding unit in the reference coding unit. However, the present invention is not limited to this, and the target of scanning is the maximum coding unit, Or any block within the processing block.

  Further, in the above-described embodiment, it has been described that the non-square block is divided into sub-blocks only when at least one or more blocks are present, and scanning according to the Z-scan order is performed, but for simplified implementation, Even when there is no non-square block, it is possible to divide the sub-block and perform scanning in the Z-scan order.

  The video decoding apparatus 100 according to an embodiment performs inter prediction or intra prediction on a coding unit to generate prediction data, and performs inverse transformation on a transform unit included in the current coding unit to obtain residual data. The current encoding unit can be restored using the generated prediction data and residual data.

  The prediction mode of a coding unit according to an embodiment is at least one of an intra mode, an inter mode, and a skip mode. According to one embodiment, the prediction mode is selected independently for each coding unit.

  When a 2Nx2N-type coding unit according to an embodiment is divided and divided into two 2NxN-type or two Nx2N-type coding units, inter-mode prediction and intra-mode prediction are performed for each of the coding units. Is also done separately. In addition, the skip mode may be applied to a 2NxN or Nx2N coding unit according to an embodiment.

  Meanwhile, the video decoding apparatus 100 according to an embodiment may be allowed to perform bi-prediction in the 8 × 4 or 4 × 8 coding unit skip mode. In the skip mode, since only the skip mode information is transmitted to the coding unit, the use of residual data for the coding unit is omitted. Therefore, in that case, overhead for inverse quantization and inverse transform can be saved. Instead, the video decoding apparatus 100 according to an embodiment can increase the decoding efficiency by allowing bi-directional prediction for a coding unit to which the skip mode is applied. Also, the video decoding apparatus 100 according to an embodiment allows bi-directional prediction for an 8 × 4 or 4 × 8 coding unit, but relatively reduces the number of interpolation taps in the motion compensation stage. Set and use memory bandwidth efficiently. As an example, instead of using an 8-tap interpolation filter, an interpolation filter having a tap number of less than 8 (for example, a 2-tap interpolation filter) may be used.

  In addition, the video decoding apparatus 100 according to an embodiment divides a region included in a current encoding unit into an already set form (for example, diagonally-shaded division), and intra prediction information regarding each divided region or Inter prediction information can also be signaled.

  The video decoding apparatus 100 according to an embodiment may obtain a prediction sample of a current coding unit using an intra mode and a neighboring sample of the current coding unit. At this time, in the intra prediction, prediction is performed using neighboring reconstructed samples, and such samples are referred to as reference samples.

  FIG. 24 is a diagram illustrating reference samples for intra prediction of a coding unit according to an embodiment. Referring to FIG. 24, for the current coding unit 2300 in which the block form is a non-square form, the horizontal length is w, and the vertical length is h, the upper reference sample 2302 is w + h, left reference sample 2304 is w + h, left upper reference sample 2306 is 1, and a total of 2 (w + h) +1 reference samples are required. In order to reduce the quantization error included in the reconstructed reference sample, the reference sample filtering process according to the prediction mode is performed in order to reduce the quantization error included in the reconstructed reference sample through the step of performing padding on the portion where the reference sample does not exist. You can also.

  In the above-described embodiment, the number of reference samples in the case where the block form of the current coding unit is a non-square form has been described, but the number of such reference samples is a block form in which the current coding unit is a rectangular shape. The same applies to the case of.

  The various embodiments described above describe operations related to the video decoding method performed by the video decoding apparatus 100. Hereinafter, an operation of the video encoding apparatus 200 that performs the video encoding method corresponding to the reverse process of the video decoding method will be described through various embodiments.

  FIG. 2 illustrates a block diagram of a video encoding apparatus capable of encoding a video based on at least one of block form information and division form information according to an embodiment.

  Referring to FIG. 2, according to an embodiment, the video encoding apparatus 200 uses a data unit determination unit 210 that determines a data unit for intra prediction from a video picture, and a first intra prediction using predetermined prediction information. Generating a first prediction value related to the first data unit according to the prediction type, generating a second prediction value related to the second data unit according to the second intra prediction type using a data unit adjacent to the data unit; A bit stream generation unit 230 that generates a bit stream including encoding information determined based on at least one of the first prediction value and the second prediction value and encodes a video picture, and an encoding unit 220 may be included. Good. Here, the intra prediction type information is information indicating that the data unit is predicted by at least one type of the first intra prediction type or the second intra prediction type, and the first intra prediction type is a peripheral The data unit is predicted using other information that is not the sample value of the data unit, and the second intra prediction type is also used to predict the data unit using the sample value of the peripheral data unit.

  According to an exemplary embodiment, the data unit determination unit 210 of the video encoding apparatus may determine whether a data unit is predicted according to a first intra prediction type or a second intra prediction type. . On the other hand, for example, the data unit may be one of a coding unit, a prediction unit, or a transform unit.

  According to an embodiment, the encoding unit 220 of the video encoding apparatus 200 generates a first prediction value related to the first data unit according to the first intra prediction type, and generates a first prediction value related to the second data unit according to the second intra prediction type. 2 prediction values can be generated. Also, the encoding unit 220 can generate encoded information using the first predicted value and the second predicted value. For example, the prediction based on the first intra prediction type is to perform intra prediction using other information that is not in the peripheral data unit. For example, the prediction based on the second intra prediction type is to perform intra prediction using peripheral data units.

  According to an exemplary embodiment, the bitstream generation unit 230 of the video encoding device 200 may generate a bitstream that includes encoding information determined based on at least one of the first predicted value and the second predicted value. it can. In addition, the bitstream generation unit 230 may include intra prediction type information indicating whether the first data unit is predicted by the first intra prediction type or the second intra prediction type in the bitstream. it can.

  FIG. 3 illustrates a process of determining a first data unit predicted by a first intra prediction type and a second data unit predicted by a second intra prediction type according to an embodiment.

  According to an exemplary embodiment, the data unit determination unit 210 may determine the first data unit 310 predicted by the first intra prediction type and the second data unit 320 predicted by the second intra prediction type. That is, it is determined whether the predicted data unit is predicted using the peripheral data unit, or is predicted using other information that is not information related to the peripheral data unit.

  According to an exemplary embodiment, the encoding unit 220 may generate a predicted value for a data unit using other information that is not information related to a peripheral data unit. For example, the encoding unit 220 can generate a prediction value for each data unit using a value stored in advance. For example, the value stored in advance is determined by the RDO result.

  Since this is a process opposite to the operation of the video decoding apparatus 100 described with reference to FIG. 3, detailed description thereof is omitted.

  FIG. 4 illustrates a process of predicting a first data unit according to a first intra prediction type based on predetermined prediction information according to an embodiment.

  According to an exemplary embodiment, the encoding unit 220 may predict the first data unit 420 predicted by the first intra prediction type using other information that is not information related to the peripheral data unit. For example, the first data unit 420 is also predicted by using the sample value 410 adjacent to the upper layer data unit in which the first data unit 420 is included. The sample value 410 adjacent to the upper layer data unit including the first data unit 420 may include information related to peripheral pixels at the CTU boundary or information related to peripheral pixels at the CU boundary. When prediction is performed using information related to neighboring pixels at the CTU boundary, the prediction target unit is also a CU, PU, TU, or CTU. When performing prediction using information related to neighboring pixels at the CU boundary, the prediction target unit is also PU, TU, or CU.

  FIG. 5 illustrates a process of predicting a second data unit according to a second intra prediction type that predicts using adjacent data units according to an exemplary embodiment.

  According to an embodiment, the encoding unit 220 may perform prediction using a second intra prediction type using a data unit adjacent to the data unit. For example, when prediction is performed on the data unit 510, information 511 related to the encoded data unit 530 can be used according to the first intra prediction type adjacent to the lower end of the data unit 510. For example, when prediction is performed on the data unit 520, information 521 related to the data unit 530 encoded in advance can be used according to the first intra prediction type adjacent to the right side of the data unit 520.

  According to an exemplary embodiment, the encoding unit 220 may perform prediction using the left and upper sample values when the distance between the left and upper ends is close according to the predicted pixel position in the data unit 510. Alternatively, according to an exemplary embodiment, the encoding unit 220 may perform prediction using the sample values on the right and bottom edges when the distance between the right side and the bottom edge is close depending on the predicted pixel position in the data unit 510.

  Since this is a process opposite to the operation of the video decoding apparatus 100 described with reference to FIG. 6, detailed description thereof is omitted.

  FIG. 7 illustrates a process of determining a first intra prediction type and a second intra prediction type for a data unit according to an embodiment.

  According to one embodiment, the bitstream generation unit 230 generates a prediction value according to the first intra prediction type or a prediction value according to the second intra prediction type for each CU, PU, or TU. Intra prediction type information indicating this can be included in the bitstream.

  According to one embodiment, the bitstream generation unit 230 performs prediction based on the first intra prediction type for the Intra_DC mode, and indicates that prediction is performed based on the second intra prediction type for other modes besides the Intra_DC mode. Prediction type information can be included in the bitstream.

  According to an embodiment, the bitstream generation unit 230 may include intra prediction type information indicating whether a data unit is classified as one of a first data unit and a second data unit in the bitstream. it can.

  FIG. 9 illustrates a flowchart of a video encoding method using intra prediction type information according to an embodiment.

  In step S910, the data unit determination unit 210 of the video encoding device 200 determines a first data unit predicted by the first intra prediction type or a second data unit predicted by the second intra prediction type. Can do. For example, the first intra prediction type is to perform prediction for a data unit using other information that is not a sample value of a data unit adjacent to the data unit. For example, in the second intra prediction type, a prediction for a data unit is performed using a sample value of a data unit adjacent to the data unit.

  In step S920, the encoding unit 220 of the video encoding device 200 generates a first prediction value related to the first data unit according to the first intra prediction type.

  In step S930, the encoding unit 220 of the video encoding device 200 generates a second predicted value related to the second data unit according to the second intra prediction type.

  In step S940, the bitstream generation unit 230 of the video encoding device 200 may generate a bitstream that includes encoding information determined based on at least one of the first predicted value and the second predicted value. . The encoding unit 220 can encode a video picture in which a bitstream is generated.

  FIG. 10 illustrates a case where the video encoding apparatus 200 performs the second encoding when the non-square second encoding unit determined by dividing the first encoding unit 1000 satisfies a predetermined condition. FIG. 6 illustrates that the form in which a unit is divided is limited.

  According to an embodiment, the encoding unit 220 may determine to divide the square-shaped first encoding unit 1000 into the non-square-shaped second encoding units 1010a, 1010b, 1020a, and 1020b. The second coding units 1010a, 1010b, 1020a, 1020b are divided even if they are independent. Accordingly, the encoding unit 220 can determine that each of the second encoding units 1010a, 1010b, 1020a, and 1020b is divided into a plurality of encoding units or not. When the video encoding apparatus 200 according to FIG. 10 satisfies the predetermined condition for the non-square second encoding unit, the operation of limiting the form of division is the same as that of the video decoding apparatus 100 described with reference to FIG. Since this is also the opposite of the operation, detailed description is omitted.

  FIG. 11 illustrates a process in which the video coding apparatus 200 divides a square-shaped coding unit when the division mode information cannot indicate that it is divided into four square-shaped coding units according to an embodiment. Is illustrated. Since the operation of the video encoding apparatus 200 related thereto is also the opposite of the operation of the video decoding apparatus 100 described with reference to FIG. 11, detailed description thereof will be omitted.

  FIG. 12 illustrates that the processing order between a plurality of coding units may vary depending on the coding unit division process according to an embodiment.

  According to an embodiment, the encoding unit 220 may divide the square first encoding unit 1200 in at least one of a horizontal direction and a vertical direction. According to an embodiment, the bitstream generator 230 may include block form information indicating that the first coding unit 1200 is square, and the first coding unit 1200 may be at least one of a horizontal direction and a vertical direction. It is possible to generate a bit stream including division form information indicating that the data is divided into two.

  According to an embodiment, the encoding unit 220 may divide the first encoding unit 1200 and determine, for example, the second encoding units 1210a, 1210b, 1220a, 1220b, 1230a, 1230b, 1230c, and 1230d. . Referring to FIG. 12, non-square second coding units 1210a, 1210b, 1220a, and 1220b, which are determined by dividing the first coding unit 1200 only in the horizontal direction or the vertical direction, may be independent. Divided. For example, the encoding unit 220 divides the second encoding units 1210a and 1210b generated by dividing the first encoding unit 1200 in the vertical direction in the horizontal direction, and generates third encoding units 1216a, 1216b, 1216c and 1216d can be determined, and the second encoding units 1220a and 1220b generated by dividing the first encoding unit 1200 in the horizontal direction are respectively divided in the horizontal direction to obtain third encoding units 1226a and 1226a, 1226b, 1226c and 1226d can be determined. The operation of the video encoding apparatus 200 according to FIG. 10 is also the opposite of the operation of the video decoding apparatus 100 described with reference to FIG.

  FIG. 13 illustrates that when a coding unit is recursively divided and a plurality of coding units are determined according to an embodiment, the coding unit depth and the size of the coding unit may be changed, thereby reducing the depth of the coding unit. Figure 3 illustrates the process to be determined. The process in which the encoding unit 220 of the video encoding apparatus 200 determines the depth of the encoding unit is opposite to the process in which the decoding unit 130 of the video decoding apparatus 100 described with reference to FIG. 13 determines the depth of the encoding unit. Therefore, detailed description is omitted.

  According to one embodiment, the video encoding apparatus 200 is divided into specific division forms based on index values for dividing a plurality of encoding units determined by dividing from the current encoding unit. It can be determined whether or not there is. Referring to FIG. 14, the video encoding apparatus 200 divides a rectangular first encoding unit 1410 whose height is larger than a width and determines an even number of encoding units 1412a and 1412b or an odd number. Encoding units 1414a, 1414b, and 1414c can be determined. The video encoding apparatus 200 can use an index (PID) indicating each encoding unit in order to classify each of the plurality of encoding units. According to one embodiment, the PID is obtained with a sample in a predetermined position of each coding unit (eg, left top sample). The operation of the video encoding apparatus 200 according to FIG. 14 is also the opposite of the operation of the video decoding apparatus 100 described with reference to FIG.

  FIG. 15 illustrates a plurality of encoding units determined according to a plurality of predetermined data units included in a picture according to an embodiment. According to an exemplary embodiment, the encoding unit 220 may use the above-described reference encoding unit as a predetermined data unit where recursive division of the encoding unit starts. The operation of the video coding apparatus 200 using the reference coding unit in connection with FIG. 15 is opposite to the operation of the video decoding apparatus 100 described with reference to FIG. 15 using the reference coding unit. Therefore, detailed description is omitted.

  According to an exemplary embodiment, the bitstream generation unit 230 of the video encoding device 200 may include a bitstream including at least one of information related to a reference coding unit type and information related to a reference coding unit size. It can be generated for each of the various data units. The process of determining at least one coding unit included in the square reference coding unit 1500 will be described through the process of dividing the current coding unit 300 of FIG. Since the process of determining at least one coding unit included in the unit 1500 has been described through the process of dividing the current coding unit 400 or 450 of FIG. 4, detailed description thereof will be omitted.

  According to one embodiment, the encoding unit 220 determines the size and form of the reference coding unit according to the predetermined partial data unit based on a predetermined condition. An index for identifying the form can be used. That is, the bitstream generation unit 230 sets a predetermined condition (for example, a data unit having a size equal to or less than a slice) among the various data units (for example, a sequence, a picture, a slice, a slice segment, a maximum coding unit, and the like). For each satisfied data unit, a bitstream can be generated that includes an index for identifying the size and form of the reference coding unit. The encoding unit 220 can determine the size and form of the reference data unit for each data unit that satisfies the predetermined condition by using the index. According to an embodiment, at least one of the size and form of the reference coding unit related to the index indicating the size and form of the reference coding unit is determined in advance. That is, the encoding unit 220 selects at least one of the predetermined size and form of the reference coding unit by using an index, and thereby includes a reference coding unit included in a data unit serving as a reference for index acquisition. At least one of the size and the form of can be determined. Since the operation of the encoding unit 220 using an index for identifying the size and form of the reference encoding unit is similar to the operation of the decoding unit 130 described above, detailed description thereof is omitted.

  FIG. 16 illustrates a processing block serving as a reference for determining a determination order of reference coding units included in the picture 1600 according to an embodiment.

  According to an exemplary embodiment, the encoding unit 220 may obtain information on the size of a processing block and determine the size of at least one processing block included in the video. The encoding unit 220 can determine the size of at least one processing block included in the video, and the bit stream generation unit 230 can generate a bit stream including information related to the size of the processing block. . The size of such a processing block is also a predetermined size of a data unit indicated by information related to the size of the processing block.

  According to an embodiment, the bit stream generation unit 230 of the video encoding device 200 can generate a bit stream including information related to the size of a processing block for each specific data unit. For example, a bit stream including information related to the size of a processing block can be generated for each data unit such as a video, a sequence, a picture, a slice, and a slice segment. That is, the bit stream generation unit 230 can generate a bit stream including information related to the size of the processing block for each of the many data units, and the encoding unit 220 relates to the size of the processing block. Information can be used to determine the size of at least one processing block that divides a picture, and the size of such a processing block is also an integer multiple of a reference coding unit.

  According to an embodiment, the encoding unit 220 may determine the size of the processing blocks 1602 and 1612 included in the picture 1600. For example, the encoding unit 220 can determine the size of the processing block based on information related to the size of the processing block. Referring to FIG. 16, the encoding unit 220 may set the horizontal size of the processing blocks 1602 and 1612 to four times the reference coding unit horizontal size, the vertical size, and the vertical size of the reference coding unit according to an exemplary embodiment. It can be determined as 4 times. The encoding unit 220 can determine the order in which at least one reference encoding unit is determined in at least one processing block. Since the operation of the encoding unit 220 related to the processing block is similar to the operation of the decoding unit 130 described with reference to FIG. 16, detailed description thereof is omitted.

  According to an embodiment, the bitstream generation unit 230 of the video encoding apparatus 200 generates a bitstream including block form information indicating the form of the current coding unit or division form information indicating a method for dividing the current coding unit. be able to. The block form information or the division form information may be included in a bit stream related to various data units. For example, the bit stream generation unit 230 of the video encoding apparatus 200 includes a sequence parameter set, a picture parameter set, a video parameter set, a slice header, and a slice. Block form information or division form information included in a segment header can be used. Further, the bitstream generation unit 230 of the video encoding device 200 may generate a bitstream including syntax indicating block form information or division form information for each maximum coding unit, reference coding unit, and processing block. it can.

  According to an exemplary embodiment, the encoding unit 220 may determine the type of division form in which the encoding unit is divided so as to be different for each predetermined data unit. The encoding unit 220 of the video encoding device 200 determines different combinations of forms in which the encoding units are divided for each predetermined data unit (for example, sequence, picture, slice, etc.) according to an embodiment. Can do.

  FIG. 17 illustrates coding units determined for each picture when combinations of forms in which the coding units are divided are different for each picture according to an embodiment.

  Referring to FIG. 17, the encoding unit 220 can determine different combinations of division forms in which the encoding unit is divided for each picture. For example, the encoding unit 220 may include a picture 1700 that is also divided into four coding units of at least one picture included in the video, a picture 1710 that is also divided into two or four coding units, and A picture can be decoded using a picture 1720 that is also divided into two, three, or four coding units. The encoding unit 220 can divide the picture 1700 into four square encoding units. The encoding unit 220 can divide the picture 1710 into two or four encoding units. The encoding unit 220 can divide the picture 1720 into two, three, or four encoding units. Since the combination of the above-described division forms is merely an embodiment for explaining the operation of the video encoding device 200, the combination of the above-described division forms is not interpreted as being limited to the above-described embodiment, It should be construed that various combinations of division forms are used for each data unit.

  According to an embodiment, the encoding unit 220 of the video encoding device 200 determines a combination of division forms in which a coding unit is divided for each predetermined data unit using an index indicating a combination of division form information. Accordingly, combinations of different division forms can be used for each predetermined data unit. Furthermore, the bit stream generation unit 230 of the video encoding device 200 can generate a bit stream including an index indicating a combination of division form information for each predetermined data unit (eg, sequence, picture, slice, etc.). . For example, the bitstream generation unit 230 can generate a sequence parameter set, a picture parameter set, or a slice header including an index indicating a combination of division form information.

  FIG. 18 and FIG. 19 illustrate various forms of coding units determined based on partition form information represented by a binary code according to an embodiment.

  According to an embodiment, the encoding unit 220 of the video encoding apparatus 200 may divide the encoding unit into various forms, and includes block form information and division form information through the bitstream generation unit 230. A bitstream can be generated. The form of the coding unit to be divided corresponds to various forms including the form described through the above-described embodiment. Referring to FIG. 18, the encoding unit 220 may divide a square-shaped encoding unit into at least one of a horizontal direction and a vertical direction based on the division form information. The coding unit can be divided horizontally or vertically. Since the characteristics related to the binary code of the division form information that can be used by the video encoding apparatus 200 correspond to the characteristics of the video decoding apparatus 100 described with reference to FIGS. 18 and 19, detailed description thereof will be omitted.

  The video encoding apparatus 200 according to an embodiment generates prediction data by performing inter prediction or intra prediction on a coding unit, and performs inverse transformation on a transform unit included in the current coding unit to perform residual data. The current encoding unit can be encoded using the generated prediction data and residual data.

  The prediction mode of a coding unit according to an embodiment is at least one of an intra mode, an inter mode, and a skip mode. According to an embodiment, prediction is performed independently for each coding unit, and the prediction mode with the smallest error is selected.

  When a 2Nx2N-type coding unit according to an embodiment is divided and divided into two 2NxN-type or two Nx2N-type coding units, inter-mode prediction and intra mode are performed for each of the coding units. Prediction is also made separately. Also, according to an embodiment, the encoding unit 220 of the video encoding apparatus 200 uses the CU skip mode not only when the encoding unit is a square shape but also when the encoding unit is a non-square shape. Thus, the encoding unit can be encoded. Video is decoded using the CU skip mode not only in the case of a square coding unit determined based on at least one of block form information and division form information but also in a non-square coding unit. This makes it possible to use a relatively more adaptive skip mode, thereby improving video encoding / decoding efficiency. The characteristics of the video encoding apparatus 200 using the skip mode in such a non-square encoding unit are similar to the characteristics described in connection with the use of the skip mode of the video encoding apparatus 200. The detailed explanation is omitted.

  FIG. 22 illustrates a process of merging or splitting between coding units determined by a predetermined coding method according to an embodiment.

  According to an embodiment, the video encoding apparatus 200 may determine a coding unit for dividing a picture using the predetermined coding method described above. For example, the video encoding apparatus 200 can determine the encoding unit of the current depth based on the division information of the encoding unit, or can divide into four encoding units of the lower depth. As described above, the video encoding apparatus 200 may indicate that the current coding unit always has a square shape, block form information indicating that the current coding unit is not divided, or 4 according to an embodiment. The encoding unit can be determined using the division form information that can indicate that the unit is to be divided into square-shaped encoding units. Referring to FIG. 22, pictures 2200 and 2220 are divided by square encoding units determined by the above-described predetermined encoding method.

  However, in the case of the above-described predetermined decoding unit, whether or not the current coding unit is divided is suitable for expressing a relatively small object (object) included in the current coding unit. Because of this, it may not be possible for large and small objects in a picture to be encoded through one encoding unit. Here, an object is a set of samples included in a picture, and means a sample area that is distinguished from other areas by having similar sample values. Referring to FIG. 22, the video encoding apparatus 200 divides the first encoding unit 2222 into four sub-depth encoding units to restore the small object 2221, thereby decoding the small object 2221. The coding unit for can be determined. However, since the large object 2223 is not included in the current encoding unit 2222, the large object 2223 is not suitable for decoding using the current encoding unit 2222, and furthermore, because the small object 2221 is decoded. In addition, since the current coding unit 2222 is divided, an unnecessary coding unit division process must be performed in order to decode the large object 2223, which is inefficient. That is, if the video encoding apparatus 200 can use one encoding unit to encode the portion for the large object 2223, the video encoding can be performed efficiently.

  According to an embodiment, the encoding unit 220 of the video encoding apparatus 200 may divide a current coding unit using at least one of block form information and division form information, and the block form information is It is determined in advance that only the square shape is used, and it is determined in advance that the division form information can indicate that it is not divided or is divided into four square-shaped coding units. This corresponds to a coding unit determination process used in the predetermined coding method described through various embodiments. In this case, the encoding unit 220 merges the coding units determined using the predetermined encoding method, or splits the determined coding unit into pictures. The sample values included in can be used. For example, the encoding unit 220 can examine portions having similar sample values and detect various objects included in the picture. Based on the portions related to the detected objects, the encoding unit 220 can detect a variety of objects. The merge / split process can be performed.

  Referring to FIG. 22, according to an embodiment, the encoding unit 220 may determine a plurality of encoding units for dividing the picture 2200 using the predetermined encoding method described above. However, in the case where the process of dividing the similar region into a plurality of coding units that are not one coding unit is performed in spite of the presence of a portion 2201 having a similar sample value included in the picture. There can be. In this case, the encoding unit 220 merges such an encoding unit into one encoding unit 2202 and encodes it as one encoding unit even if the encoding unit is determined through a predetermined encoding method. Can be Referring to FIG. 22, as another embodiment, the encoding unit 220 uses the predetermined encoding method described above to change the encoding unit 2222 for encoding the small object 2221 into four encoding units. Can be divided into In the case of the coding unit thus divided, since none of the detected large objects 2223 is included, the coding unit 220 performs coding unit into one coding unit including a part having a similar sample value. Can be merged (2225).

  According to one embodiment, the encoding unit 220 uses the encoding unit division information and does not divide the encoding unit or uses a predetermined encoding method that divides the encoding unit into four encoding units. After determining the encoding unit, the encoding unit can be further divided in consideration of the sample value of the sample included in the picture. That is, the encoding unit 130 can divide the already determined encoding unit as well as the merge between the encoding units in order to determine the encoding unit for each object. Referring to FIG. 22, the encoding unit 130 may merge the encoding units for the object 2223, and determine the encoding unit optimized for the object 2223. Therefore, the merged coding unit can be further divided (2226). That is, the encoding unit 220 can determine a part not including the object 2223 as an encoding unit (2227) separate from the object 2223 through the division (2226) process.

  When a bitstream related to a video is generated after merging or splitting between coding units determined by a predetermined coding method through the operation of the video coding device 200 described above, The video decoding apparatus 100 can decode the video by acquiring such a bitstream and performing a video decoding method corresponding to the reverse operation of the video encoding method described above.

  FIG. 23 illustrates an index according to a Z-scan order of coding units according to one embodiment.

  The encoding unit 220 of the video encoding apparatus 200 according to an embodiment may scan the lower data unit included in the upper data unit according to the Z scan order. In addition, the video encoding apparatus 200 according to an embodiment can sequentially access data using a Z scan index within a maximum encoding unit or within an encoding unit included in a processing block. As described with reference to FIGS. 3 and 4, the encoding unit 220 of the video encoding apparatus 200 according to an embodiment may divide the reference encoding unit into at least one encoding unit. At this time, a square-shaped coding unit and a non-square-shaped coding unit can be mixed in the reference coding unit. Since the feature related to the index by the Z scan order of the coding unit in the video encoding device 200 is also a feature similar to the feature of the video decoding device 100 described with reference to FIG. 23, detailed description thereof is omitted.

  As described above, various embodiments have been mainly described. Those skilled in the art to which the present invention pertains will understand that the present invention may be embodied in variations that do not depart from the essential characteristics of the invention. Accordingly, the disclosed embodiments should be considered from an illustrative rather than a limiting viewpoint. The scope of the present invention is shown not by the foregoing description but by the claims, and all differences within the equivalent scope should be construed as being included in the present invention. is there.

  The embodiment of the present invention described above can be created in a program executed by a computer, and is embodied by a general-purpose digital computer that operates the program using a computer-readable recording medium. The computer-readable recording medium includes a magnetic recording medium (for example, ROM (read-only memory), floppy disk, hard disk, etc.), an optical reading medium (for example, CD-ROM (compact disk read only memory), A recording medium such as a DVD (digital versatile disc).

Claims (15)

In the video decoding method,
Determining a data unit for intra prediction from a video picture;
From the bitstream, the data unit is predicted by a first intra prediction type that is predicted using predetermined prediction information, or is predicted by a second intra prediction type that is predicted using a data unit adjacent to the data unit. Obtaining intra-prediction type information that indicates whether to do,
Determining a first data unit predicted by the first intra prediction type and a second data unit predicted by the second intra prediction type based on the intra prediction type information acquired from the bitstream; When,
Using the predetermined prediction information to generate a first prediction value related to the first data unit according to the first intra prediction type;
Using the data unit adjacent to the data unit to generate a second predicted value related to the second data unit according to the second intra prediction type.   The video decoding method according to claim 1, wherein the predetermined prediction information is included in at least one of a sequence parameter set (SPS), a picture parameter reset (PPS), and a slice header.   The video according to claim 1, wherein the predetermined prediction information includes a sample value adjacent to a data unit of an upper layer including the first data unit predicted by the first intra prediction type. Decryption method.   The step of generating a second prediction value related to a second data unit according to the second intra prediction type includes at least one of a left data unit or an upper data unit adjacent to the second data unit according to the second intra prediction type. The method of claim 1, further comprising: generating a prediction value by using.   The step of generating the second predicted value related to the second data unit according to the second intra prediction type may include at least one of a right data unit or a lower end data unit adjacent to the second data unit according to the second intra prediction type. The method of claim 1, further comprising: generating a prediction value by using.   The method of claim 1, further comprising filtering the second predicted value of the second data unit predicted by the second intra prediction type.   The method of claim 1, wherein the data unit is one of a coding unit (CU), a prediction unit (PU), and a transform unit (TU). In the video encoding method,
A first data unit based on a first intra prediction type predicted using predetermined prediction information and a second data unit based on a second intra prediction type predicted using a data unit adjacent to the second data unit are determined. Stages,
Using the predetermined prediction information to generate a first prediction value related to the first data unit according to the first intra prediction type;
Using a data unit adjacent to the second data unit to generate a second predicted value related to the second data unit according to the second intra prediction type;
Generating a bitstream including encoding information determined based on at least one of the first prediction value or the second prediction value, and encoding a video picture,
The video encoding method, wherein the bitstream includes the predetermined prediction information.   The video encoding method of claim 8, wherein the predetermined prediction information is included in at least one of a sequence parameter set (SPS), a picture parameter reset (PPS), or a slice header.   9. The video according to claim 8, wherein the predetermined prediction information includes a sample value adjacent to a data unit of an upper layer including the first data unit predicted by the first intra prediction type. Encoding method.   The step of generating a second prediction value related to a second data unit according to the second intra prediction type includes at least one of a left data unit or an upper data unit adjacent to the second data unit according to the second intra prediction type. The method of claim 8, further comprising: generating a prediction value by using.   The step of generating the second prediction value related to the data unit according to the second intra prediction type uses at least one of the right data unit or the lower end data unit adjacent to the second data unit according to the second intra prediction type. The method of claim 8, further comprising generating a prediction value.   The method of claim 8, further comprising filtering the second prediction value of the second data unit predicted by the second intra prediction type.   The method of claim 8, wherein the data unit is one of a coding unit (CU), a prediction unit (PU), or a transform unit (TU). In a video decoding device,
A data unit determining unit for determining a data unit for intra prediction from a video picture;
From the bitstream, the data unit is predicted by a first intra prediction type that is predicted using predetermined prediction information, or is predicted by a second intra prediction type that is predicted using a data unit adjacent to the data unit. A bitstream acquisition unit that acquires intra prediction type information indicating whether to perform,
Determining a first data unit predicted by the first intra prediction type and a second data unit predicted by the second intra prediction type based on the intra prediction type information acquired from the bitstream; Using the predetermined prediction information, generating a first prediction value related to the first data unit according to the first intra prediction type, using a data unit adjacent to the data unit, and according to the second intra prediction type A decoding unit that generates a second prediction value related to a second data unit.