KR20220120539A - A method of video processing providing independent properties between coding tree units and coding units, a method and appratus for decoding and encoding video using the processing. - Google Patents

Abstract

An image decoding method according to an embodiment of the present invention may include the steps of: identifying a parallel motion information prediction unit index of a current block from which motion information is to be decoded; obtaining motion information of at least one neighboring block among blocks other than blocks belonging to the parallel motion information prediction unit of a previous index from neighboring blocks of the current block; and processing motion information prediction decoding of the current block based on the obtained motion information.

Description

An image processing method for processing motion information for parallel processing, an image decoding and encoding method using the same, and an apparatus thereof THE PROCESSING.}

The present invention relates to an image processing method, an image decoding and encoding method using the same, and an apparatus therefor, and more particularly, to an image processing method for processing motion information for parallel processing, an image decoding and encoding method using the same, and an apparatus thereof will be.

Digital video technology includes digital television, digital direct broadcast systems, wireless broadcast systems, personal digital assistants (PDAs), laptop or desktop computers, digital cameras, digital recording devices, video gaming devices, video game consoles, cellular or satellite radio telephones, etc. It can be integrally applied to a wide range of digital video devices including Digital video devices are video compression technologies such as MPEG-2, MPEG-4, or ITU-T H.264/MPEG-4, Part 10, AVC (Advanced Video Coding), H.265/HEVC (High Efficiency Video Coding). By implementing this, digital video information is transmitted and received more efficiently. Video compression techniques perform spatial prediction and temporal prediction to remove or reduce redundancy inherent in a video sequence.

As such an image compression technique, an inter prediction technique that predicts pixel values included in the current picture from pictures before or after the current picture, intra prediction that predicts pixel values included in the current picture using pixel information in the current picture Various technologies exist, such as entropy encoding technology that assigns a short code to a value with a high frequency of occurrence and an entropy encoding technique that assigns a long code to a value with a low frequency of occurrence. .

In order to cost-effectively respond to various resolutions, frame rates, etc. according to such applications, it is necessary to have a video decoding apparatus that can be easily processed according to the performance and functions required by the application.

For example, in the image compression method, encoding is performed by dividing one picture into a plurality of blocks having a predetermined size. In addition, in order to increase compression efficiency, inter prediction and intra prediction techniques that remove redundancy between pictures are used.

In this case, a residual signal is created using intra prediction and inter prediction, and the reason for obtaining the residual signal is that when coding is performed with the residual signal, the amount of data is small, the data compression rate is high, and the better the prediction, the better the residual signal. because the value of is small.

The intra prediction method predicts data of the current block by using pixels surrounding the current block. The difference between the actual value and the predicted value is called the residual signal block. In the case of HEVC, the intra prediction method increases from 9 prediction modes used in the existing H.264/AVC to 35 prediction modes, so that prediction is further subdivided.

In the case of the inter prediction method, the most similar block is found by comparing the current block with blocks in neighboring pictures. At this time, the position information (Vx, Vy) for the found block is called a motion vector. The difference between pixel values in the block between the current block and the prediction block predicted by the motion vector is called a residual signal block (motion-compensated residual block).

As described above, as intra prediction and inter prediction are further subdivided, the amount of data of the residual signal is decreasing, but the amount of computation for processing a video has greatly increased.

In particular, there are difficulties in pipeline implementation, etc. due to an increase in complexity in the process of determining an intra-picture division structure for image encoding and decoding, and the existing block division method and the size of the divided blocks are the size of the high-resolution image. It may not be suitable for encoding.

For example, in parallel processing of motion information for inter prediction, since the processing of the current block is possible only after encoding or decoding of the left, upper, and upper-left neighboring blocks is completed, the current block can be processed even when the parallel pipeline is implemented. There is a problem in that it is necessary to wait for a block mode and a partition size of a neighboring block to be processed in another pipeline for a block, and this causes a pipeline stall.

In order to solve this problem, HEVC has proposed a merge method for merging motion information for some prediction units within an arbitrary block size. There is a problem that the encoding efficiency is greatly reduced due to this.

SUMMARY OF THE INVENTION The present invention is to solve the above problems, and an object of the present invention is to provide a video decoding and encoding method and an apparatus therefor for improving encoding efficiency by parallel processing motion information prediction decoding and encoding of a high-resolution image.

A motion information decoding method according to an embodiment of the present invention for solving the above problems includes: identifying a parallel motion information prediction unit index of a current block from which motion information is to be decoded; obtaining motion information of at least one neighboring block from among the remaining blocks except for blocks belonging to the parallel motion information prediction unit of the previous index in the neighboring blocks of the current block; and processing motion information prediction decoding for the current block based on the obtained motion information.

A motion information encoding method according to an embodiment of the present invention for solving the above problems includes: identifying a parallel motion information prediction unit index of a current block in which motion information is to be encoded; obtaining motion information of at least one neighboring block from among the remaining blocks except for blocks belonging to the parallel motion information prediction unit of the previous index in the neighboring blocks of the current block; and processing motion information prediction encoding for the current block based on the obtained motion information.

On the other hand, the method according to an embodiment of the present invention for solving the above problems may be implemented as a program for executing the method in a computer and a non-volatile recording medium in which the program is stored and which can be read by a computer.

According to an embodiment of the present invention, decoding blocks may be sequentially grouped into a predetermined parallel motion information prediction unit.

Also, according to an embodiment of the present invention, in decoding motion information, motion information decoding may be performed using motion information of blocks other than blocks belonging to a previous parallel motion information prediction unit among neighboring blocks of the current block.

Accordingly, pipeline processing for each parallel motion information prediction unit is independently possible, pipeline stalls can be prevented in advance, and encoding and decoding efficiency can be improved.

1 is a block diagram showing the configuration of an image encoding apparatus according to an embodiment of the present invention.
2 to 5 are diagrams for explaining a first embodiment of a method of dividing and processing an image in block units.
6 is a block diagram for explaining an embodiment of a method for performing inter prediction in an image encoding apparatus.
7 is a block diagram showing the configuration of an image decoding apparatus according to an embodiment of the present invention.
8 is a block diagram for explaining an embodiment of a method for performing inter prediction in an image decoding apparatus.
9 is a diagram for explaining a second embodiment of a method of dividing and processing an image in block units.
10 is a diagram for explaining a third embodiment of a method of dividing and processing an image in block units.
11 is a diagram for explaining an embodiment of a method of constructing a transform unit by dividing a coding unit into a binary tree structure.
12 is a diagram for explaining a fourth embodiment of a method for dividing and processing an image in block units.
13 to 14 are diagrams for explaining still other embodiments of a method of dividing and processing an image in block units.
15 and 16 are diagrams for explaining embodiments of a method of determining a partition structure of a transform unit by performing Rate Distortion Optimization (RDO).
17 and 18 are flowcharts for explaining an image processing method for processing motion information for parallel processing according to an embodiment of the present invention.
19 to 22 are diagrams for illustrating a motion information processing method for each case according to an embodiment of the present invention.

EMBODIMENT OF THE INVENTION Hereinafter, embodiment of this invention is described concretely with reference to drawings. In describing the embodiments of the present specification, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present specification, the detailed description thereof will be omitted.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be In addition, the description of "including" a specific configuration in the present invention does not exclude configurations other than the corresponding configuration, and means that additional configurations may be included in the practice of the present invention or the scope of the technical spirit of the present invention.

Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

In addition, the components shown in the embodiment of the present invention are shown independently to represent different characteristic functions, and it does not mean that each component is composed of separate hardware or a single software component. That is, each component is listed as each component for convenience of description, and at least two components of each component are combined to form one component, or one component can be divided into a plurality of components to perform a function, and each Integrated embodiments and separate embodiments of the components are also included in the scope of the present invention without departing from the essence of the present invention.

In addition, some of the components are not essential components for performing essential functions in the present invention, but may be optional components for merely improving performance. The present invention can be implemented by including only essential components to implement the essence of the present invention except for components used for improving performance, and only having a structure including essential components excluding optional components used for improving performance Also included in the scope of the present invention.

1 is a block diagram showing the configuration of an image encoding apparatus according to an embodiment of the present invention. The image encoding apparatus 10 includes a picture division unit 110 , a transform unit 120 , a quantization unit 130 , and scanning. unit 131 , entropy encoding unit 140 , intra prediction unit 150 , inter prediction unit 160 , inverse quantization unit 135 , inverse transform unit 125 , post-processing unit 170 , picture storage unit 180 ), a subtraction unit 190 and an addition unit 195 .

Referring to FIG. 1 , the picture dividing unit 110 analyzes an input video signal, divides a picture into coding units, determines a prediction mode, and determines the size of a prediction unit for each coding unit.

Also, the picture splitter 110 transmits a prediction unit to be encoded to the intra prediction unit 150 or the inter prediction unit 160 according to a prediction mode (or prediction method). Also, the picture dividing unit 110 transmits a prediction unit to be encoded to the subtracting unit 190 .

Here, a picture of an image may be composed of a plurality of slices, and the slice may be divided into a plurality of coding tree units (CTUs), which are basic units for dividing a picture.

The coding tree unit may be divided into one or more coding units (CUs), which are basic units in which inter prediction or intra prediction is performed.

Here, the maximum size of the coding tree unit and the coding unit may be different, and signaling information therefor may be transmitted to the decoding apparatus 20 . This will be described later in more detail with reference to FIG. 17 .

A coding unit (CU) may be divided into one or more prediction units (PUs), which are basic units in which prediction is performed.

In this case, the encoding apparatus 10 determines any one of inter prediction and intra prediction as a prediction method for each of the divided coding units (CUs), but differently predicts blocks for each prediction unit (PU). can create

Meanwhile, the coding unit (CU) may be divided into one or more transform units (TUs), which are basic units in which transform on a residual block is performed.

In this case, the picture divider 110 may transmit the image data to the subtractor 190 in units of blocks (eg, a prediction unit PU or a transform unit TU) divided as described above.

Referring to FIG. 2 , a coding tree unit (CTU) having a maximum size of 256x256 pixels may be divided into a quad tree structure and divided into four coding units (CUs) having a square shape.

Each of the four coding units (CUs) having the square shape may be re-segmented into a quad tree structure, and the depth of the coding unit (CU) divided into the quad tree structure as described above may be any of 0 to 3 It can have one integer value.

A coding unit (CU) may be divided into one or more prediction units (PUs) according to a prediction mode.

In the case of the intra prediction mode, when the size of the coding unit (CU) is 2Nx2N, the prediction unit (PU) may have a size of 2Nx2N shown in (a) of FIG. 3 or NxN shown in (b) of FIG. 3 . have.

On the other hand, in the inter prediction mode, when the size of the coding unit (CU) is 2Nx2N, the prediction unit (PU) is 2Nx2N shown in (a) of FIG. 4, 2NxN shown in (b) of FIG. 4, FIG. Nx2N shown in (c), NxN shown in FIG. 4(d), 2NxnU shown in FIG. 4(e), 2NxnD shown in FIG. 4(f), shown in FIG. 4(g) It may have a size of any one of nLx2N and nRx2N shown in (h) of FIG. 4 .

Referring to FIG. 5 , a coding unit (CU) may be divided into a quad tree structure and divided into four transform units (TUs) having a square shape.

The four transform units (TUs) having the square shape may each be re-segmented into a quad-tree structure, and the depth of the transform unit (TU) divided into the quad-tree structure as described above is any of 0 to 3 It can have one integer value.

Here, when the coding unit (CU) is in the inter prediction mode, the prediction unit (PU) and the transform unit (TU) split from the corresponding coding unit (CU) may have a partition structure independent of each other.

When the coding unit (CU) is an intra prediction mode, the transform unit (TU) divided from the coding unit (CU) cannot be larger than the size of the prediction unit (PU).

In addition, the transform unit (TU) divided as described above may have a maximum size of 64x64 pixels.

The transform unit 120 transforms a residual block that is a residual signal between the original block of the input prediction unit PU and the prediction block generated by the intra prediction unit 150 or the inter prediction unit 160, and the transform is It may be performed using a unit (TU) as a basic unit.

In the transformation process, different transformation matrices may be determined according to prediction modes (intra or inter), and since the residual signal of intra prediction has a direction according to the intra prediction mode, the transformation matrix may be adaptively determined according to the intra prediction mode. have.

A transformation unit may be transformed by two (horizontal and vertical) one-dimensional transformation matrices, and, for example, in the case of inter prediction, one predetermined transformation matrix may be determined.

On the other hand, in the case of intra prediction, when the intra prediction mode is horizontal, the probability that the residual block has a vertical direction increases, so a DCT-based integer matrix is applied in the vertical direction, and a DST-based or Apply KLT-based integer matrix. When the intra prediction mode is vertical, a DST-based or KLT-based integer matrix may be applied in a vertical direction, and a DCT-based integer matrix may be applied in a horizontal direction.

Also, in the case of the DC mode, a DCT-based integer matrix may be applied in both directions.

And, in the case of intra prediction, a transform matrix may be adaptively determined based on the size of a transform unit (TU).

The quantization unit 130 determines a quantization step size for quantizing the coefficients of the residual block transformed by the transform matrix, and the quantization step size may be determined for each quantization unit having a predetermined size or larger.

The size of the quantization unit may be 8x8 or 16x16, and the quantization unit 130 quantizes the coefficients of the transform block using a quantization matrix determined according to a quantization step size and a prediction mode.

Also, the quantization unit 130 may use a quantization step size of a quantization unit adjacent to the current quantization unit as a quantization step size predictor of the current quantization unit.

The quantization unit 130 searches in the order of the left quantization unit, the upper quantization unit, and the upper left quantization unit of the current quantization unit, and uses one or two valid quantization step sizes to generate a quantization step size predictor of the current quantization unit. have.

For example, the quantization unit 130 determines a valid first quantization step size searched in the above order as a quantization step size predictor, or determines an average value of two valid quantization step sizes searched in the above order as a quantization step size predictor, or When only one quantization step size is valid, it may be determined as a quantization step size predictor.

When the quantization step size predictor is determined, the quantization unit 130 transmits a difference between the quantization step size of the current quantization unit and the quantization step size predictor to the entropy encoding unit 140 .

On the other hand, all of the left coding unit, the upper coding unit, and the upper left coding unit of the current coding unit do not exist. Alternatively, a coding unit that exists previously in the coding order within the largest coding unit may exist.

Accordingly, in the quantization units adjacent to the current coding unit and the largest coding unit, the quantization step size of the quantization unit immediately preceding in the coding order may be a candidate.

In this case, priority is set in the order of 1) the left quantization unit of the current coding unit, 2) the upper quantization unit of the current coding unit, 3) the upper left quantization unit of the current coding unit, and 4) the quantization unit immediately preceding in the coding order. can be The order may be changed, and the upper-left quantization unit may be omitted.

Meanwhile, the transform block quantized as described above is transmitted to the inverse quantization unit 135 and the scanning unit 131 .

The scanning unit 131 scans the coefficients of the quantized transform block and transforms them into one-dimensional quantized coefficients. In this case, since the coefficient distribution of the transform block after quantization may depend on the intra prediction mode, the scanning method is based on the intra prediction mode. can be determined accordingly.

In addition, the coefficient scanning method may be determined differently according to the size of the transform unit, and the scan pattern may be changed according to the directional intra prediction mode. In this case, the scan order of the quantization coefficients may be scanned in the reverse direction.

When the quantized coefficients are divided into a plurality of subsets, the same scan pattern may be applied to the quantization coefficients in each subset, and a zigzag scan or a diagonal scan may be applied to the scan pattern between the subsets.

Meanwhile, the scan pattern is preferably scanned from the main subset including DC to the remaining subsets in a forward direction, but the reverse direction is also possible.

Also, the scan pattern between the subsets may be set to be the same as the scan pattern of the quantized coefficients in the subset, and the scan pattern between the subsets may be determined according to the intra prediction mode.

On the other hand, the encoding apparatus 10 includes, in the bitstream, information that may indicate the position of the last non-zero quantization coefficient in the transform unit PU and the position of the last non-zero quantization coefficient in each subset in the decoding apparatus ( 20) can be transmitted.

The inverse quantization unit 135 inverse quantizes the quantized coefficients as described above, and the inverse transform unit 125 performs inverse transformation in units of transform units (TUs) to restore the inverse quantized transform coefficients to a residual block in the spatial domain. can do.

The adder 195 may generate a reconstructed block by adding the residual block reconstructed by the inverse transform unit 125 and the prediction block received from the intra prediction unit 150 or the inter prediction unit 160 .

In addition, the post-processing unit 170 performs a deblocking filtering process to remove a blocking effect occurring in the reconstructed picture, and a sample adaptive offset to compensate for a difference value from the original image in units of pixels. With the SAO) application process and the coding unit, an adaptive loop filtering (ALF) process for supplementing a difference value from the original image may be performed.

The deblocking filtering process may be applied to a boundary of a prediction unit (PU) or a transform unit (TU) having a size greater than or equal to a predetermined size.

For example, the deblocking filtering process includes the steps of determining a boundary to be filtered, determining a boundary filtering strength to be applied to the boundary, determining whether to apply a deblocking filter, When it is determined to apply the deblocking filter, the method may include selecting a filter to be applied to the boundary.

On the other hand, whether the deblocking filter is applied is determined by i) whether the boundary filtering intensity is greater than 0 and ii) the degree of change in pixel values at the boundary of two blocks (P block, Q block) adjacent to the boundary to be filtered. It may be determined whether the indicated value is smaller than the first reference value determined by the quantization parameter.

The filter is preferably at least two or more. When the absolute value of the difference value between two pixels located at the block boundary is greater than or equal to the second reference value, a filter that performs relatively weak filtering is selected.

The second reference value is determined by the quantization parameter and the boundary filtering strength.

In addition, the sample adaptive offset (SAO) application process is to reduce the difference (distortion) between the original pixel and the pixel in the image to which the deblocking filter is applied. Whether or not to do it may be decided.

A picture or slice may be divided into a plurality of offset regions, and an offset type may be determined for each offset region, and the offset type may include a predetermined number (eg, four) of an edge offset type and two band offsets. It can contain types.

For example, when the offset type is an edge offset type, an edge type to which each pixel belongs is determined and a corresponding offset is applied, and the edge type can be determined based on the distribution of values of two pixels adjacent to the current pixel. have.

In the adaptive loop filtering (ALF) process, filtering may be performed based on a value obtained by comparing the original image and the reconstructed image that has undergone the deblocking filtering process or the adaptive offset application process.

The picture storage unit 180 receives the post-processed image data from the post-processing unit 170 to restore and store the image in units of pictures, and the pictures may be images in units of frames or images in units of fields.

The inter prediction unit 160 may perform motion estimation using at least one or more reference pictures stored in the picture storage unit 180 , and determine a reference picture index and a motion vector indicating the reference picture.

In this case, a prediction block corresponding to a prediction unit to be encoded may be extracted from a reference picture used for motion estimation among a plurality of reference pictures stored in the picture storage unit 180 according to the determined reference picture index and motion vector. have.

The intra prediction unit 150 may perform intra prediction encoding by using the reconstructed pixel value inside the picture including the current prediction unit.

The intra prediction unit 150 may receive a current prediction unit to be prediction-encoded and may perform intra prediction by selecting one of a preset number of intra prediction modes according to the size of the current block.

The intra prediction unit 150 adaptively filters reference pixels to generate an intra prediction block, and when the reference pixels are not available, the reference pixels may be generated using available reference pixels.

The entropy encoding unit 140 entropy-encodes the quantized coefficients quantized by the quantization unit 130 , intra prediction information received from the intra prediction unit 150 , and motion information received from the inter prediction unit 160 . can

6 is a block diagram illustrating an embodiment of a configuration for performing inter prediction in the encoding apparatus 10. The illustrated inter prediction encoder includes a motion information determiner 161 and a motion information encoding mode determiner 162. , a motion information encoder 163 , a prediction block generator 164 , a residual block generator 165 , a residual block encoder 166 , and a multiplexer 167 .

Referring to FIG. 6 , the motion information determiner 161 determines motion information of a current block, the motion information includes a reference picture index and a motion vector, and the reference picture index is any one of previously encoded and reconstructed pictures. can represent

When the current block is unidirectional inter prediction coded, it indicates any one of the reference pictures belonging to list 0 (L0), and when the current block is bidirectionally predictively coded, it indicates one of the reference pictures of the list 0 (L0). It may include an index and a reference picture index indicating one of the reference pictures of the list 1 (L1).

In addition, when the current block is bi-predictively encoded, an index indicating one or two of the reference pictures of the composite list LC generated by combining the list 0 and the list 1 may be included.

The motion vector indicates the position of the prediction block in the picture indicated by each reference picture index, and the motion vector may be a pixel unit (integer unit) or a sub-pixel unit.

For example, the motion vector may have a resolution of 1/2, 1/4, 1/8, or 1/16 pixels, and when the motion vector is not an integer unit, a prediction block may be generated from pixels of an integer unit. can

The motion information encoding mode determiner 162 may determine the encoding mode for the motion information of the current block as any one of a skip mode, a merge mode, and an AMVP mode.

The skip mode is applied when a skip candidate having the same motion information as the motion information of the current block exists and the residual signal is 0. can be applied when

The merge mode is applied when there is a merge candidate having the same motion information as the motion information of the current block. applies in case Meanwhile, the merge candidate and the skip candidate may be the same.

The AMVP mode is applied when the skip mode and the merge mode are not applied, and an AMVP candidate having a motion vector most similar to the motion vector of the current block may be selected as the AMVP predictor.

The motion information encoder 163 may encode the motion information according to the method determined by the motion information encoding mode determiner 162 .

For example, the motion information encoder 163 may perform a merge motion vector encoding process when the motion information encoding mode is a skip mode or a merge mode, and may perform an AMVP encoding process when the motion information encoding mode is an AMVP mode.

The prediction block generator 164 generates a prediction block using motion information of the current block, and when the motion vector is an integer unit, copies the block corresponding to the position indicated by the motion vector in the picture indicated by the reference picture index to copy the current block. create a prediction block of

Meanwhile, when the motion vector is not an integer unit, the prediction block generator 164 may generate pixels of the prediction block from integer unit pixels in the picture indicated by the reference picture index.

In this case, the prediction pixel may be generated by using an 8-tap interpolation filter for the luminance pixel, and the prediction pixel may be generated by using the 4-tap interpolation filter for the chrominance pixel.

The residual block generator 165 generates a residual block using the current block and the prediction blocks of the current block, and when the size of the current block is 2Nx2N, the residual block using the current block and the prediction block of the size of 2Nx2N corresponding to the current block blocks can be created.

On the other hand, when the size of the current block used for prediction is 2NxN or Nx2N, after obtaining a prediction block for each of the two 2NxN blocks constituting 2Nx2N, the final prediction block of the 2Nx2N size is obtained using the two 2NxN prediction blocks. can be created

In addition, a residual block of size 2Nx2N may be generated using the prediction block of size 2Nx2N, and overlap smoothing is applied to pixels at the boundary in order to resolve the discontinuity of the boundary between the two prediction blocks having the size of 2NxN. can

The residual block encoder 166 divides the residual block into one or more transform units (TUs), so that each transform unit (TU) may be transform-coded, quantized, and entropy-encoded.

The residual block encoder 166 may transform the residual block generated by the inter prediction method using an integer-based transform matrix, and the transform matrix may be an integer-based DCT matrix.

Meanwhile, the residual block encoder 166 uses a quantization matrix to quantize coefficients of the residual block transformed by the transform matrix, and the quantization matrix may be determined by a quantization parameter.

The quantization parameter is determined for each coding unit (CU) having a size greater than or equal to a predetermined size, and when the current coding unit (CU) is smaller than the predetermined size, the first coding unit (CU) in the coding order among the coding units (CUs) within the predetermined size ( Since only the quantization parameter of the CU is encoded and the quantization parameters of the remaining coding units (CUs) are the same as the above parameters, encoding may not be performed.

Also, the coefficients of the transform block may be quantized using a quantization matrix determined according to the quantization parameter and a prediction mode.

A quantization parameter determined for each coding unit (CU) having a size greater than or equal to the predetermined size may be predictively encoded using a quantization parameter of a coding unit (CU) adjacent to the current coding unit (CU).

A quantization parameter predictor of the current coding unit (CU) can be generated using one or two valid quantization parameters by searching in the order of the left coding unit (CU), the upper coding unit (CU) of the current coding unit (CU). have.

For example, a valid first quantization parameter retrieved in the above order may be determined as a quantization parameter predictor, and a valid first quantization parameter may be quantized by searching in the order of the left coding unit (CU) and the coding unit immediately preceding in the coding order (CU). It can be determined as a parameter predictor.

Coefficients of the quantized transform block are scanned and transformed into one-dimensional quantized coefficients, and a scanning method may be set differently according to an entropy encoding mode.

For example, when coded in CABAC, inter prediction coded quantization coefficients may be scanned in one predetermined method (raster scan in a zigzag or diagonal direction), and when coded in CAVLC, scanning is performed in a different manner from the above method can be

For example, the scanning method may be determined according to a zigzag mode in the case of inter and an intra prediction mode in the case of intra, and the coefficient scanning method may be determined differently according to the size of a transform unit.

Meanwhile, the scan pattern may vary according to the directional intra prediction mode, and the scan order of the quantization coefficients may be scanned in the reverse direction.

The multiplexer 167 multiplexes the motion information encoded by the motion information encoder 163 and the residual signals encoded by the residual block encoder 166 .

The motion information may vary depending on the encoding mode. For example, in the case of skip or merge, only the index indicating the predictor is included, and in the case of AMVP, it may include the reference picture index, differential motion vector, and AMVP index of the current block. .

Hereinafter, an embodiment of the operation of the intra prediction unit 150 shown in FIG. 1 will be described in detail.

First, the intra prediction unit 150 receives prediction mode information and the size of the prediction unit PU from the picture division unit 110 , and stores reference pixels to determine the intra prediction mode of the prediction unit PU. It can be read from (180).

The intra prediction unit 150 determines whether a reference pixel is generated by examining whether an unavailable reference pixel exists, and the reference pixels may be used to determine an intra prediction mode of the current block.

When the current block is located at the upper boundary of the current picture, pixels adjacent to the upper side of the current block are not defined, and when the current block is located at the left boundary of the current picture, pixels adjacent to the left of the current block are not defined; It may be determined that the pixels are not available pixels.

Also, even when the pixels adjacent to the upper or left side of the slice are not previously encoded and reconstructed because the current block is located at the slice boundary, it may be determined as not available pixels.

As described above, when pixels adjacent to the left or upper side of the current block do not exist or there are no pre-encoded and reconstructed pixels, the intra prediction mode of the current block may be determined using only available pixels.

Meanwhile, a reference pixel in an unavailable position may be generated using available reference pixels of the current block. For example, when pixels in an upper block are not available, some or all of the left pixels may be used to generate an upper pixel. can be created, and vice versa.

That is, a reference pixel is created by copying an available reference pixel in a closest position in a predetermined direction from a reference pixel in an unavailable position, or in the opposite direction when there is no reference pixel available in the predetermined direction A reference pixel may be created by copying an available reference pixel at a location.

Meanwhile, even when pixels above or to the left of the current block exist, they may be determined as unavailable reference pixels according to the encoding mode of the block to which the pixels belong.

For example, when a block to which a reference pixel adjacent to the upper side of the current block belongs is a reconstructed block by inter-coding, the pixels may be determined as unavailable pixels.

In this case, available reference pixels may be generated using pixels belonging to a block in which a block adjacent to the current block is intra-encoded and reconstructed, and information indicating that the encoding apparatus 10 determines available reference pixels according to the encoding mode is provided. It is transmitted to the decoding device 20 .

The intra prediction unit 150 determines the intra prediction mode of the current block by using the reference pixels, and the number of intra prediction modes allowable for the current block may vary according to the size of the block.

For example, when the size of the current block is 8x8, 16x16, or 32x32, 34 intra prediction modes may exist, and when the size of the current block is 4x4, 17 intra prediction modes may exist.

The 34 or 17 intra prediction modes may include at least one non-directional mode (non-directional mode) and a plurality of directional modes (directional modes).

The one or more non-directional modes may be DC mode and/or planar mode. When the DC mode and the planar mode are included as the non-directional mode, 35 intra prediction modes may exist regardless of the size of the current block.

In this case, two non-directional modes (DC mode and planar mode) and 33 directional modes may be included.

In the planner mode, the prediction block of the current block is determined using at least one pixel value (or the predicted value of the pixel value, hereinafter referred to as a first reference value) and reference pixels located at the bottom-right side of the current block. is created

The configuration of the image decoding apparatus according to an embodiment of the present invention may be derived from the configuration of the image encoding apparatus 10 described with reference to FIGS. 1 to 6 , and for example, as described with reference to FIGS. 1 to 6 . An image can be decoded by performing the same process of the image encoding method in reverse.

7 is a block diagram showing the configuration of a video decoding apparatus according to an embodiment of the present invention. The decoding apparatus 20 includes an entropy decoding unit 210, an inverse quantization/inverse transformation unit 220, an adder 270, It includes a deblocking filter 250 , a picture storage unit 260 , an intra prediction unit 230 , a motion compensation prediction unit 240 , and an intra/inter switching switch 280 .

The entropy decoding unit 210 receives and decodes the bit stream encoded by the image encoding apparatus 10, and separates the intra prediction mode index, motion information, quantization coefficient sequence, etc., and divides the decoded motion information into a motion compensation prediction unit ( 240).

In addition, the entropy decoder 210 transmits the intra prediction mode index to the intra prediction unit 230 and the inverse quantization/inverse transform unit 220 , and the inverse quantization coefficient sequence may be transmitted to the inverse quantization/inverse transform unit 220 . .

The inverse quantization/inverse transform unit 220 transforms the quantization coefficient sequence into a two-dimensional array of inverse quantization coefficients, and may select one of a plurality of scanning patterns for the transformation, and for example, a prediction mode of the current block (that is, , intra prediction or inter prediction) and an intra prediction mode may select a scanning pattern.

The inverse quantization/inverse transform unit 220 restores the quantization coefficients by applying a quantization matrix selected from among a plurality of quantization matrices to the inverse quantization coefficients of the two-dimensional array.

Meanwhile, different quantization matrices are applied according to the size of a current block to be reconstructed, and a quantization matrix may be selected based on at least one of a prediction mode and an intra prediction mode of the current block even for a block of the same size.

The inverse quantization/inverse transform unit 220 reconstructs a residual block by inversely transforming the reconstructed quantization coefficient, and the inverse transform process may be performed using a transform unit (TU) as a basic unit.

The adder 270 reconstructs an image block by adding the residual block reconstructed by the inverse quantization/inverse transform unit 220 and the prediction block generated by the intra prediction unit 230 or the motion compensation prediction unit 240 .

The deblocking filter 250 may perform deblocking filter processing on the reconstructed image generated by the adder 270 to reduce deblocking artifacts caused by image loss due to a quantization process.

The picture storage unit 260 is a frame memory for storing a local decoded image on which the deblocking filter process is performed by the deblocking filter 250 .

The intra prediction unit 230 reconstructs the intra prediction mode of the current block based on the intra prediction mode index received from the entropy decoder 210 , and generates a prediction block according to the reconstructed intra prediction mode.

The motion compensation prediction unit 240 generates a prediction block for the current block from the picture stored in the picture storage unit 260 based on the motion vector information, and applies the selected interpolation filter when fractional precision motion compensation is applied to the prediction block. can create

The intra/inter switching switch 280 may provide the prediction block generated by any one of the intra prediction unit 230 and the motion compensation prediction unit 240 to the adder 270 based on the encoding mode.

8 is a block diagram showing an embodiment of a configuration for performing inter prediction in the image decoding apparatus 20. The inter prediction decoder includes a demultiplexer 241, a motion information encoding mode determiner 242, and a merge mode motion. It includes an information decoder 243 , an AMVP mode motion information decoder 244 , a prediction block generator 245 , a residual block decoder 246 , and a reconstructed block generator 247 . Here, the merge mode motion information decoder 243 and the AMVP mode motion information decoder 244 may be included in the motion information decoder 248 .

Referring to FIG. 8 , the demultiplexer 241 demultiplexes the currently encoded motion information and the encoded residual signals from the received bitstream, and transmits the demultiplexed motion information to the motion information encoding mode determiner 242 . Then, the demultiplexed residual signal may be transmitted to the residual block decoding unit 246 .

The motion information encoding mode determining unit 242 determines the motion information encoding mode of the current block, and when the skip_flag of the received bitstream has a value of 1, it is determined that the motion information encoding mode of the current block is encoded as the skip encoding mode. can do.

When the skip_flag of the received bitstream has a value of 0 and the motion information received from the de-multiplexer 241 has only a merge index, the motion information encoding mode determiner 242 determines the motion information encoding mode of the current block. may be determined to be encoded in merge mode.

Also, the motion information encoding mode determining unit 242 determines that skip_flag of the received bitstream has a value of 0, and the motion information received from the demultiplexer 241 has a reference picture index, a differential motion vector, and an AMVP index. In this case, it may be determined that the motion information encoding mode of the current block is encoded in the AMVP mode.

The merge mode motion information decoder 243 is activated when the motion information encoding mode determiner 242 determines that the motion information encoding mode of the current block is the skip or merge mode, and the AMVP mode motion information decoder 244 performs the motion information encoding mode. It may be activated when the information encoding mode determining unit 242 determines that the motion information encoding mode of the current block is the AMVP mode.

The prediction block generator 245 generates a prediction block of the current block by using the motion information reconstructed by the merge mode motion information decoder 243 or the AMVP mode motion information decoder 244 .

When the motion vector is an integer unit, a prediction block of the current block may be generated by copying a block corresponding to a position indicated by the motion vector in the picture indicated by the reference picture index.

On the other hand, when the motion vector is not an integer unit, pixels of the prediction block are generated from integer unit pixels in the picture indicated by the reference picture index. In this case, an 8-tap interpolation filter is used for the luminance pixel, and A prediction pixel may be generated using a 4-tap interpolation filter.

The residual block decoding unit 246 entropy-decodes the residual signal and inversely scans the entropy-decoded coefficients to generate a two-dimensional quantized coefficient block, and the inverse scanning method may vary depending on the entropy decoding method.

For example, when decoding based on CABAC, the inverse scanning method may be applied as a diagonal raster inverse scan method, and when decoding based on CAVLC, the inverse scanning method may be applied as a zigzag inverse scan method. Also, the inverse scanning method may be determined differently according to the size of the prediction block.

The residual block decoding unit 246 may inverse quantize the coefficient block generated as described above by using an inverse quantization matrix, and may restore a quantization parameter to derive the quantization matrix. Here, the quantization step size may be reconstructed for each coding unit having a size greater than or equal to a predetermined size.

The residual block decoding unit 260 restores the residual block by inverse transforming the inverse quantized coefficient block.

The reconstructed block generation unit 270 generates a reconstructed block by adding the prediction block generated by the prediction block generation unit 250 and the residual block generated by the residual block decoding unit 260 .

Hereinafter, an embodiment of a process of reconstructing a current block through intra prediction will be described with reference to FIG. 7 again.

First, the intra prediction mode of the current block is decoded from the received bitstream. For this purpose, the entropy decoder 210 refers to one of a plurality of intra prediction mode tables to restore the first intra prediction mode index of the current block. can

The plurality of intra prediction mode tables As a table shared by the encoding apparatus 10 and the decoding apparatus 20, any one table selected according to the distribution of intra prediction modes for a plurality of blocks adjacent to the current block may be applied. .

For example, if the intra prediction mode of the left block of the current block and the intra prediction mode of the upper block of the current block are the same, the first intra prediction mode index of the current block is restored by applying the first intra prediction mode table, Otherwise, the first intra prediction mode index of the current block may be restored by applying the second intra prediction mode table.

As another example, when the intra prediction modes of the upper block and the left block of the current block are both directional intra prediction modes, the direction of the intra prediction mode of the upper block and the direction of the intra prediction mode of the left block If it is within the predetermined angle, the first intra prediction mode index of the current block is restored by applying the first intra prediction mode table, and if it is outside the predetermined angle, the first intra prediction mode index of the current block is applied by applying the second intra prediction mode table can also be restored.

The entropy decoding unit 210 transmits the first intra prediction mode index of the reconstructed current block to the intra prediction unit 230 .

The intra prediction unit 230 receiving the index of the first intra prediction mode may determine the maximum possible mode of the current block as the intra prediction mode of the current block when the index has a minimum value (ie, 0). .

Meanwhile, when the index has a value other than 0, the intra prediction unit 230 compares the index indicated by the maximum possible mode of the current block with the first intra prediction mode index, and as a result of the comparison, the first intra prediction mode If the index is not smaller than the index indicated by the maximum possible mode of the current block, the intra prediction mode corresponding to the second intra prediction mode index by adding 1 to the first intra prediction mode index is determined as the intra prediction mode of the current block, otherwise Otherwise, the intra prediction mode corresponding to the first intra prediction mode index may be determined as the intra prediction mode of the current block.

The intra prediction mode allowable for the current block may include at least one non-directional mode (non-directional mode) and a plurality of directional modes (directional modes).

The one or more non-directional modes may be DC mode and/or planar mode. Also, any one of the DC mode and the planar mode may be adaptively included in the allowable intra prediction mode set.

To this end, information specifying a non-directional mode included in the allowable intra prediction mode set may be included in the picture header or the slice header.

Next, the intra prediction unit 230 reads reference pixels from the picture storage unit 260 to generate an intra prediction block, and determines whether there are reference pixels that are not available.

The determination may be made according to the presence or absence of reference pixels used to generate an intra prediction block by applying the decoded intra prediction mode of the current block.

Next, when it is necessary to generate a reference pixel, the intra prediction unit 230 may generate reference pixels at an unavailable location using previously reconstructed available reference pixels.

A definition of an unavailable reference pixel and a method of generating a reference pixel may be the same as the operation of the intra prediction unit 150 according to FIG. 1 , but an intra prediction block is generated according to the decoded intra prediction mode of the current block. Reference pixels used for this may be selectively reconstructed.

In addition, the intra prediction unit 230 determines whether to apply the filter to the reference pixels to generate the prediction block, that is, whether to apply the filtering to the reference pixels to generate the intra prediction block of the current block. It may be determined based on the decoded intra prediction mode and the size of the current prediction block.

Since the problem of blocking artifacts increases as the size of the block increases, the number of prediction modes for filtering reference pixels can be increased as the size of the block increases. The reference pixel may not be filtered for .

When it is determined that the filter needs to be applied to the reference pixel, the intra prediction unit 230 filters the reference pixels by using the filter.

At least two or more filters may be adaptively applied according to the degree of difference in level between the reference pixels. Preferably, the filter coefficients of the filter are symmetrical.

In addition, the above two or more filters may be adaptively applied according to the size of the current block. may be applied.

In the DC mode, there is no need to apply a filter because the prediction block is generated using the average value of the reference pixels. It may not be necessary to apply a filter to the reference pixel even in the horizontal mode that is related to the direction.

As such, whether or not filtering is applied is also related to the intra prediction mode of the current block, so that reference pixels can be adaptively filtered based on the intra prediction mode of the current block and the size of the prediction block.

Next, the intra prediction unit 230 generates a prediction block using the reference pixel or the filtered reference pixels according to the reconstructed intra prediction mode, and the generation of the prediction block is the same as the operation in the encoding apparatus 10 . Therefore, a detailed description thereof will be omitted.

The intra prediction unit 230 determines whether to filter the generated prediction block, and whether to filter may be determined by using information included in a slice header or a coding unit header or according to an intra prediction mode of the current block.

When it is determined that the generated prediction block is to be filtered, the intra prediction unit 230 may generate a new pixel by filtering a pixel at a specific position in the generated prediction block using available reference pixels adjacent to the current block. .

For example, in the DC mode, a prediction pixel contacting reference pixels among prediction pixels may be filtered using a reference pixel contacting the prediction pixel.

Accordingly, the prediction pixel is filtered using one or two reference pixels according to the location of the prediction pixel, and filtering of the prediction pixel in the DC mode can be applied to prediction blocks of all sizes.

Meanwhile, in the vertical mode, among the prediction pixels of the prediction block, the prediction pixels in contact with the left reference pixel may be changed using reference pixels other than the upper pixel used to generate the prediction block.

Similarly, in the horizontal mode, among the generated prediction pixels, the prediction pixels in contact with the upper reference pixel may be changed using reference pixels other than the left pixel used to generate the prediction block.

The current block may be reconstructed using the prediction block of the current block reconstructed in this way and the residual block of the decoded current block.

9 is a diagram for explaining a second embodiment of a method of dividing and processing an image in block units.

Referring to FIG. 9 , a coding tree unit (CTU) having a maximum size of 256x256 pixels may be first divided into a quad tree structure, and then divided into four coding units (CUs) having a square shape.

Here, at least one of the coding units divided into the quad tree structure may be divided into a binary tree structure and re-segmented into two coding units (CUs) having a rectangular shape.

Meanwhile, at least one of the coding units divided into the quad tree structure may be divided into a quad tree structure and re-segmented into four coding units (CUs) having a square shape.

In addition, at least one of the coding units re-segmented into the binary tree structure may be divided into a binary tree structure and divided into two coding units (CUs) having a square or rectangular shape.

Meanwhile, at least one of the coding units re-segmented into the quad-tree structure may be further divided into a quad-tree structure or a binary tree structure, and may be divided into coding units (CUs) having a square or rectangular shape.

Coding blocks (CBs) configured by being divided into a binary tree structure as described above are not further divided and may be used for prediction and transformation. That is, the size of the prediction unit PU and the transform unit TU belonging to the coding block CB as shown in FIG. 9 may be the same as the size of the corresponding coding block CB.

The coding unit divided into the quad tree structure as described above may be divided into one or two or more prediction units (PUs) using the method described with reference to FIGS. 3 and 4 .

In addition, the coding unit divided into the quad tree structure as described above may be divided into one or two or more transform units (TUs) using the method as described with reference to FIG. 5, and the divided transform units (TUs) may have a maximum size of 64x64 pixels.

In addition, a syntax structure used to divide and process an image in block units may indicate segmentation information using a flag. For example, whether the coding unit (CU) is split may be indicated using split_cu_flag, and the depth of the coding unit (CU) split using a binary tree may be indicated using binary_depth. In addition, whether the coding unit (CU) is split into a binary tree structure may be indicated by a separate binary_split_flag.

As described with reference to FIGS. 1 to 8 for blocks (eg, coding unit (CU), prediction unit (PU), and transform unit (TU)) divided by the method as described with reference to FIG. 9 , By applying the same methods, encoding and decoding of an image may be performed.

Hereinafter, another embodiment of a method of dividing a coding unit (CU) into one or two or more transform units (TUs) will be described with reference to FIGS. 10 to 15 .

According to an embodiment of the present invention, a coding unit (CU) may be divided into a binary tree structure and divided into transform units (TUs), which are basic units in which transform on a residual block is performed.

Referring to FIG. 10 , at least one of the rectangular coding blocks CB0 and CB1 divided into a binary tree structure and having a size of Nx2N or 2NxN is again divided into a binary tree structure, and a square transform unit having a size of NxN It can be divided into (TU0, TU1).

As described above, the block-based image encoding method may perform prediction, transformation, quantization, and entropy encoding steps.

In the prediction step, a prediction signal is generated by referring to a block currently being encoded and an existing encoded image or a neighboring image, and a difference signal with the current block can be calculated through this.

On the other hand, in the transforming step, transforming is performed using various transform functions with the differential signal as input, and the transformed signal is classified into DC coefficients and AC coefficients and energy compaction is performed to improve encoding efficiency. can

In addition, in the quantization step, transform coefficients are quantized as inputs, and then entropy encoding is performed on the quantized signal, so that an image may be encoded.

On the other hand, the image decoding method proceeds in the reverse order of the encoding process as described above, and image quality distortion may occur in the quantization step.

As a method for reducing image quality distortion while improving encoding efficiency, the size or shape of the transform unit (TU) and the type of transform function applied can be varied according to the distribution of the differential signal input as an input and the characteristics of the image in the transform step. have.

For example, in the prediction step, when a block similar to the current block is found through a block-based motion estimation process, a difference using a cost measurement method such as sum of absolute difference (SAD) or mean square error (MSE) is used. The distribution of the signal may occur in various forms depending on the characteristics of the image.

Accordingly, effective encoding may be performed by selectively determining the size or shape of the transform unit CU based on the distribution of various differential signals to perform the transform.

For example, when a differential signal is generated in an arbitrary coding block (CBx), effective transform can be performed by dividing the coding block (CBx) into two transform units (TUs) by dividing the corresponding coding block (CBx) into a binary tree structure. . Since it can be said that the DC value generally represents the average value of the input signal, when a differential signal is received as an input of the transform process, it can effectively represent the DC value by dividing the coding block (CBx) into two transform units (TU). have.

Referring to FIG. 11 , a square coding unit CU0 having a size of 2Nx2N is divided into a binary tree structure, and may be divided into rectangular transform units TU0 and TU1 having a size of Nx2N or 2NxN.

According to another embodiment of the present invention, it is possible to divide the coding unit (CU) into a plurality of transform units (TUs) by repeating the step of dividing the coding unit (CU) into a binary tree structure two or more times as described above.

12 , a rectangular coding block CB1 having a size of Nx2N is divided into a binary tree structure, and the divided block having a size of NxN is divided again into a binary tree structure to form N/2xN or NxN/2. After constructing a rectangular block having a size of , TU4, TU5).

Referring to FIG. 13, a square coding block CB0 having a size of 2Nx2N is divided into a binary tree structure, and the divided block having a size of Nx2N is again divided into a binary tree structure to form a square having a size of NxN. After constructing the block, the block having a size of NxN may be divided into a binary tree structure again to be divided into rectangular transform units TU1 and TU2 having a size of N/2xN.

Referring to FIG. 14 , a rectangular coding block CB0 having a size of 2NxN is divided into a binary tree structure, and the divided block having a size of NxN is again divided into a quad tree structure to have a size of N/2xN/2. It can be divided into square transform units (TU1, TU2, TU3, TU4) having .

1 to 8 for blocks (eg, coding unit (CU), prediction unit (PU), and transform unit (TU)) divided by the method as described with reference to FIGS. 10 to 14 . By applying the methods as described above, encoding and decoding of an image may be performed.

Hereinafter, embodiments of a method for the encoding apparatus 10 according to the present invention to determine a block division structure will be described.

The picture splitter 110 included in the video encoding apparatus 10 performs Rate Distortion Optimization (RDO) according to a preset order, and as described above, a splittable coding unit (CU), a prediction unit (PU), and a transform The division structure of the unit (TU) may be determined.

For example, in order to determine the block division structure, the picture division unit 110 selects an optimal block division structure in terms of bitrate and distortion while performing Rate Distortion Optimization-Quantization (RDO-Q). can decide

Referring to FIG. 15 , when the coding unit CU has the form of a 2Nx2N pixel size, the 2Nx2N pixel size shown in (a), the NxN pixel size shown in (b), and the Nx2N pixel size shown in (c) , (d) may determine the optimal division structure of the transform unit PU by performing RDO in the order of the 2NxN pixel size transformation unit PU division structure.

Referring to FIG. 16 , when the coding unit CU has the form of an Nx2N or 2NxN pixel size, a pixel size of Nx2N (or 2NxN) shown in (a), a pixel size of NxN shown in (b), N/2xN (or NxN/2) and NxN pixel sizes shown in (c), N/2xN/2, N/2xN and NxN pixel sizes shown in (d), N shown in (e) The optimal division structure of the transformation unit PU may be determined by performing RDO in the order of the transformation unit PU division structure having a pixel size of /2xN.

In the above, the block division method of the present invention has been described by taking as an example that the block division structure is determined by performing Rate Distortion Optimization (RDO). ) to determine the block division structure, it is possible to reduce complexity while maintaining appropriate efficiency.

Hereinafter, an image processing method according to an embodiment of the present invention and an encoding and decoding method according thereto will be described in more detail.

17 and 18 are flowcharts illustrating an image processing method for processing motion information for parallel processing according to an embodiment of the present invention, and FIGS. 19 to 22 are motion information processing methods according to an embodiment of the present invention. These are drawings for illustrating each case.

As described above, when the motion compensation unit 160 of the encoding device 10 and the motion information decoder 248 of the decoding device 20 process motion information encoding and decoding in the merge and AMVP modes, respectively, the motion The processing of compensation, mode determination, entropy encoding, etc. may be implemented in a parallel pipeline system as hardware modules, respectively.

Accordingly, when the mode decision of the previous block is finished later than the processing time of the current block, the motion compensation processing of the current block cannot be performed, and thus a pipeline stall may occur.

To solve this, according to an embodiment of the present invention, the encoding apparatus 10 or the decoding apparatus 20 sequentially groups a plurality of blocks into parallel motion information prediction units according to a predetermined size (S101). , obtains motion information of at least one usable block among the remaining blocks excluding blocks belonging to the previous parallel motion information prediction unit of the current block in the neighboring block (S103), and constructs a motion information prediction list based on the obtained motion information By doing this (S105), it is possible to perform the motion information prediction decoding process for each mode based on the motion information prediction list (S107). However, if there is no block available in step S103, the motion information prediction list in step S105 is constructed using a predetermined zero motion vector (zero MV) or a collocated MV of the previous frame. can be

More specifically, the encoding and decoding object blocks may be sequentially grouped into parallel motion information prediction units (PMUs) having a predetermined size according to an encoding and decoding order.

In addition, if the nth parallel motion information prediction unit to which the current decoding object block belongs is referred to as PMU(n), the motion compensator 160 or the motion information decoder 248 performs motion vector information of neighboring blocks such as AMVP or Merge. In performing the encoding and decoding processing required for , blocks included in the PMU(n-1) encoded or decoded immediately before the current block may be excluded from the neighboring blocks.

That is, the motion compensator 160 or the motion information decoder 248 converts the motion information of the block included in the PMU(n-1) previously encoded/decoded with respect to the PMU(n) to which the current block belongs to the current block. It can be excluded when constructing the motion information prediction (MVP) candidate list of . Accordingly, the MVP candidate list corresponding to the current block may be determined from motion information of a block not included in the PMU(n-1) among neighboring blocks.

However, since the number of motion vectors of the available neighboring blocks may be reduced due to this, in order to prevent a decrease in encoding efficiency, as shown in FIG. 19 , more neighboring blocks (F ~ The motion information of I) may be further used for motion vector prediction (MVP) candidate list construction.

Accordingly, at least one of motion vectors of available (eg, blocks on the same picture/tile/slice) blocks among neighboring blocks not included in PMU(n-1) is a final motion vector prediction (MVP) candidate list. can be decided.

On the other hand, as shown in FIG. 18 , the motion compensator 160 or the motion information decoder 248 decodes the motion information using a neighboring block at a predetermined position. A neighboring block to be used for motion prediction is identified (S201), and when there is a neighboring block included in the PMU(n-1) (S203), replacement information of motion information of the neighboring block included in the PMU(n-1) is identified (S201). is obtained (S205), and motion prediction decoding of the current block using the replacement information is processed without motion information of the neighboring blocks included in the PMU(n-1) (S207).

Here, the replacement information may be calculated as a predetermined default value even if the actual motion vector information of the corresponding position is not known, or may be a value derived and determined from neighboring blocks included in the PMU(n). For example, the replacement information of the neighboring blocks included in the PMU(n-1) may be composed of a zero vector (zero MV) or a motion vector (collocated MV) at the same position in the previous frame.

For such processing, the encoding apparatus 10 may transmit the size information of the PMU by including the PMU size information in the sequence, picture, or slice header information in the form of syntax. The size information of the PMU may be explicitly or implicitly signaled as a value related to the CTU size, the CU (or PU) minimum, and the maximum size.

In addition, the encoding apparatus 10 may sequentially group the PMUs according to a preset size, allocate a parallel motion information prediction unit index to each unit for indexing, and the allocated index information is explicitly transmitted, Alternatively, the index information may be derived from the decoding apparatus 20 .

For example, the size of the PMU may always be the same as the minimum PU size, or the PMU size may be the same as the size of a PU or CU currently being encoded/decoded. In such a case, PMU size information may not be explicitly transmitted, and an index may be identified according to sequential grouping.

Referring to FIG. 20 , a thick line indicates a CTU, an inner solid line indicates a PU, and a red dotted line indicates a PMU.

According to an embodiment of the present invention, the lower left motion vector among the neighboring motion vectors of the current PU may be a motion vector of a block included in the immediately preceding PMU(n-1) according to the encoding and decoding order. . Accordingly, in the motion vector prediction encoding and decoding, the encoding apparatus 10 and the decoding apparatus 20 exclude motion vectors of neighboring blocks included in the immediately preceding PMU(n-1) when constructing the motion vector candidate list. can And, as replacement information of the block included in the PMU(n-1) of the immediately previous index, a zero vector (zero MV) or a motion vector (collocated MV) at the same position in the previous frame may be used when constructing the motion vector candidate list. have.

Meanwhile, referring to FIG. 21 , since the upper right neighboring block is included in the immediately previous PMU(n-1), it is excluded from the candidate motion vector in the motion vector prediction encoding and decoding of the current block, instead of the zero vector ( zero MV) or a co-located motion vector (collocated MV) of the previous frame may be used as a candidate motion vector.

And, referring to FIG. 22 , a case in which all the neighboring blocks on the left are included in the previous PMU(n-1) is exemplified. As shown in FIG. 22, in the motion vector prediction encoding and decoding processing of the encoding apparatus 10 and the decoding apparatus 20, motion vectors of all neighboring blocks on the left are excluded from the candidate motion vectors, and instead of the top (upper left and A candidate list for motion vector prediction may be constructed using motion vectors of neighboring blocks (upper right).

With such a configuration, dependencies between parallel motion information prediction units can be separated, and motion information decoding can be processed without waiting for the completion of processing of blocks processed in the previous pipeline among neighboring blocks. stall) can be prevented in advance, thereby improving encoding and decoding efficiency.

The method according to the present invention described above may be produced as a program to be executed by a computer and stored in a computer-readable recording medium. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape. , a floppy disk, an optical data storage device, and the like, and also includes those implemented in the form of a carrier wave (eg, transmission through the Internet).

The computer-readable recording medium is distributed in a network-connected computer system, so that the computer-readable code can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the method can be easily inferred by programmers in the art to which the present invention pertains.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims Various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

Claims (3)

In the video decoding method,
deriving a first motion information candidate using a spatial neighboring block of the current block;
deriving a second motion information candidate by using at least one block included in a specific region included in the current picture;
generating a candidate list by using at least one of the first motion candidate and the second motion candidate; and
Comprising the step of generating a prediction block of the current block based on the candidate list,
The specific region included in the current picture is a coding tree unit including the current block, and at least one block included in the specific region is a block pre-decoded than the current block,
The spatial neighboring blocks include a lower left block, a left block, an upper left block, an upper block, and an upper right block of the current block. In the video encoding method,
deriving a first motion information candidate using a spatial neighboring block of the current block;
deriving a second motion information candidate by using at least one block included in a specific region included in the current picture;
generating a candidate list by using at least one of the first motion candidate and the second motion candidate; and
Comprising the step of encoding the motion information of the current block based on the candidate list,
The specific region included in the current picture is a coding tree unit including the current block, and at least one block included in the specific region is a block less encoded than the current block,
The spatial neighboring blocks include a lower left block, a left block, an upper left block, an upper block, and an upper right block of the current block. A non-transitory computer-readable recording medium including a bitstream generated by an image encoding method,
The video encoding method comprises:
deriving a first motion information candidate using a spatial neighboring block of the current block;
deriving a second motion information candidate by using at least one block included in a specific region included in the current picture;
generating a candidate list by using at least one of the first motion candidate and the second motion candidate; and
Comprising the step of encoding the motion information of the current block based on the candidate list,
The specific region included in the current picture is a coding tree unit including the current block, and at least one block included in the specific region is a block less encoded than the current block,
The spatially neighboring blocks include a lower left block, a left block, an upper left block, an upper block, and an upper right block of the current block.

Images