WO2020180153A1

WO2020180153A1 - Method and apparatus for processing video signal for inter prediction

Info

Publication number: WO2020180153A1
Application number: PCT/KR2020/003185
Authority: WO
Inventors: 살레하이파메흐디; 김승환
Original assignee: 엘지전자 주식회사
Priority date: 2019-03-06
Filing date: 2020-03-06
Publication date: 2020-09-10

Abstract

Embodiments of the present specification provide methods of encoding and decoding a video signal for inter prediction. A decoding method according to an embodiment of the present specification comprises the steps of: obtaining motion vector difference (MVD) coding information related to a MVD for prediction of a current block; and decoding the MVD coding information. The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, the first flag information includes first component flag information indicating whether a first direction component of the MVD is greater than the first reference value, and second component flag information indicating whether a second direction component of the MVD is greater than the first reference value, and the first component flag information and the second component flag information are decoded on the basis of different context models from each other. The coding efficiency of the MVD can be increased by performing encoding/decoding by reflecting characteristics according to the components of the MVD and applying different context models according to the components of the MVD.

Description

Video signal processing method and apparatus for inter prediction

Embodiments of the present specification relate to a video/video compression coding system, and more particularly, to a method and apparatus for performing inter prediction in an encoding/decoding process of a video signal.

Compression coding refers to a series of signal processing techniques for transmitting digitized information through a communication line or storing it in a format suitable for a storage medium. Media such as video, image, and audio may be subject to compression encoding. In particular, a technique for performing compression encoding on an image is referred to as video image compression.

Next-generation video content will be characterized by high spatial resolution, high frame rate, and high dimensionality of scene representation. In order to process such content, it will bring a tremendous increase in terms of memory storage, memory access rate, and processing power.

Inter prediction is a method of performing prediction on a current picture by referring to reconstructed samples of another picture. In order to increase the efficiency of inter prediction, various motion vector derivation methods along with new inter prediction techniques have been discussed.

In addition, entropy coding is a method of outputting a bitstream or outputting a syntax element from the bitstream by compressing a syntax element (data) determined in a video signal coding process. Similarly, techniques for efficient entropy encoding/decoding of information related to inter prediction are being discussed.

An embodiment of the present specification provides a method and apparatus for efficiently encoding/decoding motion vector difference (MVD) coding information in a process of encoding/decoding information for inter prediction.

The technical problems to be achieved in the embodiments of the present specification are not limited to the technical problems mentioned above, and other technical problems that are not mentioned are those of ordinary skill in the technical field to which the embodiments of the present specification belong from the following description. Will be clearly understood.

Embodiments of the present specification provide a method of encoding and decoding a video signal for inter prediction. A method of decoding a video signal according to an embodiment of the present specification includes obtaining MVD coding information related to motion vector difference (MVD) for prediction of a current block, and decoding the MVD coding information. The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information indicates whether a first direction component of the MVD is greater than the first reference value. Including the indicated first component flag information and second component flag information indicating whether the second direction component of the MVD is greater than the first reference value, the first component flag information and the second component flag information It can be decoded based on different context models.

In one embodiment, the MVD coding information further includes second flag information indicating whether the MVD is greater than a second reference value, MVD size information, and MVD code information, and the second flag information 1 is obtained based on flag information, the MVD size information is obtained based on the first flag information and the second flag information, and the MVD code information may be obtained based on the first flag information.

In one embodiment, the second flag information includes a third component flag indicating whether a first direction component of the MVD is greater than the second reference value, and a second direction component of the MVD is greater than the second reference value. A fourth component flag indicating whether or not it is large may be included.

In an embodiment, the MVD size information may be decoded based on an exponential Golomb parameter having an order of 2 or more.

In one embodiment, the obtaining of the MVD coding information includes determining whether an intra block copy (IBC) mode is applied to the current block, and when the IBC mode is applied to the current block, IBC MVD It may include the step of obtaining coding information. The obtaining of the IBC MVD coding information includes obtaining first MVD size information indicating an absolute value of the first direction component of the MVD, and whether the second direction component of the MVD is greater than the first reference value. Acquiring the second component flag indicating the second component flag, and obtaining a fourth component flag indicating whether a second direction component of the MVD is greater than a second reference value based on the second component flag; and And obtaining second MVD size information indicating an absolute value minus 2 of the second component of the MVD based on the second component flag and the fourth component flag.

In an embodiment, the first MVD size information may be decoded based on an exponential Golomb parameter having an order of 2 or more.

A video signal encoding method according to an embodiment of the present specification includes determining a motion vector of a current block based on motion prediction, and determining a motion vector difference (MVD) of the current block based on the motion vector. And encoding MVD coding information related to the MVD. The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information indicates whether a first direction component of the MVD is greater than the first reference value. Including the indicated first component flag information and second component flag information indicating whether the second direction component of the MVD is greater than the first reference value, the first component flag information and the second component flag information They are encoded based on different context models.

In one embodiment, the MVD coding information further includes second flag information indicating whether the MVD is greater than a second reference value, MVD size information, and MVD code information, and the second flag information is the first It is obtained based on flag information, the MVD size information is encoded based on the first flag information and the second flag information, and the MVD code information may be encoded based on the first flag information.

In an embodiment, the MVD size information may be encoded based on an exponential Golomb parameter having an order of 2 or more.

In one embodiment, the encoding of the MVD coding information includes determining whether an intra block copy (IBC) mode is applied to the current block, and when the IBC mode is applied to the current block, IBC MVD It may include encoding the coding information. The encoding of the IBC MVD coding information includes: encoding first MVD size information indicating an absolute value of a first direction component of the MVD, and whether a second direction component of the MVD is greater than the first reference value. Encoding the second component flag indicating to, and encoding the fourth component flag indicating whether a second direction component of the MVD is greater than the second reference value based on the second component flag. And, based on the second component flag and the fourth component flag, second MVD size information indicating the absolute value of the second component of the MVD minus 2 may be encoded.

In an embodiment, the first MVD size information may be encoded based on an exponential Golomb parameter having a degree of 2 or more.

An apparatus for encoding a video signal for inter prediction according to an embodiment of the present specification includes a memory for storing the video signal and a processor coupled to the memory. The processor is configured to determine a motion vector of a current block based on motion prediction, determine a motion vector difference (MVD) of the current block based on the motion vector, and encode MVD coding information related to the MVD. The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information indicates whether a first direction component of the MVD is greater than the first reference value. Including the indicated first component flag information and second component flag information indicating whether the second direction component of the MVD is greater than the first reference value, the first component flag information and the second component flag information They are encoded based on different context models.

A video signal decoding apparatus for inter prediction according to an embodiment of the present specification includes a memory for storing the video signal and a processor coupled with the memory. The processor is configured to determine a motion vector of a current block based on motion prediction, determine a motion vector difference (MVD) of the current block based on the motion vector, and encode MVD coding information related to the MVD, , The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information is whether a first direction component of the MVD is greater than the first reference value. And second component flag information indicating whether a second direction component of the MVD is greater than the first reference value, and the first component flag information and the second component flag information Are encoded based on different context models.

An embodiment of the present specification provides a non-transitory computer-readable medium storing one or more instructions. The one or more instructions executed by one or more processors enable a video signal processing apparatus to obtain MVD coding information related to a motion vector difference (MVD) for prediction of a current block, and the MVD coding information Control to decode The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information indicates whether a first direction component of the MVD is greater than the first reference value. Including the indicated first component flag information and second component flag information indicating whether the second direction component of the MVD is greater than the first reference value, the first component flag information and the second component flag information It is decoded based on different context models.

The one or more instructions determine a motion vector of a current block based on motion prediction, determine a motion vector difference (MVD) of the current block based on the motion vector, and determine MVD coding information related to the MVD. Control the video signal processing device to encode. The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information indicates whether a first direction component of the MVD is greater than the first reference value. Including the indicated first component flag information and second component flag information indicating whether the second direction component of the MVD is greater than the first reference value, the first component flag information and the second component flag information They are encoded based on different context models.

According to an embodiment of the present specification, the amount of data and coding complexity/time of information required for inter prediction are reduced by applying an entropy coding technique according to the characteristics of each component constituting MVD (motion vector difference) coding information. I can make it.

The effects obtained in the embodiments of the present specification are not limited to the above-mentioned effects, and other effects not mentioned are clearly to those of ordinary skill in the art to which the embodiments of the present specification belong from the following description. It will be understandable.

The accompanying drawings, which are included as part of the detailed description to aid in understanding of the present specification, provide embodiments of the present specification, and describe technical features of the present specification together with the detailed description.

1 shows an example of an image coding system according to an embodiment of the present specification.

2 shows an example of a schematic block diagram of an encoding apparatus in which encoding of a video signal is performed according to an embodiment of the present specification.

3 shows an example of a schematic block diagram of a decoding apparatus for decoding an image signal according to an embodiment of the present specification.

4 shows an example of a content streaming system according to an embodiment of the present specification.

5 shows an example of a video signal processing apparatus according to an embodiment of the present specification.

6 illustrates an example of a picture division structure according to an embodiment of the present specification.

7A to 7D illustrate an example of a block division structure according to an embodiment of the present specification.

8 shows an example of a case in which the ternary tree (TT) and the binary tree (BT) are divided according to an embodiment of the present specification.

9 is a block diagram for entropy encoding according to an embodiment of the present specification.

10A and 10B illustrate an entropy encoding method and related components according to an embodiment of the present specification.

11A and 11B illustrate an entropy decoding method and related components according to an embodiment of the present specification.

12 is an example of a flowchart for encoding a picture constituting a video signal according to an embodiment of the present specification.

13 is an example of a flowchart for decoding a picture constituting a video signal according to an embodiment of the present specification.

14 illustrates an example of a hierarchical structure for a coded image according to an embodiment of the present specification.

15A and 15B illustrate a video/video encoding method based on inter prediction and an inter prediction unit in an encoding apparatus according to an embodiment of the present specification.

16A and 16B illustrate a video/video decoding method based on inter prediction and an inter prediction unit in a decoding apparatus according to an embodiment of the present specification.

17 illustrates an inter prediction procedure according to an embodiment of the present specification.

18 illustrates examples of spatial neighboring blocks used as spatial merge candidates according to an embodiment of the present specification.

19 is an example of a flowchart for configuring a merge candidate list according to an embodiment of the present specification.

20 is an example of a flowchart for configuring a motion vector predictor (MVP) candidate list according to an embodiment of the present specification.

21 illustrates an example in which a symmetric motion vector difference (SMVD) mode according to an embodiment of the present specification is applied.

22 illustrates an example of affine motion models according to an embodiment of the present specification.

23A and 23B illustrate examples of motion vectors for each control point according to an embodiment of the present specification.

24 shows an example of a motion vector for each subblock according to an embodiment of the present specification.

25 is an example of a flowchart for configuring an affine merge candidate list according to an embodiment of the present specification.

26 illustrates an example of blocks for deriving an inherited affine motion predictor according to an embodiment of the present specification.

27 illustrates an example of control point motion vectors for deriving an inherited affine motion predictor according to an embodiment of the present specification.

28 shows examples of blocks for deriving a constructed affine merge candidate according to an embodiment of the present specification.

29 is an example of a flowchart for configuring an affine MVP candidate list according to an embodiment of the present specification.

30A and 30B illustrate examples of spatial neighboring blocks used in adaptive temporal motion vector prediction (ATMVP) and sub-coding block (CU) motion fields derived from spatial neighboring blocks according to an embodiment of the present specification. Shows.

31A and 31B illustrate an example of a video/video encoding method based on an intra block copy (IBC) mode and a prediction unit in an encoding apparatus according to an embodiment of the present specification.

32A and 32B illustrate examples of a video/video decoding method based on an IBC mode and a prediction unit in a decoding apparatus according to an embodiment of the present specification.

33 shows an example of a flowchart for obtaining motion vector difference (MVD) coding information according to an embodiment of the present specification.

34A and 34B illustrate examples of flowcharts for obtaining information on x and y components of MVD according to an embodiment of the present specification.

35A and 35B illustrate an example of a flowchart for encoding information on an x component and a y component of an MVD according to an embodiment of the present specification.

36A and 36B illustrate examples of statistics of bin values for x and y components of MVD according to an embodiment of the present specification.

37 illustrates an example in which MVD coding is separately applied when general MVD coding and IBC mode according to an embodiment of the present specification are applied.

38 is an example of a flowchart of encoding a video signal for inter prediction according to an embodiment of the present specification.

39 is an example of a flowchart of decoding a video signal for inter prediction according to an embodiment of the present specification.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The detailed description to be disclosed hereinafter together with the accompanying drawings is intended to describe exemplary embodiments of the present invention, and is not intended to represent the only embodiments in which the present invention may be practiced. The following detailed description includes specific details to provide a thorough understanding of the present invention. However, one of ordinary skill in the art appreciates that the invention may be practiced without these specific details.

In some cases, in order to avoid obscuring the concept of the present invention, well-known structures and devices may be omitted, or may be shown in a block diagram form centering on core functions of each structure and device.

In addition, as for terms used in the present invention, general terms that are currently widely used are selected as far as possible, but specific cases will be described using terms arbitrarily selected by the applicant. In such a case, since the meaning of the term is clearly described in the detailed description of the corresponding part, it should not be interpreted simply by the name of the term used in the description of the present invention, and it should be clarified that the meaning of the term should be understood and interpreted. .

Specific terms used in the following description are provided to aid understanding of the present invention, and the use of these specific terms may be changed in other forms without departing from the technical spirit of the present invention. For example, signals, data, samples, pictures, frames, blocks, etc. may be appropriately replaced and interpreted in each coding process.

Hereinafter, in this specification, a'processing unit' means a unit in which an encoding/decoding process such as prediction, transformation, and/or quantization is performed. Also, the processing unit may be interpreted as including a unit for a luma component and a unit for a chroma component. For example, the processing unit may correspond to a block, a coding unit (CU), a prediction unit (PU), or a transform unit (TU).

Further, the processing unit may be interpreted as a unit for a luminance component or a unit for a color difference component. For example, the processing unit may correspond to a coding tree block (CTB), a coding block (CB), a PU, or a transform block (TB) for a luminance component. Alternatively, the processing unit may correspond to CTB, CB, PU or TB for the color difference component. Further, the present invention is not limited thereto, and the processing unit may be interpreted as including a unit for a luminance component and a unit for a color difference component.

Further, the processing unit is not necessarily limited to a square block, and may be configured in a polygonal shape having three or more vertices.

In addition, in the present specification, pixels or pixels are collectively referred to as samples. In addition, using a sample may mean using a pixel value or a pixel value.

1 shows an example of an image coding system according to an embodiment of the present specification. The image coding system may include a source device 10 and a reception device 20. The source device 10 may transmit the encoded video/video information or data in a file or streaming format to the receiving device 20 through a digital storage medium or a network.

The source device 10 may include a video source 11, an encoding device 12, and a transmitter 13. The receiving device 20 may include a receiver 21, a decoding device 22 and a renderer 23. The encoding device 12 may be referred to as a video/image encoding device, and the decoding device 22 may be referred to as a video/image decoding device. The transmitter 13 may be included in the encoding device 12. The receiver 21 may be included in the decoding device 22. The renderer 23 may include a display unit, and the display unit may be configured as a separate device or an external component.

The video source 11 may acquire a video/image through a process of capturing, synthesizing, or generating a video/image. The video source 11 may include a video/image capturing device and/or a video/image generating device. The video/image capturing device may include, for example, one or more cameras, and a video/image archive including previously captured video/images. Video/image generating devices may include, for example, computers, tablets, and smartphones, and may (electronically) generate video/images. For example, a virtual video/image may be generated through a computer, and in this case, a video/image capturing process may be substituted as a process of generating related data.

The encoding device 12 may encode an input video/video. The encoding apparatus 12 may perform a series of procedures such as prediction, transformation, and quantization for compression and coding efficiency. The encoded data (encoded video/video information) may be output in the form of a bitstream.

The transmitter 13 may transmit the encoded video/video information or data output in the form of a bitstream to the receiver 21 of the receiving device 20 through a digital storage medium or a network in a file or streaming form. Digital storage media include USB (universal serial bus), SD card (secure digital card), CD (compact disc), DVD (digital versatile disc), Blu-ray disc, HDD (hard disk drive), SSD (solid state drive) may include a variety of storage media. The transmitter 13 may include an element for generating a media file through a predetermined file format, and may include an element for transmission through a broadcast/communication network. The receiver 21 may extract the bitstream and transmit it to the decoding device 22.

The decoding device 22 may decode the video/video by performing a series of procedures such as inverse quantization, inverse transformation, and prediction corresponding to the operation of the encoding device 12.

The renderer 23 may render the decoded video/image. The rendered video/image may be displayed through the display unit.

2 shows an example of a schematic block diagram of an encoding apparatus in which encoding of a video signal is performed according to an embodiment of the present specification. The encoding device 100 of FIG. 2 may correspond to the encoding device 12 of FIG. 1.

Referring to FIG. 2, the encoding apparatus 100 includes an image partitioning module 110, a subtraction module 115, a transform module 120, and a quantization module. (130), a de-quantization module (140), an inverse-transform module (150), an addition module (155), a filtering module (160), a memory A (memory) 170, an inter prediction module 180, an intra prediction module 185, and an entropy encoding module 190 may be included. The inter prediction unit 180 and the intra prediction unit 185 may be collectively referred to as a prediction unit. That is, the prediction unit may include an inter prediction unit 180 and an intra prediction unit 185. The transform unit 120, the quantization unit 130, the inverse quantization unit 140, and the inverse transform unit 150 may be included in a residual processing unit. The residual processing unit may further include a subtraction unit 115. The above-described image segmentation unit 110, subtraction unit 115, transform unit 120, quantization unit 130, inverse quantization unit 140, inverse transform unit 150, addition unit 155, filtering unit 160 ), the inter prediction unit 180, the intra prediction unit 185, and the entropy encoding unit 190 may be configured by one hardware component (eg, an encoder or a processor) according to an embodiment. In addition, the memory 170 may include a decoded picture buffer (DPB) 175 and may be configured by a digital storage medium.

The image segmentation unit 110 may divide an input image (or picture, frame) input to the encoding apparatus 100 into one or more processing units. For example, the processing unit may be referred to as a coding unit (CU). In this case, the coding unit may be recursively partitioned from a coding tree unit (CTU) or a largest coding unit (LCU) according to a quad-tree binary-tree (QTBT) structure. For example, one coding unit may be divided into a plurality of coding units of a deeper depth based on a quad tree structure and/or a binary tree structure. In this case, for example, a quad tree structure may be applied first and a binary tree structure may be applied later. Alternatively, the binary tree structure may be applied first. A coding procedure according to an embodiment of the present specification may be performed based on a final coding unit that is no longer divided. In this case, the maximum coding unit may be directly used as the final coding unit based on coding efficiency according to image characteristics. Further, if necessary, the coding unit is recursively divided into coding units of a lower depth, so that a coding unit having an optimal size may be used as a final coding unit. Here, the coding procedure may include procedures such as prediction, transformation, and restoration described below. As another example, the processing unit may further include a prediction unit (PU) or a transform unit (TU). In this case, the prediction unit and the transform unit may be divided from the above-described coding units, respectively. The prediction unit may be a unit of sample prediction, and the transform unit may be a unit for inducing a transform coefficient or a unit for inducing a residual signal from the transform coefficient.

The term "unit" used in this document may be used interchangeably with terms such as "block" or "area" in some cases. In this document, the MxN block may represent a set of samples or transform coefficients consisting of M columns and N rows. A sample may generally represent a pixel or a value of a pixel, may represent a pixel/pixel value of a luminance component, or a pixel/pixel value of a saturation component. A sample may be used as a term corresponding to one picture (or image) as a pixel or pel.

The encoding apparatus 100 subtracts a prediction signal (predicted block, prediction sample array) output from the inter prediction unit 180 or the intra prediction unit 185 from the input video signal (original block, original sample array) A signal (residual signal, residual block, residual sample array) may be generated. The generated residual signal is transmitted to the conversion unit 120. In this case, as illustrated, a unit that subtracts the prediction signal (prediction block, prediction sample array) from the input image signal (original block, original sample array) in the encoding apparatus 100 may be referred to as a subtraction unit 115. . The prediction unit may perform prediction on a block to be processed (hereinafter, referred to as a current block) and generate a predicted block including prediction samples for the current block. The prediction module may determine whether intra prediction or inter prediction is applied on a per CU basis. The prediction unit may generate information about prediction, such as prediction mode information, as described later in the description of each prediction mode, and may transmit information about prediction to the entropy encoding unit 190. Information about prediction is encoded by the entropy encoding unit 190 and may be output in the form of a bitstream.

The intra prediction unit 185 may predict the current block by referring to samples in the current picture. The referenced samples may be located in the vicinity of the current block or may be located away from each other according to the prediction mode. In intra prediction, prediction modes may include a plurality of non-directional modes and a plurality of directional modes. The non-directional mode may include, for example, a DC mode and a planar mode (Planar mode). The directional mode may include, for example, 33 directional prediction modes or 65 directional prediction modes according to a detailed degree of the prediction direction. However, this is an example, and more or less directional prediction modes may be used depending on the setting. The intra prediction unit 185 may determine a prediction mode applied to the current block by using the prediction mode applied to the neighboring block.

The inter prediction unit 180 may derive a predicted block for the current block based on a reference block (reference sample array) specified by a motion vector on the reference picture. In this case, in order to reduce the amount of motion information transmitted in the inter prediction mode, the inter prediction unit 180 may predict motion information in units of blocks, subblocks, or samples based on the correlation between motion information between neighboring blocks and the current block. have. The motion information may include a motion vector and a reference picture index. The motion information may further include inter prediction direction (L0 prediction, L1 prediction, Bi prediction, etc.) information. In the case of inter prediction, the neighboring block may include a spatial neighboring block existing in the current picture and a temporal neighboring block existing in the reference picture. The reference picture including the reference block and the reference picture including the temporal neighboring block may be the same or different. The temporal neighboring block may be referred to as a collocated reference block or a colCU (colCU), and a reference picture including the temporal neighboring block may be referred to as a collocated picture (colPic). For example, the inter prediction unit 180 constructs a motion information candidate list based on motion information of neighboring blocks, and indicates which candidate is used to derive a motion vector and/or a reference picture index of the current block. Can generate information. Inter prediction may be performed based on various prediction modes. For example, when a skip mode and a merge mode are used, the inter prediction unit 180 may use motion information of a neighboring block as motion information of a current block. In the case of the skip mode, unlike the merge mode, a residual signal is not transmitted. In the case of motion vector prediction (MVP) mode, a motion vector of a neighboring block is used as a motion vector predictor and a motion vector difference (MVD) is signaled to move the current block. Vector can be indicated.

The prediction unit may generate a prediction signal (prediction sample) based on various prediction methods described later. For example, the prediction unit may not only apply intra prediction or inter prediction to predict one block, but also apply intra prediction and inter prediction together (simultaneously). This may be referred to as CIIP (combined inter and intra prediction). Also, the prediction unit may perform intra block copy (IBC) to predict a block. IBC may be used for content (eg, game) video/video coding, such as, for example, screen content coding (SCC). Also, IBC may be referred to as CPR (current picture referencing). IBC basically performs prediction in the current picture, but can be performed similarly to inter prediction in that it derives a reference block in the current picture. That is, the IBC may use at least one of the inter prediction techniques described in this document.

The prediction signal generated by the prediction unit (including the inter prediction unit 180 and/or the intra prediction unit 185) may be used to generate a reconstructed signal or may be used to generate a residual signal. The transform unit 120 may generate transform coefficients by applying a transform technique to the residual signal. For example, the transformation technique uses at least one of DCT (Discrete Cosine Transform), DST (Discrete Sine Transform), KLT (Karhunen-Loeve Transform), GBT (Graph-Based Transform), or CNT (Conditionally Non-linear Transform). Can include. Here, GBT refers to transformation obtained from a graph representing relationship information between pixels. CNT refers to a transformation obtained based on the prediction signal and generating a prediction signal using all previously reconstructed pixels. In addition, the conversion process may be applied to a pixel block having the same size of a square, or may be applied to a block that is not a square or has a variable size.

The quantization unit 130 quantizes the transform coefficients and transmits the quantized transform coefficients to the entropy encoding unit 190. The entropy encoding unit 190 may encode a quantized signal (information on quantized transform coefficients) and output it as a bitstream. Information about the quantized transform coefficients may be referred to as residual information. The quantization unit 130 may rearrange the quantized transform coefficients in a block form into a one-dimensional vector form based on a coefficient scan order, and quantize the quantized transform coefficients based on the characteristics of the quantized transform coefficients in a one-dimensional vector form. It is also possible to generate information about transform coefficients. The entropy encoding unit 190 may perform various encoding techniques such as exponential Golomb, context-adaptive variable length coding (CAVLC), and context-adaptive binary arithmetic coding (CABAC). The entropy encoding unit 190 may encode information necessary for video/image restoration (eg, values of syntax elements) in addition to quantized transform coefficients together or separately. The encoded information (eg, video/video information) may be transmitted or stored in a bitstream format in units of network abstraction layer (NAL) units. The video/video information may further include information on various parameter sets, such as adaptation parameter set (APS), picture parameter set (PPS), sequence parameter set (SPS), or video parameter set (VPS). Signaled/transmitted information and/or syntax elements described later in this document may be encoded through the above-described encoding procedure and included in the bitstream. The bitstream may be transmitted over a network or may be stored in a digital storage medium. Here, the network may include a broadcasting network and/or a communication network, and the digital storage medium may include a storage medium such as USB, SD, CD, DVD, Blu-ray, HDD, and SSD. For the signal output from the entropy encoding unit 190, a transmission unit (not shown) for transmitting and/or a storage unit (not shown) for storing may be configured as internal/external elements of the encoding apparatus 100, or the transmission unit It may be a component of the entropy encoding unit 190.

The quantized transform coefficients output from the quantization unit 130 may be used to generate a reconstructed signal. For example, a residual signal may be restored by applying inverse quantization and inverse transform through the inverse quantization unit 140 and the inverse transform unit 150 in the loop for the quantized transform coefficients. The addition unit 155 adds the reconstructed residual signal to the prediction signal output from the inter prediction unit 180 or the intra prediction unit 185 to obtain a reconstructed signal (a reconstructed picture, a reconstructed block, and a reconstructed sample array). Can be generated. When there is no residual signal for the block to be processed, such as when the skip mode is applied, the predicted block may be used as a reconstructed block. The addition unit 155 may be referred to as a restoration unit or a restoration block generation unit. The generated reconstructed signal may be used for intra prediction of the next processing target block in the current picture, and may be used for inter prediction of the next picture through filtering as described later.

The filtering unit 160 may improve subjective/objective image quality by applying filtering to the reconstructed signal. For example, the filtering unit 160 may apply various filtering methods to the reconstructed picture to generate a modified reconstructed picture, and may transmit the modified reconstructed picture to the DPB 175 of the memory 170. . Various filtering methods may include, for example, deblocking filtering, sample adaptive offset (SAO), adaptive loop filter (ALF), and bilateral filter. The filtering unit 160 may generate filtering information and transmit the filtering information to the entropy encoding unit 190 as described later in the description of each filtering method. The filtering information may be output in the form of a bitstream through entropy encoding in the entropy encoding unit 190.

The modified reconstructed picture transmitted to the DPB 175 may be used as a reference picture in the inter prediction unit 180. When inter prediction is applied, the encoding apparatus 100 may avoid prediction mismatch between the encoding apparatus 100 and the decoding apparatus 200 by using the modified reconstructed picture, and may improve encoding efficiency. The DPB 175 may store the modified reconstructed picture for use as a reference picture in the inter prediction unit 180. The stored motion information may be transmitted to the inter prediction unit 180 for use as motion information of a spatial neighboring block or motion information of a temporal neighboring block. The memory 170 may store reconstructed samples of reconstructed blocks in the current picture, and transfer information on the reconstructed samples to the intra prediction unit 185.

3 shows an example of a schematic block diagram of a decoding apparatus for decoding an image signal according to an embodiment of the present specification. The decoding device 200 of FIG. 3 may correspond to the decoding device 22 of FIG. 1.

Referring to FIG. 3, the decoding apparatus 200 includes an entropy decoding module 210, a de-quantization module 220, an inverse transform module 230, and an adder. (addition module) 235, filtering module 240, memory 250, inter prediction module 260, and intra prediction module 265 may be included. have. The inter prediction unit 260 and the intra prediction unit 265 may be collectively referred to as a prediction module. That is, the prediction unit may include an inter prediction unit 180 and an intra prediction unit 185. The inverse quantization unit 220 and the inverse transform unit 230 may be collectively referred to as a residual processing module. That is, the residual processing unit may include an inverse quantization unit 220 and an inverse transform unit 230. The entropy decoding unit 210, the inverse quantization unit 220, the inverse transform unit 230, the addition unit 235, the filtering unit 240, the inter prediction unit 260, and the intra prediction unit 265 are implemented. It may be configured by one hardware component (eg, a decoder or a processor) according to an example. Also, the memory 250 may include the DPB 255, and may be configured by one hardware component (eg, a memory or a digital storage medium) according to an embodiment.

When a bitstream including video/image information is input, the decoding apparatus 200 may reconstruct an image in response to a process in which the video/image information is processed by the encoding apparatus 100 of FIG. 2. For example, the decoding apparatus 200 may perform decoding using a processing unit applied by the encoding apparatus 100. Thus, upon decoding, the processing unit may be, for example, a coding unit, and the coding unit may be divided from a coding tree unit or a maximum coding unit according to a quad tree structure and/or a binary tree structure. In addition, the reconstructed image signal decoded and output through the decoding device 200 may be reproduced through the playback device.

The decoding apparatus 200 may receive a signal output from the encoding apparatus 100 of FIG. 2 in the form of a bitstream, and the received signal may be decoded through the entropy decoding unit 210. For example, the entropy decoding unit 210 may parse the bitstream to derive information (eg, video/video information) necessary for image restoration (or picture restoration). The video/video information may further include information on various parameter sets, such as adaptation parameter set (APS), picture parameter set (PPS), sequence parameter set (SPS), or video parameter set (VPS). The decoding apparatus may decode a picture based on information on a parameter set. Signaled/received information and/or syntax elements described later in this document may be decoded through a decoding procedure and obtained from a bitstream. For example, the entropy decoding unit 210 acquires information in the bitstream using a coding technique such as exponential Golomb coding, CAVLC, or CABAC, and a value of a syntax element required for image restoration, and a quantized value of a transform coefficient for a residual. Can be printed. In more detail, in the CABAC entropy decoding method, a bin corresponding to each syntax element is received in a bitstream, and information about the syntax element to be decoded and decoding information of a block to be decoded and a neighbor or a symbol/bin decoded in a previous step The symbol corresponding to the value of each syntax element is determined by determining the context model using the information of, and performing arithmetic decoding of the bin by predicting the probability of occurrence of the bin according to the determined context model. Can be generated. In this case, the CABAC entropy decoding method may update the context model using information of the decoded symbol/bin for the context model of the next symbol/bin after the context model is determined. Among the information decoded by the entropy decoding unit 210, information on prediction is provided to the prediction unit (inter prediction unit 260 and intra prediction unit 265), and the register on which entropy decoding is performed by the entropy decoding unit 210 Dual values, that is, quantized transform coefficients and related parameter information may be input to the inverse quantization unit 220. In addition, information about filtering among information decoded by the entropy decoding unit 210 may be provided to the filtering unit 240. Meanwhile, a receiving unit (not shown) for receiving a signal output from the encoding device 100 may be further configured as an inner/outer element of the decoding device 200, or the receiving unit may be a component of the entropy decoding unit 210. May be. Meanwhile, the decoding apparatus 200 according to the present specification may be referred to as a video/video/picture decoding apparatus. The decoding apparatus 200 may be divided into an information decoder (video/video/picture information decoder) and a sample decoder (video/video/picture sample decoder). The information decoder may include an entropy decoding unit 210, and the sample decoder is an inverse quantization unit 220, an inverse transform unit 230, an addition unit 235, a filtering unit 240, a memory 250, and an inter prediction. It may include at least one of the unit 260 and the intra prediction unit 265.

The inverse quantization unit 220 may output transform coefficients through inverse quantization of the quantized transform coefficients. The inverse quantization unit 220 may rearrange the quantized transform coefficients into a two-dimensional block shape. In this case, the reordering may be performed based on the coefficient scan order performed by the encoding apparatus 100. The inverse quantization unit 220 may perform inverse quantization on quantized transform coefficients by using a quantization parameter (eg, quantization step size information) and obtain transform coefficients.

The inverse transform unit 230 inversely transforms the transform coefficients to obtain a residual signal (residual block, residual sample array).

The prediction unit may perform prediction on the current block and generate a predicted block including prediction samples for the current block. The prediction unit may determine whether intra prediction or inter prediction is applied to the current block based on information on prediction output from the entropy decoding unit 210, and may determine a specific intra/inter prediction mode.

The intra prediction unit 265 may predict the current block by referring to samples in the current picture. The referenced samples may be located near the current block or may be spaced apart according to the prediction mode. In intra prediction, prediction modes may include a plurality of non-directional modes and a plurality of directional modes. The intra prediction unit 265 may determine a prediction mode applied to the current block by using the prediction mode applied to the neighboring block.

The inter prediction unit 260 may derive a predicted block for the current block based on a reference block (reference sample array) specified by a motion vector on the reference picture. In this case, in order to reduce the amount of motion information transmitted in the inter prediction mode, motion information may be predicted in units of blocks, subblocks, or samples based on correlation between motion information between neighboring blocks and current blocks. The motion information may include a motion vector and a reference picture index. The motion information may further include inter prediction direction (L0 prediction, L1 prediction, Bi prediction) information. In the case of inter prediction, the neighboring block may include a spatial neighboring block existing in the current picture and a temporal neighboring block existing in the reference picture. For example, the inter prediction unit 260 may construct a motion information candidate list based on neighboring blocks, and derive a motion vector and/or a reference picture index of the current block based on the received candidate selection information. Inter prediction may be performed based on various prediction modes, and information on prediction may include information indicating a mode of inter prediction for a current block.

The addition unit 235 is reconstructed by adding the obtained residual signal to the prediction signal (predicted block, prediction sample array) output from the prediction unit (including the inter prediction unit 260 and/or the intra prediction unit 265). Signals (restored pictures, reconstructed blocks, reconstructed sample arrays) can be generated. When there is no residual for a block to be processed, such as when the skip mode is applied, the predicted block may be used as a reconstructed block.

The addition unit 235 may be referred to as a restoration unit or a restoration block generation unit. The generated reconstructed signal may be used for intra prediction of the next processing target block in the current picture, and may be used for inter prediction of the next picture through filtering as described later.

The filtering unit 240 may improve subjective/objective image quality by applying filtering to the reconstructed signal. For example, the filtering unit 240 may apply various filtering methods to the reconstructed picture to generate a modified reconstructed picture, and may transmit the modified reconstructed picture to the DPB 255 of the memory 250 . Various filtering methods may include, for example, deblocking filtering, sample adaptive offset, adaptive loop filter, and bilateral filter.

The modified reconstructed picture delivered to the DPB 255 of the memory 250 may be used as a reference picture by the inter prediction unit 260. The memory 250 may store motion information of a block from which motion information in a current picture is derived (or decoded) and/or motion information of blocks in a picture that have already been reconstructed. The stored motion information may be transmitted to the inter prediction unit 260 to be used as motion information of a spatial neighboring block or motion information of a temporal neighboring block. The memory 250 may store reconstructed samples of reconstructed blocks in the current picture, and may be transmitted to the intra prediction unit 265.

In the present specification, embodiments described in the filtering unit 160, the inter prediction unit 180, and the intra prediction unit 185 of the encoding apparatus 100 are respectively the filtering unit 240 and the inter prediction unit 260 of the decoding apparatus. ) And the intra prediction unit 265 may be applied to be the same or correspond to each other.

4 shows an example of a content streaming system according to an embodiment of the present specification. Content streaming systems to which the embodiments of the present specification are applied are largely an encoding server 410, a streaming server 420, a web server 430, and a media storage 440. ), a user equipment 450, and a multimedia input device 460.

The encoding server 410 generates a bitstream by compressing content input from a multimedia input device 460 such as a smartphone, a camera, or a camcorder into digital data, and transmits the generated bitstream to the streaming server 420. As another example, when the multimedia input device 460 such as a smartphone, a camera, or a camcorder directly generates a bitstream, the encoding server 410 may be omitted.

The bitstream may be generated by an encoding method or a bitstream generation method to which an embodiment of the present specification is applied, and the streaming server 420 may temporarily store the bitstream while transmitting or receiving the bitstream.

The streaming server 420 transmits multimedia data to the user device 450 based on a user request through the web server 430, and the web server 430 serves as an intermediary that informs the user of what kind of service exists. When a user requests a desired service from the web server 430, the web server 430 transmits information on the requested service to the streaming server 420, and the streaming server 420 transmits multimedia data to the user. In this case, the content streaming system may include a separate control server, and in this case, the control server serves to control commands/responses between devices in the content streaming system.

The streaming server 420 may receive content from the media storage 440 and/or the encoding server 410. For example, when receiving content from the encoding server 410, the streaming server 420 may receive the content in real time. In this case, in order to provide a smooth streaming service, the streaming server 420 may store the bitstream for a predetermined time.

The user device 450 includes, for example, a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistants (PDA), a portable multimedia player (PMP), a navigation system, and a slate PC ( slate PC), tablet PC, ultrabook, wearable device, e.g., smartwatch, smart glass, head mounted display (HMD)), It can include digital TV, desktop computer, and digital signage.

Each server in the content streaming system may be operated as a distributed server, and in this case, data received from each server may be distributedly processed.

5 shows an example of a video signal processing apparatus according to an embodiment of the present specification. The video signal processing apparatus of FIG. 5 may correspond to the encoding apparatus 100 of FIG. 1 or the decoding apparatus 200 of FIG. 2.

The video signal processing apparatus 500 for processing a video signal includes a memory 520 for storing a video signal, and a processor 510 for processing a video signal while being combined with the memory 520. The processor 510 according to the embodiment of the present specification may be configured with at least one processing circuit for processing a video signal, and may process a video signal by executing instructions for encoding/decoding a video signal. That is, the processor 510 may encode original video data or decode an encoded video signal by executing encoding/decoding methods described below. The processor 510 may be composed of one or more processors corresponding to each of the modules of FIG. 2 or 3. The memory 520 may correspond to the memory 170 of FIG. 2 or the memory 250 of FIG. 3.

Partitioning structure

The video/image coding method according to the present specification may be performed based on a split structure described later. Procedures such as prediction, residual processing (e.g., (inverse) transformation, (inverse) quantization), syntax element coding, and filtering, which will be described later, are CTU (coding tree unit) derived based on the load structure, CU (and/ Alternatively, it may be performed based on TU, PU). The block division procedure may be performed by the video division unit 110 of the encoding apparatus 100 described above, and division-related information is (encoded) processed by the entropy encoding unit 190 and transferred to the decoding apparatus 200 in the form of a bitstream. Can be delivered. The entropy decoding unit 210 of the decoding apparatus 200 derives the block division structure of the current block based on the division-related information obtained from the bitstream, and based on this, a series of procedures (e.g., prediction, registration) for decoding an image. Dual processing, block/picture restoration, and in-loop filtering) can be performed.

In video/image coding according to the embodiment of the present specification, an image processing unit may have a hierarchical structure. One picture may be divided into one or more tiles or tile groups. One tile group may include one or more tiles. One tile may contain more than one CTU. The CTU can be divided into one or more CUs. A tile is a rectangular region of CTUs within a particular tile column and a particular tile row in a picture. The tile group may include an integer number of tiles according to a tile raster scan in a picture. The tile group header may convey information/parameters applicable to the corresponding tile group. When the encoding device 100/decoding device 200 has a multi-core processor, an encoding/decoding procedure for a tile or a group of tiles may be processed in parallel. Here, the tile group may have one type of tile groups including an intra (I) tile group, a predictive (P) tile group, and a bi-predictive (B) tile group. For prediction of blocks in an I tile group, inter prediction is not used and only intra prediction can be used. Of course, even for the I tile group, a coded original sample value may be signaled without prediction. Intra prediction or inter prediction may be used for blocks in a P tile group, and when inter prediction is used, only uni prediction may be used. Meanwhile, intra prediction or inter prediction may be used for blocks in the B tile group, and when inter prediction is used, not only unidirectional prediction but also bi prediction may be used.

6 illustrates an example of a picture division structure according to an embodiment of the present specification. In FIG. 6, a picture having 216 (18 by 12) luminance CTUs is divided into 12 tiles and 3 tile groups.

The encoder determines the size of a tile/tile group and a maximum and minimum coding unit according to a characteristic (e.g., resolution) of a video image or in consideration of coding efficiency or parallel processing, and provides information about this or information for inducing it. It can be included in the bitstream.

The decoder may obtain information indicating whether the tile/tile group of the current picture and the CTU in the tile are divided into a plurality of coding units. Coding efficiency can be increased if such information is not always acquired (decoded) by the decoder, but is acquired (decoded) only under certain conditions.

The tile group header (tile group header syntax) may include information/parameters commonly applicable to the tile group. APS (APS syntax) or PPS (PPS syntax) may include information/parameters that can be commonly applied to one or more pictures. SPS (SPS syntax) may include information/parameters that can be commonly applied to one or more sequences. VPS (VPS syntax) may include information/parameters that can be commonly applied to the entire video. The high-level syntax of the present specification may include at least one of APS syntax, PPS syntax, SPS syntax, and VPS syntax.

Further, for example, information on the division and configuration of a tile/tile group may be configured in an encoder through a higher level syntax and then transmitted to a decoder in the form of a bitstream.

7A to 7D illustrate an example of a block division structure according to an embodiment of the present specification. 7A is a QT (quadtree, QT), FIG. 7b is a binary tree (BT), and FIG. 7c is a ternary tree (TT) and FIG. 7d shows an example of block division structures by an asymmetric tree (AT). do.

In a video coding system, one block may be divided based on a QT division scheme. In addition, one subblock divided by the QT division method may be further divided recursively according to the QT division method. A leaf block that is no longer divided by the QT division method may be divided by at least one of BT, TT, or AT. BT can have two types of division, such as horizontal BT (2NxN, 2NxN) and vertical BT (Nx2N, Nx2N). TT may have two types of division, such as horizontal TT (2Nx1/2N, 2NxN, 2Nx1/2N) and vertical TT (1/2Nx2N, Nx2N, 1/2Nx2N). AT is horizontal-up AT (2Nx1/2N, 2Nx3/2N), horizontal-down AT (2Nx3/2N, 2Nx1/2N), vertical-left AT ( It can have four types of division: 1/2Nx2N, 3/2Nx2N), and vertical-right AT (3/2Nx2N, 1/2Nx2N). Each BT, TT, AT can be further divided recursively using BT, TT, AT.

7A shows an example of QT division. Block A may be divided into four sub-blocks (A0, A1, A2, A3) by QT. Sub-block A1 may be divided into four sub-blocks (B0, B1, B2, B3) by QT again.

7B shows an example of BT segmentation. Block B3 that is no longer divided by QT may be divided by vertical BT (C0, C1) or horizontal BT (D0, D1). Like block C0, each sub-block may be further divided recursively in the form of horizontal BT (E0, E1) or vertical BT (F0, F1).

7C shows an example of TT partitioning. Block B3 which is no longer divided by QT may be divided into vertical TT (C0, C1, C2) or horizontal TT (D0, D1, D2). Like block C1, each sub-block may be further divided recursively in the form of horizontal TT (E0, E1, E2) or vertical TT (F0, F1, F2).

7D shows an example of AT partitioning. Block B3, which is no longer divided by QT, can be divided into vertical ATs (C0, C1) or horizontal ATs (D0, D1). Like block C1, each sub-block can be further divided recursively in the form of a horizontal AT (E0, E1) or a vertical TT (F0, F1).

Meanwhile, BT, TT, and AT division can be applied together in one block. For example, a sub-block divided by BT may be divided by TT or AT. In addition, sub-blocks divided by TT may be divided by BT or AT. Sub-blocks divided by AT may be divided by BT or TT. For example, after horizontal BT division, each sub-block may be divided by vertical BT. In addition, after vertical BT division, each sub-block may be divided by horizontal BT. In this case, the order of division is different, but the shape of the final division is the same.

In addition, when the block is divided, the order of searching for the block may be variously defined. In general, search is performed from left to right and from top to bottom, and searching for a block means the order of determining whether to divide additional blocks of each divided sub-block, or if the block is no longer divided, each sub It may mean an encoding order of a block, or a search order when a subblock refers to information of another neighboring block.

In addition, virtual pipeline data units (VPDUs) may be defined for intra-picture pipeline processing. VPDUs may be defined as non-overlapping units within one picture. In a hardware decoder, successive VPDUs can be processed simultaneously by multiple pipeline stages. The VPDU size is roughly proportional to the buffer size in most pipeline stages. Therefore, keeping the VDPU size small is important when considering the buffer size from a hardware perspective. In most hardware decoders, the VPDU size can be set equal to the maximum TB size. For example, the VPDU size may be 64x64 (64x64 luminance samples) size. However, this is an example, and the VPDU size may be changed (increased or decreased) in consideration of the TT and/or BT partition described above. In this document, an MxN block may represent a block including samples consisting of M columns and N rows.

8 shows an example of a case in which the ternary tree (TT) and the binary tree (BT) are divided according to an embodiment of the present specification. In order to maintain the VPDU size at 64x64 luminance samples size, at least one of the following restrictions may be applied as illustrated in FIG. 8.

-TT split is not allowed for a CU with either width or height, or both width and height equal to the width or height, or for a CU with both width and height equal to 128. 128).

-For a 128xN CU with N <= 64 (ie width equal to 128 and height smaller than) 128xN (N <= 64) (i.e., width 128 and height less than 128) CU 128), horizontal BT is not allowed).

-For an Nx128 CU with N <= 64 (ie height equal to 128 and width smaller than) Nx128 (N <= 64) (i.e., the height is 128 and the width is less than 128) 128), vertical BT is not allowed).

9 is a block diagram for entropy encoding according to an embodiment of the present specification. The block diagram of FIG. 9 corresponds to an example of the entropy encoding unit 190 of FIG. 2.

As described in FIG. 2, some or all of the video/video information may be entropy-encoded by the entropy encoding unit 190, and as described in FIG. 3, some or all of the video/video information is an entropy decoding unit ( 210) can be entropy decoded. In this case, the video/video information may be encoded/decoded in units of syntax elements. In this document, that information is encoded/decoded may include encoding/decoding by the method described in this paragraph.

9 shows a block diagram of CABAC for encoding one syntax element. The encoding process of CABAC first converts the input signal into a binary value through binarization when the input signal is a syntax element rather than a binary value. If the input signal is already binary, it is bypassed without going through binarization. Here, each

binary number

0 or 1 constituting the binary value is called a bin. For example, if the binary string (empty string) after binarization is 110, each of 1, 1, and 0 is referred to as one bin. The bin(s) for one syntax element may represent a value of a corresponding syntax element.

The binarized bins are input into a regular coding engine or a bypass coding engine. The regular coding engine allocates a context model that reflects a probability value to the corresponding bin, and encodes the corresponding bin based on the allocated context model. The regular coding engine may update the probability model for the corresponding bin after performing coding for each bin. Bins coded in this way are called context-coded bins. The bypass coding engine omits the procedure of estimating the probability for the input bin and the procedure of updating the probability model applied to the corresponding bin after coding. Instead of allocating context, a uniform probability distribution (eg, 50:50) is applied to code the input bins to improve coding speed. Bins coded in this way are called bypass bins. The context model may be allocated and updated for each bin to be context-coded (regularly coded), and the context model may be indicated based on ctxidx or ctxInc. ctxidx can be derived based on ctxInc. Specifically, for example, a context index (ctxidx) indicating a context model for each of the regularly coded bins may be derived as a sum of a context index increment (ctxInc) and a context index offset (ctxIdxOffset). Here, ctxInc may be derived differently for each bin. ctxIdxOffset may be represented by the lowest value of ctxIdx. The minimum value of ctxIdx may be referred to as an initial value (initValue) of ctxIdx. ctxIdxOffset is a value generally used to distinguish context models for other syntax elements, and a context model for one syntax element may be classified/derived based on ctxinc.

In the entropy encoding procedure, it is determined whether encoding is performed through a regular coding engine or a bypass coding engine, and a coding path may be switched. Entropy decoding performs the same process as entropy encoding in reverse order.

Referring to FIG. 10B, the encoding apparatus 100 (entropy encoding unit 190) performs an entropy coding procedure for image/video information. The image/video information may include partitioning related information, prediction related information (eg, inter/intra prediction classification information, intra prediction mode information, inter prediction mode information), residual information, and in-loop filtering related information, or It can contain various syntax elements for. Entropy coding may be performed in units of syntax elements. Steps S1010 to S1020 of FIG. 10A may be performed by the entropy encoding unit 190 of the encoding apparatus 100 of FIG. 2 described above.

The encoding device 100 performs binarization on the target syntax element (S1010). Here, binarization may be based on various binarization methods such as a Truncated Rice binarization process and a fixed-length binarization process, and a binarization method for the target syntax element may be predefined. The binarization procedure may be performed by the binarization unit 192 in the entropy encoding unit 190.

The encoding device 100 performs entropy encoding on the target syntax element (S1020). The encoding apparatus 100 may encode an empty string of a target syntax element based on an entropy coding technique such as CABAC or CAVLC based on normal coding (context based) or bypass coding, and the output may be included in a bitstream. . The entropy encoding procedure may be performed by the entropy encoding processing unit 193 in the entropy encoding unit 190. As described above, the bitstream can be delivered to a decoding device through a (digital) storage medium or a network.

Referring to FIG. 11B, the decoding apparatus 200 (entropy decoding unit 210) may decode encoded image/video information. The image/video information may include partitioning related information, prediction related information (eg, inter/intra prediction classification information, intra prediction mode information, inter prediction mode information), residual information, and in-loop filtering related information, or It can contain various syntax elements related to it. Entropy coding may be performed in units of syntax elements. Steps S1110 to S1120 may be performed by the entropy decoding unit 210 of the decoding apparatus 200 of FIG. 3 described above.

The decoding apparatus 200 performs binarization on the target syntax element (S1110). Binarization can be based on various binarization methods such as the Truncated Rice binarization process and the Fixed-length binarization process, and the binarization method for the target syntax element can be predefined. The decoding apparatus may derive available bin strings (empty string candidates) for available values of a target syntax element through a binarization procedure. The binarization procedure may be performed by the binarization unit 212 in the entropy decoding unit 210.

The decoding apparatus 200 performs entropy decoding on the target syntax element (S1220). The decoding apparatus 200 sequentially decodes and parses each bin for a relative syntax element from the input bit(s) in the bitstream, and compares the derived bin string with the available bin strings for the corresponding syntax element. If the derived empty string is the same as one of the available empty strings, a value corresponding to the corresponding empty string is derived as a value of the corresponding syntax element. If not, the next bit in the bitstream is further parsed and the above-described procedure is performed again. Through this process, the information can be signaled using variable length bits without using a start bit or an end bit for specific information (specific syntax element) in the bitstream. Through this, relatively fewer bits can be allocated to a low value, and overall coding efficiency can be improved.

The decoding apparatus 200 may decode each bin in the bin string from the bitstream based on an entropy coding technique such as CABAC or CAVLC based on context or bypass. As described above, the bitstream may include various information for video/video decoding. As described above, the bitstream can be delivered to a decoding device through a (digital) storage medium or a network.

Video/video coding procedure

In video/video coding, pictures constituting the video/video may be encoded/decoded according to a series of decoding orders. A picture order corresponding to an output order of a decoded picture may be set differently from a decoding order, and based on this, not only forward prediction but also backward prediction may be performed during inter prediction.

12 is an example of a flowchart for encoding a picture constituting a video signal according to an embodiment of the present specification. In FIG. 12, step S1210 may be performed by the

prediction units

180 and 185 of the encoding apparatus 100 described in FIG. 2, and step S1220 may be performed by the

residual processing units

115, 120, and 130. , S1230 may be performed by the entropy encoding unit 190. Step S1210 may include an inter/intra prediction procedure described in this document, step S1220 may include a residual processing procedure described in this document, and step S1230 includes an information encoding procedure described in this document. can do.

Referring to FIG. 12, the picture encoding procedure is not only a procedure of encoding information for picture restoration (eg, prediction information, residual information, partitioning information) schematically as described in FIG. 2 to output in a bitstream form, A procedure for generating a reconstructed picture for the current picture and a procedure for applying in-loop filtering to the reconstructed picture (optional) may be included. The encoding apparatus 100 may derive (modified) residual samples from the quantized transform coefficients through the inverse quantization unit 140 and the inverse transform unit 150, and predictive samples corresponding to the output of step S1210 and ( A reconstructed picture may be generated based on the modified) residual samples. The reconstructed picture generated in this way may be the same as the reconstructed picture generated by the decoding apparatus 200 described above. A modified reconstructed picture can be generated through an in-loop filtering procedure for the reconstructed picture, which can be stored in the memory 170 (DPB 175), and, as in the case of the decoding device 200, a subsequent picture It can be used as a reference picture in an inter prediction procedure upon encoding of. As described above, in some cases, some or all of the in-loop filtering procedure may be omitted. When the in-loop filtering procedure is performed, (in-loop) filtering-related information (parameters) may be encoded by the entropy encoding unit 190 and output in the form of a bitstream, and the decoding apparatus 200 The in-loop filtering procedure may be performed in the same manner as the encoding apparatus 100.

Through this in-loop filtering procedure, noise generated during video/video coding such as blocking artifacts and ringing artifacts can be reduced, and subjective/objective visual quality can be improved. In addition, since both the encoding device 100 and the decoding device 200 perform an in-loop filtering procedure, the encoding device 100 and the decoding device 200 can derive the same prediction result, so that the reliability of picture coding is This can be improved and the amount of data transmitted for picture coding can be reduced.

13 is an example of a flowchart for decoding a picture constituting a video signal according to an embodiment of the present specification. Step S1310 may be performed by the entropy decoding unit 210 of the decoding apparatus 200 of FIG. 3, step S1320 may be performed by the

prediction units

260 and 265, and step S1330 may be performed by the residual processing unit ( 220, 230), step S1340 may be performed by the addition unit 235, step S1350 may be performed by the filtering unit 240. Step S1310 may include the information decoding procedure described in this document, step S1320 may include the inter/intra prediction procedure described in this document, and step S1330 includes the residual processing procedure described in this document. In addition, step S1340 may include the block/picture restoration procedure described in this document, and step S1350 may include the in-loop filtering procedure described in this document.

Referring to FIG. 13, the picture decoding procedure is a procedure for obtaining image/video information (through decoding) from a bitstream (S1310), a picture restoration procedure (S1320 to S1340), and a reconstructed picture, as described in FIG. It may include an in-loop filtering procedure (S1350) for. The picture restoration procedure is based on prediction samples and residual samples obtained through the process of inter/intra prediction (S1320) and residual processing (S1330, inverse quantization and inverse transformation of a quantized code or coefficient) described in this document. Can be done. A modified reconstructed picture may be generated through an in-loop filtering procedure for a reconstructed picture generated through a picture restoration procedure, and the modified reconstructed picture may be output as a decoded picture, and the decoding apparatus 200 It is stored in the DPB 255 of and can be used as a reference picture in inter prediction train when decoding a picture later. In some cases, the in-loop filtering procedure may be omitted, and in this case, the reconstructed picture may be output as a decoded picture, stored in the DPB 255 of the decoding device 200, and referenced in the inter prediction train when decoding a subsequent picture. Can be used as a picture. The in-loop filtering procedure S1350 may include a deblocking filtering procedure, a sample adaptive offset (SAO) procedure, an adaptive loop filter (ALF) procedure, and/or a bi-lateral filter procedure as described above. And some or all of them may be omitted. In addition, one or some of the deblocking filtering procedure, the SAO procedure, the ALF procedure, and the bilateral filter procedure may be sequentially applied, or all may be sequentially applied. For example, after the deblocking filtering procedure is applied to the reconstructed picture, the SAO procedure may be performed. Also, for example, after the deblocking filtering procedure is applied to the reconstructed picture, the ALF procedure may be performed. This may be similarly performed in the encoding device 100.

As described above, not only the decoding device 200 but also the encoding device 100 may perform a picture restoration procedure. A reconstructed block may be generated based on intra prediction/inter prediction for each block, and a reconstructed picture including the reconstructed blocks may be generated. When the current picture/slice/tile group is an I picture/slice/tile group, blocks included in the current picture/slice/tile group may be reconstructed based only on intra prediction. In this case, inter prediction may be applied to some blocks in the current picture/slice/tile group, and intra prediction may be applied to the remaining some blocks. The color component of a picture may include a luminance component and a chrominance component, and the methods and embodiments proposed in this document may be applied to the luminance component and the chrominance component unless explicitly limited in this document.

Example of coding hierarchy and structure

The coded image is a video coding layer (VCL) that deals with the decoding process of the image and itself, a subsystem that transmits and stores encoded information, and a network abstraction (NAL) that exists between the VCL and the subsystem and is responsible for network adaptation. layer).

VCL data including video data (tile group data) compressed in the VCL is generated, or a parameter set including information such as PPS (picture parameter set), SPS (sequence parameter set), VPS (video parameter set), or An additionally required SEI (supplemental enhancement information) message may be generated in the process of decoding an image.

In NAL, header information (NAL unit data) may be added to a raw byte sequence payload (RBSP) generated in VCL to generate a NAL unit. In this case, the RBSP may refer to tile group data, parameter set, and SEI message generated in the VCL. In the NAL unit header, NAL unit type information specified according to RBSP data included in the corresponding NAL unit may be included.

As shown in FIG. 9, the NAL unit may be divided into a VCL NAL unit and a Non-VCL NAL unit according to an RBSP generated from VCL. The VCL NAL unit may mean a NAL unit that includes information about an image (tile group data), and the Non-VCL NAL unit is an NAL that includes information (parameter set or SEI message) necessary for decoding an image. It can mean a unit.

The above-described VCL NAL unit and Non-VCL NAL unit may be transmitted through a network with header information added according to the data standard of the sub-system. For example, the NAL unit may be converted into a data format of a predetermined standard such as an H.266/VVC file format, a real-time transport protocol (RTP), and a transport stream (TS) and then transmitted through various networks.

As described above, the NAL unit type may be specified according to the RBSP data structure included in the corresponding NAL unit, and information on the NAL unit type may be stored in the NAL unit header and signaled.

For example, the NAL unit may be largely classified into a VCL NAL unit type and a Non-VCL NAL unit type according to whether or not information on an image (tile group data) is included. The VCL NAL unit type may be classified according to the nature and type of a picture included in the VCL NAL unit, and the non-VCL NAL unit type may be classified according to the type of the parameter set.

The following is an example of the NAl unit type specified according to the type of the parameter set included in the Non-VCL NAL unit type.

-APS (Adaptation Parameter Set) NAL unit: A type for a NAL unit including APS

-Video Parameter Set (VPS) NAL unit: A type for a NAL unit including a VPS

-SPS (Sequence Parameter Set) NAL unit: a type for a NAL unit including SPS

-PPS (Picture Parameter Set) NAL unit: A type for a NAL unit including PPS

The above-described NAL unit types have syntax information for the NAL unit type, and the syntax information may be stored in the NAL unit header and signaled. For example, syntax information may be nal_unit_type, and NAL unit types may be specified by nal_unit_type values.

The tile group header (tile group header syntax) may include information/parameters commonly applicable to the tile group. APS (APS syntax) or PPS (PPS syntax) may include information/parameters that can be commonly applied to one or more pictures. SPS (SPS syntax) may include information/parameters that can be commonly applied to one or more sequences. VPS (VPS syntax) may include information/parameters that can be commonly applied to the entire video. In this specification, the higher-level syntax may include at least one of APS syntax, PPS syntax, SPS syntax, and VPS syntax.

In this specification, the image/video information encoded by the encoding device 100 by the decoding device 200 and signaled in the form of a bitstream includes intra-picture partitioning-related information, intra/inter prediction information, residual information, and in-loop filtering information. In addition, information included in the APS, information included in the PPS, information included in the SPS, and/or the information included in the VPS may be included.

Inter prediction

Hereinafter, an inter prediction technique according to an embodiment of the present specification will be described. The inter prediction described below may be performed by the inter prediction unit 180 of the encoding apparatus 100 of FIG. 2 or the inter prediction unit 260 of the decoding apparatus 200 of FIG. 3. In addition, data encoded according to an embodiment of the present specification may be stored in the form of a bitstream.

The prediction unit of the encoding device 100/decoding device 200 may derive a prediction sample by performing inter prediction in block units. Inter prediction may represent prediction derived in a method dependent on data elements (eg, sample values, motion information, etc.) of a picture(s) other than the current picture (Inter prediction can be a prediction derived in a manner). that is de-pendent on data elements (eg, sample values or motion information) of picture(s) other than the current picture). When inter prediction is applied to the current block, a predicted block (prediction sample array) for the current block is derived based on a reference block (reference sample array) specified by a motion vector on a reference picture indicated by a reference picture index. I can. In this case, in order to reduce the amount of motion information transmitted in the inter prediction mode, motion information of the current block may be predicted in units of blocks, subblocks, or samples based on correlation between motion information between neighboring blocks and current blocks. The motion information may include a motion vector and a reference picture index. The motion information may further include inter prediction type (L0 prediction, L1 prediction, Bi prediction, etc.) information. When inter prediction is applied, the neighboring block may include a spatial neighboring block existing in the current picture and a temporal neighboring block existing in the reference picture. The reference picture including the reference block and the reference picture including the temporal neighboring block may be the same or different. The temporal neighboring block may be called a collocated reference block, a co-located CU (colCU), or the like, and a reference picture including a temporal neighboring block may be referred to as a collocated picture (colPic). . For example, a motion information candidate list may be constructed based on neighboring blocks of the current block, and a flag indicating which candidate is selected (used) to derive a motion vector and/or a reference picture index of the current block, or Index information may be signaled. Inter prediction may be performed based on various prediction modes. For example, in the case of a skip mode and a merge mode, motion information of a current block may be the same as motion information of a selected neighboring block. In the case of the skip mode, unlike the merge mode, a residual signal may not be transmitted. In the case of a motion vector prediction (MVP) mode, a motion vector of a selected neighboring block is used as a motion vector predictor, and a motion vector difference may be signaled. In this case, the motion vector of the current block may be derived using the sum of the motion vector predictor and the motion vector difference.

The encoding apparatus 100 performs inter prediction on the current block (S1510). The encoding apparatus 100 may derive inter prediction mode and motion information of the current block and generate prediction samples of the current block. Here, the procedure of determining the inter prediction mode, deriving motion information, and generating prediction samples may be performed simultaneously, or one procedure may be performed before the other procedure. For example, the inter prediction unit 180 of the encoding apparatus 100 may include a prediction mode determining unit 181, a motion information deriving unit 182, and a predicted sample deriving unit 183, and the prediction mode determining unit A prediction mode for the current block may be determined at 181, motion information of the current block may be derived by the motion information deriving unit 182, and prediction samples of the current block may be derived by the predicted sample deriving unit 183. For example, the inter prediction unit 180 of the encoding apparatus 100 searches for a block similar to the current block within a predetermined area (search area) of reference pictures through motion estimation, and searches for a block similar to the current block. It is possible to derive a reference block whose difference is less than a minimum or a certain standard. Based on this, a reference picture index indicating a reference picture in which the reference block is located may be derived, and a motion vector may be derived based on a position difference between the reference block and the current block. The encoding apparatus 100 may determine a mode applied to the current block among various prediction modes. The encoding apparatus 100 may compare rate-distortion (RD) costs for various prediction modes and determine an optimal prediction mode for the current block.

For example, when the skip mode or the merge mode is applied to the current block, the encoding apparatus 100 configures a merge candidate list to be described later, and the current block and the middle of the reference blocks indicated by merge candidates included in the merge candidate list. It is possible to derive a reference block whose difference from the current block is less than a minimum or a certain standard. In this case, a merge candidate associated with the derived reference block is selected, and merge index information indicating the selected merge candidate may be generated and signaled to the decoding apparatus 200. Motion information of the current block may be derived using motion information of the selected merge candidate.

As another example, when the (A)MVP mode is applied to the current block, the encoding apparatus 100 configures a (A)MVP candidate list to be described later, and (A)motion vector predictor (MVP) candidates included in the MVP candidate list The motion vector of the selected MVP candidate may be used as the MVP of the current block. In this case, for example, a motion vector indicating a reference block derived by motion estimation described above may be used as a motion vector of the current block, and among MVP candidates, a motion vector having the smallest difference from the motion vector of the current block is selected. The MVP candidate to have becomes the selected MVP candidate. A motion vector difference (MVD), which is a difference obtained by subtracting MVP from the motion vector of the current block, may be derived. In this case, information on the MVD may be signaled to the decoding apparatus 200. In addition, when the (A)MVP mode is applied, the value of the reference picture index may be separately signaled to the decoding apparatus 200 by configuring reference picture index information.

The encoding apparatus 100 may derive residual samples based on the prediction samples (S1520). The encoding apparatus 100 may derive residual samples by comparing the original samples of the current block with the prediction samples.

The encoding apparatus 100 encodes video information including prediction information and residual information (S1530). The encoding apparatus 100 may output the encoded image information in the form of a bitstream. The prediction information is information related to a prediction procedure and may include prediction mode information (eg, skip flag, merge flag, or mode index) and motion information. The motion information may include candidate selection information (eg, merge index, mvp flag, or mvp index) that is information for deriving a motion vector. Further, the motion information may include information on the MVD and/or reference picture index information described above. Further, the motion information may include information indicating whether L0 prediction, L1 prediction, or bi prediction is applied. The residual information is information about residual samples. The residual information may include information about quantized transform coefficients for residual samples. The prediction mode information and motion information may be collectively referred to as inter prediction information.

The output bitstream may be stored in a (digital) storage medium and transmitted to a decoding device, or may be transmitted to a decoding device through a network.

Meanwhile, as described above, the encoding apparatus may generate a reconstructed picture (including reconstructed samples and a reconstructed block) based on the reference samples and the residual samples. This is because the encoding device 100 derives the same prediction result as that performed by the decoding device 200, and coding efficiency can be improved through this. Accordingly, the encoding apparatus 100 may store a reconstructed picture (or reconstructed samples, and a reconstructed block) in a memory and use it as a reference picture for inter prediction. As described above, an in-loop filtering procedure or the like may be further applied to the reconstructed picture.

The decoding apparatus 200 may perform an operation corresponding to the operation performed by the encoding apparatus 100. The decoding apparatus 200 may perform prediction on the current block and derive prediction samples based on the received prediction information.

In more detail, the decoding apparatus 200 may determine a prediction mode for the current block based on the received prediction information (S1610). The decoding apparatus 200 may determine which inter prediction mode is applied to the current block based on prediction mode information in the prediction information.

For example, the decoding apparatus 200 may determine whether the merge mode is applied to the current block or the (A)MVP mode is determined based on the merge flag. Alternatively, the decoding apparatus 200 may select one of various inter prediction mode candidates based on a mode index. Inter prediction mode candidates may include a skip mode, a merge mode, and/or (A)MVP mode, or may include various inter prediction modes described below.

The decoding apparatus 200 derives motion information of the current block based on the determined inter prediction mode (S1620). For example, when the skip mode or the merge mode is applied to the current block, the decoding apparatus 200 may configure a merge candidate list to be described later, and select one merge candidate from among merge candidates included in the merge candidate list. . The selection of a merge candidate may be performed based on a merge index. Motion information of the current block may be derived from motion information of the selected merge candidate. Motion information of the selected merge candidate may be used as motion information of the current block.

As another example, when the (A)MVP mode is applied to the current block, the decoding apparatus 200 constructs a (A)MVP candidate list to be described later, and (A) a selected MVP candidate among MVP candidates included in the MVP candidate list. The motion vector of can be used as the MVP of the current block. The selection of MVP may be performed based on the above-described selection information (MVP flag or MVP index). In this case, the decoding apparatus 200 may derive the MVD of the current block based on the information on the MVD, and may derive a motion vector of the current block based on the MVP and the MVD of the current block. Also, the decoding apparatus 200 may derive the reference picture index of the current block based on the reference picture index information. The picture indicated by the reference picture index in the reference picture list for the current block may be derived as a reference picture referenced for inter prediction of the current block.

Meanwhile, as described later, motion information of the current block may be derived without configuring a candidate list. In this case, motion information of the current block may be derived according to a procedure disclosed in a prediction mode to be described later. In this case, the configuration of the candidate list as described above may be omitted.

The decoding apparatus 200 may generate prediction samples for the current block based on motion information of the current block (S1630). In this case, the decoding apparatus 200 may derive a reference picture based on the reference picture index of the current block, and may derive the prediction samples of the current block by using samples of the reference block indicated on the reference picture by the motion vector of the current block. . In this case, as will be described later, a prediction sample filtering procedure may be further performed on all or part of the prediction samples of the current block in some cases.

For example, the inter prediction unit 260 of the decoding apparatus 200 may include a prediction mode determination unit 261, a motion information derivation unit 262, and a prediction sample derivation unit 263, and a prediction mode determination unit A prediction mode for the current block is determined based on the prediction mode information received at (181), and motion information (motion vector) of the current block is determined based on the information on the motion information received from the motion information derivation unit 182. And/or a reference picture index), and the prediction sample derivation unit 183 may derive prediction samples of the current block.

The decoding apparatus 200 generates residual samples for the current block based on the received residual information (S1640). The decoding apparatus 200 may generate reconstructed samples for the current block based on the prediction samples and the residual samples, and generate a reconstructed picture based on the generated samples (S1650). Thereafter, as described above, an in-loop filtering procedure or the like may be further applied to the reconstructed picture.

As described above, the inter prediction procedure may include determining an inter prediction mode, deriving motion information according to the determined prediction mode, and performing prediction based on the derived motion information (generating a prediction sample).

As described above, the inter prediction procedure may include an inter prediction mode step (S1710), a motion information derivation step (S1720) according to the determined prediction mode, and a prediction performance (prediction sample generation) step (S1730) based on the derived motion information. have. The inter prediction procedure may be performed by the encoding device 100 and the decoding device 200 as described above.

Derive motion information

The encoding device 100 or the decoding device 200 may perform inter prediction using motion information of the current block. The encoding apparatus 100 may derive optimal motion information for the current block through a motion estimation procedure. For example, the encoding apparatus 100 may search for a similar reference block with high correlation using the original block in the original picture for the current block in units of fractional pixels within a predetermined search range within the reference picture, and through this Can be derived. The similarity of the block may be derived based on the difference between the phase-based sample values. For example, the similarity of blocks may be calculated based on a sum of absolute difference (SAD) between a current block (or a template of a current block) and a reference block (or a template of a reference block). In this case, motion information may be derived based on the reference block having the smallest SAD in the search area. The derived motion information may be signaled to the decoding apparatus according to various methods based on the inter prediction mode.

Merge mode and skip mode

When the merge mode is applied, motion information of a current prediction block is not directly transmitted, and motion information of a current prediction block is derived using motion information of a neighboring prediction block. Accordingly, the encoding apparatus 100 may indicate motion information of the current prediction block by transmitting flag information indicating that the merge mode has been used and a merge index indicating which prediction block is used.

In order to perform a merge mode, the encoding apparatus 100 must search for a merge candidate block used to induce motion information of a current prediction block. For example, up to five merge candidate blocks may be used, but the present specification is not limited thereto. In addition, the maximum number of merge candidate blocks may be transmitted in a slice header or a tile group header, and the present specification is not limited thereto. After finding the merge candidate blocks, the encoding apparatus 100 may generate a merge candidate list and select a merge candidate block having the lowest cost among them as the final merge candidate block.

The merge candidate list may use, for example, 5 merge candidate blocks. For example, four spatial merge candidates and one temporal merge candidate can be used.

Referring to FIG. 18, for prediction of a current block, a left neighboring block A1, a bottom-left neighboring block A0, a top-right neighboring block B0, and an upper neighboring block B1. ), and at least one of the top-left neighboring block B2 may be used. The merge candidate list for the current block may be configured based on the procedure shown in FIG. 19.

The coding apparatus (encoding apparatus 100 or decoding apparatus 200) inserts the spatial merge candidates derived by searching for spatial neighboring blocks of the current block into the merge candidate list (S1910). For example, the spatial neighboring blocks may include a block around a lower left corner of a current block, a block around a left, a block around an upper right corner, a block around an upper side, and blocks around an upper left corner. However, as an example, in addition to the spatial neighboring blocks described above, additional neighboring blocks such as a right peripheral block, a lower peripheral block, and a right lower peripheral block may be further used as the spatial neighboring blocks. The coding apparatus may detect available blocks by searching spatial neighboring blocks based on priority, and derive motion information of the detected blocks as spatial merge candidates. For example, the encoding device 100 or the decoding device 200 searches for five blocks shown in FIG. 18 in order of A1, B1, B0, A0, B2, and sequentially indexes the available candidates to obtain a merge candidate. It can be organized as a list.

The coding apparatus inserts a temporal merge candidate derived by searching for a temporal neighboring block of the current block into the merge candidate list (S1920). The temporal neighboring block may be located on a reference picture that is a picture different from the current picture in which the current block is located. A reference picture in which a temporal neighboring block is located may be referred to as a collocated picture or a col picture. The temporal neighboring block may be searched in the order of the lower right corner neighboring block and the lower right center block of the collocated block with respect to the current block on the collocated picture. Meanwhile, when motion data compression is applied, specific motion information may be stored as representative motion information for each predetermined storage unit in a collocated picture. In this case, it is not necessary to store motion information for all blocks in the predetermined storage unit, and motion data compression effect can be obtained through this. In this case, the predetermined storage unit may be predetermined, for example, in a 16x16 sample unit, an 8x8 sample unit, or the like, or size information for a predetermined storage unit may be signaled from the encoding device 100 to the decoding device 200 have. When motion data compression is applied, motion information of a temporal neighboring block may be replaced with representative motion information of a predetermined storage unit in which a temporal neighboring block is located. In other words, in this case, in terms of implementation, it is not a prediction block located at the coordinates of a temporal neighboring block, but an arithmetic right shift by a certain value based on the coordinates of the temporal neighboring block (top left sample position) and then the arithmetic left shifted position is covered. A temporal merge candidate may be derived based on motion information of the prediction block. For example, if the constant storage unit is a 2nx2n sample unit, if the coordinates of the temporal neighboring block are (xTnb, yTnb), the modified positions ((xTnb >> n) << n), (yTnb >> n) The motion information of the prediction block located at << n)) may be used for the temporal merge candidate. Specifically, for example, if the predetermined storage unit is a 16x16 sample unit, if the coordinates of the temporal neighboring block are (xTnb, yTnb), the modified positions ((xTnb >> 4) << 4), (yTnb >> 4) Motion information of the prediction block located at << 4)) may be used for a temporal merge candidate. Or, for example, if the constant storage unit is an 8x8 sample unit, if the coordinates of the temporal neighboring block are (xTnb, yTnb), the modified positions ((xTnb >> 3) << 3), (yTnb >> 3 ) << 3)) motion information of a prediction block may be used for a temporal merge candidate.

The coding apparatus may check whether the number of current merge candidates is smaller than the number of maximum merge candidates (S1930). The maximum number of merge candidates may be predefined or signaled from the encoding device 100 to the decoding device 200. For example, the encoding apparatus 100 may generate information on the number of maximum merge candidates, encode, and transmit the information to the decoding apparatus 200 in the form of a bitstream. When the maximum number of merge candidates is filled, the subsequent candidate addition process may not proceed.

As a result of checking, if the number of current merge candidates is smaller than the number of the maximum merge candidates, the coding apparatus inserts an additional merge candidate into the merge candidate list (S1940). Additional merge candidates include, for example, adaptive temporal motion vector prediction (ATMVP), combined bi-predictive merge candidate (when the slice type of the current slice is B type), and/or zero vector merge. Can include candidates.

MVP mode

The MVP mode may be referred to as AMVP (advanced MVP or adaptive MVP). When the MVP mode is applied, a motion vector predictor using a motion vector of the reconstructed spatial neighboring block (eg, neighboring block in FIG. 18) and/or a motion vector corresponding to the temporal neighboring block (or Col block) A (motion vector predictor, MVP) candidate list may be generated. That is, a motion vector of the reconstructed spatial neighboring block and/or a motion vector corresponding to the temporal neighboring block may be used as a motion vector predictor candidate. The information on prediction may include selection information (eg, an MVP flag or an MVP index) indicating an optimal motion vector predictor candidate selected from among motion vector predictor candidates included in the list. In this case, the prediction unit may select a motion vector predictor of the current block from among motion vector predictor candidates included in the motion vector candidate list using the selection information. The prediction unit of the encoding apparatus 100 may obtain a motion vector difference (MVD) between the motion vector of the current block and the motion vector predictor, encode the motion vector, and output it in the form of a bitstream. That is, MVD may be obtained by subtracting the motion vector predictor from the motion vector of the current block. In this case, the prediction unit of the decoding apparatus 200 may obtain a motion vector difference included in the prediction information, and derive the motion vector of the current block by adding the motion vector difference and the motion vector predictor. . The prediction unit of the decoding apparatus may obtain or derive a reference picture index indicating a reference picture from the prediction information. For example, the motion vector predictor candidate list may be configured as shown in FIG. 20.

Referring to FIG. 20, the coding apparatus searches for a spatial candidate block for motion vector prediction and inserts it into a prediction candidate list (S2010). For example, the coding apparatus may search for neighboring blocks according to a predetermined search order, and add information on neighboring blocks that satisfy a condition for a spatial candidate block to a prediction candidate list (MVP candidate list).

After constructing the spatial candidate block list, the coding apparatus compares the number of spatial candidate lists included in the prediction candidate list with a preset reference number (eg, 2) (S2020). When the number of spatial candidate lists included in the prediction candidate list is greater than or equal to the reference number (eg, 2), the coding apparatus may terminate the construction of the prediction candidate list.

However, when the number of spatial candidate lists included in the prediction candidate list is less than the reference number (eg, 2), the coding apparatus searches for a temporal candidate block and inserts it into the prediction candidate list (S2030), and the temporal candidate block is used. If not possible, a zero motion vector is added to the prediction candidate list (S2040).

A predicted block for the current block may be derived based on motion information derived according to the prediction mode. The predicted block may include predicted samples (prediction sample array) of the current block. When the motion vector of the current block indicates a fractional sample unit, an interpolation procedure may be performed, through which prediction samples of the current block may be derived based on reference samples of the fractional sample unit within a reference picture. . When affine inter prediction is applied to the current block, prediction samples may be generated based on a motion vector per sample/subblock. When bi-direction prediction is applied, the prediction samples derived based on the first direction prediction (eg, L0 prediction) and the prediction samples derived based on the second direction prediction (eg, L1 prediction) Final prediction samples can be derived through weighted summation (according to the phase). As described above, reconstructed samples and reconstructed pictures may be generated based on the derived prediction samples, and then a procedure such as in-loop filtering may be performed.

Meanwhile, when the MVP mode is applied, a reference picture index may be explicitly signaled. In this case, a reference picture index (refidxL0) for L0 prediction and a reference picture index (refidxL1) for L1 prediction may be signaled separately. For example, when the MVP mode is applied and pair prediction is applied, both information about refidxL0 and information about refidxL1 may be signaled.

When the MVP mode is applied, information on the MVD derived from the encoding device 100 may be signaled to the decoding device 200 as described above. The information on the MVD may include, for example, information indicating the absolute value of the MVD and the x and y components of the sign. In this case, whether the absolute MVD value is greater than 0 (abs_mvd_greater0_flag), whether it is greater than 1, and information indicating the remainder of the MVD (abs_mvd_greater1_flag) may be signaled in stages. For example, information indicating whether the absolute MVD value is greater than 1 (abs_mvd_greater1_flag) may be signaled only when the value of the flag information (abs_mvd_greater0_flag) indicating whether the absolute MVD value is greater than 0 is 1.

Symmetric MVD (SMVD)

21 shows an example of a case in which a symmetric motion vector difference (MVD) mode according to an embodiment of the present specification is applied.

Meanwhile, when bidirectional prediction is applied, symmetric MVD (SMVD) may be used in consideration of coding efficiency. In this case, signaling of some of the motion information may be omitted. For example, when SVMD is applied to the current block, information on refidxL0, information on refidxL1, and information on MVDL1 are not signaled from the encoding device 100 to the decoding device 200 and may be derived internally. . For example, when the MVP mode and bidirectional prediction are applied to the current block, flag information indicating whether to apply SMVD (eg, symmetric MVD flag information or sym_mvd_flag syntax element) may be signaled and the value of the flag information is 1 The decoding apparatus 200 may determine that SMVD is applied to the current block.

When the SMVD mode is applied (that is, when the value of symmetric MVD flag information is 1), information about mvp_l0_lfag, mvp_l1_flag, and MVDL0 may be explicitly signaled, and information about refidxL0 as described above , information on refidxL1, and signaling of information on MVDL1 may be omitted, and may be derived inside the decoder. For example, refidxL0 is derived as an index indicating the previous reference picture closest to the current picture in the order of the picture order count (POC) within the reference picture list 0 (which may be referred to as list 0, L0, or the first reference list). Can be. refidxL1 may be derived as an index indicating a subsequent reference picture closest to the current picture in the POC order in reference picture list 1 (which may be referred to as List 1, L1, or a second reference picture list). Also, for example, both refidxL0 and refidxL1 may be derived as 0, respectively. Also, for example, refidxL0 and refidxL1 may be derived as minimum indexes having the same POC difference in relation to the current picture. As a more specific example, [POC of the current picture]-[POC of the first reference picture indicated by refidxL0] is referred to as the first POC difference, and [POC of the second reference picture indicated by refidxL1] is referred to as the second POC difference. In this case, only when the first POC difference and the second POC difference are the same, the value of refidxL0 indicating the first reference picture is derived as the value of refidxL0 of the current block, and the value of refidxL1 indicating the second reference picture is the same as that of the current block. It can also be derived as the value of refidxL1. In addition, for example, when there are a plurality of sets in which the first POC difference and the second POC difference are the same, refidxL0 and refidxL1 of the set with the minimum difference may be derived as refidxL0 and refidxL1 of the current block.

MVDL1 can be derived as -MVDL0. For example, the final MV for the current block may be derived as in Equation 1 below.

In Equation 1, mvx ₀ and mvy ₀ represent the x and y components of the L0 direction motion vector for the current block, and mvx ₁ and mvy ₁ represent the x and y components of the motion vector for L0 direction prediction for the current block. And the x and y components of the motion vector for L1 direction prediction. mvp ₀ and mvp ₀ denote an MVP motion vector for L0 direction prediction (L0 base motion vector), and mvp ₁ and mvp ₁ denote an MVP motion vector for L1 direction prediction (L1 base motion vector). mvd ₀ and mvd ₀ represent the x and y components of MVD for L0 direction prediction. According to Equation 1, MVD for L1 direction prediction has the same value as L0 MVD, but has an opposite sign.

Affine mode

Existing video coding systems used one motion vector to represent the motion of a coding block (using a translation motion model). However, the method using one motion vector may express optimal motion in block units, but it is not actually optimal motion for each pixel, so if the optimal motion vector is determined in pixel units, coding efficiency can be improved. . To this end, the present embodiment describes an affine motion prediction method for encoding/decoding using an affine motion model. In the affine motion prediction method, a motion vector may be expressed in units of each pixel of a block using two, three, or four motion vectors.

The affine motion model may express four motions as shown in FIG. 22. The affine motion model that expresses three movements (translation, scale, and rotate) among the movements that can be expressed by the affine motion model is referred to as a similar (or simplified) affine motion model, and the present specification refers to a similar (or singular) motion model. The proposed methods are described based on the affine motion model. However, the embodiments of the present specification are not limited to a similar (or singular) affine motion model.

As shown in FIGS. 23A and 23B, in the affine motion prediction, a motion vector may be determined for each pixel position included in a block using two or more control point motion vectors (CPMVs).

For a 4-parameter affine motion model (FIG. 23A), a motion vector at the sample position (x, y) can be derived as in Equation 2 below.

For the 6-parameter affine motion model (FIG. 23B), the motion vector at the sample position (x, y) can be derived as in Equation 3 below.

Where {v _0x , v _0y } is the CPMV of the CP at the top-left corner of the coding block, and {v _1x , v _1y } is the CPMV of the CP at the top-right corner, {v _2x , v _2y } is the CPMV of the CP at the bottom-left corner. In addition, W corresponds to the width of the current block, H corresponds to the height of the current block, and {v _x , v _y } is a motion vector at the position {x, y}.

In the encoding/decoding process, a motion vector field (MVF), which is an affine, may be determined in a pixel unit or a predefined subblock unit. When the MVF is determined in units of pixels, a motion vector is obtained based on each pixel value, and when the MVP is determined in units of sub-blocks, the center of the sub-block (the lower right of the center, that is, the lower right of the center 4 samples) pixel A motion vector of a corresponding block may be obtained based on a value. In the following description, as shown in FIG. 22, it is assumed that the affine MVF is determined in units of 4*4 subblocks. However, this is only for convenience of explanation, and the size of the subblock may be variously changed.

That is, when affine prediction is available, motion models applicable to the current block may include the following three types. Translational motion model, 4-parameter affine motion model, and 6-parameter affine motion mode. Here, the translational motion model can represent a model in which an existing block-based motion vector is used, a 4-parameter affine motion model can represent a model in which two CPMVs are used, and a 6-parameter affine motion model can represent three It can indicate the model in which CPMV is used.

The affine motion prediction may include an affine MVP (or affine inter) mode and an affine merge. In affine motion prediction, motion vectors of a current block may be derived in units of samples or sub-blocks.

Affine merge

In the afine merge mode, the CPMV may be determined according to the afine motion model of the neighboring block coded by the afine motion prediction. Affine-coded neighboring blocks in the search order may be used for the affine merge mode. When one or more neighboring blocks are coded by affine motion prediction, the current block may be coded as AF_MERGE. That is, when the affine merge mode is applied, CPMVs of the current block may be derived using CPMVs of neighboring blocks. In this case, CPMVs of the neighboring block may be used as CPMVs of the current block, or CPMVs of the neighboring block may be used as CPMVs of the current block by being modified based on the size of the neighboring block and the size of the current block.

When the affine merge mode is applied, an affine merge candidate list may be constructed to derive CPMVs for the current block. The affine merge candidate list may include at least one of the following candidates, for example.

1) Inherited affine candidates

2) Constructed affine candidates

3) zero MV candidate

Here, the inherited affine candidates are candidates derived based on the CPMVs of the neighboring block when the neighboring block is coded in the affine mode, and constructed affine candidates are the corresponding CP neighboring blocks in each CPMV unit. It is a candidate derived by constructing CPMVs based on MV, and a zero MV candidate may represent a candidate composed of CPMVs having a value of 0.

Referring to FIG. 25, a coding device (encoding device or decoding device) inserts inherited affine candidates into a candidate list (S2510), and constructs constructed affine candidates into an affine candidate list. Then, a zero MV candidate may be inserted into the affine candidate list (S2530). In an embodiment, when the number of candidates included in the candidate list is smaller than the reference number (eg, two), the coding apparatus may insert the configured affine candidates or the zero MV candidate.

26 shows examples of blocks for deriving an inherited affine motion predictor according to an embodiment of the present specification, and FIG. 27 is a diagram for deriving an inherited affine motion predictor according to an embodiment of the present specification. An example of control point motion vectors is shown.

There may be up to two (one from the left neighboring CU and one of the upper neighboring CUs) of inherited affine candidates, which may be derived from the affine motion model of neighboring blocks. Candidate blocks are shown in FIG. 26. The scan order for the left predictor is A0-A1, and the scan order for the upper predictor is B0-B1-B2. Only the first inherited candidates from each side are selected. A pruning check may not be performed between the two inherited candidates. When the adjacent affine CU is identified, control point motion vectors of the adjacent affine CU may be used to derive a control point motion vector predictor (CPMVP) candidate from the affine merge list of the current CU. As shown in FIG. 27, if the left neighboring block A is coded in the afine mode, motion vectors of the CU including the block A are v ₂ , v ₃ of the upper left corner, the upper right corner, and the lower left corner. , And v ₄ are used. When block A is coded with a 4-parameter affine model, two CPMVs of the current CU are calculated according to v ₂ and v ₃ . When block A is coded with a 6-parameter model, the three CPMVs of the current CU are calculated according to v ₂ , v ₃ , and v ₄ .

The constructed affine merge means a candidate formed by combining neighboring translational motion information for each control point. As shown in FIG. 28, motion information for control points is derived from specified spatial and temporal neighbors. CPMV _k (k = 1, 2, 3, 4) represents the kth control point. For CPMV1 (CP0) of the upper left corner, blocks are checked in the order of B2-B3-A2 and the MV of the first available block is used. Blocks are checked in the order of B1-B0 with respect to CPMV2 (CP1) in the upper right corner, and blocks in the order of A1-A0 with CPMV3 (CP2) in the lower left corner. If available, TMVP is used for CPMV4 (CP3) in the lower right corner.

When MVs of the four control points are obtained, affine merge candidates are configured based on this motion information. The following combinations of control point MVs are used in order:

{CPMV1, CPMV2, CPMV3}, {CPMV1, CPMV2, CPMV4}, {CPMV1, CPMV3, CPMV4},

{CPMV2, CPMV3, CPMV4}, {CPMV1, CPMV2}, {CPMV1, CPMV3}

Combinations of three CPMVs constitute a 6-parameter affine merge candidate, and a combination of two CPMVs constitutes a 4-parameter affine merge candidate. In order to avoid the motion scaling process, if the reference indices of the control points are different, the combination of the related control point MVs is discarded.

Affine MVP

In the afine MVP mode, after two or more control point motion vector prediction (CPMVP) and CPMV for the current block are determined, a control point motion vector difference (CPMVD) corresponding to the difference value is obtained from the encoding device 100 from the decoding device ( 200).

When the affine MVP mode is applied, an affine MVP candidate list may be configured to derive CPMVs for the current block. For example, the affine MVP candidate list may include at least one of the following candidates. For example, the affine MVP candidate list may include a maximum of n (eg, 2) candidates.

1) Inherited affine mvp candidates that extrapolated from the CPMVs of the neighbor CUs (S2910)

2) Constructed affine mvp candidates CPMVPs that are derived using the translational MVs of the neighbor CUs) derived using translational MVs of adjacent CUs (S2920)

3) Additional candidates based on Translational MVs from neighboring CUs (S2930)

4) Zero MVs candidate (S2940)

Here, the inherited affine candidate is a candidate derived based on the CPMVs of the neighboring block when the neighboring block is coded in the affine mode, and the constructed affine candidate is each CPMV unit. As a candidate, it is a candidate derived by configuring CPMVs based on the MV of a block adjacent to the corresponding CP, and a zero MV candidate represents a candidate composed of CPMVs whose value is 0. When the maximum number of candidates for the affine MVP candidate list is two, in the above order, 2) or less candidates may be considered and added when the number of current candidates is less than two. In addition, additional candidates based on Translational MVs from neighboring CUs from neighboring CUs may be derived in the following order.

1) If the number of candidates is less than 2 and the constructed candidate CPMV0 is valid, CPMV0 is used as an affine MVP candidate. That is, the MVs of CP0, CP1, and CP2 are all set to be the same as CPMV0 of the constructed candidate.

2) If the number of candidates is less than 2 and the constructed candidate CPMV1 is valid, CPMV1 is used as an affine MVP candidate. That is, the MVs of CP0, CP1, and CP2 are all set to be the same as CPMV1 of the constructed candidate.

3) If the number of candidates is less than 2 and the constructed candidate CPMV2 is valid, CPMV2 is used as the affine MVP candidate. That is, the MVs of CP0, CP1, and CP2 are all set to be the same as CPMV2 of the constructed candidate.

4) If the number of candidates is less than 2, TMVP (temporal motion vector predictor or mvCol) is used as an affine MVP candidate.

The affine MVP candidate list may be derived by the procedure shown in FIG. 29.

The order of checking inherited MVP candidates is the same as that of the inherited affine merge candidates. The difference is that, for the MVP candidate, only affine CUs having the same reference picture as the current block are considered. When the inherited affine motion predictor is added to the candidate list, the pruning process is not applied.

The configured MVP candidate is derived from neighboring blocks shown in FIG. 28. The same confirmation order as the composition of the affine merge candidate is used. In addition, reference picture indexes of neighboring blocks are also checked. The first block that is inter-coded in the check order and has the same reference picture as the current CU is used.

SbTMVP (Subblock-based temporal motion vector prediction)

Subblock-based temporal motion vector prediction (SbTMVP) method may be used. Similar to temporal motion vector prediction (TMVP), SbTMVP may use a motion field in the co-located picture to improve the motion vector predictor and merge mode for CUs in the current picture. The same co-located picture used by TMVP is used for SbTMVP. SbTMVP differs from TMVP in the following two aspects.

1. TMVP predicts motion at the CU level, but SbTMVP predicts motion at the sub-CU level.

2. TMVP The temporal motion vector is obtained from the co-located block in each co-located picture (here, the co-located block is the current lower-right or center block with respect to the CU), whereas SbTMVP retrieves temporal motion information from the co-located picture. Apply motion shift before import, where the motion shift is obtained from a motion vector from one of the spatial neighboring blocks of the current CU.

The SbTMVP process is shown in Figs. 30A and 30B. SbTMVP predicts motion vectors of sub-CUs in the current CU in two steps. In the first step, the spatial neighbors in FIG. 30A are examined in the order of A1, B1, B0, and A0. When the first spatial neighboring block having a motion vector using the co-located picture as its reference picture is identified, this motion vector is selected to be motion shifted. (As soon as and the first spatial neighboring block that has a motion vector that uses the collocated picture as its reference picture is identified, this motion vector is selected to be the motion shift to be applied). If such motion is not confirmed from spatial surroundings, the motion shift is set to (0, 0).

In the second step, the motion shift identified in the first step is applied to obtain sub-CU level motion information (motion vectors and reference indices) from the co-located picture as shown in FIG. 30B (that is, the current Are added to the block's coordinates). The example in FIG. 30B assumes that a motion shift is set by the motion of block A1. Then, for each sub-CU, the motion information of the corresponding block (the smallest motion grid covering the center sample) in the co-located picture is used to derive the motion information for the sub-CU. After the motion information of the co-located sub-CU is confirmed, it is converted into reference indices and motion vectors of the current sub-CU in a manner similar to the TMVP process, where temporal motion scaling is the reference pictures of the temporal motion vectors. It is applied to be aligned with temporal motion vectors.

The combined subblock-based merge list including the SbTMVP candidate and the afine merge candidate may be used for signaling of the afine merge mode (which may be referred to as a subblock-based merge mode). The SbTMVP mode may be activated/deactivated by a sequence parameter set (SPS). When the SbTMVP mode is activated, the SbTMVP predictor is added as the first entry in the list of subblock-based merge candidates, and affine merge candidates are added later. The maximum allowed size of the affine merge candidate list may be 5.

The size of the sub-CU used in SbTMVP is fixed at 8x8, the same is applied to the affine merge mode, and the SbTMVP mode can only be applied to CUs with both width and height greater than or equal to 8.

The encoding logic of the additional SbTMVP merge candidate is the same as the other merge candidates, that is, for each CU in the P or B slice, an additional RD (rate-distortion) check is performed to determine whether to use the SbTMVP candidate.

AMVR (Adaptive Motion Vector Resolution)

Conventionally, when use_integer_mv_flag in a slice header is 0, a motion vector difference (MVD) (between the predicted motion vector and the motion vector of the CU) may be signaled in units of quarter-luma-samples. In this document, the CU-level AMVR scheme is introduced. The AMVR may cause the MVD of the CU to be coded in units of 1/4 luminance samples, integer luminance samples, or 4 luminance samples. If the current CU has at least one non-zero MVD component, a CU-level MVD resolution indicator is conditionally signaled. If all MVD components (i.e., horizontal and vertical MVDs for reference list L0 and reference list L1) are 0, then the 1/4 luminance sample MVD resolution is inferred.

For a CU with at least one non-zero MVD component, a first flag is signaled to determine whether 1/4 luminance sample MVD accuracy is applied for that CU. If the first flag is 0, no additional signaling is required and 1/4 luminance sample MVD accuracy is used for the current CU. Otherwise, a second flag is signaled to indicate whether integer luminance samples or 4 luminance samples MVD accuracy is used. In order for the reconstructed MV to assure the intended accuracy (1/4 luminance sample, integer luminance sample, or 4 luminance sample), the motion vector predictors for the CU have the same accuracy as the motion vector predictors previously added with the MVD. Can be rounded to have Motion vector predictors can be rounded to zero. (I.e., negative motion vector predictors are rounded to positive infinity and positive motion vector predictors are rounded to negative infinity). The encoder determines the motion vector resolution for the current CU using the RD check. In order to avoid always performing three CU-level RD checks for each MVD resolution, the RD check of 4 luminance samples MVD resolution can be called conditionally. The RD cost of 1/4 sample MVD accuracy is calculated first. Then, the RD cost of the integer luminance sample MVD accuracy is compared with the RD cost of the 1/4 luminance sample MVD accuracy in order to determine whether it is necessary to check the RD cost of the 4 luminance sample MVD accuracy. When the RD cost for 1/4 luminance sample MVD accuracy is less than the RD cost for integer luminance sample MVD accuracy, the RD cost of 4 sample MVD accuracy is omitted.

Motion Field Storage

In order to reduce the memory load, motion information of a reference picture previously decoded may be stored in units of a predetermined area. This may be referred to as temporal motion field storage, motion field compression, or motion data compression. In this case, the storage unit of motion information may be set differently depending on whether the affine mode is applied. In this case, the one with the highest accuracy among explicitly signaled motion vectors is a quarter-luma-sample. In some inter prediction modes, such as the afine mode, motion vectors are derived at 1/16th-luma-sample precision and motion compensated prediction is performed at 1/16th-sample accuracy. In terms of internal motion field storage, all motion vectors are stored with 1/16 luminance sample accuracy.

In this document, for storing the temporal motion field used by TMVP and ATMVP, motion field compression is performed with 8x8 granularity.

History-based merge candidate derivation

HMVP (history-based MVP) merge candidates may be added to the merge list after spatial MVP and TMVP. In this method, motion information of a previously coded block is stored in a table and used as an MVP for a current CU. A table composed of multiple HMVP candidates is maintained during the encoding/decoding process. When a new CTU row is used, the table is reset (emptied). When there is a CU coded by inter prediction other than a subblock, related motion information is added to the last entry of the table as a new HMVP candidate.

In one embodiment, the HMVP table size (S) is set to 6, which means that a maximum of 6 HVMP candidates can be added to the table. When inserting a new motion candidate into a table, a constrained first-in-first-out (FIFO) rule is used. Here, a redundancy check is first performed to check whether an HMVP candidate with the same HMVP candidate to be added exists in the table. If the same HMVP candidate exists, the same existing HMVP candidate is removed from the table and all HMVP candidates are moved in the previous order.

HMVP candidates can be used in the merge candidate list construction process. The most recent HMVP candidates are identified in the table, and are inserted into the merge candidate list in the order following the TMVP candidates. Redundancy check for HMVP candidates is applied to spatial or temporal merge candidates.

In order to reduce the number of times the redundancy check operations are performed, the following simplified methods may be used.

1) The number of HMVP candidates for creating a merge list is (N <= 4)? M: It is set to (8-N). Here, N denotes the number of candidates existing in the merge list, and M denotes the number of HMVP candidates available in the table.

2) When the total number of usable merge candidates reaches a value minus 1 from the maximum number of allowed merge candidates, the process of constructing a merge candidate list from HVMP is terminated.

Pair-wise average merge candidates derivation

Pair average candidates are generated by an average of predefined pairs of candidates existing in the merge candidate list. Here, the predefined pairs are defined as {(0, 1), (0, 2), (1, 2), (0, 3), (1, 3), (2, 3)}, 0, 1 Numbers such as, 2, and 3 are merge indexes in the merge candidate list. The average of motion vectors is calculated individually for each reference list. If both motion vectors are available in one list, the average value of the two motion vectors is used even if the two motion vectors are for different reference pictures. If only one motion vector is available, the available motion vector is used immediately. If there are no motion vectors available, the list is kept invalid.

When the merge list is not filled even after the pair average merge candidate is added, zero MVs are inserted until the maximum number of merge candidates is reached.

Generate prediction samples

A predicted block for the current block may be derived based on motion information derived according to the prediction mode. The predicted block may include prediction samples (prediction sample array) of the current block. When the motion vector of the current block indicates a fractional sample unit, an interpolation procedure may be performed. Prediction samples of the current block may be derived from reference samples in units of fractional samples in a reference picture through an interpolation procedure. When afine inter prediction is applied to the current block, prediction samples may be generated based on a motion vector in units of samples/subblocks. When bi prediction is applied, prediction samples derived based on L0 direction prediction (i.e., prediction using a reference picture in an L0 reference picture list and an L0 motion vector) and L1 prediction (i.e., an L1 reference picture list) Prediction samples derived through a weighted sum (according to a phase) or a weighted average of prediction samples derived based on prediction using an internal reference picture and an L1 motion vector) may be used as prediction samples of the current block. When pair prediction is applied, when the reference picture used for L0 prediction and the reference picture used for L1 prediction are located in different temporal directions with respect to the current picture (i.e., bi-directional prediction while being pair prediction If applicable) may be referred to as true pair prediction.

As described above, reconstructed samples and reconstructed pictures may be generated based on the derived prediction samples, and then procedures such as in-loop filtering may be performed.

BWA (Bi-prediction with weighted average)

As described above, according to the present specification, when pair prediction is applied to a current block, a prediction sample may be derived based on a weighted average. The pair prediction signal (ie, pair prediction samples) may be derived through a simple average or weighted average of the L0 prediction signal (L0 prediction samples) and the L1 prediction signal (L1 prediction samples). When the prediction sample derivation by a simple average is applied, the pair prediction samples may be derived as average values of the L0 prediction samples based on the L0 reference picture and the L0 motion vector, and the L1 prediction samples based on the L1 reference picture and the L1 motion vector. . According to an embodiment of the present specification, when pair prediction is applied, a pair prediction signal (pair prediction samples) may be derived through a weighted average of the L0 prediction signal and the L1 prediction signal as shown in Equation 4 below.

In Equation 4, P _bi-pred represents a pair prediction sample value, P ₀ represents an L0 prediction sample value, P ₁ represents an L0 prediction sample value, and w represents a weight value.

In weighted average pair prediction, five weight values (w) may be allowed, and the weight values (w) may be -2, 3, 4, 5, 10. For each CU to which pair prediction is applied, the weight w may be determined by one of two methods.

1) For a non-merge CU, the weight index is signaled after MVD.

2) For the merge CU, the weight index is inferred from neighboring blocks based on the merge candidate index.

The weighted sum pair prediction can only be applied to CUs with 256 or more luminance samples (CUs whose product of CU width and CU height is greater than or equal to 256). For low-delay pictures, all five weights can be used. For pictures that are not low-latency, only three weights (3, 4, 5) can be used.

a) In the encoder, a fast search algorithm is applied to find the weight index without significant increase in encoder complexity. These algorithms are summarized below. When combined with AMVR, if the current picture is a low delay picture, only unequal weights are conditionally checked for 1-pel and 4-pel motion vector accuracy.

b) When combined with afine, if the afine mode is currently selected as the optimal mode, affine ME (motion estimation) will be performed for weights that are not the same.

c) When two reference pictures are identical in pair prediction, only weights that are not identical are conditionally checked.

e) According to a POC distance between a current picture and its reference pictures, a coding quantization parameter (QP), and a temporal level, weights that are not identical are not searched when a specific condition is not satisfied.

CIIP (combined inter and intra prediction)

CIIP can be applied to the current CU. For example, when a CU is coded in merge mode, if the CU contains at least 64 luminance samples (the product of the CU width and the CU height is greater than or equal to 64), an additional flag indicates whether the CIIP mode is applied to the current CU. May be signaled to indicate. The CIIP mode may also be referred to as a multi-hypothesis mode or an inter/intra multiple hypothesis mode.

Intra prediction mode derivation

Up to four intra prediction modes including DC, PLANAR, HORIZONTAL, and VERTICAL modes can be used to predict the luminance component in the CIIP mode. If the CU shape is very wide (for example, if the width is more than twice the height), the HORIZONTAL mode is not allowed. If the CU shape is very narrow (ie, the height is more than twice the width), the VERTICAL mode is not allowed. For these cases, three intra prediction modes are allowed.

The CIIP mode uses three most probable modes (MPMs) for intra prediction. The CIIP MPM candidate list is formed as follows.

-Left and upper neighboring blocks are set to A and B, respectively

-The prediction modes of block A and block B are named intraModeA and intraModeB, respectively, and are derived as follows.

· Let X be A or B

If i) block X is unavailable, ii) block X is not predicted using CIIP mode, or iii) block B is located outside the current CTU, intraModeX is set to DC

Otherwise, i) if the intra prediction mode of block X is DC or PLANAR, intraModeX is DC or PLANAR, and ii) the intra prediction mode of block X is "vertical-like" directional mode (greater than 34). Mode), intraModeX is set to VERTICAL, or iii) intraModeX is set to HORIZONTAL if the intra-prediction mode of block X is a "horizontal-like" directional mode (mode less than or equal to 34).

-If intraModeA and intraModeB are the same,

· If intraModeA is PLANAR or DC, 3 MPMs are set in the order of {PLANAR, DC, VERTICAL}

Otherwise, 3 MPMs are set in the order of {intraModeA, PLANAR, DC}

-Otherwise (if intraModeA and intraModeB are not the same),

The first two MPMs are set in the order of {intraModeA, intraModeB}

The uniqueness (redundancy) of PLANAR, DC, VERTICAL is checked for the first two MPM candidates in that order, and if a unique (non-redundant) mode is found, it is added as the third MPM

If the CU shape is very wide or very narrow, the MPM flag is inferred as 1 without signaling. Otherwise, an MPM flag for indicating whether the CIIP intra prediction mode is one of the CIIP MPM candidate modes is signaled.

If the MPM flag is 1, an MPM index indicating which of the MPM candidate modes is used in CIIP intra prediction is additionally signaled. Otherwise, if the MPM flag is 0, the intra prediction mode in the MPM candidate list is set to a "missing" mode. For example, if the PLANAR mode is not in the MPM candidate list, PLANAR becomes the missing mode, and the intra prediction mode is set to PLANAR. Since 4 possible intra prediction modes are allowed in CIIP, the MPM candidate list contains only 3 intra prediction candidates. For color difference components, the DM mode is always applied without additional signaling. That is, the same prediction mode as the luminance component is used for the color difference components. The intra prediction mode of the CU coded with CIIP will be stored and used for intra mode coding of the next neighboring CUs.

Combining the inter and intra prediction signals

The inter prediction signal P _inter in the CIIP mode is derived using the same inter prediction process applied to the general merge mode, and the intra prediction signal P _intra is derived using the CIIP intra prediction according to the intra prediction process. Then, the intra and inter prediction signals are combined using a weighted average, where the weight value depends on the intra prediction mode and where the sample is located in the coding block as follows.

-If the intra prediction mode is DC or planar mode, or the block width or height is less than 4, the same weight is applied to the intra prediction and inter prediction signals.

Otherwise, the weights are determined based on the intra prediction mode (horizontal mode or vertical mode in this case) and the sample position in the block. The horizontal prediction mode will be described as an example (weights for the vertical mode are similar, but can be derived in an orthogonal direction). Set the width of the block to W and the height of the block to H. The coding block is initially divided into 4 co-regional parts, each dimension is (W/4)xH. Starting from the part closest to the intra prediction reference samples and ending the part farthest from the intra prediction samples, the weight wt for each of the four regions is set to 6, 5, 3, and 2. The final CIIP prediction signal may be derived as in Equation 5 below.

In Equation 5, P _CIIP is a CIIP prediction sample value, P _inter is an inter prediction sample value, P _intra is an intra prediction sample value, and wt is a weight.

IBC (Intra block copy)

A detailed description of the IBC that can be performed in the prediction unit of FIGS. 2 and 3 will be described. IBC may be used for coding a content image/movie, such as a game, such as, for example, screen content coding (SCC). IBC basically performs prediction in the current picture, but can be performed similarly to inter prediction in that it derives a reference block in the current picture. That is, the IBC may use at least one of the inter prediction techniques described in this document. For example, in the IBC, at least one of the above-described motion information (motion vector) derivation methods may be used. The IBC may refer to the current picture, and thus may be referred to as current picture referencing (CPR).

For IBC, the encoding apparatus 100 may derive an optimal block vector (or motion vector) for a current block (eg, CU) by performing block matching (BM). The derived block vector (or motion vector) may be signaled to the decoding apparatus 200 through a bitstream using a method similar to signaling of block information (motion vector) in the above-described inter prediction. The decoding apparatus 200 may derive a reference block for the current block in the current picture through the signaled block vector (motion vector), and through this, a prediction signal (predicted block or prediction samples) for the current block. Can be derived. Here, the block vector (or motion vector) may represent a displacement from a current block to a reference block located in an already reconstructed area in the current picture. Thus, the block vector (or motion vector) may be called a displacement vector. Hereinafter, in IBC, a motion vector may correspond to a block vector or a displacement vector. The motion vector of the current block may include a motion vector for a luma component (a luma motion vector) or a motion vector for a chroma component (a chroma motion vector). For example, the luma motion vector for the IBC coded CU may be in integer sample units (ie, integer precision). The chroma motion vector can also be clipped in units of integer samples. As described above, IBC may use at least one of inter prediction techniques. For example, when IBC is applied together with AMVR, 1-pel and 4-pel motion vector precision may be switched.

In order to reduce memory consumption and decoder complexity, only the reconstructed part of the predefined area including the current CU may be used. This limitation allows the IBC mode to be implemented using local on-chip memory for hardware implementations.

On the encoder side, hash-based motion estimation is performed for the IBC. The encoder performs an RD check on blocks whose width or height is not greater than 16 luminance samples. For the non-merge mode, block vector search is performed from hash-based search. If the hash search does not return a valid candidate, a block matching-based local search will be performed.

In hash-based search, hash key matching (32-bit CRC) between the current block and the reference block is extended to all allowed block sizes. The hash key calculation for all positions in the current picture is based on 4x4 subblocks. For a larger sized current block, if all hash keys in all 4x4 subblocks match with hash keys in all corresponding reference positions, the hash key is determined to match the hash key of the reference block. If the hash keys of multiple reference blocks are found to match the hash key of the current block, the block vector costs of each matched reference block are calculated and the one with the least cost is selected.

In the block matching search, the search range is set to N samples from the left and above of the current block in the current CTU. At the beginning of the CTU, if there is no temporal reference picture, the value of N is initialized to 128, and if there is at least one temporal reference picture, it is initialized to 64. The hash hit ratio is defined as the percentage of samples in the CTU that found a match using a hash-based search. While encoding the current CTU, if the hash hit rate is less than 5%, N is reduced by half.

At the CU level, the IBC mode is signaled using a flag and can be signaled as follows, such as the IBC AMVP mode or the IBC skip/merge mode.

31A and 31B illustrate examples of a video/video encoding method based on an intra block copy (IBC) mode and a prediction unit in the encoding apparatus 100 according to an embodiment of the present specification.

The encoding apparatus 100 performs IBC prediction (IBC-based prediction) for the current block (S3110). The encoding apparatus 100 may derive a prediction mode and a motion vector of a current block and generate prediction samples of the current block. The prediction mode may include at least one of the above-described inter prediction modes as prediction modes for IBC. Here, a procedure for determining a prediction mode, deriving a motion vector, and generating prediction samples may be performed simultaneously, or one procedure may be performed prior to another procedure. For example, the prediction unit of the encoding apparatus 100 may include a prediction mode determination unit, a motion vector derivation unit, and a prediction sample derivation unit. The prediction mode determination unit determines a prediction mode for the current block, and a motion vector derivation unit At, the motion vector of the current block may be derived, and prediction samples of the current block may be derived by a prediction sample derivation unit. For example, the prediction unit of the encoding apparatus 100 searches for a block similar to the current block in the reconstructed area of the current picture (or a certain area (search area) of the reconstructed area) through block matching (BM), and It is possible to derive a reference block whose difference from the block is less than a minimum or a certain standard. A motion vector can be derived based on the difference in displacement between the reference block and the current block. The encoding apparatus 100 may determine a mode applied to the current block among various prediction modes. The encoding apparatus 100 may compare RD costs based on various prediction modes and determine an optimal prediction mode for the current block.

For example, when the skip mode or the merge mode is applied to the current block, the encoding apparatus 100 configures the above-described merge candidate list, and the current block is matched with the current block among reference blocks indicated by merge candidates included in the merge candidate list. It is possible to derive a reference block whose difference is less than a minimum or a certain standard. In this case, a merge candidate associated with the derived reference block is selected, and merge index information indicating the selected merge candidate may be generated and signaled to the decoding apparatus 200. The motion vector of the current block may be derived using the motion vector of the selected merge candidate.

As another example, when the (A)MVP mode is applied to the current block, the encoding apparatus 100 configures the above-described (A)MVP candidate list, and (A)motion vector predictor (MVP) candidates included in the MVP candidate list The motion vector of the selected MVP candidate may be used as the MVP of the current block. In this case, for example, a motion vector indicating a reference block derived by motion estimation described above may be used as a motion vector of the current block, and among MVP candidates, a motion vector having the smallest difference from the motion vector of the current block is selected. The MVP candidate to have becomes the selected MVP candidate. A motion vector difference (MVD), which is a difference obtained by subtracting MVP from the motion vector of the current block, may be derived. In this case, information on the MVD may be signaled to the decoding apparatus 200.

The encoding apparatus 100 may derive residual samples based on the prediction samples (S3120). The encoding apparatus 100 may derive residual samples by comparing the original samples of the current block with the prediction samples.

The encoding apparatus 100 encodes image information including prediction information and residual information (S3130). The encoding apparatus 100 may output the encoded image information in the form of a bitstream. The prediction information is information related to a prediction procedure, and may include prediction mode information (eg, skip flag, merge flag, or mode index) and information about a motion vector. The information on the motion vector may include candidate selection information (eg, merge index, mvp flag, or mvp index) that is information for deriving the motion vector. In addition, the information on the motion vector may include information on the above-described MVD. In addition, the information on the motion vector may include information indicating whether L0 prediction, L1 prediction, or bi prediction is applied. The residual information is information about residual samples. The residual information may include information about quantized transform coefficients for residual samples.

The output bitstream may be stored in a (digital) storage medium and transmitted to the decoding device, or may be transmitted to the decoding device 200 through a network.

Meanwhile, as described above, the encoding apparatus 100 may generate a reconstructed picture (including reconstructed samples and a reconstructed block) based on reference samples and residual samples. This is because the encoding device derives the same prediction result as that performed by the decoding device 200, and coding efficiency can be improved through this. Accordingly, the encoding apparatus may store the reconstructed area (or reconstructed samples, reconstructed block) of the current picture in a memory and use it as a reference picture for IBC prediction.

The video/video decoding procedure based on the IBC and the prediction unit in the decoding apparatus 200 may schematically include, for example, the following.

32A and 32B illustrate an example of a video/video decoding method based on an IBC mode and a prediction unit in the decoding apparatus 200 according to an embodiment of the present specification.

The decoding apparatus 200 may perform an operation corresponding to the operation performed by the encoding apparatus 100. The decoding apparatus 200 may perform IBC prediction on the current block and derive prediction samples based on the received prediction information.

In more detail, the decoding apparatus 200 may determine a prediction mode for the current block based on the received prediction information (S3210). The decoding apparatus 200 may determine which prediction mode is applied to the current block based on prediction mode information in the prediction information.

For example, it may be determined whether the merge mode is applied to the current block or the (A)MVP mode is determined based on the merge flag. Alternatively, one of various prediction mode candidates may be selected based on a mode index. The prediction mode candidates may include a skip mode, a merge mode, and/or (A)MVP mode, or may include various prediction modes described above.

The decoding apparatus 200 derives a motion vector of the current block based on the determined prediction mode (S3220). For example, when the skip mode or the merge mode is applied to the current block, the decoding apparatus 200 may configure the above-described merge candidate list and select one merge candidate from among the merge candidates included in the merge candidate list. have. The selection of the merge candidate may be performed based on the above-described selection information (merge index). The motion vector of the current block may be derived using the motion vector of the selected merge candidate. The motion vector of the selected merge candidate may be used as the motion vector of the current block.

As another example, when the (A)MVP mode is applied to the current block, the decoding apparatus 200 configures the above-described (A)MVP candidate list, and (A) selects MVP candidates from among MVP candidates included in the MVP candidate list. The motion vector can be used as the MVP of the current block. The selection of the MVP candidate may be performed based on the above-described selection information (mvp flag or mvp index). In this case, the MVD of the current block may be derived based on the information on the MVD, and the motion vector of the current block may be derived based on the MVP and the MVD of the current block.

Meanwhile, as described above, motion information of the current block may be derived without configuring a candidate list. In this case, a motion vector of the current block may be derived according to a procedure disclosed in a corresponding prediction mode. In this case, the configuration of the candidate list as described above may be omitted.

The decoding apparatus 200 may generate prediction samples for the current block based on the motion vector of the current block (S3230). Prediction samples of the current block may be derived using samples of the reference block indicated by the motion vector of the current block on the current picture. In this case, a prediction sample filtering procedure may be further performed on all or part of the prediction samples of the current block.

For example, the prediction unit of the decoding apparatus 200 may include a prediction mode determination unit, a motion vector derivation unit, and a prediction sample derivation unit, and the prediction mode determination unit determines a prediction mode for the current block based on the received prediction mode information. After determining, the motion vector deriving unit may derive a motion vector of the current block based on information on the received motion vector, and the prediction sample deriving unit may derive the predicted samples of the current block.

The decoding apparatus 200 generates residual samples for the current block based on the received residual information (S3240). The decoding apparatus 200 may generate reconstructed samples for the current block based on the prediction samples and the residual samples, and generate a reconstructed picture based on the generated samples (S3250). Thereafter, as described above, an in-loop filtering procedure may be further applied to the reconstructed picture.

Motion vector difference (MVD) coding

As described above, some inter prediction techniques can be applied to IBC prediction. For example, MVD coding can be used for inter prediction and IBC prediction. Current video coding standards use motion vectors and their motion vector predictors to generate a motion vector difference (MVD). MVD can be defined as the difference between a motion vector and a motion vector predictor. Similar to the motion vector, MVD includes x and y components (first and second components) corresponding to the x and y directions. Once the MVD is determined, the MVD is encoded using entropy techniques. Video standards use MVD as one of the possible ways to achieve compression and search for redundancy in motion vectors. Embodiments for compressing video/video signals use MVD as one of tools for searching for hidden motion. At the decoder side, the MVD is decoded before the motion vectors of the coding unit are decoded. Encoding the MVD before encoding the actual motion vectors increases the darkening efficiency and helps to search for redundancy between motion vectors and their predictors. The input to the MVD coding stage at the decoder are coded MVD bins parsed for decoding. Inputs from the encoder to the MVD coding stage are an additional flag (“imv” flag) indicating actual MVD values and resolution for MVD encoding. It is used to determine whether MVD is expressed as 1-pel, 4-pel, or quarter-pel.

33 shows an example of a flowchart for obtaining motion vector difference (MVD) coding information according to an embodiment of the present specification. The operations of FIG. 33 may be performed by the entropy decoding unit 210 of the decoding apparatus 200.

First, flags (MVD _x GR0, MVD _y GR0) indicating whether MVD is greater than 0 for horizontal and vertical components are parsed (S3310). Thereafter, the parsed data for the horizontal component is checked to determine whether the x component of the MVD is greater than 0 (ie, whether MVD _x GR0 is true) (S3320). If MVD _x Gㄲ0 is true (ie, MVD _x GR0 is '1'), a flag (MVD _x GR1) indicating whether the horizontal component is greater than 1 is parsed (S3330). If MVD _x GR0 is not true (MVD _x GR0 is '0'), MVD _x GR1 data is not parsed. Thereafter, similar procedures are performed for the vertical component (S3340 and S3350). Thereafter, in order to obtain reconstructed MVDs, the MVD data parsed in the order of residual MVD coding (MVD _x _Rem_Level and MVD _y _Rem_Level) steps (S3360 and SS70) may be additionally processed.

34A and 34B illustrate examples of flowcharts for obtaining information on x and y components of MVD according to an embodiment of the present specification. FIG. 34A shows an operation of obtaining information for decoding the x component of MVD by the decoder in block MVD _x _Rem_Level (S3360) of FIG. 33, and FIG. 34B shows the y component of MVD in MVD _y _Rem_Level (S3370) of FIG. 33 Represents an operation of obtaining information for decoding.

In Figure 34a, the decoder verifies the check MVD _x GR0 and (S3410), if the MVD _x GR0 is true GR1 MVD _x (S3420). If the flag indicating whether the parsed data is greater than 0 (i.e., MVD _x GR0) is true, and the flag indicating whether the parsed data is greater than 1 (i.e., MVD _x GR1) is true, then the decoder uses MVD _x ( Abs-2) is parsed (S3430). In this case, the decoder decodes the bins corresponding to the parsed MVDx components using an Exponential Golomb (EG) code having order 1. The inputs to EG will be bins containing the absolute value minus 2 (i.e. Abs-2) and 1st order Golomb The sign information is parsed by decoding the bypass bin containing the sign information. If the decoded bypass bin has a value of 1, a negative sign is appended to the decoded MVD _x . However, if the decoded bypass bin has a value of 0, the decoded MVD is indicated to have a positive value. If MVD _x GR0 is true but MVD _x GR1 is not true, this indicates that the absolute value of MVDx is 1, and the decoder parses MVD _x Sign (S3440). The code information is parsed and updated. However, if MVD _x GR0 is false, the restored MVDx is 0.

Similar operations can be applied to obtain information on the y component of MVD. The decoder checks the check MVD _y GR0 and (S3450), if the MVD _y GR0 is true MVD _y GR1 (S3460). If the flag indicating whether the parsed data is greater than 0 (i.e., MVD _y GT0) is true and the flag indicating whether the parsed data is greater than 1 (i.e., MVD _y GT1) is true, then the decoder will MVD _y ( Abs-2) is parsed (S3470). If MVD _y GR0 is true but MVD _y GR1 is not true, this indicates that the absolute value of MVDy is 1, and the decoder parses MVD _y Sign (S3480).

Signed MVD values are encoded at the encoder side. Similar to the decoder, bins indicating whether or not the x and y components are greater than zero by checking the absolute values of the horizontal and vertical components, i.e., MVD _x GR0 and MVD _y GR0 are encoded. And flags indicating whether the horizontal and vertical components are greater than 1, that is, MVD _x Gr1 and MVD _y GR1 are encoded. Thereafter, the absolute MVD values are encoded as shown in FIGS. 35A and 35B.

Similar to the decoder, the horizontal and vertical components are encoded sequentially. For horizontal MVD encoding, the encoder checks whether the absolute value of the horizontal MVD component is greater than 0 (ie, MVD _x GR0) and whether the absolute value of the horizontal MVD component is greater than 1 (ie, MVD _x GR1) (S3510, S3520 ). If the horizontal MVD component absolute value is greater than 0 and greater than 1, (absolute value-2) is encoded using the EG code having the order 1 (S3530). The sign information is then encoded using the bypass bin. If MVD _x GR0 is true and MVD _x Gr1 is not true, only code information is encoded (S3540). The same process is performed for the encoding of MVDy.

For vertical MVD encoding, the encoder checks whether the absolute value of the vertical MVD component is greater than 0 (i.e., MVD _y GR0) and whether the absolute value of the horizontal MVD component is greater than 1 (i.e., MVD _y GR1) (S3550, S3560 ). If the vertical MVD component absolute value is greater than 0 and greater than 1, (absolute value-2) is encoded using an EG code having order 1 (S3570). The sign information is then encoded using the bypass bin. If MVD _y GR0 is true and MVD _y Gr1 is not true, only code information is encoded (S3580). Table 1 below is a syntax for MVD coding.

abs_mvd_greater0_flag [compIdx] indicates whether the compIdx component of the motion vector difference (MVD) is greater than 0.

abs_mvd_greater1_flag [compIdx] indicates whether the compIdx component of the motion vector difference (MVD) is greater than 1. If abs_mvd_greater1_flag[ compIdx] does not exist, its value is deduced as 0.

abs_mvd_minus2 [compIdx] plus 2 represents the absolute value of the compIdx component of the motion vector difference. When abs_mvd_minus2[ compIdx] does not exist, its value is deduced as -1.

mvd_sign_flag [compIdx] represents the code of the compIdx component of the motion vector as follows.

-If mvd_sign_flag[ compIdx] is 0, the compIdx component of the corresponding motion vector difference has a positive value.

-Otherwise (when mvd_sign_flag[ compIdx] is 1), the compIdx component of the corresponding motion vector difference has a negative value.

If mvd_sign_flag[ compIdx] does not exist, its value is inferred as 0.

The motion vector difference lMvd[ compIdx] for compIdx = 0..1 is derived as follows.

lMvd[ compIdx] = abs_mvd_greater0_flag[ compIdx] * (abs_mvd_minus2[ compIdx] + 2) * (1-2 * mvd_sign_flag[ compIdx]) Depending on the value of MotionModelIdc[ x ][ y ], motion vector differences are derived as follows. .

-If MotionModelIdc[x][y] is 0, the variable MvdLX[x0][y0][compIdx] whose X is 0 or 1 represents the difference between the list X vector component to be used and its prediction. Array indices x0 and y0 represent positions (x0, y0) of an upper left luminance sample of a considered coding block with respect to an upper left luminance sample of a picture. The horizontal motion vector component difference is assigned as compIdx = 0, and the vertical motion vector component is assigned as compIdx = 1.

-If refList is 0, MvdL0[x0][y0][compIdx] is set equal to lMvd[compIdx] for compIdx = 0..1.

-Otherwise (if refList is 1), MvdL1[ x0 ][ y0 ][ compIdx] is set equal to lMvd[ compIdx] for compIdx = 0..1.

-Otherwise (MotionModelIdc[ x ][ y] is not 0), the variable MvdCpLX[ x0 ][ y0 ][ cpIdx ][ compIdx] with X equals 0 or 1 is the difference between the list X vector component to be used and its prediction. Show. Array indices x0 and y0 represent positions (x0, y0) of an upper left luminance sample of a considered coding block with respect to an upper left luminance sample of a picture, and an array index cpIdx represents a control point index. The horizontal motion vector component difference is assigned compIdx = 0, and the vertical motion vector component difference is assigned compIdx = 0.

-If refList is 0, MvdCpL0[x0][y0][cpIdx][compIdx] is set equal to lMvd[compIdx] for compIdx = 0..1.

-Otherwise (if refList is 1), MvdCpL1[ x0 ][ y0 ][ cpIdx ][ compIdx] is set equal to lMvd[ compIdx] for compIdx = 0..1.

Table 2 below shows the binarization type and parameters of the syntax element for MVD coding, and Table 3 shows the bin index of the syntax element for MVD coding.

Statistical information on IBC's MVD

Analysis of MVD statistics for IBC cases shows that typical MVD and IBC MVD have different characteristics. In addition, it is confirmed that MVD _x and MVD _y have different characteristics for the IBC case. For example, compared to MVD _x , the values of MVD _y have a property that is relatively concentrated at zero.

Table 4 below is the statistics of MVD for IBC cases.

36A and 36B illustrate examples of statistics of bin values for x and y components of MVD in IBC according to an embodiment of the present specification. For the IBC case, the distribution of data between the x and y components is relatively less skewed and asymmetric, and the degree of binding to a specific value is less than that of general MVD. Due to this interpretation, the following embodiments are proposed.

Example 1

In embodiments for MVD coding cases, flags indicating whether the MVD is greater than 0 for the x component and the y component may be coded using different context modes. That is, abs_mvd_greater0_flag[ 0] and abs_mvd_greater0_flag[ 1] can use different context models, where the x/y component means MVD in the x/y direction. Similarly, flags indicating whether the MVD is greater than 1 for the x component and the y component may use different context models. That is, abs_mvd_greater1_flag[ 0] and abs_mvd_greater1_flag[ 1] can use different context models. Table 5 below shows the allocation of context-coded bins to syntax elements in the context increment (ctxInc).

Referring to Table 5, the bin index (binIdx) of the flag (abs_mvd_greater0_flag[ compIdx ]) indicating whether the MVD is greater than 0 is determined based on the index (compIdx) indicating the component, and the x component (compIdx = 0) The bin index (binIdx) for the y component may be set to 0, and the bin index (binIdx) for the y component (compIdx = 1) may be set to 1. In addition, the empty index (binIdx) of the flag (abs_mvd_greater0_flag[ compIdx ]) indicating whether the MVD is greater than 1 is determined based on the index indicating the component (compIdx), and the empty index for the x component (compIdx = 0) ( binIdx) may be set to 0, and the bin index (binIdx) for the y component (compIdx = 1) may be set to 1. That is, a flag indicating whether the x component of MVD is greater than 0 (abs_mvd_greater0_flag[ 0 ]) and a flag indicating whether the y component of MVD is greater than 0 (abs_mvd_greater0_flag[ 1 ]) are encoded based on different context models. /Can be decoded.

Example 2

In an embodiment for MVD coding cases, another coding method may be used in coding the absolute value of MVD _x . In a specific case based on the above-described statistical distribution, the absolute value coding of MVD _x can be used by other exponential Golomb parameters such as 2 or 3, which abs_mvd_minus2[ 0] is coded using other exponential Golomb parameters such as 2 or 3. Means it can be. Similarly, other coding methods can be used for the residual absolute value level of MVD y for the y component. In particular, an exponential Golomb parameter such as 2 or 3 may be used, which means that abs_mvd_minus2[ 1] can be coded with an exponential Golomb parameter such as 2 or 3. For example, Table 6 below shows an example in which the exponential Golomb parameter 2 is used for abs_mvd_minus2[ ]. In Table 6, MVD size information (abs_mvd_minus2[ ]) representing a value obtained by subtracting 2 from the absolute value of MVD may be encoded/decoded based on the exponential Golomb parameter EG2 of order 2.

Example 3

In this embodiment, Embodiment 1 and Embodiment 2 described above can be used simultaneously. In other words, this means that flags indicating whether MVD is greater than 0 for x and y components (abs_mvd_greater0_flag[ 0 ], abs_mvd_greater0_flag[ 1 ]) use different context models, and MVD for x and y components Flags indicating whether or not greater than 1 (abs_mvd_greater1_flag[ 0 ], abs_mvd_greater1_flag[ 1 ]) use different context models, and other exponential Golomb parameters such as 2 or 3 for coding of the residual absolute value level Can be used, which means that abs_mvd_minus2[] can be coded using an exponential Golomb parameter such as 2 or 3.

Example 4

37 illustrates an example in which MVD coding is separately applied when general MVD coding and IBC mode according to an embodiment of the present specification are applied. In this embodiment, a case in which separate MVD coding is performed for the IBC case and the normal MVD coding is described.

When the IBC mode is applied to the current block, a flag indicating whether the MVD _x component is greater than 0 and a flag indicating whether the MVD _x component is greater than 1 are not used, and the entire MVD _x is of

order

1, 2, or 3 It can be coded using exponential Golomb. Table 7 below shows an example in which the change is applied.

In Table 7, the strikethrough indicates a syntax element that is deleted by the application of this embodiment compared to a normal MVD coding syntax structure. abs_mvd [compIdx] represents an absolute value of a motion vector difference for component compIdx. Table 8 shows the binarization type and parameters of syntax elements for MVD coding in which abs_mvd[] is reflected.

Similarly, the MVD _y component and a flag indicating whether it is greater than 0 and 1 may not exist, and the entire MVD _y component may be coded using an exponential Golomb of

order

1, 2, or 3.

Example 5

In this embodiment, one of the components of the MVD is a flag indicating whether the corresponding MVD component is greater than 0, and without a flag indicating whether the corresponding MVD component is greater than 1, the total MVDx or MVDy is an exponent of

order

1, 2 or 3 Can be coded using. In addition, for other components of the MVD, a flag indicating whether the MVD component is greater than 0 and a flag indicating whether the corresponding MVD component is greater than 1 exist, and the remaining parts may be coded using different exponential Golomb parameters. Table 9 is an example for this case.

In one embodiment, there may be separate MVD coding for the IBC case. In addition, it may be used for a flag indicating whether the different context model is greater than 0 for the IBC case and the normal case, and a flag indicating whether the MVD component is greater than 1.

Example 6

In this embodiment, for coding MVD for the IBC case, an exponential Golomb value such as 2 or 3 may be used to code the residual value (absolute value information, sign information) of the MVD. In the IBC case, different context models may be used for the x component and the y component for a flag indicating whether the MVD component is greater than 0 and a flag indicating whether the MVD component is greater than 1 in the IBC case. Tables 10 and 11 below show examples of the case according to the present embodiment.

38 is an example of a flowchart of encoding a video signal for inter prediction according to an embodiment of the present specification. The operations of FIG. 38 may be performed by the inter prediction unit 180 of the encoding apparatus 100 or the processor 510 of the video signal processing apparatus 500. Steps S3810 and S3820 of FIG. 38 may correspond to an example of step S1710 of FIG. 17, and step S3830 of FIG. 38 may correspond to an example of step S1730 of FIG. 17.

The encoder determines a motion vector of the current block based on motion prediction, and determines the MVD of the current block based on the motion vector (S3810 and S3820). For example, the encoder determines a motion vector (or block vector) from a reference picture (or current picture) through motion estimation for the current block, and the difference between the determined motion vector and the motion vector of the MVP candidate derived from the MVP candidate list Can be determined as MVD.

The encoder encodes MVD coding information related to MVD (S3830). Here, the MVD coding information includes first flag information (eg, abs_mvd_greater0_flag[ ]) indicating whether MVD is greater than a first reference value (eg 0), and the first flag information (eg, abs_mvd_greater0_flag[ ]) is MVD The first component flag information (abs_mvd_greater0_flag[0]) indicating whether the first direction component (eg, x component) of is greater than the first reference value (eg 0) and the second direction component (eg, y component) of the MVD ) Includes second component flag information (abs_mvd_greater0_flag[1]) indicating whether or not is greater than a first reference value (eg, 0). The first component flag information (abs_mvd_greater0_flag[0]) and the second component flag information (abs_mvd_greater0_flag[1]) are encoded based on different context models.

In one embodiment, the MVD coding information includes second flag information (eg, abs_mvd_greater1_flag[ ]) indicating whether MVD is greater than a second reference value (eg, 1), MVD size information (eg, abs_mvd_minus2[ ]), and MVD code information (eg, mvd_sign_flag[ ]) may be further included. Here, the second flag (abs_mvd_greater1_flag[ ]) is obtained based on the first flag information (abs_mvd_greater0_flag[ ]), and the MVD size information (abs_mvd_minus2[ ]) is the first flag information (abs_mvd_greater0_flag[0]) and the second flag information ( It is encoded based on abs_mvd_greater1_flag[ ]), and MVD code information (mvd_sign_flag[ ]) may be encoded based on first flag information (abs_mvd_greater0_flag[ ]). For example, as shown in FIGS. 35A and 35B, the second flag (abs_mvd_greater1_flag[ ]) is encoded when the first flag information (abs_mvd_greater0_flag[ ]) is true (if 1), and MVD size information (abs_mvd_minus2[ ]) is encoded when both the first flag (abs_mvd_greater0_flag[0]) and the second flag information (abs_mvd_greater1_flag[ ]) are true (when 1), and the MVD sign information (mvd_sign_flag[ ]) is encoded as the first flag information (abs_mvd_greater0_flag[ ]) can be encoded if true (if 1).

In one embodiment, the second flag information (abs_mvd_greater1_flag[ ]) is a third component flag (abs_mvd_greater0_flag[0]) indicating whether the first direction component (x component) of the MVD is greater than a second reference value (eg, 1). ) And a fourth component flag (abs_mvd_greater0_flag[1]) indicating whether the second direction component (y component) of the MVD is greater than the second reference value (eg, 1).

In an embodiment, the first MVD size information abs_mvd_minus2[] may be encoded based on an exponential Golomb parameter having a degree of 2 or more.

In one embodiment, the step of encoding MVD coding information (S3830) is a step of determining whether the IBC mode is applied to the current block (for example, step S3710 of FIG. 37), and when the IBC mode is applied to the current block, It may include a step of encoding IBC MVD coding information (eg, mvd_coding_IBC( )) (eg, step S3730). Here, the encoding of the IBC MVD coding information includes encoding a first MVD size (eg, abs_mvd[ 0 ]) representing an absolute value of the first direction component (x component) of the MVD, and the second direction component of the MVD. Encoding a second component flag (abs_mvd_greater0_flag[ 1 ]) indicating whether the (y component) is greater than a first reference value (eg, 0), and MVD based on the second component flag (abs_mvd_greater0_flag[ 1 ]) Encoding a fourth component flag (abs_mvd_greater1_flag[ 1 ]) indicating whether a second direction component (y component) of is greater than a second reference value (eg, 1), and a second component flag (abs_mvd_greater0_flag[ 1 ]) ) And second MVD size information (abs_mvd_minus2[1]) representing the absolute value minus 2 of the second component of the MVD based on the fourth component flag (abs_mvd_greater1_flag[ 1 ]).

In an embodiment, the first MVD size information abs_mvd[ 0] may be encoded based on an exponential Golomb parameter having a degree of 2 or more.

39 is an example of a flowchart of decoding a video signal for inter prediction according to an embodiment of the present specification. The flowchart of FIG. 39 may correspond to an example of step S1810 of FIG. 18. In addition, step S3810 of FIG. 38 may correspond to step S1610 of FIG. 16A, and step S3820 of FIG. 38 may correspond to an example of step S1620 of FIG. 16A.

The decoder acquires MVD coding information (eg, mvd_coding( )) related to MVD for prediction of the current block (S3910). Here, the MVD coding information includes first flag information (eg, abs_mvd_greater0_flag[ ]) indicating whether the MVD is greater than a first reference value (eg 0), and the first flag information includes a first direction component ( Example: First component flag information indicating whether the x component is greater than the first reference value (eg, abs_mvd_greater0_flag[0]) and indicating whether the second direction component (y component) of the MVD is greater than the first reference value The second component flag information (eg, abs_mvd_greater0_flag[1]) is included. The first component flag information (abs_mvd_greater0_flag[0]) and the second component flag information (abs_mvd_greater0_flag[1]) are decoded based on different context models. For example, as shown in Table 6, first component flag information (abs_mvd_greater0_flag[0]) and second component flag information (abs_mvd_greater0_flag[1]) may be decoded based on different bin indexes (binIdx).

In one embodiment, the MVD coding information includes second flag information indicating whether the MVD is greater than the second reference value (eg, abs_mvd_greater1_flag[ ]), MVD size information (eg, abs_mvd_minus2[ ]), and MVD code information (eg. : mvd_sign_flag[ ]) may be further included. Here, the second flag information (abs_mvd_greater1_flag[ ]) is obtained based on the first flag information (abs_mvd_greater0_flag[ ]), and the MVD size information (abs_mvd_minus2[ ]) is the first flag information (abs_mvd_greater0_flag[ ]) and the second flag information ( It is obtained based on abs_mvd_greater1_flag[ ]), and the sign information (mvd_sign_flag[ ]) of the MVD may be obtained based on the first flag information (abs_mvd_greater0_flag[ ]). For example, as shown in Table 1, the second flag (abs_mvd_greater1_flag[ ]) is obtained when the first flag information (abs_mvd_greater0_flag[ ]) is true (if 1), and the MVD size information (abs_mvd_minus2[ ]) is zero. It is acquired when both the 1 flag (abs_mvd_greater0_flag[0]) and the second flag information (abs_mvd_greater1_flag[ ]) are true (when 1), and the MVD sign information (mvd_sign_flag[ ]) is the first flag information (abs_mvd_greater0_flag[ ]) is true. Case (if 1) can be obtained.

In an embodiment, the MVD size information abs_mvd_minus2[] may be decoded based on an exponential Golomb parameter having a degree of 2 or more. For example, as shown in Table 6, MVD size information abs_mvd_minus2[] may be decoded based on the exponential Golomb parameter EG2 of order 2.

In one embodiment, the step of obtaining MVD coding information (S3910) is a step of determining whether the IBC mode is applied to the current block (for example, step S3710 of FIG. 37), and when the IBC mode is applied to the current block, IBC It may include a step (eg, step S3730) of obtaining MVD coding information (eg, mvd_coding_IBC( )).

Here, the obtaining of the IBC MVD coding information includes obtaining first MVD size information (eg, abs_mvd[ 0 ]) indicating the absolute value of the first direction component (x component) of the MVD, and the second direction of the MVD. Obtaining a second component flag (abs_mvd_greater0_flag[ 1 ]) indicating whether the component is greater than a first reference value (eg, 0), and a second component of the MVD based on the second component flag (abs_mvd_greater0_flag[ 1 ]). Obtaining a fourth component flag (abs_mvd_greater1_flag[ 1 ]) indicating whether the direction component (y component) is greater than a second reference value (eg, 1), and a second component flag (abs_mvd_greater0_flag[ 1 ]) It may include the step of acquiring second MVD size information (abs_mvd_minus2[1]) indicating the absolute value of the second component of the MVD minus 2 based on the 4 component flag (abs_mvd_greater1_flag[ 1 ]).

In an embodiment, the first MVD size information abs_mvd[ 0] may be encoded based on an exponential Golomb parameter having a degree of 2 or more. For example, as shown in Tables 8 and 9, the first MVD size information (abs_mvd[ 0 ]) may be decoded based on the index Golomb parameter EG2 of order 2.

Thereafter, the decoder decodes the MVD coding information (S3920). The decoder may obtain the MVD through decoding of the decoded MVD information, and obtain a final motion vector through the sum of the motion vector derived from the MVP candidate.

Bitstream

The encoded information (eg, encoded video/video information) derived by the encoding apparatus 100 based on the above-described embodiments of the present specification may be output in a bitstream form. The encoded information may be transmitted or stored in a bitstream form in units of network abstraction layer (NAL) units. The bitstream may be transmitted over a network or may be stored in a non-transitory digital storage medium. In addition, as described above, the bitstream is not directly transmitted from the encoding device 100 to the decoding device 200, but may be provided with a streaming/download service through an external server (eg, a content streaming server). Here, the network may include a broadcasting network and/or a communication network, and the digital storage medium may include various storage media such as USB, SD, CD, DVD, Blu-ray, HDD, and SSD.

As described above, the embodiments described in the present invention may be implemented and performed on a processor, microprocessor, controller, or chip. For example, the functional units illustrated in each drawing may be implemented and executed on a computer, processor, microprocessor, controller, or chip.

The video signal processing apparatus 500 according to the embodiment of the present specification may include a memory 520 for storing a video signal, and a processor 510 coupled to the memory 520.

To encode a video signal, the processor 510 determines a motion vector of a current block based on motion prediction, determines a motion vector difference (MVD) of the current block based on the motion vector, and determines the MVD and It is set to encode related MVD coding information. The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information indicates whether a first direction component of the MVD is greater than the first reference value. Including the indicated first component flag information and second component flag information indicating whether the second direction component of the MVD is greater than the first reference value, the first component flag information and the second component flag information They are encoded based on different context models.

In one embodiment, the second flag information includes a third component flag indicating whether the first direction component of the MVD is greater than the second reference value, and whether the second direction component of the MVD is greater than the second reference value. It may include a fourth component flag indicating whether or not.

In one embodiment, the processor 510 determines whether an intra block copy (IBC) mode is applied to the current block, and when the IBC mode is applied to the current block, the processor 510 encodes IBC MVD coding information. Is set. The processor 510 encodes first MVD size information indicating an absolute value of the first direction component of the MVD, and indicates whether the second direction component of the MVD is greater than the first reference value. Encoding a component flag, encoding the fourth component flag indicating whether a second direction component of the MVD is greater than the second reference value based on the second component flag, and encoding the second component flag and the second component flag It may be set to encode second MVD size information indicating the absolute value minus 2 of the second component of the MVD based on the 4 component flag.

For decoding a video signal, the processor 510 is configured to obtain MVD coding information related to a motion vector difference (MVD) for prediction of a current block, and to decode the MVD coding information, and the MVD coding information, Includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information includes a first component flag indicating whether a first direction component of the MVD is greater than the first reference value Information and second component flag information indicating whether the second direction component of the MVD is greater than the first reference value, and the first component flag information and the second component flag information are based on different context models. And decoded.

In one embodiment, second flag information indicating whether the MVD is greater than a second reference value, information on a size of the first MVD, and information on an MVD code are further included, and the second flag information is the first flag information And the MVD size information may be obtained based on the first flag information and the second flag information, and the MVD code information may be obtained based on the first flag information.

In one embodiment, the processor 510 determines whether an intra block copy (IBC) mode is applied to the current block, and when the IBC mode is applied to the current block, the processor 510 provides IBC MVD coding information. It can be set to acquire. In addition, the processor 510 obtains first MVD size information indicating the absolute value of the first direction component of the MVD, and a second component flag indicating whether the second direction component of the MVD is greater than the first reference value. And a fourth component flag indicating whether a second direction component of the MVD is greater than a second reference value based on the second component flag, and the second component flag and the fourth component flag Based on this, second MVD size information indicating the absolute value of the second component of the MVD minus 2 may be obtained.

Further, the processing method to which the present invention is applied may be produced in the form of a program executed by a computer, and may be stored in a computer-readable recording medium. Multimedia data having a data structure according to the present invention can also be stored in a computer-readable recording medium. The computer-readable recording medium includes all kinds of storage devices and distributed storage devices in which computer-readable data is stored. The computer-readable recording medium includes, for example, Blu-ray disk (BD), universal serial bus (USB), ROM, PROM, EPROM, EEPROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical It may include a data storage device. Further, the computer-readable recording medium includes media implemented in the form of a carrier wave (for example, transmission through the Internet). In addition, the bitstream generated by the encoding method may be stored in a computer-readable recording medium or transmitted through a wired or wireless communication network.

Further, an embodiment of the present invention may be implemented as a computer program product using a program code, and the program code may be executed in a computer according to the embodiment of the present invention. The program code may be stored on a carrier readable by a computer.

A non-transitory computer-readable medium according to an embodiment of the present specification stores one or more instructions executed by one or more processors. The one or more instructions determine a motion vector of a current block based on motion prediction for encoding a video signal, determine a motion vector difference (MVD) of the current block based on the motion vector, and the The video signal processing apparatus 500 (or encoding apparatus 100) is controlled to encode MVD coding information related to MVD. The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information indicates whether a first direction component of the MVD is greater than the first reference value. Including the indicated first component flag information and second component flag information indicating whether the second direction component of the MVD is greater than the first reference value, the first component flag information and the second component flag information They are encoded based on different context models.

In one embodiment, the MVD coding information further includes second flag information indicating whether the MVD is greater than a second reference value, size information of the first MVD, and MVD code information, and the second flag information It is obtained based on the first flag information, the MVD size information is encoded based on the first flag information and the second flag information, and the MVD code information may be encoded based on the first flag information. .

In one embodiment, one or more instructions determine whether an intra block copy (IBC) mode is applied to the current block, and when the IBC mode is applied to the current block, to encode IBC MVD coding information. The video signal processing device 500 (or the encoding device 100) can be controlled. The one or more instructions encode first MVD size information indicating an absolute value of the first direction component of the MVD, and a second indicating whether the second direction component of the MVD is greater than the first reference value. Encoding a component flag, encoding a fourth component flag indicating whether a second direction component of the MVD is greater than a second reference value based on the second component flag, and the second component flag and the fourth component The video signal processing apparatus 500 (or encoding apparatus 100) may be controlled to encode the second MVD size information indicating the absolute value of the second component of the MVD minus 2 based on the flag.

In addition, the one or more instructions may include obtaining MVD coding information related to motion vector difference (MVD) for prediction of a current block for decoding a video signal, and decoding the MVD coding information. 500) (or the decoding device 200). The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value, and the first flag information indicates whether a first direction component of the MVD is greater than the first reference value. Including the indicated first component flag information and second component flag information indicating whether the second direction component of the MVD is greater than the first reference value, the first component flag information and the second component flag information It is decoded based on different context models.

In one embodiment, the MVD coding information further includes second flag information indicating whether the MVD is greater than a second reference value, MVD size information, and MVD code information, and the second flag information 1 is obtained based on flag information, the size information of the MVD is obtained based on the first flag information and the second flag information, and the MVD code information may be obtained based on the first flag information.

In one embodiment, one or more instructions determine whether an intra block copy (IBC) mode is applied to the current block, and when the IBC mode is applied to the current block, to obtain IBC MVD coding information The video signal processing device 500 (or the encoding device 100) can be controlled. The one or more commands obtain first MVD size information indicating an absolute value of the first direction component of the MVD, and indicate whether the second direction component of the MVD is greater than the first reference value. Obtain a two-component flag, obtain the fourth component flag indicating whether a second direction component of the MVD is greater than the second reference value based on the second component flag, and the second component flag and the The video signal processing apparatus 500 (or encoding apparatus 100) may be controlled to obtain second MVD size information indicating the absolute value minus 2 of the second component of the MVD based on the fourth component flag.

In addition, the decoder and encoder to which the present invention is applied include a multimedia broadcasting transmission/reception device, a mobile communication terminal, a home cinema video device, a digital cinema video device, a surveillance camera, a video chat device, a real-time communication device such as video communication, a mobile streaming device, Storage media, camcorders, video-on-demand (VoD) service providers, OTT video (Over the top video) devices, Internet streaming service providers, three-dimensional (3D) video devices, video telephony video devices, and medical video devices. And can be used to process video signals or data signals. For example, an OTT video (Over the top video) device may include a game console, a Blu-ray player, an Internet-connected TV, a home theater system, a smartphone, a tablet PC, and a digital video recorder (DVR).

The embodiments described above are those in which components and features of the present invention are combined in a predetermined form. Each component or feature should be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form that is not combined with other components or features. In addition, it is also possible to constitute an embodiment of the present invention by combining some components and/or features. The order of operations described in the embodiments of the present invention may be changed. Some configurations or features of one embodiment may be included in other embodiments, or may be replaced with corresponding configurations or features of other embodiments. It is obvious that the embodiments may be configured by combining claims that do not have an explicit citation relationship in the claims or may be included as new claims by amendment after filing.

The embodiment according to the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of implementation by hardware, an embodiment of the present invention is one or more ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs ( field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, etc.

In the case of implementation by firmware or software, an embodiment of the present invention may be implemented in the form of a module, procedure, or function that performs the functions or operations described above. The software code can be stored in a memory and driven by a processor. The memory may be located inside or outside the processor, and may exchange data with the processor through various known means.

In this document, "/" and "," are interpreted as "and/or". For example, "A/B" is interpreted as "A and/or B", and "A, B" is interpreted as "A and/or B". Additionally, “A/B/C” means “at least one of A, B and/or C”. In addition, "A, B, C" also means "at least one of A, B and/or C". (In this document, the term "/" and "," should be interpreted to indicate "and/or." For instance, the expression "A/B" may mean "A and/or B." Further, "A, B" may mean "A and/or B." Further, "A/B/C" may mean "at least one of A, B, and/or C." Also, "A/B/C" may mean " at least one of A, B, and/or C.")

Additionally, in this document "or" is interpreted as "and/or". For example, "A or B" may mean only 1) "A", 2) only "B", or 3) "A and B". In other words, "or" in this document may mean "additionally or alternatively". (Further, in the document, the term "or" should be interpreted to indicate "and/or." For instance, the expression "A or B" may comprise 1) only A, 2) only B, and/or 3) both A and B. In other words, the term "or" in this document should be interpreted to indicate "additionally or alternatively.")

It is obvious to those skilled in the art that the present invention can be embodied in other specific forms without departing from the essential features of the present invention. Therefore, the above detailed description should not be construed as restrictive in all respects, but should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Above, the above-described preferred embodiments of the present invention are disclosed for the purpose of illustration, and those skilled in the art improve and change various other embodiments within the technical spirit and scope of the present invention disclosed in the appended claims below. , Substitution or addition may be possible.

Claims

A method of decoding a video signal for inter prediction, comprising:

Obtaining MVD coding information related to motion vector difference (MVD) for prediction of the current block; and

Including the step of decoding the MVD coding information,

The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value,

The first flag information includes first component flag information indicating whether a first direction component of the MVD is greater than the first reference value, and indicating whether a second direction component of the MVD is greater than the first reference value. Contains second component flag information,

The first component flag information and the second component flag information are decoded based on different context models.
The method of claim 1,

The MVD coding information,

Further comprising second flag information indicating whether the MVD is greater than a second reference value, MVD size information, and MVD code information,

The second flag information is obtained based on the first flag information,

The MVD size information is obtained based on the first flag information and the second flag information,

The MVD code information is obtained based on the first flag information.
The method of claim 2,

The second flag information,

A third component flag indicating whether the first direction component of the MVD is greater than the second reference value, and a fourth component flag indicating whether the second direction component of the MVD is greater than the second reference value. A decoding method, characterized in that.
The method of claim 2,

The MVD size information is decoded based on an exponential Golomb parameter having an order of 2 or more.
The method of claim 1,

Acquiring the MVD coding information,

Determining whether an intra block copy (IBC) mode is applied to the current block; and

When the IBC mode is applied to the current block, including obtaining IBC MVD coding information,

The step of obtaining the IBC MVD coding information,

Obtaining first MVD size information indicating an absolute value of the first direction component of the MVD; and

Obtaining a second component flag indicating whether the second direction component of the MVD is greater than the first reference value; and

Obtaining a fourth component flag indicating whether a second direction component of the MVD is greater than a second reference value based on the second component flag; and

And acquiring second MVD size information indicating the absolute value of the second component of the MVD minus 2 based on the second component flag and the fourth component flag.
The method of claim 5,

The first MVD size information is decoded based on an exponential Golomb parameter having an order of 2 or more.
A video signal encoding method for inter prediction, comprising:

Determining a motion vector of the current block based on motion prediction, and

Determining a motion vector difference (MVD) of the current block based on the motion vector,

Including the step of encoding MVD coding information related to the MVD,

The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value,

The first flag information includes first component flag information indicating whether a first direction component of the MVD is greater than the first reference value, and indicating whether a second direction component of the MVD is greater than the first reference value. Contains second component flag information,

The encoding method, characterized in that the first component flag information and the second component flag information are encoded based on different context models.
The method of claim 7,

The MVD coding information further includes second flag information indicating whether the MVD is greater than a second reference value, MVD size information, and MVD code information,

The second flag information is obtained based on the first flag information,

The MVD size information is encoded based on the first flag information and the second flag information,

The encoding method, characterized in that the MVD code information is encoded based on the first flag information.
The method of claim 8,

The second flag information,

A third component flag indicating whether the first direction component of the MVD is greater than the second reference value, and a fourth component flag indicating whether the second direction component of the MVD is greater than the second reference value. Encoding method, characterized in that.
The method of claim 8,

The encoding method, characterized in that the MVD size information is encoded based on an exponential Golomb parameter having an order of 2 or more.
The method of claim 7,

Encoding the MVD coding information,

Determining whether an intra block copy (IBC) mode is applied to the current block; and

When the IBC mode is applied to the current block, encoding IBC MVD coding information,

Encoding the IBC MVD coding information,

Encoding first MVD size information indicating an absolute value of a first direction component of the MVD;

Encoding a second component flag indicating whether the second direction component of the MVD is greater than the first reference value;

Encoding a fourth component flag indicating whether a second direction component of the MVD is greater than a second reference value based on the second component flag; and

And encoding second MVD size information indicating an absolute value minus 2 of the second component of the MVD based on the second component flag and the fourth component flag.
The method of claim 11,

The encoding method, characterized in that the MVD size information is encoded based on an exponential Golomb parameter having an order of 2 or more.
A video signal decoding apparatus for inter prediction, comprising:

A memory for storing the video signal;

Comprising a processor coupled with the memory,

The processor,

Acquire MVD coding information related to motion vector difference (MVD) for prediction of the current block,

It is set to decode the MVD coding information,

The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value,

The first flag information includes first component flag information indicating whether a first direction component of the MVD is greater than the first reference value, and indicating whether a second direction component of the MVD is greater than the first reference value. Contains second component flag information,

And the first component flag information and the second component flag information are decoded based on different context models.
An apparatus for encoding a video signal for inter prediction, comprising:

A memory for storing the video signal;

Comprising a processor coupled with the memory,

The processor,

Determine a motion vector of the current block based on motion prediction,

Determine a motion vector difference (MVD) of the current block based on the motion vector,

It is set to encode MVD coding information related to the MVD,

The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value,

The first flag information includes first component flag information indicating whether a first direction component of the MVD is greater than the first reference value, and indicating whether a second direction component of the MVD is greater than the first reference value. Contains second component flag information,

The encoding apparatus, wherein the first component flag information and the second component flag information are encoded based on different context models.
As a non-transitory computer-readable medium that stores one or more instructions, the one or more instructions executed by one or more processors may cause a video signal processing apparatus to:

Acquire MVD coding information related to motion vector difference (MVD) for prediction of the current block,

Control to decode the MVD coding information,

The MVD coding information includes first flag information indicating whether the MVD is greater than a first reference value,

The first flag information includes first component flag information indicating whether a first direction component of the MVD is greater than the first reference value, and indicating whether a second direction component of the MVD is greater than the first reference value. Contains second component flag information,

The first component flag information and the second component flag information are decoded based on different context models.