WO2020171673A1

WO2020171673A1 - Video signal processing method and apparatus for intra prediction

Info

Publication number: WO2020171673A1
Application number: PCT/KR2020/002635
Authority: WO
Inventors: 허진; 유선미; 이령; 최장원; 최정아
Original assignee: 엘지전자 주식회사
Priority date: 2019-02-24
Filing date: 2020-02-24
Publication date: 2020-08-27

Abstract

Embodiments of the present specification provide a video signal processing method and apparatus for intra prediction. A method for encoding a video signal, according to an embodiment of the present specification, comprises the steps of: generating a most probable mode (MPM) candidate list on the basis of a prediction mode of at least one neighboring block adjacent to a current block; changing the MPM candidate list by removing at least one mode from the MPM candidate list on the basis of an intra prediction type; determining an MPM index related to an intra prediction mode of the current block, which is derived from the MPM candidate list on the basis of a rate-distortion rate; and encoding intra prediction information including information about the MPM index and the intra prediction type. By generating the same MPM candidate list for various intra prediction types and then changing the MPM candidate list so as to remove an unavailable MPM candidate according to the intra prediction type, an encoding/decoding structure of intra prediction information can be simplified, and the data amount and computation complexity required for intra prediction can be reduced.

Description

Video signal processing method and apparatus for intra prediction

Embodiments of the present specification relate to a video/video compression coding system, and more particularly, to a method and apparatus for performing intra prediction in an encoding/decoding process of a video signal.

Compression coding refers to a series of signal processing techniques for transmitting digitized information through a communication line or storing it in a format suitable for a storage medium. Media such as video, image, and audio may be subject to compression encoding. In particular, a technique for performing compression encoding on an image is referred to as video image compression.

Next-generation video content will be characterized by high spatial resolution, high frame rate, and high dimensionality of scene representation. In order to process such content, it will bring a tremendous increase in terms of memory storage, memory access rate, and processing power.

Intra prediction is a method of performing prediction by referring to reconstructed samples around a current block to be encoded/decoded in a current picture. In order to increase the efficiency of intra prediction, a new intra prediction method and addition/extension of an intra prediction mode are being discussed.

An embodiment of the present specification provides a method and apparatus for reducing the amount of data and processing time required for constructing a most probable (MPM) candidate list in a process of encoding/decoding information for intra prediction.

The technical problems to be achieved in the embodiments of the present specification are not limited to the technical problems mentioned above, and other technical problems that are not mentioned are those of ordinary skill in the technical field to which the embodiments of the present specification belong from the following description. Will be clearly understood.

Embodiments of the present specification provide a method and apparatus for processing a video signal for intra prediction. A video signal encoding method according to an embodiment of the present specification includes generating a most probable mode (MPM) candidate list based on a prediction mode of at least one neighboring block adjacent to a current block, and based on the intra prediction type. Changing the MPM candidate list by removing at least one mode from the MPM candidate list; and an intra prediction mode of the current block derived based on a rate-distortion rate from the MPM candidate list; and Determining a related MPM index, and encoding intra prediction information including information on the MPM index and the intra prediction type.

In one embodiment, the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided, and a reference sample located in a line separated by 2 sample distances or more from the current block. It may correspond to one of the used second type or a third type in which the reference sample located in a line adjacent to the current block is used and the current block is divided by an intra subpartition.

In an embodiment, if the intra prediction type corresponds to the second type, the planar mode and the DC mode may be removed from the MPM candidate list.

In an embodiment, when the intra prediction type corresponds to the third type, the DC mode may be removed from the MPM candidate list.

In an embodiment, if the intra prediction type corresponds to the second type, the planar mode may be removed from the MPM candidate list.

In one embodiment, the intra prediction information further includes ISP direction information related to a division direction of the current block when the intra prediction type corresponds to a third type, and the intra prediction mode is horizontal direction division in the MPM candidate list. It may be a mode having a smaller rate-distortion cost among the modes determined for the and vertical division.

A method of decoding a video signal according to an embodiment of the present specification includes obtaining intra prediction information of a current block to which the intra prediction is applied, wherein the intra prediction information includes information on an intra prediction type of the current block and MPM Including an index, generating an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block, and by removing at least one mode from the MPM candidate list based on the intra prediction type. Changing an MPM candidate list, determining an intra prediction mode related to the MPM index from the MPM candidate list, and generating a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture Includes steps.

In an embodiment, the intra prediction information may further include ISP direction information related to a division direction of the current block when the intra prediction type corresponds to a third type.

An encoding apparatus according to an embodiment of the present specification includes a memory for storing the video signal, and a processor coupled to the memory and processing the video signal. The processor generates an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to a current block, and removes at least one mode from the MPM candidate list based on an intra prediction type of the current block. Intra including the MPM index and information on the intra prediction type by changing a candidate list and determining an MPM index related to an intra prediction mode of the current block derived based on a rate-distortion cost from the MPM candidate list It is set to encode prediction information.

A decoding apparatus according to an embodiment of the present specification includes a memory storing the video signal, and a processor coupled to the memory and processing the video signal. The processor obtains intra prediction information of a current block to which the intra prediction is applied, wherein the intra prediction information includes information on an intra prediction type of the current block and a most probable mode (MPM) index, and the current Generate an MPM candidate list based on prediction modes of at least one neighboring block adjacent to the block, and change the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type, and the MPM It is configured to determine an intra prediction mode related to the MPM index from a candidate list, and to generate a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture.

An embodiment of the present specification provides a non-transitory computer-readable medium storing one or more instructions. The one or more instructions executed by one or more processors generate a most probable mode (MPM) candidate list based on a prediction mode of at least one neighboring block adjacent to the current block, and the intra The MPM candidate list is changed by removing at least one mode from the MPM candidate list based on a prediction type, and an intra of the current block derived based on a rate-distortion rate from the MPM candidate list A video signal processing apparatus is controlled to determine an MPM index related to a prediction mode and encode intra prediction information including information on the MPM index and the intra prediction type.

In addition, the one or more instructions executed by one or more processors obtain intra prediction information including information on an intra prediction type of a current block and an MPM index, and at least one adjacent to the current block Generate an MPM candidate list based on a prediction mode of a neighboring block, and change the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type, and the MPM index in the MPM candidate list A video signal processing apparatus is controlled to determine an intra prediction mode related to the intra prediction mode, and to generate a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture.

According to an embodiment of the present specification, after generating the same MPM candidate list for various intra prediction types, by changing the MPM candidate list so that unusable MPM candidates are removed according to the intra prediction type, the encoding/decoding structure of intra prediction information It can simplify, and reduce the amount of data and computational complexity required for intra prediction.

The effects obtained in the embodiments of the present specification are not limited to the above-mentioned effects, and other effects not mentioned are clearly to those of ordinary skill in the art to which the embodiments of the present specification belong from the following description. It will be understandable.

The accompanying drawings, which are included as part of the detailed description to aid in understanding of the present specification, provide embodiments of the present specification, and describe technical features of the present specification together with the detailed description.

1 shows an example of an image coding system according to an embodiment of the present specification.

2 shows an example of a schematic block diagram of an encoding apparatus in which encoding of a video signal is performed according to an embodiment of the present specification.

3 shows an example of a schematic block diagram of a decoding apparatus for decoding an image signal according to an embodiment of the present specification.

4 shows an example of a content streaming system according to an embodiment of the present specification.

5 shows an example of a video signal processing apparatus according to an embodiment of the present specification.

6A to 6D illustrate examples of a block division structure according to an embodiment of the present specification.

7 shows an example of a flowchart for encoding a picture constituting a video signal according to an embodiment of the present specification.

8 shows an example of a flowchart for decoding a picture constituting a video signal according to an embodiment of the present specification.

9 shows an example of a flowchart for intra prediction in an encoding process of a video signal according to an embodiment of the present specification.

10 illustrates an example of an intra prediction unit in an encoding device according to an embodiment of the present specification.

11 shows an example of a flowchart for intra prediction in a process of decoding a video signal according to an embodiment of the present specification.

12 illustrates an example of an intra prediction unit in a decoding apparatus according to an embodiment of the present specification.

13 shows an example of a flowchart for encoding intra prediction information in a process of encoding a video signal according to an embodiment of the present specification.

14 shows an example of a flowchart for decoding intra prediction information in a process of decoding a video signal according to an embodiment of the present specification.

15 illustrates an example of a flowchart for determining an intra prediction mode in a process of decoding a video signal according to an embodiment of the present specification.

16 illustrates an example of 33 directional intra prediction modes according to an embodiment of the present specification.

17 illustrates an example of 65 directional intra prediction modes according to an embodiment of the present specification.

18 shows an example of a flowchart for configuring a most probable mode (MPM) candidate list according to an embodiment of the present specification.

19 shows examples of reference samples taking into account multi-reference line (MRL) intra prediction according to an embodiment of the present specification.

20A and 20B illustrate an example of block division according to an intra sub-partition (ISP) according to an embodiment of the present specification.

21 is a diagram for explaining a multiple direct mode (DM) for intra prediction of a chroma block according to an embodiment of the present specification.

22 illustrates an example of a sample location for deriving parameters of a cross-component linear model (CCLM) mode for intra prediction of a color difference block according to an embodiment of the present specification.

23A to 23C illustrate examples of a method of configuring a most probable mode (MPM) candidate list based on an intra prediction type according to an embodiment of the present specification.

24A to 24C illustrate another example of a method of constructing an MPM candidate list based on an intra prediction type according to an embodiment of the present specification.

25 illustrates an example of a flowchart for intra prediction in an encoding process of a video signal according to an embodiment of the present specification.

26 shows an example of a flowchart for intra prediction in a process of decoding a video signal according to an embodiment of the present specification.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The detailed description to be disclosed hereinafter together with the accompanying drawings is intended to describe exemplary embodiments of the present invention, and is not intended to represent the only embodiments in which the present invention may be practiced. The following detailed description includes specific details to provide a thorough understanding of the present invention. However, one of ordinary skill in the art appreciates that the invention may be practiced without these specific details.

In some cases, in order to avoid obscuring the concept of the present invention, well-known structures and devices may be omitted, or may be shown in a block diagram form centering on core functions of each structure and device.

In addition, as for terms used in the present invention, general terms that are currently widely used are selected as far as possible, but specific cases will be described using terms arbitrarily selected by the applicant. In such a case, since the meaning of the term is clearly described in the detailed description of the corresponding part, it should not be interpreted simply by the name of the term used in the description of the present invention, and it should be clarified that the meaning of the term should be understood and interpreted .

Specific terms used in the following description are provided to aid understanding of the present invention, and the use of these specific terms may be changed in other forms without departing from the technical spirit of the present invention. For example, signals, data, samples, pictures, frames, blocks, etc. may be appropriately replaced and interpreted in each coding process.

Hereinafter, in the present specification, a'processing unit' means a unit in which an encoding/decoding process such as prediction, transformation, and/or quantization is performed. Also, the processing unit may be interpreted as including a unit for a luma component and a unit for a chroma component. For example, the processing unit may correspond to a block, a coding unit (CU), a prediction unit (PU), or a transform unit (TU).

Further, the processing unit may be interpreted as a unit for a luminance component or a unit for a color difference component. For example, the processing unit may correspond to a coding tree block (CTB), a coding block (CB), a PU, or a transform block (TB) for a luminance component. Alternatively, the processing unit may correspond to CTB, CB, PU or TB for the color difference component. Further, the present invention is not limited thereto, and the processing unit may be interpreted as including a unit for a luminance component and a unit for a color difference component.

Further, the processing unit is not necessarily limited to a square block, and may be configured in a polygonal shape having three or more vertices.

In addition, in the present specification, pixels or pixels are collectively referred to as samples. In addition, using a sample may mean using a pixel value or a pixel value.

1 shows an example of an image coding system according to an embodiment of the present specification. The image coding system may include a source device 10 and a reception device 20. The source device 10 may transmit the encoded video/video information or data in a file or streaming format to the receiving device 20 through a digital storage medium or a network.

The source device 10 may include a video source 11, an encoding device 12, and a transmitter 13. The receiving device 20 may include a receiver 21, a decoding device 22 and a renderer 23. The encoding device 12 may be referred to as a video/image encoding device, and the decoding device 22 may be referred to as a video/image decoding device. The transmitter 13 may be included in the encoding device 12. The receiver 21 may be included in the decoding device 22. The renderer 23 may include a display unit, and the display unit may be configured as a separate device or an external component.

The video source 11 may acquire a video/image through a process of capturing, synthesizing, or generating a video/image. The video source 11 may include a video/image capturing device and/or a video/image generating device. The video/image capturing device may include, for example, one or more cameras, and a video/image archive including previously captured video/images. Video/image generating devices may include, for example, computers, tablets and smartphones, and may (electronically) generate video/images. For example, a virtual video/image may be generated through a computer, and in this case, a video/image capturing process may be substituted as a process of generating related data.

The encoding device 12 may encode an input video/video. The encoding apparatus 12 may perform a series of procedures such as prediction, transformation, and quantization for compression and coding efficiency. The encoded data (encoded video/video information) may be output in the form of a bitstream.

The transmitter 13 may transmit the encoded video/video information or data output in the form of a bitstream to the receiver 21 of the receiving device 20 through a digital storage medium or a network in a file or streaming form. Digital storage media include USB (universal serial bus), SD card (secure digital card), CD (compact disc), DVD (digital versatile disc), Blu-ray disc, HDD (hard disk drive), SSD (solid state drive) may include a variety of storage media. The transmitter 13 may include an element for generating a media file through a predetermined file format, and may include an element for transmission through a broadcast/communication network. The receiver 21 may extract the bitstream and transmit it to the decoding device 22.

The decoding device 22 may decode the video/video by performing a series of procedures such as inverse quantization, inverse transformation, and prediction corresponding to the operation of the encoding device 12.

The renderer 23 may render the decoded video/image. The rendered video/image may be displayed through the display unit.

2 shows an example of a schematic block diagram of an encoding apparatus in which encoding of a video signal is performed according to an embodiment of the present specification. The encoding device 100 of FIG. 2 may correspond to the encoding device 12 of FIG. 1.

The image partitioning module 110 may divide an input image (or picture, frame) input to the encoding apparatus 100 into one or more processing units. For example, the processing unit may be referred to as a coding unit (CU). In this case, the coding unit may be recursively partitioned from a coding tree unit (CTU) or a largest coding unit (LCU) according to a quad-tree binary-tree (QTBT) structure. For example, one coding unit may be divided into a plurality of coding units of a deeper depth based on a quad tree structure and/or a binary tree structure. In this case, for example, a quad tree structure may be applied first and a binary tree structure may be applied later. Alternatively, the binary tree structure may be applied first. A coding procedure according to an embodiment of the present specification may be performed based on a final coding unit that is no longer divided. In this case, the maximum coding unit may be directly used as the final coding unit based on coding efficiency according to image characteristics. Further, if necessary, the coding unit is recursively divided into coding units of a lower depth, so that a coding unit having an optimal size may be used as a final coding unit. Here, the coding procedure may include procedures such as prediction, transformation, and restoration described below. As another example, the processing unit may further include a prediction unit (PU) or a transform unit (TU). In this case, the prediction unit and the transform unit may be divided from the above-described coding units, respectively. The prediction unit may be a unit of sample prediction, and the transform unit may be a unit for inducing a transform coefficient or a unit for inducing a residual signal from the transform coefficient.

The term "unit" used in this document may be used interchangeably with terms such as "block" or "area" in some cases. In this document, the MxN block may represent a set of samples or transform coefficients consisting of M columns and N rows. A sample may generally represent a pixel or a value of a pixel, may represent a pixel/pixel value of a luminance component, or a pixel/pixel value of a saturation component. A sample may be used as a term corresponding to one picture (or image) as a pixel or pel.

The encoding apparatus 100 includes a prediction signal (predicted block) output from an inter prediction module 180 or an intra prediction module 185 from an input video signal (original block, original sample array). , Predictive sample array), a residual signal (residual signal, residual block, residual sample array) may be generated. The generated residual signal is transmitted to the conversion unit 120. In this case, as shown, a unit that subtracts a prediction signal (prediction block, prediction sample array) from an input video signal (original block, original sample array) in the encoding apparatus 100 is used as a subtraction module 115. May be referred to. The prediction unit may perform prediction on a block to be processed (hereinafter, referred to as a current block) and generate a predicted block including prediction samples for the current block. The prediction module may determine whether intra prediction or inter prediction is applied on a per CU basis. The prediction unit may generate information about prediction, such as prediction mode information, as described later in the description of each prediction mode, and may transmit information about prediction to the entropy encoding unit 190. Information about prediction is encoded by the entropy encoding unit 190 and may be output in the form of a bitstream.

The intra prediction unit 185 may predict the current block by referring to samples in the current picture. The referenced samples may be located in the vicinity of the current block or may be located away from each other according to the prediction mode. In intra prediction, prediction modes may include a plurality of non-directional modes and a plurality of directional modes. The non-directional mode may include, for example, a DC mode and a planar mode (Planar mode). The directional mode may include, for example, 33 directional prediction modes or 65 directional prediction modes according to a detailed degree of the prediction direction. However, this is an example, and more or less directional prediction modes may be used depending on the setting. The intra prediction unit 185 may determine a prediction mode applied to the current block by using the prediction mode applied to the neighboring block.

The inter prediction unit 180 may derive a predicted block for the current block based on a reference block (reference sample array) specified by a motion vector on the reference picture. In this case, in order to reduce the amount of motion information transmitted in the inter prediction mode, the inter prediction unit 180 may predict motion information in units of blocks, subblocks, or samples based on the correlation between motion information between neighboring blocks and the current block. have. The motion information may include a motion vector and a reference picture index. The motion information may further include inter prediction direction (L0 prediction, L1 prediction, Bi prediction, etc.) information. In the case of inter prediction, the neighboring block may include a spatial neighboring block existing in the current picture and a temporal neighboring block existing in the reference picture. The reference picture including the reference block and the reference picture including the temporal neighboring block may be the same or different. The temporal neighboring block may be referred to as a collocated reference block or a colCU (colCU), and a reference picture including the temporal neighboring block may be referred to as a collocated picture (colPic). For example, the inter prediction unit 180 constructs a motion information candidate list based on motion information of neighboring blocks, and indicates which candidate is used to derive a motion vector and/or a reference picture index of the current block. Can generate information. Inter prediction may be performed based on various prediction modes. For example, when a skip mode and a merge mode are used, the inter prediction unit 180 may use motion information of a neighboring block as motion information of a current block. In the case of the skip mode, unlike the merge mode, a residual signal is not transmitted. In the case of motion vector prediction (MVP) mode, a motion vector of a neighboring block is used as a motion vector predictor and a motion vector difference (MVD) is signaled to move the current block. Vector can be indicated.

The prediction signal generated by the inter prediction unit 180 or the intra prediction unit 185 may be used to generate a reconstructed signal or may be used to generate a residual signal.

The transform module 120 may generate transform coefficients by applying a transform technique to the residual signal. For example, the transformation technique uses at least one of DCT (Discrete Cosine Transform), DST (Discrete Sine Transform), KLT (Karhunen-Loeve Transform), GBT (Graph-Based Transform), or CNT (Conditionally Non-linear Transform). Can include. Here, GBT refers to transformation obtained from a graph representing relationship information between pixels. CNT refers to a transformation obtained based on the prediction signal and generating a prediction signal using all previously reconstructed pixels. In addition, the conversion process may be applied to a pixel block having the same size of a square, or may be applied to a block that is not a square or has a variable size.

The quantization module 130 quantizes the transform coefficients and transmits the quantized transform coefficients to the entropy encoding module 190. The entropy encoding unit 190 may encode a quantized signal (information on quantized transform coefficients) and output it as a bitstream. Information about the quantized transform coefficients may be referred to as residual information. The quantization unit 130 may rearrange the quantized transform coefficients in a block form into a one-dimensional vector form based on a coefficient scan order, and quantize the quantized transform coefficients based on the characteristics of the quantized transform coefficients in a one-dimensional vector form. It is also possible to generate information about transform coefficients. The entropy encoding unit 190 may perform various encoding techniques such as exponential Golomb, context-adaptive variable length coding (CAVLC), and context-adaptive binary arithmetic coding (CABAC). The entropy encoding unit 190 may encode information necessary for video/image restoration (eg, values of syntax elements) in addition to quantized transform coefficients together or separately. The encoded information (eg, video/video information) may be transmitted or stored in a bitstream format in units of network abstraction layer (NAL) units. The bitstream may be transmitted over a network or may be stored in a digital storage medium. Here, the network may include a broadcasting network and/or a communication network, and the digital storage medium may include a storage medium such as USB, SD, CD, DVD, Blu-ray, HDD, and SSD. For the signal output from the entropy encoding unit 190, a transmission unit (not shown) for transmitting and/or a storage unit (not shown) for storing may be configured as internal/external elements of the encoding apparatus 100, or the transmission unit It may be a component of the entropy encoding unit 190.

The quantized transform coefficients output from the quantization unit 130 may be used to generate a reconstructed signal. For example, a residual signal can be restored by applying inverse quantization and inverse transform through the inverse quantization module 140 and the inverse transform module 150 in the loop for the quantized transform coefficients. have. The addition module 155 adds the reconstructed residual signal to the prediction signal output from the inter prediction unit 180 or the intra prediction unit 185 to provide a reconstructed signal (reconstructed picture, a reconstructed block, and Sample array). When there is no residual signal for the block to be processed, such as when the skip mode is applied, the predicted block may be used as a reconstructed block. The addition unit 155 may be referred to as a restoration unit or a restoration block generation unit. The generated reconstructed signal may be used for intra prediction of the next processing target block in the current picture, and may be used for inter prediction of the next picture through filtering as described later.

The filtering module 160 may improve subjective/objective image quality by applying filtering to the reconstructed signal. For example, the filtering unit 160 may apply various filtering methods to the reconstructed picture to generate a modified reconstructed picture, and may transmit the modified reconstructed picture to the decoded picture buffer 170. Various filtering methods may include, for example, deblocking filtering, sample adaptive offset (SAO), adaptive loop filter (ALF), and bilateral filter. The filtering unit 160 may generate filtering information and transmit the filtering information to the entropy encoding unit 190 as described later in the description of each filtering method. The filtering information may be output in the form of a bitstream through entropy encoding in the entropy encoding unit 190.

The modified reconstructed picture transmitted to the decoded picture buffer (DBP) 170 may be used as a reference picture in the inter prediction unit 180. When inter prediction is applied, the encoding apparatus 100 may avoid prediction mismatch between the encoding apparatus 100 and the decoding apparatus 200 by using the modified reconstructed picture, and may improve encoding efficiency. The decoded picture buffer 170 may store the modified reconstructed picture to be used as a reference picture in the inter prediction unit 180.

3 shows an example of a schematic block diagram of a decoding apparatus for decoding an image signal according to an embodiment of the present specification. The decoding device 200 of FIG. 3 may correspond to the decoding device 22 of FIG. 1.

Referring to FIG. 3, the decoding apparatus 200 includes an entropy decoding module 210, a de-quantization module 220, an inverse transform module 230, and an adder. (addition module) 235, filtering module 240, decoded picture buffer (DPB) 250, inter prediction module 260, and intra prediction module 265 ) Can be included. The inter prediction unit 260 and the intra prediction unit 265 may be collectively referred to as a prediction module. That is, the prediction unit may include an inter prediction unit 180 and an intra prediction unit 185. The inverse quantization unit 220 and the inverse transform unit 230 may be collectively referred to as a residual processing module. That is, the residual processing unit may include an inverse quantization unit 220 and an inverse transform unit 230. The entropy decoding unit 210, the inverse quantization unit 220, the inverse transform unit 230, the addition unit 235, the filtering unit 240, the inter prediction unit 260, and the intra prediction unit 265 are implemented. It may be configured by one hardware component (eg, a decoder or a processor) according to an example. Also, the decoded picture buffer 250 may be configured by one hardware component (eg, a memory or a digital storage medium) according to an embodiment.

When a bitstream including video/image information is input, the decoding apparatus 200 may reconstruct an image in response to a process in which the video/image information is processed by the encoding apparatus 100 of FIG. 2. For example, the decoding apparatus 200 may perform decoding using a processing unit applied by the encoding apparatus 100. Thus, upon decoding, the processing unit may be a coding unit, for example, and the coding unit may be divided from a coding tree unit or a maximum coding unit along a quad tree structure and/or a binary tree structure. In addition, the reconstructed image signal decoded and output through the decoding device 200 may be reproduced through the playback device.

The decoding apparatus 200 may receive a signal output from the encoding apparatus 100 of FIG. 2 in the form of a bitstream, and the received signal may be decoded through the entropy decoding unit 210. For example, the entropy decoding unit 210 may parse the bitstream to derive information (eg, video/video information) necessary for image restoration (or picture restoration). For example, the entropy decoding unit 210 acquires information in the bitstream using a coding technique such as exponential Golomb coding, CAVLC, or CABAC, and a value of a syntax element required for image restoration, and a quantized value of a transform coefficient for a residual Can be printed. In more detail, in the CABAC entropy decoding method, a bin corresponding to each syntax element is received in a bitstream, and information about the syntax element to be decoded and decoding information of a block to be decoded and a neighbor or a symbol/bin decoded in a previous step The symbol corresponding to the value of each syntax element is determined by determining the context model using the information of, and performing arithmetic decoding of the bin by predicting the probability of occurrence of the bin according to the determined context model. Can be generated. In this case, the CABAC entropy decoding method may update the context model using information of the decoded symbol/bin for the context model of the next symbol/bin after the context model is determined. Among the information decoded by the entropy decoding unit 210, information on prediction is provided to the prediction unit (inter prediction unit 260 and intra prediction unit 265), and the register on which entropy decoding is performed by the entropy decoding unit 210 Dual values, that is, quantized transform coefficients and related parameter information may be input to the inverse quantization unit 220. In addition, information about filtering among information decoded by the entropy decoding unit 210 may be provided to the filtering unit 240. Meanwhile, a receiving unit (not shown) for receiving a signal output from the encoding device 100 may be further configured as an inner/outer element of the decoding device 200, or the receiving unit may be a component of the entropy decoding unit 210. May be.

The inverse quantization unit 220 may output transform coefficients through inverse quantization of the quantized transform coefficients. The inverse quantization unit 220 may rearrange the quantized transform coefficients into a two-dimensional block shape. In this case, the reordering may be performed based on the coefficient scan order performed by the encoding apparatus 100. The inverse quantization unit 220 may perform inverse quantization on quantized transform coefficients by using a quantization parameter (eg, quantization step size information) and obtain transform coefficients.

The inverse transform unit 230 inversely transforms the transform coefficients to obtain a residual signal (residual block, residual sample array).

The prediction unit may perform prediction on the current block and generate a predicted block including prediction samples for the current block. The prediction unit may determine whether intra prediction or inter prediction is applied to the current block based on information on prediction output from the entropy decoding unit 210, and may determine a specific intra/inter prediction mode.

The intra prediction unit 265 may predict the current block by referring to samples in the current picture. The referenced samples may be located near the current block or may be spaced apart according to the prediction mode. In intra prediction, prediction modes may include a plurality of non-directional modes and a plurality of directional modes. The intra prediction unit 265 may determine a prediction mode applied to the current block by using the prediction mode applied to the neighboring block.

The inter prediction unit 260 may derive a predicted block for the current block based on a reference block (reference sample array) specified by a motion vector on the reference picture. In this case, in order to reduce the amount of motion information transmitted in the inter prediction mode, motion information may be predicted in units of blocks, subblocks, or samples based on correlation between motion information between neighboring blocks and current blocks. The motion information may include a motion vector and a reference picture index. The motion information may further include inter prediction direction (L0 prediction, L1 prediction, Bi prediction) information. In the case of inter prediction, the neighboring block may include a spatial neighboring block existing in the current picture and a temporal neighboring block existing in the reference picture. For example, the inter prediction unit 260 may construct a motion information candidate list based on neighboring blocks, and derive a motion vector and/or a reference picture index of the current block based on the received candidate selection information. Inter prediction may be performed based on various prediction modes, and information on prediction may include information indicating a mode of inter prediction for a current block.

The addition unit 235 adds the obtained residual signal to the prediction signal (predicted block, prediction sample array) output from the inter prediction unit 260 or the intra prediction unit 265 to provide a reconstructed signal (a reconstructed picture, a reconstructed block). , Restoration sample array) can be generated. When there is no residual for a block to be processed, such as when the skip mode is applied, the predicted block may be used as a reconstructed block.

The addition unit 235 may be referred to as a restoration unit or a restoration block generation unit. The generated reconstructed signal may be used for intra prediction of the next processing target block in the current picture, and may be used for inter prediction of the next picture through filtering as described later.

The filtering unit 240 may improve subjective/objective image quality by applying filtering to the reconstructed signal. For example, the filtering unit 240 may apply various filtering methods to the reconstructed picture to generate a modified reconstructed picture, and may transmit the modified reconstructed picture to the decoded picture buffer 250. Various filtering methods may include, for example, deblocking filtering, sample adaptive offset, adaptive loop filter, and bilateral filter.

The modified reconstructed picture delivered to the decoded picture buffer 250 may be used as a reference picture by the inter prediction unit 260.

In the present specification, embodiments described in the filtering unit 160, the inter prediction unit 180, and the intra prediction unit 185 of the encoding apparatus 100 are respectively the filtering unit 240 and the inter prediction unit 260 of the decoding apparatus. ) And the intra prediction unit 265 may be applied to be the same or correspond to each other.

4 shows an example of a content streaming system according to an embodiment of the present specification. Content streaming systems to which the embodiments of the present specification are applied are largely an encoding server 410, a streaming server 420, a web server 430, and a media storage 440. ), a user equipment 450, and a multimedia input device 460.

The encoding server 410 generates a bitstream by compressing content input from a multimedia input device 460 such as a smartphone, a camera, or a camcorder into digital data, and transmits the generated bitstream to the streaming server 420. As another example, when the multimedia input device 460 such as a smartphone, a camera, or a camcorder directly generates a bitstream, the encoding server 410 may be omitted.

The bitstream may be generated by an encoding method or a bitstream generation method to which an embodiment of the present specification is applied, and the streaming server 420 may temporarily store the bitstream while transmitting or receiving the bitstream.

The streaming server 420 transmits multimedia data to the user device 450 based on a user request through the web server 430, and the web server 430 serves as an intermediary that informs the user of what kind of service exists. When a user requests a desired service from the web server 430, the web server 430 transmits information on the requested service to the streaming server 420, and the streaming server 420 transmits multimedia data to the user. In this case, the content streaming system may include a separate control server, and in this case, the control server serves to control commands/responses between devices in the content streaming system.

The streaming server 420 may receive content from the media storage 440 and/or the encoding server 410. For example, when content is received from the encoding server 410, the content may be received in real time. In this case, in order to provide a smooth streaming service, the streaming server 420 may store the bitstream for a predetermined time.

The user device 450 includes, for example, a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistants (PDA), a portable multimedia player (PMP), a navigation system, and a slate PC ( slate PC), tablet PC, ultrabook, wearable device, e.g., smartwatch, smart glass, head mounted display (HMD)), It can include digital TV, desktop computer, and digital signage.

Each server in the content streaming system may be operated as a distributed server, and in this case, data received from each server may be distributedly processed.

5 shows an example of a video signal processing apparatus according to an embodiment of the present specification. The video signal processing apparatus of FIG. 5 may correspond to the encoding apparatus 100 of FIG. 1 or the decoding apparatus 200 of FIG. 2.

The video signal processing apparatus 500 for processing a video signal includes a memory 520 for storing a video signal, and a processor 510 for processing a video signal while being combined with the memory 520. The processor 510 according to the embodiment of the present specification may be configured with at least one processing circuit for processing a video signal, and may process a video signal by executing instructions for encoding/decoding a video signal. That is, the processor 510 may encode original video data or decode an encoded video signal by executing encoding/decoding methods described below.

As will be described later, the processor 510 according to the embodiment of the present specification, for encoding a video signal, for encoding a video signal, based on a prediction mode of at least one neighboring block adjacent to the current block, the MPM ( most probable mode) a candidate list is generated, and the MPM candidate list is changed by removing at least one mode from the MPM candidate list based on the intra prediction type of the current block, and rate-distortion cost in the MPM candidate list It is configured to determine an MPM index related to an intra prediction mode of the current block derived based on the current block, and to encode intra prediction information including information on the MPM index and the intra prediction type.

In one embodiment, the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided, and a reference sample located in a line separated by 2 sample distances or more from the current block. It may correspond to one of the used second type or a third type in which a reference sample located in a line adjacent to the current block is used and the current block is divided by an intra sub-partition (ISP).

As described later, the processor 510 according to an embodiment of the present specification acquires intra prediction information of a current block to which the intra prediction is applied, for decoding a video signal, wherein the intra prediction information is the current Including information on the intra prediction type of a block and an MPM index, generating an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block, and in the MPM candidate list based on the intra prediction type Change the MPM candidate list by removing at least one mode, determine an intra prediction mode related to the MPM index from the MPM candidate list, and predict the current block based on the intra prediction mode and a reference sample in the current picture It is set up to generate samples.

6A to 6D illustrate examples of a block division structure according to an embodiment of the present specification. 6A is a QT (quadtree, QT), FIG. 6B is a binary tree (BT), FIG. 6C is a ternary tree (TT) and FIG. 6D shows an example of block division structures by an asymmetric tree (AT). do.

In a video coding system, one block may be divided based on a QT division scheme. In addition, one subblock divided by the QT division method may be further divided recursively according to the QT division method. A leaf block that is no longer divided by the QT division method may be divided by at least one of BT, TT, or AT. BT can have two types of division, such as horizontal BT (2NxN, 2NxN) and vertical BT (Nx2N, Nx2N). TT may have two types of divisions, such as horizontal TT (2Nx1/2N, 2NxN, 2Nx1/2N) and vertical TT (1/2Nx2N, Nx2N, 1/2Nx2N). AT is horizontal-up AT (2Nx1/2N, 2Nx3/2N), horizontal-down AT (2Nx3/2N, 2Nx1/2N), vertical-left AT ( It can have four types of division: 1/2Nx2N, 3/2Nx2N), and vertical-right AT (3/2Nx2N, 1/2Nx2N). Each BT, TT, AT can be further divided recursively using BT, TT, AT.

6A shows an example of QT division. Block A may be divided into four sub-blocks (A0, A1, A2, A3) by QT. Sub-block A1 may be divided into four sub-blocks (B0, B1, B2, B3) by QT again.

6B shows an example of BT segmentation. Block B3 that is no longer divided by QT may be divided by vertical BT (C0, C1) or horizontal BT (D0, D1). Like block C0, each sub-block may be further divided recursively in the form of horizontal BT (E0, E1) or vertical BT (F0, F1).

6C shows an example of TT partitioning. Block B3 which is no longer divided by QT may be divided into vertical TT (C0, C1, C2) or horizontal TT (D0, D1, D2). Like block C1, each sub-block may be further divided recursively in the form of horizontal TT (E0, E1, E2) or vertical TT (F0, F1, F2).

6D shows an example of AT partitioning. Block B3, which is no longer divided by QT, can be divided into vertical ATs (C0, C1) or horizontal ATs (D0, D1). Like block C1, each sub-block can be further divided recursively in the form of a horizontal AT (E0, E1) or a vertical TT (F0, F1).

Meanwhile, BT, TT, and AT division can be applied together in one block. For example, a sub-block divided by BT may be divided by TT or AT. In addition, sub-blocks divided by TT may be divided by BT or AT. Sub-blocks divided by AT may be divided by BT or TT. For example, after horizontal BT division, each sub-block may be divided by vertical BT. In addition, after vertical BT division, each sub-block may be divided by horizontal BT. In this case, the order of division is different, but the shape of the final division is the same.

In addition, when the block is divided, the order of searching for the block may be variously defined. In general, a search is performed from left to right and from top to bottom, and searching for a block means the order of determining whether to divide additional blocks of each divided sub-block, or if the block is no longer divided, each sub It may mean an encoding order of a block, or a search order when a subblock refers to information of another neighboring block.

Video/video coding procedure

In video/video coding, pictures constituting the video/video may be encoded/decoded according to a series of decoding orders. A picture order corresponding to an output order of a decoded picture may be set differently from a decoding order, and based on this, not only forward prediction but also backward prediction may be performed during inter prediction.

7 shows an example of a flowchart for encoding a picture constituting a video signal according to an embodiment of the present specification. In FIG. 7, step S710 may be performed by the

prediction units

180 and 185 of the encoding apparatus 100 described in FIG. 2, and step S720 may be performed by the

residual processing units

115, 120, and 130. , S730 may be performed by the entropy encoding unit 190. Step S710 may include an inter/intra prediction procedure described in this document, step S720 may include a residual processing procedure described in this document, and step S730 includes an information encoding procedure described in this document. can do.

Referring to FIG. 7, the picture encoding procedure is not only a procedure of encoding information for picture restoration (eg, prediction information, residual information, partitioning information) schematically as described in FIG. 2 to output in a bitstream form, A procedure for generating a reconstructed picture for the current picture and a procedure for applying in-loop filtering to the reconstructed picture (optional) may be included. The encoding device 100 may derive (modified) residual samples from the quantized transform coefficients through the inverse quantization unit 140 and the inverse transform unit 150, and predictive samples corresponding to the output of step S710 and the ( A reconstructed picture may be generated based on the modified) residual samples. The reconstructed picture generated in this way may be the same as the reconstructed picture generated by the decoding apparatus 200 described above. A modified reconstructed picture can be generated through an in-loop filtering procedure for the reconstructed picture, which can be stored in the decoded picture buffer 170 or a memory, and, as in the case of the decoding device 200, subsequent picture encoding It can be used as a reference picture in a time inter prediction procedure. As described above, in some cases, some or all of the in-loop filtering procedure may be omitted. When the in-loop filtering procedure is performed, (in-loop) filtering-related information (parameters) may be encoded by the entropy encoding unit 190 and output in the form of a bitstream, and the decoding apparatus 200 The in-loop filtering procedure may be performed in the same manner as the encoding apparatus 100.

Through this in-loop filtering procedure, noise generated during video/video coding such as blocking artifacts and ringing artifacts can be reduced, and subjective/objective visual quality can be improved. In addition, by performing the in-loop filtering procedure in both the encoding device 100 and the decoding device 200, the encoding device 100 and the decoding device 200 can derive the same prediction result, and increase the reliability of picture coding. , It is possible to reduce the amount of data transmitted for picture coding.

8 shows an example of a flowchart for decoding a picture constituting a video signal according to an embodiment of the present specification. Operation S810 may be performed by the entropy decoding unit 210 in the decoding apparatus 200 of FIG. 3, operation S820 may be performed by the

prediction units

260 and 265, and operation S830 may be performed by the residual processing unit ( 220, 230), step S840 may be performed by the addition unit 235, step S850 may be performed by the filtering unit 240. Step S810 may include the information decoding procedure described in this document, step S820 may include the inter/intra prediction procedure described in this document, and step S830 includes the residual processing procedure described in this document. In addition, step S840 may include the block/picture restoration procedure described in this document, and step S850 may include the in-loop filtering procedure described in this document.

Referring to FIG. 8, the picture decoding procedure is schematically a procedure for obtaining image/video information (through decoding) from a bitstream (S810), a picture restoration procedure (S820 to S840), and a reconstructed picture as described in FIG. It may include an in-loop filtering procedure (S850) for. The picture restoration procedure is based on prediction samples and residual samples obtained through the process of inter/intra prediction (S820) and residual processing (S830, inverse quantization and inverse transformation of a quantized code or coefficient) described in this document. Can be done. A modified reconstructed picture may be generated through an in-loop filtering procedure for a reconstructed picture generated through a picture restoration procedure, and the modified reconstructed picture may be output as a decoded picture, and the decoding apparatus 200 It is stored in the decoded picture buffer 250 or a memory, and may be used as a reference picture in inter prediction when decoding a picture later. In some cases, the in-loop filtering procedure may be omitted. In this case, the reconstructed picture may be output as a decoded picture, and stored in the decoded picture buffer 250 of the decoding device 200 or in a memory to be It can be used as a reference picture in the prediction train. The in-loop filtering procedure S850 may include a deblocking filtering procedure, a sample adaptive offset (SAO) procedure, an adaptive loop filter (ALF) procedure, and/or a bi-lateral filter procedure as described above. And some or all of them may be omitted. In addition, one or some of the deblocking filtering procedure, the SAO procedure, the ALF procedure, and the bilateral filter procedure may be sequentially applied, or all may be sequentially applied. For example, after the deblocking filtering procedure is applied to the reconstructed picture, the SAO procedure may be performed. Also, for example, after the deblocking filtering procedure is applied to the reconstructed picture, the ALF procedure may be performed. This may be similarly performed in the encoding device 100.

As described above, not only the decoding apparatus 200 but also the encoding apparatus 100 may perform a picture restoration procedure. A reconstructed block may be generated based on intra prediction/inter prediction for each block, and a reconstructed picture including the reconstructed blocks may be generated. When the current picture/slice/tile group is an I picture/slice/tile group, blocks included in the current picture/slice/tile group may be reconstructed based only on intra prediction. In this case, inter prediction may be applied to some blocks in the current picture/slice/tile group, and intra prediction may be applied to the remaining some blocks. The color component of a picture may include a luminance component and a chrominance component, and the methods and embodiments proposed in this document may be applied to the luminance component and the chrominance component unless explicitly limited in this document.

Intra prediction

An embodiment of the present specification relates to an intra prediction method, and in the case of a decoder, the video/video decoding method based on intra prediction of FIG. 11 and the intra prediction unit 265 in the decoding apparatus 200 of FIG. 12 may be used. In addition, the encoder may be represented by an intra prediction-based video/spiritual encoding method of FIG. 9 and an intra prediction unit in the encoding apparatus 100 of FIG. 10. In this case, the data encoded by FIGS. 9 and 10 may be stored in the form of a bitstream.

Intra prediction may mean prediction in which prediction samples for a current block are generated based on reference samples in a picture to which the current block belongs (hereinafter, referred to as a current picture). When intra prediction is applied to the current block, surrounding reference samples to be used for intra prediction of the current block may be derived. The neighboring reference samples of the current block are a sample adjacent to the left boundary of the current block of size nWxnH and a total of 2xnH samples adjacent to the bottom-left, a sample adjacent to the top boundary of the current block, and A total of 2xnW samples adjacent to the top-right side and one sample adjacent to the top-left side of the current block may be included. Also, the peripheral reference samples of the current block may include upper peripheral samples of a plurality of columns and left peripheral samples of a plurality of rows. In addition, the neighboring reference samples of the current block are a total of nH samples adjacent to the right boundary of the current block of size nWxnH, a total of nW samples adjacent to the bottom boundary of the current block, and the lower right ( It may include one sample adjacent to the bottom-right).

However, some of the neighboring reference samples of the current block have not yet been decoded or may not be available. In this case, the decoder can construct surrounding reference samples to be used for prediction by substituting the samples that are not available with the available samples. Further, surrounding reference samples to be used for prediction may be constructed through interpolation of available samples.

When neighboring reference samples are derived, (i) prediction samples may be derived based on an average or interpolation of neighboring reference samples of the current block, and (ii) prediction among neighboring reference samples of the current block The prediction sample may be derived based on a reference sample existing in a specific (prediction) direction with respect to the sample. In the case of (i), it may be referred to as a non-directional mode or a non-angular mode, and in the case of (ii), it may be referred to as a directional mode or an angular mode. In addition, through interpolation between the second neighboring samples and the first neighboring samples located in the opposite direction to the prediction direction of the intra prediction mode of the current block based on the prediction sample (first neighboring sample) of the current block among neighboring reference samples. A prediction sample may be generated. The above-described case may be referred to as linear interpolation intra prediction (LIP). Also, chrominance prediction samples may be generated based on luminance samples using a linear model. This case may be referred to as an LM mode. In addition, a temporary prediction sample of the current block is derived based on the filtered surrounding reference samples, and at least one reference sample derived according to the intra prediction mode among existing surrounding reference samples, that is, unfiltered surrounding reference samples, and A prediction sample of the current block may be derived through a weighted sum of the temporary prediction samples. This case may be referred to as a position dependent prediction combination (PDPC).

In addition, the encoding apparatus 100 selects a reference sample line with the highest prediction accuracy among a plurality of reference sample lines located around the current block, and derives a prediction sample from the corresponding line using a reference sample located in the prediction direction. In this case, intra prediction encoding may be performed by indicating (signaling) the used reference sample line to the decoding apparatus 200. This case may be referred to as multi-reference line (MRL) intra prediction or MRL-based intra prediction. In addition, the encoder/decoder divides the current block into vertical or horizontal subpartitions and performs intra prediction based on the same intra prediction mode, but may derive and use surrounding reference samples in units of subpartitions. That is, in this case, the intra prediction mode for the current block is equally applied to the subpartitions, but the intra prediction performance can be improved in some cases by deriving and using the surrounding reference samples in units of the subpartition. This prediction method may be referred to as an ISP (intra sub-partition) or ISP-based intra prediction. The above-described intra prediction methods may be referred to as an intra prediction type to distinguish them from the existing intra prediction modes. The intra prediction type may be referred to in various terms such as an intra prediction technique or an additional intra prediction mode. For example, the intra prediction type (or additional intra prediction mode) may include at least one of the aforementioned LIP PDPC, MRL, and ISP. Meanwhile, post-processing filtering may be performed on the derived prediction samples as necessary.

Specifically, the intra prediction procedure may include determining an intra prediction mode/type, deriving a neighboring reference sample, and deriving an intra prediction mode/type based prediction sample. In addition, a post-processing filtering step may be performed on the derived prediction samples as necessary.

9 shows an example of a flowchart for intra prediction in a process of encoding a video signal according to an embodiment of the present specification, and FIG. 10 shows an example of an intra prediction unit in an encoding apparatus according to an embodiment of the present specification.

Operation S910 of FIG. 9 may be performed by the intra prediction unit 185 of the encoding apparatus 100, and operation S920 may be performed by the residual processing unit of the encoding apparatus 100. Specifically, step S920 may be performed by the subtraction unit 115 of the encoding device 100. In step S930, the prediction information may be derived by the intra prediction unit 185 and encoded by the entropy encoding unit 190. In step S930, the residual information may be derived by the residual processing unit and encoded by the entropy encoding unit 190. The residual information is information about residual samples. The residual information may include information on quantized transform coefficients for residual samples. As described above, residual samples may be derived as transform coefficients through the transform unit 120 of the encoding apparatus 100, and transform coefficients may be derived as quantized transform coefficients through the quantization unit 130. Information about the quantized transform coefficients may be encoded by the entropy encoding unit 190 through a residual coding procedure.

The encoding apparatus 100 performs intra prediction on the current block (S910). The encoding apparatus 100 may derive an intra prediction mode/type for the current block, derive neighboring reference samples of the current block, and generate prediction samples in the current block based on the intra prediction mode/type and neighboring reference samples. do. Here, the procedure of determining the intra prediction mode/type, deriving neighboring reference samples, and generating prediction samples may be simultaneously performed, or one procedure may be performed before the other procedure. For example, the intra prediction unit 185 of the encoding apparatus 100 may include an intra prediction mode/type determiner 186, a reference sample derivation unit 187, and a prediction sample derivation unit 188. The intra prediction mode/type determination unit 186 determines an intra prediction mode/type corresponding to the current block, the reference sample derivation unit 187 derives neighboring reference samples of the current block, and the prediction sample derivation unit 188 Predictive samples of the current block can be derived. Meanwhile, although not shown, when a prediction sample filtering procedure described later is performed, the intra prediction unit 185 may further include a prediction sample filter unit (not shown). The encoding apparatus 100 may determine a mode/type applied to the current block from among a plurality of intra prediction modes/types. The encoding apparatus 100 may compare rate-distortion (RD) costs for intra prediction modes/types and determine an optimal intra prediction mode/type for the current block.

Meanwhile, the encoding apparatus 100 may perform a prediction sample filtering procedure. Predictive sample filtering may be referred to as post filtering. Some or all of the prediction samples may be filtered by the prediction sample filtering procedure. In some cases, the prediction sample filtering procedure may be omitted.

The encoding apparatus 100 generates residual samples for the current block based on the (filtered) prediction samples (S920). The encoding apparatus 100 may compare prediction samples from original samples of a current block based on a phase and derive residual samples.

The encoding apparatus 100 may encode image information including information on intra prediction (prediction information) and residual information on residual samples (S930). The prediction information may include intra prediction mode information and intra prediction type information. The encoding apparatus 100 may output the encoded image information in the form of a bitstream. The output bitstream may be delivered to the decoding apparatus 200 through a storage medium or a network.

The residual information may include a residual coding syntax to be described later. The encoding apparatus 100 may derive quantized transform coefficients by transforming/quantizing residual samples. The residual information may include information on quantized transform coefficients.

Meanwhile, as described above, the encoding apparatus 100 may generate a reconstructed picture (including reconstructed samples and a reconstructed block). To this end, the encoding apparatus 100 may perform inverse quantization/inverse transformation on the quantized transform coefficients again to derive (modified) residual samples. The reason for performing inverse quantization/inverse transformation after transforming/quantizing the residual samples in this way is to derive residual samples identical to the residual samples derived from the decoding apparatus 200 as described above. The encoding apparatus 100 may generate a reconstructed block including reconstructed samples for the current block based on the prediction samples and (modified) residual samples. A reconstructed picture for the current picture may be generated based on the reconstructed block. As described above, the in-loop filtering procedure for the reconstructed picture may be further applied.

11 shows an example of a flowchart for intra prediction in a process of decoding a video signal according to an embodiment of the present specification, and FIG. 12 shows an example of an intra prediction unit in the decoding apparatus 200 according to the embodiment of the present specification. do. Steps S1110 to S1130 may be performed by the intra prediction unit 265 of the decoding apparatus 200, and the prediction information of step S1110 and the residual information of step S1140 are obtained from the bitstream by the entropy decoding unit 210 Can be. The residual processing unit of the decoding apparatus 200 may derive residual samples for the current block based on the residual information. Specifically, the inverse quantization unit 220 of the residual processing unit derives the transformation coefficients by performing inverse quantization based on the quantized transformation coefficients derived based on the residual information, and the inverse transformation unit 230 of the residual processing unit performs transformation. Residual samples for the current block can be derived by performing inverse transformation on the coefficients. Operation S1150 may be performed by the addition unit 235 or the restoration unit of the decoding apparatus 200.

In more detail, the decoding apparatus 200 may derive an intra prediction mode/type for the current block based on the received prediction information (intra prediction mode/type information) (S1110). The decoding apparatus 200 may derive neighboring reference samples of the current block (S1120). The decoding apparatus 200 generates prediction samples in the current block based on the intra prediction mode/type and surrounding reference samples (S1130). In this case, the decoding apparatus 200 may perform a prediction sample filtering procedure. Predictive sample filtering may be referred to as post filtering. Some of the prediction samples or the government may be filtered by the prediction sample filtering procedure. In some cases, the prediction sample filtering procedure may be omitted.

The decoding apparatus 200 generates residual samples for the current block based on the received residual information. The decoding apparatus 200 may generate a reconstructed sample for the current block based on the prediction samples and the residual samples, and derive a reconstructed block including the reconstructed samples (S1140). A reconstructed picture for the current picture may be generated based on the reconstructed block. As described above, the in-loop filtering procedure for the reconstructed picture may be further applied.

Here, the intra prediction unit 265 of the decoding apparatus 200 may include an intra prediction mode/type determination unit 266, a reference sample derivation unit 267, and a prediction sample derivation unit 268, and the intra prediction mode The /type determination unit 266 determines an intra prediction mode/type for the current block based on the intra prediction mode/type information generated and signaled by the intra prediction mode/type determination unit 186 of the encoding apparatus 100 , The reference sample derivation unit 267 may derive neighboring reference samples of the current block, and the prediction sample derivation unit 267 may derive prediction samples of the current block. Meanwhile, although not shown, when the above-described prediction sample filtering procedure is performed, the intra prediction unit 265 may further include a prediction sample filter unit (not shown).

Intra prediction mode information may include flag information (eg, intra_luma_mpm_flag) indicating whether, for example, most probable mode (MPM) is applied to a current block or a remaining mode is applied, MPM When applied to the current block, the prediction mode information may further include index information (eg, intra_luma_mpm_idx) indicating one of intra prediction mode candidates (MPM candidates). Intra prediction mode candidates (MPM candidates) may be composed of an MPM candidate list or an MPM list. In addition, when MPM is not applied to the current block, the intra prediction mode information may further include remaining mode information (eg, intra_luma_mpm_remainder) indicating one of the remaining intra prediction modes except for intra prediction mode candidates (MPM candidates). I can. The decoding apparatus 200 may determine an intra prediction mode of the current block based on the intra prediction mode information.

In addition, the intra prediction type information may be implemented in various forms. For example, the intra prediction type information may include intra prediction type index information indicating one of the intra prediction types. As another example, the intra prediction type information includes reference sample line information indicating whether the MRL is applied to the current block and the number of reference sample lines used when the MRL is applied (eg, intra_luma_ref_idx), and whether the ISP is applied to the current block. Indicating ISP flag information (e.g., intra_subpartitions_mode_flag), ISP type information indicating the split type of subpartitions when the ISP is applied (e.g., intra_subpartitions_split_flag), flag information indicating whether to apply PDPC, or indicating whether to apply LIP It may include at least one of flag information.

Intra prediction mode information and/or intra prediction type information may be encoded/decoded through the coding method described in this document. For example, intra prediction mode information and/or intra prediction type information may be encoded/decoded through entropy coding (eg, CABAC, CAVLC) based on a truncated (rice) binary code. have.

Intra prediction mode/type determination

When intra prediction is applied, an intra prediction mode applied to the current block may be determined using an intra prediction mode of a neighboring block. For example, the decoding apparatus 200 receives one of the MPM candidates in the MPM list derived based on the intra prediction mode of the neighboring block (eg, left and/or upper neighboring block) of the current block and additional candidate modes. It may be selected based on the index, or one of the remaining intra prediction modes that are not included in the MPM candidates may be selected based on the remaining intra prediction mode information. For example, whether the intra prediction mode applied to the current block is among MPM candidates or is in the remaining mode may be indicated based on an MPM flag (eg, intra_luma_mpm_flag). The value of the MPM flag of 1 indicates that the intra prediction mode for the current block is in the MPM candidates (MPM list), and the value of the MPM flag is 0 indicates that the intra prediction mode for the current block is in the MPM candidates (MPM list). May indicate that it does not exist. The MPM index may be signaled in the form of a syntax element such as mpm_idx or intra_luma_mpm_idx, and the remaining intra prediction mode information may be signaled in the form of a syntax element such as rem_intra_luma_pred_mode or intra_luma_mpm_remainder. For example, the remaining intra prediction mode information may index the remaining intra prediction modes that are not included in MPM candidates among all intra prediction modes and indicate one of them. The intra prediction mode may be an intra prediction mode for a luminance component (sample). Hereinafter, the intra prediction mode information may include at least one of an MPM flag (eg, intra_luma_mpm_flag), an MPM index (eg, mpm_idx or intra_luma_mpm_idx), or remaining intra prediction mode information (eg, rem_intra_luma_pred_mode or intra_luma_mpm_remainder). In this document, the MPM list may be referred to in various terms such as an MPM candidate list and candModeList. The intra prediction mode signaling procedure in the encoding apparatus 100 and the intra prediction mode determination procedure in the decoding apparatus 200 may be performed as shown in FIGS. 13 and 14.

Referring to FIG. 13, the encoding apparatus 100 constructs an MPM list for a current block (S1310). The MPM list may include candidate intra prediction modes (MPM candidates) that are likely to be applied to the current block. The MPM list may include intra prediction modes of neighboring blocks, or may further include specific intra prediction modes according to a predetermined method. A detailed MPM list construction method will be described later.

The encoding apparatus 100 determines an intra prediction mode of the current block (S1320). The encoding apparatus 100 may perform prediction based on various intra prediction modes, and may determine an optimal intra prediction mode based on rate-distortion optimization (RDO) based thereon. In this case, the encoding apparatus 100 may determine the optimal intra prediction mode by using only the MPM candidates configured in the MPM list, or by further using the remaining intra prediction modes as well as the MPM candidates configured in the MPM list. You can decide. As a more specific example, if the intra prediction type of the current block is a specific type (eg, LIP, MRL, or ISP), the encoding apparatus 100 considers only MPM candidates as intra prediction mode candidates for the current block, The prediction mode can be determined. That is, in this case, the intra prediction mode for the current block may be determined only among MPM candidates, and encoding/signaling of the MPM flag may not be performed. In this case, the decoding apparatus 200 may infer that the MPM flag is 1 without separately decoding the MPM flag.

Meanwhile, when the intra prediction mode of the current block is one of MPM candidates in the MPM list, the encoding apparatus 100 generates an MPM index (mpm_idx) indicating one of the MPM candidates. If the intra prediction mode of the current block is not in the MPM list, the encoding apparatus 100 remines intra prediction mode information indicating the same mode as the intra prediction mode of the current block among the remaining intra prediction modes not included in the MPM list. Create

The encoding apparatus 100 may encode intra prediction mode information and output it in the form of a bitstream. The intra prediction mode information may include the above-described MPM flag, MPM index, and/or remaining intra prediction mode information. Since the MPM index and the remaining intra prediction mode information indicate an intra prediction mode for one block in an alternative relationship, they are not signaled at the same time. That is, the MPM flag value 1 and the MPM index are signaled together, or the MPM flag 0 and the remaining intra prediction mode information are signaled together. However, as described above, when a specific intra prediction type is applied to the current block, the MPM flag may not be signaled and only the MPM index may be signaled. That is, in this case, the intra prediction mode information may include only the MPM index.

14 shows an example of a flowchart for decoding intra prediction information in a process of decoding a video signal according to an embodiment of the present specification. The decoding device 200 may determine an intra prediction mode in response to intra prediction mode information determined and signaled by the encoding device 100.

Referring to FIG. 14, the decoding apparatus 200 acquires intra prediction mode information from a bitstream (S1410). As described above, the intra prediction mode information may include at least one of an MPM flag, an MPM index, and a remaining intra prediction mode index.

The decoding apparatus 200 constructs an MPM list (S1420). The MPM list is configured in the same way as the MPM list configured in the encoding device 100. That is, the MPM list may include intra prediction modes of neighboring blocks, or may further include specific intra prediction modes according to a predetermined method. Specifically, the MPM list construction method will be described later.

Although it is shown in FIG. 14 that step S1420 is performed after step S1410, this is only an example, and step S1420 may be performed before step S1410 or may be performed simultaneously.

The decoding apparatus 200 determines an intra prediction mode of the current block based on the MPM list and intra prediction mode information (S1430). For example, when the value of the MPM flag is 1, the decoding apparatus 200 may derive a candidate indicated by the MPM index from among MPM candidates in the MPM list as the intra prediction mode of the current block. As another example, when the value of the MPM flag is 0, the decoding apparatus 200 derives an intra prediction mode indicated by the remaining intra prediction information from among the remaining intra prediction modes not included in the MPM list as the intra prediction mode of the current block. can do. Meanwhile, as another example, when the intra prediction type of the current block is a specific type (eg, LIP, MRL, or ISP), the decoding apparatus 200 selects a candidate indicated by the MPM index in the MPM list without checking the MPM flag. It can also be derived as the intra prediction mode of the current block. A detailed procedure for deriving an intra prediction mode as described above is shown in FIG. 15. 15 illustrates an example of a flowchart for determining an intra prediction mode in a process of decoding a video signal according to an embodiment of the present specification.

16 shows an example of 33 directional intra prediction modes according to an embodiment of the present specification, and FIG. 17 shows an example of 65 directional intra prediction modes according to an embodiment of the present specification.

Meanwhile, the intra prediction mode may include, for example, two non-directional intra prediction modes and 33 directional intra prediction modes. The non-directional intra prediction modes may include a planar intra prediction mode and a DC intra prediction mode, and the directional intra prediction modes may include 2 to 34 intra prediction modes. The planar intra prediction mode may be referred to as a planner mode, and the DC intra prediction mode may be referred to as a DC mode.

In addition, in order to capture an arbitrary edge direction presented in a natural image, directional intra prediction modes may be extended from 33 to 65 as shown in FIG. 17. In this case, the intra prediction mode may include two non-directional intra prediction modes and 65 directional intra prediction modes. The extended directional intra prediction modes can be applied to blocks of all sizes, and can be applied to both a luminance component and a color difference component.

In addition, the intra prediction mode may include two non-directional intra prediction modes and 129 directional intra prediction modes. Non-directional intra prediction modes may include a planar intra prediction mode and a DC intra prediction mode, and the directional intra prediction modes may include intra prediction modes 2 to 130.

Meanwhile, the intra prediction mode may further include a cross-component linear model (CCLM) mode for color difference samples in addition to the aforementioned intra prediction modes. The CCLM mode can be classified into LT_CCLM, L_CCLM, and T_CCLM depending on whether a left sample is considered, an upper sample is considered, or both are considered to derive an LM parameter, and can be applied only to a color difference component.

The intra prediction mode may be indexed, for example, as shown in Table 1 below.

Meanwhile, the intra prediction type (or additional intra prediction mode) may include at least one of the aforementioned LIP, PDPC, MRL, and ISP. The intra prediction type may be indicated based on intra prediction type information, and the intra prediction type information may be implemented in various forms. For example, the intra prediction type information may include intra prediction type index information indicating one of the intra prediction types. As another example, the intra prediction type information includes reference sample line information (e.g., intra_lumma_ref_idx) indicating whether MRL is applied to the current block and in which case the reference sample line is used, and when the ISP is applied, the split type of subpartitions It may include at least one of indicating ISP type information (eg, intra_subpartitions_split_flag), flag information indicating whether PDPC is applied, or flag information indicating whether LIP is applied.

MPM candidate list composition

When block division is performed on an image, a current block to be coded and a neighboring block are likely to have similar image characteristics. Therefore, it is highly likely that the current block and the neighboring block have the same or similar intra prediction modes. Accordingly, the encoder can use the intra prediction mode of the neighboring block to encode the intra prediction mode of the current block.

For example, the encoder/decoder may construct an MPM list for the current block. The MPM list may also be referred to as an MPM candidate list. Here, MPM may mean a mode used to improve coding efficiency in consideration of similarity between a current block and a neighboring block when coding an intra prediction mode. In this case, a method of configuring an MPM list including three MPM candidates may be used in order to keep the complexity for generating the MPM list low. For example, even when 67 intra prediction modes are used, the MPM list may include 3 MPM candidates. When the intra prediction mode for the current block is not included in the MPM list, a remanufacturing mode may be used. In this case, the remaining mode includes 64 remaining candidates, and information on the remaining intra prediction mode indicating one of the 64 remaining candidates may be signaled. For example, the remaining intra prediction mode information may include a 6-bit syntax element (eg, rem_intra_luma_pred_mode).

Three types of modes can be considered to construct the MPM list.

-Neighbor intra modes

-Derived intra modes

-Default intra modes

When the neighboring block is intra-coded, the encoder may check or derive the prediction mode of the neighboring block (S1810). For example, the encoder may determine the prediction mode of the current block based on the prediction mode of the left neighboring block and the prediction mode of the upper neighboring block, and at this time, the prediction mode of the corresponding neighboring block may be determined as MPM. Determining the MPM may be expressed as listing up MPM candidates (or MPM list).

The encoder checks whether the prediction mode of the left neighboring block and the prediction mode of the upper neighboring block are the same (S1820). The initial MPM list may be formed by performing a pruning process for intra prediction modes of two adjacent blocks.

If the prediction mode of the left neighboring block and the prediction mode of the upper neighboring block are not the same, the first MPM may be set as the prediction mode of the left neighboring block, and the second MPM may be determined as the prediction mode of the upper neighboring block. The MPM may be set to one of an intra planner mode, an intra DC mode, or an intra vertical mode (50th intra prediction mode) (S1830). Specifically, if the intra prediction modes of the two neighboring blocks are different from each other, the two intra prediction modes may be set as MPM, and one of the default intra modes is added to the MPM list after pruning check by MPMs. Can be. Here, the default intra modes may include an intra planner mode, an intra DC mode, and/or an intra vertical mode (50th intra prediction mode). For example, if the prediction mode of the left neighboring block is not the same as the prediction mode of the upper neighboring block, the MPM list may be configured as follows.

If A and B are not equal,

-If both A and B are not 0, candModeList [3] = {A, B, 0}.

-Otherwise (one of A and B is 0), if both A and B are not 1, candModeList [3] = {A, B, 1}.

-Otherwise (if A, B is 0, 1 or 1, 0), candModeList [3] = {A, B, 50}.

Here, A denotes an intra prediction mode of the left neighboring block, B denotes an intra prediction mode of an upper neighboring block, 0 denotes an intra planner mode, 1 denotes an intra DC mode, 50 denotes an intra vertical mode, and candModeList denotes an MPM list. have.

Meanwhile, when the prediction mode of the left neighboring block and the prediction mode of the upper neighboring block are the same, the encoder may determine whether the prediction mode of the left neighboring block is less than 2 (S1840).

If the prediction mode of the left neighboring block is less than 2, the first MPM may be set to an intra planner mode, the second MPM may be set to an intra DC mode, and the third MPM is an intra vertical mode (50th intra prediction mode). It may be set to (S1850).

On the other hand, when the prediction mode of the left neighboring block is not less than 2, the first MPM may be set as the prediction mode of the left neighboring block, the second MPM may be set to (prediction mode of the left neighboring block-1), and the third The MPM may be set to (prediction mode of the left neighboring block + 1) (S1860).

For example, when the prediction mode of the left neighboring block and the prediction mode of the upper neighboring block are the same, the MPM list may be configured as described later.

If the two neighboring candidate modes are the same (i.e. A == B),

-If A is less than 2, candModeList [3] = {0, 1, 50}.

-Otherwise (if A is greater than or equal to 2), candModeList[3] = (A, 2 + ((A + 61)% 64 ), 2 + ((A-1)% 64 )}

Meanwhile, an additional pruning process may be performed to remove duplicate modes so that only unique modes can be included. In addition, for entropy coding of 64 non-MPM modes excluding 3 MPMs, a 6-bit fixed length code (6-bit FLC) may be used. That is, an index representing 64 non-MPM modes may be entropy-coded with a 6-bit fixed length code.

In addition, the encoder may determine whether an optimal intra prediction mode to be applied to the current block belongs to the previously configured MPM candidate. If the intra prediction mode of the current block belongs to the MPM candidate, the encoder may encode the MPM flag and the MPM index. Here, the MPM flag may indicate whether the intra prediction mode of the current block is derived from a neighboring intra-prediction block (ie, whether the intra prediction mode of the current block belongs to the MPM list). In addition, the MPM index may indicate which MPM mode is applied as an intra prediction mode of the current block among MPM candidates. On the other hand, if the intra prediction mode of the current block does not belong to the MPM candidate, the encoder may encode the intra prediction mode of the current block.

Meanwhile, the encoder/decoder may configure an MPM list including 6 MPMs. In order to configure the MPM list, the following three types of modes can be considered.

-Neighbor intra modes

-Derived intra modes

-Default intra modes

As the peripheral intra modes, two neighboring blocks, that is, a left neighboring block A and an upper neighboring block B may be considered. In order to generate an MPM list including 6 MPMs, the following initialized default MPM list may be considered.

Default 6 MPM modes = {A, Planar (0) or DC (1), Vertical (50), HOR (18), VER-4 (46), VER + 4 (54)}

Thereafter, 6-MPMs are updated by performing a pruning process for two neighboring intra modes. If the two neighboring modes are the same and larger than the DC mode (1), 6-MPMs are added to the three default modes (A, planner, DC) and the neighboring mode, and a predefined offset value is added to the modular operation. It will contain three derived modes obtained by. Otherwise, if the two neighboring modes are different from each other, the two neighboring modes are allocated to the first two MPM modes and the remaining four MPM modes are derived from the default modes and neighboring modes. During the 6-MPM list creation process, pruning is used to remove identical modes so that unique modes can be included in the MPM list. For entropy coding of 61 non-MPM modes, a truncated binary code (TBC) is used.

Derive peripheral reference samples

As described above, when intra prediction is applied to the current block, neighboring reference samples to be used for intra prediction of the current block may be derived. The neighboring reference samples of the current block are a sample adjacent to the left boundary of the current block of size nWxnH and a total of 2xnH samples adjacent to the bottom-left, a sample adjacent to the top boundary of the current block, and A total of 2xnW samples adjacent to the top-right side and one sample adjacent to the top-left side of the current block may be included. Also, the peripheral reference samples of the current block may include upper peripheral samples of a plurality of columns and left peripheral samples of a plurality of rows.

Some of the neighboring reference samples of the current block have not yet been decoded or may not be available. The decoder may construct surrounding reference samples to be used for prediction through interpolation of available samples.

Some of the neighboring reference samples of the current block have not yet been decoded or may not be available. In this case, the decoder may construct surrounding reference samples to be used for prediction through extrapolation of available samples. Substitute or padding pixels that have not yet been decoded or available with the latest referenceable sample, updating the referenceable sample with the latest sample, starting at the bottom left and until reaching the top right reference sample. can do.

Intra prediction mode/type-based prediction sample derivation

Multiple reference line (MRL) intra prediction

In the conventional intra prediction, only neighboring samples of the upper first line and the neighboring samples of the left first line of the current block are used as reference samples for intra prediction. However, according to the MRL method, intra prediction may be performed by using as reference samples neighboring samples located in sample lines separated by 1 to 3 sample distances in the upper and/or left direction of the current block.

19 shows examples of reference samples taking into account multi-reference line (MRL) intra prediction according to an embodiment of the present specification. 19 shows directly neighboring (closest) reference samples at reference line 0 and extended reference samples at reference lines 1 to 3 used in MRL intra prediction. The MRL index (eg, mrl_idx) indicates which line is used for intra prediction for the current block.

For example, the MRL index may be signaled through the coding unit syntax as shown in Table 2 below. The MRL index may be signaled in the form of a syntax element intra_luma_ref_idx.

intra_luma_ref_idx [x0][y0] represents the intra reference line index IntraLumaRefLineIdx[x0][y0] defined as shown in Table 3 below.

If intra_luma_ref_idx[x0][y0] does not exist, its value is deduced as 0.

intra_luma_ref_idx may be referred to as a (intra) reference sample line index, a reference line index, or mrl_idx. Also, intra_luma_ref_idx may be referred to as intra_luma_ref_line_idx.

Table 3 below shows the values of IntraLumaRefLineIdx[x0][y0] according to intra_luma_ref_idx[x0][y0].

If intra_luma_mpm_flag[x0][y0] does not exist, its value is deduced as 1.

The MRL may be disabled for a block of the first line (row) in the CTU. This is to prevent samples of extended reference lines outside the current CTU line from being used. Also, when the above-described additional reference line is used, the PDPC may not be available.

ISP (Intra Sub-Partition) coding mode

In the conventional intra prediction, a block to be currently encoded is regarded as one coding unit, and coding is performed without splitting. However, the ISP method performs intra prediction encoding by dividing a block to be currently encoded in a horizontal direction or a vertical direction. In this case, a reconstructed block is generated by performing encoding/decoding in units of divided blocks, and the reconstructed block is used as a reference block of the next divided block. According to the ISP, blocks are divided as shown in Table 4 below based on the block size.

The ISP method determines an optimal mode by generating an MPM according to each division method (horizontal division and vertical division) in order to reduce coding complexity and comparing an appropriate prediction mode among prediction modes in the generated MPM list from an RDO perspective. In addition, when the above-described MRL intra prediction is used, the ISP may not be used. That is, ISP intra prediction can be applied only when the 0th reference line is used (that is, when intra_luma_ref_idx is 0). Also, when the ISP method is used, the PDPC cannot be used.

The ISP intra prediction method first encodes/decodes information indicating whether the ISP is applied (e.g., intra_subparitions_mode_flag) in block units, and if the ISP is applied to the current block, information about whether it is horizontal or vertical (intra_subpartitions_split_flag) is encoded. /Decoded. Table 5 below shows an example of the syntax structure reflecting the ISP.

When ISP intra prediction is applied, the intra prediction mode for the current block is equally applied to each subpartition (subblocks), and the intra prediction performance can be improved by deriving neighboring reference samples in units of subpartitions. That is, when ISP intra prediction is applied, a residual sample processing procedure is performed in units of sub-partitions. In other words, intra prediction samples are derived for each subpartition, and reconstructed samples are obtained by adding a residual signal (residual samples) for the corresponding subpartition to this. The residual signal (residual samples) may be derived through an inverse quantization/inverse transform procedure based on residual information (quantized transform coefficient information or residual coding syntax) in the above-described bitstream. That is, prediction samples for the first subpartition are derived and residual samples are derived, and reconstructed samples for the first subpartition may be derived based on this. In this case, when deriving prediction samples for the second subpartition, some of the reconstructed samples in the first subpartition (eg, left or upper peripheral reference samples of the second subpartition) are peripheral reference samples for the second subpartition. Can be used as Likewise, prediction samples for the second subpartition and residual samples may be derived, and reconstructed samples for the second subpartition may be derived based on this. In this case, when deriving prediction samples for the third subpartition, some of the reconstructed samples (eg, left or upper peripheral reference samples of the third subpartition) are used as peripheral reference samples for the third subpartition. Can be used.

Meanwhile, when a prediction sample of the current block is generated through interpolation of reference samples, an interpolation filter for interpolation may be derived through various methods. For example, the interpolation filter may be determined based on at least one of a size of a current block and an intra prediction mode applied to the current block. The interpolation filter may include, for example, a Gaussian filter and a Cubic filter.

After the intra prediction is performed, a filter (intra boundary filter) for mitigating a block boundary may be applied in order to reduce an error between prediction samples of the current block and neighboring samples that have already been reconstructed. For example, whether to apply an intra boundary filter and a filter type may be determined according to the predicted mode and the size of the block.

Derive prediction samples for color difference components

When intra prediction is performed on the current block, prediction of a luminance component block (luminance block) of the current block and prediction of a chrominance component block (color difference block) may be performed. In this case, The intra prediction mode may be set separately from the corresponding intra prediction mode in the luminance component (luminance block).

For example, the intra prediction mode for the color difference component may be indicated based on intra chroma prediction mode information, the intra chroma prediction mode information may be indicated in the form of a syntax element intra_chroma_pred_mode, and the intra chroma prediction mode information is a planar mode. , DC mode, vertical mode, horizontal mode, DM (Derived Mode), it may indicate one of the CCLM mode. Here, the planar mode may represent a 0th intra prediction mode, a DC mode 1st intra prediction mode, a vertical mode 26th intra prediction mode, and a horizontal mode 10th intra prediction mode. DM may also be referred to as direct mode. CCLM may be referred to as LM.

Meanwhile, DM and CCLM are dependent intra prediction modes for predicting a color difference block using information on a luminance block. The DM may represent a mode in which an intra prediction mode identical to an intra prediction mode for a luminance component is applied as an intra prediction mode for a color difference component. In addition, the CCLM subsamples the reconstructed samples of the luminance block in the process of generating the predictive samples for the color difference block, and then applies the CCLM parameters (α, β) to the subsampled samples. Intra prediction mode used as prediction samples of may be indicated.

Multiple direct modes for chroma intra coding

Multiple direct mode (MDM) can be applied to the current chroma block. In the multiple direct mode, the DM mode, which is an existing single mode, is extended and used in a plurality of modes. That is, when configuring the intra prediction mode of the color difference image, a plurality of DM modes may be selected as follows.

-In-screen prediction mode of the location of CR, TL, TR, BL, BR (see Fig. 21) of the same location luminance block

-In-screen prediction mode for L, A, BL, AR, and AL blocks that are neighboring blocks of the current color difference block

-PLANAR, DC mode

--1 or +1 angular mode to the previously selected angular mode

-Vertical, Horizontal, 2, 34, 66, 10, 26 mode (in case of 65 direction mode)

-If 5 prediction modes are not selected, copy the previously selected mode and select

Cross-component linear model

CCLM mode can be applied to the current chroma block. The CCLM mode is an intra prediction mode using correlation between a luminance block and a color difference block corresponding to the luminance block. According to the CCLM mode, a linear model may be derived based on surrounding samples of the luminance block and the surrounding samples of the chrominance block, and prediction samples of the chrominance block may be derived based on the linear model and reconstructed samples of the luminance block. More specifically, when the CCLM mode is applied to the current chrominance block, parameters for the linear model are derived based on the surrounding samples used for intra prediction of the current chrominance block and the surrounding samples used for intra prediction of the current luminance block. Can be. For example, the linear model may be expressed based on Equation 1 below.

Here, pred _c (i,j) represents a predicted sample of the (i,j) locus of the current color difference block, and rec _L '(i,j) represents a reconstructed sample of the (i,j) coordinates of the current luminance block. In addition, rec _L '(i,j) may represent a down-sampled reconstructed sample of the current luminance block.

Meanwhile, the parameters α and β of the linear model may be derived based on surrounding samples used for intra prediction of the current luminance block and surrounding samples used for intra prediction of the current color difference block. The parameters α and β may be derived based on

Equations

2 and 3 below.

Here, L(n) may represent upper peripheral samples and/or left peripheral samples of the current luminance block, and C(n) may represent upper peripheral samples and/or left peripheral samples of the current color difference block. Also, L(n) may represent down-sampled upper peripheral samples and/or left peripheral samples of the current luminance block. Further, N may represent a value that is twice the smaller of the width and height of the current color difference block.

Meanwhile, a total of 8 intra prediction modes may be allowed to code the chroma intra prediction mode. The 8 intra prediction modes may include 5 existing intra prediction modes and CCLM mode(s). Table 6 below shows a mapping table for deriving intra-chroma prediction mode when CCLM is not available (sps_cclm_enabled_flag is 0), and Table 7 shows intra prediction when CCLM is enabled (sps_cclm_enabled_flag is 1) Represents a mapping table for mode derivation. As shown in Tables 7 and 8, the intra-chroma prediction mode is an intra luma prediction mode and a signaled intra-chroma prediction mode for a luminance block (e.g., when DUAL_TREE is applied) covering a current block or a center-right lower sample of the chroma block It may be determined based on the value of (intra_chroma_pred_mode) information. The indices of IntraPredModeC[xCb][yCb] derived from Tables 7 and 8 may correspond to the indexes of the intra prediction modes of Table 1.

Example

Embodiments described below provide a method for constructing a unified MPM list according to. Embodiments of the present specification provide a method of generating (modifying) an MPM list using a unified method when constructing an MPM list in a process of encoding/decoding intra prediction information. Thus, in a process of encoding/decoding intra prediction information, a structure for encoding/decoding intra prediction information can be simplified and efficiency of encoding/decoding intra prediction information can be increased.

Embodiments described below provide a method of constructing an MPM list using a unified method for a plurality of intra prediction types (eg, MRL intra prediction, ISP intra prediction). Example 1 is, after generating an MPM list using a unified method, constructing an MPM list for each of conventional intra prediction (first type), MRL intra prediction (second type), and ISP intra prediction (third type) Provides a way. Embodiment 2 provides a method of generating an MPM list for MRL intra prediction and ISP intra prediction in consideration that a DC mode may be additionally used in MRL intra prediction after generating an MPM list using a unified method. Embodiment 3 provides a method for performing optimal encoding/decoding based on a method of constructing an MPM list using the unified method proposed in

Embodiments

1 and 2.

Embodiments of the present specification are a single unified method for generating an MPM candidate list used in conventional intra prediction (first type), MRL intra prediction (second type), and ISP intra prediction (third type). It should be done in a way. Conventional intra prediction uses 67 intra prediction modes to encode/decode intra prediction information, and MRL intra prediction uses 65 intra prediction modes excluding planar mode and DC mode to encode/decode intra prediction information. Perform. In addition, ISP intra prediction performs encoding/decoding of intra prediction information using 66 intra prediction modes excluding the DC mode. Since the three types of intra predictions perform encoding/decoding of intra prediction information using different numbers of intra prediction modes, methods of generating an MPM candidate list for each prediction are different.

More specifically, (conventional) intra prediction in which a reference sample located in a line adjacent to the current block is used and the current block is not divided by the ISP (hereinafter, first type intra prediction) is performed using all 67 intra prediction modes. An MPM candidate list including two MPM candidates is constructed. MRL intra prediction in which a reference sample located on a line separated by more than 2 samples from the current block is used (hereinafter, second type intra prediction) uses 65 intra prediction modes excluding planar mode and DC mode, so planar mode and DC mode An MPM candidate list having 6 MPM candidates is constructed using 65 intra prediction modes except for. Finally, a reference sample located in a line adjacent to the current block is used, and the ISP intra prediction (hereinafter, the third type intra prediction) in which the current block is divided by the ISP uses 66 intra prediction modes excluding the DC mode. An MPM candidate list having 6 MPM candidates is constructed by using the excluded 66 intra prediction modes. In this case, in the case of ISP intra prediction, an MPM candidate list is constructed in different ways according to horizontal division and vertical division. In this way, an MPM candidate list having six MPM candidates is generated through different methods for one intra prediction.

Accordingly, an embodiment of the present specification provides a method of generating an MPM candidate list using a unified method. Example 1 is, after generating an MPM list using a unified method, constructing an MPM list for each of conventional intra prediction (first type), MRL intra prediction (second type), and ISP intra prediction (third type) Provides a way. Embodiment 2 provides a method of generating an MPM list for MRL intra prediction and ISP intra prediction in consideration that a DC mode may be additionally used in MRL intra prediction after generating an MPM list using a unified method. Embodiment 3 provides a method for performing optimal encoding/decoding based on a method of constructing an MPM list using the unified method proposed in

Embodiments

1 and 2.

Example 1

The present embodiment provides a method for constructing each MPM list for conventional intra prediction, MRL intra prediction, and ISP intra prediction after generating an MPM candidate list using a unified method.

According to the present embodiment, a method of generating an MPM candidate list having 6 MPM candidates used in the first type intra prediction (conventional intra prediction) is divided into a second type intra prediction (MRL intra prediction) and a third type intra prediction ( The same applies to ISP intra prediction). In this case, a method of generating an MPM candidate list having six MPM candidate lists used in the first type intra prediction may be a conventional MPM candidate list generating method or an improved method from the conventional MPM candidate list. The method of generating the 6 MPM candidate lists used in the first type intra prediction includes a planar mode and a DC mode because the MPM candidate list is generated by considering all 67 intra prediction modes. However, since the second type intra prediction (MRL intra prediction) does not use the planar mode and the DC mode, and the third type intra prediction (ISP intra prediction) does not use the DC mode, an MPM candidate list is generated in consideration of this. I can.

The MPM candidate list construction method according to the present embodiment includes a method of generating an MPM candidate list having six MPM candidates used in the first type intra prediction (or a method of generating six MPM candidate lists improved through various improvement methods). An MPM candidate list having 6 MPM candidates is equally generated by applying the same to a method of generating an MPM candidate list of type 2 intra prediction and type 3 intra prediction. However, since the second type intra prediction (MRL intra prediction) does not use the planar mode and the DC mode, and the third type intra prediction (ISP intra prediction) does not use the DC mode, 6 candidates generated identically The MPM candidate list is changed to be suitable for the corresponding prediction type by removing a mode that is not used for each prediction type from the MPM candidate list having.

23A to 23C illustrate an example of a method of constructing an MPM candidate list based on an intra prediction type according to an embodiment of the present specification. FIG. 23A is a method for configuring an MPM candidate list according to a first type intra prediction (existing intra prediction), FIG. 23B is a method for configuring an MPM candidate list according to a second type intra prediction (MRL intra prediction), and FIG. 23C is a third type intra prediction. An example of a method of constructing an MPM candidate list according to prediction (ISP intra prediction) is shown, respectively.

In FIGS. 23A to 23C, a method of generating an MPM candidate list having six candidates used in the first type intra prediction is applied equally to the method of generating an MPM candidate list of the second type intra prediction and the ISP intra prediction.

In the case of the second type intra prediction, since the planar mode and the DC mode are not used, the MPM candidates in the MPM candidate list are rearranged after the planar mode and the DC mode are removed from the MPM candidate list having six candidates that are initially generated. do. 23B, the planner mode corresponding to the 0th MPM index and the DC mode corresponding to the 2nd MPM index are removed from the MPM candidate list, and the remaining 4 MPM candidates are rearranged to have 4 MPM candidates. A candidate list is constructed. In the case of the third type intra prediction, since the DC mode is not used, the MPM candidates are rearranged after the DC mode is removed from the initially generated MPM candidate list having 6 candidates. As shown in FIG. 23C, the DC mode corresponding to the second MPM index is removed from the MPM candidate list, and the remaining five MPM candidates are rearranged to form an MPM candidate having five MPM candidates.

23A to 23C are diagrams for explaining an example of a method for constructing an MPM candidate list, and a method according to an embodiment of the present specification includes 6 candidates according to a first type intra prediction (existing intra prediction). An MPM candidate list is generated, and the MPM candidate list is similarly used for the second type intra prediction (MRL intra prediction) and the third type intra prediction (ISP intra prediction). In this case, since the planar mode and the DC mode are not used in the case of the second type intra prediction (MRL intra prediction), if there are planar mode and DC mode in the initially generated MPM candidate list, the MPM candidate Rearrange the list. The planar mode and the DC mode are removed and the rearranged MPM candidate list may be used for a block to which the second type intra prediction is applied. In addition, since the DC mode is not used in the case of the third type intra prediction (ISP intra prediction), if the DC mode is included in the initially generated MPM candidate list, the MPM candidate list is rearranged while removing the DC mode. The DC mode is removed and the rearranged MPM candidate list may be used for a block to which the third type intra prediction is applied.

Example 2

In the present embodiment, after generating an MPM candidate list using a unified method, the DC mode is enabled in the second type intra prediction (MRL intra prediction), and in consideration of this, the first type intra prediction (the existing intra prediction ), a second type intra prediction (MRL intra prediction), and a method of generating an MPM candidate list for a third type intra prediction (ISP intra prediction). In Example 2, compared to Example 1, in the second type intra prediction, a DC mode is added as a usable mode, and an MPM candidate list is generated in consideration of this.

According to the present embodiment, the method of generating an MPM candidate list having 6 MPM candidates used in the first type intra prediction is equally applied to the second type intra prediction and the third type intra prediction. In this case, a method of generating an MPM candidate list having six MPM candidate lists used in the first type intra prediction may be a conventional MPM candidate list generating method or an improved method from the conventional MPM candidate list. Unlike the first embodiment, since the DC mode can be used for the second type intra prediction, the second type intra prediction does not use the planar mode, and the third type intra prediction does not use the DC mode. In the method according to the present embodiment, each MPM candidate list is constructed (changed) in consideration of this.

The method according to the present embodiment is a second method of generating an MPM candidate list having six candidates used in the first type intra prediction (or a method of generating an MPM candidate list having six candidates improved through various improvement methods). An MPM candidate list having the same 6 candidates is generated by applying the same to a method of generating an MPM candidate list for type intra prediction and third type intra prediction. Since the 1st type intra prediction does not use the planar mode and the 2nd type intra prediction does not use the DC mode, it is suitable for the corresponding prediction method by removing the mode not used in each prediction method from the 6 MPM lists generated identically. Reorganize (change) the MPM candidate list to do so.

24A to 24C illustrate another example of a method of constructing an MPM candidate list based on an intra prediction type according to an embodiment of the present specification. FIG. 24A is a method for configuring an MPM candidate list according to a first type intra prediction (existing intra prediction), FIG. 24B is a method for configuring an MPM candidate list according to a second type intra prediction (MRL intra prediction), and FIG. 24C is a third type intra prediction. An example of a method of constructing an MPM candidate list according to prediction (ISP intra prediction) is shown, respectively.

As shown in FIGS. 24A to 24C, the method of generating an MPM candidate list having 6 candidates used in the first type intra prediction (conventional intra prediction) is the second type intra prediction (MRL intra prediction) and the third type. The same applies to the method of generating an MPM candidate list for intra prediction (ISP intra prediction).

In the case of the second type intra prediction (MRL intra prediction), since the DC mode can be used, only the planar mode is not used. Therefore, the planner mode is removed in the MPM candidate list having 6 candidates initially generated, and the MPM candidates in the MPM candidate list are rearranged. As shown in FIG. 24B, the planar mode corresponding to the 0th MPM index is removed, and the remaining MPM candidates are rearranged to form an MPM candidate list having 5 MPM candidates.

In the case of the third type intra prediction (ISP intra prediction), the DC mode is not used. Accordingly, after the DC mode is removed from the MPM list having 6 candidates initially generated, the MPM candidates in the MPM candidate list are rearranged. As shown in FIG. 24C, the DC mode corresponding to the second MPM index is removed and the remaining MPM candidates are rearranged, thereby constructing an MPM list having five MPM candidates.

Example 3

Based on the method of generating an MPM candidate list using the unified method proposed in

Embodiments

1 and 2, this embodiment provides a method of performing encoder optimization.

When generating an MPM candidate list in the existing third type intra prediction (ISP intra prediction), different MPM candidate lists are generated according to the division type (horizontal division or vertical division) of the current block. That is, the MPM candidate list for horizontal division and the MPM candidate list for vertical division are generated differently (separately). As the optimal intra prediction mode for the current block, candidate modes generated from the first type intra prediction (existing intra prediction), candidate modes selected from the MPM candidate list generated for horizontal division, and vertical division The mode with the lowest cost is selected from the viewpoint of rate-distortion optimization (RDO) of candidate modes selected in the generated MPM candidate list. Therefore, in order to calculate the cost of the third type intra prediction (ISP intra prediction), the encoder always had to generate an MPM candidate list for horizontal division and an MPM candidate list for vertical division, respectively. Thus, the encoder had to generate two MPM candidate lists for a block to which the third type intra prediction (ISP intra prediction) is applied, and to allocate two buffers for this. This increases the computational complexity of the encoder and increases the hardware size of the encoder. Therefore, this embodiment provides a method of performing encoder optimization based on a method of generating an MPM candidate list using the unified method proposed in

Embodiments

1 and 2. In addition, Embodiment 3 can be applied to a decoder, and the computational complexity and hardware size of the decoder can be reduced by using a method of generating a unified MPM candidate list.

The method of constructing a unified MPM candidate list proposed in

Embodiments

1 and 2 is, when generating an MPM candidate list for a third type intra prediction (ISP intra prediction), the current block division type (horizontal division or vertical division) Splitting) is not considered and one MPM candidate list is generated using a unified MPM candidate list generation method. That is, as shown in FIGS. 23A to 24C, the encoder/decoder creates one unified MPM list regardless of the division type of the current block. Therefore, in comparison with the method of generating each MPM candidate list in consideration of the partition type of the current block, according to the method proposed in this embodiment, the encoder/decoder is a block to which the third type intra prediction (ISP intra prediction) is applied. A single MPM candidate list is generated for and for this purpose, one buffer is allocated. As an optimal intra prediction mode derived based on the proposed method, candidate modes generated from a first type intra prediction (conventional intra prediction) and one generated for a third type intra prediction (ISP intra prediction) For horizontal division and vertical division for candidate modes in the MPM candidate list, the mode with the lowest cost is selected from the viewpoint of RDO, respectively. In the method proposed in this embodiment, when generating an MPM candidate list for third type intra prediction (ISP intra prediction), since only one MPM candidate list is generated regardless of the partition type, the complexity of the encoder required for MPM generation is reduced. Also, since only one buffer is used for the MPM candidate list, the hardware size of the encoder can be reduced.

The method proposed in the embodiments of the present specification may simplify the encoding/decoding structure for intra prediction by using a unified method in the process of constructing an MPM candidate list. In addition, it is possible to increase the encoding/decoding performance of a video signal by increasing the intra mode encoding/decoding efficiency.

Bitstream

The encoded information (eg, encoded video/video information) derived by the encoding apparatus 100 based on the above-described embodiments of the present specification may be output in a bitstream form. The encoded information may be transmitted or stored in a bitstream form in units of network abstraction layer (NAL) units. The bitstream may be transmitted over a network or may be stored in a non-transitory digital storage medium. In addition, as described above, the bitstream is not directly transmitted from the encoding device 100 to the decoding device 200, but may be provided with a streaming/download service through an external server (eg, a content streaming server). Here, the network may include a broadcasting network and/or a communication network, and the digital storage medium may include various storage media such as USB, SD, CD, DVD, Blu-ray, HDD, and SSD.

25 illustrates an example of a flowchart for intra prediction in an encoding process of a video signal according to an embodiment of the present specification. The operations of FIG. 25 may be performed by the encoding device 100 or the video signal processing device 500. More specifically, it may be performed by the intra prediction unit 185 (intra prediction mode/type determination unit 186 of FIG. 10) in the encoding apparatus 100 of FIG. 25, and the video signal processing apparatus 500 It can be performed by the processor 510 of. In addition, steps S2510 to S2530 of FIG. 25 may correspond to an example of step S910 of FIG. 9, and step S2540 of FIG. 25 may correspond to an example of step S930 of FIG. 9.

In step S2510, the encoder generates an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block. For example, the encoder generates an MPM candidate list based on the intra prediction mode of the left neighboring block and the upper neighboring block of the current block. Here, the encoder generates a single MPM candidate list regardless of the intra prediction type of the current block (general intra prediction, MRL intra prediction, and ISP intra prediction). In addition, when ISP intra prediction is applied, the encoder may generate the same MPM candidate list regardless of the ISP division direction (vertical direction, horizontal direction).

In step S2520, the encoder changes the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type. That is, with respect to a single MPM candidate list generated regardless of the intra prediction type, the encoder checks whether or not an unused mode exists for each intra prediction type. If there is a mode that cannot be used in the corresponding intra prediction, the mode is removed from the MPM candidate list. Prior to or concurrently with step S2520, the encoder may determine the intra prediction type of the current block.

In one embodiment, the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided (existing intra prediction), and a reference sample located in a line separated by 2 samples distance or more from the current block. This may correspond to one of the used second type (MRL intra prediction) or the third type (ISP intra prediction) in which the current block is divided by the ISP using a reference sample located in a line adjacent to the current block.

In an embodiment, if the intra prediction type corresponds to the second type (MRL intra prediction), the planar mode and the DC mode may be removed from the MPM candidate list. As described in the first embodiment, since the planar mode and the DC mode cannot be used for the second type intra prediction (MRL intra prediction), the encoder may remove the planar mode and the DC mode from the MPM candidate list. For example, as shown in FIG. 23B, the encoder may reconstruct (change) the MPM candidate list by rearranging the remaining modes after removing the planar mode and the DC mode from the MPM candidate list.

In an embodiment, if the intra prediction type corresponds to the third type (ISP intra prediction), the DC mode may be removed from the MPM candidate list. As described in the first embodiment, since the DC mode cannot be used in the third type intra prediction (ISP intra prediction), the encoder can remove the DC mode from the MPM candidate list. For example, as shown in FIG. 23C, the encoder may reconstruct (change) the MPM candidate list by rearranging the remaining modes after removing the DC mode from the MPM candidate list.

In an embodiment, if the intra prediction type corresponds to the second type (MRL intra prediction), the planner mode may be removed from the MPM candidate list. As described in the second embodiment, in the second type intra prediction (MRL intra prediction), the DC mode may be available and the planar mode may not be used. In consideration of this, the encoder may remove the planar mode from the MPM candidate list. For example, as shown in FIG. 24B, the encoder may reconfigure (change) the MPM candidate list by rearranging the remaining modes while removing the planar mode from the MPM candidate list.

In step S2530, the encoder determines an MPM index related to the intra prediction mode of the current block derived based on the rate-distortion cost from the MPM candidate list. The encoder may determine an optimal intra prediction mode from the MPM candidate list in consideration of rate-distortion cost and determine an MPM index corresponding to the optimal intra prediction mode.

In step S2540, the encoder encodes intra prediction information including information on an MPM index and an intra prediction type. In addition, the information on the intra prediction type may further include a reference line index (eg, ref_idx) indicating the location of the reference sample and information indicating whether to divide the ISP.

In an embodiment, if the intra prediction type corresponds to the third type (ISP intra prediction), the intra prediction information may further include ISP direction information related to the division direction of the current block. When the second type of intra prediction (ISP intra prediction) is applied, the current block may be divided in a horizontal direction or a vertical direction, such as 20a and 20b. In this case, the encoder may equally construct one MPM candidate list regardless of the division direction, and determine an intra prediction mode as an optimal mode (a mode having a smaller RD cost) among prediction modes determined according to each division direction. That is, the intra prediction mode may be a mode having a lower rate-distortion cost among modes determined for horizontal division and vertical division in the MPM candidate list.

26 shows an example of a flowchart for intra prediction in a process of decoding a video signal according to an embodiment of the present specification. The operations of FIG. 26 may be performed by the decoding apparatus 200 or the video signal processing apparatus 500. More specifically, the operations of FIG. 26 may be performed by the intra prediction unit 265 (intra prediction mode/type determination unit 266 of FIG. 10) in the decoding apparatus 200, and further, the video signal processing apparatus ( 500) may be performed by the processor 510. In addition, steps S2610 to S2640 of FIG. 26 may correspond to an example of step S1110 of FIG. 11, and step S2650 may correspond to an example of step S1130 of FIG. 11.

In step S2610, the decoder acquires intra prediction information of a current block to which intra prediction is applied. Here, the intra prediction information includes information on an intra prediction type of the current block and an MPM index. The information on the intra prediction type may further include a reference line index (eg, ref_idx) indicating the location of the reference sample and information indicating whether to divide the ISP. If the intra prediction type corresponds to the third type (ISP intra prediction), the intra prediction information may further include ISP direction information related to the division direction of the current block.

In step S2620, the decoder generates an MPM candidate list based on the prediction mode of at least one neighboring block adjacent to the current block. For example, the decoder generates an MPM candidate list based on the intra prediction mode of the left neighboring block and the upper neighboring block of the current block. Here, the decoder generates a single MPM candidate list regardless of the intra prediction type of the current block (general intra prediction, MRL intra prediction, and ISP intra prediction). In addition, when ISP intra prediction is applied, the decoder can generate the same MPM candidate list regardless of the ISP division direction (vertical direction, horizontal direction).

In step S2630, the decoder changes the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type. That is, with respect to a single MPM candidate list generated regardless of the intra prediction type, the decoder checks whether or not an unused mode exists for each intra prediction type. If there is a mode that cannot be used in the corresponding intra prediction, the mode is removed from the MPM candidate list.

In one embodiment, the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided (existing intra prediction), and a reference sample located in a line separated by 2 samples distance or more from the current block This may correspond to one of the used second type (MRL intra prediction) or the third type (ISP intra prediction) in which the current block is divided by the ISP using a reference sample located in a line adjacent to the current block.

In an embodiment, if the intra prediction type corresponds to the second type (MRL intra prediction), the planar mode and the DC mode may be removed from the MPM candidate list. As described in the first embodiment, since the planar mode and the DC mode cannot be used for the second type intra prediction (MRL intra prediction), the decoder can remove the planar mode and the DC mode from the MPM candidate list. For example, as shown in FIG. 23B, the decoder may reconstruct (change) the MPM candidate list by rearranging the remaining modes after removing the planar mode and the DC mode from the MPM candidate list.

In an embodiment, if the intra prediction type corresponds to the third type (ISP intra prediction), the DC mode may be removed from the MPM candidate list. As described in the first embodiment, since the DC mode cannot be used in the third type intra prediction (ISP intra prediction), the decoder can remove the DC mode from the MPM candidate list. For example, as shown in FIG. 23C, the decoder may reconstruct (change) the MPM candidate list by rearranging the remaining modes after removing the DC mode from the MPM candidate list.

In an embodiment, if the intra prediction type corresponds to the second type (MRL intra prediction), the planner mode may be removed from the MPM candidate list. As described in the second embodiment, in the second type intra prediction (MRL intra prediction), the DC mode may be available and the planar mode may not be used. In consideration of this, the decoder may remove the planar mode from the MPM candidate list. For example, as shown in FIG. 24B, the decoder may reconfigure (change) the MPM candidate list by rearranging the remaining modes while removing the planar mode from the MPM candidate list.

In step S2640, the decoder determines an intra prediction mode related to the MPM index from the MPM candidate list. The decoder may determine an MPM candidate (prediction mode) corresponding to the MPM index from the MPM candidate list reconstructed in consideration of the intra prediction type after being generated singly as the intra prediction mode of the current block.

In step S2650, the decoder generates a prediction sample of the current block based on the intra prediction mode and the reference sample in the current picture.

Further, the processing method to which the present invention is applied may be produced in the form of a program executed by a computer, and may be stored in a computer-readable recording medium. Multimedia data having a data structure according to the present invention can also be stored in a computer-readable recording medium. The computer-readable recording medium includes all kinds of storage devices and distributed storage devices in which computer-readable data is stored. The computer-readable recording medium includes, for example, Blu-ray disk (BD), universal serial bus (USB), ROM, PROM, EPROM, EEPROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical It may include a data storage device. Further, the computer-readable recording medium includes media implemented in the form of a carrier wave (for example, transmission through the Internet). In addition, the bitstream generated by the encoding method may be stored in a computer-readable recording medium or transmitted through a wired or wireless communication network.

In addition, an embodiment of the present invention may be implemented as a computer program product using a program code, and the program code may be executed in a computer according to the embodiment of the present invention. The program code may be stored on a carrier readable by a computer.

A non-transitory computer-readable medium according to an embodiment of the present specification stores one or more instructions executed by one or more processors. The one or more instructions generate a most probable mode (MPM) candidate list based on a prediction mode of at least one neighboring block adjacent to a current block for encoding a video signal, and the intra prediction type of the current block Change the MPM candidate list by removing at least one mode from the MPM candidate list based on the MPM candidate list, determine an MPM index related to the intra prediction mode of the current block derived based on a rate-distortion cost from the MPM candidate list, and , The video signal processing apparatus 500 (encoding apparatus 100) is controlled to encode intra prediction information including information on the MPM index and the intra prediction type.

The instructions according to an embodiment of the present specification acquire intra prediction information of a current block to which the intra prediction is applied, for decoding a video signal, wherein the intra prediction information includes information on an intra prediction type of the current block and The MPM includes an MPM index, generates an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block, and removes at least one mode from the MPM candidate list based on the intra prediction type. A video signal processing apparatus to change a candidate list, determine an intra prediction mode related to the MPM index from the MPM candidate list, and generate a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture ( 500) (encoding device 100) is controlled.

As described above, the embodiments described in the present invention may be implemented and performed on a processor, microprocessor, controller, or chip. For example, the functional units illustrated in each drawing may be implemented and executed on a computer, processor, microprocessor, controller, or chip.

In addition, the decoder and encoder to which the present invention is applied include a multimedia broadcasting transmission/reception device, a mobile communication terminal, a home cinema video device, a digital cinema video device, a surveillance camera, a video chat device, a real-time communication device such as video communication, a mobile streaming device, Storage media, camcorders, video-on-demand (VoD) service providers, OTT video (Over the top video) devices, Internet streaming service providers, three-dimensional (3D) video devices, video telephony video devices, and medical video devices. And can be used to process video signals or data signals. For example, an OTT video (Over the top video) device may include a game console, a Blu-ray player, an Internet-connected TV, a home theater system, a smartphone, a tablet PC, and a digital video recorder (DVR).

The embodiments described above are those in which components and features of the present invention are combined in a predetermined form. Each component or feature should be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form that is not combined with other components or features. In addition, it is also possible to constitute an embodiment of the present invention by combining some components and/or features. The order of operations described in the embodiments of the present invention may be changed. Some configurations or features of one embodiment may be included in other embodiments, or may be replaced with corresponding configurations or features of other embodiments. It is obvious that the embodiments may be configured by combining claims that do not have an explicit citation relationship in the claims or may be included as new claims by amendment after filing.

The embodiment according to the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of implementation by hardware, an embodiment of the present invention is one or more ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs ( field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, etc.

In the case of implementation by firmware or software, an embodiment of the present invention may be implemented in the form of a module, procedure, or function that performs the functions or operations described above. The software code can be stored in a memory and driven by a processor. The memory may be located inside or outside the processor, and may exchange data with the processor through various known means.

It is obvious to those skilled in the art that the present invention can be embodied in other specific forms without departing from the essential features of the present invention. Therefore, the above detailed description should not be construed as restrictive in all respects, but should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Above, preferred embodiments of the present invention described above are disclosed for the purpose of illustration, and those skilled in the art improve and change various other embodiments within the technical spirit and scope of the present invention disclosed in the appended claims below. , Substitution or addition may be possible.

Claims

A video signal encoding method for intra prediction, comprising:

Generating a most probable mode (MPM) candidate list based on a prediction mode of at least one neighboring block adjacent to the current block; and

Changing the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type of the current block; and

Determining an MPM index related to an intra prediction mode of the current block derived based on a rate-distortion rate from the MPM candidate list; and

And encoding intra prediction information including information on the MPM index and the intra prediction type.
The method of claim 1,

The intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used and the current block is not divided, and a second type in which a reference sample located in a line spaced apart from the current block by at least 2 samples is used. Or a reference sample located in a line adjacent to the current block is used, and the current block corresponds to one of a third type in which the current block is divided by an intra sub-partition (ISP).
The method of claim 2,

When the intra prediction type corresponds to the second type, the planar mode and the DC mode are removed from the MPM candidate list.
The method of claim 2,

If the intra prediction type corresponds to the third type,

The encoding method, characterized in that the DC mode is removed from the MPM candidate list.
The method of claim 2,

When the intra prediction type corresponds to the second type, a planar mode is removed from the MPM candidate list.
The method of claim 1,

The intra prediction information,

If the intra prediction type corresponds to a third type, ISP direction information related to a division direction of the current block is further included,

The intra prediction mode is a mode having a lower rate-distortion cost among modes determined for horizontal division and vertical division in the MPM candidate list.
A method for decoding a video signal for intra prediction, comprising:

Obtaining intra prediction information of a current block to which the intra prediction is applied, wherein the intra prediction information includes information on an intra prediction type of the current block and a most probable mode (MPM) index,

Generating an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block; and

Changing the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type;

Determining an intra prediction mode related to the MPM index from the MPM candidate list;

And generating a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture.
The method of claim 7,

The intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used and the current block is not divided, and a second type in which a reference sample located in a line spaced apart from the current block by at least 2 samples is used. Or a reference sample located in a line adjacent to the current block is used, and the current block corresponds to one of a third type in which the current block is divided by an intra sub-partition (ISP).
The method of claim 8,

When the intra prediction type corresponds to the second type, the planar mode and the DC mode are removed from the MPM candidate list.
The method of claim 8,

When the intra prediction type corresponds to the third type, the DC mode is removed from the MPM candidate list.
The method of claim 8,

When the intra prediction type corresponds to the second type, a planar mode is removed from the MPM candidate list.
The method of claim 7,

The intra prediction information,

If the intra prediction type corresponds to the third type, the decoding method further comprises ISP direction information related to the division direction of the current block.
An apparatus for encoding a video signal for intra prediction, comprising:

A memory for storing the video signal;

A processor coupled to the memory and processing the video signal,

The processor,

Generates a most probable mode (MPM) candidate list based on a prediction mode of at least one neighboring block adjacent to the current block,

Change the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type of the current block,

Determine an MPM index related to an intra prediction mode of the current block derived based on a rate-distortion rate from the MPM candidate list,

The encoding apparatus according to claim 1, wherein the encoding apparatus is configured to encode intra prediction information including information on the MPM index and the intra prediction type.
A video signal decoding apparatus for intra prediction, comprising:

A memory for storing the video signal;

A processor coupled to the memory and processing the video signal,

The processor,

Obtaining intra prediction information of a current block to which the intra prediction is applied, wherein the intra prediction information includes information on an intra prediction type of the current block and a most probable mode (MPM) index,

Generate an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block,

Change the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type,

Determine an intra prediction mode related to the MPM index from the MPM candidate list,

And a decoding apparatus configured to generate a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture.
As a non-transitory computer-readable medium storing one or more instructions, the one or more instructions executed by one or more processors,

Acquire intra prediction information of a current block, wherein the intra prediction information includes information on an intra prediction type of the current block and a most probable mode (MPM) index,

Generate an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block,

Change the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type,

Determine an intra prediction mode related to the MPM index from the MPM candidate list,

And controlling a video signal processing apparatus to generate a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture.