WO2020171673A1 - Procédé et appareil de traitement de signal vidéo pour prédiction intra - Google Patents

Procédé et appareil de traitement de signal vidéo pour prédiction intra Download PDF

Info

Publication number
WO2020171673A1
WO2020171673A1 PCT/KR2020/002635 KR2020002635W WO2020171673A1 WO 2020171673 A1 WO2020171673 A1 WO 2020171673A1 KR 2020002635 W KR2020002635 W KR 2020002635W WO 2020171673 A1 WO2020171673 A1 WO 2020171673A1
Authority
WO
WIPO (PCT)
Prior art keywords
intra prediction
mode
mpm
current block
candidate list
Prior art date
Application number
PCT/KR2020/002635
Other languages
English (en)
Korean (ko)
Inventor
허진
유선미
이령
최장원
최정아
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Publication of WO2020171673A1 publication Critical patent/WO2020171673A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • Embodiments of the present specification relate to a video/video compression coding system, and more particularly, to a method and apparatus for performing intra prediction in an encoding/decoding process of a video signal.
  • Compression coding refers to a series of signal processing techniques for transmitting digitized information through a communication line or storing it in a format suitable for a storage medium.
  • Media such as video, image, and audio may be subject to compression encoding.
  • a technique for performing compression encoding on an image is referred to as video image compression.
  • Next-generation video content will be characterized by high spatial resolution, high frame rate, and high dimensionality of scene representation. In order to process such content, it will bring a tremendous increase in terms of memory storage, memory access rate, and processing power.
  • Intra prediction is a method of performing prediction by referring to reconstructed samples around a current block to be encoded/decoded in a current picture.
  • a new intra prediction method and addition/extension of an intra prediction mode are being discussed.
  • An embodiment of the present specification provides a method and apparatus for reducing the amount of data and processing time required for constructing a most probable (MPM) candidate list in a process of encoding/decoding information for intra prediction.
  • MPM most probable
  • Embodiments of the present specification provide a method and apparatus for processing a video signal for intra prediction.
  • a video signal encoding method includes generating a most probable mode (MPM) candidate list based on a prediction mode of at least one neighboring block adjacent to a current block, and based on the intra prediction type. Changing the MPM candidate list by removing at least one mode from the MPM candidate list; and an intra prediction mode of the current block derived based on a rate-distortion rate from the MPM candidate list; and Determining a related MPM index, and encoding intra prediction information including information on the MPM index and the intra prediction type.
  • MPM most probable mode
  • the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided, and a reference sample located in a line separated by 2 sample distances or more from the current block. It may correspond to one of the used second type or a third type in which the reference sample located in a line adjacent to the current block is used and the current block is divided by an intra subpartition.
  • the planar mode and the DC mode may be removed from the MPM candidate list.
  • the DC mode when the intra prediction type corresponds to the third type, the DC mode may be removed from the MPM candidate list.
  • the planar mode may be removed from the MPM candidate list.
  • the intra prediction information further includes ISP direction information related to a division direction of the current block when the intra prediction type corresponds to a third type, and the intra prediction mode is horizontal direction division in the MPM candidate list. It may be a mode having a smaller rate-distortion cost among the modes determined for the and vertical division.
  • a method of decoding a video signal includes obtaining intra prediction information of a current block to which the intra prediction is applied, wherein the intra prediction information includes information on an intra prediction type of the current block and MPM Including an index, generating an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block, and by removing at least one mode from the MPM candidate list based on the intra prediction type.
  • Changing an MPM candidate list, determining an intra prediction mode related to the MPM index from the MPM candidate list, and generating a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture Includes steps.
  • the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided, and a reference sample located in a line separated by 2 sample distances or more from the current block. It may correspond to one of the used second type or a third type in which the reference sample located in a line adjacent to the current block is used and the current block is divided by an intra subpartition.
  • the planar mode and the DC mode may be removed from the MPM candidate list.
  • the DC mode when the intra prediction type corresponds to the third type, the DC mode may be removed from the MPM candidate list.
  • the planar mode may be removed from the MPM candidate list.
  • the intra prediction information may further include ISP direction information related to a division direction of the current block when the intra prediction type corresponds to a third type.
  • An encoding apparatus includes a memory for storing the video signal, and a processor coupled to the memory and processing the video signal.
  • the processor generates an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to a current block, and removes at least one mode from the MPM candidate list based on an intra prediction type of the current block.
  • Intra including the MPM index and information on the intra prediction type by changing a candidate list and determining an MPM index related to an intra prediction mode of the current block derived based on a rate-distortion cost from the MPM candidate list It is set to encode prediction information.
  • a decoding apparatus includes a memory storing the video signal, and a processor coupled to the memory and processing the video signal.
  • the processor obtains intra prediction information of a current block to which the intra prediction is applied, wherein the intra prediction information includes information on an intra prediction type of the current block and a most probable mode (MPM) index, and the current Generate an MPM candidate list based on prediction modes of at least one neighboring block adjacent to the block, and change the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type, and the MPM It is configured to determine an intra prediction mode related to the MPM index from a candidate list, and to generate a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture.
  • MPM most probable mode
  • An embodiment of the present specification provides a non-transitory computer-readable medium storing one or more instructions.
  • the one or more instructions executed by one or more processors generate a most probable mode (MPM) candidate list based on a prediction mode of at least one neighboring block adjacent to the current block, and the intra
  • the MPM candidate list is changed by removing at least one mode from the MPM candidate list based on a prediction type, and an intra of the current block derived based on a rate-distortion rate from the MPM candidate list
  • a video signal processing apparatus is controlled to determine an MPM index related to a prediction mode and encode intra prediction information including information on the MPM index and the intra prediction type.
  • the one or more instructions executed by one or more processors obtain intra prediction information including information on an intra prediction type of a current block and an MPM index, and at least one adjacent to the current block Generate an MPM candidate list based on a prediction mode of a neighboring block, and change the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type, and the MPM index in the MPM candidate list
  • a video signal processing apparatus is controlled to determine an intra prediction mode related to the intra prediction mode, and to generate a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture.
  • the encoding/decoding structure of intra prediction information After generating the same MPM candidate list for various intra prediction types, by changing the MPM candidate list so that unusable MPM candidates are removed according to the intra prediction type, the encoding/decoding structure of intra prediction information It can simplify, and reduce the amount of data and computational complexity required for intra prediction.
  • FIG. 1 shows an example of an image coding system according to an embodiment of the present specification.
  • FIG. 2 shows an example of a schematic block diagram of an encoding apparatus in which encoding of a video signal is performed according to an embodiment of the present specification.
  • FIG. 3 shows an example of a schematic block diagram of a decoding apparatus for decoding an image signal according to an embodiment of the present specification.
  • FIG. 4 shows an example of a content streaming system according to an embodiment of the present specification.
  • FIG 5 shows an example of a video signal processing apparatus according to an embodiment of the present specification.
  • 6A to 6D illustrate examples of a block division structure according to an embodiment of the present specification.
  • FIG. 7 shows an example of a flowchart for encoding a picture constituting a video signal according to an embodiment of the present specification.
  • FIG. 8 shows an example of a flowchart for decoding a picture constituting a video signal according to an embodiment of the present specification.
  • FIG 9 shows an example of a flowchart for intra prediction in an encoding process of a video signal according to an embodiment of the present specification.
  • FIG. 10 illustrates an example of an intra prediction unit in an encoding device according to an embodiment of the present specification.
  • FIG. 11 shows an example of a flowchart for intra prediction in a process of decoding a video signal according to an embodiment of the present specification.
  • FIG. 12 illustrates an example of an intra prediction unit in a decoding apparatus according to an embodiment of the present specification.
  • FIG. 13 shows an example of a flowchart for encoding intra prediction information in a process of encoding a video signal according to an embodiment of the present specification.
  • FIG. 14 shows an example of a flowchart for decoding intra prediction information in a process of decoding a video signal according to an embodiment of the present specification.
  • FIG. 15 illustrates an example of a flowchart for determining an intra prediction mode in a process of decoding a video signal according to an embodiment of the present specification.
  • 16 illustrates an example of 33 directional intra prediction modes according to an embodiment of the present specification.
  • 17 illustrates an example of 65 directional intra prediction modes according to an embodiment of the present specification.
  • MCM most probable mode
  • FIG 19 shows examples of reference samples taking into account multi-reference line (MRL) intra prediction according to an embodiment of the present specification.
  • MRL multi-reference line
  • FIGS 20A and 20B illustrate an example of block division according to an intra sub-partition (ISP) according to an embodiment of the present specification.
  • ISP intra sub-partition
  • FIG. 21 is a diagram for explaining a multiple direct mode (DM) for intra prediction of a chroma block according to an embodiment of the present specification.
  • DM multiple direct mode
  • CCLM cross-component linear model
  • 23A to 23C illustrate examples of a method of configuring a most probable mode (MPM) candidate list based on an intra prediction type according to an embodiment of the present specification.
  • MPM most probable mode
  • 24A to 24C illustrate another example of a method of constructing an MPM candidate list based on an intra prediction type according to an embodiment of the present specification.
  • 25 illustrates an example of a flowchart for intra prediction in an encoding process of a video signal according to an embodiment of the present specification.
  • 26 shows an example of a flowchart for intra prediction in a process of decoding a video signal according to an embodiment of the present specification.
  • a'processing unit' means a unit in which an encoding/decoding process such as prediction, transformation, and/or quantization is performed.
  • the processing unit may be interpreted as including a unit for a luma component and a unit for a chroma component.
  • the processing unit may correspond to a block, a coding unit (CU), a prediction unit (PU), or a transform unit (TU).
  • the processing unit may be interpreted as a unit for a luminance component or a unit for a color difference component.
  • the processing unit may correspond to a coding tree block (CTB), a coding block (CB), a PU, or a transform block (TB) for a luminance component.
  • the processing unit may correspond to CTB, CB, PU or TB for the color difference component.
  • the present invention is not limited thereto, and the processing unit may be interpreted as including a unit for a luminance component and a unit for a color difference component.
  • processing unit is not necessarily limited to a square block, and may be configured in a polygonal shape having three or more vertices.
  • pixels or pixels are collectively referred to as samples.
  • using a sample may mean using a pixel value or a pixel value.
  • the image coding system may include a source device 10 and a reception device 20.
  • the source device 10 may transmit the encoded video/video information or data in a file or streaming format to the receiving device 20 through a digital storage medium or a network.
  • the source device 10 may include a video source 11, an encoding device 12, and a transmitter 13.
  • the receiving device 20 may include a receiver 21, a decoding device 22 and a renderer 23.
  • the encoding device 12 may be referred to as a video/image encoding device, and the decoding device 22 may be referred to as a video/image decoding device.
  • the transmitter 13 may be included in the encoding device 12.
  • the receiver 21 may be included in the decoding device 22.
  • the renderer 23 may include a display unit, and the display unit may be configured as a separate device or an external component.
  • the video source 11 may acquire a video/image through a process of capturing, synthesizing, or generating a video/image.
  • the video source 11 may include a video/image capturing device and/or a video/image generating device.
  • the video/image capturing device may include, for example, one or more cameras, and a video/image archive including previously captured video/images.
  • Video/image generating devices may include, for example, computers, tablets and smartphones, and may (electronically) generate video/images.
  • a virtual video/image may be generated through a computer, and in this case, a video/image capturing process may be substituted as a process of generating related data.
  • the encoding device 12 may encode an input video/video.
  • the encoding apparatus 12 may perform a series of procedures such as prediction, transformation, and quantization for compression and coding efficiency.
  • the encoded data (encoded video/video information) may be output in the form of a bitstream.
  • the transmitter 13 may transmit the encoded video/video information or data output in the form of a bitstream to the receiver 21 of the receiving device 20 through a digital storage medium or a network in a file or streaming form.
  • Digital storage media include USB (universal serial bus), SD card (secure digital card), CD (compact disc), DVD (digital versatile disc), Blu-ray disc, HDD (hard disk drive), SSD (solid state drive) may include a variety of storage media.
  • the transmitter 13 may include an element for generating a media file through a predetermined file format, and may include an element for transmission through a broadcast/communication network.
  • the receiver 21 may extract the bitstream and transmit it to the decoding device 22.
  • the decoding device 22 may decode the video/video by performing a series of procedures such as inverse quantization, inverse transformation, and prediction corresponding to the operation of the encoding device 12.
  • the renderer 23 may render the decoded video/image.
  • the rendered video/image may be displayed through the display unit.
  • FIG. 2 shows an example of a schematic block diagram of an encoding apparatus in which encoding of a video signal is performed according to an embodiment of the present specification.
  • the encoding device 100 of FIG. 2 may correspond to the encoding device 12 of FIG. 1.
  • the image partitioning module 110 may divide an input image (or picture, frame) input to the encoding apparatus 100 into one or more processing units.
  • the processing unit may be referred to as a coding unit (CU).
  • the coding unit may be recursively partitioned from a coding tree unit (CTU) or a largest coding unit (LCU) according to a quad-tree binary-tree (QTBT) structure.
  • CTU coding tree unit
  • LCU largest coding unit
  • QTBT quad-tree binary-tree
  • one coding unit may be divided into a plurality of coding units of a deeper depth based on a quad tree structure and/or a binary tree structure.
  • a quad tree structure may be applied first and a binary tree structure may be applied later.
  • the binary tree structure may be applied first.
  • a coding procedure according to an embodiment of the present specification may be performed based on a final coding unit that is no longer divided.
  • the maximum coding unit may be directly used as the final coding unit based on coding efficiency according to image characteristics.
  • the coding unit is recursively divided into coding units of a lower depth, so that a coding unit having an optimal size may be used as a final coding unit.
  • the coding procedure may include procedures such as prediction, transformation, and restoration described below.
  • the processing unit may further include a prediction unit (PU) or a transform unit (TU).
  • the prediction unit and the transform unit may be divided from the above-described coding units, respectively.
  • the prediction unit may be a unit of sample prediction
  • the transform unit may be a unit for inducing a transform coefficient or a unit for inducing a residual signal from the transform coefficient.
  • the term "unit” used in this document may be used interchangeably with terms such as "block” or "area” in some cases.
  • the MxN block may represent a set of samples or transform coefficients consisting of M columns and N rows.
  • a sample may generally represent a pixel or a value of a pixel, may represent a pixel/pixel value of a luminance component, or a pixel/pixel value of a saturation component.
  • a sample may be used as a term corresponding to one picture (or image) as a pixel or pel.
  • the encoding apparatus 100 includes a prediction signal (predicted block) output from an inter prediction module 180 or an intra prediction module 185 from an input video signal (original block, original sample array). , Predictive sample array), a residual signal (residual signal, residual block, residual sample array) may be generated. The generated residual signal is transmitted to the conversion unit 120.
  • a unit that subtracts a prediction signal (prediction block, prediction sample array) from an input video signal (original block, original sample array) in the encoding apparatus 100 is used as a subtraction module 115. May be referred to.
  • the prediction unit may perform prediction on a block to be processed (hereinafter, referred to as a current block) and generate a predicted block including prediction samples for the current block.
  • the prediction module may determine whether intra prediction or inter prediction is applied on a per CU basis.
  • the prediction unit may generate information about prediction, such as prediction mode information, as described later in the description of each prediction mode, and may transmit information about prediction to the entropy encoding unit 190.
  • Information about prediction is encoded by the entropy encoding unit 190 and may be output in the form of a bitstream.
  • the intra prediction unit 185 may predict the current block by referring to samples in the current picture.
  • the referenced samples may be located in the vicinity of the current block or may be located away from each other according to the prediction mode.
  • prediction modes may include a plurality of non-directional modes and a plurality of directional modes.
  • the non-directional mode may include, for example, a DC mode and a planar mode (Planar mode).
  • the directional mode may include, for example, 33 directional prediction modes or 65 directional prediction modes according to a detailed degree of the prediction direction. However, this is an example, and more or less directional prediction modes may be used depending on the setting.
  • the intra prediction unit 185 may determine a prediction mode applied to the current block by using the prediction mode applied to the neighboring block.
  • the inter prediction unit 180 may derive a predicted block for the current block based on a reference block (reference sample array) specified by a motion vector on the reference picture.
  • the inter prediction unit 180 may predict motion information in units of blocks, subblocks, or samples based on the correlation between motion information between neighboring blocks and the current block.
  • the motion information may include a motion vector and a reference picture index.
  • the motion information may further include inter prediction direction (L0 prediction, L1 prediction, Bi prediction, etc.) information.
  • the neighboring block may include a spatial neighboring block existing in the current picture and a temporal neighboring block existing in the reference picture.
  • the reference picture including the reference block and the reference picture including the temporal neighboring block may be the same or different.
  • the temporal neighboring block may be referred to as a collocated reference block or a colCU (colCU), and a reference picture including the temporal neighboring block may be referred to as a collocated picture (colPic).
  • the inter prediction unit 180 constructs a motion information candidate list based on motion information of neighboring blocks, and indicates which candidate is used to derive a motion vector and/or a reference picture index of the current block. Can generate information. Inter prediction may be performed based on various prediction modes. For example, when a skip mode and a merge mode are used, the inter prediction unit 180 may use motion information of a neighboring block as motion information of a current block.
  • a residual signal is not transmitted.
  • MVP motion vector prediction
  • MVD motion vector difference
  • the prediction signal generated by the inter prediction unit 180 or the intra prediction unit 185 may be used to generate a reconstructed signal or may be used to generate a residual signal.
  • the transform module 120 may generate transform coefficients by applying a transform technique to the residual signal.
  • the transformation technique uses at least one of DCT (Discrete Cosine Transform), DST (Discrete Sine Transform), KLT (Karhunen-Loeve Transform), GBT (Graph-Based Transform), or CNT (Conditionally Non-linear Transform).
  • DCT Discrete Cosine Transform
  • DST Discrete Sine Transform
  • KLT Kerhunen-Loeve Transform
  • GBT Graph-Based Transform
  • CNT Supplementally Non-linear Transform
  • GBT refers to transformation obtained from a graph representing relationship information between pixels.
  • CNT refers to a transformation obtained based on the prediction signal and generating a prediction signal using all previously reconstructed pixels.
  • the conversion process may be applied to a pixel block having the same size of a square, or may be applied to a block that is not a square or has a variable size.
  • the quantization module 130 quantizes the transform coefficients and transmits the quantized transform coefficients to the entropy encoding module 190.
  • the entropy encoding unit 190 may encode a quantized signal (information on quantized transform coefficients) and output it as a bitstream. Information about the quantized transform coefficients may be referred to as residual information.
  • the quantization unit 130 may rearrange the quantized transform coefficients in a block form into a one-dimensional vector form based on a coefficient scan order, and quantize the quantized transform coefficients based on the characteristics of the quantized transform coefficients in a one-dimensional vector form. It is also possible to generate information about transform coefficients.
  • the entropy encoding unit 190 may perform various encoding techniques such as exponential Golomb, context-adaptive variable length coding (CAVLC), and context-adaptive binary arithmetic coding (CABAC).
  • the entropy encoding unit 190 may encode information necessary for video/image restoration (eg, values of syntax elements) in addition to quantized transform coefficients together or separately.
  • the encoded information (eg, video/video information) may be transmitted or stored in a bitstream format in units of network abstraction layer (NAL) units.
  • NAL network abstraction layer
  • the bitstream may be transmitted over a network or may be stored in a digital storage medium.
  • the network may include a broadcasting network and/or a communication network
  • the digital storage medium may include a storage medium such as USB, SD, CD, DVD, Blu-ray, HDD, and SSD.
  • a transmission unit (not shown) for transmitting and/or a storage unit (not shown) for storing may be configured as internal/external elements of the encoding apparatus 100, or the transmission unit It may be a component of the entropy encoding unit 190.
  • the quantized transform coefficients output from the quantization unit 130 may be used to generate a reconstructed signal.
  • a residual signal can be restored by applying inverse quantization and inverse transform through the inverse quantization module 140 and the inverse transform module 150 in the loop for the quantized transform coefficients. have.
  • the addition module 155 adds the reconstructed residual signal to the prediction signal output from the inter prediction unit 180 or the intra prediction unit 185 to provide a reconstructed signal (reconstructed picture, a reconstructed block, and Sample array).
  • the predicted block may be used as a reconstructed block.
  • the addition unit 155 may be referred to as a restoration unit or a restoration block generation unit.
  • the generated reconstructed signal may be used for intra prediction of the next processing target block in the current picture, and may be used for inter prediction of the next picture through filtering as described later.
  • the filtering module 160 may improve subjective/objective image quality by applying filtering to the reconstructed signal.
  • the filtering unit 160 may apply various filtering methods to the reconstructed picture to generate a modified reconstructed picture, and may transmit the modified reconstructed picture to the decoded picture buffer 170.
  • Various filtering methods may include, for example, deblocking filtering, sample adaptive offset (SAO), adaptive loop filter (ALF), and bilateral filter.
  • the filtering unit 160 may generate filtering information and transmit the filtering information to the entropy encoding unit 190 as described later in the description of each filtering method.
  • the filtering information may be output in the form of a bitstream through entropy encoding in the entropy encoding unit 190.
  • the modified reconstructed picture transmitted to the decoded picture buffer (DBP) 170 may be used as a reference picture in the inter prediction unit 180.
  • the encoding apparatus 100 may avoid prediction mismatch between the encoding apparatus 100 and the decoding apparatus 200 by using the modified reconstructed picture, and may improve encoding efficiency.
  • the decoded picture buffer 170 may store the modified reconstructed picture to be used as a reference picture in the inter prediction unit 180.
  • FIG. 3 shows an example of a schematic block diagram of a decoding apparatus for decoding an image signal according to an embodiment of the present specification.
  • the decoding device 200 of FIG. 3 may correspond to the decoding device 22 of FIG. 1.
  • the decoding apparatus 200 includes an entropy decoding module 210, a de-quantization module 220, an inverse transform module 230, and an adder. (addition module) 235, filtering module 240, decoded picture buffer (DPB) 250, inter prediction module 260, and intra prediction module 265 ) Can be included.
  • the inter prediction unit 260 and the intra prediction unit 265 may be collectively referred to as a prediction module. That is, the prediction unit may include an inter prediction unit 180 and an intra prediction unit 185.
  • the inverse quantization unit 220 and the inverse transform unit 230 may be collectively referred to as a residual processing module.
  • the residual processing unit may include an inverse quantization unit 220 and an inverse transform unit 230.
  • the entropy decoding unit 210, the inverse quantization unit 220, the inverse transform unit 230, the addition unit 235, the filtering unit 240, the inter prediction unit 260, and the intra prediction unit 265 are implemented. It may be configured by one hardware component (eg, a decoder or a processor) according to an example. Also, the decoded picture buffer 250 may be configured by one hardware component (eg, a memory or a digital storage medium) according to an embodiment.
  • the decoding apparatus 200 may reconstruct an image in response to a process in which the video/image information is processed by the encoding apparatus 100 of FIG. 2.
  • the decoding apparatus 200 may perform decoding using a processing unit applied by the encoding apparatus 100.
  • the processing unit may be a coding unit, for example, and the coding unit may be divided from a coding tree unit or a maximum coding unit along a quad tree structure and/or a binary tree structure.
  • the reconstructed image signal decoded and output through the decoding device 200 may be reproduced through the playback device.
  • the decoding apparatus 200 may receive a signal output from the encoding apparatus 100 of FIG. 2 in the form of a bitstream, and the received signal may be decoded through the entropy decoding unit 210.
  • the entropy decoding unit 210 may parse the bitstream to derive information (eg, video/video information) necessary for image restoration (or picture restoration).
  • the entropy decoding unit 210 acquires information in the bitstream using a coding technique such as exponential Golomb coding, CAVLC, or CABAC, and a value of a syntax element required for image restoration, and a quantized value of a transform coefficient for a residual Can be printed.
  • a bin corresponding to each syntax element is received in a bitstream, and information about the syntax element to be decoded and decoding information of a block to be decoded and a neighbor or a symbol/bin decoded in a previous step
  • the symbol corresponding to the value of each syntax element is determined by determining the context model using the information of, and performing arithmetic decoding of the bin by predicting the probability of occurrence of the bin according to the determined context model.
  • the CABAC entropy decoding method may update the context model using information of the decoded symbol/bin for the context model of the next symbol/bin after the context model is determined.
  • the entropy decoding unit 210 Among the information decoded by the entropy decoding unit 210, information on prediction is provided to the prediction unit (inter prediction unit 260 and intra prediction unit 265), and the register on which entropy decoding is performed by the entropy decoding unit 210 Dual values, that is, quantized transform coefficients and related parameter information may be input to the inverse quantization unit 220. In addition, information about filtering among information decoded by the entropy decoding unit 210 may be provided to the filtering unit 240. Meanwhile, a receiving unit (not shown) for receiving a signal output from the encoding device 100 may be further configured as an inner/outer element of the decoding device 200, or the receiving unit may be a component of the entropy decoding unit 210. May be.
  • the inverse quantization unit 220 may output transform coefficients through inverse quantization of the quantized transform coefficients.
  • the inverse quantization unit 220 may rearrange the quantized transform coefficients into a two-dimensional block shape. In this case, the reordering may be performed based on the coefficient scan order performed by the encoding apparatus 100.
  • the inverse quantization unit 220 may perform inverse quantization on quantized transform coefficients by using a quantization parameter (eg, quantization step size information) and obtain transform coefficients.
  • a quantization parameter eg, quantization step size information
  • the inverse transform unit 230 inversely transforms the transform coefficients to obtain a residual signal (residual block, residual sample array).
  • the prediction unit may perform prediction on the current block and generate a predicted block including prediction samples for the current block.
  • the prediction unit may determine whether intra prediction or inter prediction is applied to the current block based on information on prediction output from the entropy decoding unit 210, and may determine a specific intra/inter prediction mode.
  • the intra prediction unit 265 may predict the current block by referring to samples in the current picture.
  • the referenced samples may be located near the current block or may be spaced apart according to the prediction mode.
  • prediction modes may include a plurality of non-directional modes and a plurality of directional modes.
  • the intra prediction unit 265 may determine a prediction mode applied to the current block by using the prediction mode applied to the neighboring block.
  • the inter prediction unit 260 may derive a predicted block for the current block based on a reference block (reference sample array) specified by a motion vector on the reference picture.
  • motion information may be predicted in units of blocks, subblocks, or samples based on correlation between motion information between neighboring blocks and current blocks.
  • the motion information may include a motion vector and a reference picture index.
  • the motion information may further include inter prediction direction (L0 prediction, L1 prediction, Bi prediction) information.
  • the neighboring block may include a spatial neighboring block existing in the current picture and a temporal neighboring block existing in the reference picture.
  • the inter prediction unit 260 may construct a motion information candidate list based on neighboring blocks, and derive a motion vector and/or a reference picture index of the current block based on the received candidate selection information.
  • Inter prediction may be performed based on various prediction modes, and information on prediction may include information indicating a mode of inter prediction for a current block.
  • the addition unit 235 adds the obtained residual signal to the prediction signal (predicted block, prediction sample array) output from the inter prediction unit 260 or the intra prediction unit 265 to provide a reconstructed signal (a reconstructed picture, a reconstructed block).
  • a reconstructed signal (a reconstructed picture, a reconstructed block).
  • Restoration sample array) can be generated.
  • the addition unit 235 may be referred to as a restoration unit or a restoration block generation unit.
  • the generated reconstructed signal may be used for intra prediction of the next processing target block in the current picture, and may be used for inter prediction of the next picture through filtering as described later.
  • the filtering unit 240 may improve subjective/objective image quality by applying filtering to the reconstructed signal. For example, the filtering unit 240 may apply various filtering methods to the reconstructed picture to generate a modified reconstructed picture, and may transmit the modified reconstructed picture to the decoded picture buffer 250.
  • Various filtering methods may include, for example, deblocking filtering, sample adaptive offset, adaptive loop filter, and bilateral filter.
  • the modified reconstructed picture delivered to the decoded picture buffer 250 may be used as a reference picture by the inter prediction unit 260.
  • embodiments described in the filtering unit 160, the inter prediction unit 180, and the intra prediction unit 185 of the encoding apparatus 100 are respectively the filtering unit 240 and the inter prediction unit 260 of the decoding apparatus.
  • the intra prediction unit 265 may be applied to be the same or correspond to each other.
  • FIG. 4 shows an example of a content streaming system according to an embodiment of the present specification.
  • Content streaming systems to which the embodiments of the present specification are applied are largely an encoding server 410, a streaming server 420, a web server 430, and a media storage 440. ), a user equipment 450, and a multimedia input device 460.
  • the encoding server 410 generates a bitstream by compressing content input from a multimedia input device 460 such as a smartphone, a camera, or a camcorder into digital data, and transmits the generated bitstream to the streaming server 420.
  • a multimedia input device 460 such as a smartphone, a camera, or a camcorder
  • the encoding server 410 may be omitted.
  • the bitstream may be generated by an encoding method or a bitstream generation method to which an embodiment of the present specification is applied, and the streaming server 420 may temporarily store the bitstream while transmitting or receiving the bitstream.
  • the streaming server 420 transmits multimedia data to the user device 450 based on a user request through the web server 430, and the web server 430 serves as an intermediary that informs the user of what kind of service exists.
  • the web server 430 transmits information on the requested service to the streaming server 420, and the streaming server 420 transmits multimedia data to the user.
  • the content streaming system may include a separate control server, and in this case, the control server serves to control commands/responses between devices in the content streaming system.
  • the streaming server 420 may receive content from the media storage 440 and/or the encoding server 410. For example, when content is received from the encoding server 410, the content may be received in real time. In this case, in order to provide a smooth streaming service, the streaming server 420 may store the bitstream for a predetermined time.
  • the user device 450 includes, for example, a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistants (PDA), a portable multimedia player (PMP), a navigation system, and a slate PC ( slate PC), tablet PC, ultrabook, wearable device, e.g., smartwatch, smart glass, head mounted display (HMD)), It can include digital TV, desktop computer, and digital signage.
  • PDA personal digital assistants
  • PMP portable multimedia player
  • HMD head mounted display
  • Each server in the content streaming system may be operated as a distributed server, and in this case, data received from each server may be distributedly processed.
  • FIG. 5 shows an example of a video signal processing apparatus according to an embodiment of the present specification.
  • the video signal processing apparatus of FIG. 5 may correspond to the encoding apparatus 100 of FIG. 1 or the decoding apparatus 200 of FIG. 2.
  • the video signal processing apparatus 500 for processing a video signal includes a memory 520 for storing a video signal, and a processor 510 for processing a video signal while being combined with the memory 520.
  • the processor 510 may be configured with at least one processing circuit for processing a video signal, and may process a video signal by executing instructions for encoding/decoding a video signal. That is, the processor 510 may encode original video data or decode an encoded video signal by executing encoding/decoding methods described below.
  • the processor 510 for encoding a video signal, for encoding a video signal, based on a prediction mode of at least one neighboring block adjacent to the current block, the MPM ( most probable mode) a candidate list is generated, and the MPM candidate list is changed by removing at least one mode from the MPM candidate list based on the intra prediction type of the current block, and rate-distortion cost in the MPM candidate list It is configured to determine an MPM index related to an intra prediction mode of the current block derived based on the current block, and to encode intra prediction information including information on the MPM index and the intra prediction type.
  • the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided, and a reference sample located in a line separated by 2 sample distances or more from the current block. It may correspond to one of the used second type or a third type in which a reference sample located in a line adjacent to the current block is used and the current block is divided by an intra sub-partition (ISP).
  • ISP intra sub-partition
  • the planar mode and the DC mode may be removed from the MPM candidate list.
  • the DC mode when the intra prediction type corresponds to the third type, the DC mode may be removed from the MPM candidate list.
  • the planar mode may be removed from the MPM candidate list.
  • the intra prediction information further includes ISP direction information related to a division direction of the current block when the intra prediction type corresponds to a third type, and the intra prediction mode is horizontal direction division in the MPM candidate list. It may be a mode having a smaller rate-distortion cost among the modes determined for the and vertical division.
  • the processor 510 acquires intra prediction information of a current block to which the intra prediction is applied, for decoding a video signal, wherein the intra prediction information is the current Including information on the intra prediction type of a block and an MPM index, generating an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block, and in the MPM candidate list based on the intra prediction type Change the MPM candidate list by removing at least one mode, determine an intra prediction mode related to the MPM index from the MPM candidate list, and predict the current block based on the intra prediction mode and a reference sample in the current picture It is set up to generate samples.
  • the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided, and a reference sample located in a line separated by 2 sample distances or more from the current block. It may correspond to one of the used second type or a third type in which the reference sample located in a line adjacent to the current block is used and the current block is divided by an intra subpartition.
  • the planar mode and the DC mode may be removed from the MPM candidate list.
  • the DC mode when the intra prediction type corresponds to the third type, the DC mode may be removed from the MPM candidate list.
  • the planar mode may be removed from the MPM candidate list.
  • the intra prediction information may further include ISP direction information related to a division direction of the current block when the intra prediction type corresponds to a third type.
  • 6A to 6D illustrate examples of a block division structure according to an embodiment of the present specification.
  • 6A is a QT (quadtree, QT)
  • FIG. 6B is a binary tree (BT)
  • FIG. 6C is a ternary tree (TT)
  • FIG. 6D shows an example of block division structures by an asymmetric tree (AT). do.
  • one block may be divided based on a QT division scheme.
  • one subblock divided by the QT division method may be further divided recursively according to the QT division method.
  • a leaf block that is no longer divided by the QT division method may be divided by at least one of BT, TT, or AT.
  • BT can have two types of division, such as horizontal BT (2NxN, 2NxN) and vertical BT (Nx2N, Nx2N).
  • TT may have two types of divisions, such as horizontal TT (2Nx1/2N, 2NxN, 2Nx1/2N) and vertical TT (1/2Nx2N, Nx2N, 1/2Nx2N).
  • AT is horizontal-up AT (2Nx1/2N, 2Nx3/2N), horizontal-down AT (2Nx3/2N, 2Nx1/2N), vertical-left AT ( It can have four types of division: 1/2Nx2N, 3/2Nx2N), and vertical-right AT (3/2Nx2N, 1/2Nx2N).
  • Each BT, TT, AT can be further divided recursively using BT, TT, AT.
  • Block A may be divided into four sub-blocks (A0, A1, A2, A3) by QT.
  • Sub-block A1 may be divided into four sub-blocks (B0, B1, B2, B3) by QT again.
  • Block B3 that is no longer divided by QT may be divided by vertical BT (C0, C1) or horizontal BT (D0, D1). Like block C0, each sub-block may be further divided recursively in the form of horizontal BT (E0, E1) or vertical BT (F0, F1).
  • Block B3 which is no longer divided by QT may be divided into vertical TT (C0, C1, C2) or horizontal TT (D0, D1, D2). Like block C1, each sub-block may be further divided recursively in the form of horizontal TT (E0, E1, E2) or vertical TT (F0, F1, F2).
  • Block B3 which is no longer divided by QT, can be divided into vertical ATs (C0, C1) or horizontal ATs (D0, D1). Like block C1, each sub-block can be further divided recursively in the form of a horizontal AT (E0, E1) or a vertical TT (F0, F1).
  • BT, TT, and AT division can be applied together in one block.
  • a sub-block divided by BT may be divided by TT or AT.
  • sub-blocks divided by TT may be divided by BT or AT.
  • Sub-blocks divided by AT may be divided by BT or TT.
  • each sub-block may be divided by vertical BT.
  • each sub-block may be divided by horizontal BT. In this case, the order of division is different, but the shape of the final division is the same.
  • the order of searching for the block may be variously defined.
  • a search is performed from left to right and from top to bottom, and searching for a block means the order of determining whether to divide additional blocks of each divided sub-block, or if the block is no longer divided, each sub It may mean an encoding order of a block, or a search order when a subblock refers to information of another neighboring block.
  • pictures constituting the video/video may be encoded/decoded according to a series of decoding orders.
  • a picture order corresponding to an output order of a decoded picture may be set differently from a decoding order, and based on this, not only forward prediction but also backward prediction may be performed during inter prediction.
  • step S710 may be performed by the prediction units 180 and 185 of the encoding apparatus 100 described in FIG. 2, and step S720 may be performed by the residual processing units 115, 120, and 130. , S730 may be performed by the entropy encoding unit 190.
  • Step S710 may include an inter/intra prediction procedure described in this document
  • step S720 may include a residual processing procedure described in this document
  • step S730 includes an information encoding procedure described in this document. can do.
  • the picture encoding procedure is not only a procedure of encoding information for picture restoration (eg, prediction information, residual information, partitioning information) schematically as described in FIG. 2 to output in a bitstream form,
  • a procedure for generating a reconstructed picture for the current picture and a procedure for applying in-loop filtering to the reconstructed picture (optional) may be included.
  • the encoding device 100 may derive (modified) residual samples from the quantized transform coefficients through the inverse quantization unit 140 and the inverse transform unit 150, and predictive samples corresponding to the output of step S710 and the ( A reconstructed picture may be generated based on the modified) residual samples.
  • the reconstructed picture generated in this way may be the same as the reconstructed picture generated by the decoding apparatus 200 described above.
  • a modified reconstructed picture can be generated through an in-loop filtering procedure for the reconstructed picture, which can be stored in the decoded picture buffer 170 or a memory, and, as in the case of the decoding device 200, subsequent picture encoding It can be used as a reference picture in a time inter prediction procedure. As described above, in some cases, some or all of the in-loop filtering procedure may be omitted.
  • (in-loop) filtering-related information may be encoded by the entropy encoding unit 190 and output in the form of a bitstream, and the decoding apparatus 200
  • the in-loop filtering procedure may be performed in the same manner as the encoding apparatus 100.
  • the encoding device 100 and the decoding device 200 can derive the same prediction result, and increase the reliability of picture coding. , It is possible to reduce the amount of data transmitted for picture coding.
  • Operation S810 may be performed by the entropy decoding unit 210 in the decoding apparatus 200 of FIG. 3, operation S820 may be performed by the prediction units 260 and 265, and operation S830 may be performed by the residual processing unit ( 220, 230), step S840 may be performed by the addition unit 235, step S850 may be performed by the filtering unit 240.
  • Step S810 may include the information decoding procedure described in this document
  • step S820 may include the inter/intra prediction procedure described in this document
  • step S830 includes the residual processing procedure described in this document.
  • step S840 may include the block/picture restoration procedure described in this document
  • step S850 may include the in-loop filtering procedure described in this document.
  • the picture decoding procedure is schematically a procedure for obtaining image/video information (through decoding) from a bitstream (S810), a picture restoration procedure (S820 to S840), and a reconstructed picture as described in FIG. It may include an in-loop filtering procedure (S850) for.
  • the picture restoration procedure is based on prediction samples and residual samples obtained through the process of inter/intra prediction (S820) and residual processing (S830, inverse quantization and inverse transformation of a quantized code or coefficient) described in this document. Can be done.
  • a modified reconstructed picture may be generated through an in-loop filtering procedure for a reconstructed picture generated through a picture restoration procedure, and the modified reconstructed picture may be output as a decoded picture, and the decoding apparatus 200 It is stored in the decoded picture buffer 250 or a memory, and may be used as a reference picture in inter prediction when decoding a picture later.
  • the in-loop filtering procedure may be omitted.
  • the reconstructed picture may be output as a decoded picture, and stored in the decoded picture buffer 250 of the decoding device 200 or in a memory to be It can be used as a reference picture in the prediction train.
  • the in-loop filtering procedure S850 may include a deblocking filtering procedure, a sample adaptive offset (SAO) procedure, an adaptive loop filter (ALF) procedure, and/or a bi-lateral filter procedure as described above. And some or all of them may be omitted.
  • one or some of the deblocking filtering procedure, the SAO procedure, the ALF procedure, and the bilateral filter procedure may be sequentially applied, or all may be sequentially applied.
  • the SAO procedure may be performed.
  • the ALF procedure may be performed. This may be similarly performed in the encoding device 100.
  • a reconstructed block may be generated based on intra prediction/inter prediction for each block, and a reconstructed picture including the reconstructed blocks may be generated.
  • the current picture/slice/tile group is an I picture/slice/tile group
  • blocks included in the current picture/slice/tile group may be reconstructed based only on intra prediction.
  • inter prediction may be applied to some blocks in the current picture/slice/tile group
  • intra prediction may be applied to the remaining some blocks.
  • the color component of a picture may include a luminance component and a chrominance component, and the methods and embodiments proposed in this document may be applied to the luminance component and the chrominance component unless explicitly limited in this document.
  • An embodiment of the present specification relates to an intra prediction method, and in the case of a decoder, the video/video decoding method based on intra prediction of FIG. 11 and the intra prediction unit 265 in the decoding apparatus 200 of FIG. 12 may be used.
  • the encoder may be represented by an intra prediction-based video/spiritual encoding method of FIG. 9 and an intra prediction unit in the encoding apparatus 100 of FIG. 10.
  • the data encoded by FIGS. 9 and 10 may be stored in the form of a bitstream.
  • Intra prediction may mean prediction in which prediction samples for a current block are generated based on reference samples in a picture to which the current block belongs (hereinafter, referred to as a current picture).
  • a current picture When intra prediction is applied to the current block, surrounding reference samples to be used for intra prediction of the current block may be derived.
  • the neighboring reference samples of the current block are a sample adjacent to the left boundary of the current block of size nWxnH and a total of 2xnH samples adjacent to the bottom-left, a sample adjacent to the top boundary of the current block, and A total of 2xnW samples adjacent to the top-right side and one sample adjacent to the top-left side of the current block may be included.
  • the peripheral reference samples of the current block may include upper peripheral samples of a plurality of columns and left peripheral samples of a plurality of rows.
  • the neighboring reference samples of the current block are a total of nH samples adjacent to the right boundary of the current block of size nWxnH, a total of nW samples adjacent to the bottom boundary of the current block, and the lower right ( It may include one sample adjacent to the bottom-right).
  • the decoder can construct surrounding reference samples to be used for prediction by substituting the samples that are not available with the available samples. Further, surrounding reference samples to be used for prediction may be constructed through interpolation of available samples.
  • prediction samples may be derived based on an average or interpolation of neighboring reference samples of the current block, and (ii) prediction among neighboring reference samples of the current block
  • the prediction sample may be derived based on a reference sample existing in a specific (prediction) direction with respect to the sample.
  • it may be referred to as a non-directional mode or a non-angular mode
  • it may be referred to as a directional mode or an angular mode.
  • a prediction sample may be generated.
  • LIP linear interpolation intra prediction
  • chrominance prediction samples may be generated based on luminance samples using a linear model. This case may be referred to as an LM mode.
  • a temporary prediction sample of the current block is derived based on the filtered surrounding reference samples, and at least one reference sample derived according to the intra prediction mode among existing surrounding reference samples, that is, unfiltered surrounding reference samples, and A prediction sample of the current block may be derived through a weighted sum of the temporary prediction samples. This case may be referred to as a position dependent prediction combination (PDPC).
  • PDPC position dependent prediction combination
  • the encoding apparatus 100 selects a reference sample line with the highest prediction accuracy among a plurality of reference sample lines located around the current block, and derives a prediction sample from the corresponding line using a reference sample located in the prediction direction.
  • intra prediction encoding may be performed by indicating (signaling) the used reference sample line to the decoding apparatus 200.
  • This case may be referred to as multi-reference line (MRL) intra prediction or MRL-based intra prediction.
  • MRL multi-reference line
  • the encoder/decoder divides the current block into vertical or horizontal subpartitions and performs intra prediction based on the same intra prediction mode, but may derive and use surrounding reference samples in units of subpartitions.
  • the intra prediction mode for the current block is equally applied to the subpartitions, but the intra prediction performance can be improved in some cases by deriving and using the surrounding reference samples in units of the subpartition.
  • This prediction method may be referred to as an ISP (intra sub-partition) or ISP-based intra prediction.
  • the above-described intra prediction methods may be referred to as an intra prediction type to distinguish them from the existing intra prediction modes.
  • the intra prediction type may be referred to in various terms such as an intra prediction technique or an additional intra prediction mode.
  • the intra prediction type (or additional intra prediction mode) may include at least one of the aforementioned LIP PDPC, MRL, and ISP. Meanwhile, post-processing filtering may be performed on the derived prediction samples as necessary.
  • the intra prediction procedure may include determining an intra prediction mode/type, deriving a neighboring reference sample, and deriving an intra prediction mode/type based prediction sample.
  • a post-processing filtering step may be performed on the derived prediction samples as necessary.
  • FIG. 9 shows an example of a flowchart for intra prediction in a process of encoding a video signal according to an embodiment of the present specification
  • FIG. 10 shows an example of an intra prediction unit in an encoding apparatus according to an embodiment of the present specification.
  • Operation S910 of FIG. 9 may be performed by the intra prediction unit 185 of the encoding apparatus 100, and operation S920 may be performed by the residual processing unit of the encoding apparatus 100. Specifically, step S920 may be performed by the subtraction unit 115 of the encoding device 100.
  • the prediction information may be derived by the intra prediction unit 185 and encoded by the entropy encoding unit 190.
  • the residual information may be derived by the residual processing unit and encoded by the entropy encoding unit 190.
  • the residual information is information about residual samples.
  • the residual information may include information on quantized transform coefficients for residual samples.
  • residual samples may be derived as transform coefficients through the transform unit 120 of the encoding apparatus 100, and transform coefficients may be derived as quantized transform coefficients through the quantization unit 130.
  • Information about the quantized transform coefficients may be encoded by the entropy encoding unit 190 through a residual coding procedure.
  • the encoding apparatus 100 performs intra prediction on the current block (S910).
  • the encoding apparatus 100 may derive an intra prediction mode/type for the current block, derive neighboring reference samples of the current block, and generate prediction samples in the current block based on the intra prediction mode/type and neighboring reference samples. do.
  • the procedure of determining the intra prediction mode/type, deriving neighboring reference samples, and generating prediction samples may be simultaneously performed, or one procedure may be performed before the other procedure.
  • the intra prediction unit 185 of the encoding apparatus 100 may include an intra prediction mode/type determiner 186, a reference sample derivation unit 187, and a prediction sample derivation unit 188.
  • the intra prediction mode/type determination unit 186 determines an intra prediction mode/type corresponding to the current block, the reference sample derivation unit 187 derives neighboring reference samples of the current block, and the prediction sample derivation unit 188 Predictive samples of the current block can be derived. Meanwhile, although not shown, when a prediction sample filtering procedure described later is performed, the intra prediction unit 185 may further include a prediction sample filter unit (not shown).
  • the encoding apparatus 100 may determine a mode/type applied to the current block from among a plurality of intra prediction modes/types. The encoding apparatus 100 may compare rate-distortion (RD) costs for intra prediction modes/types and determine an optimal intra prediction mode/type for the current block.
  • RD rate-distortion
  • the encoding apparatus 100 may perform a prediction sample filtering procedure.
  • Predictive sample filtering may be referred to as post filtering. Some or all of the prediction samples may be filtered by the prediction sample filtering procedure. In some cases, the prediction sample filtering procedure may be omitted.
  • the encoding apparatus 100 generates residual samples for the current block based on the (filtered) prediction samples (S920).
  • the encoding apparatus 100 may compare prediction samples from original samples of a current block based on a phase and derive residual samples.
  • the encoding apparatus 100 may encode image information including information on intra prediction (prediction information) and residual information on residual samples (S930).
  • the prediction information may include intra prediction mode information and intra prediction type information.
  • the encoding apparatus 100 may output the encoded image information in the form of a bitstream.
  • the output bitstream may be delivered to the decoding apparatus 200 through a storage medium or a network.
  • the residual information may include a residual coding syntax to be described later.
  • the encoding apparatus 100 may derive quantized transform coefficients by transforming/quantizing residual samples.
  • the residual information may include information on quantized transform coefficients.
  • the encoding apparatus 100 may generate a reconstructed picture (including reconstructed samples and a reconstructed block). To this end, the encoding apparatus 100 may perform inverse quantization/inverse transformation on the quantized transform coefficients again to derive (modified) residual samples. The reason for performing inverse quantization/inverse transformation after transforming/quantizing the residual samples in this way is to derive residual samples identical to the residual samples derived from the decoding apparatus 200 as described above.
  • the encoding apparatus 100 may generate a reconstructed block including reconstructed samples for the current block based on the prediction samples and (modified) residual samples. A reconstructed picture for the current picture may be generated based on the reconstructed block. As described above, the in-loop filtering procedure for the reconstructed picture may be further applied.
  • Steps S1110 to S1130 may be performed by the intra prediction unit 265 of the decoding apparatus 200, and the prediction information of step S1110 and the residual information of step S1140 are obtained from the bitstream by the entropy decoding unit 210 Can be.
  • the residual processing unit of the decoding apparatus 200 may derive residual samples for the current block based on the residual information.
  • the inverse quantization unit 220 of the residual processing unit derives the transformation coefficients by performing inverse quantization based on the quantized transformation coefficients derived based on the residual information, and the inverse transformation unit 230 of the residual processing unit performs transformation. Residual samples for the current block can be derived by performing inverse transformation on the coefficients. Operation S1150 may be performed by the addition unit 235 or the restoration unit of the decoding apparatus 200.
  • the decoding apparatus 200 may derive an intra prediction mode/type for the current block based on the received prediction information (intra prediction mode/type information) (S1110).
  • the decoding apparatus 200 may derive neighboring reference samples of the current block (S1120).
  • the decoding apparatus 200 generates prediction samples in the current block based on the intra prediction mode/type and surrounding reference samples (S1130).
  • the decoding apparatus 200 may perform a prediction sample filtering procedure. Predictive sample filtering may be referred to as post filtering. Some of the prediction samples or the government may be filtered by the prediction sample filtering procedure. In some cases, the prediction sample filtering procedure may be omitted.
  • the decoding apparatus 200 generates residual samples for the current block based on the received residual information.
  • the decoding apparatus 200 may generate a reconstructed sample for the current block based on the prediction samples and the residual samples, and derive a reconstructed block including the reconstructed samples (S1140).
  • a reconstructed picture for the current picture may be generated based on the reconstructed block.
  • the in-loop filtering procedure for the reconstructed picture may be further applied.
  • the intra prediction unit 265 of the decoding apparatus 200 may include an intra prediction mode/type determination unit 266, a reference sample derivation unit 267, and a prediction sample derivation unit 268, and the intra prediction mode
  • the /type determination unit 266 determines an intra prediction mode/type for the current block based on the intra prediction mode/type information generated and signaled by the intra prediction mode/type determination unit 186 of the encoding apparatus 100 .
  • the reference sample derivation unit 267 may derive neighboring reference samples of the current block, and the prediction sample derivation unit 267 may derive prediction samples of the current block.
  • the intra prediction unit 265 may further include a prediction sample filter unit (not shown).
  • Intra prediction mode information may include flag information (eg, intra_luma_mpm_flag) indicating whether, for example, most probable mode (MPM) is applied to a current block or a remaining mode is applied, MPM
  • the prediction mode information may further include index information (eg, intra_luma_mpm_idx) indicating one of intra prediction mode candidates (MPM candidates).
  • Intra prediction mode candidates may be composed of an MPM candidate list or an MPM list.
  • the intra prediction mode information may further include remaining mode information (eg, intra_luma_mpm_remainder) indicating one of the remaining intra prediction modes except for intra prediction mode candidates (MPM candidates). I can.
  • the decoding apparatus 200 may determine an intra prediction mode of the current block based on the intra prediction mode information.
  • the intra prediction type information may be implemented in various forms.
  • the intra prediction type information may include intra prediction type index information indicating one of the intra prediction types.
  • the intra prediction type information includes reference sample line information indicating whether the MRL is applied to the current block and the number of reference sample lines used when the MRL is applied (eg, intra_luma_ref_idx), and whether the ISP is applied to the current block.
  • ISP flag information e.g., intra_subpartitions_mode_flag
  • ISP type information indicating the split type of subpartitions when the ISP is applied
  • flag information indicating whether to apply PDPC, or indicating whether to apply LIP It may include at least one of flag information.
  • Intra prediction mode information and/or intra prediction type information may be encoded/decoded through the coding method described in this document.
  • intra prediction mode information and/or intra prediction type information may be encoded/decoded through entropy coding (eg, CABAC, CAVLC) based on a truncated (rice) binary code. have.
  • entropy coding eg, CABAC, CAVLC
  • an intra prediction mode applied to the current block may be determined using an intra prediction mode of a neighboring block.
  • the decoding apparatus 200 receives one of the MPM candidates in the MPM list derived based on the intra prediction mode of the neighboring block (eg, left and/or upper neighboring block) of the current block and additional candidate modes. It may be selected based on the index, or one of the remaining intra prediction modes that are not included in the MPM candidates may be selected based on the remaining intra prediction mode information. For example, whether the intra prediction mode applied to the current block is among MPM candidates or is in the remaining mode may be indicated based on an MPM flag (eg, intra_luma_mpm_flag).
  • an MPM flag eg, intra_luma_mpm_flag
  • the value of the MPM flag of 1 indicates that the intra prediction mode for the current block is in the MPM candidates (MPM list), and the value of the MPM flag is 0 indicates that the intra prediction mode for the current block is in the MPM candidates (MPM list). May indicate that it does not exist.
  • the MPM index may be signaled in the form of a syntax element such as mpm_idx or intra_luma_mpm_idx, and the remaining intra prediction mode information may be signaled in the form of a syntax element such as rem_intra_luma_pred_mode or intra_luma_mpm_remainder.
  • the remaining intra prediction mode information may index the remaining intra prediction modes that are not included in MPM candidates among all intra prediction modes and indicate one of them.
  • the intra prediction mode may be an intra prediction mode for a luminance component (sample).
  • the intra prediction mode information may include at least one of an MPM flag (eg, intra_luma_mpm_flag), an MPM index (eg, mpm_idx or intra_luma_mpm_idx), or remaining intra prediction mode information (eg, rem_intra_luma_pred_mode or intra_luma_mpm_remainder).
  • the MPM list may be referred to in various terms such as an MPM candidate list and candModeList.
  • the intra prediction mode signaling procedure in the encoding apparatus 100 and the intra prediction mode determination procedure in the decoding apparatus 200 may be performed as shown in FIGS. 13 and 14.
  • FIG. 13 shows an example of a flowchart for encoding intra prediction information in a process of encoding a video signal according to an embodiment of the present specification.
  • the encoding apparatus 100 constructs an MPM list for a current block (S1310).
  • the MPM list may include candidate intra prediction modes (MPM candidates) that are likely to be applied to the current block.
  • the MPM list may include intra prediction modes of neighboring blocks, or may further include specific intra prediction modes according to a predetermined method. A detailed MPM list construction method will be described later.
  • the encoding apparatus 100 determines an intra prediction mode of the current block (S1320).
  • the encoding apparatus 100 may perform prediction based on various intra prediction modes, and may determine an optimal intra prediction mode based on rate-distortion optimization (RDO) based thereon.
  • RDO rate-distortion optimization
  • the encoding apparatus 100 may determine the optimal intra prediction mode by using only the MPM candidates configured in the MPM list, or by further using the remaining intra prediction modes as well as the MPM candidates configured in the MPM list. You can decide.
  • the intra prediction type of the current block is a specific type (eg, LIP, MRL, or ISP)
  • the encoding apparatus 100 considers only MPM candidates as intra prediction mode candidates for the current block, The prediction mode can be determined.
  • the intra prediction mode for the current block may be determined only among MPM candidates, and encoding/signaling of the MPM flag may not be performed.
  • the decoding apparatus 200 may infer that the MPM flag is 1 without separately decoding the MPM flag.
  • the encoding apparatus 100 when the intra prediction mode of the current block is one of MPM candidates in the MPM list, the encoding apparatus 100 generates an MPM index (mpm_idx) indicating one of the MPM candidates. If the intra prediction mode of the current block is not in the MPM list, the encoding apparatus 100 remines intra prediction mode information indicating the same mode as the intra prediction mode of the current block among the remaining intra prediction modes not included in the MPM list. Create
  • the encoding apparatus 100 may encode intra prediction mode information and output it in the form of a bitstream.
  • the intra prediction mode information may include the above-described MPM flag, MPM index, and/or remaining intra prediction mode information. Since the MPM index and the remaining intra prediction mode information indicate an intra prediction mode for one block in an alternative relationship, they are not signaled at the same time. That is, the MPM flag value 1 and the MPM index are signaled together, or the MPM flag 0 and the remaining intra prediction mode information are signaled together. However, as described above, when a specific intra prediction type is applied to the current block, the MPM flag may not be signaled and only the MPM index may be signaled. That is, in this case, the intra prediction mode information may include only the MPM index.
  • the decoding device 200 may determine an intra prediction mode in response to intra prediction mode information determined and signaled by the encoding device 100.
  • the decoding apparatus 200 acquires intra prediction mode information from a bitstream (S1410).
  • the intra prediction mode information may include at least one of an MPM flag, an MPM index, and a remaining intra prediction mode index.
  • the decoding apparatus 200 constructs an MPM list (S1420).
  • the MPM list is configured in the same way as the MPM list configured in the encoding device 100. That is, the MPM list may include intra prediction modes of neighboring blocks, or may further include specific intra prediction modes according to a predetermined method. Specifically, the MPM list construction method will be described later.
  • step S1420 is performed after step S1410, this is only an example, and step S1420 may be performed before step S1410 or may be performed simultaneously.
  • the decoding apparatus 200 determines an intra prediction mode of the current block based on the MPM list and intra prediction mode information (S1430). For example, when the value of the MPM flag is 1, the decoding apparatus 200 may derive a candidate indicated by the MPM index from among MPM candidates in the MPM list as the intra prediction mode of the current block. As another example, when the value of the MPM flag is 0, the decoding apparatus 200 derives an intra prediction mode indicated by the remaining intra prediction information from among the remaining intra prediction modes not included in the MPM list as the intra prediction mode of the current block. can do.
  • the decoding apparatus 200 selects a candidate indicated by the MPM index in the MPM list without checking the MPM flag. It can also be derived as the intra prediction mode of the current block.
  • FIG. 15. 15 illustrates an example of a flowchart for determining an intra prediction mode in a process of decoding a video signal according to an embodiment of the present specification.
  • FIG. 16 shows an example of 33 directional intra prediction modes according to an embodiment of the present specification
  • FIG. 17 shows an example of 65 directional intra prediction modes according to an embodiment of the present specification.
  • the intra prediction mode may include, for example, two non-directional intra prediction modes and 33 directional intra prediction modes.
  • the non-directional intra prediction modes may include a planar intra prediction mode and a DC intra prediction mode, and the directional intra prediction modes may include 2 to 34 intra prediction modes.
  • the planar intra prediction mode may be referred to as a planner mode, and the DC intra prediction mode may be referred to as a DC mode.
  • directional intra prediction modes may be extended from 33 to 65 as shown in FIG. 17.
  • the intra prediction mode may include two non-directional intra prediction modes and 65 directional intra prediction modes.
  • the extended directional intra prediction modes can be applied to blocks of all sizes, and can be applied to both a luminance component and a color difference component.
  • the intra prediction mode may include two non-directional intra prediction modes and 129 directional intra prediction modes.
  • Non-directional intra prediction modes may include a planar intra prediction mode and a DC intra prediction mode, and the directional intra prediction modes may include intra prediction modes 2 to 130.
  • the intra prediction mode may further include a cross-component linear model (CCLM) mode for color difference samples in addition to the aforementioned intra prediction modes.
  • CCLM cross-component linear model
  • the CCLM mode can be classified into LT_CCLM, L_CCLM, and T_CCLM depending on whether a left sample is considered, an upper sample is considered, or both are considered to derive an LM parameter, and can be applied only to a color difference component.
  • the intra prediction mode may be indexed, for example, as shown in Table 1 below.
  • the intra prediction type (or additional intra prediction mode) may include at least one of the aforementioned LIP, PDPC, MRL, and ISP.
  • the intra prediction type may be indicated based on intra prediction type information, and the intra prediction type information may be implemented in various forms.
  • the intra prediction type information may include intra prediction type index information indicating one of the intra prediction types.
  • the intra prediction type information includes reference sample line information (e.g., intra_lumma_ref_idx) indicating whether MRL is applied to the current block and in which case the reference sample line is used, and when the ISP is applied, the split type of subpartitions It may include at least one of indicating ISP type information (eg, intra_subpartitions_split_flag), flag information indicating whether PDPC is applied, or flag information indicating whether LIP is applied.
  • reference sample line information e.g., intra_lumma_ref_idx
  • the split type of subpartitions It may include at least one of indicating ISP type information (eg, intra_subpartitions_split_flag), flag information indicating whether PDPC is applied, or flag information indicating whether LIP is applied.
  • the encoder can use the intra prediction mode of the neighboring block to encode the intra prediction mode of the current block.
  • the encoder/decoder may construct an MPM list for the current block.
  • the MPM list may also be referred to as an MPM candidate list.
  • MPM may mean a mode used to improve coding efficiency in consideration of similarity between a current block and a neighboring block when coding an intra prediction mode.
  • a method of configuring an MPM list including three MPM candidates may be used in order to keep the complexity for generating the MPM list low.
  • the MPM list may include 3 MPM candidates.
  • a remanufacturing mode may be used.
  • the remaining mode includes 64 remaining candidates, and information on the remaining intra prediction mode indicating one of the 64 remaining candidates may be signaled.
  • the remaining intra prediction mode information may include a 6-bit syntax element (eg, rem_intra_luma_pred_mode).
  • MCM most probable mode
  • the encoder may check or derive the prediction mode of the neighboring block (S1810). For example, the encoder may determine the prediction mode of the current block based on the prediction mode of the left neighboring block and the prediction mode of the upper neighboring block, and at this time, the prediction mode of the corresponding neighboring block may be determined as MPM. Determining the MPM may be expressed as listing up MPM candidates (or MPM list).
  • the encoder checks whether the prediction mode of the left neighboring block and the prediction mode of the upper neighboring block are the same (S1820).
  • the initial MPM list may be formed by performing a pruning process for intra prediction modes of two adjacent blocks.
  • the first MPM may be set as the prediction mode of the left neighboring block, and the second MPM may be determined as the prediction mode of the upper neighboring block.
  • the MPM may be set to one of an intra planner mode, an intra DC mode, or an intra vertical mode (50th intra prediction mode) (S1830).
  • the two intra prediction modes may be set as MPM, and one of the default intra modes is added to the MPM list after pruning check by MPMs.
  • the default intra modes may include an intra planner mode, an intra DC mode, and/or an intra vertical mode (50th intra prediction mode).
  • the MPM list may be configured as follows.
  • A denotes an intra prediction mode of the left neighboring block
  • B denotes an intra prediction mode of an upper neighboring block
  • 0 denotes an intra planner mode
  • 1 denotes an intra DC mode
  • 50 denotes an intra vertical mode
  • candModeList denotes an MPM list.
  • the encoder may determine whether the prediction mode of the left neighboring block is less than 2 (S1840).
  • the first MPM may be set to an intra planner mode
  • the second MPM may be set to an intra DC mode
  • the third MPM is an intra vertical mode (50th intra prediction mode). It may be set to (S1850).
  • the first MPM may be set as the prediction mode of the left neighboring block
  • the second MPM may be set to (prediction mode of the left neighboring block-1)
  • the third The MPM may be set to (prediction mode of the left neighboring block + 1) (S1860).
  • the MPM list may be configured as described later.
  • candModeList [3] ⁇ 0, 1, 50 ⁇ .
  • candModeList[3] (A, 2 + ((A + 61)% 64 ), 2 + ((A-1)% 64 ) ⁇
  • A denotes an intra prediction mode of the left neighboring block
  • B denotes an intra prediction mode of an upper neighboring block
  • 0 denotes an intra planner mode
  • 1 denotes an intra DC mode
  • 50 denotes an intra vertical mode
  • candModeList denotes an MPM list.
  • an additional pruning process may be performed to remove duplicate modes so that only unique modes can be included.
  • a 6-bit fixed length code (6-bit FLC) may be used for entropy coding of 64 non-MPM modes excluding 3 MPMs. That is, an index representing 64 non-MPM modes may be entropy-coded with a 6-bit fixed length code.
  • the encoder may determine whether an optimal intra prediction mode to be applied to the current block belongs to the previously configured MPM candidate. If the intra prediction mode of the current block belongs to the MPM candidate, the encoder may encode the MPM flag and the MPM index.
  • the MPM flag may indicate whether the intra prediction mode of the current block is derived from a neighboring intra-prediction block (ie, whether the intra prediction mode of the current block belongs to the MPM list).
  • the MPM index may indicate which MPM mode is applied as an intra prediction mode of the current block among MPM candidates. On the other hand, if the intra prediction mode of the current block does not belong to the MPM candidate, the encoder may encode the intra prediction mode of the current block.
  • the encoder/decoder may configure an MPM list including 6 MPMs.
  • the following three types of modes can be considered.
  • two neighboring blocks that is, a left neighboring block A and an upper neighboring block B may be considered.
  • the following initialized default MPM list may be considered.
  • 6-MPMs are updated by performing a pruning process for two neighboring intra modes. If the two neighboring modes are the same and larger than the DC mode (1), 6-MPMs are added to the three default modes (A, planner, DC) and the neighboring mode, and a predefined offset value is added to the modular operation. It will contain three derived modes obtained by. Otherwise, if the two neighboring modes are different from each other, the two neighboring modes are allocated to the first two MPM modes and the remaining four MPM modes are derived from the default modes and neighboring modes. During the 6-MPM list creation process, pruning is used to remove identical modes so that unique modes can be included in the MPM list. For entropy coding of 61 non-MPM modes, a truncated binary code (TBC) is used.
  • TBC truncated binary code
  • neighboring reference samples to be used for intra prediction of the current block may be derived.
  • the neighboring reference samples of the current block are a sample adjacent to the left boundary of the current block of size nWxnH and a total of 2xnH samples adjacent to the bottom-left, a sample adjacent to the top boundary of the current block, and A total of 2xnW samples adjacent to the top-right side and one sample adjacent to the top-left side of the current block may be included.
  • the peripheral reference samples of the current block may include upper peripheral samples of a plurality of columns and left peripheral samples of a plurality of rows.
  • the decoder may construct surrounding reference samples to be used for prediction through interpolation of available samples.
  • the decoder may construct surrounding reference samples to be used for prediction through extrapolation of available samples. Substitute or padding pixels that have not yet been decoded or available with the latest referenceable sample, updating the referenceable sample with the latest sample, starting at the bottom left and until reaching the top right reference sample. can do.
  • MDL Multiple reference line
  • intra prediction only neighboring samples of the upper first line and the neighboring samples of the left first line of the current block are used as reference samples for intra prediction.
  • intra prediction may be performed by using as reference samples neighboring samples located in sample lines separated by 1 to 3 sample distances in the upper and/or left direction of the current block.
  • 19 shows examples of reference samples taking into account multi-reference line (MRL) intra prediction according to an embodiment of the present specification.
  • 19 shows directly neighboring (closest) reference samples at reference line 0 and extended reference samples at reference lines 1 to 3 used in MRL intra prediction.
  • the MRL index (eg, mrl_idx) indicates which line is used for intra prediction for the current block.
  • the MRL index may be signaled through the coding unit syntax as shown in Table 2 below.
  • the MRL index may be signaled in the form of a syntax element intra_luma_ref_idx.
  • intra_luma_ref_idx [x0][y0] represents the intra reference line index IntraLumaRefLineIdx[x0][y0] defined as shown in Table 3 below.
  • intra_luma_ref_idx may be referred to as a (intra) reference sample line index, a reference line index, or mrl_idx. Also, intra_luma_ref_idx may be referred to as intra_luma_ref_line_idx.
  • Table 3 shows the values of IntraLumaRefLineIdx[x0][y0] according to intra_luma_ref_idx[x0][y0].
  • the MRL may be disabled for a block of the first line (row) in the CTU. This is to prevent samples of extended reference lines outside the current CTU line from being used. Also, when the above-described additional reference line is used, the PDPC may not be available.
  • ISP Intra Sub-Partition
  • a block to be currently encoded is regarded as one coding unit, and coding is performed without splitting.
  • the ISP method performs intra prediction encoding by dividing a block to be currently encoded in a horizontal direction or a vertical direction. In this case, a reconstructed block is generated by performing encoding/decoding in units of divided blocks, and the reconstructed block is used as a reference block of the next divided block.
  • blocks are divided as shown in Table 4 below based on the block size.
  • FIGS 20A and 20B illustrate an example of block division according to an intra sub-partition (ISP) according to an embodiment of the present specification.
  • ISP intra sub-partition
  • the ISP method determines an optimal mode by generating an MPM according to each division method (horizontal division and vertical division) in order to reduce coding complexity and comparing an appropriate prediction mode among prediction modes in the generated MPM list from an RDO perspective.
  • the ISP may not be used. That is, ISP intra prediction can be applied only when the 0th reference line is used (that is, when intra_luma_ref_idx is 0). Also, when the ISP method is used, the PDPC cannot be used.
  • the ISP intra prediction method first encodes/decodes information indicating whether the ISP is applied (e.g., intra_subparitions_mode_flag) in block units, and if the ISP is applied to the current block, information about whether it is horizontal or vertical (intra_subpartitions_split_flag) is encoded. /Decoded. Table 5 below shows an example of the syntax structure reflecting the ISP.
  • the intra prediction mode for the current block is equally applied to each subpartition (subblocks), and the intra prediction performance can be improved by deriving neighboring reference samples in units of subpartitions. That is, when ISP intra prediction is applied, a residual sample processing procedure is performed in units of sub-partitions.
  • intra prediction samples are derived for each subpartition, and reconstructed samples are obtained by adding a residual signal (residual samples) for the corresponding subpartition to this.
  • the residual signal (residual samples) may be derived through an inverse quantization/inverse transform procedure based on residual information (quantized transform coefficient information or residual coding syntax) in the above-described bitstream.
  • prediction samples for the first subpartition are derived and residual samples are derived, and reconstructed samples for the first subpartition may be derived based on this.
  • some of the reconstructed samples in the first subpartition eg, left or upper peripheral reference samples of the second subpartition
  • peripheral reference samples for the second subpartition e.g. left or upper peripheral reference samples of the second subpartition
  • prediction samples for the second subpartition and residual samples may be derived, and reconstructed samples for the second subpartition may be derived based on this.
  • some of the reconstructed samples eg, left or upper peripheral reference samples of the third subpartition
  • an interpolation filter for interpolation may be derived through various methods.
  • the interpolation filter may be determined based on at least one of a size of a current block and an intra prediction mode applied to the current block.
  • the interpolation filter may include, for example, a Gaussian filter and a Cubic filter.
  • a filter for mitigating a block boundary may be applied in order to reduce an error between prediction samples of the current block and neighboring samples that have already been reconstructed. For example, whether to apply an intra boundary filter and a filter type may be determined according to the predicted mode and the size of the block.
  • intra prediction When intra prediction is performed on the current block, prediction of a luminance component block (luminance block) of the current block and prediction of a chrominance component block (color difference block) may be performed.
  • the intra prediction mode may be set separately from the corresponding intra prediction mode in the luminance component (luminance block).
  • the intra prediction mode for the color difference component may be indicated based on intra chroma prediction mode information
  • the intra chroma prediction mode information may be indicated in the form of a syntax element intra_chroma_pred_mode
  • the intra chroma prediction mode information is a planar mode.
  • DC mode, vertical mode, horizontal mode, DM (Derived Mode) it may indicate one of the CCLM mode.
  • the planar mode may represent a 0th intra prediction mode, a DC mode 1st intra prediction mode, a vertical mode 26th intra prediction mode, and a horizontal mode 10th intra prediction mode.
  • DM may also be referred to as direct mode.
  • CCLM may be referred to as LM.
  • DM and CCLM are dependent intra prediction modes for predicting a color difference block using information on a luminance block.
  • the DM may represent a mode in which an intra prediction mode identical to an intra prediction mode for a luminance component is applied as an intra prediction mode for a color difference component.
  • the CCLM subsamples the reconstructed samples of the luminance block in the process of generating the predictive samples for the color difference block, and then applies the CCLM parameters ( ⁇ , ⁇ ) to the subsampled samples. Intra prediction mode used as prediction samples of may be indicated.
  • FIG. 21 is a diagram for explaining a multiple direct mode (DM) for intra prediction of a chroma block according to an embodiment of the present specification.
  • DM multiple direct mode
  • MDM Multiple direct mode
  • the DM mode which is an existing single mode, is extended and used in a plurality of modes. That is, when configuring the intra prediction mode of the color difference image, a plurality of DM modes may be selected as follows.
  • the CCLM mode can be applied to the current chroma block.
  • the CCLM mode is an intra prediction mode using correlation between a luminance block and a color difference block corresponding to the luminance block.
  • a linear model may be derived based on surrounding samples of the luminance block and the surrounding samples of the chrominance block, and prediction samples of the chrominance block may be derived based on the linear model and reconstructed samples of the luminance block. More specifically, when the CCLM mode is applied to the current chrominance block, parameters for the linear model are derived based on the surrounding samples used for intra prediction of the current chrominance block and the surrounding samples used for intra prediction of the current luminance block. Can be.
  • the linear model may be expressed based on Equation 1 below.
  • pred c (i,j) represents a predicted sample of the (i,j) locus of the current color difference block
  • rec L '(i,j) represents a reconstructed sample of the (i,j) coordinates of the current luminance block
  • rec L '(i,j) may represent a down-sampled reconstructed sample of the current luminance block.
  • CCLM cross-component linear model
  • the parameters ⁇ and ⁇ of the linear model may be derived based on surrounding samples used for intra prediction of the current luminance block and surrounding samples used for intra prediction of the current color difference block.
  • the parameters ⁇ and ⁇ may be derived based on Equations 2 and 3 below.
  • L(n) may represent upper peripheral samples and/or left peripheral samples of the current luminance block
  • C(n) may represent upper peripheral samples and/or left peripheral samples of the current color difference block
  • L(n) may represent down-sampled upper peripheral samples and/or left peripheral samples of the current luminance block
  • N may represent a value that is twice the smaller of the width and height of the current color difference block.
  • the 8 intra prediction modes may include 5 existing intra prediction modes and CCLM mode(s).
  • Table 6 below shows a mapping table for deriving intra-chroma prediction mode when CCLM is not available (sps_cclm_enabled_flag is 0), and Table 7 shows intra prediction when CCLM is enabled (sps_cclm_enabled_flag is 1) Represents a mapping table for mode derivation.
  • the intra-chroma prediction mode is an intra luma prediction mode and a signaled intra-chroma prediction mode for a luminance block (e.g., when DUAL_TREE is applied) covering a current block or a center-right lower sample of the chroma block It may be determined based on the value of (intra_chroma_pred_mode) information.
  • the indices of IntraPredModeC[xCb][yCb] derived from Tables 7 and 8 may correspond to the indexes of the intra prediction modes of Table 1.
  • Embodiments described below provide a method for constructing a unified MPM list according to.
  • Embodiments of the present specification provide a method of generating (modifying) an MPM list using a unified method when constructing an MPM list in a process of encoding/decoding intra prediction information.
  • a structure for encoding/decoding intra prediction information can be simplified and efficiency of encoding/decoding intra prediction information can be increased.
  • Embodiments described below provide a method of constructing an MPM list using a unified method for a plurality of intra prediction types (eg, MRL intra prediction, ISP intra prediction).
  • Example 1 is, after generating an MPM list using a unified method, constructing an MPM list for each of conventional intra prediction (first type), MRL intra prediction (second type), and ISP intra prediction (third type) Provides a way.
  • Embodiment 2 provides a method of generating an MPM list for MRL intra prediction and ISP intra prediction in consideration that a DC mode may be additionally used in MRL intra prediction after generating an MPM list using a unified method.
  • Embodiment 3 provides a method for performing optimal encoding/decoding based on a method of constructing an MPM list using the unified method proposed in Embodiments 1 and 2.
  • Embodiments of the present specification are a single unified method for generating an MPM candidate list used in conventional intra prediction (first type), MRL intra prediction (second type), and ISP intra prediction (third type). It should be done in a way.
  • Conventional intra prediction uses 67 intra prediction modes to encode/decode intra prediction information
  • MRL intra prediction uses 65 intra prediction modes excluding planar mode and DC mode to encode/decode intra prediction information.
  • ISP intra prediction performs encoding/decoding of intra prediction information using 66 intra prediction modes excluding the DC mode. Since the three types of intra predictions perform encoding/decoding of intra prediction information using different numbers of intra prediction modes, methods of generating an MPM candidate list for each prediction are different.
  • (conventional) intra prediction in which a reference sample located in a line adjacent to the current block is used and the current block is not divided by the ISP (hereinafter, first type intra prediction) is performed using all 67 intra prediction modes.
  • An MPM candidate list including two MPM candidates is constructed.
  • MRL intra prediction in which a reference sample located on a line separated by more than 2 samples from the current block is used (hereinafter, second type intra prediction) uses 65 intra prediction modes excluding planar mode and DC mode, so planar mode and DC mode
  • An MPM candidate list having 6 MPM candidates is constructed using 65 intra prediction modes except for.
  • an MPM candidate list having 6 MPM candidates is constructed by using the excluded 66 intra prediction modes.
  • an MPM candidate list is constructed in different ways according to horizontal division and vertical division. In this way, an MPM candidate list having six MPM candidates is generated through different methods for one intra prediction.
  • an embodiment of the present specification provides a method of generating an MPM candidate list using a unified method.
  • Example 1 is, after generating an MPM list using a unified method, constructing an MPM list for each of conventional intra prediction (first type), MRL intra prediction (second type), and ISP intra prediction (third type) Provides a way.
  • Embodiment 2 provides a method of generating an MPM list for MRL intra prediction and ISP intra prediction in consideration that a DC mode may be additionally used in MRL intra prediction after generating an MPM list using a unified method.
  • Embodiment 3 provides a method for performing optimal encoding/decoding based on a method of constructing an MPM list using the unified method proposed in Embodiments 1 and 2.
  • the present embodiment provides a method for constructing each MPM list for conventional intra prediction, MRL intra prediction, and ISP intra prediction after generating an MPM candidate list using a unified method.
  • a method of generating an MPM candidate list having 6 MPM candidates used in the first type intra prediction is divided into a second type intra prediction (MRL intra prediction) and a third type intra prediction ( The same applies to ISP intra prediction).
  • a method of generating an MPM candidate list having six MPM candidate lists used in the first type intra prediction may be a conventional MPM candidate list generating method or an improved method from the conventional MPM candidate list.
  • the method of generating the 6 MPM candidate lists used in the first type intra prediction includes a planar mode and a DC mode because the MPM candidate list is generated by considering all 67 intra prediction modes.
  • the second type intra prediction does not use the planar mode and the DC mode
  • the third type intra prediction ISP intra prediction
  • the MPM candidate list construction method includes a method of generating an MPM candidate list having six MPM candidates used in the first type intra prediction (or a method of generating six MPM candidate lists improved through various improvement methods).
  • An MPM candidate list having 6 MPM candidates is equally generated by applying the same to a method of generating an MPM candidate list of type 2 intra prediction and type 3 intra prediction.
  • MRL intra prediction does not use the planar mode and the DC mode
  • ISP intra prediction does not use the DC mode
  • the MPM candidate list is changed to be suitable for the corresponding prediction type by removing a mode that is not used for each prediction type from the MPM candidate list having.
  • FIG. 23A to 23C illustrate an example of a method of constructing an MPM candidate list based on an intra prediction type according to an embodiment of the present specification.
  • FIG. 23A is a method for configuring an MPM candidate list according to a first type intra prediction (existing intra prediction)
  • FIG. 23B is a method for configuring an MPM candidate list according to a second type intra prediction (MRL intra prediction)
  • FIG. 23C is a third type intra prediction.
  • ISP intra prediction An example of a method of constructing an MPM candidate list according to prediction
  • a method of generating an MPM candidate list having six candidates used in the first type intra prediction is applied equally to the method of generating an MPM candidate list of the second type intra prediction and the ISP intra prediction.
  • the MPM candidates in the MPM candidate list are rearranged after the planar mode and the DC mode are removed from the MPM candidate list having six candidates that are initially generated.
  • the planner mode corresponding to the 0th MPM index and the DC mode corresponding to the 2nd MPM index are removed from the MPM candidate list, and the remaining 4 MPM candidates are rearranged to have 4 MPM candidates.
  • a candidate list is constructed.
  • the MPM candidates are rearranged after the DC mode is removed from the initially generated MPM candidate list having 6 candidates. As shown in FIG. 23C, the DC mode corresponding to the second MPM index is removed from the MPM candidate list, and the remaining five MPM candidates are rearranged to form an MPM candidate having five MPM candidates.
  • 23A to 23C are diagrams for explaining an example of a method for constructing an MPM candidate list, and a method according to an embodiment of the present specification includes 6 candidates according to a first type intra prediction (existing intra prediction).
  • An MPM candidate list is generated, and the MPM candidate list is similarly used for the second type intra prediction (MRL intra prediction) and the third type intra prediction (ISP intra prediction).
  • MRL intra prediction second type intra prediction
  • ISP intra prediction third type intra prediction
  • the MPM candidate Rearrange the list since the planar mode and the DC mode are not used in the case of the second type intra prediction (MRL intra prediction), if there are planar mode and DC mode in the initially generated MPM candidate list, the MPM candidate Rearrange the list.
  • the planar mode and the DC mode are removed and the rearranged MPM candidate list may be used for a block to which the second type intra prediction is applied.
  • the MPM candidate list is rearranged while removing the DC mode.
  • the DC mode is removed and the rearranged MPM candidate list may be used for a block to which the third type intra prediction is applied.
  • the DC mode is enabled in the second type intra prediction (MRL intra prediction), and in consideration of this, the first type intra prediction (the existing intra prediction ), a second type intra prediction (MRL intra prediction), and a method of generating an MPM candidate list for a third type intra prediction (ISP intra prediction).
  • MRL intra prediction the second type intra prediction
  • ISP intra prediction a third type intra prediction
  • the method of generating an MPM candidate list having 6 MPM candidates used in the first type intra prediction is equally applied to the second type intra prediction and the third type intra prediction.
  • a method of generating an MPM candidate list having six MPM candidate lists used in the first type intra prediction may be a conventional MPM candidate list generating method or an improved method from the conventional MPM candidate list.
  • the DC mode can be used for the second type intra prediction
  • the second type intra prediction does not use the planar mode
  • the third type intra prediction does not use the DC mode.
  • each MPM candidate list is constructed (changed) in consideration of this.
  • the method according to the present embodiment is a second method of generating an MPM candidate list having six candidates used in the first type intra prediction (or a method of generating an MPM candidate list having six candidates improved through various improvement methods).
  • An MPM candidate list having the same 6 candidates is generated by applying the same to a method of generating an MPM candidate list for type intra prediction and third type intra prediction. Since the 1st type intra prediction does not use the planar mode and the 2nd type intra prediction does not use the DC mode, it is suitable for the corresponding prediction method by removing the mode not used in each prediction method from the 6 MPM lists generated identically. Reorganize (change) the MPM candidate list to do so.
  • FIG. 24A to 24C illustrate another example of a method of constructing an MPM candidate list based on an intra prediction type according to an embodiment of the present specification.
  • FIG. 24A is a method for configuring an MPM candidate list according to a first type intra prediction (existing intra prediction)
  • FIG. 24B is a method for configuring an MPM candidate list according to a second type intra prediction (MRL intra prediction)
  • FIG. 24C is a third type intra prediction.
  • ISP intra prediction An example of a method of constructing an MPM candidate list according to prediction
  • the method of generating an MPM candidate list having 6 candidates used in the first type intra prediction is the second type intra prediction (MRL intra prediction) and the third type.
  • MDL intra prediction second type intra prediction
  • ISP intra prediction intra prediction
  • the planner mode is removed in the MPM candidate list having 6 candidates initially generated, and the MPM candidates in the MPM candidate list are rearranged. As shown in FIG. 24B, the planar mode corresponding to the 0th MPM index is removed, and the remaining MPM candidates are rearranged to form an MPM candidate list having 5 MPM candidates.
  • the DC mode is not used. Accordingly, after the DC mode is removed from the MPM list having 6 candidates initially generated, the MPM candidates in the MPM candidate list are rearranged. As shown in FIG. 24C, the DC mode corresponding to the second MPM index is removed and the remaining MPM candidates are rearranged, thereby constructing an MPM list having five MPM candidates.
  • this embodiment Based on the method of generating an MPM candidate list using the unified method proposed in Embodiments 1 and 2, this embodiment provides a method of performing encoder optimization.
  • MPM candidate list in the existing third type intra prediction different MPM candidate lists are generated according to the division type (horizontal division or vertical division) of the current block. That is, the MPM candidate list for horizontal division and the MPM candidate list for vertical division are generated differently (separately).
  • the optimal intra prediction mode for the current block candidate modes generated from the first type intra prediction (existing intra prediction), candidate modes selected from the MPM candidate list generated for horizontal division, and vertical division The mode with the lowest cost is selected from the viewpoint of rate-distortion optimization (RDO) of candidate modes selected in the generated MPM candidate list.
  • RDO rate-distortion optimization
  • this embodiment provides a method of performing encoder optimization based on a method of generating an MPM candidate list using the unified method proposed in Embodiments 1 and 2.
  • Embodiment 3 can be applied to a decoder, and the computational complexity and hardware size of the decoder can be reduced by using a method of generating a unified MPM candidate list.
  • the method of constructing a unified MPM candidate list proposed in Embodiments 1 and 2 is, when generating an MPM candidate list for a third type intra prediction (ISP intra prediction), the current block division type (horizontal division or vertical division) Splitting) is not considered and one MPM candidate list is generated using a unified MPM candidate list generation method. That is, as shown in FIGS. 23A to 24C, the encoder/decoder creates one unified MPM list regardless of the division type of the current block. Therefore, in comparison with the method of generating each MPM candidate list in consideration of the partition type of the current block, according to the method proposed in this embodiment, the encoder/decoder is a block to which the third type intra prediction (ISP intra prediction) is applied.
  • ISP intra prediction third type intra prediction
  • a single MPM candidate list is generated for and for this purpose, one buffer is allocated.
  • candidate modes generated from a first type intra prediction conventional intra prediction
  • one generated for a third type intra prediction ISP intra prediction
  • the mode with the lowest cost is selected from the viewpoint of RDO, respectively.
  • ISP intra prediction when generating an MPM candidate list for third type intra prediction (ISP intra prediction), since only one MPM candidate list is generated regardless of the partition type, the complexity of the encoder required for MPM generation is reduced. Also, since only one buffer is used for the MPM candidate list, the hardware size of the encoder can be reduced.
  • the method proposed in the embodiments of the present specification may simplify the encoding/decoding structure for intra prediction by using a unified method in the process of constructing an MPM candidate list.
  • the encoded information (eg, encoded video/video information) derived by the encoding apparatus 100 based on the above-described embodiments of the present specification may be output in a bitstream form.
  • the encoded information may be transmitted or stored in a bitstream form in units of network abstraction layer (NAL) units.
  • NAL network abstraction layer
  • the bitstream may be transmitted over a network or may be stored in a non-transitory digital storage medium.
  • the bitstream is not directly transmitted from the encoding device 100 to the decoding device 200, but may be provided with a streaming/download service through an external server (eg, a content streaming server).
  • the network may include a broadcasting network and/or a communication network
  • the digital storage medium may include various storage media such as USB, SD, CD, DVD, Blu-ray, HDD, and SSD.
  • FIG. 25 illustrates an example of a flowchart for intra prediction in an encoding process of a video signal according to an embodiment of the present specification.
  • the operations of FIG. 25 may be performed by the encoding device 100 or the video signal processing device 500. More specifically, it may be performed by the intra prediction unit 185 (intra prediction mode/type determination unit 186 of FIG. 10) in the encoding apparatus 100 of FIG. 25, and the video signal processing apparatus 500 It can be performed by the processor 510 of.
  • steps S2510 to S2530 of FIG. 25 may correspond to an example of step S910 of FIG. 9, and step S2540 of FIG. 25 may correspond to an example of step S930 of FIG. 9.
  • the encoder generates an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block. For example, the encoder generates an MPM candidate list based on the intra prediction mode of the left neighboring block and the upper neighboring block of the current block.
  • the encoder generates a single MPM candidate list regardless of the intra prediction type of the current block (general intra prediction, MRL intra prediction, and ISP intra prediction).
  • the encoder may generate the same MPM candidate list regardless of the ISP division direction (vertical direction, horizontal direction).
  • step S2520 the encoder changes the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type. That is, with respect to a single MPM candidate list generated regardless of the intra prediction type, the encoder checks whether or not an unused mode exists for each intra prediction type. If there is a mode that cannot be used in the corresponding intra prediction, the mode is removed from the MPM candidate list. Prior to or concurrently with step S2520, the encoder may determine the intra prediction type of the current block.
  • the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided (existing intra prediction), and a reference sample located in a line separated by 2 samples distance or more from the current block.
  • This may correspond to one of the used second type (MRL intra prediction) or the third type (ISP intra prediction) in which the current block is divided by the ISP using a reference sample located in a line adjacent to the current block.
  • the planar mode and the DC mode may be removed from the MPM candidate list.
  • the encoder may remove the planar mode and the DC mode from the MPM candidate list. For example, as shown in FIG. 23B, the encoder may reconstruct (change) the MPM candidate list by rearranging the remaining modes after removing the planar mode and the DC mode from the MPM candidate list.
  • the DC mode may be removed from the MPM candidate list.
  • the encoder can remove the DC mode from the MPM candidate list. For example, as shown in FIG. 23C, the encoder may reconstruct (change) the MPM candidate list by rearranging the remaining modes after removing the DC mode from the MPM candidate list.
  • the planner mode may be removed from the MPM candidate list.
  • the DC mode may be available and the planar mode may not be used.
  • the encoder may remove the planar mode from the MPM candidate list. For example, as shown in FIG. 24B, the encoder may reconfigure (change) the MPM candidate list by rearranging the remaining modes while removing the planar mode from the MPM candidate list.
  • step S2530 the encoder determines an MPM index related to the intra prediction mode of the current block derived based on the rate-distortion cost from the MPM candidate list.
  • the encoder may determine an optimal intra prediction mode from the MPM candidate list in consideration of rate-distortion cost and determine an MPM index corresponding to the optimal intra prediction mode.
  • the encoder encodes intra prediction information including information on an MPM index and an intra prediction type.
  • the information on the intra prediction type may further include a reference line index (eg, ref_idx) indicating the location of the reference sample and information indicating whether to divide the ISP.
  • the intra prediction information may further include ISP direction information related to the division direction of the current block.
  • the current block may be divided in a horizontal direction or a vertical direction, such as 20a and 20b.
  • the encoder may equally construct one MPM candidate list regardless of the division direction, and determine an intra prediction mode as an optimal mode (a mode having a smaller RD cost) among prediction modes determined according to each division direction. That is, the intra prediction mode may be a mode having a lower rate-distortion cost among modes determined for horizontal division and vertical division in the MPM candidate list.
  • FIG. 26 shows an example of a flowchart for intra prediction in a process of decoding a video signal according to an embodiment of the present specification.
  • the operations of FIG. 26 may be performed by the decoding apparatus 200 or the video signal processing apparatus 500. More specifically, the operations of FIG. 26 may be performed by the intra prediction unit 265 (intra prediction mode/type determination unit 266 of FIG. 10) in the decoding apparatus 200, and further, the video signal processing apparatus ( 500) may be performed by the processor 510.
  • steps S2610 to S2640 of FIG. 26 may correspond to an example of step S1110 of FIG. 11, and step S2650 may correspond to an example of step S1130 of FIG. 11.
  • the decoder acquires intra prediction information of a current block to which intra prediction is applied.
  • the intra prediction information includes information on an intra prediction type of the current block and an MPM index.
  • the information on the intra prediction type may further include a reference line index (eg, ref_idx) indicating the location of the reference sample and information indicating whether to divide the ISP. If the intra prediction type corresponds to the third type (ISP intra prediction), the intra prediction information may further include ISP direction information related to the division direction of the current block.
  • the decoder generates an MPM candidate list based on the prediction mode of at least one neighboring block adjacent to the current block. For example, the decoder generates an MPM candidate list based on the intra prediction mode of the left neighboring block and the upper neighboring block of the current block.
  • the decoder generates a single MPM candidate list regardless of the intra prediction type of the current block (general intra prediction, MRL intra prediction, and ISP intra prediction).
  • the decoder can generate the same MPM candidate list regardless of the ISP division direction (vertical direction, horizontal direction).
  • step S2630 the decoder changes the MPM candidate list by removing at least one mode from the MPM candidate list based on the intra prediction type. That is, with respect to a single MPM candidate list generated regardless of the intra prediction type, the decoder checks whether or not an unused mode exists for each intra prediction type. If there is a mode that cannot be used in the corresponding intra prediction, the mode is removed from the MPM candidate list.
  • the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided (existing intra prediction), and a reference sample located in a line separated by 2 samples distance or more from the current block
  • This may correspond to one of the used second type (MRL intra prediction) or the third type (ISP intra prediction) in which the current block is divided by the ISP using a reference sample located in a line adjacent to the current block.
  • the planar mode and the DC mode may be removed from the MPM candidate list.
  • the decoder can remove the planar mode and the DC mode from the MPM candidate list. For example, as shown in FIG. 23B, the decoder may reconstruct (change) the MPM candidate list by rearranging the remaining modes after removing the planar mode and the DC mode from the MPM candidate list.
  • the DC mode may be removed from the MPM candidate list.
  • the decoder can remove the DC mode from the MPM candidate list. For example, as shown in FIG. 23C, the decoder may reconstruct (change) the MPM candidate list by rearranging the remaining modes after removing the DC mode from the MPM candidate list.
  • the planner mode may be removed from the MPM candidate list.
  • the DC mode may be available and the planar mode may not be used.
  • the decoder may remove the planar mode from the MPM candidate list. For example, as shown in FIG. 24B, the decoder may reconfigure (change) the MPM candidate list by rearranging the remaining modes while removing the planar mode from the MPM candidate list.
  • the decoder determines an intra prediction mode related to the MPM index from the MPM candidate list.
  • the decoder may determine an MPM candidate (prediction mode) corresponding to the MPM index from the MPM candidate list reconstructed in consideration of the intra prediction type after being generated singly as the intra prediction mode of the current block.
  • step S2650 the decoder generates a prediction sample of the current block based on the intra prediction mode and the reference sample in the current picture.
  • the processing method to which the present invention is applied may be produced in the form of a program executed by a computer, and may be stored in a computer-readable recording medium.
  • Multimedia data having a data structure according to the present invention can also be stored in a computer-readable recording medium.
  • the computer-readable recording medium includes all kinds of storage devices and distributed storage devices in which computer-readable data is stored.
  • the computer-readable recording medium includes, for example, Blu-ray disk (BD), universal serial bus (USB), ROM, PROM, EPROM, EEPROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical It may include a data storage device.
  • the computer-readable recording medium includes media implemented in the form of a carrier wave (for example, transmission through the Internet).
  • the bitstream generated by the encoding method may be stored in a computer-readable recording medium or transmitted through a wired or wireless communication network.
  • an embodiment of the present invention may be implemented as a computer program product using a program code, and the program code may be executed in a computer according to the embodiment of the present invention.
  • the program code may be stored on a carrier readable by a computer.
  • a non-transitory computer-readable medium stores one or more instructions executed by one or more processors.
  • the one or more instructions generate a most probable mode (MPM) candidate list based on a prediction mode of at least one neighboring block adjacent to a current block for encoding a video signal, and the intra prediction type of the current block Change the MPM candidate list by removing at least one mode from the MPM candidate list based on the MPM candidate list, determine an MPM index related to the intra prediction mode of the current block derived based on a rate-distortion cost from the MPM candidate list, and ,
  • the video signal processing apparatus 500 (encoding apparatus 100) is controlled to encode intra prediction information including information on the MPM index and the intra prediction type.
  • the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided, and a reference sample located in a line separated by 2 sample distances or more from the current block. It may correspond to one of the used second type or a third type in which the reference sample located in a line adjacent to the current block is used and the current block is divided by an intra subpartition.
  • the planar mode and the DC mode may be removed from the MPM candidate list.
  • the DC mode when the intra prediction type corresponds to the third type, the DC mode may be removed from the MPM candidate list.
  • the planar mode may be removed from the MPM candidate list.
  • the intra prediction information further includes ISP direction information related to a division direction of the current block when the intra prediction type corresponds to a third type, and the intra prediction mode is horizontal direction division in the MPM candidate list. It may be a mode having a smaller rate-distortion cost among the modes determined for the and vertical division.
  • the instructions according to an embodiment of the present specification acquire intra prediction information of a current block to which the intra prediction is applied, for decoding a video signal, wherein the intra prediction information includes information on an intra prediction type of the current block and
  • the MPM includes an MPM index, generates an MPM candidate list based on a prediction mode of at least one neighboring block adjacent to the current block, and removes at least one mode from the MPM candidate list based on the intra prediction type.
  • a video signal processing apparatus to change a candidate list, determine an intra prediction mode related to the MPM index from the MPM candidate list, and generate a prediction sample of the current block based on the intra prediction mode and a reference sample in the current picture ( 500) (encoding device 100) is controlled.
  • the intra prediction type is a first type in which a reference sample located in a line adjacent to the current block is used, and the current block is not divided, and a reference sample located in a line separated by 2 sample distances or more from the current block. It may correspond to one of the used second type or a third type in which the reference sample located in a line adjacent to the current block is used and the current block is divided by an intra subpartition.
  • the planar mode and the DC mode may be removed from the MPM candidate list.
  • the DC mode when the intra prediction type corresponds to the third type, the DC mode may be removed from the MPM candidate list.
  • the planar mode may be removed from the MPM candidate list.
  • the intra prediction information may further include ISP direction information related to a division direction of the current block when the intra prediction type corresponds to a third type.
  • the embodiments described in the present invention may be implemented and performed on a processor, microprocessor, controller, or chip.
  • the functional units illustrated in each drawing may be implemented and executed on a computer, processor, microprocessor, controller, or chip.
  • the decoder and encoder to which the present invention is applied include a multimedia broadcasting transmission/reception device, a mobile communication terminal, a home cinema video device, a digital cinema video device, a surveillance camera, a video chat device, a real-time communication device such as video communication, a mobile streaming device, Storage media, camcorders, video-on-demand (VoD) service providers, OTT video (Over the top video) devices, Internet streaming service providers, three-dimensional (3D) video devices, video telephony video devices, and medical video devices. And can be used to process video signals or data signals.
  • an OTT video (Over the top video) device may include a game console, a Blu-ray player, an Internet-connected TV, a home theater system, a smartphone, a tablet PC, and a digital video recorder (DVR).
  • an embodiment of the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof.
  • an embodiment of the present invention is one or more ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs ( field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, etc.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • processors controllers, microcontrollers, microprocessors, etc.
  • an embodiment of the present invention may be implemented in the form of a module, procedure, or function that performs the functions or operations described above.
  • the software code can be stored in a memory and driven by a processor.
  • the memory may be located inside or outside the processor, and may exchange data with the processor through various known means.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

L'invention concerne, selon divers modes de réalisation, un procédé et un appareil de traitement de signal vidéo pour prédiction intra. Un procédé de codage d'un signal vidéo, selon un mode de réalisation de la présente invention, comprend les étapes consistant à : générer une liste de modes les plus probables (MPM) candidats sur la base d'un mode de prédiction d'au moins un bloc voisin adjacent à un bloc courant ; modifier la liste de MPM candidats par retrait d'au moins un mode de la liste de MPM candidats sur la base d'un type de prédiction intra ; déterminer un indice de MPM relatif à un mode de prédiction intra du bloc courant, qui est dérivé de la liste de MPM candidats sur la base d'un rapport débit-distorsion ; et coder des informations de prédiction intra comprenant des informations concernant l'indice de MPM et le type de prédiction intra. Par génération de la même liste de MPM candidats pour divers types de prédiction intra, puis par modification de la liste de MPM candidats de façon à retirer un MPM candidat indisponible en fonction du type de prédiction intra, une structure de codage/décodage d'informations de prédiction intra peut être simplifiée, et la quantité de données et la complexité de calcul requises pour une prédiction intra peuvent être réduites.
PCT/KR2020/002635 2019-02-24 2020-02-24 Procédé et appareil de traitement de signal vidéo pour prédiction intra WO2020171673A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962809710P 2019-02-24 2019-02-24
US62/809,710 2019-02-24

Publications (1)

Publication Number Publication Date
WO2020171673A1 true WO2020171673A1 (fr) 2020-08-27

Family

ID=72143555

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/002635 WO2020171673A1 (fr) 2019-02-24 2020-02-24 Procédé et appareil de traitement de signal vidéo pour prédiction intra

Country Status (1)

Country Link
WO (1) WO2020171673A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113691809A (zh) * 2021-07-07 2021-11-23 浙江大华技术股份有限公司 帧内预测方法及编、解码方法、电子设备及存储介质
US20220167010A1 (en) * 2019-03-11 2022-05-26 Kddi Corporation Image decoding device, image decoding method, and program
CN116563105A (zh) * 2023-04-18 2023-08-08 武汉大学 一种众源卫星遥感影像数据集优选方法及计算机可读介质
WO2024067036A1 (fr) * 2022-09-26 2024-04-04 广州市百果园信息技术有限公司 Procédé et appareil de décision pour mode de prédiction intra-trame, et dispositif de codage vidéo

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180072133A (ko) * 2016-12-21 2018-06-29 전자부품연구원 고효율 비디오 부호화 모드 결정방법 및 결정장치
US20190028729A1 (en) * 2011-01-12 2019-01-24 Ntt Docomo, Inc. Mode identification data reducing method for intra-prediction coding
KR20190013611A (ko) * 2017-07-28 2019-02-11 한국전자통신연구원 영상 처리 방법, 그를 이용한 영상 부호화/복호화 방법 및 그 장치

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190028729A1 (en) * 2011-01-12 2019-01-24 Ntt Docomo, Inc. Mode identification data reducing method for intra-prediction coding
KR20180072133A (ko) * 2016-12-21 2018-06-29 전자부품연구원 고효율 비디오 부호화 모드 결정방법 및 결정장치
KR20190013611A (ko) * 2017-07-28 2019-02-11 한국전자통신연구원 영상 처리 방법, 그를 이용한 영상 부호화/복호화 방법 및 그 장치

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
DE -LUXAN-HERNANDEZ, SANTIAGO ET AL.: "CE3: Intra Sub-Partitions Coding Mode (Tests 1.1.1 and 1.1.2)", JVET-M0102-V5. JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11. 13TH MEETING, 17 January 2019 (2019-01-17), Marrakech, MA, pages 1 - 9, XP030202390 *
YAO, JIE ET AL.: "Non-CE3: Intra prediction information coding", JVET-M0210_V3 JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11. 13TH MEETING, 11 January 2019 (2019-01-11), Marrakech, MA, pages 1 - 7, XP030253348 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220167010A1 (en) * 2019-03-11 2022-05-26 Kddi Corporation Image decoding device, image decoding method, and program
US11962801B2 (en) * 2019-03-11 2024-04-16 Kddi Corporation Image decoding device, image decoding method, and program
CN113691809A (zh) * 2021-07-07 2021-11-23 浙江大华技术股份有限公司 帧内预测方法及编、解码方法、电子设备及存储介质
WO2024067036A1 (fr) * 2022-09-26 2024-04-04 广州市百果园信息技术有限公司 Procédé et appareil de décision pour mode de prédiction intra-trame, et dispositif de codage vidéo
CN116563105A (zh) * 2023-04-18 2023-08-08 武汉大学 一种众源卫星遥感影像数据集优选方法及计算机可读介质
CN116563105B (zh) * 2023-04-18 2024-02-02 武汉大学 一种众源卫星遥感影像数据集优选方法及计算机可读介质

Similar Documents

Publication Publication Date Title
WO2017065532A1 (fr) Procédé et appareil de codage et de décodage d'un signal vidéo
WO2020009556A1 (fr) Procédé et dispositif de codage d'image à base de transformée
WO2020171660A1 (fr) Procédé et dispositif de traitement d'un signal vidéo pour prédiction intra
WO2020046091A1 (fr) Procédé de codage d'image basé sur une sélection d'une transformée multiple et dispositif associé
WO2020171673A1 (fr) Procédé et appareil de traitement de signal vidéo pour prédiction intra
WO2020213944A1 (fr) Transformation pour une intra-prédiction basée sur une matrice dans un codage d'image
WO2019203610A1 (fr) Procédé de traitement d'images et dispositif pour sa mise en œuvre
WO2020213946A1 (fr) Codage d'image utilisant un indice de transformée
WO2021040484A1 (fr) Appareil et procédé de codage d'image à base de filtrage de boucle adaptatif à composante transversale
WO2020231140A1 (fr) Codage de vidéo ou d'image basé sur un filtre à boucle adaptatif
WO2019194514A1 (fr) Procédé de traitement d'image fondé sur un mode de prédiction inter et dispositif associé
WO2019235822A1 (fr) Procédé et dispositif de traitement de signal vidéo à l'aide de prédiction de mouvement affine
WO2021040483A1 (fr) Appareil et procédé de codage d'images
WO2020213945A1 (fr) Transformée dans un codage d'image basé sur une prédiction intra
WO2019216714A1 (fr) Procédé de traitement d'image fondé sur un mode de prédiction inter et appareil correspondant
WO2020204419A1 (fr) Codage vidéo ou d'image basé sur un filtre à boucle adaptatif
WO2020180143A1 (fr) Codage vidéo ou d'image basé sur un mappage de luminance avec mise à l'échelle de chrominance
WO2020213867A1 (fr) Codage de vidéo ou d'image basé sur la signalisation de données de liste de mise à l'échelle
WO2021141226A1 (fr) Procédé de décodage d'image basé sur bdpcm pour composante de luminance et composante de chrominance, et dispositif pour celui-ci
WO2019194463A1 (fr) Procédé de traitement d'image et appareil associé
WO2021141227A1 (fr) Procédé de décodage d'image et dispositif associé
WO2018034374A1 (fr) Procédé et appareil de codage et décodage d'un signal vidéo à l'aide d'un filtrage de prédiction-intra
WO2020180122A1 (fr) Codage de vidéo ou d'images sur la base d'un modèle à alf analysé conditionnellement et d'un modèle de remodelage
WO2020009447A1 (fr) Procédé de traitement d'images sur la base d'un mode d'inter-prédiction et dispositif associé
WO2020197207A1 (fr) Codage d'image ou vidéo sur la base d'un filtrage comprenant un mappage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20760199

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20760199

Country of ref document: EP

Kind code of ref document: A1