WO2020175905A1

WO2020175905A1 - Signaled information-based picture partitioning method and apparatus

Info

Publication number: WO2020175905A1
Application number: PCT/KR2020/002730
Authority: WO
Inventors: 파루리시탈; 김승환
Original assignee: 엘지전자 주식회사
Priority date: 2019-02-26
Filing date: 2020-02-26
Publication date: 2020-09-03

Abstract

A video decoding method performed by a decoding apparatus according to the present disclosure comprises the steps of: acquiring, from a bitstream, video information including partition information for a current picture and prediction information for a current block included in the current picture; deriving, on the basis of the partition information for the current picture, a partitioning structure of the current picture on the basis of a plurality of tiles; deriving prediction samples for the current block on the basis of the prediction information on the current block included in one of the plurality of tiles; and restoring the current picture on the basis of the prediction samples.

Description

Specification

Name of the invention: Picture partitioning method and apparatus based on signaled information

Technical field

[1] This disclosure is about video coding technology, and more specifically, video coding.

It relates to a picture partitioning method and apparatus based on information signaled by the system.

Background

四 The latest 4K or 8K or higher UHD (Ultra High Definition) video/video

The demand for high-resolution, high-quality video/video is increasing in various fields. The higher the resolution and quality of the video/video data, the higher the amount of information or bits to be transmitted compared to the existing video/video data.Therefore, the video data can be transmitted using a medium such as a wired/wireless broadband line or an existing storage medium When the video/video data is stored using the method, the transmission cost and storage cost increase.

[3] In addition, interest and demand for immersive media such as VR (Virtual Reality) and AR (Artificial Realtiy) contents and holograms are increasing recently. Broadcasting for video/video is increasing.

[4] Accordingly, in recent years, video/video applications with various characteristics

A flexible picture partitioning method that can be applied to efficiently compress and play back images/videos is required.

Detailed description of the invention

Technical task

[5] The technical task of this disclosure is to provide a method and apparatus to increase the image coding efficiency.

[6] Another technical task of this disclosure is to provide a method and apparatus for signaling partitioning information.

[7] Another technical task of this disclosure is to create pictures based on signaled information.

It is to provide a flexible partitioning method and device.

[8] Another technical task of this disclosure is to provide a method and apparatus for partitioning a current picture based on partition information for the current picture.

[9] Another technical task of this disclosure is flag information on whether the current picture is divided into motion constrained tile sets (MCTS), information on the number of MCTSs in the current picture, and upper left for each of the MCTSs. Position information of the tile located at the (top-left) or the position of the tile located at the bottom-right for each MCTS It is intended to provide a method and apparatus for partitioning the current picture based on at least one of the information.

Problem solving means

[1] According to an embodiment of the present disclosure, an image decoding method performed by a decoding apparatus is provided. The method includes partition information for a current picture and a current block included in the current picture. For example, acquiring image information including prediction information from a bitstream; Based on the partitioning information for the current picture, a partitioning structure of the current picture based on a plurality of tiles is also provided. A step of; Deriving prediction samples for the current block based on the prediction information for the current block included in one of the plurality of tiles; And the current picture based on the prediction samples Including the step of restoring, the plurality of tiles are grouped into a plurality of tile groups, and at least one type group among the plurality of tile groups is arranged in a non-raster scan order. Includes tiles.

[11] According to another embodiment of the present disclosure, a decoding device for performing image decoding is provided. The decoding device includes partition information for a current picture and a current block included in the current picture. For example, obtaining image information including prediction information from a bitstream, and reducing the partitioning structure of the current picture based on a plurality of tiles, based on the partitioning information for the current picture. An entropy decoding unit; A prediction unit for deriving prediction samples for the current block based on the prediction information for the current block included in one of the plurality of tiles; And the current picture based on the prediction samples It includes an adder for restoring, and the plurality of tiles are grouped into a plurality of tile groups, and at least one type group among the plurality of tile groups is arranged in a non-raster scan order. Includes tiles.

[12] According to another embodiment of the present disclosure, an image encoding method performed by an encoding device is provided. The method includes the steps of dividing a current picture into a plurality of tiles; based on the plurality of tiles. Generating segmentation information for the current picture; Deriving prediction samples for a current block included in one of the plurality of tiles; Generating prediction information for the current block based on the prediction samples And encoding image information including segmentation information on the current picture and prediction information on the current block, wherein the plurality of tiles are grouped into a plurality of tile groups, and the plurality of tiles At least one type group of the groups contains tiles arranged in a non-raster scan order.

[13] According to another embodiment of this disclosure, an encoding device that performs image encoding is The encoding apparatus includes: an image segmentation unit that divides the current picture into a plurality of tiles and generates segmentation information for the current picture based on the plurality of tiles, and in one tile of the plurality of tiles. A prediction unit that derives prediction samples for the included current block and generates prediction information for the current block based on the prediction samples, and an image including segmentation information for the current picture and prediction information for the current block Entropy to encode information

Including an encoding unit, the plurality of tiles are grouped into a plurality of tile groups, and at least one type group among the plurality of tile groups is non-raster

Contains tiles arranged in a non-raster scan order.

[14] According to another embodiment of the present disclosure, image decoding by a decoding device

A computer-readable digital storage medium for storing encoded image information for causing the method to be performed is provided. The decoding method according to the above embodiment includes partition information for a current picture and partition information included in the current picture. Acquiring image information including prediction information for the current block from the bitstream; based on the partitioning information for the current picture, partitioning structure of the current picture based on a plurality of tiles ); Deriving prediction samples for the current block based on the prediction information for the current block included in one of the plurality of tiles; And based on the prediction samples Including the step of restoring the current picture, the plurality of tiles are grouped into a plurality of tile groups, and at least one type group among the plurality of tile groups is in a non-raster scan order. Includes arranged tiles.

Effects of the Invention

[15] According to this specification, the overall image/video compression efficiency can be improved.

[16] According to this specification, the efficiency of picture partitioning can be improved.

[17] According to this specification, it is possible to increase the flexibility of picture partitioning based on the partition information for the current picture.

[18] According to the present specification, non-raster scans are arranged in order.

By partitioning the current picture based on a tile group containing tiles, the efficiency of signaling for picture partitioning can be improved.

Brief description of the drawing

[19] Fig. 1 schematically shows an example of a video/video coding system to which this disclosure can be applied.

[2] Fig. 2 shows the configuration of a video/video encoding device to which this disclosure can be applied.

This is a schematic drawing.

[21] Figure 3 shows the configuration of a video/video decoding apparatus to which this disclosure can be applied.

This is a schematic drawing. 2020/175905 1»（：1/10公020/002730 Fig. 4 exemplarily shows the inheritance structure for the coded data.

5 is a diagram showing an example of partitioning a picture.

6 is a flowchart illustrating a procedure for encoding a picture based on a tile and/or a tile group according to an embodiment.

7 is a flowchart illustrating a tile and/or tile group-based picture decoding procedure according to an embodiment.

8 is a diagram showing an example of partitioning a picture into a plurality of tiles. 9 is a block diagram showing the configuration of an encoding apparatus according to an embodiment. W is a block diagram showing the configuration of a decoding apparatus according to an embodiment. 11 is a diagram showing an example of a tile and a tile group unit constituting a current picture.

12 is a diagram schematically showing an example of a signaling structure of tile group information.

13 is a diagram illustrating an example of a picture in a video conferencing program. 14 is a diagram showing an example of partitioning a picture into tiles or tile groups in a video conference video program.

15 is a diagram illustrating an example of partitioning a picture into tiles or tile groups based on MCTS (Motion Constrained Tile Set).

16 is a diagram illustrating an example of dividing a picture based on an R0I area. 17 is a diagram showing an example of partitioning a picture into a plurality of tiles. 18 is a diagram illustrating an example of partitioning a picture into a plurality of tiles and tile groups.

19 illustrates an example of partitioning a picture into a plurality of tiles and tile groups.

]]]]]]]]]]]]]]]]]]]] This is the drawing shown.

24790247902363568811

22222224443333333333 ₄₃ FIG. 20 is a flow chart showing the operation of the decoding apparatus according to an embodiment.

21 is a block diagram showing a configuration of a decoding apparatus according to an embodiment. 22 is a flow chart showing the operation of the encoding device according to an embodiment. 23 is a block diagram showing the configuration of an encoding device according to an embodiment. 24 shows an example of a content streaming system to which the disclosure of this document can be applied.

Modes for the implementation of the invention

Since the present disclosure can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail. However, this is not intended to limit the present disclosure to specific embodiments. Commonly used terms are used only to describe specific embodiments, and are not intended to limit the technical idea of this disclosure. Singular expressions include plural expressions unless clearly indicated otherwise in context. In the real specification 2020/175905 1»（：1^1{2020/002730

Terms such as "include" or "have" are intended to designate the existence of a feature, number, step, action, component, part, or combination of those listed on the specification, but one or more other features, numbers, steps, It is to be understood that the operation, component and part diagrams do not preclude the presence or addition of any combination of them.

[44] On the other hand, each configuration on the drawings described in this disclosure

As shown independently for convenience of explanation of the functions, it does not mean that each configuration is implemented as separate hardware or separate software. For example, two or more of each configuration may be combined to form a single configuration. However, one configuration may be divided into a plurality of configurations. Embodiments in which each configuration is incorporated and/or separated are also included within the scope of the rights of this disclosure, unless departing from the essence of this disclosure.

[45] In this specification, 1 or show or p" may mean "only show," "only, or "show and ^ both." In other words, 1 or 1 of show in this specification is 1 and/ Or it can be interpreted as show （1/（epidermis”. For example, in this specification, “6” or “：（人 3 or（：）” means “only show”, “only ，,” only 0 \ or “人Any combination of ：8 and（：（

6 Can mean （1〔:）”.

[46] A forward slash (/) or comma (¥111111幻) is used in this specification.

For example, "show 思" could mean 1 and/or 6".

“Show 思” can mean “only show”, “only, or “show and ^ all”. For example, “人 3,（:” can mean “人 3 or (:”).

[47]

It can be interpreted in the same way.

[48] Also, in this specification, “at least one 6 and 01 6 mountain (I!)” means only 0 \ or any combination of “人：8 and（：（

It can mean 11（1（I!）”. Also, “at least one 6 or （I!）” or “at least one

One person：8 and（：（no

It can mean.

[49] In addition, parentheses used in this specification

Specifically, when marked as “prediction (intra prediction)”, “intra prediction” may have been proposed as an example of “prediction”. In other words, “forecast” in this specification is limited to “intra prediction” (1) It is not 0, and “intra prediction” may be suggested as an example of “prediction.” In addition, even when “prediction (ie, intra prediction)” is indicated, “intra prediction” is proposed as an example of “prediction” Can be [5 In this specification, technical features that are individually described within one drawing may be implemented individually or simultaneously.

[51] Hereinafter, with reference to the accompanying drawings, a preferred embodiment of the present disclosure will be described in more detail. Hereinafter, the same reference numerals are used for the same components in the drawings, and duplicate descriptions for the same components will be described. Can be omitted.

1 schematically shows an example of a video/video coding system to which this disclosure can be applied.

[53] Referring to Fig. 1, a video/video coding system may include a first device (source device) and a second device (receive device). The source device is encoded.

Video/image information or data can be transferred to a receiving device via a digital storage medium or a network in the form of files or streaming.

[54] The source device may include a video source, an encoding device, and a transmission unit. The receiving device may include a receiver, a decoding device, and a renderer. The encoding device may be referred to as a video/image encoding device, and the decoding device may be referred to as a video/image decoding device. The transmitter may be included in the encoding device. The receiver may be included in the decoding device. The renderer may include a display unit, and the display unit may be composed of separate devices or external components.

[55] Video sources are captured through video/video capture, synthesis, or generation

Video/image can be acquired Video sources can include video/image capture devices and/or video/image generation devices Video/image capture devices can be, for example, one or more cameras, previously captured video/image It can contain video/picture archives, etc. Video/picture generation devices can include, for example computers, tablets and smartphones, etc. It can generate video/pictures (electronically), for example computers A virtual video/video can be created through the like, and in this case, the video/video capture process can be replaced by the process of generating related data.

[56] The encoding device can encode the input video/video. The encoding device can perform a series of procedures such as prediction, transformation, and quantization for compression and coding efficiency.

The encoded data (encoded video/video information) can be summarized in the form of a bitstream.

[57] The transmission unit is encoded video/video information output in the form of a bitstream or

Data can be transferred to the receiver of the receiving device via a digital storage medium or network in the form of a file or streaming. The digital storage medium can include various storage media such as USB, SD, CD, DVD, Blu-ray, HDD, SSD, etc. The transmission unit may include an element for generating a media file through a predetermined file format and may include an element for transmission through a broadcasting/communication network. The receiving unit may receive/extract the bitstream and transmit it to the decoding device. have.

[58] The decoding device is inverse quantization, inverse transformation, prediction, etc. corresponding to the operation of the encoding device.

Video/video can be decoded by performing a series of procedures.

[59] The renderer can render decoded video/video. The rendered video/video can be displayed through the display unit.

[6 This document is about video/image coding. For example,

The method/embodiment includes a versatile video coding (VVC) standard, an essential video coding (EVC) standard, an AOMedia Video 1 (AVI) standard, a 2nd generation of audio video coding standard (AVS2), or a next-generation video/image coding standard (ex.H). .267 or H.268, etc.).

[61] In this document, various embodiments of video/image coding are presented, and the above embodiments may be implemented in combination with each other unless otherwise stated.

[62] In this document, video is a series of images over time.

It can mean a set. A picture generally refers to a unit representing one image in a specific time period, and a slice/tile is a unit constituting a part of a picture in coding. A tile can contain more than one CTU (coding tree unit); a picture can consist of more than one slice/tile.

[63] A tile is a rectangular region of CTUs within a particular tile column and a particular tile row in a picture). The tile row is a rectangular region of CTUs within a particular tile row. The tile column is a rectangular region of CTUs having a height equal to the height of the picture and width can be specified by syntax elements in the picture parameter set. a width specified by syntax elements in the picture parameter set).The tile row is a rectangular area of CTUs, the rectangular area has a width specified by syntax elements in the picture parameter set, and the height can be the same as the height of the picture. (The tile row is a rectangular region of CTUs having a height specified by syntax elements in the picture parameter set and a width equal to the width of the picture) A tile scan can represent a specific sequential ordering of CTUs partitioning the picture. In addition, the CTUs may be sequentially aligned with a CTU raster scan in a tile, and tiles in a picture may be sequentially aligned with a raster scan of the tiles of the picture (A tile scan is a specific sequential ordering of CTUs partitioning a picture in which the CTUs are ordered consecutively in CTU raster scan in a tile whereas tiles in a picture are ordered consecutively in a raster scan of the tiles of the picture). It can contain multiple consecutive CTU rows in a single tile of a picture that can be contained in either complete tiles of a single NAL unit or in a single NAL unit. Tile groups and slices can be mixed in this document. For example, in this document, tile group/ The tile group header can be called a slice/slice header. [64] On the other hand, a picture can be divided into two or more subpictures. A subpicture can be a rectangular region of one or more slices within a picture.

[65] A pixel or pel may mean the smallest unit constituting a picture (or image). In addition,'sample' may be used as a term corresponding to a pixel. In general, can represent the pixel or pixel value, it can represent only the pixel/pixel value of the luma component, or it can represent only the pixel/pixel value of the chroma component.

[66] A unit can represent a basic unit of image processing. A unit can contain at least one of a specific region of a picture and information related to that region. One unit contains one luma block and two chromas (one luma block and two chromas). ex. cb, cr) may contain a block A unit may be used interchangeably with terms such as _block or area in some cases. In general, the MxN block may include a set (or array) of samples (or sample array) or transform coefficients consisting of M columns and N rows.

[67] Fig. 2 shows the configuration of a video/video encoding apparatus to which this disclosure can be applied.

This is a schematic diagram. Hereinafter, the video encoding device may include an image encoding device.

Referring to FIG. 2, the encoding apparatus 200 includes an image partitioner 210,

Predictor (220), residual processor (230), entropy encoder (240), adder (250), filtering unit (filter, 260) and memory (memory, 270) It can be configured to include. For example, the part 220 is

It may include a prediction unit 221 and an intra prediction unit 222. The residual processing unit 230 includes a transform unit 232, a quantizer 233, an inverse quantizer 234, and an inverse transform unit ( An inverse transformer 235 may be included. The residual processing unit 230 may further include a subtractor 231. The addition unit 250 may include a reconstructor or a recontructged block generator. The image segmentation unit 210, the prediction unit 220, the residual processing unit 230, the entropy encoding unit 240, the addition unit 250 and the filtering unit 260 described above may be used according to the embodiment. One or more hardware

The hardware component may be configured by a component (e.g., an encoder chipset or processor). Also, the memory 270 may include a decoded picture buffer (DPB), and may be configured by a digital storage medium. The hardware component is a memory 270. You can also include more as internal/external components.

[69] The image segmentation unit (2W) is an input image (or, picture, input) input to the encoding device 200

Frame) can be divided into one or more processing units. For example, the processing unit may be referred to as a coding unit (CU), in which case the coding unit is a coding tree unit (CTU). Or according to the QTBTTT (Quad-tree binary-tree ternary-tree) structure from the largest coding unit (LCU) It can be divided recursively; for example, a coding unit can be divided into multiple coding units of deeper depth based on a quad tree structure, a binary tree structure, and/or a ternary structure. In this case, for example, the quadtree structure may be applied first, and the binary and/or ternary structure may be applied later, or the binary tree structure may be applied first. This disclosure is based on the final coding unit, which is no longer divided. In this case, the maximum coding unit can be used directly as the final coding unit, or if necessary, the coding unit can be used based on the coding efficiency according to the video characteristics.

It is recursively divided into coding units of a lower depth, so that the optimal size coding unit can be used as the final coding unit. Here, the coding procedure may include procedures such as prediction, conversion, and restoration described later. As another example, the processing unit may further include a unit (PU: Prediction Unit) or a transformation unit (TU: Transform Unit). In this case, the prediction unit and the transformation unit are each divided from the final coding unit described above. Alternatively, it may be partitioned. The prediction unit may be a unit of sample prediction, and the transform unit may be a unit for inducing a conversion factor and/or a unit for inducing a residual signal from the conversion factor.

P This unit is sometimes used interchangeably with terms such as block or area.

In general, an MxN block can represent a set of samples or transform coefficients consisting of M columns and N rows. A sample can typically represent a pixel or pixel value, and the luminance ( It can represent only the pixel/pixel value of the luma component, or it can represent only the pixel/pixel value of the chroma component. A sample corresponds to one picture (or image) corresponding to a pixel or pel. Can be used as a term.

1] The encoding device 200 intercepts the input video signal (original block, original sample array)

A residual signal (residual signal, residual block, residual sample array) can be generated by subtracting the prediction signal (predicted block, prediction sample array) output from the prediction unit 221 or the intra prediction unit 222, and the generated The residual signal is transmitted to the conversion unit 232. In this case, the prediction signal (prediction block, prediction sample array) is subtracted from the input video signal (original block, original sample array) in the encoding device 200 as shown. The unit to be processed may be called a subtraction unit 231. The prediction unit performs prediction on the block to be processed (hereinafter referred to as the current block), and a predicted block including prediction samples for the current block. The prediction unit can determine whether intra prediction or inter prediction is applied in the current block or CU unit. The prediction unit may generate various types of information related to prediction, such as prediction mode information, as described later in the description of each prediction mode, and transmit it to the entropy encoding unit 240. The information on prediction may be encoded in the entropy encoding unit 240 and summarized in the form of a bitstream.

2] The intra prediction unit 222 refers to the samples in the current picture and predicts the current block. Depending on the prediction mode, the referenced samples may be located in the vicinity of the current block or may be located apart from each other. In intra prediction, prediction modes include a plurality of non-directional modes and a plurality of directional modes. Non-directional mode can include, for example, DC mode and planar mode (Planar mode) Directional mode depends on the degree of detail of the prediction direction, for example

It may include 33 directional prediction modes or 65 directional prediction modes. However, this is an example and more or less directional predictions depending on the setting.

Modes may be used. The intra prediction unit 222 may determine a prediction mode to be applied to the current block by using the prediction mode applied to the surrounding block.

3] The inter prediction unit 221 refers to a reference specified by a motion vector on the reference picture.

Based on the block (reference sample array), it is possible to induce the predicted block for the current block. In this case, based on the correlation of the motion information between the neighboring block and the current block to reduce the amount of motion information transmitted in the inter prediction mode. Motion information can be predicted in units of blocks, sub-blocks, or samples. The motion information may include a motion vector and a reference picture index. The motion information indicates inter prediction direction (L0 prediction, L1 prediction, Bi prediction, etc.) In the case of inter prediction, the peripheral block may include a spatial neighboring block existing in the current picture and a temporal neighboring block existing in the reference picture. The reference picture including the reference block and the reference picture including the temporal peripheral block may be the same or different. The temporal peripheral block may be a collocated reference block, a co-located CU (colCU), etc. It can be called by the name of, and the reference picture containing the temporal surrounding block is the same position.

It can also be called a picture (collocated picture, colPic), for example, inter

The prediction unit 221 may construct a motion information candidate list based on the neighboring blocks, and generate information indicating which candidate is used to derive the motion vector and/or reference picture index of the current block. Inter prediction may be performed based on the prediction mode, for example, in the case of skip mode and merge mode, the inter prediction unit 221 may use the motion information of the neighboring block as the motion information of the current block. In this case, unlike the merge mode, the residual signal may not be transmitted. In the case of the motion information (motion vector prediction, MVP) mode, the motion vector of the surrounding block is used as the motion vector predictor, and the motion vector By signaling the motion vector difference, you can indicate the motion vector of the current block.

4] The prediction unit 220 may generate a prediction signal based on various prediction methods to be described later. For example, the prediction unit may apply intra prediction or inter prediction for prediction of one block, as well as intra prediction. Prediction and inter prediction can be applied at the same time. This can be called combined inter and intra prediction ([It can be called). In addition, for example, for example, an intra block copy, The IBC prediction mode or the palette mode may be based. The IBC prediction mode or the palette mode can be used for content video/video coding such as games, for example, SCC (screen content coding). Can be used for IBC basically performs prediction within the current picture, but can perform similarly to inter prediction in that it derives a reference block within the current picture, i.e. IBC can use at least one of the inter prediction techniques described in this document. The palette mode can be seen as an example of intracoding or intra prediction. When the palette mode is applied, the sample values in the picture can be signaled based on the information about the palette table and palette index.

5] The prediction signal generated through the prediction unit (including the inter prediction unit 221 and/or the intra prediction unit 222) may be used to generate a restoration signal or may be used to generate a residual signal. The transform unit 232 may generate transform coefficients by applying a transform method to the residual signal. For example, the transform method is DCT (Discrete Cosine Transform), DST (Discrete Sine Transform),

KLT (Karhunen-Loeve Transform), GBT (Graph-Based Transform), or

It may include at least one of CNT (Conditionally Non-linear Transform).

Here, when it is said that GBT expresses relationship information between pixels in a graph,

It means the transformation obtained from the graph. CNT refers to a transformation that is obtained based on, e.g., generating a signal using all previously reconstructed pixels. Also, the transformation process can be applied to a block of pixels of the same size of a square, and It can also be applied to blocks of variable size that are not square.

6] The quantization unit 233 quantizes the transform coefficients to the entropy encoding unit 240

After being transmitted, the entropy encoding unit 240 encodes the quantized signal (information on quantized transformation coefficients) and outputs it as a bitstream. The information on the quantized transformation coefficients may be referred to as residual information. The quantization unit 233 can rearrange the quantized transformation coefficients in the block form into a one-dimensional vector form based on the coefficient scan order, and the quantized transformation coefficients are quantized based on the quantized transformation coefficients in the one-dimensional vector form. It is also possible to generate information about the transformation coefficients. The entropy encoding unit 240, for example, exponential Golomb,

Various encoding methods such as CAVLC (context-adaptive variable length coding) and CABAC (context-adaptive binary arithmetic coding) can be performed. The entropy encoding unit 240 includes quantized conversion factors and information necessary for video/image restoration. It is also possible to encode together or separately (e.g., values of syntax elements). The encoded information (e.g., encoded video/video information) is

The video/video information may be transmitted or stored in the form of a bitstream in units of network abstraction layer (NAL) units. The video/video information is an appointment parameter set (APS), a picture parameter set (PPS), a sequence parameter set (SPS), or a video parameter. Set (VPS), etc. may contain more information about various parameter sets. Also, the video/video information may further contain general constraint information. In this document, transmitted/signaled from the encoding device to the decoding device. Information and/or syntax elements may be included in video/image information. The video/image information may be encoded through the above-described encoding procedure and included in the bitstream. The bitstream may be transmitted through a network, or It can be stored on a digital storage medium, where the network can include a broadcasting network and/or a communication network, and the digital storage medium can include a variety of storage media such as USB, SD, CD, DVD, Blu-ray, HDD, SSD, etc. Entropy The signal output from the encoding unit 240 may be configured as an internal/external element of the encoding device 200 by a transmitting unit (not shown) for transmitting and/or a storage unit (not shown) for storing, or the transmitting unit It may be included in (240).

7] The quantized transformation coefficients output from the quantization unit 233 can be used to generate a prediction signal. For example, the quantization unit 234 and the inverse transformation unit 235 are used to generate a prediction signal. Residual by applying quantization and inverse transformation

A signal (residual block or residual samples) can be restored. The addition unit 155 restores the restored residual signal by adding the restored residual signal to the prediction signal output from the inter prediction unit 221 or the intra prediction unit 222. A (reconstructed) signal (restored picture, reconstructed block, reconstructed sample array) can be generated If there is no residual for the block to be processed, such as when the skip mode is applied, the predicted block can be used as a reconstructed block. The unit 250 may be referred to as a restoration unit or a restoration block generation unit. The generated restoration signal may be used for intra prediction of the next processing target block in the current picture, and inter prediction of the next picture through filtering as described below. It can also be used for

R8] Meanwhile, LMCS (luma mapping with chroma scaling) may be applied during picture encoding and/or restoration.

9] The filtering unit 260 applies filtering to the restored signal to improve subjective/objective image quality.

For example, the filtering unit 260 may apply various filtering methods to the restored picture to generate a modified restored picture, and store the modified restored picture in a memory 270, specifically a memory 270. The various filtering methods include, for example, deblocking filtering, sample adaptive offset, adaptive loop filter, and bilateral filter. The filtering unit 260 may generate a variety of filtering information and transmit it to the entropy encoding unit 240, as described later in the description of each filtering method. The filtering information is encoded by the entropy encoding unit 240. It can be output as a bitstream.

[8] The modified restored picture transmitted to this memory 270 can be used as a reference picture in the inter prediction unit 221. The encoding device encodes when the inter prediction is applied through this. It can avoid predictive mismatch between the device (WO) and the decoding device, and also improve the encoding efficiency.

[81] Memory 270 The DPB can store the modified restored picture for use as a reference picture in the inter prediction unit 221. The memory 270 is a block from which motion information in the current picture is derived (or encoded). Motion information and/or motion information of blocks in a picture that has already been restored can be stored. The stored motion information is transmitted to the inter prediction unit 221 in order to use it as motion information of spatial neighboring blocks or motion information of temporal neighboring blocks. The memory 270 may store restoration samples of the restored blocks in the current picture, and may transmit the restoration samples to the intra prediction unit 222.

[82] Figure 3 shows the configuration of a video/video decoding apparatus to which this disclosure can be applied.

This is a schematic drawing.

Referring to FIG. 3, the decoding apparatus 300 includes an entropy decoder 310, a residual processor 320, a predictor 330, and an adder 340. , Can be configured including a filtering unit (filter, 350) and memory (memory, 360). The prediction unit 330 may include an intra prediction unit 331 and an inter prediction unit 332.

The residual processing unit 320 may include a dequantizer 321 and an inverse transformer 321. The above-described entropy decoding unit 310, a residual processing unit 320, a prediction unit 330, The addition unit 340 and the filtering unit 350 may be configured by one hardware component (for example, a decoder chipset or processor) according to an embodiment. Further, the memory 360 may include a decoded picture buffer (DPB). In addition, it may be configured by a digital storage medium. The hardware component may include a memory 360 as an internal/external component loader.

[84] When a bitstream including video/image information is input, the decoding device 300 can restore the image in response to the process in which the video/image information is processed in the encoding device of FIG. 3. For example, decoding The device 300 may derive units/blocks based on the block division related information acquired from the bitstream. The decoding device 300 may perform decoding using a processing unit applied in the encoding device. Therefore, decoding The processing unit of may be, for example, a coding unit, and the coding unit may be divided from the coding tree unit or the largest coding unit according to the quadtree structure, binary retrieval structure and/or turner retrie structure. From the coding unit one or more conversion units In addition, the restored video signal decoded and output through the decoding device 300 can be reproduced through the playback device.

[85] The decoding device 300 converts the signal output from the encoding device of FIG. 3 into a bitstream.

It can be received in a form, and the received signal can be decoded through the entropy decoding unit 310. For example, the entropy decoding unit 3W parses the bitstream and is required for image restoration (or picture restoration). Information (ex. video/video information) can be derived. The above video/video information includes an appointment parameter set (APS), a picture parameter set (PPS), a sequence parameter set (SPS), or a video parameter set (VPS). Further information on various parameter sets may be included. In addition, the video/video information may further include general constraint information. The decoding device may further decode the picture based on the information on the parameter set and/or the general limit information. The signaling/received information and/or syntax elements described later in this document are decoded through the decoding procedure, It can be obtained from the bitstream. For example, the entropy decoding unit (3W) decodes the information in the bitstream based on a coding method such as exponential Golomb encoding, CAVLC or CABAC, and determines the value of the syntax element required for image restoration, and the residual. In more detail, the CABAC entropy decoding method receives the bin corresponding to each syntax element in the bitstream, and receives the decoding target syntax element information and the surrounding and decoding information of the decoding target block. Alternatively, the context model is determined using the symbol/bin information decoded in the previous step, and the probability of occurrence of bins is predicted according to the determined context model, and arithmetic decoding of bins is performed. A symbol corresponding to the value of the syntax element can be generated. In this case, the CABAC entropy decoding method can update the context model using information of the decoded symbol/bin for the context model of the next symbol/bin after determining the context model. Among the information decoded by the entropy decoding unit (3W), information about prediction is provided to the prediction unit (inter prediction unit 332 and intra prediction unit 331), and entropy decoding is performed by the entropy decoding unit 3W. The residual value, that is, quantized transform coefficients and related parameter information may be input to the residual processing unit 320.

The residual processing unit 320 may derive a residual signal (residual block, residual samples, and residual sample array). In addition, information about filtering among information decoded by the entropy decoding unit 310 is a filtering unit. Can be provided as 350. On the other hand, a receiving unit (not shown) that receives the signal output from the encoding device may be further configured as an internal/external element of the decoding device 300, or the receiving unit may be a component of the entropy decoding unit 3W. ,The decoding device according to this document can be called a video/video/picture decoding device, and the decoding device can be divided into an information decoder (video/video/picture information decoder) and a sample decoder (video/video/picture sample decoder). The information decoder is the entropy

A decoding unit (3W) may be included, and the sample decoder includes the inverse quantization unit 321, an inverse transform unit 322, an addition unit 340, a filtering unit 350, a memory 360, an inter prediction unit ( 332) and an intra prediction unit 331.

[86] The inverse quantization unit 321 may inverse quantize the quantized transformation coefficients to output the transformation coefficients. The inverse quantization unit 321 may rearrange the quantized transformation coefficients into a two-dimensional block form. In this case, the above reordering The inverse quantization unit 321 performs inverse quantization on the quantized transform coefficients using a quantization parameter (for example, quantization step size information) based on the coefficient scan order performed by the silver encoding device. And obtain the transform coefficients Can

In the inverse transform unit 322, the residual signal (residual block, residual sample array) is obtained by inverse transforming the transform coefficients.

[88] The prediction unit performs prediction on the current block, and predicts the current block

A predicted block including samples may be generated. The prediction unit determines whether intra prediction or inter prediction is applied to the current block based on the information about the prediction output from the entropy decoding unit 310. Can be determined and specific intra/inter prediction modes can be determined.

[89] The prediction unit 330 may generate a prediction signal based on various prediction methods to be described later. For example, the prediction unit may apply intra prediction or inter prediction for prediction for one block, as well as, Intra prediction and inter prediction can be applied at the same time. This can be called combined inter and intra prediction ([can be referred to as). In addition, for example, the example is based on the intra block copy (IBC) prediction mode for block prediction. It may or may be based on a palette mode. The IBC prediction mode or palette mode can be used for content video/video coding such as games, for example, SCC (screen content coding), etc. IBC is Basically, the prediction is performed within the current picture, but it can be performed similarly to inter prediction in that it derives a reference block within the current picture, i.e., IBC can use at least one of the inter prediction techniques described in this document. Palette mode can be seen as an example of intra coding or intra prediction. When the palette mode is applied, information about the palette table and palette index can be included in the video/video information and signaled.

[9 The intra prediction unit 331 may predict the current block by referring to samples in the current picture. The referenced samples are of the current block according to the prediction mode.

The prediction modes may include a plurality of non-directional modes and a plurality of directional modes in intra prediction. The intra prediction unit 331 is a prediction applied to a peripheral block. Using the mode, you can also determine the prediction mode that applies to the current block.

[91] The inter prediction unit 332 is a reference specified by a motion vector on the reference picture.

Based on the block (reference sample array), it is possible to induce the predicted block for the current block. In this case, based on the correlation of the motion information between the neighboring block and the current block to reduce the amount of motion information transmitted in the inter prediction mode. Motion information can be predicted in units of blocks, sub-blocks, or samples. The motion information may include a motion vector and a reference picture index. The motion information indicates inter prediction direction (L0 prediction, L1 prediction, Bi prediction, etc.) In the case of inter prediction, the peripheral block may include a spatial neighboring block existing in the current picture and a temporal neighboring block existing in the reference picture. For example, the inter prediction unit 332 is a motion information candidate based on surrounding blocks. A list can be constructed, and a motion vector and/or a reference picture index of the current block can be derived based on the received candidate selection information. Inter prediction can be performed based on various prediction modes, and the information on the prediction is described above. It may include information indicating the mode of inter prediction for the current block.

[92] The addition unit 340 predicts the obtained residual signal (inter prediction unit 332 and/or

In addition to the prediction signals (predicted blocks, prediction sample arrays) output from the intra prediction unit 331), a restoration signal (restored picture, restoration block, restoration sample array) can be generated. Processing as in the case where skip mode is applied. If there is no residual for the target block, the predicted block can be used as a restore block.

[93] The addition unit 340 may be referred to as a restoration unit or a restoration block generation unit. The generated restoration signal may be used for intra prediction of the next processing target block in the current picture, and output through filtering as described later. It may be used or it may be used for inter prediction of the next picture.

[94] Meanwhile, luma mapping with chroma scaling (LMCS) may be applied in the picture decoding process.

[95] The filtering unit 350 applies filtering to the restored signal to improve subjective/objective image quality.

For example, the filtering unit 350 may apply various filtering methods to the restored picture to generate a modified restored picture, and store the modified restored picture in a memory 360, specifically a memory 360. The various filtering methods include, for example, deblocking filtering, sample adaptive offset, adaptive loop filter, bilateral filter, etc. can do.

[96] The (modified) restored picture stored in the DPB of the memory 360 can be used as a reference picture in the inter prediction unit 332. The memory 360 is from which motion information in the current picture is derived (or decoded). The motion information of the block and/or the motion information of the blocks in the picture that has already been restored can be stored. The stored motion information is interpolated to be used as the motion information of the spatial surrounding block or the motion information of the temporal surrounding block.

It can be transmitted to the prediction unit 332. The memory 360 can store reconstructed samples of the restored blocks in the current picture, and can transfer them to the intra prediction unit 331.

[97] In the present specification, the embodiments described in the filtering unit 260, the inter prediction unit 221, and the intra prediction unit 222 of the encoding apparatus 100 are respectively described in the filtering unit 350 of the decoding apparatus 300. , The inter prediction unit 332 and the intra prediction unit 331 may be applied to be the same or corresponding to each other.

[98] As described above, prediction is performed to increase compression efficiency in performing video coding. Through this, a predicted block including predicted samples for the current block, which is a block to be coded, can be generated. Here, the predicted The block includes prediction samples in the spatial domain (or pixel domain). The predicted block is derived identically in the encoding device and the decoding device, and the encoding device Image coding efficiency can be improved by signaling information about the residual (residual information) between the original block and the predicted block, not the original sample value of the original block by itself. The decoding apparatus is based on the residual information. As a result, a residual block including residual samples may be derived, the residual block and the predicted block may be combined to generate a restoration block including restoration samples, and a restoration picture including restoration blocks may be generated.

[99] The above residual information can be generated through conversion and quantization procedures.

For example, the encoding apparatus derives a residual block between the original block and the predicted block, and performs a conversion procedure on residual samples (residual sample array) included in the residual block to derive conversion coefficients, By performing a quantization procedure on the transform coefficients, quantized transform coefficients are derived, and related residual information can be signaled to a decoding device (via a bitstream). Here, the residual information is value information of the quantized transform coefficients, value information, and It can include information such as location information, conversion technique, conversion kernel, quantization parameter, etc. The decoding device can perform inverse quantization/inverse conversion procedures based on the residual information and derive residual samples (or residual blocks). The decoding device can generate a reconstructed picture based on the predicted block and the residual block. The encoding device can also inverse quantize/inverse transform the quantized transformation coefficients for reference for inter prediction of a subsequent picture to obtain a residual block. Can be derived, and a restored picture can be created based on it.

[100] Fig. 4 exemplarily shows a hierarchical structure for coded data.

[101] Referring to FIG. 4, the coded data is between a video coding layer (VCL) that handles the video/image coding process and itself, and a sub-system that stores and transmits the coded video/image data. It can be classified as a network abstraction layer (NAL).

[102] VCL is a set of parameters corresponding to headers such as sequences and pictures (picture parameter set (PPS), sequence parameter set (SPS), video parameter set (VPS), etc.) and in addition to the video/image coding process. You can generate the necessary Supplemental Enhancement Information (SEI) messages. The SEI message is separated from the video/image information (slice data). The VCL containing the video/image information consists of the slice data and the slice header. On the other hand, the slice header is a tile group header. It may be referred to as, and the slice data may be referred to as tile group data.

[103] In NAL, header to RBSP (Raw Byte Sequence Payload) generated from VCL

NAL unit can be created by adding information (NAL unit header). At this time, RBSP refers to slice data, parameter set, SEI message, etc. generated from VCL. The NAL unit header may include NAL unit type information specified according to RBSP data included in the corresponding NAL unit. [104] The NAL unit, which is the basic unit of NAL, plays a role of mapping the coded image to the bit string of sub-systems such as file format, RTP (Real-time Transport Protocol), TS (Transport Strea), etc. according to a predetermined standard.

[105] As shown, the NAL unit is the NAL unit according to the RBSP generated from the VCL.

It can be divided into a VCL NAL unit and a Non-VCL NAL unit. The VCL NAL unit can mean a NAL unit that contains information about the video (slice data), and the Non-VCL NAL unit is a NAL unit that contains the information (parameter set or SEI message) necessary for decoding the video. Can mean

[106] The above-described VCL NAL unit and Non-VCL NAL unit can be transmitted through a network by attaching header information according to the data standard of the sub-system. For example, the NAL unit is in H.266/VVC file format, RTP (Real-RTP). time Transport Protocol), TS (Transport Stream), etc., can be transformed into data types of predetermined standards and transmitted through various networks.

[107] As described above, the NAL unit is RBSP data included in the NAL unit.

The NAL unit type may be specified according to the structure, and information on the NAL unit type may be stored in the NAL unit header and signaled.

[108] For example, whether the NAL unit contains information about the image (slice data)

Depending on whether or not, it can be largely classified into VCL NAL unit type and Non-VCL NAL unit type. The VCL NAL unit type can be classified according to the properties and types of pictures included in the VCL NAL unit, and the non-VCL NAL unit type can be classified according to the type of parameter set.

[109] The following is an example of the NAL unit type specified according to the type of parameter set included in the Non-VCL NAL unit type. The NAL unit type can be specified according to the type of parameter set, etc. For example, the NAL unit type is an APS (Adaptation Parameter Set) NAL unit, which is a type for NAL units including APS, and a type for NAL units including DPS. In DPS (Decoding Parameter Set) NAL unit, VPS (Video Parameter Set) NAL unit, which is a type for NAL unit including VPS, SPS (Sequence Parameter Set) NAL unit and PPS, which is a type for NAL unit including SPS It may be specified as any one of the PPS (Picture Parameter Set) NAL unit, which is the type for the included NAL unit.

[110] The above-described NAL unit types have syntax information for the NAL unit type, and the syntax information may be stored in the NAL unit header and signaled. For example, the syntax information may be nal_unit_type, and the NAL unit types are nal_unit_type values. Can be specified.

[111] On the other hand, as described above, one picture can contain a plurality of slices, and one slice can contain a slice header and slice data. In this case, multiple slices (slice header and slice data) within one picture. For a set), one picture header can be added. The picture header (picture header Syntax) may include information/parameters commonly applicable to the picture. The slice header (slice header syntax) may include information/parameters commonly applicable to the slice. The APS (APS syntax) or PPS (PPS syntax) may contain information/parameters commonly applicable to one or more slices or pictures. The SPS (SPS syntax) may contain information/parameters commonly applicable to one or more sequences. VPS syntax) may include information/parameters commonly applicable to multiple layers. The DPS (DPS syntax) may include information/parameters commonly applicable to overall video. The DPS is a coded video sequence (CVS). In this document, the high level syntax (HLS) refers to the above APS syntax, PPS syntax, SPS syntax, VPS syntax, DPS syntax, a picture header syntax, slice You can include at least one of the header syntax.

[112] In this text, the image/video information encoded from the encoding device to the decoding device and signaled in the form of a bitstream only includes intra-picture partitioning information, intra/inter prediction information, residual information, and in-loop filtering information. Rather, information included in the slice header, information included in the picture header, information included in the APS, information included in the PPS, information included in the SPS, information included in the VPS, and/or the information included in the DPS. Information may be included. In addition, the image/video information may further include information of the NAL unit header.

5 is a diagram showing an example of partitioning a picture.

[114] Pictures can be divided into coding tree units (CTUs), and CTUs are

Blocks (CTB) can be matched. The CTU can include a coding tree block of luma samples and two coding tree blocks of chroma samples corresponding thereto. On the other hand, the maximum allowable size of the CTU for coding and prediction is the CTU for conversion. It may be different from the maximum allowable size.

[115] A tile can correspond to a series of CTUs that cover a rectangular area of a picture, and a picture can be divided into one or more tile rows and one or more tile columns.

[116] On the other hand, a slice may consist of an integer number of complete tiles or an integer number of consecutive complete CTU rows. In this case, two slice modes including a raster-scan slice mode and a rectangular slice mode can be supported.

[117] In raster scan slice mode, a slice can contain a series of complete tiles in a tile raster scan of a picture. In square slice mode, a slice is a number of complete tiles or pictures that collectively form a rectangular area of a picture. It can contain a number of consecutive CTU rows within a tile that collectively form a rectangular region of the square. Tiles within a square slice can be scanned in tile raster scan order within the square region corresponding to that slice.

[118] Figure 5 (a) shows an example of dividing a picture into tiles and raster scan slices. 2020/175905 1»（：1^1{2020/002730 This is a drawing, for example, a picture can be divided into 12 tiles and 3 raster scan slices.

[119] In addition,) of FIG. 5 shows an example of dividing a picture into tiles and square slices.

This is a drawing, for example, a picture can be divided into 24 tiles (6 tile columns and 4 tile rows) and 9 square slices.

[120] Also, the figure in Fig. 5 shows an example of dividing the picture into tiles and square slices.

This is a drawing, for example, a picture can be divided into 24 tiles (2 tile columns and 2 tile rows) and 4 square slices.

[122] In one embodiment, information on picture partitioning 600) and tiles/tile groups

Generation 610) may be performed by the image dividing unit 210 of the encoding device, and for video/image information including information on a tile/tile group.

The encoding 620 may be performed by the entropy encoding unit 240 of the encoding device.

[123] The encoding apparatus according to an embodiment may perform picture partitioning for encoding an input picture 600). The picture may include one or more tiles/tile groups. The encoding apparatus includes an image of the picture. Considering the characteristics and coding efficiency, the picture can be partitioned into various types, and information indicating the partitioning type with the optimum coding efficiency can be generated and signaled to the decoding device.

[124] An encoding apparatus according to an embodiment includes a tile/tile applied to the picture

A group is determined, and information about the tile/tile group can be generated (610). The information on the tile/tile group may include information indicating the structure of the tile/tile group for the picture. The information on the tile/tile group includes various parameter sets and/or tile group headers as described later. It can be signaled through. A specific example is described below.

[125] The encoding apparatus according to an embodiment may encode video/image information including information on the tile/tile group and output it in the form of a bitstream 620). The bitstream is through a digital storage medium or a network. The video/video information may include a table and/or tile group header syntax described in this document. In addition, the video/video information may include prediction information, residual information, and (In-loop) filtering information may be further included. For example, the encoding apparatus may restore the current picture, apply in-loop filtering, and encode the parameters related to the in-loop filtering, and output in a bitstream format.

[127] In one embodiment, step 700 of acquiring information about a tile/tile group from a bitstream, and step 0) of deriving a tile/tile group in a picture, to a tile/tile group The step of performing the based picture decoding (S720) is the entropy of the decoding device.

It may be performed by the decoding unit 310, and the step (S620) of encoding video/image information including information on a tile/tile group may be performed by a sample decoder of the decoding apparatus.

[128] A decoding apparatus according to an embodiment includes tiles/tiles from a received bitstream.

Information on the group can be obtained (S700). The information on the tile/tile group can be obtained through various parameter sets and/or tile group headers as described later. A specific example will be described later.

The decoding apparatus according to an embodiment may derive a tile/tile group in a current picture based on the information on the tile/tile group (S phase 0).

[13 The decoding apparatus according to this embodiment may decode the current picture based on the tile/tile group (S720). For example, the decoding apparatus derives a CTU/CU located in the tile, and performs it. Based on inter/intra prediction, residual processing, restoration block (picture) generation, and/or in-loop filtering procedures can be performed. In this case, for example, the decoding device can perform context model/information in tile/tile group units. In addition, if the surrounding block or the surrounding sample referenced during inter/intra prediction is located on a tile different from the current tile where the current block is located, the decoding device may treat the surrounding block or the surrounding sample as not available. .

8 is a diagram showing an example of partitioning a picture into a plurality of tiles.

In one embodiment, tiles may refer to regions within a picture defined by a set of vertical and/or horizontal boundaries that divide the picture into a plurality of rectangles. FIG. 8 shows one picture 700 Figure 8 shows an example of splitting into multiple tiles based on a plurality of column boundaries (810) and row boundaries (820) within the first 32 maximum coding units (or 820). Coding Tree Units (CTUs) are numbered and shown.

[133] In one embodiment, each tile may include an integer number of CTUs processed in a raster scan order within each tile. In this case, a plurality of tiles within a picture, including each tile, may also include the picture. It can be processed as a raster scan order within. The tiles can be grouped to form tile groups, and tiles within a single tile group can be raster scanned. Dividing a picture into tiles is the syntax and semantics of the Picture Parameter Set (PPS). It can be defined based on semantics.

[134] In one embodiment, the information derived from the PPS about tiles may be used to check (or read) the following items. First, it is checked whether one tile exists in the picture or if more than one tile exists. If more than one tile is present, it can be checked whether the above one or more tiles are uniformly distributed, the dimension of the tiles can be checked, and whether the loop filter is enabled can be checked. have. In one embodiment, the PPS may first signal the syntax element single_tile_in_pic_flag. The single_tile_in_pic_flag may indicate whether only one tile in a picture exists or whether a plurality of tiles in a picture exist. A plurality of tiles in a picture When they are present, the decoding device can parse information about the number of tile rows and tile columns using the syntax elements num_tile_columns_minus 1 and num_tile_rows_minusl. The syntax element num_tile_columns_minus 1 and

num_tile_rows_minusl can specify the process of dividing a picture into tile rows and columns. The heights of tile rows and widths of tile columns are in terms of CTBs (i.e.

CTB unit) can be displayed.

[136] In one embodiment, whether the tiles in the picture are uniformly spaced

Additional flags can be parsed to check. If the tiles in the picture are not uniformly spaced, the number of CTBs per tile can be explicitly signaled for each tile row and column boundaries (i.e. CTB within each tile row). The number of and the number of CTBs in each tile row can be signaled). If the tiles are uniformly spaced, the tiles can have the same width and height.

[137] In one embodiment, a loop filter is enabled for tile boundaries.

Another flag (for example, the syntax element loop_filter_across_tiles_enabled_flag) can be parsed to determine whether or not.

[138] Table 1 below summarizes examples of main information about tiles that can be derived by parsing the PPS. Table 1 can represent the PPS RBSP syntax.

[139] [Table 1]

[14] Table 2 below shows an example of semantics for the syntax elements described in Table 1 above. [141] [S.2]

2020/175905 1»（：1/10公020/002730

[142]

9 is a block diagram showing a configuration of an encoding apparatus according to an embodiment, and FIG. 9 is a block diagram showing a configuration of a decoding apparatus according to an embodiment.

9 shows an example of a block diagram of the encoding device. The encoding device 900 shown in FIG. 9 includes a partitioning module 910 and an encoding module 920. The partitioning module (0) and the image division unit (0) of the encoding device shown in FIG. The same and/or similar operations may be performed, and the encoding module 920 may perform the same and/or similar operations as the entropy encoding unit 240 of the encoding apparatus shown in FIG. 2. The input video is a partitioning module 9 After being divided in W), it can be encoded in the encoding module 920. After being encoded, the encoded video can be output from the encoding device 900.

An example of a block diagram of a decoding apparatus is shown in FIG. W. The decoding apparatus 1000 shown in FIG. W includes a decoding module 1010 and a deblocking filter 1020. The decoding module ( 1010) can perform the same and/or similar operations as the entropy decoding unit 3W of the decoding apparatus shown in FIG. 3, and the deblocking filter 1020 is a filtering unit 350 of the decoding apparatus shown in FIG. The same and/or similar operations can be performed. The decoding module 1010 decodes the input received from the encoding device 900 to derive information about tiles. A processing unit based on the decoded information The deblocking filter 1020 may apply an in-loop deblocking filter to process the processing unit. In-loop filtering may be applied to remove coding artifacts generated during the partitioning process. The in-loop filtering The operation may include an adaptive loop filter (ALF), a deblocking filter (DF), a sample adaptive operation set (SAO), etc. After that, the decoded picture can be output.

[146] An example of a descriptor that embodies the parsing process of each syntax element is shown in Table 3 below.

[147] [S.3]

]

11 is a diagram showing an example of a tile and a tile group unit constituting the current picture.

[150] As mentioned above, tiles can be grouped to form tile groups. 11 shows an example in which one picture is divided into tiles and tile groups. In FIG. 11, the picture includes 9 tiles and 3 tile groups. Each tile group can be independently coded.

12 schematically shows an example of the signaling structure of tile group information

It is a drawing.

[152] In CVS (Coded Video Sequence), each tile group has a tile group header.

Tile groups can have a similar meaning to a slice group. Each tile group can be independently coded. A tile group can contain one or more tiles. A tile group header can refer to a PPS, and a PPS can sequentially refer to a SPS (Sequence Parameter Set). .

12, the tile group header is the PPS of the PPS referenced by the tile group header.

It can have an index. The PPS can refer to the SPS in sequence.

[154] In addition to the PPS index, the tile group header according to one embodiment can be determined for the following information. First, if more than one tile exists per picture, the tile group address and the number of tiles in the tile group are determined. Next, you can determine the tile group type, such as intra/predictive/bi-directional. Next, you can determine the picture order count (POC) of the Lease Significant Bits (LSB). Next, if there is more than one tile in a picture, you can determine the offset length and entry point to the tile.

[155] Table 4 below shows an example of the syntax of the tile group header. In Table 4, the tile group header (tile_group_header) can be replaced by a slice header.

2020/175905 1»(：1^1{2020/002730

[156] [Table 4]

Table 5 below shows an example of English semantics for the syntax of the tile group header.

[158] [S.5]

When present, the value of the tile group header syntax element, group_pic_parameter_set_id and ti le_group_pic_order_cnt_l sb shall be ame in all tile group headers of a coded picture. _*' ti le_group_pic_para eter_set_id specifies the value of

pps_pic_parameter_set_id for the PPS in use. The value of ti 1 e_group_pic_para eter_set_id shall be in the range of 0 to 63, inclusive. _* ·

It is a requirement of bitstream conformance that the value of Temporal Id of the current picture shall be greater than or equal to the value of Temporal Id of the PPS that has pps_pic_parameter_set_id equal to ti 1 e_group_p i c_parameter _set_id. _*' ti le_group_address specifies the tile address of the first tile in the tile group, where tile address is the tile ID as specified by Equation c-7. The length of ti le_group_address is Cei 1 (Log2 (NumTi lesInPic)) bits. The value of ti le_group_address shall be in the range of 0 to

NumTi lesInPic-1, inclusive, and the value of ti le_group_address shall not be equal to the value of ti le_group_address of any other coded tile group ML unit of the same coded picture. When ti le_group_address is not present it is inferred to be equal to 0..： num_tiies_in_ti le_group_minusl plus 1 specifies the number of tiles [159] in the tile group. The value of num_ti les_in_ti le_group_minusl shall be in the range of 0 to Nu Ti lesInPic-1, inclusive. When not present, the value of num_t i 1 es_ i n_t i le_group_minusl is inferred to be equal to 0.-' ti le_group_type specifies the coding type of the tile group according to table 6.-· _'

When nal_unit_type is equal to IRAP_NUT, i.e., the picture is an

I RAP picture, ti le_group_type shall be equal to 2.*· ti le_group_pic_order_cnt_lsb specifies the picture order count modulo MaxPicOrderCntLsb for the current picture. The length of the ti le_group_pic_order_cnt_lsb syntax element is log2_max_pic_order_cnt_lsb_minus4 + 4 bits. The value of the ti le_group_pic_order_cnt_lsb shall be in the range of 0 to

MaxPicOrderCntLsb-1, inclusive.- _' of fset_len_ inusl plus 1 specifies the length, in bits, of the entry_point_offset_ inusl [i] syntax elements. The value of offset_len_minusl shall be in the range of 0 to 31, inclusive.-· _' entry_point_of fset_minusl[ i] plus 1 specifies the i-th entry point offset in bytes, and is represented by offset_len_minusl plus 1 bits. The tile group data that follow the tile group header consists of nu _ti les_in_ti le_group_ inusl +1 subsets, with subset index values 2020/175905 1»(：1/10公020/002730

[16 this

[161] [Table 6]

[162] In one embodiment, the tile group may include a tile group header and tile group data. When the tile group address is known, each 0X1 in the tile group is 2020/175905 PCT/KR2020/002730 Locations can be mapped and decoded. Table 7 below shows an example of the syntax of tile group data. In Table 7, tile group data can be replaced with slice data.

[163] [Table

[164] Table 8 below shows an example of English semantics for the syntax of the tile group data.

WO 2020/175905 PCT/KR2020/002730

[165] [S.8]

[166] = 0; j <= num_t i le_rows_minusl; j++ )·,·

RowHeight[ j] = ((j + l) PicHeight InCtbsY) / ows_minusl + 1)-(j * PicHeight InCtbsY) / ws_minusl + 1 )+ ght [num_t i le_rows_aiinusl] = PicHeight InCtbsY

= 0： j <nu _t i le_rows_minusl： j++) i,·

RowHeight [j

RowHeight [num_t i le_rows_mimisl] -= RowHeight [j] _* '

st ColBd[ i] for i ranging from 0 to nuin_t i le_columns_minusl e, specifying the location of the i-th tile column boundary TBs, is derived as follows—

olBd[ 0] = 0, 1 = 0; i <= num_tile_coluinns_mInusl: i++ )· ColBd[ i + 1] = ColBd[ i] + Colfidtht i]

st RowBd[ j] for j ranging from 0 to num_t i le_rows_jninusl + specifying the location of the j-th tile row boundary in, is derived as follows—·

owBd[ 0] = 0, j = 0: j <= num_t i le_rows_minusl: j++ )· [167] Ro Bd [j + 1] = RowBd [j] + RowHeight[ j]

The list CtbAddrRsToTs[ ctbAddrRs] for ctbAddrRs ranging from 0 to PicSizelnCtbsY-1, inclusive, specifying the conversion from a CTB address in CTB raster scan of a picture to a CTB address in tile scan, is derived as follows: *

fori ctbAddrRs = Q; ctbAddrRs <PicSizelnCtbsY: ctbAddrRs++)-tbX = ctbAddrRs% ricWidthlnCtbsY,

tbY = ctbAddrRs / PicfidthlnCtbsY

fori i = 0： i <= num_ti ]e_coluiiins_minusl： i++ )<·

if (tbX >= ColBd[ i] ).

ti leX = i _' fori j = 0： j <= num_t ile_rows_minusl; j++)

iff tbY >= Ro«-Bd[ j])

tileY-j ·

CrbAddrRsToTsf ctbAddrRs] = 0

for( i = 0: i <ci leX ^' iH-)

CrbAddrRsToTs[ ctbAddrRs] += RowHeighi [tileY] *

Colffidtht i )·

fori j ~ 0: j <tileY; j++ ).·

CtbAddrRsToTs[ ctbAddrRs] += Gί cWidthlnCtbsY * [168] RowHei ht [j]-

CtbAddrRsToTst ctbAddrRs] += (tbY-RowBd[ tileY]) *

Coiffidth[ tileS] + tbX-ColBd[ tiieX ].·

The list CtbAddrTsToRs[ ctbAddrTs] for ctbAddrTs ranging from 0 to

FicSizelnCtbsY-1, inclusive, specifying the conversion from a CTB address in tile scan to a CTB address in CTB raster scan of a picture, is derived as follows:- for( ctbAddrRs = 0： ctbAddrRs <FicSizelnCtbsY: ctbAddrRs++) CtbAddrTsToRs[ CtbAddrRsTo ]] = ctbAddrRs-·

The list Tileld[ ctbAddrTs] for ctbAddrTs ranging from 0 to ricSizelnCtbsY-1, inclusive, specifying the conversion from a CTB address in tile scan to a tile ID, is derived as follows:- for( j = 0. tileldx = 0: j <= num_t i le_rows_minusl: j++) _*· for( i = 0: i <= num_t i le_columns_niinusl; i++, tileldx++ )«· for( y = RowBd [j ]; y <RowBd[ j + 1 ]; y++). ··

for( x = ColBd[ i ]： x <CoIBd[ i + 1 ]： X-H- )-

Tileidt CtbAddrRsToTst y * PicWidthInCtbsY+ x 3 J = tileldx-

The list NumCtusInTi ie[ tileldx] for tileldx ranging from 0 to [169] PicSizelnCtbsY-1, inclusive, specifying the conversion from a tile index to the number of CTUs in the tile, is derived as follows·· _*·

for( j = 0, tileldx = 0; j <= num_tile_rows_minusl; j++) _* for( i = 0: i <= nuin_t ile_columns_minusl; i++, tileldx++)

NumCtusInTi le[ tileldx] = Colfidth[ i] * RowHeight[ j] _' The list FirstCtbAddrTs[ tileldx] for tileldx ranging from 0 to NumTilesInPic-1. inclusive, specifying the conversion from a tile ID to the CTB address in tile scan of the first CTB in the tile are derived as fol lows：-for( ctbAddrTs = 0, tileldx = 0, tileStartFIag = 1： ctbAddrTs <

PicSizeln CtbsY;

if( tileStartFIag

FirstCtbAddrTsf t i ieldx] = ctbAddrTs

tileStartFIag = 0

}*>

tiieEndFlag = ctbAddrTs = = PicSizelnCtbsY-1

Ti 1 e Id [ctbAddrTs + 1] != Tiieldt ctbAddrTs] _*

if( tiieEndFlag) 1

ti leldx+A

tileStartFIag = 1 2020/175905 1»（：1/10公020/002730

[17 this

[171] There may be various application examples that require picture division based on tiles.

And, the present embodiments may be related to the above application examples.

[172] In one example, we review parallel processing.

Some implementations running on CPUs require dividing the source picture into tiles and tile groups, where each tile group can be processed in parallel on a separate core. The parallel processing is a high-resolution real-time encoding of videos. In addition, the above parallel processing can reduce the sharing of information between groups of tiles, thereby reducing the memory constraint. Tiles can be distributed to different threads while processing in parallel. Therefore, the parallel architecture can benefit from this partitioning mechanism.

[173] In another example, the maximum transmission unit (MTU) size matching is reviewed. The coded pictures transmitted through the network are subject to fragmentation when the coded pictures are larger than the MTU size. It can be different. Similarly, if the coded segments are small, the IP (Internet Protocol) header can become important. Packet fragmentation can lead to loss of error resiliency. The picture is taken to mitigate the effects of packet fragmentation. When dividing into tiles and packing each tile/tile group as a separate packet, the packet may be smaller than the MTU size.

[174] In another example, error resilience is reviewed. Error resilience is motivated by the requirements of some applications that apply Unequal Error Protection (UEP) to coded tile groups. Can be given.

[175] As described above, the structure of tiles for partitioning pictures can be efficiently A method for signaling is required, which is described in detail in Figs. 13 to 21.

13 is a diagram showing an example of a picture in a video conference video program.

[177] According to this specification, in tiling for partitioning a picture into a plurality of tiles, flexible tiling can be achieved by using a predefined rectangular area.

[178] In the case of the existing tiling, it was performed according to the raster scan order, but the tiling structure according to this method has recently been applied to video programs for video conferencing.

There are aspects that are not suitable for application to programs.

[179] Fig. 13 shows an example of a picture in a video program for video conferencing when a video conference with multiple participants is held. In this case, the participant is speaker l (Speaker 1), speaker 2 (Speaker 2), speaker 3 (Speaker 3) and Speaker 4 (Speaker 4) The area corresponding to each participant in the picture can correspond to each of the preset areas, and each of the preset areas can be coded as a single tile or a group of tiles. have. When a participant changes in a video conference, the single tile or group of tiles corresponding to the participant may also change.

14 is a diagram showing an example of partitioning a picture into tiles or tile groups in a video conference video program.

Referring to FIG. 14, an area assigned to a speaker 1 (Speaker 1) participating in a video conference may be coded as a single tile. Similarly, the areas assigned to each of Speaker 2, Speaker 3, and Speaker 4 can be coded as a single tile.

[182] As shown in Fig. 14, the area allocated to each participant is

In the case of coding, it is possible to enable efficient coding as spatial dependency is improved. In addition, this division method can be applied to 360 video data, which will be described later in Fig. 15.

[184] In Fig. 15, a picture can be acquired from 360 degree video data. 360 video can mean video or image content that is captured or played back in all directions (360 degrees) at the same time required to provide VR (Virtual Reality). %0 video can refer to a video or image that appears in various types of 3D space depending on the 3D model. For example, a 360 video can be displayed on a spherical surface.

[185] A two-dimensional space (2D) picture obtained from 360-degree video data can be encoded with at least one spatial resolution. For example, a picture can be encoded with a first resolution and a second resolution, and the first resolution. May be higher than the second resolution. Referring to FIG. 15, a picture can be encoded in two spatial resolutions, each having a size of 1536x1536 and 768x768, but the spatial resolution is not limited thereto and may correspond to various sizes. [186] At this time, a 6x4 size tile grid may be used for the bitstreams encoded at each of the two spatial resolutions. In addition, a motion constraint tile set (MCTS) for each position of the tiles may be coded and used. As described above with reference to FIGS. 13 and 14, each of the MCTSs may include tiles positioned in respective areas set for a picture.

[187] MCTS may contain at least one tile to form a set of square tiles.

A tile can represent a rectangular area composed of coding tree blocks (CTBs) of a two-dimensional picture. A tile can be classified based on a specific tile row and tile column within a picture. A specific MCTS in the encoding/decoding process When inter prediction is performed on the blocks within, the blocks within the specific MCTS may be restricted to refer only to the corresponding MCTS of the reference picture for motion estimation/motion compensation.

[188] For example, referring to 15, the 12 first MCTSs 1510 are of 1536x1536.

It is derived from a bitstream encoded with a spatial resolution having a size, and 12 second MCTSs 1520 may be derived from a bitstream encoded with a spatial resolution having a size of 768x768. That is, the first MCTSs 1510 May correspond to a region having a first resolution in the same picture, and the second MCTSs 1520 may correspond to a region having a second resolution in the same picture.

[189] The first MCTSs may correspond to the viewport area in the picture. The viewport area may refer to the area that the user is viewing in the 360-degree video. Or, the first MCTSs may correspond to the ROI (Region in the picture). of Interest). The ROI area can refer to the area of interest of users, suggested by the 360 content provider.

[19 At this time, MCTSs received in a single time are merged into one merged picture (merged

picture), for example, the first MCTSs 1510 and the second

The MCTSs 1520 can be merged and merged into a 1920x4708-sized merge picture 1530, and the merge picture 1530 can have four tile groups.

[191] Table 9 below shows an example of the PPS syntax.

2020/175905 1 ^» (：1/10公020/002730

[192] [Table 9]

[193] The table below shows an example of English semantics for the above syntax.

[194] [5.10]

[195]

ti le_addr_val [i ][ j] specifies the ti le_group_address value of the tile of the i-th tile row and the j— th tile column. The length of ti le_addr_val [i ][ j] is ti le_addr_len_minusl + 1 bits. _*

For any integer m in the range of 0 to num_t i 1 e_co 1 umns_m i nu s 1 inclusive, and any integer n in the range of 0 to num_t i le_rows_minusl, inclusive, ti le_addr_val [i ][ j] shall not be equal to ti le_addr_val [m ][ n] when i is not equal to m or j is not equal to n. num_mcts_in_pic_minusl plus 1 specifies the number of MCTSs in the picture 2020/175905 1»（：1/10公020/002730

[196]

[197] In an embodiment, when there are multiple tiles within a picture, a syntax element unifoml_tile_spacing_flag indicating whether tiles having the same width and height are to be derived by dividing the picture uniformly may be parsed. The syntax element above.

The unifoml_tile_spacing_flag can be used to indicate whether the tiles in the picture are divided in a uniform manner. When the syntax element unifoml_tile_spacing_flag is enabled, the width of the tile row and the height of the tile row can be parsed, i.e., the syntax indicating the width of the tile column. Element 1: _（：011111111_\¥1（1111_1111111181 and a syntax element representing the height of the tile row (116_1'0\¥_11 寒11（：_1111111181 can be signaled and/or parsed).

[198] In one embodiment, the tiles in the picture

Syntax element indicating whether to form 111 8_:^Can be parsed.

If so, it may indicate that the tiles or groups of tiles in the picture may or may not form a square tile set, and that the use of sample values or variables outside the rectangular tile set is restricted or unrestricted. 111 If _:^^ is 1, it can be indicated that the picture is divided into ■刀.

[199] In addition, the syntax element 1111111_111（：18_：11 in 1（：_1111111181 may represent the number. In one embodiment, when 111_£ is 1,

In the case of dividing by, the syntax element num_mcts_in_pic_minusl can be parsed. 2020/175905 1»(：1/10公020/002730 There is.

[20] In addition, the syntax element top_left_tile_addr[i] is in the i-th MCTS

The tile_group_address value, which is the position of the tile located at the top-left, can be indicated. Similarly, the syntax element bottom_right_tile_addr[ i] is the i-th

In MCTS, the tile_group_address value, which is the location of the tile located at the bottom-right, can be displayed.

[201] Table 11 below shows an example of the tile group data syntax. In Table 11, tile group data can be replaced with slice data.

[202] [Table 11]

[203] Table 12 below shows English semantics for the tile group data syntax.

Give an example.

2020/175905 1»(：1/10公020/002730

[204] [Table 12]

[205] On the other hand, the scanning process of the order of decoding the tiles in the picture (

have.

2020/175905 1»(：1/10公020/002730

[206] [Table 13]

16 is a diagram showing an example of dividing a picture based on an R region.

[208] According to the present specification, in tiling for partitioning a picture into a plurality of tiles, flexible tiling based on a region of interest (ROI) can be achieved. Referring to FIG. 16, a picture is in the R region. Based on this, it can be divided into multiple tile groups.

[209] Table 14 below shows an example of the PPS syntax.

2020/175905 1»(：1/10公020/002730

[210] [Table 14]

[211] Table 15 below shows an example of English semantics for the above syntax.

[212] [5.15]

2020/175905 1»(：1/10公020/002730

[213]

In one embodiment, a syntax element tile_group_info_in_pps_flag indicating whether tile group information related to tiles included in the tile group exists in or in a tile group header referring to may be parsed.

If tile_group_info_in_pps_flag is 1, it can be indicated that the tile group information exists in 客 and does not exist in the tile group header referring to 客. In addition, when tile_group_info_in_pps_flag is 0, the tile group information does not exist in 客 and refers to In the tile group header, it can indicate its presence.

have.

In addition, the syntax element niim_tile_groups_in_pic_minusl may indicate the number of tile groups in the picture referring to.

[216] In addition, the syntax element pps_first_tile_id] can represent the tile 11) of the first tile of the first tile group, and the syntax element pps_last_tile_id can represent the tile 11) of the last tile of the first tile group.

17 is a diagram showing an example of partitioning a picture into a plurality of tiles.

[218] According to the present specification, coding for tiling that divides a picture into a plurality of tiles Flexible tiling can be achieved by considering tiles smaller than the size of the tree unit (CTU). The tiling structure according to this method can be usefully applied to modern video applications such as video conferencing programs.

[219] Referring to FIG. 17, a picture may be partitioned into a plurality of tiles, and a plurality of

The size of at least one of the tiles may be smaller than the size of the Coding Tree Unit (CTU), e.g., a picture is a tile l (Tile 1), a tile 2 (Tile 2), a tile 3 (Tile 3) and a tile. It can be partitioned into 4 (Tile 4), among which the size of Tile 1, Tile 2, and Tile 4 is smaller than the size of CTU.

[22 Table 16 below shows an example of the PPS syntax.

[221] [Table 16]

[222] Table 17 below shows an example of English semantics for the PPS syntax.

[223] [Table 17]

2020/175905 PCT/KR2020/002730

[224] In one embodiment, the syntax element tile_size_unit_idc may represent the unit size of the tile. For example, if tile_size_unit_id is 0, 1, 2..., the height and width of the tile is a coding tree block (CTB) can be defined as 4, 8, 16...

[225] Figure 18 shows an example of partitioning a picture into a plurality of tiles and tile groups

This is a drawing to show.

[226] According to this specification, a plurality of tiles within a picture can be grouped into a plurality of tile groups, and flexible tiling can be achieved by applying a tile group index to the plurality of tile groups.

[227] On the other hand, in the case of conventional tiling, tiles arranged in raster scan order were grouped into multiple tile groups. However, according to this specification, at least one type group among multiple tile groups is non-existent in order to promote flexible tiling. Raster

It can contain tiles arranged in a non-raster scan order.

[228] For example, referring to Fig. 18, a picture can be partitioned into a plurality of tiles, and a plurality of tiles is a tile group l (Tile Group 1), a tile group 2 (Tile Group 2), and a tile group 3 (Tile Group). It can be grouped by 3), where each of tile group 1, tile group 2 and tile group 3 can contain tiles arranged in a non-raster scan order.

[229] Table 18 below shows an example of the syntax of the tile group header (tile_group_header).

In Table 18, tile group headers can be replaced with slice headers.

[23 is [Table 18]

[231] Table 19 below shows an example of English semantics for the syntax of the tile group header. 2020/175905 1»(：1/10公020/002730

[232] [Table 19]

[233] In one embodiment, a syntax element bar 6_ that designates an index of each of a plurality of tile groups within a picture may be 1'011]3_:111 (16 visible signalling/parsing. In this case, bar 6_ is 1'011] 3_: 111 (value of 16 bar for another tile in the same picture group NAL unit 6_; 011; 3_: 111 _(not the same as the value of 16.

[234] under

Example

In Table 20, tile group headers can be replaced with slice headers.

[235] [Table 2

[236] Table 21 below shows an example of English semantics for the syntax of the tile group header. [237] [5.21]

[238]

single_t i le_per_t i le_group_f lag is equal to 1, the value of single_t i le_in_t i le_group_f lag is inferred to be equal to 1. _*

firs t_t i 1 e_i d specifies the tile ID of the first tile of the tile group. The length of fir s t_t i 1 e_i d is CeiK Log2( NumTi lesInTic)) bits. The value of f irst_ti le_id of a tile group shall not be equal to the value of f irst_t i le_id of any other tile group of the same picture. When not present, the value of f irst_t i le_id is inferred to be equal to the tile ID of the first tile of the current picture.-'

i as t_t i 1 e_i d specifies the tile ID of the last tile of the tile group. The length of last_tile_id is CeiK Log2( NumTi lesInTic)) bits.-' When NumTi lesInTic is equal to 1 or single_t i le_in_t i le_group_f lag is equal to 1, the value of last_tile_id is inferred to be equal to f irst _ ti le_id . When ti le_group_info_in_pps_f lag is equal to 1, the value of 1 as t_t ii e_i d is inferred to be equal to the value of

2020/175905 1»(：1/10公020/002730

[239] pps_last_r i le_id[ i] where i is the value such that f irst_ti le_id is equal to pps_f irst_t i le_id[ i].

NOTE-The first_tile_id is the tile ID of the tile located at the top-left corner of the tile group, and the last_ti le_id is the tile ID of the tile located at the bottom-right corner of the tile group. ^

The variable NumTi lesInTi leGroup, which specifies the number of tiles in the tile group, and TgTi leldx[ i], which specifies the tile index of the i-th ti le in the tile group, are derived as follows: deltaTi leldx = last_t i le_idx一 f irst_ti le_idx^ nimiTi leRows = (deltaTi leldx / (nuni_t i le_colunuis_minusl + 1)) + l iiuiiiTI leColunms = (deltaTi leldx% (nuin_t i le_coIumns_minusl + 1)) + 1 ^ nuinTi leRows = nuinTi le leColunms ^ ti leldx = first_ti le_id^

[24 this

In one embodiment, for each of a plurality of tile groups in a picture, a syntax element first_tile_id that designates a tile ID of the first tile may be signaled/parsed. The first_tile_id may correspond to the tile ID of the tile located at the top-left of the tile group. In this case, the tile ID of the first tile of the tile group is not the same as the tile ID of the first tile of the other tile group in the same picture.

[242] In one embodiment, the tile of the last tile for each of the plurality of tile groups in the picture The syntax element last_tile_id specifying the ID can be signaled/parsed. The last_tile_id may correspond to the tile ID of the tile located at the bottom-right of the tile group. When the syntax element NumTilesInPic is 1 or single_tile_in_tile_group_flag is 1, the value of last_tile_id can be the same as first_tile_id. In addition, when the tile_group_info_in_pps_flag is 1, the value of last_tile_id can be the same as the meaning of pps_last_tile_id.

[243] Fig. 19 shows an example of partitioning a picture into a plurality of tiles and tile groups

This is a drawing to show.

[244] According to this specification, tiles can be grouped secondaryly within the tile group of a picture. Accordingly, the size of the tiles can be more effectively controlled, and thus flexible tiling can be achieved.

[245] For example, referring to 19, a picture can be first partitioned into three tile groups, and Tile group #2, which is a second tile group, can be additionally partitioned into secondary tile groups.

[246] Table 22 below shows an example of the PPS syntax.

[247] [Table 22]

[248] The following is an example of semantics. 2020/175905 1 ^» (：1/10公020/002730

[249] [Table 23]

[25] In this embodiment, a syntax element related to the number of tile groups within a picture

111D1_(116_寒1'01中8_1111111181 can be signaled/parsed. For example, the value of the syntax element 1111111_(1'01¾^_1111111181 for 116_ plus 1) indicates the number of tile groups in the picture. Can be represented.

[251] In one embodiment, the first (syntax element calculation specifying the position of the ¾) positioned on the upper left side (one part-:¾) of the soil-th tile group in the picture _寒1'0111)_11_（1（ 1 88]

It can be signaled/parsed. Also,

Lower right girl !!!-! !!!) at the end (Syntax element specifying the position of ¾) _611 (1_（1（1 88] can be signaled/parsed. Mountain _寒1'0111)_ 031_（ 1（1 88] and 1: The value of _寒1'0111)_611（1_（1（1 88] is （for 立16_1 ^* 0111）_ Table 11_（1（1 8） of the other tile group units in the same picture. It is not the same as the value of [}] and (for 立16_1 ^* 0111 YES 1 (1_（1（1 8□]).

[252] Also, according to this specification, II) of the tiles in the picture can be explicitly signaled. 2020/175905 PCT/KR2020/002730, and the ID of the tile may be different from the index of the tile. Accordingly, it is possible to provide MCTS without the need to change the video coding layer (VCL) and the network abstraction layer (NAL). In addition, The advantage is that there is no need to change the tile group header.

[253] Table 24 below shows an example of the PPS syntax.

[254] [Table 24]

[255] Table 25 below shows an example of English semantics for Su.

2020/175905 1»(：1/10公020/002730

[256] [Table 25]

[257] In one embodiment, a plurality of tiles, each tile of the tile II) is explicitly

Indicates signaled

Signaling / can be parsed There is 2020/175905 PCT/KR2020/002730, for example, if explicit_tile_id_flag is 0, the tile ID is explicitly

It can indicate that it is not signaled.

In one embodiment, a syntax element tile_id_val[i] designating the tile ID of the i-th tile in the picture referencing the PPS may be signaled/parsed.

Meanwhile, the variables in Table 26 below can be derived by calling the CTB raster and tile scanning conversion process.

[260] [5.26]

2020/175905 1»（：1/10公020/002730

[261]

[262] Table 27 below shows an example of the syntax of the tile group header. In Table 27, the tile group header can be replaced by a slice header. 2020/175905 1»(：1/10公020/002730

[263] [Table 27]

[264] Table 28 below shows an example of English semantics for the syntax of the tile group header.

[265] [Table 28]

In one embodiment, a syntax element tile_group_address that designates the tile ID of the first tile of the tile group in the picture may be signaled/parsed. The value of tile_group_address is not the same as the value of tile_group_address of other tile group NAL units in the same picture.

[267] On the other hand, in certain systems it may be necessary to identify a tile group. This may be essential at the system level to interpret and distinguish which VCL NAL units belong to a certain tile group.

[268] For example, a MANE (Media-Aware Network Element) or video editor can identify a tile group carried by NAL units, and remove the corresponding NAL units or belong to a target tile group. A sub-bitstream including NAL units can also be provided.

[269] To do this, a syntax element that has the same value as the value of tile_group_id

nuh_tile_group_id may be suggested in the NAL unit header.

[27 This network element or video editor only 2020/175905 1»(：1/10公020/002730 By parsing and interpreting, the tile group carried by the NAL units can be easily identified. In addition, the network element or video editor can remove the corresponding NAL units. Accordingly, a subbitstream including NAL units belonging to the target tile group can be extracted.

[271] Table 29 below shows an example of the syntax of the NAL unit header.

[272] [Table 29]

[273] Table 30 below shows an example of English semantics for the syntax of the show unit header.

[274] [Table 3

[275] In one embodiment, a syntax element specifying tile group II) of the NAL unit

111山_ bought 16_ 011]3_:1（1 can be signaled/parsed. 111!11_Bought 16_ 011]3_：1 (The value of 1 is the same as the value of (_ 01¾)_ of the tile group header.

[276] Table 31 below shows an example of the syntax of _1^(1) when the example of a tile group header is bright. In Table 31, a tile group header can be replaced by a slice header.

2020/175905 1»(：1/10公020/002730

[277] [Table 31]

[278] Table 32 below shows an example of English semantics for the syntax of the tile group header. 2020/175905 1»（：1/10公020/002730

[279] [Table 32]

[28 In this embodiment, a syntax element tile_group_id specifying a tile group ID of a tile group in a picture may be signaled/parsed. At this time, the value of tile_group_id is not the same as the value of tile_group_id of another tile group NAL unit in the same picture.

20 is a flow chart showing the operation of the decoding apparatus according to an embodiment, and FIG. 21 is a block diagram showing the configuration of the decoding apparatus according to the embodiment.

Each step disclosed in FIG. 20 may be performed by the decoding device 300 disclosed in FIG. 3. More specifically, S2000 and S2010 are entropy disclosed in FIG.

It may be performed by the decoding unit 310, S2020 may be performed by the prediction unit 330 disclosed in FIG. 3, and S2030 may be performed by the addition unit 340 disclosed in FIG. 3. In addition, operations according to S2000 to S2030 may be performed according to S2000 to S2030. , It is based on some of the contents described above in Figs. 1 to 19. Therefore, specific contents overlapping with the contents described above in Figs. 1 to 19 will be omitted or simplified.

[283] As shown in FIG. 21, the decoding apparatus according to an embodiment is

It may include a decoding unit (3W), a prediction unit 330 and an addition unit 340. However, in some cases, all of the components shown in Fig. 21 may not be essential components of the decoding device, and the decoding device is It may be implemented by more or less components than the components shown in FIG. 21.

[284] In the decoding apparatus according to an embodiment, the entropy decoding unit (3W), the prediction unit 330, and the addition unit 340 are each implemented as a separate chip, or at least two or more components are It can also be implemented through a chip.

[285] The decoding apparatus according to an embodiment includes partition information for a current picture (partition

information) and image information including prediction infomiation about the current block included in the current picture can be obtained from the bitstream.

More specifically, the entropy decoding unit (3W) of the decoding device can obtain image information including segmentation information for the current picture and prediction information for the current block included in the current picture from the bitstream. have. [286] The decoding apparatus according to an embodiment may provide a partitioning structure of the current picture based on a plurality of tiles, based on the division information for the current picture. (S2(XL0). More specifically, the entropy decoding unit (3W) of the decoding device is based on the division information on the current picture, In one example, the plurality of tiles are grouped into a plurality of tile groups, and at least one type group among the plurality of tile groups is a non-raster scan. ) May contain tiles arranged in order.

[287] The decoding apparatus according to an embodiment may derive predicted samples for the current block based on the prediction information for the current block included in one of the plurality of tiles (S2020). More specifically, the prediction unit 330 of the decoding apparatus may derive prediction samples for the current block based on the prediction information for the current block included in one of the plurality of tiles.

[288] The decoding apparatus according to an embodiment may restore the current picture based on the predicted samples (S2030). More specifically, the adding unit 340 of the decoding apparatus is based on the predicted samples. Pictures can be restored.

[289] In one embodiment, the split information for the current picture is, index information for each of the plurality of tile groups, and located at the top-left for each of the plurality of tile groups. It may include at least one of the ID information of the tile and the ID information of the tile located at the bottom-right of each of the plurality of tile groups.

[29 In this embodiment, the division information on the current picture is at least one of flag information on whether ID information of each of the plurality of tiles is explicitly signaled, and ID information of each of the plurality of tiles. In addition, at least one of the flag information and ID information of each of the plurality of tiles may be included in a PPS (Picture Parameter Set) of the image information.

[291] In one embodiment, the division information for the current picture includes information on the number of tiles of the plurality of tile groups, and a coding tree (CTB) positioned at the top-left for each of the plurality of tile groups. Block) and at least one of the location information of the CTB located at the bottom-right for each of the plurality of tile groups.

[292] In addition, information on the number of tile groups, location information of the CTB located at the upper left of each of the plurality of tile groups, and location of the CTB located at the lower right of each of the plurality of tile groups At least one of the information may be included in the PPS (Picture Parameter Set) of the image information.

[293] In one embodiment, the division information for the current picture may further include ID information of each of the plurality of tile groups. In addition, the plurality of tile groups Each ID information may be included in the NAL (Network Abstraction Layer) unit header of the image information.

[294] According to the above-described disclosure, a picture can be converted to a plurality of tiles and the plurality of tiles are

It is possible to flexibly partition into a plurality of tile groups to be grouped. Further, according to the present disclosure, the efficiency of picture partitioning can be improved based on the division information for the current picture.

22 is a flow chart showing an operation of an encoding device according to an embodiment, and FIG. 23 is a block diagram showing a configuration of an encoding device according to an embodiment.

The encoding apparatus according to FIGS. 22 and 23 can perform operations corresponding to those of the decoding apparatus according to FIGS. 20 and 21. Accordingly, operations of the encoding apparatus to be described later in FIGS. The same can be applied to a decoding device according to 21.

[297] Each step disclosed in FIG. 22 may be performed by the encoding apparatus 200 disclosed in FIG. 2. More specifically, S2200 and S2210 may be performed by the image dividing unit 210 disclosed in FIG. 2, and S2220 and S2230 may be performed by the prediction unit 220 disclosed in Fig. 2, and S2240 may be performed by the entropy encoding unit 240 disclosed in Fig. 2. In addition, operations according to S2200 to S2240 are described above in Figs. It is based on some of the contents. Therefore, detailed contents overlapping with the contents described above in Figs. 1 to 19 will be omitted or simplified.

As shown in FIG. 23, the encoding apparatus according to an embodiment may include an image division unit 210, a prediction unit 220, and an entropy encoding unit 240. However, in some cases, All of the components shown in 23 may not be essential components of the encoding device, and the encoding device may be implemented by more or less components than the components shown in FIG. 23.

[299] In the encoding apparatus according to an embodiment, the image segmentation unit 210, the prediction unit 220, and the entropy encoding unit 240 are each implemented as a separate chip, or at least two or more components are It can also be implemented through a chip.

[300] The encoding apparatus according to an embodiment can divide the current picture into a plurality of tiles.

More specifically, the image dividing unit 210 of the encoding apparatus may divide the current picture into a plurality of tiles.

[301] The encoding apparatus according to an embodiment may generate division information for the current picture based on the plurality of tiles (S22W). More specifically, the image division unit 2W of the encoding apparatus includes the plurality of tiles. In one example, the plurality of tiles are grouped into a plurality of tile groups, and at least one type group among the plurality of tile groups is non-raster scan. You can include tiles arranged in (non-raster scan) order. The encoding apparatus according to an embodiment may derive prediction samples for the current block included in one of the plurality of tiles (S2220). More specifically, the prediction unit 220 of the encoding apparatus Can derive prediction samples for the current block included in one of the plurality of tiles.

[303] The encoding apparatus according to an embodiment, based on the predicted samples, the current

It is possible to generate prediction information for the block (S2230). More specifically, the prediction unit 220 of the encoding device may generate prediction information for the current block based on the prediction samples.

The encoding apparatus according to an embodiment may encode image information including division information for the current picture and prediction information for the current block (S2240). More specifically, it is possible to encode image information including at least one of division information for the current picture or prediction information for the current block.

[305] In one embodiment, the split information for the current picture is, index information for each of the plurality of tile groups, and located at the top-left for each of the plurality of tile groups. It may include at least one of the ID information of the tile and the ID information of the tile located at the bottom-right of each of the plurality of tile groups.

[306] In one embodiment, the split information on the current picture is at least one of flag information on whether ID information of each of the plurality of tiles is explicitly signaled, and ID information of each of the plurality of tiles. In addition, at least one of the flag information and ID information of each of the plurality of tiles may be included in a PPS (Picture Parameter Set) of the image information.

[307] In one embodiment, the division information for the current picture includes information on the number of tile groups, and a coding tree (CTB) positioned at the top-left for each of the plurality of tile groups. Block) and at least one of the location information of the CTB located at the bottom-right for each of the plurality of tile groups.

[308] In addition, information on the number of tile groups, location information of the CTB located at the upper left of each of the plurality of tile groups, and location of the CTB located at the lower right of each of the plurality of tile groups At least one of the information may be included in the PPS (Picture Parameter Set) of the image information.

In one embodiment, the split information for the current picture may further include ID information of each of the plurality of tile groups. Further, ID information of each of the plurality of tile groups is the image information. It can be included in the NAL (Network Abstraction Layer) unit header.

[310] In the above-described embodiment, the methods are described on the basis of a flow chart as a series of steps or blocks, but this disclosure is not limited to the order of the steps, and certain steps are in a different order from those described above, or It can occur simultaneously. Also, Those skilled in the art will appreciate that the steps shown in the flowchart are not exclusive, other steps may be included, or one or more steps in the flowchart may be deleted without affecting the scope of this disclosure.

[311] The above-described method according to this disclosure can be implemented in the form of software, and the encoding device and/or the decoding device according to this disclosure can perform image processing such as TV, computer, smartphone, set-top box, and display device. It can be included in a device that performs.

[312] In the present disclosure, when the embodiments are implemented as software, the above-described method is

It can be implemented as a module (process, function, etc.) that performs a function. Modules are stored in memory and can be executed by the processor. The memory can be inside or outside the processor, it is well known and can be connected to the processor by various means. . Processors may include application-specific integrated circuits (ASICs), other chipsets, logic circuits and/or data processing devices. Memory includes read-only memory (ROM), random access memory (RAM), flash memory, memory card In other words, the embodiments described in this disclosure may be implemented and implemented on a processor, microprocessor, controller, or chip. For example, the functional units shown in the respective figures may be included. It can be implemented and performed on a computer, processor, microprocessor, controller or chip, in which case information on instructions or algorithms can be stored on a digital storage medium.

[313] In addition, the decoding device and encoding device to which this disclosure is applied are multimedia broadcasting.

Transmission/reception device, mobile communication terminal, home cinema video device, digital cinema video device, surveillance camera, video conversation device, real-time communication device such as video communication, mobile streaming device, storage medium, camcorder, video-on-demand (VoD) service provider device , OTT video (Over the top video) device, Internet streaming service providing device,

3D (3D) video device, VR (virtual reality) device, AR (argumente reality) device, video phone video device, transportation terminal (ex. vehicle (including self-driving vehicle) terminal, airplane terminal, ship terminal, etc.) and It can be included in medical video equipment, etc., and can be used to process video signals or data signals. For example, OTT video (Over the top video) devices include game consoles, Blu-ray players, Internet access TVs, home theater systems, It can include smartphones, tablet PCs, and DVR (Digital Video Recoder).

[314] In addition, the processing method to which this disclosure is applied may be produced in the form of a program executed by a computer, and may be stored in a computer-readable recording medium. Multimedia data having a data structure according to the present disclosure may also be produced by a computer. The computer-readable recording medium includes all kinds of storage devices and distributed storage devices in which computer-readable data is stored. The computer-readable recording medium is, for example, a computer-readable recording medium. For example, it can include Blu-ray disk (BD), universal serial bus (USB), ROM, PROM, EPROM, EEPROM, RAM, CD-ROM, magnetic tape, floppy disk and optical data storage device. The temporary readable recording medium is a carrier (e.g. For example, it includes media implemented in the form of transmission over the Internet). In addition, bitstreams generated by the encoding method may be stored in a computer-readable recording medium or transmitted through a wired or wireless communication network.

Further, an embodiment of the present disclosure may be implemented as a computer program product using a program code, and the program code may be executed in a computer by an embodiment of the present disclosure. The program code is a carrier readable by a computer. Can be stored on

[316] Figure 24 shows an example of a content streaming system to which the disclosure of this document can be applied.

Referring to FIG. 24, the content streaming system to which this disclosure is applied may largely include an encoding server, a streaming server, a web server, a media storage, a user device, and a multimedia input device.

[318] The encoding server plays a role of generating a bitstream by compressing content input from multimedia input devices such as smartphones, cameras, camcorders, etc. into digital data and transmitting them to the streaming server. As another example, a smart phone When multimedia input devices such as phones, cameras, camcorders, etc. directly generate bitstreams, the encoding server may be omitted.

The bitstream may be generated by an encoding method or a bitstream generation method to which the present disclosure is applied, and the streaming server may temporarily store the bitstream while transmitting or receiving the bitstream.

[32 This streaming server transmits multimedia data to a user device based on a user request through a web server, and the web server serves as a medium that informs the user of what kind of service is available. The user wants the web server to be sent to the user's device. When a service is requested, the web server delivers it to the streaming server, and the streaming server transmits multimedia data to the user. At this time, the content streaming system may include a separate control server, in which case the control server is the above. It controls the command/response between devices in the content streaming system.

[321] The streaming server may receive the content from the media storage and/or the encoding server. For example, when receiving the content from the encoding server, the content can be received in real time. In this case, a seamless streaming service In order to provide a, the streaming server may store the bitstream for a predetermined time.

[322] Examples of the user device, mobile phones, smart phones (smart phone), notebook

Computer (laptop computer), digital broadcasting terminal, PDA (personal digital assistants), PMP (portable multimedia player), navigation, slate PC, tablet PC, ultrabook (ul-abook), wearable device (wearable device, for example, a watch-type terminal (smartwatch), a glass-type terminal (smart glass), HMD (head mounted display), digital TV, desktop computer, digital signage, etc.

Each server in the content streaming system can be operated as a distributed server, and in this case, the data received from each server can be distributed and processed.

[324] The claims in this specification can be combined in various ways. For example, the technical features of the method claims of this specification can be combined to be implemented as an apparatus, and the technical features of the apparatus claims of this specification can be combined in a method. Can be implemented. In addition, the technical characteristics of the method claim of this specification and the technical characteristics of the apparatus claim may be combined to be implemented as a device, and the technical characteristics of the method claim of this specification and the technical characteristics of the device claim may be combined to be implemented in a method.

Claims

2020/175905 1»（：1/10公020/002730 Claims

[Claim 1] In the video decoding method performed by the decoding device,

Acquiring from a bitstream image information including partition information on a current picture and, for example, prediction information on a current block included in the current picture;

Reducing a partitioning structure of the current picture based on a plurality of tiles based on the division information for the current picture;

Deriving prediction samples for the current block based on the prediction information for the current block included in one of the plurality of tiles; And

Including the step of restoring the current picture based on the prediction samples,

The plurality of tiles are grouped into a plurality of tile groups, and at least one type group among the plurality of tile groups includes tiles arranged in a non-raster scan order. .

[Claim 2] The method of claim 1,

The segmentation information for the current picture includes index (i _n d _ex ) information of each of the plurality of tile groups, ID information of a tile located at the top-left of each of the plurality of tile groups, A video decoding method comprising at least one of ID information of a tile positioned at a bottom-right for each of the plurality of tile groups.

[Claim 3] The method of claim 1,

The division information for the current picture,

The plurality of tiles further include at least one of flag information on whether ID information of each of the plurality of tiles is explicitly signaled and ID information of each of the plurality of tiles,

At least one of the flag information and ID information of each of the plurality of tiles is included in a PPS (Picture Parameter Set) of the image information.

[Claim 4] The method of claim 1,

The division information for the current picture,

Information on the number of tiles of the plurality of tile groups, location information of the coding tree block (CTB) located at the top-left of each of the plurality of tile groups, and the lower right of each of the plurality of tile groups ( Image decoding including at least one of the CTB's location information located at the bottom-right) Way.

[Claim 5] The method of claim 4,

At least one of the number information of the plurality of tile groups, the location information of the CTB located at the upper left of each of the plurality of tile groups, and the location information of the CTB located at the lower right of each of the plurality of tile groups Included in the PPS (Picture Parameter Set) of the image information, image decoding method.

[Claim 6] The method of claim 1,

The division information for the current picture,

Each of the plurality of tile groups further includes ID information, and the ID information of each of the plurality of tile groups is included in the NAL (Network Abstraction Layer) unit header of the image information.

[Claim 7] In the video encoding method performed by the encoding device,

Dividing the current picture into a plurality of tiles;

Generating segmentation information for the current picture based on the plurality of tiles;

Deriving prediction samples for the current block included in one of the plurality of tiles;

Generating prediction information for the current block based on the prediction samples; And

Including the step of encoding image information including segmentation information on the current picture and prediction information on the current block,

[Claim 8] The method of claim 7,

The segmentation information for the current picture includes index (i _n d _ex ) information of each of the plurality of tile groups, ID information of a tile located at the top-left of each of the plurality of tile groups, An image encoding method comprising at least one of the ID information of a tile located at the bottom-right for each of the plurality of tile groups.

[Claim 9] The method of claim 7,

The division information for the current picture,

At least of the flag information and ID information of each of the plurality of tiles One is included in the PPS (Picture Parameter Set) of the image information, image encoding method.

[Claim 10] In paragraph 7,

The division information for the current picture,

Information on the number of tiles of the plurality of tile groups, location information of the coding tree block (CTB) located at the top-left of each of the plurality of tile groups, and the lower right of each of the plurality of tile groups ( An image encoding method that includes at least one of the CTB's location information located at the bottom-right).

[Claim 11] In clause 10,

At least one of the number information of the plurality of tile groups, the location information of the CTB located at the upper left of each of the plurality of tile groups, and the location information of the CTB located at the lower right of each of the plurality of tile groups Included in the PPS (Picture Parameter Set) of the image information, image encoding method.

[Claim 12] In paragraph 7,

The division information for the current picture,

The plurality of tile groups each further includes ID information, and the ID information of each of the plurality of tile groups is included in the NAL (Network Abstraction Layer) unit header of the image information. [Claim 13] The decoding device is required to perform the video decoding method.

In a computer-readable digital storage medium for storing encoded image information, the image decoding method,

The plurality of tiles are grouped into a plurality of tile groups, and at least one type group among the plurality of tile groups includes tiles arranged in a non-raster scan order.