WO2020182157A1 - Encoding method and device, and decoding method and device - Google Patents

Abstract

The present application relates to the technical field of data processing. Disclosed are an encoding method and device, and a decoding method and device. The method comprises: when a current block starts an intra sub-block sub-partition mode, determining a target sub-block sub-partition mode from sub-block sub-partition modes supported by the current block, and partitioning the current block into a plurality of sub-blocks according to the target sub-block sub-partition mode; determining a target prediction mode of the current block from prediction modes of a candidate prediction mode list of the current block, performing intra sub-block prediction according to the target prediction mode to obtain prediction pixel information of the plurality of sub-blocks, and determining residual information of the current block according to original pixel information of the current block and the prediction pixel information of the plurality of sub-blocks; transforming the residual information according to a transformation mode supported by the plurality of sub-blocks, and encoding the current block according to the transformed information to generate an encoding stream of the current block. According to the present application, the problem of relatively high processing costs of hardware on the sub-blocks partitioned by means of a certain sub-partition mode can be avoided.

Description

Coding method, decoding method and device

This application claims the priority of the Chinese patent application with the application number 201910181501.7 and the invention title "Encoding Method, Decoding Method and Device" filed on March 11, 2019, the entire content of which is incorporated into this application by reference.

Technical field

This application relates to the field of data processing technology, and in particular to an encoding method, decoding method and device.

Background technique

At present, ISP (Intra sub-block sub-partitions) technology is widely used in image coding. The principle of this ISP technology is to divide an image block into multiple sub-blocks to make predictions based on the multiple sub-blocks. , Transformation, quantization, and coding.

In some embodiments, the sub-block division mode for the image block supporting the ISP technology generally includes a horizontal mode and a vertical mode. For example, for a 16*8 image block, it can be divided into four 16*2 sub-blocks in a horizontal manner, and four 4*8 sub-blocks in a vertical manner. In addition, for a 4*8 image block, it can be divided into two 4*4 blocks in a horizontal manner, and can be divided into two 2*8 sub-blocks in a vertical manner. After that, the hardware can perform a series of processing based on the obtained sub-blocks.

In the foregoing implementation manner, since the sub-block division modes of the image block supporting the ISP technology include a horizontal mode and a vertical mode, however, after dividing according to a certain sub-block division mode, it may cause the hardware to process some size sub-blocks more expensively.

Summary of the invention

The embodiments of the present application provide an encoding method, a decoding method, a device, a device, and a storage medium, which can solve the problem of relatively large processing of some size sub-blocks by hardware in related technologies. The technical solution is as follows:

In the first aspect, an encoding method is provided, and the method includes:

When the current block starts the intra-frame sub-block division mode, determine the target sub-block division mode from the sub-block division modes supported by the current block, and divide the current block into multiple sub-blocks according to the target sub-block division mode;

Determining the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block;

Performing intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks, and determining residual information of the current block according to original pixel information of the current block and predicted pixel information of the multiple sub-blocks;

Transform the residual information according to the transformation modes supported by the multiple sub-blocks to obtain transformed information;

According to the transformed information, the current block is encoded to generate an encoded stream of the current block.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*N, and N is greater than 4, the sub-block division mode supported by the current block is horizontal division;

If the width and height dimensions of the current block are 8*N and N is greater than or equal to 4, the sub-block division mode supported by the current block is horizontal division, or the sub-block division mode supported by the current block includes both vertical division and Horizontal division, vertical division can only be divided into two sub-blocks.

In a possible implementation of the present application, if the width and height dimensions of the current block are 64*64, the current block does not support the intra sub-block division mode.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the candidate sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*16 or 4*32 or 8*32, the current block does not support vertical division, but only supports horizontal division;

If the width and height dimensions of the current block are 16*4 or 32*4 or 32*8, the current block does not support horizontal division, but only supports vertical division.

In a possible implementation of the present application, if the intra-frame sub-block division mode is activated for the current block, the multiple sub-blocks are obtained according to non-uniform division; or the multiple sub-blocks are obtained according to uniform division; or,

If the current block starts the intra-frame sub-block division mode, the multiple sub-blocks are obtained according to multi-level division.

In a possible implementation of this application,

When the intra sub-block division mode is activated by the current block, the candidate prediction mode list of the current block includes:

If the current block starts intra-frame sub-block division, if the candidate prediction mode list corresponding to the intra-frame sub-block division includes the vertical prediction mode and the horizontal prediction mode, then

When the sub-block division mode supported by the current block is horizontal division, place the vertical prediction mode before the horizontal prediction mode;

When the sub-block division mode supported by the current block is vertical division, the horizontal prediction mode is placed before the vertical prediction mode.

In a possible implementation of this application,

When the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode is a predefined fixed list;

Wherein, the fixed list only includes Planar prediction mode;

Or, if the target sub-block division mode of the current block is horizontal division, the fixed list only includes the horizontal mode; or, if the target sub-block division mode of the current block is vertical division, the fixed list only Including vertical mode.

In a possible implementation of this application,

When the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list;

Wherein, the non-angle candidate mode list includes only Planar mode or only DC mode, and the angle candidate mode list includes at least one angle prediction mode other than Planar mode and DC mode; or

The non-angle candidate mode list includes Planar mode and DC mode, and the angle candidate mode list includes at least one angle prediction mode other than the Planar mode and the DC mode.

In a possible implementation of this application,

When the intra-frame sub-block division mode is activated by the current block, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra-frame sub-block division mode is shared by the spatially adjacent coded blocks of the current block The list of candidate prediction modes.

In a possible implementation of this application,

When the intra sub-block division mode is activated by the current block, if the current block size is less than the set size, the candidate prediction mode list supported by the intra sub-block division mode is a fixed list, and the fixed list contains 6 The first prediction mode list or the second prediction mode list of prediction modes.

In a possible implementation of this application,

When the intra sub-block division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the candidate prediction mode list supported by the intra sub-block division mode.

In a possible implementation of this application,

The encoded stream carries first indication information, and the first indication information is used to indicate index information of the target prediction mode in the candidate prediction mode list.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the encoded stream carries third indication information, and the third indication information is used to indicate that the current block starts the intra-frame sub-block division mode.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, and the sub-block division mode supported by the current block includes both vertical division and horizontal division, the coded stream also carries second indication information, and the second indication information is used for Indicates the division method of the target sub-block.

In a possible implementation manner of the present application, when the encoded stream carries the third indication information, before generating the encoded stream, the method further includes:

Encode the third indication information according to the context model;

Wherein, the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In a possible implementation of this application,

The encoding the third indication information includes:

The coding sequence of the third indication information precedes the coding sequence of the multi-line prediction technology.

In a possible implementation of this application,

If the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list, the encoded stream carries fourth indication information, and the fourth indication information is used to indicate the current block Whether the target prediction mode is an angle prediction mode.

In a possible implementation of this application,

The encoded stream carries fifth indication information, where the fifth indication information is used to indicate whether the current block or multiple sub-blocks of the current block have residual information.

In a possible implementation of this application,

If the coded stream carries fifth indication information, the fifth indication information is used to indicate whether the current block or multiple sub-blocks of the current block have residual information, before generating the coded stream, The method also includes:

Encode the fifth indication information according to the context model;

The context model is determined according to the division depth of the multiple sub-blocks. When the division depth of the multiple sub-blocks is 0, the first context model is adopted. When the division depth of the multiple sub-blocks is not 0, the second context model is adopted. A context model, where the first context model is different from the second context model.

In a possible implementation of this application,

After the residual information is transformed according to the transformation modes supported by the multiple sub-blocks, the method further includes:

Perform quantization processing on the transformed information, and perform inverse quantization and inverse transformation processing on the quantized data to obtain the inverse transformation result;

Determine the reconstructed image of the current block based on the inverse transform result;

Filtering the reconstructed image;

Wherein, filtering the reconstructed image includes:

When the intra-frame sub-block division mode is activated by the current block, determine the boundary filter strength value of the sub-block according to the target sub-block division mode;

Filter the reconstructed image according to the boundary filter strength value.

In a possible implementation of this application,

According to the target sub-block division mode of the current block, determining the boundary filter strength value of the sub-block includes:

When the target sub-block division method is vertical division, the filter strength value of the vertical boundary of each sub-block is set to 0; or,

When the target sub-block division method is horizontal division, the filter strength value of the horizontal boundary of each sub-block is set to 0; or,

Set the filter strength values of the horizontal boundary and the vertical boundary of each sub-block to 0.

In a second aspect, a decoding method is provided, and the method includes:

Get the encoding stream of the current block;

When it is determined that the current block starts the intra-frame sub-block division mode according to the information carried in the encoding stream, the target sub-block division mode is determined from the sub-block division modes supported by the current block, and the target sub-block division mode is determined from the prediction modes in the candidate prediction mode list of the current block. Determine the target prediction mode of the current block;

Dividing the current block into multiple sub-blocks according to the target sub-block dividing manner;

Performing inverse quantization and inverse transformation on the encoded stream according to the multiple sub-blocks to obtain residual information corresponding to the multiple sub-blocks;

Performing intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks;

Determine the reconstructed image of the current block according to the residual information corresponding to the multiple sub-blocks and the predicted pixel information.

In a possible implementation manner of the present application, if the intra-frame sub-block division mode is activated for the current block, the sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*N, and N is greater than 4, the sub-block division mode supported by the current block is horizontal division;

If the width and height dimensions of the current block are 8*N, and N is greater than or equal to 4, the sub-block division mode supported by the current block is horizontal division; or, the sub-block division mode supported by the current block includes both vertical division and Horizontal division, vertical division can only be divided into two sub-blocks.

In a possible implementation of the present application, if the width and height dimensions of the current block are 64*64, the current block does not support the intra sub-block division mode.

In a possible implementation manner of the present application, if the intra-frame sub-block division mode is activated for the current block, the candidate sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*16 or 4*32 or 8*32, the current block does not support vertical division, but only supports horizontal division;

If the width and height dimensions of the current block are 16*4 or 32*4 or 32*8, the current block does not support horizontal division, but only supports vertical division.

In a possible implementation of the present application, if the intra-frame sub-block division mode is activated for the current block, the multiple sub-blocks are obtained according to non-uniform division; or the multiple sub-blocks are obtained according to uniform division; or,

If the current block starts the intra-frame sub-block division mode, the multiple sub-blocks are obtained according to multi-level division.

In a possible implementation manner of this application, when the intra sub-block division mode is activated by the current block, the candidate prediction mode list of the current block includes:

If the current block starts intra-frame sub-block division, if the candidate prediction mode list corresponding to the intra-frame sub-block division includes the vertical prediction mode and the horizontal prediction mode, then

When the sub-block division mode supported by the current block is horizontal division, place the vertical prediction mode before the horizontal prediction mode;

When the sub-block division mode supported by the current block is vertical division, the horizontal prediction mode is placed before the vertical prediction mode.

In a possible implementation manner of this application, when the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode is a predefined fixed list;

Wherein, the fixed list only includes Planar prediction mode;

Or, if the target sub-block division mode of the current block is horizontal division, the fixed list only includes the horizontal mode; or, if the target sub-block division mode of the current block is vertical division, the fixed list only Including vertical mode.

In a possible implementation manner of the present application, when the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list;

Wherein, the non-angle candidate mode list includes only Planar mode or only DC mode, and the angle candidate mode list includes at least one angle prediction mode other than Planar mode and DC mode; or

The non-angle candidate mode list includes Planar mode and DC mode, and the angle candidate mode list includes at least one angle prediction mode other than the Planar mode and the DC mode.

In a possible implementation of this application, when the current block starts the intra sub-block division mode, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is all A list of candidate prediction modes shared by neighboring coded blocks in the spatial domain of the current block.

In a possible implementation of this application, when the current block starts the intra sub-block division mode, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is A fixed list, where the fixed list is a first prediction mode list or a second prediction mode list containing 6 prediction modes.

In a possible implementation of the present application, when the intra sub-block division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the candidate prediction mode list supported by the intra sub-block division mode .

In a possible implementation manner of the present application, the encoded stream carries first indication information, and the first indication information is used to indicate index information of the target prediction mode in the candidate prediction mode list.

In a possible implementation manner of this application, if the intra-frame sub-block division mode is enabled for the current block, and the sub-block division mode supported by the current block includes both vertical division and horizontal division, the coded stream also carries a second Indication information, where the second indication information is used to indicate the target sub-block division mode;

The method also includes:

Parse the second indication information in the encoded stream according to the context model;

Wherein, the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the encoded stream carries third indication information, and the third indication information is used to instruct the current block to start the intra-frame sub-block division mode; the method further includes:

Parse the third indication information in the encoded stream according to the context model;

Wherein, the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In a possible implementation of this application,

The parsing sequence of the third indication information precedes the coding sequence of the multi-line prediction technology.

In a possible implementation of this application,

If the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list, the encoded stream carries fourth indication information, and the fourth indication information is used to indicate the current block Whether the target prediction mode is an angle prediction mode.

In a possible implementation of this application,

The encoded stream carries fifth indication information, where the fifth indication information is used to indicate whether there is residual information in the current block or a sub-block of the current block; the method further includes:

Parse the fifth indication information according to the context model;

The context model is determined according to the division depth of the multiple sub-blocks. When the division depth of the multiple sub-blocks is 0, the first context model is adopted. When the division depth of the multiple sub-blocks is not 0, the second context model is adopted. A context model, where the first context model is different from the second context model.

In a possible implementation of this application,

When the intra-frame sub-block division mode is activated by the current block, determine the boundary filter strength value of the sub-block according to the target sub-block division mode;

Filter the reconstructed image according to the boundary filter strength value.

In a possible implementation of this application,

According to the target sub-block division mode of the current block, determining the boundary filter strength value of the sub-block includes:

When the target sub-block division method is vertical division, the filter strength value of the vertical boundary of each sub-block is set to 0; or

When the target sub-block division method is horizontal division, the filter strength value of the horizontal boundary of each sub-block is set to 0; or

Set the filter strength values of the horizontal boundary and the vertical boundary of each sub-block to 0.

In a third aspect, an encoding device is provided, and the device includes:

The first determining module is configured to determine the target sub-block division mode from the sub-block division modes supported by the current block when the intra-frame sub-block division mode is activated by the current block, and divide the current block according to the target sub-block division mode Into multiple sub-blocks;

The second determining module is configured to determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block;

The first prediction module is configured to perform intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks, and determine the current pixel information based on the original pixel information of the current block and the predicted pixel information of the multiple sub-blocks. The residual information of the block;

A transformation module, configured to transform the residual information according to the transformation modes supported by the multiple sub-blocks to obtain transformed information;

The encoding module is configured to encode the current block according to the transformed information to generate an encoding stream of the current block.

In a possible implementation manner of the present application, if the intra-frame sub-block division mode is activated for the current block, the sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*N, and N is greater than 4, the sub-block division mode supported by the current block is horizontal division;

If the width and height dimensions of the current block are 8*N, and N is greater than or equal to 4, the sub-block division mode supported by the current block is horizontal division; or, the sub-block division mode supported by the current block includes both vertical division and Horizontal division, vertical division can only be divided into two sub-blocks.

In a possible implementation of the present application, if the width and height dimensions of the current block are 64*64, the current block does not support the intra sub-block division mode.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the candidate sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*16 or 4*32 or 8*32, the current block does not support vertical division, but only supports horizontal division;

If the width and height dimensions of the current block are 16*4 or 32*4 or 32*8, the current block does not support horizontal division, but only supports vertical division.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the multiple sub-blocks are obtained according to non-uniform division; or the multiple sub-blocks are obtained according to uniform division; or,

If the current block starts the intra-frame sub-block division mode, the multiple sub-blocks are obtained according to multi-level division.

In a possible implementation of this application,

When the intra sub-block division mode is activated by the current block, the candidate prediction mode list of the current block includes:

If the current block starts intra-frame sub-block division, if the candidate prediction mode list corresponding to the intra-frame sub-block division includes the vertical prediction mode and the horizontal prediction mode, then

When the sub-block division mode supported by the current block is horizontal division, place the vertical prediction mode before the horizontal prediction mode;

When the sub-block division mode supported by the current block is vertical division, the horizontal prediction mode is placed before the vertical prediction mode.

In a possible implementation of this application,

When the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode is a predefined fixed list;

Wherein, the fixed list only includes Planar prediction mode;

Or, if the target sub-block division mode of the current block is horizontal division, the fixed list only includes the horizontal mode; or, if the target sub-block division mode of the current block is vertical division, the fixed list only Including vertical mode.

In a possible implementation of this application,

When the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list;

Wherein, the non-angle candidate mode list includes only Planar mode or only DC mode, and the angle candidate mode list includes at least one angle prediction mode other than Planar mode and DC mode; or

The non-angle candidate mode list includes Planar mode and DC mode, and the angle candidate mode list includes at least one angle prediction mode other than the Planar mode and the DC mode.

In a possible implementation of this application,

When the intra-frame sub-block division mode is activated by the current block, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra-frame sub-block division mode is shared by the spatially adjacent coded blocks of the current block The list of candidate prediction modes.

In a possible implementation of this application,

When the intra sub-block division mode is activated by the current block, if the current block size is less than the set size, the candidate prediction mode list supported by the intra sub-block division mode is a fixed list, and the fixed list contains 6 The first prediction mode list or the second prediction mode list of prediction modes.

In a possible implementation of this application,

When the intra sub-block division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the candidate prediction mode list supported by the intra sub-block division mode in any one of the foregoing items.

In a possible implementation of this application,

The encoded stream carries first indication information, and the first indication information is used to indicate index information of the target prediction mode in the candidate prediction mode list.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the encoded stream carries third indication information, and the third indication information is used to indicate that the current block starts the intra-frame sub-block division mode.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, and the sub-block division mode supported by the current block includes both vertical division and horizontal division, the coded stream also carries second indication information, and the second indication information is used for Indicates the division method of the target sub-block.

In a possible implementation manner of this application, the encoding module is further used to:

Encode the third indication information according to the context model;

Wherein, the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In a possible implementation manner of the present application, the coding sequence of the third indication information precedes the coding sequence of the multi-line prediction technology.

In a possible implementation of the present application, if the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list, the encoded stream carries fourth indication information, and the first The fourth indication information is used to indicate whether the target prediction mode of the current block is an angle prediction mode.

In a possible implementation of this application,

The encoded stream carries fifth indication information, and the fifth indication information is used to indicate whether residual information exists in the current block or a sub-block of the current block.

In a possible implementation manner of this application, if the encoded stream carries fifth indication information, the fifth indication information is used to indicate whether the current block or multiple sub-blocks of the current block have residuals Information, the encoding module is also used to:

Encode the fifth indication information according to the context model;

The context model is determined according to the division depth of the multiple sub-blocks. When the division depth of the multiple sub-blocks is 0, the first context model is adopted. When the division depth of the multiple sub-blocks is not 0, the second context model is adopted. A context model, where the first context model is different from the second context model.

In a possible implementation manner of this application, the transformation module is further used to:

Perform quantization processing on the transformed information, and perform inverse quantization and inverse transformation processing on the quantized data to obtain the inverse transformation result;

Determine the reconstructed image of the current block based on the inverse transform result;

Filtering the reconstructed image;

Wherein, filtering the reconstructed image includes:

When the intra-frame sub-block division mode is activated by the current block, determine the boundary filter strength value of the sub-block according to the target sub-block division mode;

Filter the reconstructed image according to the boundary filter strength value.

In a possible implementation manner of this application, the transformation module is further used to:

When the target sub-block division method is vertical division, the filter strength value of the vertical boundary of each sub-block is set to 0; or

When the target sub-block division method is horizontal division, the filter strength value of the horizontal boundary of each sub-block is set to 0; or

Set the filter strength values of the horizontal boundary and the vertical boundary of each sub-block to 0.

In a fourth aspect, a decoding device is provided, and the device includes:

The acquisition module is used to acquire the encoding stream of the current block;

The third determining module is used to determine the target sub-block division mode from the sub-block division modes supported by the current block when determining the current block to start the intra-frame sub-block division mode according to the information carried in the encoded stream, and predict from the candidate of the current block Determine the target prediction mode of the current block in the prediction mode of the mode list;

A sub-block division module, configured to divide the current block into multiple sub-blocks according to the target sub-block division mode;

An inverse quantization transformation module, configured to perform inverse quantization and inverse transformation on the encoded stream according to the multiple sub-blocks to obtain residual information corresponding to the multiple sub-blocks;

The second prediction module is configured to perform intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks;

The fourth determining module is configured to determine the reconstructed image of the current block according to the residual information corresponding to the multiple sub-blocks and the predicted pixel information.

In a possible implementation manner of the present application, if the intra-frame sub-block division mode is activated for the current block, the sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*N, and N is greater than 4, the sub-block division mode supported by the current block is horizontal division;

If the width and height dimensions of the current block are 8*N, and N is greater than or equal to 4, the sub-block division mode supported by the current block is horizontal division; or, the sub-block division mode supported by the current block includes both vertical division and Horizontal division, vertical division can only be divided into two sub-blocks.

In a possible implementation of the present application, if the width and height dimensions of the current block are 64*64, the current block does not support the intra sub-block division mode.

In a possible implementation manner of the present application, if the intra-frame sub-block division mode is activated for the current block, the candidate sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*16 or 4*32 or 8*32, the current block does not support vertical division, but only supports horizontal division;

If the width and height dimensions of the current block are 16*4 or 32*4 or 32*8, the current block does not support horizontal division, but only supports vertical division.

In a possible implementation of the present application, if the intra-frame sub-block division mode is activated for the current block, the multiple sub-blocks are obtained according to non-uniform division; or the multiple sub-blocks are obtained according to uniform division; or,

If the current block starts the intra-frame sub-block division mode, the multiple sub-blocks are obtained according to multi-level division.

In a possible implementation manner of this application, when the intra sub-block division mode is activated by the current block, the candidate prediction mode list of the current block includes:

If the current block starts intra-frame sub-block division, if the candidate prediction mode list corresponding to the intra-frame sub-block division includes the vertical prediction mode and the horizontal prediction mode, then

When the sub-block division mode supported by the current block is horizontal division, place the vertical prediction mode before the horizontal prediction mode;

When the sub-block division mode supported by the current block is vertical division, the horizontal prediction mode is placed before the vertical prediction mode.

In a possible implementation manner of this application, when the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode is a predefined fixed list;

Wherein, the fixed list only includes Planar prediction mode;

Or, if the target sub-block division mode of the current block is horizontal division, the fixed list only includes the horizontal mode; or, if the target sub-block division mode of the current block is vertical division, the fixed list only Including vertical mode.

In a possible implementation of the present application, when the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list;

Wherein, the non-angle candidate mode list includes only Planar mode or only DC mode, and the angle candidate mode list includes at least one angle prediction mode other than Planar mode and DC mode; or

The non-angle candidate mode list includes Planar mode and DC mode, and the angle candidate mode list includes at least one angle prediction mode other than the Planar mode and the DC mode.

In a possible implementation of this application, when the current block starts the intra sub-block division mode, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is all A list of candidate prediction modes shared by neighboring coded blocks in the spatial domain of the current block.

In a possible implementation of this application, when the current block starts the intra sub-block division mode, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is A fixed list, where the fixed list is a first prediction mode list or a second prediction mode list containing 6 prediction modes.

In a possible implementation of the present application, when the intra sub-block division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the candidate prediction mode list supported by the intra sub-block division mode .

In a possible implementation manner of the present application, the encoded stream carries first indication information, and the first indication information is used to indicate index information of the target prediction mode in the candidate prediction mode list.

In a possible implementation manner of this application, if the intra-frame sub-block division mode is enabled for the current block, and the sub-block division mode supported by the current block includes both vertical division and horizontal division, the coded stream also carries a second Indication information, where the second indication information is used to indicate the target sub-block division mode;

The method also includes:

Parse the second indication information in the encoded stream according to the context model;

Wherein, the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the encoded stream carries third indication information, and the third indication information is used to instruct the current block to start the intra-frame sub-block division mode; the method further includes:

Parse the third indication information in the encoded stream according to the context model;

Wherein, the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In a possible implementation manner of the present application, the parsing sequence of the third indication information precedes the coding sequence of the multi-line prediction technology.

In a possible implementation of this application,

If the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list, the encoded stream carries fourth indication information, and the fourth indication information is used to indicate the current block Whether the target prediction mode is an angle prediction mode.

In a possible implementation manner of the present application, the encoded stream carries fifth indication information, and the fifth indication information is used to indicate whether residual information exists in the current block or a sub-block of the current block; The inverse quantization transform module is used to:

Parse the fifth indication information according to the context model;

The context model is determined according to the division depth of the multiple sub-blocks. When the division depth of the multiple sub-blocks is 0, the first context model is adopted. When the division depth of the multiple sub-blocks is not 0, the second context model is adopted. A context model, where the first context model is different from the second context model.

In a possible implementation manner of the present application, when the intra-frame sub-block division mode is activated by the current block, the fourth determining module is configured to;

Filter the reconstructed image according to the boundary filter strength value.

In a possible implementation manner of this application, the fourth determining module is configured to:

When the target sub-block division method is vertical division, the filter strength value of the vertical boundary of each sub-block is set to 0; or

When the target sub-block division method is horizontal division, the filter strength value of the horizontal boundary of each sub-block is set to 0; or

Set the filter strength values of the horizontal boundary and the vertical boundary of each sub-block to 0.

In a fifth aspect, an electronic device is provided, including:

processor;

A memory for storing processor executable instructions;

Wherein, the processor is configured to implement the method described in the first aspect.

In a sixth aspect, an electronic device is provided, including:

processor;

A memory for storing processor executable instructions;

Wherein, the processor is configured to implement the method described in the second aspect above.

In a seventh aspect, a computer-readable storage medium is provided, and instructions are stored on the computer-readable storage medium, and when the instructions are executed by a processor, the method described in the first aspect is implemented.

In an eighth aspect, a computer-readable storage medium is provided, and instructions are stored on the computer-readable storage medium. When the instructions are executed by a processor, the method described in the second aspect is implemented.

In a ninth aspect, a computer program product containing instructions is provided, which when running on a computer, causes the computer to execute the method described in the first aspect.

In a tenth aspect, a computer program product containing instructions is provided, which when run on a computer, causes the computer to execute the method described in the second aspect.

The beneficial effects brought about by the technical solutions provided by the embodiments of this application are:

When the current block starts the intra-frame sub-block division mode, the target sub-block division mode is determined from the sub-block division modes supported by the current block, and the current block is divided into multiple sub-blocks according to the target sub-block division mode. Determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block, perform intra-frame sub-block prediction according to the target prediction mode, and obtain the predicted pixel information of the multiple sub-blocks, according to the original pixel information of the current block and the The predicted pixel information of multiple sub-blocks determines the residual information of the current block. The residual information is transformed according to the transformation mode supported by the multiple sub-blocks, and the current block is encoded according to the transformed information to generate an encoded stream of the current block. In the embodiment of the present application, not all the sub-block division methods supported by the current block are horizontal division and vertical division. In this way, the problem of high processing cost of sub-blocks divided by a certain sub-block division method by hardware can be avoided.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained from these drawings without creative work.

Fig. 1 is a schematic diagram showing the architecture of a coding and decoding system according to an exemplary embodiment;

Fig. 2 is a schematic diagram showing a flow of encoding and decoding according to an exemplary embodiment;

Fig. 3 is an example of a direction corresponding to an intra prediction mode according to an exemplary embodiment;

Fig. 4 is an example of a direction corresponding to an angle mode according to an exemplary embodiment;

Fig. 5 is a schematic diagram showing the division of image blocks according to an exemplary embodiment;

Fig. 6 is a schematic diagram showing the division of image blocks according to another exemplary embodiment;

Fig. 7 is a flowchart showing an encoding method according to an exemplary embodiment;

Fig. 8 is a schematic diagram showing the division of a current block according to an exemplary embodiment;

Fig. 9 is a schematic diagram showing the division of a current block according to another exemplary embodiment;

Fig. 10 is a flowchart showing an encoding method according to another exemplary embodiment;

Fig. 11 is a schematic diagram showing neighboring blocks according to an exemplary embodiment;

Fig. 12 is a flowchart showing an encoding method according to another exemplary embodiment;

Fig. 13 is a flowchart showing a decoding method according to an exemplary embodiment;

Fig. 14 is a schematic diagram showing a current block according to an exemplary embodiment;

Fig. 15 is a schematic structural diagram showing an encoding device according to an exemplary embodiment;

Fig. 16 is a schematic structural diagram showing a decoding device according to an exemplary embodiment;

Fig. 17 is a schematic diagram showing an image block according to an exemplary embodiment;

Fig. 18 is a schematic structural diagram of a terminal according to another exemplary embodiment.

detailed description

In order to make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.

FIG. 1 is a schematic structural diagram of an encoding and decoding system provided by an embodiment of the present application. As shown in Figure 1, the codec system includes an encoder 01, a decoder 02, a storage device 03 and a link 04. The encoder 01 can communicate with the storage device 03, and the encoder 01 can also communicate with the decoder 02 through the link 04. The decoder 02 can also communicate with the storage device 03.

Encoder 01 is used to obtain the data source, encode the data source, and transmit the encoded code stream to the storage device 03 for storage, or the encoder 01 can directly transmit the encoded code stream obtained through the link 04 to Decoder 02.

The decoder 02 can obtain the code stream from the storage device 03 and decode it to obtain the data source; or after receiving the code stream transmitted by the encoder 01 through the link 04, it can decode to obtain the data source.

Among them, the data source can be a captured image or a captured video.

Both the encoder 01 and the decoder 02 can be used as an electronic device alone.

The storage device 03 may include any of a variety of distributed or locally accessible data storage media. For example, hard drives, Blu-ray discs, read-only discs, flash memory, or other suitable digital storage media for storing encoded data.

The link 04 may include at least one communication medium, and the at least one communication medium may include a wireless and/or wired communication medium, such as a radio frequency (RF) spectrum or one or more physical transmission lines.

Please refer to FIG. 2, which is a schematic diagram of a coding and decoding process according to an exemplary embodiment. The coding includes prediction, transformation, quantization, and entropy coding. Decoding includes decoding, inverse quantization, inverse transformation, and prediction. Several processes. Prediction in encoding and decoding generally includes intra-frame prediction and inter-frame prediction. Next, we will briefly introduce intra-frame prediction.

Intra-frame prediction refers to using the correlation of the image space domain to predict the pixels of the current image block by using the pixels of the neighboring blocks that have been coded and reconstructed around the current image block, so as to achieve the purpose of removing the image space redundancy. A variety of intra prediction modes are specified in intra prediction, and each intra prediction mode corresponds to a texture direction (except for the DC mode). For example, if the texture of the image is arranged horizontally, then selecting the horizontal prediction mode can better predict the image information. Exemplarily, the luminance component in HEVC (High Efficiency Video Coding) can support 5 sizes of prediction units (image blocks or sub-blocks), and each size of prediction unit corresponds to 35 intra prediction modes. Contains Planar mode, DC mode and 33 angle modes, as shown in Table 1.

Table 1

Mode number	Intra prediction mode
0	Intra_Planar
1	Intra_DC
2...34	Intra_angular2…Intra_angular34

The prediction directions corresponding to the multiple intra prediction modes are shown in FIG. 3. The Planar mode is suitable for areas where the pixel value changes slowly. In implementation, two linear filters in the horizontal and vertical directions can be used for filtering, and the average of the two is used as the predicted value of the current image block.

The DC mode is suitable for a large flat area. The average pixel value of the neighboring blocks that have been coded and reconstructed around the current image block can be used as the predicted value of the current image block.

As an example, the Planar mode and the DC mode may also be called non-angle modes.

Please continue to refer to FIG. 3, in the angle mode, the intra prediction modes corresponding to the mode number 26 and the mode number 10 respectively indicate the vertical direction and the horizontal direction. In a possible implementation manner of the present application, the intra prediction mode corresponding to the mode number 26 may be The intra prediction modes corresponding to the adjacent mode numbers are collectively referred to as vertical prediction modes, and the intra prediction modes corresponding to the mode numbers adjacent to the mode number 10 are collectively referred to as horizontal prediction modes. Illustratively, the vertical prediction modes can be Including intra prediction modes corresponding to mode number 2 to mode number 18, and horizontal prediction modes may include intra prediction modes corresponding to mode number 19 to mode number 34. In addition, in the new generation of coding and decoding standard VVC (Versatile Video Coding, Valser Video Coding), a more detailed division is made for the angle mode, as shown in Figure 4.

It should be noted that the above description is only an example in which the intra prediction modes corresponding to mode number 26 and mode number 10 respectively represent the vertical direction and the horizontal direction. In another embodiment, the intra prediction modes corresponding to the vertical direction and the horizontal direction The mode number of the prediction mode may also have other values, which is not limited in the embodiment of the present application.

In a possible implementation of this application, encoding and decoding can be implemented based on ISP technology. The method of intra prediction in ISP technology is to divide an image block into multiple sub-blocks for prediction. For image blocks that support ISP technology, the sub-block division methods that can be supported include horizontal division and vertical division. As an example, According to the rules shown in Table 2, the sub-block division methods that the image block can support are indicated, where "N" means that ISP mode is not supported, HOR means that horizontal division is supported, VER means that vertical division is supported, rows represent the width of image blocks, and columns represent The height of the image block. Exemplarily, the image block may be divided into the forms shown in FIG. 5 and FIG. 6.

Table 2

To	4	8	16	32	64	128
4	N	HOR/VER	HOR/VER	HOR/VER	N		N
8	HOR/VER	HOR/VER	HOR/VER	HOR/VER	N		N
16	HOR/VER	HOR/VER	HOR/VER	HOR/VER	N		N
32	HOR/VER	HOR/VER	HOR/VER	HOR/VER	N	N
64	N	N	N	N	HOR/VER	N
128	N	N	N	N	N	N

In some embodiments, for the hardware, the pixel information of the sub-block is obtained by raster scanning, and after dividing according to the sub-block division method shown in Table 2 above, it is easy to cause sub-blocks of some sizes, such as 1 *N, 2*N sub-blocks, the cost of hardware access will be very high. To this end, the embodiments of the present application provide a coding and decoding method based on ISP technology, which can solve this problem. For specific implementation, please refer to the following embodiments. In some embodiments, the ISP mode may also be referred to as an intra-frame sub-block division mode.

Next, the method provided by the embodiment of the present application will be described in detail with reference to the accompanying drawings. Please refer to FIG. 7. FIG. 7 is a flowchart showing an encoding method according to an exemplary embodiment. The encoding method may be applied to an encoding terminal device. The method may include the following steps:

Step 701: When the current block starts the intra-frame sub-block division mode, determine the target sub-block division mode from the sub-block division modes supported by the current block, and divide the current block into multiple sub-blocks according to the target sub-block division mode.

Wherein, the current block is any image block in the image to be processed. In some embodiments, the current block may also be referred to as the current image block. The image to be processed can be any image or video image.

In some standards, the size of the image block supported by the ISP mode is specified. For example, it can be determined by the following table 3. The "N" indicates that the ISP mode is not supported, and the "Y" indicates that the ISP mode is supported, and the row represents the image block. The width of the column represents the height of the image block. For example, the ISP mode does not support the processing of 4*4 image blocks.

table 3

To

4

8

16

32

64

128

4	N	Y	Y	Y	N	N
8	Y	Y	Y	Y	N	N
16	Y	Y	Y	Y	N	N
32	Y	Y	Y	Y	N	N
64	N	N	N	N	Y	N
128	N	N	N	N	N	N

As an example, if the width and height dimensions of the current block are 64*64, the current block does not support or prohibit the activation of the intra-frame sub-block division mode. That is, because of the 64*64 size image block processing, the implementation effect of using the ISP mode and the conventional mode (ie non-ISP mode) is not obvious, and even the computational complexity of using the ISP mode is relatively large. Therefore, in this application In a possible implementation, it is proposed that the ISP mode that does not enable 64*64 image blocks is proposed, that is, it is proposed that the ISP mode does not support the size of 64*64. In this case, Table 3 is changed to Table 4, where the row represents the image The width of the block, the column represents the height of the image block.

Table 4

To	4	8	16	32	64	128
4	N	Y	Y	Y	N	N
8	Y	Y	Y	Y	N	N
16	Y	Y	Y	Y	N	N
32	Y	Y	Y	Y	N	N
64	N	N	N	N	N	N
128	N	N	N	N	N	N

In a possible implementation manner, the encoding end device can determine whether the current image block supports the ISP mode based on the width and height of the current image block, based on the above Table 3 or Table 4. When it is determined to support the ISP mode, the frame can be started Internal sub-block division mode.

Since the hardware scan cost for sub-blocks of some sizes is relatively high, as an example, the sub-block division mode of some size blocks may be limited. Illustratively, the following possible implementation modes may be included:

The first implementation manner: if the width and height dimensions of the current block are 4*N, and N is greater than 4, the sub-block division mode supported by the current block is horizontal division.

As mentioned above, since the hardware access cost for 1*N and 2*N sub-blocks will be relatively large, the width and height size of 4*N can be limited to only support horizontal division, not vertical division.

The second implementation mode: if the width and height dimensions of the current block are 8*N, and N is greater than or equal to 4, the sub-block division mode supported by the current block is horizontal division; or, the sub-block division modes supported by the current block are simultaneously Including vertical division and horizontal division, the vertical division can only be divided into two sub-blocks.

As an example, for an image block with a width and height size of 8*N, it may also be restricted that it does not support vertical division and only supports horizontal division. As an example, for an image block with a width and height size of 8*N, it is also allowed to only be vertically divided into 4*N sub-blocks, that is, only one vertical slice is allowed.

The third implementation manner: if the width and height dimensions of the current block are 4*16 or 4*32 or 8*32, the current block does not support vertical division, but only supports horizontal division.

The fourth implementation manner: If the width and height dimensions of the current block are 16*4 or 32*4 or 32*8, the current block does not support horizontal division, but only supports vertical division.

Exemplarily, the sub-block division mode supported by the ISP technology may be as shown in Table 5, where the row represents the width of the image block, and the column represents the height of the image block.

table 5

To	4	8	16	32	64	128
4	N	HOR/VER	VER	VER	N		N
8	HOR/VER	HOR/VER	HOR/VER	VER	N		N
16	HOR	HOR/VER	HOR/VER	HOR/VER	N		N
32	HOR	HOR	HOR/VER	HOR/VER	N	N
64	N	N	N	N	N	N

128

N

N

N

N

N

N

It should be noted that the several implementation manners provided above and the sub-block division manner shown in Table 5 are all exemplary. In another embodiment, the current block may also be determined according to the ratio of the width to the height of the current block. The sub-block division method supported by the block. As an example, the following situations can be included:

The first implementation manner: when the ratio between the width and the height of the current block is greater than or equal to the first threshold, the sub-block division manner supported by the current block is vertical division.

When the ratio between the width and height of the current block is greater than or equal to the first threshold, it means that the width of the current block is very wide and the height is very short. If the current block is horizontally divided, the width of the sub-block obtained will be It is very wide and shorter in height, so horizontal division may not be enabled for this kind of current block, that is, the sub-block division mode supported by the current block is vertical division, and horizontal division is not supported.

The foregoing first threshold may be set according to actual requirements. For example, the first threshold is 1, that is, when the aspect ratio is greater than 1, it is suitable for vertical division.

The second implementation manner: when the ratio between the width and the height of the current block is less than or equal to the second threshold, the sub-block division mode supported by the current block is horizontal division.

The foregoing second threshold may be set according to actual requirements. For example, the second threshold may be 1 or a number less than 1, which is suitable for horizontal division.

When the ratio between the width and height of the current block is less than or equal to the second threshold, it means that the width of the current block is relatively small and the height is particularly high. If the current block is divided vertically, the width of the sub-block obtained will be It is narrower and extremely high in height, so vertical division may not be enabled for this type of current block, that is, the sub-block division mode supported by the current block is horizontal division, and vertical division is not supported.

As an example, when the current block only supports horizontal division, horizontal division may be determined as the target sub-block division method, and when the current block only supports vertical division, vertical division may be determined as the target sub-block division method . When the front block supports both horizontal division and vertical division, the target sub-block division method can be determined by trial. For example, the final sub-block division method can be selected according to the processing cost. As an example, the processing The cost can be decided based on RDO (Rate Distortion Optimized).

As an example, the encoding end device may divide the current block into multiple sub-blocks according to the division rule shown in Table 6 according to the target sub-block division mode.

Table 6

In the above table 6, W represents the width of the current block, H represents the height of the current block, w represents the width of the divided sub-block, h represents the height of the divided sub-block, and k represents the multiple first sub-blocks obtained by the division. The number of tiles.

For example, when the width of the current block is 16 and the height is 4, the current block can be divided into 4 4x4 sub-blocks in a vertical manner.

As an example, the multiple sub-blocks are obtained according to non-uniform division, or the multiple sub-blocks are obtained according to uniform division. It can be divided according to uniform size, or it can be divided according to non-uniform size. The current block can be divided into multiple sub-blocks with the same size, or the current block can be divided into multiple sub-blocks with different sizes, for example, as shown in Figure 8, the current block is divided into two sub-blocks with different sizes. Of sub-blocks.

As an example, the multiple sub-blocks may be obtained according to multi-level division. That is, the sub-block of larger size can be divided more finely. Exemplarily, as shown in FIG. 9, a sub-block of larger size can be further divided into 8 sub-blocks of smaller size. Then, follow-up processing is performed based on the obtained 8 sub-blocks of smaller size.

The reference size threshold may be set by the user according to actual needs, or may also be set by default by the encoding end device, which is not limited in the embodiment of the present application.

Step 702: Determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block.

As an example, the candidate prediction mode list of the current block should be constructed before the target prediction mode is selected. When the intra sub-block division mode is activated for the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode can be the same as the current block does not start the intra sub-block division mode. The candidate prediction mode list in the block division mode is the same or may be different.

As an example, the current block starts the intra sub-block division mode, and the candidate prediction mode list supported by the intra sub-block division mode is a predefined fixed list, where the fixed list only includes the Planar prediction mode; or, if the target sub-block of the current block If the block division mode is horizontal division, the fixed list only includes the horizontal mode; or, if the target sub-block division mode of the current block is vertical division, the fixed list only includes the vertical mode.

In other words, a fixed mode can be directly used as the target prediction mode. In a possible implementation, no matter what kind of block, the Planar mode can be directly used as the target prediction mode. In another possible implementation manner, the target prediction mode may be determined according to the sub-block division mode, that is, when the sub-block division mode of the current block is horizontal division, the horizontal mode is determined as the target prediction mode. , The mode number of this horizontal mode is 10. Or, when the sub-block division mode of the current block is vertical division, the vertical mode is determined as the target prediction mode. Exemplarily, the mode number of the vertical mode is 26.

In an example, when the target prediction mode defaults to horizontal mode, or vertical mode, or planar mode, or DC mode, in this implementation, there is no need to carry the target prediction mode for local use in the code stream The instruction information saves bit overhead.

In a possible implementation of the present application, the current block starts the intra sub-block division mode, and if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is the spatial domain of the current block A list of candidate prediction modes shared by adjacent coded blocks.

In a possible implementation manner of the present application, when the intra sub-block division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the candidate prediction mode list supported by the intra sub-block division mode.

Step 703: Perform intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks, and determine residual information of the current block according to the original pixel information of the current block and the predicted pixel information of the multiple sub-blocks.

As an example, prediction processing may be performed on each of the multiple sub-blocks according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks.

As another example, prediction processing may be performed on the current block according to the target prediction mode, and the obtained predicted pixel information may be used as the predicted pixel information of the multiple sub-blocks.

As an example, the original pixel information of the current block and the predicted pixel information of the multiple sub-blocks may be subjected to residual processing to obtain residual information of the current block.

Step 704: Transform the residual information according to the transformation mode supported by the multiple sub-blocks to obtain transformed information.

As an example, if the current block supports a multi-transform core transform mode, the residual information is transformed according to the transform cores corresponding to the multiple sub-blocks. As an example, when the current block starts the intra-frame sub-block division mode, The transform check corresponding to the sub-block includes DCT2 and DCT7; if the width and height dimensions of the current block are both greater than or equal to 32, the transform check corresponding to the sub-block includes DCT2.

Step 705: According to the transformed information, encode the current block to generate an encoded stream of the current block.

As an example, if the intra-frame sub-block division mode is enabled for the current block, and the sub-block division mode supported by the current block includes both vertical division and horizontal division, the encoded stream carries second indication information, and the second indication information is used to indicate the target Sub-block division method.

That is to say, when the current block supports both horizontal division and vertical division, in order to facilitate the decoding end to parse the encoded stream to know which sub-block division method is used, the encoding end device may encode the second indication information to the encoding In the stream, the target sub-block division mode of the current block is indicated by the second indication information.

As an example, if the current block starts the intra-frame sub-block division mode, the encoded stream carries third indication information, and the third indication information is used to indicate that the current block starts the intra-frame sub-block division mode.

In other words, when the encoding end starts the intra-frame sub-block division mode, the third indication information can be encoded into the encoded stream, and the third indication information can make the decoding end parse out that the current block is processed in the ISP mode, which is exemplary , The third indication information may be the flag of the ISP mode.

Table 7

As an example, please refer to Table 7. If the ISP mode is not supported or is not activated, the third indication information does not need to be transmitted. At this time, the code bit for the third indication information may be 0.

When the current block starts the ISP mode and the current block only supports horizontal division or vertical division, at this time, the third indication information can be coded with 1 bit. When the current block starts the ISP mode and the current block supports horizontal division and vertical division, 2 bits can be used in the encoding process to represent the second indication information and the third indication information respectively.

As an example, the third indication information is coded according to the context model, where the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In other words, the context model for encoding the flag of the ISP mode can be determined according to the size of the current block.

As an example, the context model for encoding the flag of the ISP mode can also be determined according to the shape and aspect ratio of the current block.

As an example, the implementation of encoding the third indication information may include: the coding order of the third indication information is prior to the coding order of the multi-line prediction technology.

That is, the encoding sequence of the ISP mode flag and the flags of other prediction modes (such as multi-line prediction mode) can be adjusted by modifying the syntax, so that the encoding end device first encodes the ISP mode flag during encoding. , Encode the ISP mode flag in front of the multi-line prediction mode flag, so that the decoder can parse the ISP mode flag first.

As an example, the intra-frame multi-line prediction mode does not support 4*4 size image blocks. If it is a 4*4 image block, the encoding end device may not encode the syntax elements related to the multi-line prediction mode, and the decoding end The device does not need to decode syntax elements related to the multi-line prediction mode.

As an example, the encoded stream carries fifth indication information, and the fifth indication information is used to indicate whether the current block or multiple sub-blocks of the current block have residual information.

During encoding, the fifth indication information can be used to indicate whether the current block or sub-blocks of the current block has residual information. Illustratively, the fifth indication information is whether there is residual information CBF (Coded block flag, Encoding block ID) value flag.

As an example, if the encoded stream carries fifth indication information, the fifth indication information is used to indicate whether residual information exists in the current block or multiple sub-blocks of the current block. Before generating the encoded stream, the method It also includes: encoding the fifth indication information according to a context model; the context model is determined according to the division depth of the multiple sub-blocks, and when the division depth of the multiple sub-blocks is 0, the first context model is adopted, and the multiple sub-blocks When the division depth of is not 0, the second context model is used, and the first context model is different from the second context model.

As an example, the context model of the CBF value of the residual coding of the current block is selected according to the division depth of the transform block, rather than the CBF value of the previous sub-block. This avoids the need for context model selection to depend on before and after The question of the relevance of sub-blocks.

As an example, after transforming the residual information according to the multiple sub-blocks, the method further includes: quantizing the transformed information, and dequantizing and inverse transforming the quantized data to obtain an inverse transform Result; determine the reconstructed image of the current block based on the result of the inverse transform; filter the reconstructed image; wherein, filtering the reconstructed image includes: when the current block starts the intra-frame sub-block division mode, according to the target sub-block The block division method determines the boundary filter strength value of the sub-block; according to the boundary filter strength value, the reconstructed image is filtered.

At the encoding end, after determining the reconstructed image based on the transformed information, the reconstructed image can be filtered through a filter. The boundary filter intensity value of the filter is determined based on the size of multiple sub-blocks, and the boundary filter intensity value is used To filter the boundaries of multiple sub-blocks.

As an example, determining the boundary filter intensity value of the sub-block according to the target sub-block division mode of the current block includes: when the target sub-block division mode is vertical division, the filter intensity value of the vertical boundary of each sub-block is determined Set to 0; or, when the target sub-block is divided into horizontal division, set the filter intensity value of the horizontal boundary of each sub-block to 0; or, set the filter intensity value of the horizontal boundary and the vertical boundary of each sub-block to both Set to 0.

That is to say, you can set the boundary filter intensity value of each sub-block according to the target sub-block division method, or directly set the filter intensity value of the horizontal boundary and the vertical boundary of each sub-block to 0, where "0" means No filtering, non-"0" means filtering.

As an example, the boundary filter strength values of the transform blocks of multiple sub-blocks can be set according to the width or height of the current block. Exemplarily, when the width or height of the current block is greater than a certain threshold, the multiple sub-blocks are transformed The boundary filter strength value of the block is set to non-zero. Otherwise, the boundary filter strength value of the transform blocks of the multiple sub-blocks is set to 0. The threshold can be set according to actual needs. As an example, the threshold can be 32.

As an example, the boundary filter strength values of the transform blocks of multiple sub-blocks can also be set according to the shape of the current block, which is not limited in the embodiment of the present application.

As an example, a traditional intra-frame prediction method can be used to perform prediction processing on the current block, and then the predicted pixel information obtained using the traditional intra-frame prediction method and the pixel information of the reconstructed image can be weighted. Alternatively, the predicted pixel information obtained by using the traditional intra-frame prediction method and the predicted pixel information determined by the above-mentioned ISP mode may also be weighted, which is not limited in the embodiment of the present application.

As an example, when the current block initiates intra-frame sub-block division and the current block is a chroma block, the priority of the cross-component linear model prediction prediction mode included in the candidate prediction mode list corresponding to the chroma block is higher than For the brightness prediction mode in the candidate prediction mode list, the brightness prediction mode is the prediction mode in the candidate prediction mode list supported by the brightness block when the current block is a brightness block.

For multi-channel images, including luminance block and chrominance block, when the luminance block is implemented in ISP mode, it can be considered that the cross-component linear model can predict the chrominance block well. Therefore, the cross-component linear model is used In the process of predicting the chroma block, when constructing the candidate prediction mode list corresponding to the chroma block, the prediction mode predicted by the cross-component linear model is ranked before the luma prediction mode.

In the embodiment of the present application, when the current block starts the intra-frame sub-block division mode, the target sub-block division mode is determined from the sub-block division modes supported by the current block, and the current block is divided into multiple sub-block division modes according to the target sub-block division mode. Sub-blocks. Determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block, perform intra sub-block prediction according to the target prediction mode to obtain the predicted pixel information of the multiple sub-blocks, and obtain the predicted pixel information of the multiple sub-blocks according to the original pixel information of the current block and the multiple The predicted pixel information of each sub-block determines the residual information of the current block. The residual information is transformed according to the transformation mode supported by the multiple sub-blocks, and the current block is encoded according to the transformed information to generate an encoded stream of the current block. In the embodiment of the present application, not all the sub-block division methods supported by the current block are horizontal division and vertical division. In this way, the problem of high processing cost of sub-blocks divided by a certain sub-block division method by hardware can be avoided.

Fig. 10 shows an encoding method according to an exemplary embodiment. The method may be applied to an encoding terminal device. The method may include the following implementation steps:

Step 1001: When the current block starts the intra-frame sub-block division mode, determine the target sub-block division mode from the sub-block division modes supported by the current block, and divide the current block into multiple sub-blocks according to the target sub-block division mode.

The implementation process is the same as step 701 in the embodiment of FIG. 7.

Step 1002: Determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block.

Exemplarily, for the ISP mode, only the candidate prediction modes in the candidate prediction mode list are used for prediction. Therefore, the encoding terminal device determines the candidate prediction mode list. As an example, the candidate prediction mode list may be determined based on the intra prediction modes of adjacent image blocks that have been reconstructed around the current block, the candidate prediction mode list includes multiple candidate prediction modes, and the multiple candidate prediction modes The priority of the candidates decreases in order according to the sequence in the candidate prediction mode list.

In a possible implementation of the present application, the method of constructing the candidate prediction mode list of the ISP mode is the same as that of the candidate prediction mode list of the non-ISP mode, that is, the method of constructing the candidate prediction mode list of the ISP mode can be compared with that of the non-ISP mode candidate prediction mode list. The construction method of the candidate prediction mode list of the ISP mode is unified.

As an example, the planar mode and the DC mode are in fixed positions in the candidate prediction mode list.

Exemplarily, it is assumed that the adjacent image blocks that have been reconstructed around the current block are the upper adjacent image block A and the left adjacent image block B, and the number of candidate prediction modes is 6. In a possible implementation, when the intra prediction mode of A or B is not available, the default intra prediction mode of A or B is the Planar mode. For the convenience of the following description, the intra prediction mode of A can be set here. It is denoted as ModeA, and the intra prediction mode of B is denoted as ModeB.

First, the candidate prediction mode list can be initialized. The first candidate prediction mode in the candidate prediction mode list can be initialized as ModeA. The second candidate prediction mode can be determined by judging whether the first candidate prediction mode is the Planar mode. The candidate prediction mode is Planar mode, the second candidate prediction mode is DC mode, otherwise it is Planar mode. The third candidate prediction mode is the vertical intra prediction mode, the fourth candidate prediction mode is the horizontal intra prediction mode, and the fifth candidate prediction mode is the adjacent mode of the vertical intra prediction mode. For example, the mode number can be The mode number of the vertical intra prediction mode is minus 4, and the sixth candidate prediction mode is an adjacent mode of the vertical intra prediction mode. Exemplarily, the mode number may be the mode number of the vertical intra prediction mode plus 4.

As an example, when ModeA=ModeB, that is, when the intra prediction mode of A is the same as the intra prediction mode of B: if ModeA is the DC mode or the Planar mode, the initialized candidate prediction mode list can be used as the current block List of candidate prediction modes. Otherwise, if ModeA and ModeB are neither DC mode nor Planar mode, the candidate prediction mode list of the current block is constructed as follows:

The first candidate prediction mode is ModeA;

The second candidate prediction mode is PLANAR_IDX;

The third candidate prediction mode is DC_IDX;

The fourth candidate prediction mode is the adjacent mode of ModeA. Exemplarily, the calculation method of the mode number may be: ((ModeA+offset)%mod)+2;

The fifth candidate prediction mode is the adjacent mode of ModeA. For example, the mode number calculation method can be: ((ModeA-1)%mod)+2;

The sixth candidate prediction mode is the adjacent mode of ModeA. For example, the mode number calculation method can be: ((ModeA+offset-1)%mod)+2;

As an example, the above offset can be set to 61, and the mod can be set to 64.

As an example, when ModeA! =ModeB, that is, when the intra prediction mode of A is different from the intra prediction mode of B, the candidate prediction mode list of the current block is constructed as follows:

The first candidate prediction mode is ModeA;

The second candidate prediction mode is ModeB;

If ModeA and ModeB are neither Planar nor DC mode, then

The third candidate prediction mode is PLANAR_IDX;

The fourth candidate prediction mode is DC_IDX;

As an example, the difference between the mode numbers of ModeA and ModeB can be compared. When the difference is within a certain interval, the fifth candidate prediction mode is the adjacent one of the two modes with the larger mode number. Mode, for example, the calculation method of the mode number can be: ((CandModeList[maxCandModeIdx]+offset)%mod)+2;

The sixth candidate prediction mode is the adjacent mode of the mode with the larger mode number among the two modes. Exemplarily, the mode number calculation method can be: ((CandModeList[maxCandModeIdx]-1)%mod)+2 ；

Among them, mpm[maxCandModeIdx] is the larger mode number of ModeA and ModeB.

Otherwise, when the difference between the mode numbers of ModeA and ModeB is not within a certain interval, the fifth candidate prediction mode is the adjacent mode of the larger mode number of the two modes, for example, the mode number The calculation method of can be: ((CandModeList[maxCandModeIdx]+offset-1)%mod)+2;

The sixth candidate prediction mode is the adjacent mode of the mode with the larger mode number among the two modes. Exemplarily, the mode number calculation method can be: ((CandModeList[maxCandModeIdx])%mod)+2;

Among them, CandModeList[maxCandModeIdx] is the larger of ModeA and ModeB. It can be simply understood as taking adjacent intra prediction modes.

Otherwise, when ModeA and ModeB have and only one of the mode numbers is greater than or equal to 2, DC mode or planar mode will inevitably appear. The first two candidate prediction modes may have two combinations of DC mode and angle mode, planar mode And the combination of angle mode.

The second candidate prediction mode is planar mode or DC mode.

Exemplarily, the calculation method of the mode number of the third candidate prediction mode may be: (CandModeList[!maxCandModeIdx]==PLANAR_IDX)? DC_IDX: PLANAR_IDX; Among them, CandModeList[! maxCandModeIdx] is the smaller one of the first two candidate prediction modes.

The fourth candidate prediction mode is the adjacent mode of the candidate prediction mode with the larger mode number among the first two candidate prediction modes. Exemplarily, the mode number calculation method can be: ((CandModeList[maxCandModeIdx]+offset)%mod )+2;

The fifth candidate prediction mode is the adjacent mode of the candidate prediction mode with the larger mode number among the first two candidate prediction modes. Exemplarily, the mode number calculation method can be: ((CandModeList[maxCandModeIdx]-1)%mod )+2;

The sixth candidate prediction mode is the adjacent mode of the candidate prediction mode with the larger mode number among the first two candidate prediction modes. Exemplarily, the mode number calculation method can be: ((CandModeList[maxCandModeIdx]+offset-1) %Mod)+2.

All in all, the above-mentioned core idea is to select the intra prediction mode adjacent to ModeA or ModeB as the candidate prediction mode of the current block.

It should be noted that the foregoing adjacent image blocks may be one or more image blocks in an adjacent area, for example, may include second adjacent image blocks.

In the candidate prediction mode list, the higher the ranking, the higher the candidate priority and the smaller the corresponding coding cost. In a possible implementation manner of this application, the sequence of candidate prediction modes in the candidate prediction mode list may be determined according to the sub-block division manner. As an example, if the current block starts intra sub-block division, if the candidate prediction mode list corresponding to the intra sub-block division includes the vertical prediction mode and the horizontal prediction mode, then when the current block supports the sub-block division mode as horizontal When dividing, the vertical prediction mode is placed before the horizontal prediction mode; when the sub-block division mode supported by the current block is vertical division, the horizontal prediction mode is placed before the vertical prediction mode.

In a possible implementation manner of the present application, the candidate prediction mode list may be a fixed list. For example, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is The fixed list is a first prediction mode list or a second prediction mode list containing 6 prediction modes. In other words, a fixed candidate list can be used as the candidate prediction mode of the current block.

As an example, the fixed first prediction mode candidate list may be:

The first candidate prediction mode: planar mode;

The second candidate prediction mode: DC mode;

The third candidate prediction mode: vertical mode;

The fourth candidate prediction mode: horizontal mode;

The fifth candidate prediction mode: the adjacent mode of the vertical mode, the mode number can be the vertical mode number minus 4;

The sixth candidate prediction mode: the adjacent mode of the vertical mode, the mode number can be the vertical mode number plus 4.

As another example, the fixed second prediction mode candidate list may be:

The first candidate prediction mode: vertical prediction mode, for example, the mode number can be 50;

The second candidate prediction mode: horizontal prediction mode, exemplary, the mode number can be 18;

The third candidate prediction mode: horizontal prediction mode, for example, the mode number can be 2;

The fourth candidate prediction mode: diagonal prediction mode, for example, the mode number can be 34;

The fifth candidate prediction mode: non-diagonal prediction mode, for example, the mode number can be 66;

The sixth candidate prediction mode: the horizontal prediction mode. For example, the mode number may be 26.

As an example, when the current block starts the intra sub-block division mode, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is the spatially adjacent coded block of the current block Common candidate prediction mode list.

As an example, multiple current blocks in the reference range may share a candidate prediction mode list, and the reference range may be set according to actual requirements. In other words, the current block can use a candidate prediction mode list with multiple adjacent current blocks. For example, please refer to Figure 11. If the current block is image block 1, it can be based on the intra-frame of adjacent image blocks. The prediction mode determines the candidate prediction mode list of the current block, and when the current block is the image block 2, 3, or 4, the candidate prediction mode list of the image block 1 can be used. It should be noted that this implementation is not limited to the ISP mode, and can also be applied to other modes, such as multi-line prediction mode, which is not limited in the embodiment of the present application.

As an example, the candidate prediction mode list of the neighboring block may also be obtained, and the obtained candidate prediction mode list is used as the candidate prediction mode list of the current block.

As an example, when the candidate prediction mode list of the neighboring block cannot be obtained, the Planar mode may be used as the target prediction mode of the current block.

As an example, when the size of the current block is smaller than the set size, the current block can share a candidate prediction mode list with all other current blocks in the image to be encoded, and the set size can be set according to actual needs. Exemplarily, the set size is 4*4. That is to say, if the size of the current block is small enough, it can share a candidate prediction mode list with all other current blocks in the image to be encoded. In this case, it is only necessary to determine the first prediction mode in the image to be encoded. The candidate prediction mode list of a block can use the candidate prediction mode list of the first block in subsequent current blocks, which reduces the amount of calculation and improves coding efficiency.

As an example, when the intra sub-block division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the above-mentioned fixed list or the candidate prediction mode list shared by neighboring coded blocks in the spatial domain of the current block. That is to say, when the intra sub-block division mode is not activated, the candidate prediction mode list supported by any of the above-mentioned intra sub-block division modes can be used.

After the candidate prediction mode list is constructed, the target prediction mode is determined based on the candidate prediction mode list. In a possible implementation of this application, the implementation process may include: using each candidate prediction mode pair in the candidate prediction mode list Perform prediction processing on the multiple sub-blocks to obtain multiple predicted pixel values corresponding to each candidate prediction mode; determine the rate distortion cost corresponding to each candidate prediction mode based on the multiple predicted pixel values corresponding to each candidate prediction mode; Select the candidate prediction mode corresponding to the smallest rate-distortion cost from all the obtained rate-distortion costs; determine the selected candidate prediction mode as the target prediction mode.

That is to say, the multiple sub-blocks can share one intra-frame prediction mode, and the encoding end device can traverse and use each candidate prediction mode in the candidate prediction mode list to perform prediction processing on the multiple sub-blocks. In this way, based on each candidate prediction mode The prediction mode can determine the predicted pixel value of each sub-block in the multiple sub-blocks. Then you can determine the rate-distortion cost of the multiple predicted pixel values corresponding to each candidate prediction mode. The smaller the rate-distortion cost, the more suitable the corresponding candidate prediction mode is to predict the multiple sub-blocks. Therefore, the smallest rate-distortion cost corresponding The candidate prediction mode is used as the target prediction mode.

For example, suppose the candidate prediction mode list includes candidate prediction mode 0, candidate prediction mode 1, candidate prediction mode 2, and candidate prediction mode 3. The encoding end device uses candidate prediction mode 0 to perform prediction processing on the multiple sub-blocks to obtain candidate prediction modes Multiple predicted pixel values corresponding to 0; use candidate prediction mode 1 to perform prediction processing on the multiple sub-blocks to obtain multiple predicted pixel values corresponding to candidate prediction mode 1; use candidate prediction mode 2 to perform prediction processing on the multiple sub-blocks, Obtain multiple predicted pixel values corresponding to candidate prediction mode 2; and perform prediction processing on the multiple sub-blocks using candidate prediction mode 3 to obtain multiple predicted pixel values corresponding to candidate prediction mode 3. The encoding end device determines the rate distortion cost corresponding to candidate prediction mode 0 based on multiple predicted pixel values corresponding to candidate prediction mode 0, and determines the rate distortion cost corresponding to candidate prediction mode 1 based on multiple predicted pixel values corresponding to candidate prediction mode 1 Determine the rate distortion cost corresponding to the candidate prediction mode 2 based on the multiple predicted pixel values corresponding to the candidate prediction mode 2, and determine the rate distortion cost corresponding to the candidate prediction mode 3 based on the multiple predicted pixel values corresponding to the candidate prediction mode 3. Assuming that the rate-distortion cost corresponding to candidate prediction mode 1 is the smallest, the encoding end device determines candidate prediction mode 1 as the target prediction mode.

Step 1003: Perform intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks, and determine residual information of the current block according to original pixel information of the current block and predicted pixel information of the multiple sub-blocks.

The implementation process is the same as step 703 in the embodiment of FIG. 7 described above.

Step 1004: Transform the residual information according to the transformation mode supported by the multiple sub-blocks to obtain transformed information.

The implementation process is the same as step 704 in the embodiment of FIG. 7 described above.

Step 1005: According to the transformed information, encode the current block to generate an encoded stream of the current block.

As an example, the encoded stream carries first indication information, and the first indication information is used to indicate index information of the target prediction mode in the candidate prediction mode list.

When the candidate prediction mode list includes multiple candidate prediction modes, in order to facilitate the decoding end device to know which intra prediction mode is used for encoding, the encoding end device can be based on the target prediction mode in the candidate prediction mode list. The index information determines the first indication information, and encodes the first indication information into the coded stream.

As an example, the encoding terminal device may select a context model for encoding the first indication information according to the size or shape of the current block, and then encode the first indication information based on the selected context model.

It should be noted that this step also includes other possible implementation manners of step 705 in the embodiment of FIG. 7, which will not be repeated here.

In the embodiment of the present application, in the embodiment of the present application, when the current block starts the intra-frame sub-block division mode, the target sub-block division mode is determined from the sub-block division modes supported by the current block, and according to the target sub-block division mode, Divide the current block into multiple sub-blocks. Determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block, perform intra-frame sub-block prediction according to the target prediction mode, and obtain the predicted pixel information of the multiple sub-blocks, according to the original pixel information of the current block and the The predicted pixel information of multiple sub-blocks determines the residual information of the current block. The residual information is transformed according to the transformation mode supported by the multiple sub-blocks, and the current block is encoded according to the transformed information to generate an encoded stream of the current block. In the embodiment of the present application, not all the sub-block division methods supported by the current block are horizontal division and vertical division. In this way, the problem of high processing cost of sub-blocks divided by a certain sub-block division method by hardware can be avoided.

Fig. 12 shows an encoding method according to an exemplary embodiment. The encoding method may be applied to an encoding terminal device. The method may include the following implementation steps:

Step 1201: When the current block starts the intra-frame sub-block division mode, determine the target sub-block division mode from the sub-block division modes supported by the current block, and divide the current block into multiple sub-blocks according to the target sub-block division mode.

The implementation process is the same as step 701 in the embodiment of FIG. 7.

Step 1202: Determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block.

When the current block starts intra sub-block division, the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list; as an example, the non-angle candidate mode list includes only Planar mode or Including only DC mode, the angle candidate mode list includes at least one angle prediction mode other than Planar mode and DC mode; or, the non-angle candidate mode list includes Planar mode and DC mode, and the angle candidate mode list includes at least one angle prediction mode other than Planar mode and DC mode. Angle prediction modes other than Planar mode and DC mode.

In other words, the angular prediction mode and the non-angle prediction mode can be divided into two lists. When constructing the candidate prediction mode list of the current block, the angular candidate prediction mode list can be constructed, or the non-angle prediction mode can also be constructed List of patterns.

As an example, the non-angle candidate prediction mode list may include only Planar mode, or only DC mode, and the angle candidate prediction mode list may include at least one angular prediction mode, for example, may include at least one vertical prediction mode, or It may also include at least one horizontal prediction mode, or alternatively, it may also include at least one vertical prediction mode and at least one horizontal prediction mode.

As another example, the non-angle candidate prediction mode list may include Planar mode and DC mode, and the angle candidate prediction mode list may include at least one angular prediction mode. For example, it may include at least one vertical prediction mode, or may include at least One horizontal prediction mode, or alternatively, may also include at least one vertical prediction mode and at least one horizontal prediction mode.

The specific realization of determining the target prediction mode of the current block from the angular prediction mode or the non-angle prediction mode is the same as the realization principle of determining the target prediction mode of the current block from the candidate prediction mode list in FIG. 10.

As an example, when the intra sub-block division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the angular prediction mode, or the candidate prediction mode list corresponding to the current block is the same as the non-angle prediction mode. That is, when the intra sub-block division mode is not activated, any one of the candidate prediction mode lists described above can be used.

Step 1203: Perform intra sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks, and determine the residual information of the current block according to the original pixel information of the current block and the predicted pixel information of the multiple sub-blocks.

The implementation process is the same as step 703 in the embodiment of FIG. 7.

Step 1204: Transform the residual information according to the transformation mode supported by the multiple sub-blocks to obtain transformed information.

The implementation process is the same as step 704 in the embodiment of FIG. 7.

Step 1205: According to the transformed information, encode the current block to generate an encoded stream of the current block.

As an example, if the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list, the encoded stream carries fourth indication information, and the fourth indication information is used to indicate the current Whether the target prediction mode of the block is the angle prediction mode.

That is to say, when the candidate prediction mode list supported by the intra-frame sub-block division mode includes the angle candidate prediction mode list and the non-angle candidate mode list, the final selected target sub-block division method may come from the angle candidate prediction mode list. It may come from the non-angle candidate mode list. In order to facilitate the decoding end device to know whether the angle candidate prediction mode list needs to be established, or the non-angle candidate mode list needs to be established, the encoding end device encodes the first indication information into the encoding stream during encoding. At home and abroad, the fourth indication information can also be added to the encoded stream.

It should be noted that this step also includes other possible implementation manners of step 705 in the embodiment of FIG. 7, which will not be repeated here.

In the embodiment of the present application, when the current block starts the intra-frame sub-block division mode, the target sub-block division mode is determined from the sub-block division modes supported by the current block, and the current block is divided into multiple sub-block division modes according to the target sub-block division mode. Sub-blocks. Determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block, perform intra-frame sub-block prediction according to the target prediction mode, and obtain the predicted pixel information of the multiple sub-blocks, according to the original pixel information of the current block and the The predicted pixel information of multiple sub-blocks determines the residual information of the current block. The residual information is transformed according to the transformation mode supported by the multiple sub-blocks, and the current block is encoded according to the transformed information to generate an encoded stream of the current block. In the embodiment of the present application, not all the sub-block division methods supported by the current block are horizontal division and vertical division. In this way, the problem of high processing cost of sub-blocks divided by a certain sub-block division method by hardware can be avoided.

Please refer to FIG. 13, which is a flowchart of a decoding method according to an exemplary embodiment. In this embodiment, the decoding method is applied to a decoding end device as an example. The decoding method may include the following steps :

Step 1301: Obtain the encoding stream of the current block.

As an example, the decoding end device may receive the encoded stream sent by the encoding end device, and as another example, it may also read the encoded stream from the storage device.

Step 1302: When it is determined that the current block starts the intra-frame sub-block division mode according to the information carried in the encoding stream, the target sub-block division mode is determined from the sub-block division modes supported by the current block, and the prediction from the candidate prediction mode list of the current block Determine the target prediction mode of the current block in the mode.

As an example, the decoding end device parses the width and height of the current block carried in the encoded stream, and determines whether the intra-frame sub-block division mode is supported according to the width and height. The intra-frame sub-block division mode is not activated. At this time, other modes can be used for decoding, such as multi-line prediction mode. Otherwise, when it is determined that the intra-frame sub-block division mode is supported, it is further determined whether the encoding end turns on the intra-frame sub-block division mode.

As an example, if the current block starts the intra-frame sub-block division mode, the encoded stream carries third indication information, and the third indication information is used to indicate that the current block starts the intra-frame sub-block division mode. At this time, according to the context model Analyze the third indication information in the encoded stream; wherein the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In other words, if the encoding end device starts the intra-frame sub-block division mode, it will add third indication information to the encoded stream. For example, the third indication information is the flag of the ISP mode, and the decoding end device determines that the current block supports intra-frame sub-blocks. After the division mode, the third indication information is parsed, and when the third indication information exists, it may be determined to start the intra-frame sub-block division mode.

As an example, when parsing the third indication information, the context model can be determined according to the aspect ratio of the current block, that is, the context model can be determined according to the size of the current block, and the context model can be analyzed according to the determined context model. The third instruction information.

As an example, when parsing the third indication information, the context model can also be determined according to the shape of the current block, that is, it is not limited to determining the context model according to the aspect ratio of the current block, and it can also be considered according to the shape. .

As an example, the parsing order of the third indication information precedes the coding order of the multi-line prediction technology.

In a possible implementation manner, the order of intra_luma_ref_idx syntax and intra_subpartitions_mode_flag syntax of the multi-line prediction technology can be modified so that the parsing order of the third indication information precedes the coding order of the multi-line prediction technology, for example, the original table 8 The code is changed as shown in Table 9:

Table 8

Table 9

When it is determined that the current block starts the intra-frame sub-block division mode, the encoded stream may not carry the second indication information, and the decoding end device determines the target sub-block division mode from the sub-block division modes supported by the current block. As an example, when it is determined that the current block supports only one sub-block division method, the supported seed block division method can be directly determined as the target sub-block division method. For example, when the current block only supports horizontal division, The horizontal division can be directly determined as the target sub-block division mode. For example, when the current block only supports the vertical division mode, the vertical division mode can be directly determined as the target sub-block division mode.

In another possible implementation manner, if the intra-frame sub-block division mode is enabled for the current block, and the sub-block division mode supported by the current block includes both vertical division and horizontal division, then the encoded stream also carries second indication information, The second indication information is used to indicate the target sub-block division mode.

The method further includes: analyzing the second indication information in the encoded stream according to a context model; wherein, determining the context model according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

That is to say, when the current block starts the intra-frame sub-block division mode, the current block supports both horizontal division and vertical division. In addition to the third indication information, the coded stream also includes second indication information, which is used for Indicates the sub-block division method adopted by the encoding device. For the decoding end device, when the decoding end device determines that the current block supports both horizontal division and vertical division, it parses the second indication information in the encoded stream and determines the sub-block division mode indicated by the second indication information as The way the target sub-block is divided.

When parsing the second indication information, the context model can be determined according to the aspect ratio of the current block, that is, the context model can be determined according to the size of the current block, and the second indication can be parsed according to the determined context model information.

As an example, when parsing the second indication information, the context model can also be determined based on the shape of the current block, that is, it is not limited to determining the context model based on the aspect ratio of the current block, and it can also be considered based on the shape. .

In addition, the encoding terminal device determines the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block.

As an example, when the candidate prediction mode list includes only one candidate prediction mode, it may not be indicated to use this candidate prediction mode as the target prediction mode. For example, when the candidate prediction mode list only includes the Planar mode, the Planar mode can be used as the target prediction mode. As another example, when the target sub-block division method is horizontal division, the candidate prediction mode list only includes the horizontal mode, and in this case, the horizontal mode is determined as the target prediction mode. As another example, when the target sub-block division method is vertical division, the candidate prediction mode list includes only the vertical mode, and in this case, the vertical mode is determined as the target prediction mode.

As another example, the encoded stream carries first indication information, and the first indication information is used to indicate index information of the target prediction mode in the candidate prediction mode list.

That is to say, when the candidate prediction mode list includes multiple candidate prediction modes, the index information of the target prediction mode in the candidate prediction mode list can also be parsed from the information in the encoded stream, and according to the index information, from the multiple The target prediction mode is determined in the candidate prediction mode list.

As an example, before decoding the first indication information, a context model may be determined according to the shape or size of the current block, and the first indication information may be parsed based on the determined context model.

As an example, if the intra-frame sub-block division mode is activated for the current block, the sub-block division modes supported by the current block include: if the width and height dimensions of the current block are 4*N, and N is greater than 4, the sub-blocks supported by the current block The block division method is horizontal division; if the width and height of the current block is 8*N, and N is greater than or equal to 4, the sub-block division method supported by the current block is horizontal division; or, the sub-block division method supported by the current block Including vertical division and horizontal division at the same time, the vertical division can only be divided into two sub-blocks.

As an example, if the width and height dimensions of the current block are 64*64, the current block does not support the intra sub-block division mode.

As an example, if the current block starts the intra-frame sub-block division mode, the candidate sub-block division modes supported by the current block include: if the width and height dimensions of the current block are 4*16 or 4*32 or 8*32, then The current block does not support vertical division, but only supports horizontal division; if the width and height dimensions of the current block are 16*4 or 32*4 or 32*8, the current block does not support horizontal division and only supports vertical division.

As an example, if the current block starts the intra-frame sub-block division mode, the multiple sub-blocks are obtained according to non-uniform division; or the multiple sub-blocks are obtained according to uniform division; or, if the current block starts the intra-frame sub-block division mode, the Multiple sub-blocks are obtained according to multi-level division.

As an example, when the current block starts the intra sub-block division mode, the candidate prediction mode list of the current block includes: if the current block starts the intra sub-block division, the candidate prediction mode list corresponding to the intra sub-block division includes vertical Class prediction mode and horizontal class prediction mode, when the sub-block division mode supported by the current block is horizontal division, the vertical class prediction mode is located before the horizontal class prediction mode; when the sub-block division mode supported by the current block is During vertical division, the horizontal prediction mode is placed before the vertical prediction mode.

As an example, when the current block starts intra sub-block division, the candidate prediction mode list supported by the intra sub-block division mode is a predefined fixed list; wherein, the fixed list only includes the Planar prediction mode; or, if the current block The target sub-block division mode of is horizontal division, then the fixed list only includes the horizontal mode; or, if the target sub-block division mode of the current block is vertical division, the fixed list only includes the vertical mode.

As an example, when the current block starts intra sub-block division, the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list; wherein, the non-angle candidate mode list only includes Planar Mode or only DC mode, the angle candidate mode list includes at least one angle prediction mode other than Planar mode and DC mode; or the non-angle candidate mode list includes Planar mode and DC mode, and the angle candidate mode list includes at least one Angle prediction modes other than Planar mode and DC mode.

As an example, when the current block starts the intra sub-block division mode, if the current block size is less than the set size, the candidate prediction mode list supported by the intra sub-block division mode is the spatial neighboring coded of the current block A list of candidate prediction modes shared by the block.

As an example, when the current block starts the intra sub-block division mode, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is a fixed list, and the fixed list contains 6 The first prediction mode list or the second prediction mode list of each prediction mode.

As an example, when the intra sub-block division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the candidate prediction mode list supported by the intra sub-block division mode.

It should be noted that the construction of the candidate prediction mode list is the same as the construction of the encoding end, and will not be repeated here.

As an example, if the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list, the encoded stream carries fourth indication information, and the fourth indication information is used to indicate the current Whether the target prediction mode of the block is the angle prediction mode.

If the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list, it is necessary for the decoder device to determine which list the target prediction mode comes from, and the decoder device parses the fourth Instructions. For example, when the fourth indication information indicates an angle candidate prediction mode list, an angle candidate prediction mode list is constructed, so that the target prediction mode is determined based on the angle candidate prediction mode list and the first indication information. When the fourth indication information indicates a non-angle candidate mode list, a non-angle candidate prediction mode list is constructed, and the target prediction mode is determined based on the non-angle candidate prediction mode list and the first indication information.

It is also possible to select the target prediction mode directly based on the first indication information from the angle candidate prediction mode list or the non-angle candidate prediction mode list that has been constructed. If the target prediction mode is not the default one, it is the angle candidate prediction mode list or the non-angle candidate prediction mode list. One of the multiple prediction modes in the candidate prediction mode list may also determine the target prediction mode by analyzing the index information carried in the coded stream.

As an example, the encoded stream carries fifth indication information, and the fifth indication information is used to indicate whether the current block or multiple sub-blocks of the current block have residual information.

The method further includes: parsing the fifth indication information according to a context model, the context model being determined according to the division depth of the plurality of sub-blocks, when the division depth of the plurality of sub-blocks is 0, adopting the first context model, and the plurality of sub-blocks When the division depth of is not 0, the second context model is used, and the first context model is different from the second context model.

As an example, during encoding, the fifth indication information may be used to indicate whether there is residual information in the current block or sub-blocks of the current block. Exemplarily, the fifth indication information is CBF (Coded block flag, coded block flag). Block ID) value flag, the decoder will parse the fifth indication information to determine whether there is residual information.

For example, if a given block is an ISP block, the decoder device will consider that it contains at least one non-zero CBF block. Based on this, if there are n sub-blocks, but the first n-1 sub-blocks are all zero CBF, then the last line The CBF of the sub-block is 1 by default. In this case, the encoding end may not transmit the CBF value of the last sub-block.

When parsing the fifth indication information, a context model is determined according to the division depth of the multiple sub-blocks, and the first context model is different from the second context model. It is worth mentioning that the context model of the CBF for the residual decoding of the current block is selected according to the division depth of the transform block, rather than based on the CBF value of the previous sub-block. This can avoid the need for context model selection to rely on before and after The question of the relevance of sub-blocks.

Step 1303: According to the target sub-block division mode, divide the current block into multiple sub-blocks.

The specific implementation is the same as the implementation on the encoding end, and will not be repeated here.

Step 1304: Perform inverse quantization and inverse transformation on the encoded stream according to the multiple sub-blocks to obtain residual information corresponding to the multiple sub-blocks.

This process is opposite to the transformation and quantization process at the encoding end. In this way, the residual information of the multiple sub-blocks can be determined, so that the image can be reconstructed according to the residual information.

Step 1305: Perform intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks.

In an embodiment, intra-frame prediction may be performed on the multiple sub-blocks respectively according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks. In another implementation manner, it is also possible to perform intra-frame prediction on the current block according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks.

Step 1306: Determine the reconstructed image of the current block according to the residual information and predicted pixel information corresponding to the multiple sub-blocks.

As an example, after the reconstructed image is obtained, a filter can be used to filter the boundary of the sub-block. As an example, when the intra-frame sub-block division mode is activated for the current block, the boundary filter intensity value of the sub-block is determined according to the target sub-block division mode, and the reconstructed image is filtered according to the boundary filter intensity value .

As an example, according to the target sub-block division mode of the current block, the realization of determining the boundary filter strength value of the sub-block may include: when the target sub-block division mode is vertical division, filtering the vertical boundary of each sub-block The intensity value is set to 0; or, when the target sub-block division method is horizontal division, the filter intensity value of the horizontal boundary of each sub-block is set to 0; or the filter intensity value of the horizontal boundary and the vertical boundary of each sub-block Both are set to 0.

That is to say, you can set the boundary filter intensity value of each sub-block according to the target sub-block division method, or directly set the filter intensity value of the horizontal boundary and the vertical boundary of each sub-block to 0, where "0" means No filtering, non-"0" means filtering.

As an example, the boundary filter strength values of the transform blocks of multiple sub-blocks can be set according to the width or height of the current block (as shown in Figure 14). Illustratively, when the width or height of the current block is greater than a certain threshold, the The boundary filter strength values of the transform blocks of the multiple sub-blocks are set to non-zero, for example, set to 32. Otherwise, the boundary filter strength value of the transform blocks of the multiple sub-blocks is set to 0.

As an example, the boundary filter strength values of the transform blocks of multiple sub-blocks can also be set according to the shape of the current block, which is not limited in the embodiment of the present application.

As an example, a traditional intra-frame prediction method can be used to perform prediction processing on the current block, and then the predicted pixel information obtained using the traditional intra-frame prediction method and the pixel information of the reconstructed image can be weighted. Alternatively, the predicted pixel information obtained by using the traditional intra-frame prediction method and the predicted pixel information determined by the above-mentioned ISP mode may also be weighted, which is not limited in the embodiment of the present application.

As an example, when the current block initiates intra-sub-block division, in the candidate prediction mode list corresponding to the chrominance block, the priority of the prediction mode included in the cross-component linear model prediction is higher than that added to the candidate prediction mode list Brightness prediction mode.

For multi-channel images, including luminance block and chrominance block, when the luminance block is implemented in ISP mode, it can be considered that the cross-component linear model can predict the chrominance block well. Therefore, the cross-component linear model is used In the process of predicting the chrominance block, a list of candidate prediction modes corresponding to the chrominance block is constructed, and the prediction modes predicted by the cross-component linear model are ranked before the luminance prediction mode.

Fig. 15 is a schematic structural diagram showing an encoding device according to an exemplary embodiment. The encoding device can be implemented by software, hardware or a combination of both. The encoding device may include:

The first determining module 1510 is configured to determine the target sub-block division mode from the sub-block division modes supported by the current block when the current block starts the intra-frame sub-block division mode, and divide the current block according to the target sub-block division mode. Divided into multiple sub-blocks;

The second determining module 1520 is configured to determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block;

The first prediction module 1530 is configured to perform intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks, and determine the predicted pixel information according to the original pixel information of the current block and the predicted pixel information of the multiple sub-blocks. State the residual information of the current block;

The transformation module 1540 is configured to transform the residual information according to the transformation modes supported by the multiple sub-blocks to obtain transformed information;

The encoding module 1550 is configured to encode the current block according to the transformed information to generate an encoding stream of the current block.

In a possible implementation manner of the present application, if the intra-frame sub-block division mode is activated for the current block, the sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*N, and N is greater than 4, the sub-block division mode supported by the current block is horizontal division;

If the width and height dimensions of the current block are 8*N, and N is greater than or equal to 4, the sub-block division mode supported by the current block is horizontal division; or, the sub-block division mode supported by the current block includes both vertical division and Horizontal division, vertical division can only be divided into two sub-blocks.

In a possible implementation of the present application, if the width and height dimensions of the current block are 64*64, the current block does not support the intra sub-block division mode.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the candidate sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*16 or 4*32 or 8*32, the current block does not support vertical division, but only supports horizontal division;

If the width and height dimensions of the current block are 16*4 or 32*4 or 32*8, the current block does not support horizontal division, but only supports vertical division.

In a possible implementation of this application,

If the current block starts the intra-frame sub-block division mode, the multiple sub-blocks are obtained according to non-uniform division; or the multiple sub-blocks are obtained according to uniform division; or,

If the current block starts the intra-frame sub-block division mode, the multiple sub-blocks are obtained according to multi-level division.

In a possible implementation of this application,

When the intra sub-block division mode is activated by the current block, the candidate prediction mode list of the current block includes:

If the current block starts intra-frame sub-block division, if the candidate prediction mode list corresponding to the intra-frame sub-block division includes the vertical prediction mode and the horizontal prediction mode, then

When the sub-block division mode supported by the current block is horizontal division, place the vertical prediction mode before the horizontal prediction mode;

When the sub-block division mode supported by the current block is vertical division, the horizontal prediction mode is placed before the vertical prediction mode.

In a possible implementation of this application,

When the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode is a predefined fixed list;

Wherein, the fixed list only includes Planar prediction mode;

Or, if the target sub-block division mode of the current block is horizontal division, the fixed list only includes the horizontal mode; or, if the target sub-block division mode of the current block is vertical division, the fixed list only Including vertical mode.

In a possible implementation of this application,

When the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list;

Wherein, the non-angle candidate mode list includes only Planar mode or only DC mode, and the angle candidate mode list includes at least one angle prediction mode other than Planar mode and DC mode; or

The non-angle candidate mode list includes Planar mode and DC mode, and the angle candidate mode list includes at least one angle prediction mode other than the Planar mode and the DC mode.

In a possible implementation of this application,

When the intra-frame sub-block division mode is activated by the current block, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra-frame sub-block division mode is shared by the spatially adjacent coded blocks of the current block The list of candidate prediction modes.

In a possible implementation of this application,

When the current block starts the intra sub-block division mode, if the current block size is less than the set size, the candidate prediction mode list supported by the intra sub-block division mode is a fixed list, and the fixed list contains 6 predictions The first prediction mode list or the second prediction mode list of modes.

In a possible implementation of this application,

When the intra sub-block division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the candidate prediction mode list supported by the intra sub-block division mode in any one of the foregoing items.

In a possible implementation of this application,

The encoded stream carries first indication information, and the first indication information is used to indicate index information of the target prediction mode in the candidate prediction mode list.

In a possible implementation of the present application, if the current block starts the intra sub-block division mode, the encoded stream carries third indication information, and the third indication information is used to instruct the current block to start the intra sub-block Partition mode.

In a possible implementation manner of this application, if the intra-frame sub-block division mode is enabled for the current block, and the sub-block division mode supported by the current block includes both vertical division and horizontal division, the coded stream also carries a second Indication information, where the second indication information is used to indicate the target sub-block division mode.

In a possible implementation manner of this application, the encoding module is further used to:

Encode the third indication information according to the context model;

Wherein, the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In a possible implementation manner of the present application, the coding sequence of the third indication information precedes the coding sequence of the multi-line prediction technology.

In a possible implementation of the present application, if the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list, the encoded stream carries fourth indication information, and the first The fourth indication information is used to indicate whether the target prediction mode of the current block is an angle prediction mode.

In a possible implementation of this application,

The encoded stream carries fifth indication information, where the fifth indication information is used to indicate whether the current block or multiple sub-blocks of the current block have residual information.

In a possible implementation manner of the present application, if the encoded stream carries fifth indication information, the fifth indication information is used to indicate whether the current block or multiple sub-blocks of the current block have residual information , The encoding module is also used for:

Encode the fifth indication information according to the context model;

The context model is determined according to the division depth of the multiple sub-blocks. When the division depth of the multiple sub-blocks is 0, the first context model is adopted. When the division depth of the multiple sub-blocks is not 0, the second context model is adopted. A context model, where the first context model is different from the second context model.

In a possible implementation manner of this application, the transformation module is further used to:

Perform quantization processing on the transformed information, and perform inverse quantization and inverse transformation processing on the quantized data to obtain the inverse transformation result;

Determine the reconstructed image of the current block based on the inverse transform result;

Filtering the reconstructed image;

Wherein, filtering the reconstructed image includes: when the intra-frame sub-block division mode is activated for the current block, determining the boundary filter strength value of the sub-block according to the target sub-block division mode;

Filter the reconstructed image according to the boundary filter strength value.

In a possible implementation manner of this application, the transformation module is further used to:

When the target sub-block division method is vertical division, the filter strength value of the vertical boundary of each sub-block is set to 0; or

When the target sub-block division method is horizontal division, the filter strength value of the horizontal boundary of each sub-block is set to 0; or

Set the filter strength values of the horizontal boundary and the vertical boundary of each sub-block to 0.

In the embodiment of this application, when the current block starts the intra-frame sub-block division mode, the target sub-block division mode is determined from the sub-block division modes supported by the current block, and the current block is divided into multiple sub-block division modes according to the target sub-block division mode. Sub-blocks. Determine the target prediction mode of the current block from the prediction modes of the candidate prediction mode list of the current block, perform intra sub-block prediction according to the target prediction mode to obtain the predicted pixel information of the multiple sub-blocks, and obtain the predicted pixel information of the multiple sub-blocks according to the original pixel information of the current block and the multiple The predicted pixel information of each sub-block determines the residual information of the current block. The residual information is transformed according to the transformation mode supported by the multiple sub-blocks, and the current block is encoded according to the transformed information to generate an encoded stream of the current block. In the embodiment of the present application, not all the sub-block division methods supported by the current block are horizontal division and vertical division. In this way, the problem of high processing cost of sub-blocks divided by a certain sub-block division method by hardware can be avoided.

Fig. 16 is a schematic structural diagram showing a decoding device according to an exemplary embodiment. The decoding device may be implemented by software, hardware or a combination of both. The decoding device may include:

The obtaining module 1610 is used to obtain the encoding stream of the current block;

The third determining module 1620 is configured to determine the target sub-block division mode from the sub-block division modes supported by the current block when the current block starts the intra-frame sub-block division mode according to the information carried in the coded stream, and determine the target sub-block division mode from the current block candidate Determine the target prediction mode of the current block in the prediction modes of the prediction mode list;

A sub-block division module 1630, configured to divide the current block into multiple sub-blocks according to the target sub-block division mode;

An inverse quantization transformation module 1640, configured to perform inverse quantization and inverse transformation on the encoded stream according to the multiple sub-blocks to obtain residual information corresponding to the multiple sub-blocks;

The second prediction module 1650 is configured to perform intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks;

The fourth determining module 1660 is configured to determine the reconstructed image of the current block according to the residual information and predicted pixel information corresponding to the multiple sub-blocks.

As an example, if the intra-frame sub-block division mode is enabled for the current block, the sub-block division modes supported by the current block include: if the width and height dimensions of the current block are 4*N and N is greater than 4, the current block supports The sub-block division mode of the current block is horizontal division; if the width and height of the current block is 8*N, and N is greater than or equal to 4, the sub-block division mode supported by the current block is horizontal division; or, the current block supports The sub-block division method includes both vertical division and horizontal division, and the vertical division can only be divided into two sub-blocks.

As an example, if the width and height dimensions of the current block are 64*64, the current block does not support the intra sub-block division mode.

As an example, if the intra-frame sub-block division mode is activated for the current block, the candidate sub-block division modes supported by the current block include:

If the width and height dimensions of the current block are 4*16 or 4*32 or 8*32, the current block does not support vertical division, but only supports horizontal division;

If the width and height dimensions of the current block are 16*4 or 32*4 or 32*8, the current block does not support horizontal division, but only supports vertical division.

As an example, if the intra-frame sub-block division mode is activated for the current block, the multiple sub-blocks are obtained according to non-uniform division; or the multiple sub-blocks are obtained according to uniform division; or,

If the current block starts the intra-frame sub-block division mode, the multiple sub-blocks are obtained according to multi-level division.

As an example, when the intra sub-block division mode is activated for the current block, the candidate prediction mode list of the current block includes:

If the current block starts intra-frame sub-block division, if the candidate prediction mode list corresponding to the intra-frame sub-block division includes the vertical prediction mode and the horizontal prediction mode, then

When the sub-block division mode supported by the current block is horizontal division, place the vertical prediction mode before the horizontal prediction mode;

When the sub-block division mode supported by the current block is vertical division, the horizontal prediction mode is placed before the vertical prediction mode.

As an example, when the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode is a predefined fixed list;

Wherein, the fixed list only includes Planar prediction mode;

Or, if the target sub-block division mode of the current block is horizontal division, the fixed list only includes the horizontal mode; or, if the target sub-block division mode of the current block is vertical division, the fixed list only Including vertical mode.

As an example, when the intra-frame sub-block division is initiated by the current block, the candidate prediction mode list supported by the intra-frame sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list;

Wherein, the non-angle candidate mode list includes only Planar mode or only DC mode, and the angle candidate mode list includes at least one angle prediction mode other than Planar mode and DC mode; or

The non-angle candidate mode list includes Planar mode and DC mode, and the angle candidate mode list includes at least one angle prediction mode other than the Planar mode and the DC mode.

As an example, when the current block starts the intra sub-block division mode, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is the spatial phase of the current block. A list of candidate prediction modes shared by adjacent coded blocks.

As an example, when the intra sub-block division mode is activated by the current block, if the current block size is smaller than the set size, the candidate prediction mode list supported by the intra sub-block division mode is a fixed list, and the fixed The list is a first prediction mode list or a second prediction mode list containing 6 prediction modes.

As an example, when the intra subblock division mode is not activated for the current block, the candidate prediction mode list corresponding to the current block is the same as the candidate prediction mode list supported by the intra subblock division mode.

In a possible implementation manner of the present application, the encoded stream carries first indication information, and the first indication information is used to indicate index information of the target prediction mode in the candidate prediction mode list.

In a possible implementation manner of this application, if the intra-frame sub-block division mode is enabled for the current block, and the sub-block division mode supported by the current block includes both vertical division and horizontal division, the coded stream also carries a second Indication information, where the second indication information is used to indicate the target sub-block division mode;

The method also includes:

Parse the second indication information in the encoded stream according to the context model;

Wherein, the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In a possible implementation of the present application, if the current block starts the intra sub-block division mode, the encoded stream carries third indication information, and the third indication information is used to instruct the current block to start the intra sub-block Division mode; the method further includes:

Parse the third indication information in the encoded stream according to the context model;

Wherein, the context model is determined according to the aspect ratio of the current block, and different aspect ratios correspond to different context models.

In a possible implementation manner of the present application, the parsing sequence of the third indication information precedes the coding sequence of the multi-line prediction technology.

In a possible implementation of this application,

If the candidate prediction mode list supported by the intra sub-block division mode includes an angle candidate prediction mode list and a non-angle candidate mode list, the encoded stream carries fourth indication information, and the fourth indication information is used to indicate the current block Whether the target prediction mode is an angle prediction mode.

In a possible implementation manner of this application, the encoded stream carries fifth indication information, and the fifth indication information is used to indicate whether residual information exists in the current block or multiple sub-blocks of the current block; The inverse quantization transform module is used for:

Parse the fifth indication information according to the context model;

The context model is determined according to the division depth of the multiple sub-blocks. When the division depth of the multiple sub-blocks is 0, the first context model is adopted. When the division depth of the multiple sub-blocks is not 0, the second context model is adopted. A context model, where the first context model is different from the second context model.

In a possible implementation manner of the present application, when the intra-frame sub-block division mode is activated by the current block, the fourth determining module is used to;

Filter the reconstructed image according to the boundary filter strength value.

In a possible implementation manner of this application, the fourth determining module is configured to:

When the target sub-block division method is vertical division, the filter strength value of the vertical boundary of each sub-block is set to 0; or

When the target sub-block division method is horizontal division, the filter strength value of the horizontal boundary of each sub-block is set to 0; or

Set the filter strength values of the horizontal boundary and the vertical boundary of each sub-block to 0.

It should be noted that the above-mentioned multi-line prediction technology refers to the reconstruction of multiple rows of adjacent blocks of the current block as reference pixel values, or the above-mentioned multi-line prediction technology refers to the reconstruction of multiple columns of adjacent blocks of the current block. As a reference pixel value, or, the above-mentioned multi-line prediction technique refers to using multiple rows and multiple columns reconstructed from adjacent blocks of the current block as reference pixel values. Or, use the reconstructed row of the neighboring block of the current block as the reference pixel value, or use the reconstructed column of the neighboring block of the current block as the reference pixel value, or combine the reconstructed row of the neighboring block of the current block and One column is used as the reference pixel value. For example, referring to FIG. 17, any one of reference rows 0, 1, 2 or 3 can be used as the reference pixel value of the current block.

As an example, for intra-frame prediction in non-ISP mode, when the size of the current block is 4*4, only the candidate prediction modes in the candidate prediction mode list can be used instead of other prediction modes other than the candidate prediction mode list. Other prediction modes. As an example, when the size of the current block is 4*4, the candidate prediction mode list of the neighboring block may also be obtained, and the obtained candidate prediction mode list is used as the candidate prediction mode list of the current block. As an example, when the candidate prediction mode list of the neighboring block cannot be obtained, the Planar mode may be used as the target prediction mode of the current block.

As an example, for intra prediction in ISP mode or non-ISP mode, Planar mode may be fixed as the first candidate prediction mode in the candidate prediction mode list.

It should be noted that: when the device provided in the above embodiment implements the method, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned function allocation can be completed by different functional modules as required, that is, the equipment The internal structure is divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided by the above-mentioned embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

FIG. 18 shows a structural block diagram of a terminal 1700 provided by an exemplary embodiment of the present application. The terminal 1700 may be a laptop computer or a desktop computer. The terminal 1700 may also be called user equipment, portable terminal, laptop terminal, desktop terminal and other names.

Generally, the terminal 1700 includes a processor 1701 and a memory 1702.

The processor 1701 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 1701 can adopt at least one hardware form among DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array, Programmable Logic Array). achieve. The processor 1701 may also include a main processor and a coprocessor. The main processor is a processor used to process data in the wake state, also called a CPU (Central Processing Unit, central processing unit); the coprocessor is A low-power processor used to process data in the standby state. In some embodiments, the processor 1701 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used to render and draw content that needs to be displayed on the display screen. In some embodiments, the processor 1701 may further include an AI (Artificial Intelligence) processor, and the AI processor is used to process calculation operations related to machine learning.

The memory 1702 may include one or more computer-readable storage media, which may be non-transitory. The memory 1702 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1702 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 1701 to implement the method provided in the method embodiment of the present application.

In some embodiments, the terminal 1700 may optionally further include: a peripheral device interface 1703 and at least one peripheral device. The processor 1701, the memory 1702, and the peripheral device interface 1703 may be connected by a bus or a signal line. Each peripheral device can be connected to the peripheral device interface 1703 through a bus, a signal line, or a circuit board. Exemplarily, the peripheral device includes: at least one of a radio frequency circuit 1704, a touch display screen 1705, a camera 1706, an audio circuit 1707, a positioning component 1708, and a power supply 1709.

The peripheral device interface 1703 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 1701 and the memory 1702. In some embodiments, the processor 1701, the memory 1702, and the peripheral device interface 1703 are integrated on the same chip or circuit board; in some other embodiments, any one of the processor 1701, the memory 1702, and the peripheral device interface 1703 or The two can be implemented on separate chips or circuit boards, which are not limited in this embodiment.

The radio frequency circuit 1704 is used to receive and transmit RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals. The radio frequency circuit 1704 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1704 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. In some embodiments, the radio frequency circuit 1704 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so on. The radio frequency circuit 1704 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: World Wide Web, Metropolitan Area Network, Intranet, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area network and/or WiFi (Wireless Fidelity, wireless fidelity) network. In some embodiments, the radio frequency circuit 1704 may also include NFC (Near Field Communication) related circuits, which is not limited in this application.

The display screen 1705 is used to display UI (User Interface). The UI can include graphics, text, icons, videos, and any combination thereof. When the display screen 1705 is a touch display screen, the display screen 1705 also has the ability to collect touch signals on or above the surface of the display screen 1705. The touch signal may be input to the processor 1701 as a control signal for processing. At this time, the display screen 1705 may also be used to provide virtual buttons and/or virtual keyboards, also called soft buttons and/or soft keyboards. In some embodiments, there may be one display screen 1705, which is provided with the front panel of the terminal 1700; in other embodiments, there may be at least two display screens 1705, which are respectively arranged on different surfaces of the terminal 1700 or in a folded design; In still other embodiments, the display screen 1705 may be a flexible display screen, which is arranged on the curved surface or the folding surface of the terminal 1700. Furthermore, the display screen 1705 can also be set as a non-rectangular irregular pattern, that is, a special-shaped screen. The display screen 1705 may be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

The camera assembly 1706 is used to capture images or videos. As an example, the camera assembly 1706 includes a front camera and a rear camera. Generally, the front camera is set on the front panel of the terminal, and the rear camera is set on the back of the terminal. In some embodiments, there are at least two rear cameras, each of which is a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth-of-field camera to realize the background blur function, the main camera Integrate with the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1706 may also include a flash. The flash can be a single-color flash or a dual-color flash. Dual color temperature flash refers to a combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.

The audio circuit 1707 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them to the processor 1701 for processing, or input to the radio frequency circuit 1704 to implement voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively set in different parts of the terminal 1700. The microphone can also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1701 or the radio frequency circuit 1704 into sound waves. The speaker can be a traditional membrane speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into human audible sound waves, but also convert the electrical signal into human inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1707 may also include a headphone jack.

The positioning component 1708 is used to locate the current geographic location of the terminal 1700 to implement navigation or LBS (Location Based Service, location-based service). The positioning component 1708 may be a positioning component based on the GPS (Global Positioning System, Global Positioning System) of the United States, the Beidou system of China, or the Galileo system of Russia.

The power supply 1709 is used to supply power to various components in the terminal 1700. The power source 1709 may be alternating current, direct current, disposable batteries or rechargeable batteries. When the power source 1709 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

In some embodiments, the terminal 1700 further includes one or more sensors 1710. The one or more sensors 1710 include, but are not limited to: an acceleration sensor 1711, a gyroscope sensor 1717, a pressure sensor 1713, a fingerprint sensor 1714, an optical sensor 1715, and a proximity sensor 1716.

The acceleration sensor 1711 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the terminal 1700. For example, the acceleration sensor 1711 can be used to detect the components of the gravitational acceleration on three coordinate axes. The processor 1701 may control the touch screen 1705 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 1711. The acceleration sensor 1711 can also be used for game or user motion data collection.

The gyroscope sensor 1712 can detect the body direction and rotation angle of the terminal 1700, and the gyroscope sensor 1712 can cooperate with the acceleration sensor 1711 to collect the user's 3D actions on the terminal 1700. Based on the data collected by the gyroscope sensor 1712, the processor 1701 can implement the following functions: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

The pressure sensor 1713 may be disposed on the side frame of the terminal 1700 and/or the lower layer of the touch screen 1705. When the pressure sensor 1713 is arranged on the side frame of the terminal 1700, the user's holding signal of the terminal 1700 can be detected, and the processor 1701 performs left and right hand recognition or quick operation according to the holding signal collected by the pressure sensor 1713. When the pressure sensor 1713 is arranged on the lower layer of the touch display screen 1705, the processor 1701 controls the operability controls on the UI interface according to the pressure operation of the user on the touch display screen 1705. The operability control includes at least one of a button control, a scroll bar control, an icon control, and a menu control.

The fingerprint sensor 1714 is used to collect the user's fingerprint. The processor 1701 can identify the user's identity according to the fingerprint collected by the fingerprint sensor 1714, or the fingerprint sensor 1714 can identify the user's identity according to the collected fingerprint. When it is recognized that the user's identity is a trusted identity, the processor 1701 authorizes the user to perform related sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings. The fingerprint sensor 1714 may be provided on the front, back or side of the terminal 1700. When a physical button or a manufacturer logo is provided on the terminal 1700, the fingerprint sensor 1714 can be integrated with the physical button or the manufacturer logo.

The optical sensor 1715 is used to collect the ambient light intensity. In an embodiment, the processor 1701 may control the display brightness of the touch screen 1705 according to the intensity of the ambient light collected by the optical sensor 1715. Exemplarily, when the ambient light intensity is high, the display brightness of the touch screen 1705 is increased; when the ambient light intensity is low, the display brightness of the touch screen 1705 is decreased. In another embodiment, the processor 1701 may also dynamically adjust the shooting parameters of the camera assembly 1706 according to the ambient light intensity collected by the optical sensor 1715.

The proximity sensor 1716, also called a distance sensor, is usually arranged on the front panel of the terminal 1700. The proximity sensor 1716 is used to collect the distance between the user and the front of the terminal 1700. In one embodiment, when the proximity sensor 1716 detects that the distance between the user and the front of the terminal 1700 gradually decreases, the processor 1701 controls the touch screen 1705 to switch from the on-screen state to the off-screen state; when the proximity sensor 1716 detects When the distance between the user and the front of the terminal 1700 gradually increases, the processor 1701 controls the touch display screen 1705 to switch from the rest screen state to the bright screen state.

Those skilled in the art can understand that the structure shown in FIG. 18 does not constitute a limitation on the terminal 1700, and may include more or fewer components than shown in the figure, or combine some components, or adopt different component arrangements.

The embodiments of the present application also provide a non-transitory computer-readable storage medium. When the instructions in the storage medium are executed by the processor of the mobile terminal, the mobile terminal can execute the methods provided in the foregoing embodiments.

The embodiments of the present application also provide a computer program product containing instructions, which when run on a computer, cause the computer to execute the methods provided in the foregoing embodiments.

Those of ordinary skill in the art can understand that all or part of the steps in the foregoing embodiments can be implemented by hardware, or by a program instructing relevant hardware to be completed. The program can be stored in a computer-readable storage medium. The storage medium mentioned can be a read-only memory, a magnetic disk or an optical disk, etc.

The above descriptions are only preferred embodiments of this application and are not intended to limit this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the protection of this application. Within range.

Claims (10)

1. A filtering method, characterized in that the method includes:

   When the intra-frame sub-block division mode is activated by the current block, determine the target sub-block division mode from the sub-block division modes supported by the current block, and determine the target prediction mode from the prediction modes in the candidate prediction mode list of the current block;

   Determine the reconstructed image of the current block according to the target sub-block division mode and the target prediction mode;

   Determine the boundary filter intensity value of the sub-block according to the target sub-block division mode; filter the reconstructed image according to the boundary filter intensity value.
2. The method according to claim 1, wherein the determining the boundary filter strength value of the sub-block according to the target sub-block division mode comprises:

   Divide the reconstructed image of the current block into multiple sub-blocks according to the target sub-block division method, determine the boundary filter strength value of the sub-block based on the obtained multiple sub-block sizes, and the boundary filter strength value is used for sub-block The boundary of the block is filtered.
3. The method of claim 1, wherein:

   When the width or height of the current block is greater than the set threshold, the boundary filter strength values of the transform blocks of the multiple sub-blocks are set to be non-zero.
4. The method according to claim 3, wherein the set threshold value is 32.
5. The method of claim 4, wherein:

   When the width and height dimensions of the current block satisfy 64*64, the current block supports both horizontal division and vertical division.
6. The method according to claim 4 or 5, wherein the sub-block division mode of the current block satisfies that the width of the sub-block divided by the current block is an integer multiple of 8, or the height is an integer multiple of 8.
7. The method of claim 1, wherein the determining the reconstructed image of the current block according to the target sub-block division mode and the target prediction mode comprises:

   When decoding, divide the current block into multiple sub-blocks according to the target sub-block division mode;

   Performing inverse quantization and inverse transformation on the encoded stream according to the multiple sub-blocks to obtain residual information corresponding to the multiple sub-blocks;

   Performing intra-frame sub-block prediction according to the target prediction mode to obtain predicted pixel information of the multiple sub-blocks;

   Determine the reconstructed image of the current block according to the residual information corresponding to the multiple sub-blocks and the predicted pixel information.
8. The method of claim 1, wherein the method comprises:

   When encoding, divide the current block into multiple sub-blocks according to the target sub-block division mode;

   Intra-frame sub-block prediction is obtained according to the target prediction mode, the predicted pixel information of the multiple sub-blocks, and the residual of the current block is determined according to the original pixel information of the current block and the predicted pixel information of the multiple sub-blocks information;

   Transform the residual information according to the transformation modes supported by the multiple sub-blocks to obtain transformed information;

   Perform quantization processing on the transformed information, and perform inverse quantization and inverse transformation processing on the quantized data to obtain the inverse transformation result;

   The reconstructed image of the current block is determined based on the result of the inverse transformation.
9. An encoding terminal device is characterized by comprising:

   A processor, the processor is used to execute executable instructions;

   A memory for storing processor executable instructions;

   Wherein, the processor is configured to:

   When the intra-frame sub-block division mode is activated by the current block, determine the target sub-block division mode from the sub-block division modes supported by the current block, and determine the target prediction mode from the prediction modes in the candidate prediction mode list of the current block;

   Determine the reconstructed image of the current block according to the target sub-block division mode and the target prediction mode;

   Determine the boundary filter intensity value of the sub-block according to the target sub-block division mode; filter the reconstructed image according to the boundary filter intensity value.
10. A decoding terminal device, characterized in that it comprises:

    A processor, the processor is used to execute executable instructions;

    A memory for storing processor executable instructions;

    Wherein, the processor is configured to:

    When the intra-frame sub-block division mode is activated by the current block, determine the target sub-block division mode from the sub-block division modes supported by the current block, and determine the target prediction mode from the prediction modes in the candidate prediction mode list of the current block;

    Determine the reconstructed image of the current block according to the target sub-block division mode and the target prediction mode;

    Determine the boundary filter intensity value of the sub-block according to the target sub-block division mode; filter the reconstructed image according to the boundary filter intensity value.

Images