WO2020258001A1

WO2020258001A1 - Luminance component prediction method, encoder, decoder and storage medium

Info

Publication number: WO2020258001A1
Application number: PCT/CN2019/092664
Authority: WO
Inventors: 万帅; 郭锦坤; 霍俊彦; 马彦卓; 杨付正
Original assignee: Oppo广东移动通信有限公司
Priority date: 2019-06-25
Filing date: 2019-06-25
Publication date: 2020-12-30
Also published as: CN113243105A; CN113243105B

Abstract

Disclosed are a luminance component prediction method, an encoder, a decoder and a storage medium. The luminance component prediction method comprises: calculating a size ratio according to a first side length and a second side length which correspond to a current block, wherein the first side length is greater than or equal to the second side length, and the size ratio is set to be the ratio of the first side length to the second side length; if the size ratio is less than or equal to a preset ratio threshold value, and the size of the current block is not a first preset size, constructing, according to a preset prediction strategy, a matrix-based intra prediction (MIP) list corresponding to the current block, wherein the preset prediction strategy is used for luminance prediction based on a size-dependent MIP mode; acquiring, according to the MIP list, a luminance component prediction value corresponding to the current block; and performing encoding processing on the current block according to the MIP list and the luminance component prediction value in order to obtain code stream data corresponding to the current block.

Description

Luminance component prediction method, encoder, decoder and storage medium

Technical field

The embodiments of the present application relate to the technical field of video coding and decoding, and in particular to a method for predicting a luminance component, an encoder, a decoder, and a storage medium.

Background technique

In the reference software test platform for Versatile Video Coding (VVC), a new intra-frame coding technology, Matrix-based Intra Prediction (MIP) is proposed. MIP is based on neural The intra-frame prediction technology of the network uses a multilayer neural network to predict the brightness value of the current block based on the adjacent reconstructed brightness block. Specifically, the same as the traditional intra mode, when using MIP mode to perform intra prediction, the input of MIP prediction is also the data of the adjacent brightness block in the previous row and the left column of the current block, and the output is the brightness component prediction value of the current block. . The specific prediction process is divided into three steps: downsampling, matrix vector multiplication and interpolation.

However, due to the high complexity of the MIP mode, while the MIP technology improves the coding and decoding performance, the storage space and overall time required in the coding and decoding process are also greatly increased, thereby reducing the coding and decoding efficiency.

Summary of the invention

The embodiments of the present application provide a luminance component prediction method, an encoder, a decoder, and a storage medium, which can reduce complexity and reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance. Effectively improve coding and decoding efficiency.

The technical solutions of the embodiments of the present application are implemented as follows:

The embodiment of the present application provides a method for predicting a luminance component, which is applied to an encoder, and the method includes:

The size ratio is calculated according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio is set as the first side length and the second side length The ratio of the length of the second side;

If the size ratio is less than or equal to a preset ratio threshold, and the size of the current block is not the first preset size, constructing a matrix-based intra prediction MIP list corresponding to the current block according to the preset prediction strategy; Wherein, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode;

Acquiring, according to the MIP list, the predicted value of the luminance component corresponding to the current block;

Perform encoding processing on the current block according to the MIP list and the predicted value of the brightness component to obtain code stream data corresponding to the current block.

The embodiment of the application provides a method for predicting a luminance component, which is applied to a decoder, and the method includes:

The size ratio is calculated according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio is set as the first side length and the second side length The ratio of the second side length;

If the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first preset size, then the code stream data corresponding to the current block is parsed according to the preset prediction strategy to obtain the current block Corresponding MIP list and brightness component prediction values; wherein, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode;

Obtain image data corresponding to the current block according to the MIP list and the predicted value of the brightness component.

An embodiment of the present application provides an encoder, which includes: a first acquisition part, a construction part, and an encoding part,

The first acquiring part is configured to calculate a size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio is set to The ratio of the first side length to the second side length;

The construction part is configured to construct a matrix-based matrix corresponding to the current block according to a preset prediction strategy if the size ratio is less than or equal to a preset ratio threshold, and the size of the current block is not a first preset size Intra-frame prediction MIP list; wherein, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode;

The first obtaining part is further configured to obtain the predicted value of the luminance component corresponding to the current block according to the MIP list;

The coding part is configured to perform coding processing on the current block according to the MIP list and the predicted value of the luminance component to obtain code stream data corresponding to the current block.

An embodiment of the present application provides a decoder, the encoder includes: a second acquiring part and a decoding part,

The second acquiring part is configured to calculate a size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio Set as the ratio of the first side length to the second side length;

The decoding part is configured to analyze the code stream corresponding to the current block according to the preset prediction strategy if the size ratio is less than or equal to a preset ratio threshold and the size of the current block is not the first preset size Data to obtain the MIP list and the brightness component prediction value corresponding to the current block; wherein the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode;

The second obtaining part is further configured to obtain image data corresponding to the current block according to the MIP list and the predicted value of the brightness component.

An embodiment of the present application provides an encoder. The encoder includes a first processor, a first memory storing executable instructions of the first processor, a first communication interface, and a first communication interface for connecting to the first processor. The processor, the first memory, and the first bus of the first communication interface, when the instruction is executed by the first processor, implement the brightness component prediction method as described above.

An embodiment of the present application provides an encoder, which includes a second processor, a second memory storing executable instructions of the second processor, a second communication interface, and a second communication interface for connecting to the second processor. The processor, the second memory, and the second bus of the second communication interface, when the instruction is executed by the second processor, implement the brightness component prediction method as described above.

The embodiment of the present application provides a computer-readable storage medium with a program stored thereon and applied to an encoder and a decoder. When the program is executed by a processor, the method for predicting the luminance component as described above is realized.

The embodiments of the present application provide a luminance component prediction method, an encoder, a decoder, and a storage medium. The encoder obtains the size ratio by calculating the first side length and the second side length corresponding to the current block; wherein the first side length is greater than Or equal to the second side length, the size ratio is set to the ratio of the first side length to the second side length; if the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first preset size, the Set the prediction strategy to construct the matrix-based intra prediction MIP list corresponding to the current block; among them, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode; obtain the brightness component prediction value corresponding to the current block according to the MIP list; The list and the predicted value of the luminance component encode the current block to obtain the code stream data corresponding to the current block. Correspondingly, the decoder calculates the size ratio according to the first side length and the second side length corresponding to the current block; if the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first preset size, then The preset prediction strategy parses the code stream data corresponding to the current block to obtain the MIP list and the predicted value of the brightness component corresponding to the current block; and obtains the image data corresponding to the current block according to the MIP list and the predicted value of the brightness component. That is to say, in the embodiment of the present application, when the encoder encodes the current block, it can perform brightness prediction in the size-dependent MIP mode according to the first side length and the second side length corresponding to the current block. Specifically, Except for the current block whose size ratio is greater than or equal to 4, the current block whose size is 4×16 and 16×4 is forbidden to use MIP mode; accordingly, the decoder can also use MIP mode after obtaining the bitstream data of the current block. Corresponding to the first side length and the second side length, the size-dependent MIP mode is used for brightness prediction, which can simplify the MIP prediction process, reduce the complexity and reduce the complexity of the coding and decoding process while ensuring the coding and decoding performance. The required storage space and overall time can effectively improve the coding and decoding efficiency.

Description of the drawings

Figure 1 is a schematic diagram of the arrangement of 67 prediction modes in intra prediction;

Figure 2 is a schematic flow chart of encoding in MIP mode;

FIG. 3 is a schematic diagram of the arrangement of the adjacent brightness block on the upper side and the adjacent brightness block on the left side of the current block;

Figure 4 is a schematic diagram of the arrangement of determining the DM mode;

Figure 5 is a schematic diagram of the structure of a video encoding system;

Figure 6 is a schematic structural diagram of a video decoding system;

FIG. 7 is a schematic diagram 1 of the implementation process of a luminance component prediction method proposed by an embodiment of the application;

FIG. 8 is a schematic diagram of the existing MIP prediction logic branch;

Fig. 9 is a schematic diagram of MIP prediction logic branches in this application;

FIG. 10 is a second schematic diagram of the implementation process of a method for predicting luminance components according to an embodiment of the application;

FIG. 11 is a third schematic diagram of the implementation process of a luminance component prediction method proposed by an embodiment of this application;

FIG. 12 is a fourth schematic diagram of the implementation process of a method for predicting luminance components according to an embodiment of this application;

FIG. 13 is a schematic diagram 5 of the implementation process of a luminance component prediction method proposed by an embodiment of this application;

FIG. 14 is a schematic diagram 1 of the composition structure of an encoder proposed in an embodiment of the application;

FIG. 15 is a second schematic diagram of the composition structure of the encoder proposed in an embodiment of the application;

FIG. 16 is a schematic diagram 1 of the composition structure of a decoder proposed by an embodiment of the application;

FIG. 17 is a second schematic diagram of the composition structure of the decoder proposed in an embodiment of the application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It is understandable that the specific embodiments described here are only used to explain the related application, but not to limit the application. In addition, it should be noted that, for ease of description, only the parts related to the relevant application are shown in the drawings.

In video images, VVC accepted the ray-like weighted intra prediction technology (Affine Linear Weighted Intra Prediction) proposed in the Joint Video Experts Team (JVET)-N0217, and changed its name to matrix-based intra prediction , Namely MIP technology, this technology adds a different number of matrix-based intra prediction modes in the intra-frame brightness prediction process according to the different sizes of intra-frame luminance coding blocks.

In order to capture the finer edge directions presented in natural video, VVC expands the 33 kinds of intra-frame luminance prediction angle modes defined in the video compression standard (High Efficiency Video Coding, HEVC) to 65 kinds. Figure 1 shows the intra-frame prediction. A schematic diagram of the arrangement of 67 kinds of prediction modes, as shown in Figure 1, the arrows numbered 2-66 indicate 65 kinds of intra-angle prediction modes, and there are two non-angle modes, namely, the gradient flat Planar mode numbered 0 And the direct current DC mode numbered 1; therefore, the intra prediction process in VVC includes two non-angle modes and 65 angle modes. Here, these 67 prediction modes are referred to as traditional intra prediction modes.

MIP is an intra-frame prediction technology based on neural networks, which uses a multilayer neural network to predict the brightness value of the current block based on adjacent reconstructed pixels. Specifically, the MIP technology divides the brightness coding blocks into three categories according to the size of the brightness coding block in the frame. Set the size of the brightness coding block as W×H, where W is the width parameter and H is the height parameter, according to the size of the brightness coding block Luma coding blocks can be divided into three categories:

Luminance coding blocks with a size of 4×4 belong to the first type of luminance block, 8×4, 4×8 and 8×8 luminance coding blocks are classified as the second type of luminance block, and other sizes of luminance coding blocks belong to the third type. Brightness block.

For these three types of intra-frame luminance coding blocks, MIP technology adds M types of MIP modes on the basis of 67 traditional intra-frame prediction modes. Among them, for the first type of luminance block, M=35, for the second type of luminance Block, M=19, for the third type of luminance block, M=11.

Specifically, MIP technology is only applied to intra-frame brightness prediction. Like the traditional mode, the input of MIP prediction is also the previous row and left column of the current block, and the output is the predicted value of the current block. The specific prediction process is divided into three Steps: averaging, matrix vector multiplication and interpolation. In other words, by performing these three operations on the input reconstructed brightness values of the adjacent pixels in the upper row and the left column, the predicted value of the brightness component of the current block can be obtained.

Figure 2 is a schematic flow chart of encoding in MIP mode. As shown in Figure 2, the specific implementation of brightness prediction in MIP mode is as follows:

Step 1: Perform averaging operation on the adjacent reference points on the upper side of the current block to obtain the vector bdry _top with a total of N values; perform averaging operation on the adjacent reference points on the left side of the current block to obtain the vector bdry _left with a total of N values. When the current brightness code is the first type of brightness code, N=2; when the current brightness code is the second or third type of brightness code, N=4. Vector bdry _top and vector bdry _left form a new vector bdry _red and perform subsequent operations;

Step 2: Obtain the corresponding matrix A _k and the offset b _k through the mode number k of the MIP mode, and obtain the partial prediction value of the current block as shown in Figure 2 by the following formula (1):

Pred _red =A _k ·bdry _red +b _k (1)

Step 3: Obtain the remaining predicted value Predred in the current block through linear interpolation.

It should be noted that for the implementation process of encoding the current block, which encoding mode used for intra prediction needs to be written into the compressed code stream, so that the decoder can determine which encoding mode is used by analyzing the mode information. One mode, whether it is a traditional mode or a MIP mode; if it is a traditional mode, which is the specific traditional mode; if it is a MIP mode, which is the specific MIP mode.

In VVC intra-frame prediction, the rate-distortion cost RDcost of 67 traditional modes and M MIP modes is compared for each luminance coding block, and the optimal mode is selected among 67 traditional modes and M MIP modes. coding. In order to save bit overhead, VVC uses the most probable mode list (Most Probable Modes List, MPM)-based intra mode coding technology,

It should be noted that since the multiple reference line technology (extend reference line) and the intra sub-patitionar (Itra Sub-Patitionar, ISP) are only used for the modes in the MPM list, when both extendrefflag and ispflag are 0, use 0 When the reference line is not divided into sub-blocks, it is not necessary to encode mpmflag, and the position of the optimal mode in the MPM list is directly encoded.

Further, for the construction of the MPM list and the MIPMPM list, in VVC luma intra prediction, if the optimal mode selected by the current block is the traditional mode, it is necessary to construct an MPM list containing the 6 most likely traditional modes; The optimal mode selected by the block is the MIP mode, and a MIPMPM list containing the 3 most likely MIP modes needs to be constructed.

Figure 3 is a schematic diagram of the arrangement of the adjacent brightness block on the upper side of the current block and the adjacent brightness block on the left side. The optimal mode of the luminance block (A) and the adjacent luminance block (L) on the left is derived.

Specifically, for the construction of the MPM list, in VVC intra prediction, if the optimal mode of the current block is the traditional mode, the MPM list needs to be constructed. In the process of constructing the MPM list, it is first necessary to obtain the traditional mode ABOVE corresponding to the optimal mode of the upper adjacent luminance block and the traditional mode LEFT corresponding to the optimal mode of the adjacent luminance block on the left.

Further, for the construction of the MIPMPM list, in VVC intra prediction, if the optimal mode of the current block is the MIP mode, the MIPMPM list needs to be constructed. In the process of constructing the MIPMPM list, it is first necessary to obtain the MIP mode ABOVE_MIP corresponding to the optimal mode of the upper adjacent luminance block and the MIP mode LEFT_MIP corresponding to the optimal mode of the adjacent luminance block on the left.

Further, after obtaining LEFT_MIP and ABOVE_MIP, construct the MIPMPM list containing the 3 most probable MIPMPM modes according to the following method, where the number in MIPMPM is the number of the MIP mode, and the number range is 0 to (M-1) For the first type of brightness block number is 0-34; for the second type of brightness block number is 0-18; for the third type of brightness block number is 0-10:

If LEFT_MIP is available (not -1), put LEFT_MIP into MIPMPMlist;

If ABOVE_MIP is available (not -1), put ABOVE_MIP into MIPMPMlist after passing the redundancy check;

If LEFT_MIP is not available (for -1), ABOVE_MIP is not available (for -1), according to the type of the current block, the default list will be added after the redundancy check is passed until MIPMPMlist is filled:

The default list of the first type of brightness block is: {17, 34, 5};

The default list of the second type of brightness block is: {0, 7, 16};

The default list of the third type of luminance block is: {1, 4, 6}.

Further, it needs to be added that there is a direct mode (Direct Mode, DM) that uses inter-component correlation in the chroma intra prediction process of VVC, which uses the frame at the center of the co-located luminance coding block corresponding to the current block Intra prediction mode is used to perform intra prediction of the current chrominance block. Figure 4 is a schematic diagram of determining the arrangement of the DM mode. As shown in Figure 4, since the MIP technology is only applied to the luma coding block, when the frame at the CR position in Figure 4 When the intra prediction mode is the MIP mode, the MIP mode needs to be mapped to the traditional mode through the "MIP-traditional mapping table" to perform intra prediction of the current chrominance block.

That is to say, due to the introduction of MIP technology, in the process of intra prediction, the traditional mode needs to be mapped to the MIP mode in the construction of the MIPMPM list, and the MIP mode needs to be mapped to the traditional mode in the construction of the MPM list and the determination of the DM mode. .

However, in practical applications, the mapping from the traditional mode to the MIP mode needs to be used in the MIPMPM list construction process. As shown in Table 1, the traditional mode is mapped to the MIP mode through the "traditional-MIP mapping table".

Table 1

In addition, the mapping from the MIP mode to the traditional mode needs to be used in the MPM list construction process and the DM mode acquisition process. Specifically, 35/19/11 MIP modes are mapped to 67 traditional modes through the "MIP-Traditional Mapping Table". For the three types of luminance blocks, three "MIP-traditional mapping tables" are shown in Table 2, Table 3 and Table 4.

Table 2

MIP模式 MIP mode	00	11	22	33	44	55	66	77	88	99	1010	1111	1212	1313	1414	1515	1616	1717
传统模式 Traditional model	00	1818	1818	00	1818	00	1212	00	1818	22	1818	1212	1818	1818	11	1818	1818	00
MIP模式MIP mode	1818	1919	2020	21twenty one	22twenty two	23twenty three	24twenty four	2525	2626	2727	2828	2929	3030	3131	3232	3333	3434	To
传统模式 Traditional model	00	5050	00	5050	00	5656	00	5050	6666	5050	5656	5050	5050	11	5050	5050	5050	To

table 3

MIP模式 MIP mode	00	11	22	33	44	55	66	77	88	99	1010	1111	1212	1313	1414	1515	1616	1717	1818
传统模式 Traditional model	00	11	00	11	00	22twenty two	1818	1818	11	00	11	00	11	00	4444	00	5050	11	00

Table 4

MIP模式 MIP mode	00	11	22	33	44	55	66	77	88	99	1010
传统模式Traditional model	11	11	11	11	1818	00	11	00	11	5050	00

Figure 5 is a schematic structural diagram of a video encoding system. As shown in Figure 5, the video encoding system 100 includes a transform and quantization module 101, an intra-frame estimation module 102, an intra-frame prediction module 103, a motion compensation module 104, and a motion estimation module 105, Inverse transform and inverse quantization module 106, filter control analysis module 107, deblocking filter and sample adaptive indentation (Sample Adaptive Offset, SAO) filter module 108, header information coding and context-based adaptive binary arithmetic coding (Context- Based on Adaptive Binary Arithmatic Coding, CABAC) encoding module 109 and decoded image buffer module 110; Figure 6 is a schematic diagram of the structure of the video decoding system, as shown in Figure 6, the video decoding system 200 includes header information decoding and CABAC decoding module 201 , Inverse transform and inverse quantization module 202, intra-frame prediction module 203, motion compensation module 204, deblocking filter and SAO filter module 205, decoded image buffer module 206 and other components. The video image passes through the transformation and quantization module 101, the intra-frame estimation module 102, the intra-frame prediction module 103, the motion compensation module 104, the motion estimation module 105, the deblocking filtering and SAO filtering module 108, the header information encoding and CABAC in the video encoding system 100 After processing by the module 109 and other parts, it outputs the code stream of the video image; the code stream is input into the video decoding system 200, and passes through the header information decoding and CABAC decoding module 201 in the video decoding system 200, the inverse transform and inverse quantization module 202, and the intraframe The prediction module 203 and the motion compensation module 204 perform partial processing, and finally restore the original video image.

According to the height and width parameters, the current block can have 25 sizes. Specifically, the standard stipulates that the maximum size of the brightness block is 128×128, but since the maximum size of the transform unit is 64×64, that is, the brightness block is at 128× Under the size of 128, quadtree division must be performed first, so the maximum luminance block size is 64×64. Table 5 is a schematic table of the size of the brightness block, as shown in Table 5.

table 5

(4×4)(4×4)	(4×8)(4×8)	(4×16)(4×16)	(4×32)(4×32)	(4×64)(4×64)
(8×4)(8×4)	(8×8)(8×8)	(8×16)(8×16)	(8×32)(8×32)	(8×64)(8×64)
(16×4)(16×4)	(16×8)(16×8)	(16×16)(16×16)	(16×32)(16×32)	(16×64)(16×64)
(32×4)(32×4)	(32×8)(32×8)	(32×16)(32×16)	(32×32)(32×32)	(32×64)(32×64)
(64×4)(64×4)	(64×8)(64×8)	(64×16)(64×16)	(64×32)(64×32)	(64×64)(64×64)

In the prior art, the MIP mode is restricted according to the height parameter and the width parameter of the current block. Specifically, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the current block is not encoded in the MIP mode. , Table 6 is the limitation of the brightness block size in the MIP mode in the prior art, as shown in Table 6,

Table 6

In the prior art, in the first type of brightness block in the MIP mode (corresponding to a 4×4 brightness block), there are two upper and left neighboring brightness blocks each, after matrix operation, a 4×4 prediction block is generated ; In the second type of brightness block in MIP mode (corresponding to 4×8, 8×4, 8×8 brightness blocks), there are 4 upper and left neighboring brightness blocks each, after matrix operation, 4× 4 prediction blocks; in the third type of brightness blocks in the MIP mode (corresponding to brightness blocks of other sizes), there are 4 upper and left adjacent brightness blocks each. After matrix operation, a 4×8 prediction block ( 4×16 brightness block), 8×4 prediction block (16×4 brightness block) or 8×8 prediction block (other size brightness block). Among them, since the third type of luminance block will generate a non-square prediction block, it is necessary to extract odd rows of the matrix during calculation.

Further, in the syntax, MipSizeId can be used to indicate the application category of MIP, numModes indicates the number of MIP modes, boundarySize indicates the number of brightness blocks in the upper reference row or left reference column obtained by downsampling, and predW indicates the width parameter of the prediction block. predH represents the height parameter of the prediction block, and predC represents the side length of the MIP matrix. Table 7 shows the grammatical relationship corresponding to the MIP mode in the prior art. As shown in Table 7, the MipSizeId, numModes, boundarySize, predW, predH, and predC in the grammar have the following relationships:

Table 7

MipSizeIdMipSizeId	numModesnumModes	boundarySizeboundarySize	predW predW	predHpredH		predCpredC
00	3535	22	44	44	44
11	1919	44	44	44	44
22	1111	44	Min(nTbW，8)Min(nTbW, 8)	Min(nTbH，8)Min(nTbH, 8)	88

Further, in the syntax, the value of MipSizeId is 0 for 4×4 brightness block, the value of 1 is 4×8, 8×4, 8×8 brightness block, and the value is 2 for brightness blocks of other sizes. . numModes indicates how many MIP prediction modes there will be, that is, there are 35 types of 4×4 brightness blocks, 19 types of 4×8, 8×4, and 8×8 brightness blocks, and 11 types of brightness blocks of other sizes. The boundarySize indicates that the adjacent luminance blocks in the upper or left column of the current block are finally down-sampled into 2 or 4 adjacent luminance blocks.

In MIP technology, it is necessary to downsample adjacent luminance blocks in different ways according to three types of MIP modes based on the size of the current block. The prediction blocks generated after matrix operation have four sizes, and then they need to be discussed in different situations. Whether it is necessary to upsample each type of prediction block, how to upsample, and finally restore the size of the current block.

Specifically, when the current block is 4×4 in size, 4 adjacent luminance blocks are generated after down-sampling adjacent luminance blocks, that is, the left column and the upper adjacent luminance blocks are both down-sampled into 2 luminance blocks and then spliced, and then Carry out matrix operation to generate 4×4 prediction matrix, a total of 35 modes, no upsampling is required at this time; when the current block is 4×8, 8×4 or 8×8 size, after the adjacent luminance block is downsampled Generate 8 adjacent brightness blocks, that is, the left column and the upper adjacent brightness blocks are down-sampled into 4 brightness blocks and then spliced, and then matrix operation is performed to generate a 4×4 prediction matrix, a total of 19 modes are required. Up-sampling is performed; when the current block is of other sizes, 8 adjacent luminance blocks are generated after the adjacent luminance blocks are down-sampled, that is, the left column and the upper adjacent luminance blocks are all down-sampled into 4 luminance blocks and then spliced. Among them, when the current block is 4×16, a 4×8 prediction matrix will be generated, a total of 11 modes; when the current block is 16×4, a 8×4 prediction matrix will be generated, a total of 11 modes; the current block is other For large hours, an 8×8 prediction matrix will be generated with a total of 11 modes.

Table 8 shows the classification of luminance blocks in MIP mode. As shown in Table 8, according to the size of the generated MIP prediction block, the luminance block can be divided into several situations shown in Table 11: 4×4 size will be generated after matrix operation The brightness block of the prediction block, the brightness block of the 4×8 or 8×4 size prediction block will be generated after the matrix operation, the brightness block of the 8×8 size prediction block will be generated after the matrix operation, and the brightness that is not specified in the current VVC for MIP prediction Piece.

Table 8

It can be seen that due to the existence of two size brightness blocks of 4×16 and 16×4, the MIP algorithm will have some redundant logic branches. Specifically, when the current block width and height are both less than or equal to 8, it will generate 4×4 prediction blocks, a total of 35 or 19 types; when the current block width and height are greater than 8, except for 4×16 and 16×4, 8×8 prediction blocks will be generated, a total of 11 types; When the block is 4×16, 4×8 prediction blocks will be generated, 11 types in total; when the current block is 16×4, 8×4 prediction blocks will be generated, 11 types in total. For brightness blocks of two sizes, 4×16 and 16×4, the algorithm needs to determine whether to extract odd rows of the existing matrix during matrix operation, and it will also make the prediction block not all square.

In the prior art, when the encoder performs brightness prediction in the MIP mode, it can be performed by the following formula (2):

Among them, mWeight and vBias are weight matrices and bias matrices trained by deep learning for each MIP mode. Specifically, mWeight is the weight matrix of each type of MIP mode, and vBias is the bias matrix of each type of MIP mode. sB is the left shift of the bias matrix, oW is the rounded reserved value, and sW is the right shift of the overall predicted value. The sW value in different MIP modes needs to be obtained by looking up the table.

Based on JVET-N1001-v7, when generating the MIP prediction matrix, the encoder uses the variables incW and incH to determine whether it needs to extract the predicted values of odd rows, specifically:

oW＝1<<(sW-1)

sB=BitDepth _Y -1

mipW=isTransposed? predH:predW

mipH=isTransposed? predW:predH

incW=(predC>mipW)? 2:1

incH=(predC>mipH)? 2:1

Among them, incW=2 or incH=2 means that the width parameter or the height parameter needs to be extracted.

It can be seen that the introduction of MIP technology has brought about major changes to the current intra-frame prediction and coding framework. While coding and decoding performance has been improved, a large number of logic branches have also been introduced, which has increased the overall time and complexity. Specifically, the prediction process of the existing MIP model is very cumbersome, with too many branches, which increases the complexity. At the same time, many variables are introduced in the prediction process and the storage space is increased. In order to overcome the above-mentioned shortcomings, the luminance component prediction method proposed in this application can be applied to both the encoder and the decoder, which can simplify the MIP prediction process and reduce the complexity and reduce The storage space and overall time required in the small encoding and decoding process can effectively improve the encoding and decoding efficiency.

Furthermore, the luminance component prediction method proposed in this application can affect the intra prediction part in the video coding mixing framework, that is, it is mainly used in the intra prediction module 103 in video coding and the intra prediction module 203 in video decoding. Simultaneously act on the encoding end and the decoding end.

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

In an embodiment of the present application, FIG. 7 is a schematic diagram 1 of the implementation process of a luminance component prediction method proposed in an embodiment of the present application, which is applied to an encoder, as shown in FIG. 7, in the embodiment of the present application, The method for the encoder to predict the luminance component may include the following steps.

Step 101: Calculate the size ratio according to the first side length and the second side length corresponding to the current block; where the first side length is greater than or equal to the second side length, and the size ratio is set as the ratio of the first side length and the second side length ratio.

In the embodiment of the present application, the encoder may first calculate the size ratio corresponding to the current block according to the first side length and the second side length corresponding to the current block. Among them, the current block may represent the current block to be encoded or the current block to be decoded. Specifically, in the embodiment of the present application, when the encoder performs encoding, the current block is the block to be encoded.

Further, in the embodiments of the present application, the first side length may be the longer side of the current block, and the second side length may be the shorter side of the current block, that is, the first side length may be greater than or equal to the second side. Side length. Specifically, the first side length and the second side length can be respectively the height parameter and the width parameter corresponding to the current block. That is to say, the ratio of the first side length and the second side length, that is, the size ratio, can be either height or width. The ratio can also be an aspect ratio.

It should be noted that in the implementation of this application, it is precisely because the first side length can be the longer side of the current block, and the second side length can be the shorter side of the current block, that is, the size ratio represents the current block corresponding The ratio of the long side to the short side of, therefore, the size ratio is a natural number greater than or equal to 1.

Further, in the embodiment of the present application, when the encoder encodes the current block, it can first select the optimal encoding mode in the traditional mode and the MIP mode. Specifically, the encoder can select the optimal encoding method according to the size corresponding to the current block. The ratio is used to select the optimal encoding method.

It should be noted that, in the embodiment of the present application, in the intra prediction process of VVC, for any luma coding block, an optimal mode can be selected for coding processing in the traditional mode and the MIP mode. Among them, the traditional mode includes 67 intra prediction modes including Planar mode numbered 0, DC mode numbered 1, and 65 angle modes.

Further, in the embodiment of the present application, when the encoder selects the optimal mode, it can compare the Rdcost of 67 traditional modes and M MIP modes on the current block, so that the optimal mode can be selected according to the comparison result. And encode it. Among them, based on the type of the current brightness coding module, the value of M is different. Specifically, when the current brightness coding module is the first type of brightness block, that is, when the current brightness coding module size is 4×4, M=35; The current brightness coding module is the second type of brightness block, that is, when the current brightness coding module size is 8×4, 4×8, or 8×8, M=19; when the current brightness coding module is the third type of brightness block, that is, the current brightness When the encoding module is of other sizes, M=11.

Step 102: If the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first preset size, construct the MIP list corresponding to the current block according to the preset prediction strategy; wherein the preset prediction strategy is used based on The size-dependent MIP mode performs brightness prediction.

In the embodiment of this application, after the encoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, if the size ratio is less than or equal to the preset ratio threshold, if the size of the current block is If it is not the first preset size, the encoder can construct the MIP list corresponding to the current block according to the preset prediction strategy.

Further, in the embodiment of the present application, the preset ratio threshold is equal to 4, and the first preset size is 4×16 and 16×4.

It should be noted that in the embodiment of the present application, when the encoder encodes the current block according to the MIP mode, it needs to first limit the size of the current block. Specifically, when the size ratio of the current block is less than or equal to 4. And when the size of the current block is not 4×16, and it is not 16×4 at the same time, the encoder will determine the luminance prediction of the current block according to the MIP mode.

Further, in the implementation of this application, a size-dependent MIP mode prediction method, that is, a preset prediction strategy, can be preset The block performs brightness prediction, so that the corresponding MIP list can be obtained.

It should be noted that, in the implementation of the present application, the prior art can limit the current block size ratio to be less than or equal to 4 when selecting the optimal encoding mode, and then perform brightness prediction according to the MIP mode. Fig. 8 is a schematic diagram of the existing MIP prediction logic branch. As shown in Fig. 8, combined with the above Table 8, in the prior art, when encoding the current block, it is assumed that the first side length is the height parameter, and the second side length is The width parameter, based on the first side length H and the second side length W of the current block, can be encoded through the following steps:

S701: Determine whether to use the MIP mode, if yes, execute S702, otherwise execute S7011;

S702: Whether H and W are both less than or equal to 8, if yes, go to S703, otherwise go to S706;

S703: Whether H and W are both 4, if yes, execute S704, otherwise, execute S705;

S704: Generate a 4×4 prediction matrix through 35 MIP modes, and end.

S705: Generate a 4×4 prediction matrix through 19 MIP modes, and end.

S706: Whether H is greater than or equal to 8 or W is greater than or equal to 8, if yes, execute S707, otherwise, execute S708;

S707: Generate an 8×8 prediction matrix through 11 MIP modes, and end.

S708: Whether W is greater than or equal to H, if yes, execute S709, and if so, execute S7010;

S709: Generate a 4×8 prediction matrix through 11 MIP modes, and end.

S710: Generate an 8×4 prediction matrix through 11 MIP modes, and end.

S711: Use traditional prediction mode.

It can be seen that due to the existence of two size brightness blocks of 4×16 and 16×4, the MIP algorithm will have some redundant logic branches. Specifically, when the current block is 4×16, 4× There are 11 types of 8 prediction blocks; when the current block is 16×4, 8×4 prediction blocks will be generated, a total of 11 types. For brightness blocks of two sizes, 4×16 and 16×4, the algorithm needs to determine whether to extract odd rows of the existing matrix during matrix operation, and it will also make the prediction block not all square.

Based on the foregoing Table 6, it can be seen that in the prior art, when the MIP mode is restricted, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the current block is not encoded in the MIP mode. Furthermore, in the brightness component prediction method proposed by this application, when the MIP mode is restricted, if the size ratio of the current block is greater than 4, and the size of the current block is 4×16 and 16×4, the current block is not used in the MIP mode. Block encoding. Table 9 is the first limit of the size of the luminance block in the MIP mode in this application. As shown in Table 9, the luminance component prediction method proposed in this application can change the limit conditions of the MIP mode to 4×16 and 16×4. These two sizes of luminance blocks are restricted to not perform MIP prediction. After this restriction, the prediction branch will be simplified, the syntax and semantics of the algorithm are simplified, the time complexity is reduced, and the memory is saved.

Table 9

Further, in the embodiment of the present application, after the restriction conditions of the MIP mode are changed, compared with the above-mentioned FIG. 11, FIG. 9 is a schematic diagram of the MIP prediction logic branch in the application, as shown in FIG. 9, combined with the above-mentioned Table 9, In the embodiment of the present application, when encoding the current block, assuming that the first side length is the height parameter and the second side length is the width parameter, based on the first side length H and the second side length W of the current block, The encoding process can be performed through the following steps:

S801: Determine whether to use the MIP mode, if yes, execute S802, otherwise execute S807;

S802: Whether H and W are both less than or equal to 8, if yes, go to S803, otherwise go to S806;

S803: Whether H and W are both 4, if yes, execute S804, otherwise, execute S805;

S804: Generate a 4×4 prediction matrix through 35 MIP modes, and end.

S805: Generate a 4×4 prediction matrix through 19 MIP modes, and end.

S806: Generate an 8×8 prediction matrix through 11 MIP modes, and end.

S807: Use traditional mode.

Comparing the foregoing Figures 8 and 9, the brightness component prediction method proposed in this application can effectively solve the problem that due to the existence of brightness blocks of 4×16 and 16×4, the MIP algorithm will have some redundant logic branches. At the same time, since the obtained prediction blocks are all squares, the determination of whether to extract odd rows of the existing matrix can be avoided during matrix operations.

Further, in the embodiment of the present application, in terms of syntax and semantics, when the MIP mode is restricted, the current block that satisfies the Abs(Log2(cbWidth)-Log2(cbHeight))<=2) condition is allowed to perform MIP prediction , Modified to satisfy Abs(Log2(cbWidth)-Log2(cbHeight))<2)&&(Log2(cbWidth)!=4&&Log2(cbHeight)!=2)&&(Log2(cbWidth)!=2)&&Log2(cbHeight)! =4) Only the current block under the conditions can use the MIP mode.

Further, in the embodiment of the present application, when the grammar of the MIP prediction process is modified, the grammar in Table 7 can be specifically modified. Specifically, Table 10 is the grammatical relationship corresponding to the MIP mode in this application. As shown in Table 10, in the embodiment of this application, the MipSizeId, numModes, boundarySize, predW, predH, and predC in the syntax have the following relationships:

Table 10

MipSizeIdMipSizeId	numModes numModes	boundarySizeboundarySize		predCpredC
00	3535	22	44
11	1919	44	44
22	1111	44	88

It can be seen that, compared with the prior art, the brightness component prediction method proposed in this application can prohibit the use of MIP modes for two brightness blocks of 4×16 and 16×4, and predW and predH when MipSizeId is equal to 2, due to the current The side length of the luminance encoding must be greater than or equal to 8, so it can be directly equal to 8 without performing comparison operations. This change makes predW, predH and predC completely equal, so the syntax can be further simplified, using predC instead of all predW and predH in the MIP mode, that is, the size of the prediction matrix generated by the MIP mode is completely equal to the size of the matrix in the MIP, and there is no need Additional comparison.

In the prior art, when using the MIP mode to predict two kinds of brightness blocks, 4×16 and 16×4, it is necessary to extract the odd rows of the matrix to generate prediction blocks of 4×8 and 8×4 sizes. It is necessary to determine whether this step of extraction is required, and the brightness component prediction method proposed in this application can effectively avoid the extraction of odd rows of the matrix after changing the restriction conditions of the MIP mode. Compared with the above formula (2), in this application In the implementation of, when the encoder performs brightness prediction in MIP mode, it can be performed by the following formula (3):

among them,

oW＝1<<(sW-1)

sB=BitDepth _Y -1

It should be noted that, in the embodiment of the present application, after the encoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, if the size of the current block is 4×16 or 16×4, Then, even if the size ratio is less than or equal to 4, the encoder will not encode the current block according to the MIP mode, which can simplify prediction branching and syntax semantics, and reduce time complexity.

further. In the embodiment of the present application, after the encoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, when the size ratio of the current block is less than or equal to 4, and the size of the current block is not 4 ×16 and not 16×4 at the same time, the encoder can construct the MIP list corresponding to the current block according to the preset prediction strategy, where the MIP list is MIPMPM.

It should be noted that, in the embodiments of the present application, in order to save bit overhead, the MPM intra-mode coding technology is used in VVC. Specifically, when constructing the MIPMPM list, it is first necessary to obtain the first prediction mode of the upper neighboring luminance block, that is, the MIP mode ABOVE_MIP corresponding to the optimal mode of the upper neighboring luminance block, and the The second prediction mode is the MIP mode LEFT_MIP mode corresponding to the optimal mode of the adjacent brightness block on the left, and then the MIP list is constructed based on the first prediction mode and the second prediction mode.

That is to say, before the encoder constructs the MIP list corresponding to the current block according to the preset prediction strategy, it needs to first obtain the first prediction mode of the upper neighboring luminance block corresponding to the current block, and at the same time obtain the left neighbor corresponding to the current block. The second prediction mode of the luma block.

Further, in the embodiment of the present application, based on the size ratio of the current block, that is, the aspect ratio and aspect ratio corresponding to the current block are both less than or equal to 4. At the same time, the size of the current block is not 4×16 and 16× 4. When the encoder constructs the MIP list corresponding to the current block according to the first side length and the second side length, the following three situations can be included:

When the current block belongs to the first type of luminance block, that is, when the size of the current block is 4×4, the encoder can construct the MIP list according to the first construction strategy based on the first side length and the second side length, where the first construction strategy Used for brightness prediction through 35 MIP modes. Specifically, the encoder may construct the MIP list according to the first prediction mode, the second prediction mode, and 35 MIP modes.

When the current block belongs to the second type of luminance block, that is, when the size of the current block is 4×8, 8×4 or 8×8, the encoder can construct the MIP according to the second construction strategy based on the first side length and the second side length List, where the second construction strategy is used for brightness prediction through 19 MIP modes. Specifically, the encoder may construct the MIP list according to the first prediction mode, the second prediction mode, and 19 MIP modes.

When the current block belongs to the third type of luminance block, that is, when the first side length H of the current block is greater than 8, and the second side length W is greater than 8, the encoder can be based on the first side length and the second side length, according to the third configuration The strategy constructs the MIP list, where the third construct strategy is used for brightness prediction through 11 MIP modes. Specifically, the encoder may construct the MIP list according to the first prediction mode, the second prediction mode, and 11 MIP modes.

Step 103: Obtain the predicted value of the luminance component corresponding to the current block according to the MIP list.

Step 104: Perform encoding processing on the current block according to the MIP list and the predicted value of the luminance component to obtain code stream data corresponding to the current block.

In the embodiment of the present application, after the encoder constructs the MIP list corresponding to the current block according to the preset prediction strategy, it can continue to obtain the brightness component prediction value corresponding to the current block according to the MIP list, and then can directly follow the MIP list and the brightness component The prediction value encodes the current block.

It should be noted that, in the embodiments of the present application, the luminance component prediction method proposed in the embodiments of the present application can modify the syntax of the MIP prediction process, while the encoding process of the MIP technology, the construction process of the MIPMPM list, and the traditional mode The syntax of the process of mutual mapping with MIP mode may not be modified.

Further, in the embodiment of the present application, after constructing the MIP list, the encoder can obtain the prediction value of the luminance component corresponding to the current block according to the MIP list, so that the encoding process of the current block can be continued.

It should be noted that, in the embodiment of the present application, when the encoder obtains the predicted value of the brightness component corresponding to the current block according to the MIP list, it can read the mode number k of the MIP mode from the MIP list, so as to obtain the corresponding matrix Ak and the offset bk are used to perform matrix vector multiplication according to the above formula (1), so as to obtain the predicted value of the brightness component corresponding to the current block.

Based on the brightness component prediction method from step 101 to step 104, in the embodiment of the present application, the encoder can reduce algorithm branches and syntax semantics, making the implementation of MIP technology more concise and unified. Specifically, in the prior art, 4 The brightness blocks of ×16 and 16×4 are branched separately, but this application can reduce the number of judgments in the MIP prediction process, avoiding the need to extract odd rows before the matrix is multiplied, and the matrix can be unified The calculation method, and the generated prediction blocks are unified into square blocks, which reduces the probability by half.

It should be noted that the luminance component prediction method proposed in the present application reduces the complexity without significant loss in coding performance. Specifically, in the embodiment of the present application, in the case of reducing MIP prediction branches, according to the general test standard of VVC, there is no significant loss in overall performance. The BD-rates on Y, U, and V are 0.05%, -0.04%, and -0.04%, respectively.

In the brightness component prediction method proposed in the embodiment of the present application, the encoder obtains the size ratio by calculating the first side length and the second side length corresponding to the current block; wherein the first side length is greater than or equal to the second side length, and the size ratio is Set to the ratio of the first side length to the second side length; if the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first preset size, then the current block based on the preset prediction strategy is constructed. Matrix intra prediction MIP list; among them, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode; obtain the brightness component prediction value corresponding to the current block according to the MIP list; compare the current block according to the MIP list and the brightness component prediction value Perform encoding processing to obtain code stream data corresponding to the current block. That is to say, in the embodiment of the present application, when the encoder encodes the current block, it can perform brightness prediction in the size-dependent MIP mode according to the first side length and the second side length corresponding to the current block. Specifically, Except for the current block whose size ratio is greater than or equal to 4, the current block whose size is 4×16 and 16×4 is forbidden to use MIP mode; accordingly, the decoder can also use MIP mode after obtaining the bitstream data of the current block. Corresponding to the first side length and the second side length, the size-dependent MIP mode is used for brightness prediction, which can simplify the MIP prediction process, reduce the complexity and reduce the complexity of the coding and decoding process while ensuring the coding and decoding performance. The required storage space and overall time can effectively improve the coding and decoding efficiency.

Based on the foregoing embodiment, in another embodiment of the present application, FIG. 10 is a schematic diagram of the second implementation flow of a luminance component prediction method proposed in an embodiment of the present application. As shown in FIG. 10, the encoder is working according to the current block corresponding After the first side length and the second side length are calculated to obtain the size ratio, that is, after the above step 101, and before the brightness component prediction value corresponding to the current block is obtained according to the MIP list, that is, before step 103, the method for the encoder to perform the brightness component prediction is also It can include the following steps:

Step 105: If the size ratio is less than the preset ratio threshold, construct the MIP list corresponding to the current block according to the preset prediction strategy.

In the embodiment of the present application, after the encoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, if the size ratio is less than the preset ratio threshold, the encoder can be constructed according to the preset prediction strategy The MIP list corresponding to the current block.

Based on the foregoing Table 6, it can be seen that in the prior art, when the MIP mode is restricted, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the current block is not encoded in the MIP mode. Further, in the brightness component prediction method proposed in this application, when the MIP mode is restricted, if the aspect ratio of the current block is greater than or equal to 4, or the aspect ratio is greater than or equal to 4, the current block is not evaluated in the MIP mode. Encode. Table 11 is the second limitation of the brightness block size in the MIP mode in this application. As shown in Table 11, the brightness component prediction method proposed by this application can not only change the 4×16 and 16× 4 Luminance blocks of these two sizes are restricted from performing MIP prediction. At the same time, four luma blocks of 32×8, 8×32, 16×64, and 64×16 are restricted from performing MIP prediction. After this restriction, the prediction branch will be simplified, the syntax and semantics of the algorithm will be simplified, the time complexity will be reduced, and the memory will be saved.

Table 11

Further, in the embodiment of the present application, after changing the restriction conditions of the MIP mode, that is, in the prior art, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the current block will not be processed through the MIP mode. The restriction conditions for encoding the block are modified to the restriction conditions in this application that if the aspect ratio of the current block is greater than or equal to 4, or if the aspect ratio is greater than or equal to 4, then the current block is not encoded in the MIP mode. It can effectively solve the problem of excessively redundant logic branches in the MIP algorithm due to the existence of two size brightness blocks of 4×16 and 16×4. At the same time, because the obtained prediction blocks are all square, it can be used in The matrix operation avoids the decision whether to extract odd rows of the existing matrix.

Further, in the embodiment of the present application, grammatically, when the MIP mode is restricted, the current block that satisfies the condition of Abs(Log2(cbWidth)-Log2(cbHeight))<=2) is allowed to perform MIP prediction, modify Only the current block that meets the condition of Abs(Log2(cbWidth)-Log2(cbHeight))<2) can use MIP mode.

It can be seen that, compared with the prior art, the brightness component prediction method proposed in this application can set all aspect ratios including 4×16 and 16×4 brightness blocks to 4, or the aspect ratio to 4. MIP mode is prohibited for the current block of, and predW and predH when MipSizeId is equal to 2, since the side length of the current luminance encoding must be greater than or equal to 8, there is no need to perform comparison operations and can be directly equal to 8. This change makes predW, predH and predC completely equal, so the syntax can be further simplified, using predC instead of all predW and predH in the MIP mode, that is, the size of the prediction matrix generated by the MIP mode is completely equal to the size of the matrix in the MIP, and there is no need Additional comparison.

Based on the brightness component prediction method from step 101 to step 105, in the embodiment of the present application, the encoder can reduce algorithm branches and syntax semantics, make the implementation of MIP technology more concise and unified, and reduce the complexity of the MIP mode. Specifically, Compared with the traditional luma intra prediction mode, the calculation complexity of the MIP mode is higher. In the prior art, MIP not only has more branches, but also requires more luma blocks for MIP prediction. In this application, all bandwidths can be removed. Brightness blocks with an aspect ratio greater than or equal to 4, or with an aspect ratio greater than or equal to 4, can specifically include 4×16, 8×32, 16×64, 16×4, 32×8, 64×16 brightness blocks, thereby saving time complexity.

Based on the foregoing embodiment, in another embodiment of the present application, FIG. 11 is a schematic diagram of the third implementation process of a luminance component prediction method proposed by an embodiment of the application. As shown in FIG. 11, the encoder is in accordance with the current block corresponding After the first side length and the second side length are calculated to obtain the size ratio, that is, after the above step 101, and before the brightness component prediction value corresponding to the current block is obtained according to the MIP list, that is, before step 103, the method for the encoder to perform the brightness component prediction is also It can include the following steps:

Step 106: If the size ratio is less than the preset ratio threshold, and the first side length and the second side length are not the first preset side length, construct the MIP list corresponding to the current block according to the preset prediction strategy.

In the embodiment of the present application, after the encoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, if the size ratio is less than the preset ratio threshold, at the same time, the first side length and the second side length If the length is not the first preset side length, the encoder can construct the MIP list corresponding to the current block according to the preset prediction strategy.

It should be noted that in the embodiment of the present application, the first preset side length is equal to 64.

Further, in the brightness component prediction method proposed by this application, when the MIP mode is restricted, if the size ratio of the current block is greater than or equal to 4, and the first side length or the second side length is 64, the MIP mode is not used to The current block is encoded. Table 12 is the third limitation of the brightness block size in the MIP mode in this application.

Table 12

As shown in Table 12, the brightness component prediction method proposed by this application can not only change 4×16, 16×4, 32×8, 8×32, 16×64, and 64× 16 Luminance blocks of these sizes are restricted to not perform MIP prediction, and the three types of luminance blocks of 64×32, 32×64, and 64×64 are also restricted to not perform MIP prediction. After this restriction, the prediction branch will be simplified, the syntax and semantics of the algorithm will be simplified, the time complexity will be reduced, and the memory will be saved.

Further, in the embodiment of the present application, after changing the restriction conditions of the MIP mode, that is, in the prior art, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the current block will not be processed through the MIP mode. The restriction condition for encoding the block is modified as the restriction condition in this application that if the size ratio of the current block is greater than or equal to 4, and the first side length or the second side length is 64, the current block is not encoded in the MIP mode After that, it can effectively solve the problem of excessively redundant logic branches in the MIP algorithm due to the existence of two size brightness blocks of 4×16 and 16×4. At the same time, because the obtained prediction blocks are all square, It is possible to avoid the determination of whether to extract odd rows of the existing matrix during matrix operations.

Further, in the embodiment of the present application, grammatically, when the MIP mode is restricted, the current block that satisfies the condition of Abs(Log2(cbWidth)-Log2(cbHeight))<=2) is allowed to perform MIP prediction, modify Only the current block that meets the condition of Abs(Log2(cbWidth)-Log2(cbHeight))<2)&&Log2(cbWidth)<6&&Log2(cbHeight)<6 can use MIP mode.

Fig. 12 is a fourth schematic diagram of the implementation process of a luminance component prediction method proposed by an embodiment of the application. As shown in Fig. 12, after the encoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, That is, after step 101 and before obtaining the predicted value of the luminance component corresponding to the current block according to the MIP list, that is, before step 103, the method for the encoder to predict the luminance component may further include the following steps:

Step 107: If the size ratio is less than or equal to the preset ratio threshold, and the first side length and the second side length are not the first preset side length, construct the MIP list corresponding to the current block according to the preset prediction strategy.

In the embodiment of the present application, after the encoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, if the size ratio is less than or equal to the preset ratio threshold, if the first side length Neither the second side length nor the second side length is the first preset side length, then the encoder can construct the MIP list corresponding to the current block according to the preset prediction strategy.

Further, in the brightness component prediction method proposed in this application, when the MIP mode is restricted, if the size ratio of the current block is greater than 4, and the first side length or the second side length is 64, the current block is not evaluated in the MIP mode. Encode. Table 13 is the limit 4 of the brightness block size in the MIP mode in this application. As shown in Table 13, the brightness component prediction method proposed by this application can not only change the 4×16 and 16× 4 The brightness block of these two sizes is limited to not perform MIP prediction, and it is also possible to limit the brightness block size of 64×32, 32×64, 16×64, 64×16 and 64×64 without MIP prediction. After this restriction, the prediction branch will be simplified, the syntax and semantics of the algorithm will be simplified, the time complexity will be reduced, and the memory will be saved.

Table 13

Further, in the embodiment of the present application, after changing the restriction conditions of the MIP mode, that is, in the prior art, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the current block will not be processed through the MIP mode. The restriction condition of block encoding is modified as the restriction condition in this application that if the size ratio of the current block is greater than 4, and the first side length or the second side length is 64, then the current block is not encoded in MIP mode. It can effectively solve the problem of excessively redundant logic branches in the MIP algorithm due to the existence of two size brightness blocks of 4×16 and 16×4. At the same time, because the obtained prediction blocks are all square, it can be used in The matrix operation avoids the decision whether to extract odd rows of the existing matrix.

Further, in the embodiment of the present application, grammatically, when the MIP mode is restricted, the current block that satisfies the condition of Abs(Log2(cbWidth)-Log2(cbHeight))<=2) is allowed to perform MIP prediction, modify To satisfy Abs(Log2(cbWidth)-Log2(cbHeight))<2)&&Log2(cbWidth)<6&&Log2(cbHeight)<6&&(Log2(cbWidth)!=4&&Log2(cbHeight)!=2)&&(Log2(cbWidth)! ＝2) &&Log2(cbHeight)! =4) Only the current block under the conditions can use the MIP mode.

Based on the luminance component prediction method from step 101 to step 107, in the embodiment of this application, the encoder can reduce algorithm branches and syntax and semantics, making the implementation of MIP technology more concise and unified. Specifically, the prior art needs to compare 4 The brightness blocks of ×16 and 16×4 are branched separately, but this application can reduce the number of judgments in the MIP prediction process, avoiding the need to extract odd rows before the matrix is multiplied, and the matrix can be unified The calculation method, and the generated prediction blocks are unified into square blocks, which reduces the probability by half.

FIG. 13 is a schematic diagram 5 of the implementation process of a luminance component prediction method proposed by an embodiment of the application, which is applied to a decoder, as shown in FIG. 13, in the embodiment of the application, the method for predicting the luminance component by the decoder can be Include the following steps.

Step 201: Calculate the size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio is set as the ratio of the first side length and the second side length ratio.

In the embodiment of the present application, the decoder may first calculate the size ratio corresponding to the current block according to the first side length and the second side length corresponding to the current block. Among them, the current block may represent the current block to be encoded or the current block to be decoded. Specifically, in the embodiment of the present application, when the decoder is performing decoding, the current block is the block to be decoded.

Step 202: If the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first preset size, analyze the code stream data corresponding to the current block according to the preset prediction strategy to obtain the MIP list and MIP list corresponding to the current block. Luminance component prediction value; among them, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode.

In the embodiment of the present application, after the decoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, if the size ratio is less than or equal to the preset ratio threshold, if the size of the current block is If the size is not the first preset size, the decoder can analyze the bitstream data corresponding to the current block according to the preset prediction strategy, so as to obtain the MIP list and the predicted value of the luminance component corresponding to the current block.

Further, in the implementation of this application, the preset ratio threshold is equal to 4, and at the same time, the first preset size is 4×16 and 16×4.

It should be noted that, in the embodiment of this application, when the decoder decodes the current block according to the MIP mode, it needs to first limit the size of the current block. Specifically, when the size ratio of the current block is less than or equal to 4. And when the size of the current block is not 4×16, and it is not 16×4 at the same time, the decoder will determine the brightness prediction of the current block according to the MIP mode.

Further, in the implementation of the present application, a size-dependent MIP mode prediction method, that is, a preset prediction strategy, can be preset, wherein the decoder can compare the current prediction strategy based on the preset prediction strategy characterizing the size-dependent MIP mode. The block performs brightness prediction, so that the corresponding MIP list can be obtained.

In the prior art, due to the existence of two size luma blocks of 4×16 and 16×4, the MIP algorithm will have some logic branches that are too redundant. Specifically, when the current block is 4×16, 4 will be generated. ×8 prediction blocks, 11 types; when the current block is 16×4, 8×4 prediction blocks will be generated, 11 types in total. For brightness blocks of two sizes, 4×16 and 16×4, the algorithm needs to determine whether to extract odd rows of the existing matrix during matrix operation, and it will also make the prediction block not all square.

Based on Table 6 above, in the prior art, when the MIP mode is restricted, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the current block is not decoded in the MIP mode. Furthermore, in the brightness component prediction method proposed by this application, when the MIP mode is restricted, if the size ratio of the current block is greater than 4, and the size of the current block is 4×16 and 16×4, the current block is not used in the MIP mode. The block is decoded. As shown in Table 9, the luminance component prediction method proposed by this application can restrict the luminance blocks of the two sizes of 4×16 and 16×4 from performing MIP prediction by changing the restriction conditions of the MIP mode. , It will simplify the prediction branch, simplify the syntax and semantics of the algorithm, reduce time complexity, and save memory.

Step 203: Obtain image data corresponding to the current block according to the MIP list and the predicted value of the brightness component.

In the embodiment of the present application, after the decoder parses the bitstream data corresponding to the current block according to the preset prediction strategy, and obtains the MIP list and the predicted value of the brightness component corresponding to the current block, it can then use the MIP list and the predicted value of the brightness component to obtain, Obtain the image data corresponding to the current block.

Based on the luminance component prediction method from step 201 to step 203, in the embodiment of the present application, the decoder can reduce algorithm branches and syntax semantics, making the implementation of MIP technology more concise and unified, and reducing the complexity of the MIP mode. Specifically, Compared with the traditional luma intra prediction mode, the calculation complexity of the MIP mode is higher. In the prior art, MIP not only has more branches, but also requires more luma blocks for MIP prediction. In this application, all bandwidths can be removed. Brightness blocks with an aspect ratio greater than or equal to 4, or with an aspect ratio greater than or equal to 4, can specifically include 4×16, 8×32, 16×64, 16×4, 32×8, 64×16 brightness blocks, thereby saving time complexity.

Further, in the implementation of the present application, the decoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, that is, after the above step 201, and obtains according to the MIP list and the predicted value of the luminance component Before the image data corresponding to the current block, that is, before step 203, the method for the decoder to predict the luminance component may further include the following steps:

Step 204: If the size ratio is less than the preset ratio threshold, analyze the code stream data corresponding to the current block according to the preset prediction strategy to obtain the MIP list and the brightness component prediction value corresponding to the current block.

In the embodiment of the present application, after the decoder obtains the size ratio according to the first side length and the second side length corresponding to the current block, if the size ratio is less than the preset ratio threshold, the decoder can analyze according to the preset prediction strategy The code stream data corresponding to the current block obtains the MIP list and the predicted value of the luminance component corresponding to the current block.

Based on the above Table 6, in the prior art, when the MIP mode is restricted, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the current block is not decoded in the MIP mode. Further, in the brightness component prediction method proposed in this application, when the MIP mode is restricted, if the aspect ratio of the current block is greater than or equal to 4, or the aspect ratio is greater than or equal to 4, the current block is not evaluated in the MIP mode. To decode. As shown in Table 11, the brightness component prediction method proposed by this application can not only restrict the brightness blocks of the two sizes of 4×16 and 16×4 from MIP prediction by changing the restriction conditions of the MIP mode, but also The brightness blocks of four sizes of 32×8, 8×32, 16×64, and 64×16 are restricted from performing MIP prediction. After this restriction, the prediction branch will be simplified, the syntax and semantics of the algorithm will be simplified, the time complexity will be reduced, and the memory will be saved.

Step 205: If the size ratio is less than the preset ratio threshold, and the first side length and the second side length are not the first preset side length, analyze the code stream data corresponding to the current block according to the preset prediction strategy to obtain the current block corresponding The MIP list and the predicted value of the luminance component.

In the embodiment of the present application, after the decoder calculates the size ratio according to the first side length and the second side length corresponding to the current block, if the size ratio is less than the preset ratio threshold, at the same time, the first side length and the second side length If the length is not the first preset side length, then the encoder can parse the code stream data corresponding to the current block according to the preset prediction strategy to obtain the MIP list and the brightness component prediction value corresponding to the current block. Wherein, the first preset side length is equal to 64.

Further, in the brightness component prediction method proposed by this application, when the MIP mode is restricted, if the size ratio of the current block is greater than or equal to 4, and the first side length or the second side length is 64, the MIP mode is not used to The current block is decoded. As shown in Table 12, the brightness component prediction method proposed by this application can not only change 4×16, 16×4, 32×8, 8×32, 16×64, and 64× 16 Luminance blocks of these sizes are restricted to not perform MIP prediction, and the three types of luminance blocks of 64×32, 32×64, and 64×64 are also restricted to not perform MIP prediction. After this restriction, the prediction branch will be simplified, the syntax and semantics of the algorithm will be simplified, the time complexity will be reduced, and the memory will be saved.

Step 206: If the size ratio is less than or equal to the preset ratio threshold, and the first side length and the second side length are not the first preset side length, analyze the code stream data corresponding to the current block according to the preset prediction strategy to obtain the current The MIP list corresponding to the block and the predicted value of the luminance component.

In the embodiment of the present application, after the decoder calculates the size ratio according to the first side length and the second side length corresponding to the current block, if the size ratio is less than or equal to the preset ratio threshold, at the same time, the first side length and the second side length Both side lengths are not the first preset side length, then the encoder can parse the code stream data corresponding to the current block according to the preset prediction strategy to obtain the MIP list and the brightness component prediction value corresponding to the current block.

Further, in the brightness component prediction method proposed in this application, when the MIP mode is restricted, if the size ratio of the current block is greater than 4, and the first side length or the second side length is 64, the current block is not evaluated in the MIP mode. To decode. As shown in Table 13, the brightness component prediction method proposed by this application can not only restrict the brightness blocks of the two sizes of 4×16 and 16×4 from performing MIP prediction, but also by changing the restriction conditions of the MIP mode. For the five types of luminance blocks of 64×32, 32×64, 16×64, 64×16, and 64×64, MIP prediction is not restricted. After this restriction, the prediction branch will be simplified, the syntax and semantics of the algorithm will be simplified, the time complexity will be reduced, and the memory will be saved.

Based on the luminance component prediction method from step 201 to step 206, in the embodiment of the present application, the decoder can reduce algorithm branches and syntax and semantics, so that the implementation of MIP technology is more concise and unified. Specifically, in the prior art, 4 The brightness blocks of ×16 and 16×4 are branched separately, but this application can reduce the number of judgments in the MIP prediction process, avoiding the need to extract odd rows before the matrix is multiplied, and the matrix can be unified The calculation method, and the generated prediction blocks are unified into square blocks, which reduces the probability by half.

In the brightness component prediction method proposed in the embodiment of the application, the decoder calculates the size ratio according to the first side length and the second side length corresponding to the current block; if the size ratio is less than or equal to the preset ratio threshold, and the size of the current block If the size is not the first preset size, the bitstream data corresponding to the current block is analyzed according to the preset prediction strategy to obtain the MIP list and the predicted value of the brightness component corresponding to the current block; according to the MIP list and the predicted value of the brightness component, the data corresponding to the current block is obtained Image data. That is to say, in the embodiment of the present application, when the encoder encodes the current block, it can perform brightness prediction in the size-dependent MIP mode according to the first side length and the second side length corresponding to the current block. Specifically, Except for the current block whose size ratio is greater than or equal to 4, the current block whose size is 4×16 and 16×4 is forbidden to use MIP mode; accordingly, the decoder can also use MIP mode after obtaining the bitstream data of the current block. Corresponding to the first side length and the second side length, the size-dependent MIP mode is used for brightness prediction, which can simplify the MIP prediction process, reduce the complexity and reduce the complexity of the coding and decoding process while ensuring the coding and decoding performance. The required storage space and overall time can effectively improve the coding and decoding efficiency.

Based on the foregoing embodiment, in another embodiment of the present application, FIG. 14 is a schematic diagram 1 of the composition structure of the encoder proposed in the embodiment of the application. As shown in FIG. 14, the encoder 300 proposed in the embodiment of the present application may include a first An acquisition part 301, a construction part 302 and an encoding part 303.

The first acquiring part 301 is configured to calculate the size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio is set Is the ratio of the first side length to the second side length.

The constructing part 302 is configured to construct a base corresponding to the current block according to a preset prediction strategy if the size ratio is less than or equal to a preset ratio threshold and the size of the current block is not the first preset size. Matrix intra-frame prediction MIP list; wherein the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode.

The first obtaining part 301 is further configured to obtain the predicted value of the luminance component corresponding to the current block according to the MIP list.

The encoding part 303 is configured to perform encoding processing on the current block according to the MIP list and the predicted value of the luminance component to obtain code stream data corresponding to the current block.

Further, in the embodiment of the present application, the construction part 302 is further configured to calculate the size ratio according to the first side length and the second side length corresponding to the current block, and according to the MIP list Before obtaining the prediction value of the brightness component corresponding to the current block, if the size ratio is less than a preset ratio threshold, construct a MIP list corresponding to the current block according to the preset prediction strategy.

Further, in the embodiment of the present application, the construction part 302 is further configured to calculate the size ratio according to the first side length and the second side length corresponding to the current block, and according to the MIP list Before obtaining the predicted value of the brightness component corresponding to the current block, if the size ratio is less than a preset ratio threshold, and the first side length and the second side length are not the first preset side length, then The preset prediction strategy constructs a MIP list corresponding to the current block.

Further, in the embodiment of the present application, the construction part 302 is further configured to calculate the size ratio according to the first side length and the second side length corresponding to the current block, and according to the MIP list Before obtaining the predicted value of the brightness component corresponding to the current block, if the size ratio is less than or equal to a preset ratio threshold, and the first side length and the second side length are not the first preset side length, then Constructing the MIP list corresponding to the current block according to the preset prediction strategy.

Further, in the embodiment of the present application, the first obtaining part 301 is further configured to obtain the upper phase corresponding to the current block before constructing the MIP list corresponding to the current block according to the preset prediction strategy. A first prediction mode of a neighboring luminance block; and obtaining a second prediction mode of a left neighboring luminance block corresponding to the current block.

Further, in the embodiment of the present application, the construction part 302 is specifically configured to, if the size of the current block is a second preset size, according to the first prediction mode, the second prediction mode, and 35 types The MIP mode constructs the MIP list.

Further, in the embodiment of the present application, the construction part 302 is further specifically configured to, if the size of the current block is a third preset size, perform according to the first prediction mode and the second prediction mode And 19 kinds of MIP modes construct the MIP list.

Further, in the embodiment of the present application, the structure part 302 is also specifically configured to perform according to the first side length and the second side length greater than the second preset side length. The prediction mode, the second prediction mode, and the 11 MIP modes construct the MIP list.

Further, in the embodiment of the present application, the preset ratio threshold is equal to 4; the first preset size is 4×16 and 16×4; the first preset side length is equal to 64; The second preset size is 4×4; the third preset size is 4×8, 8×4, or 8×8; the second preset side length is equal to 8.

FIG. 15 is a second schematic diagram of the composition structure of the encoder proposed in the embodiment of the application. As shown in FIG. 15, the encoder 300 proposed in the embodiment of the application may further include a first processor 304, and store the first processor 304 to execute The first memory 305 of instructions, the first communication interface 306, and the first bus 307 for connecting the first processor 304, the first memory 305, and the first communication interface 306.

Further, in the embodiment of the present application, the above-mentioned first processor 304 is configured to calculate the size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to Second side length, the size ratio is set to the ratio of the first side length to the second side length; if the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first A preset size, the matrix-based intra prediction MIP list corresponding to the current block is constructed according to a preset prediction strategy; wherein, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode; The MIP list obtains the predicted value of the brightness component corresponding to the current block; and the encoding process is performed on the current block according to the MIP list and the predicted value of the brightness component to obtain the code stream data corresponding to the current block.

In addition, the functional modules in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be realized in the form of hardware or software function module.

If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or correct The part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal A computer, a server, or a network device, etc.) or a processor (processor) execute all or part of the steps of the method in this embodiment. The aforementioned storage media include: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.

The embodiment of the present application provides an image encoder, which calculates the size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio is Set to the ratio of the first side length to the second side length; if the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first preset size, then the current block based on the preset prediction strategy is constructed. Matrix intra prediction MIP list; among them, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode; obtain the brightness component prediction value corresponding to the current block according to the MIP list; compare the current block according to the MIP list and the brightness component prediction value Perform encoding processing to obtain code stream data corresponding to the current block. That is to say, in the embodiment of the present application, when the encoder encodes the current block, it can perform brightness prediction in the size-dependent MIP mode according to the first side length and the second side length corresponding to the current block. Specifically, Except for the current block whose size ratio is greater than or equal to 4, the current block whose size is 4×16 and 16×4 is forbidden to use MIP mode; accordingly, the decoder can also use MIP mode after obtaining the bitstream data of the current block. Corresponding to the first side length and the second side length, the size-dependent MIP mode is used for brightness prediction, which can simplify the MIP prediction process, reduce the complexity and reduce the complexity of the coding and decoding process while ensuring the coding and decoding performance. The required storage space and overall time can effectively improve the coding and decoding efficiency.

Based on the foregoing embodiment, in another embodiment of the present application, FIG. 16 is a first schematic diagram of the composition structure of the decoder proposed in this embodiment of the application. As shown in FIG. 16, the decoder 400 proposed in this embodiment of the application may include a first Second, the acquisition part 401 and the decoding part 402.

The second acquiring part 401 is configured to calculate a size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size The ratio is set as the ratio of the first side length to the second side length.

The decoding part 402 is configured to analyze the code corresponding to the current block according to the preset prediction strategy if the size ratio is less than or equal to a preset ratio threshold and the size of the current block is not the first preset size Stream data to obtain the MIP list and the brightness component prediction value corresponding to the current block; wherein the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode.

The second obtaining part 401 is further configured to obtain image data corresponding to the current block according to the MIP list and the predicted value of the brightness component.

Further, in the embodiment of the present application, the decoding part 402 is further configured to calculate the size ratio according to the first side length and the second side length corresponding to the current block, and according to the MIP list And the brightness component prediction value, before obtaining the image data corresponding to the current block, if the size ratio is less than a preset ratio threshold, the bitstream data is parsed according to the preset prediction strategy to obtain the current block The corresponding MIP list and the predicted value of the luminance component.

Further, in the embodiment of the present application, the decoding part 402 is further configured to calculate the size ratio according to the first side length and the second side length corresponding to the current block, and according to the MIP list And the predicted value of the brightness component, before obtaining the image data corresponding to the current block, if the size ratio is less than a preset ratio threshold, the first side length and the second side length are not the first preset Side length, the code stream data is analyzed according to the preset prediction strategy to obtain the MIP list and the brightness component prediction value corresponding to the current block.

Further, in the embodiment of the present application, the decoding part 402 is further configured to calculate the size ratio according to the first side length and the second side length corresponding to the current block, and according to the MIP list And the brightness component prediction value, before obtaining the image data corresponding to the current block, if the size ratio is less than or equal to a preset ratio threshold, the first side length and the second side length are not the first If the side length is preset, the code stream data is analyzed according to the preset prediction strategy to obtain the MIP list and the brightness component prediction value corresponding to the current block.

Further, in the embodiment of the present application, the preset ratio threshold is equal to 4; the first preset size is 4×16 and 16×4; the first preset side length is equal to 64.

FIG. 17 is a second schematic diagram of the composition structure of the decoder proposed in the embodiment of the application. As shown in FIG. 17, the decoder 400 proposed in the embodiment of the present application may further include a second processor 403, which stores a second processor 403 for executable The second memory 404 of instructions, the second communication interface 405, and the second bus 406 for connecting the second processor 403, the second memory 404, and the second communication interface 405.

Further, in the embodiment of the present application, the above-mentioned second processor 403 is configured to calculate the size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than Or equal to the second side length, the size ratio is set to the ratio of the first side length to the second side length; if the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not Is the first preset size, the code stream data corresponding to the current block is parsed according to the preset prediction strategy to obtain the MIP list and the brightness component prediction value corresponding to the current block; wherein, the preset prediction strategy is used to The size-dependent MIP mode performs brightness prediction; according to the MIP list and the brightness component prediction value, the image data corresponding to the current block is obtained.

The embodiment of the application provides an image decoder, which calculates the size ratio according to the first side length and the second side length corresponding to the current block; if the size ratio is less than or equal to the preset ratio threshold, and the size of the current block If the size is not the first preset size, the bitstream data corresponding to the current block is analyzed according to the preset prediction strategy to obtain the MIP list and the predicted value of the brightness component corresponding to the current block; according to the MIP list and the predicted value of the brightness component, the data corresponding to the current block is obtained Image data. That is to say, in the embodiment of the present application, when the encoder encodes the current block, it can perform brightness prediction in the size-dependent MIP mode according to the first side length and the second side length corresponding to the current block. Specifically, Except for the current block whose size ratio is greater than or equal to 4, the current block whose size is 4×16 and 16×4 is forbidden to use MIP mode; accordingly, the decoder can also use MIP mode after obtaining the bitstream data of the current block. Corresponding to the first side length and the second side length, the size-dependent MIP mode is used for brightness prediction, which can simplify the MIP prediction process, reduce the complexity and reduce the complexity of the coding and decoding process while ensuring the coding and decoding performance. The required storage space and overall time can effectively improve the coding and decoding efficiency.

The embodiments of the present application provide a computer-readable storage medium and a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the method as described in the foregoing embodiment is implemented.

Specifically, the program instructions corresponding to a luminance component prediction method in this embodiment can be stored on storage media such as optical disks, hard disks, USB flash drives, etc., when the program instructions corresponding to a luminance component prediction method in the storage medium When being read or executed by an electronic device, it includes the following steps:

Specifically, the program instructions corresponding to a luminance component prediction method in this embodiment can be stored on storage media such as optical disks, hard disks, USB flash drives, etc., when the program instructions corresponding to a luminance component prediction method in the storage medium When being read by an electronic device or executed, it also includes the following steps:

Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of hardware embodiments, software embodiments, or embodiments combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.

This application is described with reference to the schematic diagrams and/or block diagrams of the implementation process of the method, equipment (system), and computer program product according to the embodiments of the application. It should be understood that computer program instructions can be used to implement each process and/or block in the schematic flow diagram and/or block diagram, and to implement a combination of processes and/or blocks in the schematic flow diagram and/or block diagram. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated A device for realizing the functions specified in one or more processes in the schematic flow chart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device realizes the functions specified in one or more processes in the schematic diagram and/or one block or more in the block diagram.

These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing functions specified in one or more processes in the schematic diagram and/or one block or more in the block diagram.

The above are only the preferred embodiments of the present application, and are not used to limit the protection scope of the present application.

Industrial applicability

Claims

A method for predicting luminance components, applied to an encoder, the method including:

The size ratio is calculated according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio is set as the first side length and the second side length The ratio of the length of the second side;

If the size ratio is less than or equal to a preset ratio threshold, and the size of the current block is not the first preset size, constructing a matrix-based intra prediction MIP list corresponding to the current block according to the preset prediction strategy; Wherein, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode;

Acquiring, according to the MIP list, the predicted value of the luminance component corresponding to the current block;

Perform encoding processing on the current block according to the MIP list and the predicted value of the brightness component to obtain code stream data corresponding to the current block.
The method according to claim 1, wherein after the calculating the size ratio according to the first side length and the second side length corresponding to the current block, and the obtaining the corresponding value of the current block according to the MIP list Before the luminance component prediction value, the method further includes:

If the size ratio is less than the preset ratio threshold, construct the MIP list corresponding to the current block according to the preset prediction strategy.
The method according to claim 1, wherein after the calculating the size ratio according to the first side length and the second side length corresponding to the current block, and the obtaining the corresponding value of the current block according to the MIP list Before the luminance component prediction value, the method further includes:

If the size ratio is less than the preset ratio threshold, and the first side length and the second side length are not the first preset side length, the current block corresponding to the current block is constructed according to the preset prediction strategy List of MIPs.
The method according to claim 1, wherein after the calculating the size ratio according to the first side length and the second side length corresponding to the current block, and the obtaining the corresponding value of the current block according to the MIP list Before the luminance component prediction value, the method further includes:

If the size ratio is less than or equal to the preset ratio threshold, and the first side length and the second side length are not the first preset side length, then the current is constructed according to the preset prediction strategy The MIP list corresponding to the block.
The method according to any one of claims 1 to 4, wherein before the constructing the MIP list corresponding to the current block according to the preset prediction strategy, the method further comprises:

Acquiring the first prediction mode of the upper neighboring luminance block corresponding to the current block;

Acquire the second prediction mode of the left neighboring luminance block corresponding to the current block.
The method according to claim 5, wherein the constructing the MIP list corresponding to the current block according to the preset prediction strategy comprises:

If the size of the current block is the second preset size, the MIP list is constructed according to the first prediction mode, the second prediction mode, and 35 MIP modes.
The method according to claim 5, wherein the constructing the MIP list corresponding to the current block according to the preset prediction strategy comprises:

If the size of the current block is the third preset size, the MIP list is constructed according to the first prediction mode, the second prediction mode, and 19 MIP modes.
The method according to claim 5, wherein the constructing the MIP list corresponding to the current block according to the preset prediction strategy comprises:

If the first side length and the second side length are both greater than the second preset side length, the MIP list is constructed according to the first prediction mode, the second prediction mode, and 11 MIP modes.
The method according to any one of claims 1 to 8, wherein:

The preset ratio threshold is equal to 4;

The first preset size is 4×16 and 16×4;

The first preset side length is equal to 64;

The second preset size is 4×4;

The third preset size is 4×8, 8×4 or 8×8;

The second preset side length is equal to 8.
A method for predicting luminance components, applied to a decoder, the method including:

The size ratio is calculated according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio is set as the first side length and the second side length The ratio of the second side length;

If the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first preset size, then the code stream data corresponding to the current block is parsed according to the preset prediction strategy to obtain the current block Corresponding MIP list and brightness component prediction values; wherein, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode;

Obtain image data corresponding to the current block according to the MIP list and the predicted value of the brightness component.
10. The method according to claim 10, wherein after said calculating the size ratio according to the first side length and the second side length corresponding to the current block, and the predicting value according to the MIP list and the brightness component Before obtaining the image data corresponding to the current block, the method further includes:

If the size ratio is less than the preset ratio threshold, the bitstream data is parsed according to the preset prediction strategy to obtain the MIP list and the brightness component prediction value corresponding to the current block.
10. The method according to claim 10, wherein after said calculating the size ratio according to the first side length and the second side length corresponding to the current block, and the predicting value according to the MIP list and the brightness component Before obtaining the image data corresponding to the current block, the method further includes:

If the size ratio is less than the preset ratio threshold, and the first side length and the second side length are not the first preset side length, then the code stream data is parsed according to the preset prediction strategy To obtain the MIP list and the predicted value of the luminance component corresponding to the current block.
10. The method according to claim 10, wherein after said calculating the size ratio according to the first side length and the second side length corresponding to the current block, and the predicting value according to the MIP list and the brightness component Before obtaining the image data corresponding to the current block, the method further includes:

If the size ratio is less than or equal to the preset ratio threshold, and the first side length and the second side length are not the first preset side length, then the code is parsed according to the preset prediction strategy Stream data to obtain the MIP list and the predicted value of the luminance component corresponding to the current block.
The method according to any one of claims 10 to 13, wherein:

The preset ratio threshold is equal to 4;

The first preset size is 4×16 and 16×4;

The first preset side length is equal to 64.
An encoder comprising: a first acquisition part, a construction part and an encoding part,

The first acquiring part is configured to calculate a size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio is set to The ratio of the first side length to the second side length;

The construction part is configured to construct a matrix-based matrix corresponding to the current block according to a preset prediction strategy if the size ratio is less than or equal to a preset ratio threshold, and the size of the current block is not a first preset size Intra-frame prediction MIP list; wherein, the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode;

The first obtaining part is further configured to obtain the predicted value of the luminance component corresponding to the current block according to the MIP list;

The coding part is configured to perform coding processing on the current block according to the MIP list and the predicted value of the luminance component to obtain code stream data corresponding to the current block.
The encoder according to claim 15, wherein:

The construction part is further configured after the size ratio is calculated according to the first side length and the second side length corresponding to the current block, and before the brightness component prediction value corresponding to the current block is obtained according to the MIP list If the size ratio is less than the preset ratio threshold, construct the MIP list corresponding to the current block according to the preset prediction strategy.
The encoder according to claim 15, wherein:

The construction part is further configured after the size ratio is calculated according to the first side length and the second side length corresponding to the current block, and before the brightness component prediction value corresponding to the current block is obtained according to the MIP list If the size ratio is less than the preset ratio threshold, and the first side length and the second side length are not 64, the MIP list corresponding to the current block is constructed according to the preset prediction strategy.
The encoder according to claim 15, wherein:

The construction part is further configured after the size ratio is calculated according to the first side length and the second side length corresponding to the current block, and before the brightness component prediction value corresponding to the current block is obtained according to the MIP list , If the size ratio is less than or equal to the preset ratio threshold, and the first side length and the second side length are not the first preset side length, then the structure is constructed according to the preset prediction strategy The MIP list corresponding to the current block.
The encoder according to any one of claims 15 to 18, wherein:

The preset ratio threshold is equal to 4;

The first preset size is 4×16 and 16×4;

The first preset side length is equal to 64.
A decoder, the encoder includes: a second acquisition part and a decoding part,

The second acquiring part is configured to calculate a size ratio according to the first side length and the second side length corresponding to the current block; wherein, the first side length is greater than or equal to the second side length, and the size ratio Set as the ratio of the first side length to the second side length;

The decoding part is configured to, if the size ratio is less than or equal to the preset ratio threshold, and the size of the current block is not the first preset size, then parse the current block corresponding to the preset prediction strategy. Code stream data to obtain the MIP list and the brightness component prediction value corresponding to the current block; wherein the preset prediction strategy is used for brightness prediction based on the size-dependent MIP mode;

The second obtaining part is further configured to obtain image data corresponding to the current block according to the MIP list and the predicted value of the brightness component.
The decoder according to claim 20, wherein:

The decoding part is further configured to obtain the size ratio according to the first side length and the second side length corresponding to the current block, and the current block is obtained according to the MIP list and the predicted value of the brightness component. Before the image data corresponding to the block, if the size ratio is less than the preset ratio threshold, the bitstream data is parsed according to the preset prediction strategy to obtain the MIP list and the brightness component prediction value corresponding to the current block.
The decoder according to claim 20, wherein:

The decoding part is further configured to obtain the size ratio according to the first side length and the second side length corresponding to the current block, and the current block is obtained according to the MIP list and the predicted value of the brightness component. Before the image data corresponding to the block, if the size ratio is less than the preset ratio threshold, and the first side length and the second side length are not the first preset side length, then according to the preset prediction The strategy parses the code stream data to obtain the MIP list and the predicted value of the luminance component corresponding to the current block.
The decoder according to claim 20, wherein:

The decoding part is further configured to obtain the size ratio according to the first side length and the second side length corresponding to the current block, and the current block is obtained according to the MIP list and the predicted value of the brightness component. Before the image data corresponding to the block, if the size ratio is less than or equal to the preset ratio threshold, and the first side length and the second side length are not the first preset side length, then according to the preset It is assumed that the prediction strategy parses the code stream data to obtain the MIP list and the predicted value of the luminance component corresponding to the current block.
The decoder according to any one of claims 20 to 23, wherein:

The preset ratio threshold is equal to 4;

The first preset size is 4×16 and 16×4;

The first preset side length is equal to 64.
An encoder includes a first processor, a first memory storing executable instructions of the first processor, a first communication interface, and a first communication interface for connecting the first processor and the first processor. A memory and the first bus of the first communication interface, when the instruction is executed by the first processor, implement the method according to any one of claims 1-9.
A decoder including a second processor, a second memory storing executable instructions of the second processor, a second communication interface, and a second communication interface for connecting the second processor and the second processor. The second memory and the second bus of the second communication interface, when the instruction is executed by the second processor, implement the method according to any one of claims 10-14.
A computer-readable storage medium with a program stored thereon and applied to an encoder and a decoder. When the program is executed by a processor, the method according to any one of claims 1-14 is realized.