WO2020258010A1 - 图像编解码方法、编码器、解码器以及存储介质 - Google Patents

图像编解码方法、编码器、解码器以及存储介质 Download PDF

Info

Publication number
WO2020258010A1
WO2020258010A1 PCT/CN2019/092689 CN2019092689W WO2020258010A1 WO 2020258010 A1 WO2020258010 A1 WO 2020258010A1 CN 2019092689 W CN2019092689 W CN 2019092689W WO 2020258010 A1 WO2020258010 A1 WO 2020258010A1
Authority
WO
WIPO (PCT)
Prior art keywords
modified
offset
matrix
initial
mip mode
Prior art date
Application number
PCT/CN2019/092689
Other languages
English (en)
French (fr)
Inventor
万帅
霍俊彦
马彦卓
杨付正
郭锦坤
王海鑫
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to PCT/CN2019/092689 priority Critical patent/WO2020258010A1/zh
Priority to KR1020217016992A priority patent/KR20220023324A/ko
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Priority to BR112021006724A priority patent/BR112021006724A2/pt
Priority to CA3208670A priority patent/CA3208670A1/en
Priority to JP2021568185A priority patent/JP7448563B2/ja
Priority to CN201980048358.2A priority patent/CN112514381A/zh
Priority to ES19935158T priority patent/ES2950980T3/es
Priority to SG11202102562WA priority patent/SG11202102562WA/en
Priority to CN202210766458.2A priority patent/CN115150612A/zh
Priority to MX2021004541A priority patent/MX2021004541A/es
Priority to CN202110310256.2A priority patent/CN113068032B/zh
Priority to AU2019455073A priority patent/AU2019455073A1/en
Priority to EP23170496.6A priority patent/EP4228256A1/en
Priority to EP19935158.6A priority patent/EP3820151B1/en
Priority to CA3112849A priority patent/CA3112849C/en
Priority to IL281400A priority patent/IL281400B2/en
Priority to PL19935158.6T priority patent/PL3820151T3/pl
Priority to IL309549A priority patent/IL309549A/en
Publication of WO2020258010A1 publication Critical patent/WO2020258010A1/zh
Priority to PH12021550517A priority patent/PH12021550517A1/en
Priority to ZA2021/01697A priority patent/ZA202101697B/en
Priority to US17/211,636 priority patent/US11146798B2/en
Priority to US17/382,932 priority patent/US20210352298A1/en
Priority to JP2024030632A priority patent/JP2024059922A/ja

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/11Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F5/00Methods or arrangements for data conversion without changing the order or content of the data handled
    • G06F5/01Methods or arrangements for data conversion without changing the order or content of the data handled for shifting, e.g. justifying, scaling, normalising
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/184Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques

Definitions

  • the embodiments of the present application relate to the technical field of video coding and decoding, and in particular, to an image coding and decoding method, an encoder, a decoder, and a storage medium.
  • MIP Matrix-based Intra Prediction
  • VVC Versatile Video Coding
  • MIP is based on neural
  • the intra-frame prediction technology of the network uses a multilayer neural network to predict the brightness value of the current block based on the adjacent reconstructed brightness block.
  • the input of MIP prediction is also the data of the adjacent brightness block in the previous row and the left column of the current block, and the output is the brightness component prediction value of the current block.
  • the specific prediction process is divided into three steps: downsampling, matrix vector multiplication and interpolation.
  • the parameters used by brightness blocks of different sizes may also be different. Therefore, a large storage space is required to store a large number of parameters, and the search and call of parameters during the prediction process are also different. Increase the overall time, thereby reducing the coding and decoding efficiency.
  • the embodiments of the present application provide an image encoding and decoding method, encoder, decoder, and storage medium, which can reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance, and effectively improve the encoding and decoding process. Decoding efficiency.
  • the embodiment of the present application provides an image coding method applied to an encoder, and the method includes:
  • the initial right shift parameters corresponding to different sizes and different MIP mode numbers are uniformly modified according to the offset parameters; wherein, the offset parameter is used for the right shift number of the predicted value Give instructions; and,
  • the embodiment of the application provides an image decoding method applied to a decoder, and the method includes:
  • the initial right shift parameters corresponding to different sizes and different MIP mode numbers are uniformly modified according to the offset parameters; wherein, the offset parameter is used for the right shift number of the predicted value Give instructions; and,
  • the decoding process is performed according to the MIP mode
  • the decoding process is performed according to the offset parameter.
  • the embodiment of the present application provides an encoder, the encoder includes: a first modification part and an encoding part,
  • the first modification part is configured to uniformly modify the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to offset parameters before encoding processing according to the MIP mode; wherein, the offset parameters are To indicate the right shift number of the predicted value;
  • the coding part is configured to perform coding processing according to the offset parameter when performing coding processing according to the MIP mode.
  • the embodiment of the present application provides a decoder, and the decoder includes: a second modification part and a decoding part,
  • the second modification part is configured to uniformly modify the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters before decoding processing according to the MIP mode; wherein the offset parameters are To indicate the right shift number of the predicted value;
  • the encoding part is configured to perform decoding processing according to the offset parameter when performing decoding processing according to the MIP mode.
  • An embodiment of the present application provides an encoder.
  • the encoder includes a first processor, a first memory storing executable instructions of the first processor, a first communication interface, and a first communication interface for connecting to the first processor.
  • An embodiment of the application provides a decoder, the decoder includes a second processor, a second memory storing executable instructions of the second processor, a second communication interface, and a second communication interface for connecting the second processor.
  • the embodiment of the present application provides a computer-readable storage medium with a program stored thereon and applied to an encoder and a decoder.
  • the program is executed by a processor, the image encoding and decoding method described above is implemented.
  • the embodiments of the present application provide an image encoding and decoding method, an encoder, a decoder, and a storage medium.
  • the encoder Before encoding according to the MIP mode, the encoder performs an offset parameter on the initial right corresponding to different sizes and different MIP mode numbers.
  • the shift parameter is uniformly modified; wherein, the offset parameter is used to indicate the right shift number of the predicted value; and, when the encoding process is performed according to the MIP mode, the encoding process is performed according to the offset parameter.
  • the decoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters; and, when performing decoding according to the MIP mode, according to the offset parameters Perform decoding processing.
  • the image coding and decoding method proposed in this application uses the offset parameter to uniformly modify the right shift number of the predicted value, so that all luminance blocks of different sizes and different MIP mode numbers have the same sW value, thereby
  • the sW value can reduce the complexity of the MIP algorithm, and can reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance. Effectively improve coding and decoding efficiency.
  • Figure 1 is a schematic diagram of the arrangement of 67 prediction modes in intra prediction
  • Figure 2 is a schematic flow chart of encoding in MIP mode
  • FIG. 3 is a schematic diagram of the arrangement of the adjacent brightness block on the upper side and the adjacent brightness block on the left side of the current block;
  • Figure 4 is a schematic diagram of the arrangement of determining the DM mode
  • Figure 5 is a schematic diagram of the structure of a video encoding system
  • Figure 6 is a schematic structural diagram of a video decoding system
  • FIG. 7 is a schematic diagram 1 of the implementation process of an image coding method proposed by an embodiment of this application.
  • FIG. 8 is a second schematic diagram of the implementation process of an image coding method proposed by an embodiment of this application.
  • FIG. 9 is a schematic diagram 1 of the implementation process of an image decoding method proposed by an embodiment of this application.
  • FIG. 10 is a second schematic diagram of the implementation process of an image decoding method proposed by an embodiment of this application.
  • FIG. 11 is a schematic diagram 1 of the composition structure of an encoder proposed in an embodiment of the application.
  • FIG. 12 is a second schematic diagram of the composition structure of the encoder proposed in an embodiment of the application.
  • FIG. 13 is a schematic diagram 1 of the composition structure of a decoder proposed in an embodiment of the application.
  • FIG. 14 is a second schematic diagram of the composition structure of the decoder proposed in an embodiment of the application.
  • VVC accepted the ray-like weighted intra prediction technology (Affine Linear Weighted Intra Prediction) proposed in the Joint Video Experts Team (JVET)-N0217, and changed its name to matrix-based intra prediction , Namely MIP technology, this technology adds a different number of matrix-based intra prediction modes in the intra-frame brightness prediction process according to the different sizes of intra-frame luminance coding blocks.
  • JVET Joint Video Experts Team
  • VVC expands the 33 kinds of intra-frame luminance prediction angle modes defined in the video compression standard (High Efficiency Video Coding, HEVC) to 65 kinds.
  • Figure 1 shows the intra-frame prediction.
  • these 67 prediction modes are referred to as traditional intra prediction modes.
  • MIP is an intra-frame prediction technology based on neural networks, which uses a multilayer neural network to predict the brightness value of the current block based on adjacent reconstructed pixels. Specifically, the MIP technology divides the brightness coding blocks into three categories according to the size of the brightness coding block in the frame. Set the size of the brightness coding block as W ⁇ H, where W is the width parameter and H is the height parameter, according to the size of the brightness coding block Luma coding blocks can be divided into three categories:
  • Luminance coding blocks with a size of 4 ⁇ 4 belong to the first type of luminance block
  • 8 ⁇ 4, 4 ⁇ 8 and 8 ⁇ 8 luminance coding blocks are classified as the second type of luminance block
  • other sizes of luminance coding blocks belong to the third type. Brightness block.
  • MIP technology adds M types of MIP modes on the basis of 67 traditional intra-frame prediction modes.
  • M 35
  • M 11.
  • MIP technology is only applied to intra-frame brightness prediction.
  • the input of MIP prediction is also the previous row and left column of the current block, and the output is the predicted value of the current block.
  • the specific prediction process is divided into three Steps: averaging, matrix vector multiplication and interpolation. In other words, by performing these three operations on the input reconstructed brightness values of the adjacent pixels in the upper row and the left column, the predicted value of the brightness component of the current block can be obtained.
  • FIG. 2 is a schematic flow chart of encoding in MIP mode. As shown in Figure 2, the specific implementation of brightness prediction in MIP mode is as follows:
  • Step 1 Perform averaging operation on the adjacent reference points on the upper side of the current block to obtain the vector bdry top with a total of N values; perform averaging operation on the adjacent reference points on the left side of the current block to obtain the vector bdry left with a total of N values.
  • N the first type of luminance coding
  • Vector bdry top and vector bdry left form a new vector bdry red and perform subsequent operations;
  • Step 2 Obtain the corresponding matrix A k and the offset b k through the mode number k of the MIP mode, and obtain the partial prediction value of the current block as shown in Figure 2 by the following formula (1):
  • Pred red A k ⁇ bdry red +b k (1)
  • Step 3 Obtain the remaining predicted value Predred in the current block through linear interpolation.
  • the decoder can determine which encoding mode is used by analyzing the mode information.
  • One mode whether it is a traditional mode or a MIP mode; if it is a traditional mode, which is the specific traditional mode; if it is a MIP mode, which is the specific MIP mode.
  • VVC intra-frame prediction the rate-distortion cost RDcost of 67 traditional modes and M MIP modes is compared for each luminance coding block, and the optimal mode is selected from the 67 traditional modes and M MIP modes and performed coding.
  • VVC uses an intra mode coding technique based on the Most Probable Modes List (MPM).
  • the optimal mode selected by the current block is the traditional mode, it is necessary to construct an MPM list containing the 6 most likely traditional modes;
  • the optimal mode selected by the block is the MIP mode, and a MIPMPM list containing the 3 most likely MIP modes needs to be constructed.
  • Fig. 3 is a schematic diagram of the arrangement of the adjacent luminance block on the upper side of the current block and the adjacent luminance block on the left side. As shown in Fig. 3, the above two lists are based on the upper adjacent luminance block of the current block as shown in Fig. 3 The optimal mode of the luminance block (A) and the adjacent luminance block (L) on the left is derived.
  • the MIPMPM list in VVC intra prediction, if the optimal mode of the current block is the MIP mode, the MIPMPM list needs to be constructed. In the process of constructing the MIPMPM list, it is first necessary to obtain the MIP mode ABOVE_MIP corresponding to the optimal mode of the upper adjacent luminance block and the MIP mode LEFT_MIP corresponding to the optimal mode of the adjacent luminance block on the left.
  • MIPMPM the number in MIPMPM is the number of the MIP mode, and the number range is 0 to (M-1)
  • M-1 the number in MIPMPM is the number of the MIP mode
  • the number range is 0 to (M-1)
  • the default list of the first type of brightness block is: ⁇ 17, 34, 5 ⁇ ;
  • the default list of the second type of brightness block is: ⁇ 0, 7, 16 ⁇ ;
  • the default list of the third type of luminance block is: ⁇ 1, 4, 6 ⁇ .
  • FIG. 4 is a schematic diagram of determining the arrangement of the DM mode. As shown in Figure 4, since the MIP technology is only applied to the luma coding block, when the frame at the CR position in Figure 4 When the intra prediction mode is the MIP mode, the MIP mode needs to be mapped to the traditional mode through the "MIP-traditional mapping table" to perform intra prediction of the current chrominance block.
  • DM Direct Mode
  • the traditional mode needs to be mapped to the MIP mode in the construction of the MIPMPM list, and the MIP mode needs to be mapped to the traditional mode in the construction of the MPM list and the determination of the DM mode.
  • mapping from the MIP mode to the traditional mode needs to be used in the MPM list construction process and the DM mode acquisition process.
  • 35/19/11 MIP modes are mapped to 67 traditional modes through the "MIP-Traditional Mapping Table".
  • MIP-Traditional Mapping Table For the three types of luminance blocks, three "MIP-traditional mapping tables" are shown in Table 2, Table 3 and Table 4.
  • MIP mode 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
  • Traditional model 0 1 0 1 0 twenty two 18 18 1 0 1 0 1 0 44 0 50 1 0
  • FIG. 5 is a schematic structural diagram of a video encoding system.
  • the video encoding system 100 includes a transform and quantization module 101, an intra-frame estimation module 102, an intra-frame prediction module 103, a motion compensation module 104, and a motion estimation module 105, Inverse transform and inverse quantization module 106, filter control analysis module 107, deblocking filter and sample adaptive indentation (Sample Adaptive Offset, SAO) filter module 108, header information coding and context-based adaptive binary arithmetic coding (Context- Based on Adaptive Binary Arithmatic Coding, CABAC) encoding module 109 and decoded image buffer module 110;
  • Figure 6 is a schematic diagram of the structure of the video decoding system, as shown in Figure 6, the video decoding system 200 includes header information decoding and CABAC decoding module 201 , Inverse transform and inverse quantization module 202, intra-frame prediction module 203, motion compensation module 204, deblocking filter and SAO filter module 205, de
  • the video image passes through the transformation and quantization module 101, the intra-frame estimation module 102, the intra-frame prediction module 103, the motion compensation module 104, the motion estimation module 105, the deblocking filtering and SAO filtering module 108, the header information encoding and CABAC in the video encoding system 100
  • the module 109 and other parts it outputs the code stream of the video image;
  • the code stream is input into the video decoding system 200, and passes through the header information decoding and CABAC decoding module 201 in the video decoding system 200, the inverse transform and inverse quantization module 202, and the intraframe
  • the prediction module 203 and the motion compensation module 204 perform partial processing, and finally restore the original video image.
  • the current block can have 25 sizes.
  • the standard stipulates that the maximum size of the brightness block is 128 ⁇ 128, but since the maximum size of the transform unit is 64 ⁇ 64, that is, the brightness block is at 128 ⁇ Under the size of 128, quadtree division must be performed first, so the maximum luminance block size is 64 ⁇ 64.
  • Table 5 is a schematic table of the size of the brightness block, as shown in Table 5.
  • the MIP mode is restricted according to the height parameter and the width parameter of the current block. Specifically, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the current block is not encoded in the MIP mode.
  • Table 6 is the limitation of the brightness block size in the MIP mode in the prior art, as shown in Table 6,
  • MipSizeId can be used to indicate the application category of MIP
  • numModes indicates the number of MIP modes
  • boundarySize indicates the number of brightness blocks in the upper reference row or left reference column obtained by downsampling
  • predW indicates the width parameter of the prediction block.
  • predH represents the height parameter of the prediction block
  • predC represents the side length of the MIP matrix.
  • Table 7 shows the grammatical relationship corresponding to the MIP mode in the prior art. As shown in Table 7, the MipSizeId, numModes, boundarySize, predW, predH, and predC in the grammar have the following relationships:
  • the value of MipSizeId is 0 for 4 ⁇ 4 brightness block, the value of 1 is 4 ⁇ 8, 8 ⁇ 4, 8 ⁇ 8 brightness block, and the value is 2 for brightness blocks of other sizes.
  • numModes indicates how many MIP prediction modes there will be, that is, there are 35 types of 4 ⁇ 4 brightness blocks, 19 types of 4 ⁇ 8, 8 ⁇ 4, and 8 ⁇ 8 brightness blocks, and 11 types of brightness blocks of other sizes.
  • the boundarySize indicates that the adjacent luminance blocks in the upper or left column of the current block are finally down-sampled into 2 or 4 adjacent luminance blocks.
  • mWeight and vBias are weight matrices and bias matrices trained by deep learning for each MIP mode.
  • mWeight is the weight matrix of each type of MIP mode
  • vBias is the bias matrix of each type of MIP mode.
  • sB is the left shift of the bias matrix
  • oW is the rounded reserved value
  • sW is the right shift of the overall predicted value. The sW value in different MIP modes needs to be obtained by looking up the table.
  • the encoder uses the variables incW and incH to determine whether it needs to extract the predicted values of odd rows, specifically:
  • Table 8 shows the grammatical description of sw in the prior art. As shown in Table 8, if and only if MipSizeId is equal to 1, that is, the current block size is 4 ⁇ 8, 8 ⁇ 4, 8 ⁇ 8, and the MIP mode number is 3. , 8, 12, 17, the value of sW is 9, and the value of sW is 8 in all other MIP modes. Among them, since the value of sW in the MIP mode is a mapping relationship, the values of sW in all modes can be obtained from Table 8.
  • Table 9 shows the mWeight matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • Table 10 shows the vBias matrix when MipSizeId is 1, and MIP mode numbers are 3 and 12.
  • Table 11 shows the mWeight matrix when MipSizeId is 1, and MIP mode numbers are 8 and 17.
  • Table 12 shows the vBias matrix when MipSizeId is 1, and MIP mode numbers are 8 and 17.
  • this application proposes an image coding method, by modifying the value of sW in the MIP mode numbers of 3, 8, 12, 17 for the second type of luminance block, so that the value of sW under all MIP mode numbers is taken
  • the values are the same, thereby reducing storage space, and reducing the overall time by omitting table lookup operations.
  • the image coding method proposed in this application can affect the intra prediction part in the video coding hybrid framework, that is, it is mainly used in the intra prediction module 103 in video coding and the intra prediction module 203 in video decoding.
  • the encoding end and the decoding end act simultaneously.
  • the image coding and decoding method proposed in this application can uniformly modify sW according to the offset parameter with a fixed value, and modify the corresponding The weight matrix and bias matrix.
  • it is not limited to the modification of the value of sW when the second type of brightness block is numbered in the MIP mode of 3, 8, 12, 17, but in the specific parameters (including size, mode, right shift)
  • the calculation parameters obtained from the machine learning method training and the different values of sW are uniformly modified.
  • FIG. 7 is a schematic diagram 1 of the implementation process of an image encoding method proposed in an embodiment of this application. As shown in FIG. 7, in the embodiment of this application, the encoder performs image encoding. The following steps can be included.
  • Step 101 Before performing encoding processing according to the MIP mode, uniformly modify the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters; wherein, the offset parameters are used to shift the predicted value to the right Number to indicate.
  • the encoder may first set the offset parameter used to indicate the number of offset bits.
  • the offset parameter is the sW in formula (2), that is, the offset parameter is the right shift amount of the overall predicted value, that is, When performing luminance prediction on the current block, the offset parameter is used to indicate the right shift number of the overall prediction value of the current block.
  • the encoder may set the offset parameter to a fixed positive integer before performing encoding processing in the MIP mode. That is to say, after the encoder sets the offset parameter, for any current block, no matter what the size of the current block is, and regardless of the MIP mode number corresponding to the current block, the offset parameter it uses All are certain.
  • the offset parameters can be set to any Positive integer.
  • the encoder may preferably set the offset parameter sW to 6, or preferably set the offset parameter sW to 7, or preferably set the offset parameter sW to 8, or preferably set the offset parameter sW to Set to 9.
  • Table 13 is the grammar description 1 of sW in this application.
  • the encoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters For the brightness block whose size is 4 ⁇ 8, 8 ⁇ 4 or 8 ⁇ 8 and the MIP mode number is 3, 8, 12 or 17, the corresponding SW can be set to the same SW corresponding to other brightness blocks Value, that is, when the sW corresponding to other brightness blocks is 8, set the sW corresponding to the brightness block whose size is 4 ⁇ 8, 8 ⁇ 4 or 8 ⁇ 8 and the MIP mode number is 3, 8, 12 or 17 to 8. , So that different current blocks have the same offset parameter sW.
  • Table 14 is the grammar description 2 of sW in this application.
  • the encoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters
  • the corresponding SW can be set to the same SW corresponding to other brightness blocks Value, that is, when the sW corresponding to other brightness blocks is 7, set the sW corresponding to the brightness block whose size is 4 ⁇ 8, 8 ⁇ 4 or 8 ⁇ 8 and the MIP mode number is 3, 8, 12 or 17 to 7.
  • the encoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters
  • the corresponding SW can be set to the same SW corresponding to other brightness blocks Value, that is, when the sW corresponding to other brightness blocks is 7, set the sW corresponding to the brightness block whose size is 4 ⁇ 8, 8 ⁇ 4 or 8 ⁇ 8 and the MIP mode number is 3, 8, 12 or 17 to 7.
  • So that different current blocks have the same offset parameter sW.
  • Table 15 is the grammar description 2 of sW in this application.
  • the encoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters For the brightness block whose size is 4 ⁇ 8, 8 ⁇ 4 or 8 ⁇ 8 and the MIP mode number is 3, 8, 12 or 17, the corresponding SW can be set to the same SW corresponding to other brightness blocks Value, that is, when the sW corresponding to other brightness blocks is 8, set the sW corresponding to the brightness block whose size is 4 ⁇ 8, 8 ⁇ 4 or 8 ⁇ 8 and the MIP mode number is 3, 8, 12 or 17 to 8. , So that different current blocks have the same offset parameter sW.
  • the offset parameter sW corresponding to different current blocks may be different. Specifically, if and only if MipSizeId is equal to 1, that is, the current block is a second-type luminance block with a size of 4 ⁇ When 8, 8 ⁇ 4, 8 ⁇ 8, and the MIP mode numbers are 3, 8, 12, and 17, the value of sW is different from the value of sW under all other MIP mode numbers. Therefore, when the encoder encodes the current block, it needs to query and call the offset parameter sW according to the size of the current block and the MIP mode number, which increases the overall time and reduces the coding and decoding efficiency. The syntax description table is stored, and storage space is also increased.
  • this application can first set the offset parameter sW before encoding according to the MIP mode, and set the offset parameter sW corresponding to all brightness blocks of different sizes and different MIP mode numbers. Set to the same value, so that when encoding the current block, it is no longer necessary to query and call the offset parameter sw according to the size of the current block and the MIP mode number, and the encoder does not need to perform the syntax description table of sw Storage, in turn, can reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • the size is 4 ⁇ 8, 8 ⁇ 4, 8 ⁇ 8, and the MIP mode number is 3, 8, 12, and 17 corresponding to the offset parameter sW for setting.
  • the encoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters, that is, when the initial right shift parameters and When the offset parameters are not the same, the initial right shift parameter is modified to the offset parameter so that the right shift numbers of all predicted values corresponding to all sizes and all MIP mode numbers are the same.
  • Step 102 When encoding processing is performed according to the MIP mode, encoding processing is performed according to the offset parameter.
  • the encoder when the encoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters, when the encoder performs encoding processing in accordance with the MIP mode, it can be based on the design
  • the specified offset parameter is encoded.
  • the encoder after setting the offset parameter, the encoder can directly encode the current block according to the offset parameter when performing encoding processing in the MIP mode. Therefore, on the basis of ensuring the coding and decoding performance, the storage space and overall time required in the coding and decoding process can be reduced, and the coding and decoding efficiency can be effectively improved.
  • FIG. 8 is the second schematic diagram of the implementation process of an image encoding method proposed in an embodiment of the present application.
  • the encoder performs the processing of different sizes and different MIPs according to offset parameters.
  • the method for the encoder to perform image encoding may further include the following steps:
  • Step 103 Modify the initial weight matrix and the initial bias matrix according to the preset calculation rules to obtain the modified weight matrix and the modified bias matrix; wherein the initial weight matrix and the initial bias matrix are unified and modified The initial right shift parameter corresponds to it.
  • the initial weight matrix and the initial offset can be adjusted according to the preset calculation rules. Set the matrix to obtain the modified weight matrix and the modified offset matrix.
  • the initial weight matrix and the initial bias matrix correspond to the initial right shift parameters that are unified and modified.
  • the preset calculation rule can be used to update when the size is 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or 17.
  • the corresponding initial weight matrix and initial bias matrix can be used to update when the size is 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or 17.
  • the encoder is setting the offset parameter, that is, the size is changed to 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or After the offset parameter corresponding to 17, in order to prevent the codec performance from degrading, the corresponding initial weight matrix and initial offset matrix can be further updated to obtain the modified weight matrix and the modified offset matrix.
  • the encoder when the size is 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or 17, the encoder is in accordance with the preset calculation rule When obtaining the modified weight matrix and the modified offset matrix, the corresponding initial weight matrix and the initial offset matrix can be updated through a variety of different methods. For example, when the size is 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or 17, the encoder can calculate any value in the initial weight matrix according to the calculation rule of rounding down. An element value A is updated to A/2, and any element value B in the initial offset matrix is updated to B/2, so that the modified weight matrix and the modified offset matrix can be obtained. Wherein, A and B are both integers.
  • the encoder can also update any element value A in the initial weight matrix to A/2 according to the calculation rule of rounding up, and at the same time update any element value B in the initial bias matrix to B/2 , So that the modified weight matrix and the modified bias matrix can be obtained. Further, the encoder can also update any element value A in the initial weight matrix to A/2 according to the calculation rule of rounding, and at the same time update any element value B in the initial bias matrix to B/2, thereby The modified weight matrix and the modified bias matrix can be obtained.
  • Step 104 Perform encoding processing according to the offset parameter, the modified weight matrix, and the modified offset matrix.
  • the encoding processing when the encoder performs encoding processing in the MIP mode, the encoding processing may be performed based on the set offset parameter, the modified weight matrix, and the modified offset matrix.
  • the current block can be encoded according to the offset parameter, the modified weight matrix and the modified offset matrix. Therefore, on the basis of ensuring the coding and decoding performance, the storage space and overall time required in the coding and decoding process can be reduced, and the coding and decoding efficiency can be effectively improved.
  • the encoder may directly encode the current block according to the offset parameter, the initial weight matrix, and the initial offset matrix. In other words, the encoder may not update the corresponding initial weight matrix and initial offset matrix after completing the setting of the offset parameter.
  • the image coding method proposed in this application unifies the offset parameter The setting makes the realization of the MIP mode more concise and unified; further, it is precisely because the offset parameter sW in the prior art is different, it is necessary to store the sW table representing the right shift number, and in the calculation process, the current block The corresponding sW is queried and called to determine the number of bits that the predicted value calculated by the MIP needs to be shifted to the right.
  • the image coding method proposed in this application sets the offset parameter uniformly, so there is no need to store the right shift There are several SW tables, thereby saving storage space and eliminating the processing flow of querying and calling SW.
  • the encoder may also update the corresponding initial weight matrix and initial bias matrix, so that there is no significant loss in coding and decoding performance.
  • the BD-rates on Y, U, and V are 0.00%, -0.02%, and -0.02%, respectively.
  • the result at 24 frame intervals is expected to be the codec performance at 8 frame intervals. similar.
  • the encoder before encoding according to the MIP mode, uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to offset parameters;
  • the shift parameter is used to indicate the right shift number of the predicted value; and, when the encoding process is performed according to the MIP mode, the encoding process is performed according to the offset parameter.
  • the image coding and decoding method proposed in this application uses the offset parameter to uniformly modify the right shift number of the predicted value, so that all luminance blocks of different sizes and different MIP mode numbers have the same sW value, thereby
  • the sW value can reduce the complexity of the MIP algorithm, and can reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance. Effectively improve coding and decoding efficiency.
  • the encoder calculates according to the preset
  • the method for obtaining the modified weight matrix and the modified bias matrix according to the rule may include the following steps:
  • Step 103a According to the calculation rule of rounding down, modify all element values in the initial weight matrix to values of the same binary order of magnitude as the element values of other weight matrices to obtain the modified weight matrix.
  • Step 103b According to the calculation rule of rounding down, all elements in the initial bias matrix are modified to values of the same binary order as the values of other bias matrix elements to obtain the modified bias matrix.
  • the encoder can follow the calculation rule of rounding down to Modify all element values in the initial weight matrix to values of the same binary order as other weight matrix element values, and at the same time modify all elements in the initial bias matrix to values of the same binary order as other bias matrix element values, so as to obtain The modified weight matrix and the modified bias matrix.
  • Table 16 shows the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • the encoder uses the calculation rule of rounding down to calculate each value in Table 9.
  • An element value A is updated to A/2, thereby obtaining the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • Table 17 shows the modified offset matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • the value B of each element is updated to B/2, thereby obtaining the modified offset matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • Table 18 shows the modified weight matrix when the MipSizeId is 1, the MIP mode numbers are 8 and 17, as shown in Table 18.
  • An element value A is updated to A/2, thereby obtaining the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 8 and 17.
  • Table 19 is the modified offset matrix when MipSizeId is 1, and MIP mode numbers are 8 and 17.
  • the value B of each element is updated to B/2, thereby obtaining the modified offset matrix when the MipSizeId is 1, and the MIP mode numbers are 8 and 17.
  • the encoder obtains the modified
  • the method of the weight matrix and the modified bias matrix can include the following steps:
  • Step 103c According to the calculation rule of rounding up, modify all element values in the initial weight matrix to values of the same binary order as the element values of other weight matrices to obtain the modified weight matrix.
  • Step 103d According to the calculation rule of rounding up, all the elements in the initial bias matrix are modified to values of the same binary order as the values of other bias matrix elements to obtain the modified bias matrix.
  • the encoder can calculate the initial Modify all element values in the weight matrix to the same binary order of value as other weight matrix element values, and at the same time modify all the elements in the initial offset matrix to the same binary order of value as other offset matrix element values, so that the modification can be obtained After the weight matrix and the modified bias matrix.
  • Table 20 is the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • the element value A is updated to A/2, thereby obtaining the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • Table 21 is the modified offset matrix when MipSizeId is 1, and MIP mode numbers are 3 and 12.
  • An element value B is updated to B/2, thereby obtaining the modified offset matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • Table 22 is the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 8 and 17.
  • the element value A is updated to A/2, thereby obtaining the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 8 and 17.
  • Table 23 is the modified offset matrix when the MipSizeId is 1, and the MIP mode numbers are 8 and 17.
  • the encoder uses the rounding-up calculation rule to divide each An element value B is updated to B/2, thereby obtaining the modified offset matrix when the MipSizeId is 1, and the MIP mode numbers are 8 and 17.
  • the encoder obtains the modified
  • the method of the weight matrix and the modified bias matrix can include the following steps:
  • Step 103e According to the calculation rule of rounding, modify all element values in the initial weight matrix to values of the same binary order as the element values of other weight matrices to obtain the modified weight matrix.
  • Step 103f According to the calculation rule of rounding, modify all the elements in the initial offset matrix to values of the same binary order as the values of other offset matrix elements to obtain the modified offset matrix.
  • the encoder can calculate the initial weight matrix according to the rounding calculation rule Modify all element values in to the same binary order of magnitude as the other weight matrix element values, and at the same time modify all elements in the initial bias matrix to the same binary order of value as the other bias matrix element values, so that the modified The weight matrix and the modified bias matrix.
  • Table 24 is the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • the encoder calculates the value of each element in Table 9 according to the rounding calculation rule A is updated to A/2 to obtain the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • Table 25 is the modified offset matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • the encoder will calculate each element in Table 10 according to the rounding calculation rule
  • the value B is updated to B/2 to obtain the modified offset matrix when the MipSizeId is 1, and the MIP mode numbers are 3 and 12.
  • Table 26 is the modified weight matrix when the MipSizeId is 1, the MIP mode numbers are 8 and 17, as shown in Table 26, the encoder calculates the value of each element in Table 11 according to the rounding calculation rule A is updated to A/2 to obtain the modified weight matrix when the MipSizeId is 1, and the MIP mode numbers are 8 and 17.
  • Table 27 is the modified offset matrix when the MipSizeId is 1, the MIP mode numbers are 8 and 17, as shown in Table 30, the encoder will calculate each element in Table 12 according to rounding The value B is updated to B/2, thereby obtaining the modified offset matrix when the MipSizeId is 1, and the MIP mode numbers are 8 and 17.
  • the encoder before encoding according to the MIP mode, uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to offset parameters;
  • the shift parameter is used to indicate the right shift number of the predicted value; and, when the encoding process is performed according to the MIP mode, the encoding process is performed according to the offset parameter.
  • the image coding and decoding method proposed in this application uses the offset parameter to uniformly modify the right shift number of the predicted value, so that all luminance blocks of different sizes and different MIP mode numbers have the same sW value, thereby
  • the sW value can reduce the complexity of the MIP algorithm, and can reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance. Effectively improve coding and decoding efficiency.
  • FIG. 9 is a schematic diagram 1 of the implementation process of an image decoding method proposed in an embodiment of this application.
  • the decoder performs image decoding.
  • the method can include the following steps.
  • Step 201 Before performing decoding processing according to the MIP mode, uniformly modify the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters; wherein, the offset parameters are used to shift the predicted value to the right Number to indicate.
  • the decoder before performing the decoding process according to the MIP mode, may first set the offset parameter for indicating the number of offset bits.
  • the offset parameter is the sW in formula (2), that is, the offset parameter is the right shift amount of the overall predicted value, that is, When performing luminance prediction on the current block, the offset parameter is used to indicate the right shift number of the overall prediction value of the current block.
  • the decoder may set the offset parameter to a fixed positive integer before performing decoding processing according to the MIP mode.
  • the decoder sets the offset parameter, for any current block, no matter what the size of the current block is, and no matter what the MIP mode number corresponding to the current block is, the offset parameter it uses All are certain.
  • the offset parameters can be set to any Positive integer.
  • the decoder may preferably set the offset parameter sW to 6, or preferably set the offset parameter sW to 7, or preferably set the offset parameter sW to 8, or preferably set the offset parameter sW to Set to 9.
  • the offset parameter sW corresponding to different current blocks may be different. Specifically, if and only if MipSizeId is equal to 1, that is, the current block is the second type of luminance block, and the size is 4 ⁇ 8, 8 ⁇ 4, 8. ⁇ 8, and the MIP mode number is 3, 8, 12, 17, the value of sW is different from the value of sW under all other MIP mode numbers. Therefore, when the decoder decodes the current block, it needs to query and call the offset parameter sW according to the size of the current block and the MIP mode number, thereby increasing the overall time and reducing the coding and decoding efficiency. At the same time, due to the need for sW The syntax description table is stored, and storage space is also increased.
  • this application can first set the offset parameter sW before performing the decoding process according to the MIP mode, and set the offset parameter sW corresponding to all luminance blocks of different sizes and different MIP mode numbers. Set to the same value, so that when decoding the current block, it is no longer necessary to query and call the offset parameter sW according to the size of the current block and the MIP mode number, and the decoder does not need to perform the grammar description table of sW Storage, in turn, can reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • the decoder sets the offset parameter sW when setting the offset parameter sW
  • all offset parameters sW corresponding to different sizes and different MIP mode numbers are set to the same value.
  • MipSizeId is equal to 1
  • the size is 4 ⁇ 8, 8 ⁇ 4, 8 ⁇ 8, and the MIP mode number is 3, 8, 12, 17, the sW
  • the value is different from the sW values of all other MIP mode numbers.
  • the decoder uniformly modifies the sW of the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters, the size is 4 ⁇ 8, 8 ⁇ 4, 8 ⁇ 8, and the MIP mode number is 3, 8, 12, 17 corresponding to the offset parameter sW for setting.
  • the decoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters.
  • modify the initial right shift parameter to the offset parameter so that the right shift numbers of all predicted values corresponding to all sizes and all MIP mode numbers are the same.
  • Step 202 When performing decoding processing according to the MIP mode, perform decoding processing according to the offset parameter.
  • the decoder when the decoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters, when the decoder performs decoding processing according to the MIP mode, it can be based on the design Set the offset parameter for decoding.
  • the decoder after setting the offset parameter, the decoder can directly decode the current block according to the offset parameter when performing decoding processing in the MIP mode. Therefore, on the basis of ensuring the coding and decoding performance, the storage space and overall time required in the coding and decoding process can be reduced, and the coding and decoding efficiency can be effectively improved.
  • FIG. 10 is a schematic diagram of the second implementation flow of an image decoding method proposed in an embodiment of the present application.
  • the method for the decoder to decode the image may further include the following steps:
  • Step 203 Modify the initial weight matrix and the initial bias matrix according to the preset calculation rules to obtain the modified weight matrix and the modified bias matrix; wherein, the initial weight matrix and the initial bias matrix are unified and modified The initial right shift parameter corresponds to it.
  • the initial weight matrix and the initial offset can be adjusted according to the preset calculation rules. Set the matrix to obtain the modified weight matrix and the modified bias matrix.
  • the initial weight matrix and the initial bias matrix correspond to the initial right shift parameters that are unified and modified.
  • the preset calculation rule can be used to update when the size is 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or 17.
  • the corresponding initial weight matrix and initial bias matrix can be used to update when the size is 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or 17.
  • the decoder is setting the offset parameter, that is, the size is changed to 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or After the offset parameter corresponding to 17, in order to prevent the codec performance from degrading, the corresponding initial weight matrix and initial offset matrix can be further updated to obtain the modified weight matrix and the modified offset matrix.
  • the decoder when the size is 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or 17, the decoder is in accordance with the preset calculation rule When obtaining the modified weight matrix and the modified bias matrix, the corresponding initial weight matrix and the initial bias matrix can be updated through a variety of different methods. For example, when the size is 4 ⁇ 8, 8 ⁇ 4, or 8 ⁇ 8, and the MIP mode number is 3, 8, 12, or 17, the decoder can calculate any value in the initial weight matrix according to the calculation rule of rounding down. An element value A is updated to A/2, and any element value B in the initial offset matrix is updated to B/2, so that the modified weight matrix and the modified offset matrix can be obtained.
  • a and B are both integers.
  • the decoder can also update any element value A in the initial weight matrix to A/2 according to the calculation rule of rounding up, and at the same time update any element value B in the initial bias matrix to B/2 , So that the modified weight matrix and the modified bias matrix can be obtained.
  • the decoder can also update any element value A in the initial weight matrix to A/2 according to the calculation rule of rounding, and at the same time update any element value B in the initial bias matrix to B/2, thereby The modified weight matrix and the modified bias matrix can be obtained.
  • Step 204 Perform decoding processing according to the offset parameter, the modified weight matrix, and the modified offset matrix.
  • the decoding processing when the decoder performs decoding processing according to the MIP mode, the decoding processing may be performed based on the set offset parameter, the modified weight matrix, and the modified offset matrix.
  • the current block can be decoded according to the offset parameter, the modified weight matrix and the modified offset matrix. Therefore, on the basis of ensuring the coding and decoding performance, the storage space and overall time required in the coding and decoding process can be reduced, and the coding and decoding efficiency can be effectively improved.
  • the decoder may also directly decode the current block according to the offset parameter, the initial weight matrix, and the initial offset matrix. In other words, the decoder may not update the corresponding initial weight matrix and initial bias matrix after completing the setting of the offset parameter.
  • the image decoding method proposed in this application unifies the offset parameter
  • the setting makes the realization of the MIP mode more concise and unified; further, it is precisely because the offset parameter sW in the prior art is different, it is necessary to store the sW table representing the right shift number, and in the calculation process, the current block The corresponding sW is queried and called to determine the number of bits that the predicted value of MIP calculation needs to be shifted to the right.
  • the image decoding method proposed in this application sets the offset parameter uniformly, so there is no need to store the right shift There are several SW tables, thereby saving storage space and eliminating the processing flow of querying and calling SW.
  • the decoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to offset parameters before performing decoding processing in accordance with the MIP mode;
  • the shift parameter is used to indicate the right shift number of the predicted value; and, when the decoding process is performed according to the MIP mode, the decoding process is performed according to the offset parameter.
  • the image coding and decoding method proposed in this application uses the offset parameter to uniformly modify the right shift number of the predicted value, so that all luminance blocks of different sizes and different MIP mode numbers have the same sW value, thereby
  • the sW value can reduce the complexity of the MIP algorithm, and can reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance. Effectively improve coding and decoding efficiency.
  • FIG. 11 is a schematic diagram 1 of the composition structure of the encoder proposed in the embodiment of the application.
  • the encoder 300 proposed in the embodiment of the present application may include a first A modification part 301 and an encoding part 302.
  • the first modification part 301 is configured to uniformly modify the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to offset parameters before encoding processing according to the MIP mode; wherein, the offset parameters Used to indicate the right shift number of the predicted value.
  • the coding part 302 is configured to perform coding processing according to the offset parameter when performing coding processing according to the MIP mode.
  • the first modification part 301 is specifically configured to modify the initial right shift parameter to the offset parameter when the initial right shift parameter and the offset parameter are not the same, so that the full size and all MIP The right shift numbers of all predicted values corresponding to the mode number are the same.
  • Fig. 12 is a second schematic diagram of the composition structure of the encoder proposed in the embodiment of the application.
  • the encoder 300 proposed in the embodiment of the present application may further include a first processor 303, and store the first processor 303 to execute The first memory 304 of instructions, the first communication interface 305, and the first bus 306 for connecting the first processor 303, the first memory 304, and the first communication interface 305.
  • the above-mentioned first processor 303 is configured to unify the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters before performing encoding processing according to the MIP mode
  • the offset parameter is used to indicate the right shift number of the predicted value; and, when the encoding process is performed according to the MIP mode, the encoding process is performed according to the offset parameter.
  • the functional modules in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be realized in the form of hardware or software function module.
  • the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this embodiment is essentially or correct
  • the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal A computer, a server, or a network device, etc.) or a processor (processor) execute all or part of the steps of the method in this embodiment.
  • the aforementioned storage media include: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.
  • the embodiment of the present application provides an encoder, which uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to offset parameters before performing encoding processing according to the MIP mode;
  • the shift parameter is used to indicate the right shift number of the predicted value; and, when the encoding process is performed according to the MIP mode, the encoding process is performed according to the offset parameter.
  • the image coding and decoding method proposed in this application uses the offset parameter to uniformly modify the right shift number of the predicted value, so that all luminance blocks of different sizes and different MIP mode numbers have the same sW value, thereby
  • the sW value can reduce the complexity of the MIP algorithm, and can reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance. Effectively improve coding and decoding efficiency.
  • FIG. 13 is a schematic diagram 1 of the composition structure of the decoder proposed in the embodiment of the application.
  • the decoder 400 proposed in the embodiment of the application may include a second modification part 401 and a decoding part 402.
  • the second modification part 401 is configured to uniformly modify the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters before decoding processing according to the MIP mode; wherein, the offset parameters Used to indicate the right shift number of the predicted value.
  • the decoding part 402 is configured to perform decoding processing according to the offset parameter when performing decoding processing according to the MIP mode.
  • the second modification part 401 is specifically configured to modify the initial right shift parameter to the offset parameter when the initial right shift parameter and the offset parameter are not the same, so that the full size and all MIP The right shift numbers of all predicted values corresponding to the mode number are the same.
  • FIG. 14 is a second schematic diagram of the composition structure of the decoder proposed in the embodiment of the application.
  • the decoder 400 proposed in the embodiment of the application may further include a second processor 403, which stores the second processor 403 for executable The second memory 404 for instructions, the second communication interface 405, and the second bus 406 for connecting the second processor 403, the first memory 404 and the second communication interface 405.
  • the above-mentioned second processor 403 is configured to unify the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters before performing decoding processing according to the MIP mode
  • the offset parameter is used to indicate the right shift number of the predicted value; and, when the decoding process is performed according to the MIP mode, the decoding process is performed according to the offset parameter.
  • the functional modules in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be realized in the form of hardware or software function module.
  • the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this embodiment is essentially or correct
  • the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal A computer, a server, or a network device, etc.) or a processor (processor) execute all or part of the steps of the method in this embodiment.
  • the aforementioned storage media include: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.
  • the embodiment of the present application provides an encoder, the decoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to offset parameters before performing decoding processing according to the MIP mode; and, When the decoding process is performed in the MIP mode, the decoding process is performed according to the offset parameter.
  • the image coding and decoding method proposed in this application uses the offset parameter to uniformly modify the right shift number of the predicted value, so that all luminance blocks of different sizes and different MIP mode numbers have the same sW value, thereby
  • the sW value can reduce the complexity of the MIP algorithm, and can reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance. Effectively improve coding and decoding efficiency.
  • the embodiments of the present application provide a computer-readable storage medium and a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the method as described in the foregoing embodiment is implemented.
  • the program instructions corresponding to an image encoding method in this embodiment can be stored on storage media such as optical disks, hard disks, USB flash drives, etc.
  • storage media such as optical disks, hard disks, USB flash drives, etc.
  • the initial right shift parameters corresponding to different sizes and different MIP mode numbers are uniformly modified according to the offset parameters; wherein, the offset parameter is used for the right shift number of the predicted value Give instructions; and,
  • the program instructions corresponding to an image decoding method in this embodiment can be stored on storage media such as optical disks, hard disks, USB flash drives, etc.
  • storage media such as optical disks, hard disks, USB flash drives, etc.
  • the initial right shift parameters corresponding to different sizes and different MIP mode numbers are uniformly modified according to the offset parameters; wherein, the offset parameter is used for the right shift number of the predicted value Give instructions; and,
  • the decoding process is performed according to the MIP mode
  • the decoding process is performed according to the offset parameter.
  • this application may be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of hardware embodiments, software embodiments, or embodiments combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.
  • a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device realizes the functions specified in one or more processes in the schematic diagram and/or one block or more in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing functions specified in one or more processes in the schematic diagram and/or one block or more in the block diagram.
  • the embodiments of the present application provide an image encoding and decoding method, an encoder, a decoder, and a storage medium.
  • the encoder Before encoding according to the MIP mode, the encoder performs an offset parameter on the initial right corresponding to different sizes and different MIP mode numbers.
  • the shift parameter is uniformly modified; wherein, the offset parameter is used to indicate the right shift number of the predicted value; and, when the encoding process is performed according to the MIP mode, the encoding process is performed according to the offset parameter.
  • the decoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameters; and, when performing decoding according to the MIP mode, according to the offset parameters Perform decoding processing.
  • the image coding and decoding method proposed in this application uses the offset parameter to uniformly modify the right shift number of the predicted value, so that all luminance blocks of different sizes and different MIP mode numbers have the same sW value, thereby
  • the sW value can reduce the complexity of the MIP algorithm, and can reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance. Effectively improve coding and decoding efficiency.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

本申请实施例公开了一种图像编解码方法、编码器、解码器以及存储介质,编码器在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示;以及,在按照MIP模式进行编码处理时,根据偏移参数进行编码处理。解码器在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示;以及,在按照MIP模式进行解码处理时,根据偏移参数进行解码处理。

Description

图像编解码方法、编码器、解码器以及存储介质 技术领域
本申请实施例涉及视频编解码技术领域,尤其涉及的是一种图像编解码方法、编码器、解码器以及存储介质。
背景技术
在多功能视频编码(Versatile Video Coding,VVC)的参考软件测试平台中,一种新的帧内编码技术,基于矩阵的帧内预测(Matrix-based Intra Prediction,MIP)被提出,MIP是基于神经网络的帧内预测技术,即利用多层神经网络基于相邻已重建亮度块预测当前块的亮度值。具体地,与传统帧内模式相同,在利用MIP模式进行帧内预测时,MIP预测的输入也为当前块的上一行和左一列相邻亮度块的数据,输出为当前块的亮度分量预测值。具体的预测过程分为三步:下采样,矩阵向量乘法和插值。
然而,在通过MIP模式进行亮度预测时,尺寸不同的亮度块所采用的参数也有可能不同,因此,需要占用较大的存储空间对大量参数进行存储,且预测过程中对参数的查找和调用也增加了整体时间,从而降低了编解码效率。
发明内容
本申请实施例提供一种图像编解码方法、编码器、解码器以及存储介质,能够在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
本申请实施例的技术方案是这样实现的:
本申请实施例提供了一种图像编码方法,应用于编码器,所述方法包括:
在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;以及,
在按照所述MIP模式进行编码处理时,根据所述偏移参数进行编码处理。
本申请实施例提供了一种图像解码方法,应用于解码器,所述方法包括:
在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;以及,
在按照所述MIP模式进行解码处理时,根据所述偏移参数进行解码处理。
本申请实施例提供了一种编码器,所述编码器包括:第一修改部分和编码部分,
所述第一修改部分,配置于在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;
所述编码部分,配置于在按照所述MIP模式进行编码处理时,根据所述偏移参数进行编码处理。
本申请实施例提供了解码器,所述解码器包括:第二修改部分和解码部分,
所述第二修改部分,配置于在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;
所述编码部分,配置于在按照所述MIP模式进行解码处理时,根据所述偏移参数进行解码处理。
本申请实施例提供了一种编码器,所述编码器包括第一处理器、存储有所述第一处理器可执行指令的第一存储器、第一通信接口,和用于连接所述第一处理器、所述第一存储器以及所述第一通信接口的第一总线,当所述指令被所述第一处理器执行时,实现如如上所述的图像编码方法。
本申请实施例提供了一种解码器,所述解码器包括第二处理器、存储有所述第二处理器可执行指令的第二存储器、第二通信接口,和用于连接所述第二处理器、所述第二存储器以及所述第一通信接口的第二总线,当所述指令被所述第二处理器执行时,实现如如上所述的图像解码方法。
本申请实施例提供了一种计算机可读存储介质,其上存储有程序,应用于编码器和解码器中,所述程序被处理器执行时,实现如上所述的图像编解码方法。
本申请实施例提供了一种图像编解码方法、编码器、解码器以及存储介质,编码器在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示;以及,在按照MIP模式进行编码处理时,根据偏移参数进行编码处理。解码器在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;以及,在按照MIP模式进行解码处理时,根据偏移参数进行解码处理。由此可见,本申请提出的图像编解码方法,通过利用偏移参数对预测值的右移位数进行统一化修改,使不同尺寸、不同MIP模式编号的全部亮度块具有相同的sW值,从而在进行编解码处理时,不需要对sW值进行查询和调用,可以降低MIP算法的复杂度,能够在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
附图说明
图1为帧内预测中的67种预测模式的排布示意图;
图2为MIP模式进行编码的流程示意图;
图3为当前块的上侧相邻亮度块和左侧相邻亮度块的排布示意图;
图4为确定DM模式的排布示意图;
图5为视频编码系统的结构示意图;
图6为视频解码系统的结构示意图;
图7为本申请实施例提出的一种图像编码方法的实现流程示意图一;
图8为本申请实施例提出的一种图像编码方法的实现流程示意图二;
图9为本申请实施例提出的一种图像解码方法的实现流程示意图一;
图10为本申请实施例提出的一种图像解码方法的实现流程示意图二;
图11为本申请实施例提出的编码器的组成结构示意图一;
图12为本申请实施例提出的编码器的组成结构示意图二;
图13为本申请实施例提出的解码器的组成结构示意图一;
图14为本申请实施例提出的解码器的组成结构示意图二。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。可以理解的是,此处所描述的具体实施例仅仅用于解释相关申请,而非对该申请的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与有关申请相关的部分。
在视频图像中,VVC接受了联合视频专家组(Joint Video Experts Team,JVET)-N0217中提出的仿射线性权重帧内预测技术(Affine Linear Weighted Intra Prediction),并更名为基于矩阵的帧内预测,即MIP技术,该技术针对帧内亮度编码块大小的不同,在帧内亮度预测过程中增加了不同数量的基于矩阵的帧内预测模式。
为了捕捉自然视频中呈现的更精细的边缘方向,VVC中将视频压缩标准(High Efficiency Video Coding,HEVC)中定义的33种帧内亮度预测角度模式扩展到了65种,图1为帧内预测中的67种预测模式的排布示意图,如图1所示,箭头编号为2-66的表示65种帧内角度预测模式,另外还有两种非角度模式,即编号为0的渐变平坦Planar模式和编号为1的直流DC模式;所以,VVC中的帧内预测过程中包含两种非角度模式和65种角度模式,这里,将这67种预测模式称为帧内预测的传统模式。
MIP是基于神经网络的帧内预测技术,即利用多层神经网络基于相邻已重建像素预测当前块的亮度值。具体地,MIP技术根据帧内亮度编码块的大小将亮度编码块分为三类,设亮度编码块大小为W×H,其中,W为宽度参数,H为高度参数,按照亮度编码块的大小可以将亮度编码块分为三类:
大小为4×4的亮度编码块为第一类亮度块,大小为8×4,4×8和8×8的亮度编码块为第二类亮度块,其他大小的亮度编码块为第三类亮度块。
针对这三种类型的帧内亮度编码块,MIP技术在67种传统帧内预测模式的基础上增加了M种MIP模式,其中,针对第一类亮度块,M=35,针对第二类亮度块,M=19,针对第三类亮度块,M=11。
具体来说,MIP技术只应用于帧内亮度预测,与传统模式相同,MIP预测的输入也为当前块的上一行和左一列数据,输出为当前块的预测值,具体的预测过程分为三步:平均,矩阵向量乘法和插值。也就是说,通过对输入的上一行和左一列相邻像素点的重建亮度值进行这三步操作,就可以得到当前块的亮度分量预测值。
图2为MIP模式进行编码的流程示意图,如图2所示,MIP模式进行亮度预测的具体实现如下:
第一步:对当前块的上侧相邻参考点进行平均操作获得向量bdry top,共N个值;对当前块的左侧相邻参考点进行平均操作获得向量bdry left,共N个值。当当前块为第一类亮度编码时,N=2;当当前块为第二类或第三类亮度编码时,N=4。向量bdry top和向量bdry left组成一个新的向量bdry red并进行后续操作;
第二步:通过MIP模式的模式号k获取对应的矩阵A k和偏移量b k,通过下列公式(1)计算获得如图2中用交叉线标识的当前块的部分预测值:
Pred red=A k·bdry red+b k     (1)
第三步:通过线性插值,获得当前块中剩余的预测值Predred。
需要说明的是,针对当前块进行编码的实现过程,需要将帧内预测具体使用的哪一种编码模式写入到压缩码流中,从而使解码端通过解析该模式信息,可以确定具体使用哪一种模式,是传统模式还是MIP模式;若是传统模式,具体是哪一种传统模式;若是MIP模式,具体是哪一种MIP模式。
在VVC的帧内预测中,对每个亮度编码块都会进行67个传统模式和M个MIP模 式的率失真代价RDcost比较,在67个传统模式和M个MIP模式中选出最优模式并进行编码。为了节省比特开销,VVC中使用了基于最可能模式列表(Most Probable Modes List,MPM)的帧内模式编码技术。
需要注意的是,由于多参考行技术(extend reference line)和帧内子块划分技术(Intra Sub-Patitionar,ISP)只对MPM列表中的模式使用,所以当extendrefflag和ispflag都为0,即使用0参考行且不进行子块划分时,不必编码mpmflag,直接编码最优模式在MPM列表中的位置。
进一步地,针对MPM列表和MIPMPM列表的构造来说,在VVC亮度帧内预测中,若当前块选中的最优模式是传统模式,则需要构造包含6个最可能传统模式的MPM列表;若当前块选中的最优模式是MIP模式,则需要构造包含3个最可能MIP模式的MIPMPM列表。
图3为当前块的上侧相邻亮度块和左侧相邻亮度块的排布示意图,如图3所示,上述两个列表都是根据如图3所示的当前块的上侧相邻亮度块(A)和左侧相邻亮度块(L)的最优模式进行推导的。
进一步地,针对MIPMPM列表的构造来说,在VVC帧内预测中,若当前块的最优模式是MIP模式,则需要构造MIPMPM列表。构造MIPMPM列表的过程中,首先需要获取上侧相邻亮度块的最优模式所对应的MIP模式ABOVE_MIP和左侧相邻亮度块的最优模式所对应的MIP模式LEFT_MIP模式。
进一步地,在获取到LEFT_MIP和ABOVE_MIP之后,按照如下方法进行包含3个最可能MIPMPM模式的MIPMPM列表的构造,其中,MIPMPM中的编号为MIP模式的编号,编号范围为0至(M-1),对于第一类亮度块编号为0-34;对于第二类亮度块编号为0-18;对于第三类亮度块编号为0-10:
若LEFT_MIP可用(不为-1),将LEFT_MIP放入MIPMPMlist中;
若ABOVE_MIP可用(不为-1),将ABOVE_MIP通过冗余检查后放入MIPMPMlist中;
若LEFT_MIP不可用(为-1),ABOVE_MIP不可用(为-1),根据当前块的类型将默认列表通过冗余检查后添入直到补满MIPMPMlist:
第一类亮度块默认列表为:{17,34,5};
第二类亮度块默认列表为:{0,7,16};
第三类亮度块默认列表为:{1,4,6}。
进一步地,需要补充的是,在VVC的色度帧内预测过程中有一种利用分量间相关性的直接模式(Direct Mode,DM),会使用当前块对应的同位亮度编码块的中心位置的帧内预测模式来进行当前色度块的帧内预测,图4为确定DM模式的排布示意图,如图4所示,由于MIP技术只应用于亮度编码块,所以当图4中CR位置的帧内预测模式为MIP模式时,需要将该MIP模式通过“MIP-传统映射表”映射为传统模式,进行当前色度块的帧内预测。
也就是说,由于MIP技术的引入,在帧内预测过程中,在构建MIPMPM列表中,需要将传统模式映射为MIP模式,在构建MPM列表和确定DM模式中,需要将MIP模式映射为传统模式。
表1
Figure PCTCN2019092689-appb-000001
另外,在MPM列表构造过程和DM模式的获取过程中需要使用到MIP模式到传统模式的映射。具体通过“MIP-传统映射表”将35/19/11种MIP模式映射为67种传统模式。针对三种类型的亮度块,三种“MIP-传统映射表”如表2,表3和表4所示。
表2
MIP模式 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17
传统模式 0 18 18 0 18 0 12 0 18 2 18 12 18 18 1 18 18 0
MIP模式 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34  
传统模式 0 50 0 50 0 56 0 50 66 50 56 50 50 1 50 50 50  
表3
MIP模式 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
传统模式 0 1 0 1 0 22 18 18 1 0 1 0 1 0 44 0 50 1 0
表4
MIP模式 0 1 2 3 4 5 6 7 8 9 10
传统模式 1 1 1 1 18 0 1 0 1 50 0
图5为视频编码系统的结构示意图,如图5所示,该视频编码系统100包括变换与量化模块101、帧内估计模块102、帧内预测模块103、运动补偿模块104、运动估计模块105、反变换与反量化模块106、滤波器控制分析模块107、去方块滤波及样本自适应缩进(Sample Adaptive 0ffset,SAO)滤波模块108、头信息编码及基于上下文的自适应二进制算术编码(Context-based Adaptive Binary Arithmatic Coding,CABAC)编码模块109和解码图像缓存模块110等部件;图6为视频解码系统的结构示意图,如图6所示,该视频解码系统200包括头信息解码及CABAC解码模块201、反变换与反量化模块202、帧内预测模块203、运动补偿模块204、去方块滤波及SAO滤波模块205和解码图像缓存模块206等部件。视频图像经过视频编码系统100中变换与量化模块101、帧内估计模块102、帧内预测模块103、运动补偿模块104、运动估计模块105、去方块滤波及SAO滤波模块108以及头信息编码及CABAC模块109等部分处理之后,输出该视频图像的码流;该码流输入视频解码系统200中,经过视频解码系统200中头信息解码及CABAC解码模块201、反变换与反量化模块202、帧内预测模块203以及运动补偿模块204等部分处理,最终恢复出原来的视频图像。
按照高度参数和宽度参数,当前块可以为25种尺寸,具体地,标准中规定亮度块最大为128×128,但由于变换单元的最大尺寸为64×64,也就是说,亮度块在128×128的尺寸下必定需要先进行四叉树划分,因此最大的亮度块尺寸是64×64。表5为亮度块的尺寸示意表,如表5所示,
表5
(4×4) (4×8) (4×16) (4×32) (4×64)
(8×4) (8×8) (8×16) (8×32) (8×64)
(16×4) (16×8) (16×16) (16×32) (16×64)
(32×4) (32×8) (32×16) (32×32) (32×64)
(64×4) (64×8) (64×16) (64×32) (64×64)
现有技术中,根据当前块的高度参数和宽度参数对MIP模式进行限制,具体地,如果当前块的宽高比大于4,或者高宽比大于4,则不通过MIP模式对当前块进行编码,表6为现有技术中MIP模式下亮度块尺寸的限制,如表6所示,
表6
Figure PCTCN2019092689-appb-000002
现有技术中,在MIP模式的第一类亮度块中(对应于4×4的亮度块),上相邻和左相邻亮度块各2个,经过矩阵运算,生成4×4的预测块;在MIP模式的第二类亮度块中(对应于4×8,8×4,8×8的亮度块),上相邻和左相邻亮度块各4个,经过矩阵运算,生成4×4的预测块;在MIP模式的第三类亮度块中(对应于其他大小的亮度块),上相邻和左相邻亮度块各4个,经过矩阵运算,生成4×8的预测块(4×16的亮度块),8×4的预测块(16×4的亮度块)或8×8的预测块(其他大小的亮度块)。其中,由于第三类亮度块会生成非正方形预测块,因此在计算时需要对矩阵进行奇数行的抽取。
进一步地,在语法中,可以通过MipSizeId表示MIP的应用类别,numModes表示MIP模式的数量,boundarySize表示下采样获得的上参考行或左参考列的亮度块个数,predW表示预测块的宽度参数,predH表示预测块的高度参数,predC表示MIP的矩阵的边长。表7为现有技术中MIP模式对应的语法关系,如表7所示,语法中的MipSizeId,numModes,boundarySize,predW,predH,predC有以下关系:
表7
MipSizeId numModes boundarySize predW predH predC
0 35 2 4 4 4
1 19 4 4 4 4
2 11 4 Min(nTbW,8) Min(nTbH,8) 8
进一步地,在语法中,MipSizeId取值为0表示4×4的亮度块,取值为1表示4×8,8×4,8×8的亮度块,取值为2表示其他大小的亮度块。numModes表示一共会有多少种MIP预测模式,即4×4的亮度块共有35种,4×8,8×4,8×8的亮度块共有19种,其他大小的亮度块共有11种。boundarySize表示当前块上行或左列的相邻亮度块最终被下采样成2个或4个相邻亮度块。
现有技术中,编码器在通过MIP模式进行亮度预测时,可以通过如下的公式(2)进行:
Figure PCTCN2019092689-appb-000003
其中,mWeight和vBias是各MIP模式通过深度学习训练出来的权重矩阵和偏置矩阵,具体地,mWeight为每一类MIP模式的权重矩阵,vBias为每一类MIP模式的偏置矩阵。sB为偏置矩阵的左移量,oW为四舍五入的保留值,sW为整体预测值的右移量,需要通过查表得到不同MIP模式下的sW值。
基于JVET-N1001-v7,在生成MIP的预测矩阵时,编码器是通过变量incW和incH来判断是否需要抽取奇数行的预测值,具体地:
oW=1<<(sW-1)
sB=BitDepth Y-1
mipW=isTransposed?predH:predW
mipH=isTransposed?predW:predH
incW=(predC>mipW)?2:1
incH=(predC>mipH)?2:1
其中,incW=2或incH=2代表需要在宽度参数或者高度参数上进行抽取。
表8为现有技术中的sW的语法描述,如表8所示,当且仅当MipSizeId等于1,即当前块尺寸为4×8,8×4,8×8,且MIP模式编号为3,8,12,17时,sW取值为9,其余所有MIP模式下sW取值都为8。其中,由于MIP模式下sW取值为映射关系,因此通过表8可以获得全部模式下的sW取值。
表8
Figure PCTCN2019092689-appb-000004
表9为MipSizeId为1,MIP模式编号为3和12时的mWeight矩阵。
表9
218 -56 9 -3 411 -76 12 -4
448 94 -45 6 23 -15 2 -3
-1 476 77 -34 -5 -2 1 -3
1 -16 466 61 5 -4 1 -3
-38 2 -3 0 260 358 -77 8
122 -39 1 -1 463 -25 -11 -2
405 54 -41 5 121 -33 2 -6
107 402 16 -12 3 -4 1 -6
5 -1 -1 0 -62 267 375 -73
-25 3 -4 -1 108 466 -28 -11
58 -25 -3 -1 418 96 -35 -3
301 18 -15 5 229 -21 -4 -7
-1 -3 -2 -2 24 -95 291 297
3 1 -5 -2 -30 103 464 -29
-16 0 -6 0 41 429 70 -13
27 -5 -2 1 303 193 -13 -1
表10为MipSizeId为1,MIP模式编号为3和12时的vBias矩阵。
表10
1 2 3 1 1 3 3 3 2 4 4 4 3 5 5 5
表11为MipSizeId为1,MIP模式编号为8和17时的mWeight矩阵。表12为MipSizeId为1,MIP模式编号为8和17时的vBias矩阵。
表11
-91 23 13 8 209 261 72 24
-26 -22 14 13 88 306 114 35
-16 18 -16 5 31 327 135 39
-11 11 30 -19 3 325 142 41
12 -4 1 1 -14 273 227 26
3 10 -3 -5 6 231 249 34
1 8 5 -9 10 214 262 37
-1 11 4 -7 15 208 259 40
5 0 4 -4 6 92 340 78
4 6 1 -5 6 113 329 75
2 13 2 -8 6 123 319 75
1 13 6 -10 9 136 303 74
6 1 4 -5 8 38 217 252
4 10 1 -7 9 58 313 141
3 12 4 -8 11 70 327 114
2 14 4 -7 14 82 314 110
表12
-7 -10 -11 -11 -10 -14 -17 -18 -11 -15 -19 -21 -10 -17 -21 -22
正是由于如表8所示的不同MIP模式下sW的不同语法描述,编码器在通过MIP模式进行亮度预测时,如果当前块的MipSizeId为1,即当前块为第二类亮度块(大小为4×8,8×4,8×8的亮度块),且当前编码块对应的MIP模式编号为3,8,12,17模式时,sW的取值会与其他模式不同,这造成了算法的不统一,且查询上述表8的流程增加了算法的时间复杂度,表8的存储也需要占用存储空间。也就是说,在通过MIP模式进行亮度预测时,尺寸不同的亮度块所采用的参数也有可能不同,因此,需要占用较大的存储空间对大量参数进行存储,且预测过程中对参数的查找和调用也增加了整体时间,从而降低了编解码效率。
为了解决上述问题,本申请提出了一种图像编码方法,通过修改第二类亮度块在3,8,12,17的MIP模式编号时sW的取值,使得所有MIP模式编号下的sW的取值均相同,从而减少了存储空间,通过省略查表的运算来降低整体时间。
进一步地,本申请提出的图像编码方法,可以影响视频编码混合框架中的帧内预测部分,即主要应用于视频编码中的帧内预测模块103和视频解码中的帧内预测模块203中,对编码端和解码端同时作用。
需要说明的是,在本申请的实施例中,基于机器学习方法训练所得计算用参数,本申请提出的图像编解码方法,可以按照数值固定的偏移参数对sW进行统一化修改,同时修改对应的权重矩阵和偏置矩阵。其中,在本申请中,并不局限于对第二类亮度块在3,8,12,17的MIP模式编号时sW的取值的修改,而是在具体参数(包括尺寸、模式、右移数值等参数的不同组合)变化后,对机器学习方法训练所得计算用参数,sW的不同取值情况统一化修改。
进一步地,在下述实施例中,以第二类亮度块在3,8,12,17的MIP模式编号时 sW的取值为例,对本申请提出的图像编解码方法进行示意性的说明。
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。
在本申请的一个实施例中,图7为本申请实施例提出的一种图像编码方法的实现流程示意图一,如图7所示,在本申请的实施例中,编码器进行图像编码的方法可以包括以下步骤。
步骤101、在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示。
在本申请的实施例中,在按照MIP模式进行编码处理之前,编码器可以先对用于指示偏移位数的偏移参数进行设定。
需要说明的是,在本申请的实施例中,基于上述公式(2),偏移参数即为公式(2)中的sW,即偏移参数为整体预测值的右移量,也就是说,在对当前块进行亮度预测时,偏移参数用于对当前块的整体预测值的右移位数进行指示。
进一步地,在本申请的实施例中,编码器可以在按照MIP模式进行编码处理之前,将偏移参数设定为一个固定的正整数。也就是说,编码器在对偏移参数进行设定之后,对于任意当前块,无论该当前块的尺寸大小为多少,也无论该当前块对应的MIP模式编号是多少,其使用的偏移参数都是确定的。
需要说明的是,在本申请的实施例中,编码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改时,可以将偏移参数设定为任意正整数。具体地,编码器可以优选将偏移参数sW设定为6,或者优选将偏移参数sW设定为7,或者优选将偏移参数sW设定为8,还可以优选将偏移参数sW设定为9。
例如,表13为本申请中的sW的语法描述一,在本申请的实施例中,编码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改时,对于尺寸为4×8,8×4或者8×8,且MIP模式编号为3,8,12或者17的亮度块,可以将其对应的sW设定为与其他亮度块对应的sW相同的数值,即其他亮度块对应的sW为8时,将尺寸为4×8,8×4或者8×8,且MIP模式编号为3,8,12或者17的亮度块对应的sW设定为8,从而可以使不同的当前块具有相同的偏移参数sW。
表13
Figure PCTCN2019092689-appb-000005
例如,表14为本申请中的sW的语法描述二,在本申请的实施例中,编码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改时,对于尺寸为4×8,8×4或者8×8,且MIP模式编号为3,8,12或者17的亮度块,可以将其对应的sW设定为与其他亮度块对应的sW相同的数值,即其他亮度块对应的sW为7时,将尺寸为4×8,8×4或者8×8,且MIP模式编号为3,8,12或者17的亮度块对应的sW设定为7,从而可以使不同的当前块具有相同的偏移参数sW。
表14
Figure PCTCN2019092689-appb-000006
例如,表15为本申请中的sW的语法描述二,在本申请的实施例中,编码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改时,对于尺寸为4×8,8×4或者8×8,且MIP模式编号为3,8,12或者17的亮度块,可以将其对应的sW设定为与其他亮度块对应的sW相同的数值,即其他亮度块对应的sW为8时,将尺寸为4×8,8×4或者8×8,且MIP模式编号为3,8,12或者17的亮度块对应的sW设定为8,从而可以使不同的当前块具有相同的偏移参数sW。
表15
Figure PCTCN2019092689-appb-000007
如上述表8所示,现有技术中,不同的当前块对应的偏移参数sW可能不同,具体地,当且仅当MipSizeId等于1,即当前块为第二类亮度块,尺寸为4×8,8×4,8×8,且MIP模式编号为3,8,12,17时,sW的取值与其余所有MIP模式编号下的sW取值不同。因此,编码器在对当前块进行编码时,需要根据当前块的尺寸和MIP模式编号进行偏移参数sW的查询和调用,从而增加了整体时间,降低了编解码效率,同时,由于需要对sW的语法描述表进行存储,也增加了存储空间。与现有技术相比,本申请在按照MIP模式进行编码处理之前,可以先对偏移参数sW进行设定,将不同尺寸、不同MIP模式编号的所有亮度块所对应的偏移参数sW都设定为同一个值,从而在对当前块进行编码时,不再需要根据当前块的尺寸和MIP模式编号进行偏移参数sW的查询和调用,且编码器也不需要对sW的语法描述表进行存储,进而能够减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
需要说明的是,在本申请的实施例中,虽然编码器在进行偏移参数sW的设定时,是对不同尺寸、不同MIP模式编号所对应的全部偏移参数sW设置为同一个值,但是由于当且仅当MipSizeId等于1,即当前块为第二类亮度块,尺寸为4×8,8×4,8×8,且MIP模式编号为3,8,12,17时,sW的取值与其余所有MIP模式编号的sW取值不同,因此,编码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改sW时,是对尺寸为4×8,8×4,8×8,且MIP模式编号为3,8,12,17所对应的偏移参数sW进行设定。
由此可见,在本申请的实施例中,编码器按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改的过程,即为当所述初始右移参数和所述偏移参数不相同时,将初始右移参数修改为偏移参数,以使全部尺寸和全部MIP模式编号所对应的全部预测值的右移位数均相同。
步骤102、在按照MIP模式进行编码处理时,根据偏移参数进行编码处理。
在本申请的实施例中,编码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改之后,当编码器按照MIP模式进行编码处理时,可以基于设定的偏移参数进行编码处理。
需要说明的是,在本申请的实施例中,编码器在对偏移参数进行设定之后,在按照MIP模式进行编码处理时,便可以直接根据偏移参数对当前块进行编码处理。从而可以在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
在本申请的实施例中,进一步地,图8为本申请实施例提出的一种图像编码方法的实现流程示意图二,如图8所示,编码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改之后,即步骤101之后,编码器进行图像编码的方法还可以包括以下步骤:
步骤103、按照预设计算规则对初始权重矩阵和初始偏置矩阵进行修改,获得修改后的权重矩阵和修改后的偏置矩阵;其中,初始权重矩阵和初始偏置矩阵与被统一化修改的初始右移参数相对应。
在本申请的实施例中,编码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改之后,便可以按照预设计算规则对初始权重矩阵和初始偏置矩阵,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。
需要说明的是,在本申请的实施中,初始权重矩阵和初始偏置矩阵与被统一化修改的初始右移参数相对应。
需要说明的是,在本申请的实施例中,预设计算规则可以用于在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,更新对应的初始权重矩阵和初始偏置矩阵。
进一步地,在本申请的实施例中,编码器在对偏移参数进行设定,即改变了尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17所对应的偏移参数之后,为了防止编解码性能减低,可以进一步对相应地初始权重矩阵和初始偏置矩阵进行更新处理,从而获得修改后的权重矩阵和修改后的偏置矩阵。
需要说明的是,在本申请的实施例中,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,编码器在按照预设计算规则获取修改后的权重矩阵和修改后的偏置矩阵时,可以通过多种不同的方法更新对应的初始权重矩阵和初始偏置矩阵。例如,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,编码器可以按照向下取整的计算规则,将初始权重矩阵中的任一个元素值A更新为A/2,同时将初始偏置矩阵中的任一个元素值B更新为B/2,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。其中,A和B均为整数。进一步地,编码器也可以按照向上取整的计算规则,将初始权重矩阵中的任一个元素值A更新为A/2,同时将初始偏置矩阵中的任一个元素值B更新为B/2,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。进一步地,编码器还可以按照四舍五入的计算规则,将初始权重矩阵中的任一个元素值A更新为A/2,同时将初始偏置矩阵中的任一个元素值B更新为B/2,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。
步骤104、根据偏移参数、修改后的权重矩阵以及修改后的偏置矩阵进行编码处理。
在本申请的实施例中,当编码器按照MIP模式进行编码处理时,可以基于设定的偏移参数、修改后的权重矩阵以及修改后的偏置矩阵进行编码处理。
需要说明的是,在本申请的实施例中,编码器在对偏移参数进行设定之后,为了放置编解码性能的降低,还将对应的初始权重矩阵和初始偏置矩阵进行更新,获得修改后的权重矩阵和修改后的偏置矩阵,然后在按照MIP模式进行编码处理时,便可以根据偏移参数、修改后的权重矩阵以及修改后的偏置矩阵对当前块进行编码处理。从而可以在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
需要说明的是,在本申请的实施例中,编码器在对偏移参数进行设定之后,也可以可以直接根据偏移参数、初始权重矩阵以及初始偏置矩阵对当前块进行编码处理。也就是说,编码器在完成偏移参数的设定之后,也可以不对相应地初始权重矩阵和初始偏置矩阵进行更新。
现有技术中,在通过MIP模式对当前块进行亮度预测值时,需要右移的位数不统一,即偏移参数sW不相同,而本申请提出的图像编码方法,将偏移参数进行统一设定,使得MIP模式的实现更加简洁统一;进一步地,正是由于现有技术中偏移参数sW不相同,因此需要存储表征右移位数的sW表,并在计算过程中,对当前块对应的sW进行查询和调用,从而确定MIP计算的预测值需要右移的位数,而本申请提出的图像编码方法,由于将偏移参数进行统一设定,因此不再需要存储表征右移位数的sW表,从而节省存储空间,同时省去查询和调用sW的处理流程。
进一步地,在本申请的实施例中,编码器在对偏移参数进行设定之后,还可以将对应的初始权重矩阵和初始偏置矩阵进行更新,使得编解码性能没有明显损失。具体地,根据VVC的通测标准,Y、U、V上的BD-rate分别为0.00%、-0.02%、-0.02%,其中,24帧间隔下的结果,预计8帧间隔的编解码性能相似。
本申请实施例提出的一种图像编码方法,编码器在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示;以及,在按照MIP模式进行编码处理时,根据偏移参数进行编码处理。由此可见,本申请提出的图像编解码方法,通过利用偏移参数对预测值的右移位数进行统一化修改,使不同尺寸、不同MIP模式编号的全部亮度块具有相同的sW值,从而在进行编解码处理时,不需要对sW值进行查询和调用,可以降低MIP算法的复杂度,能够在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
基于上述实施例,在本申请的另一实施例中,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,编码器按照预设计算规则获取修改后的权重矩阵和修改后的偏置矩阵的方法可以包括以下步骤:
步骤103a、按照向下取整的计算规则,将初始权重矩阵中的全部元素值修改为与其他权重矩阵元素值相同二进制数量级的值,以获得修改后的权重矩阵。
步骤103b、按照向下取整的计算规则,将初始偏置矩阵中的全部元素修改为与其他偏置矩阵元素值相同二进制数量级的值,以获得修改后的偏置矩阵。
在本申请的实施例中,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,编码器可以按照向下取整的计算规则,将初始权重矩阵中的全部元素值修改为与其他权重矩阵元素值相同二进制数量级的值,同时将初始偏置矩阵中的全部元素修改为与其他偏置矩阵元素值相同二进制数量级的值,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。
基于上述表9,表16为MipSizeId为1,MIP模式编号为3和12时的修改后的权重矩阵,如表16所示,编码器按照向下取整的计算规则,将表9中的每一个元素值A更新为A/2,从而获得MipSizeId为1,MIP模式编号为3和12时的修改后的权重矩阵。
表16
109 -28 4 -2 205 -38 6 -2
224 47 -23 3 11 -8 1 -2
-1 238 38 -17 -3 -1 0 -2
0 -8 233 30 2 -2 0 -2
-19 1 -2 0 130 179 -39 4
61 -20 0 -1 231 -13 -6 -1
202 27 -21 2 60 -17 1 -3
53 201 8 -6 1 -2 0 -3
2 -1 -1 0 -31 133 187 -37
-13 1 -2 -1 54 233 -14 -6
29 -13 -2 -1 209 48 -18 -2
150 9 -8 2 114 -11 -2 -4
-1 -2 -1 -1 12 -48 145 148
1 0 -3 -1 -15 51 232 -15
-8 0 -3 0 20 214 35 -7
13 -3 -1 0 151 96 -7 -1
基于上述表10,表17为MipSizeId为1,MIP模式编号为3和12时的修改后的偏置矩阵,如表17所示,编码器按照向下取整的计算规则,将表10中的每一个元素值B更新为B/2,从而获得MipSizeId为1,MIP模式编号为3和12时的修改后的偏置矩阵。
表17
0 1 1 0 0 1 1 1 1 2 2 2 1 2 2 2
基于上述表11,表18为MipSizeId为1,MIP模式编号为8和17时的修改后的权重矩阵,如表18所示,编码器按照向下取整的计算规则,将表11中的每一个元素值A更新为A/2,从而获得MipSizeId为1,MIP模式编号为8和17时的修改后的权重矩阵。
表18
-46 11 6 4 104 130 36 12
-13 -11 7 6 44 153 57 17
-8 9 -8 2 15 163 67 19
-6 5 15 -10 1 162 71 20
6 -2 0 0 -7 136 113 13
1 5 -2 -3 3 115 124 17
0 4 2 -5 5 107 131 18
-1 5 2 -4 7 104 129 20
2 0 2 -2 3 46 170 39
2 3 0 -3 3 56 164 37
1 6 1 -4 3 61 159 37
0 6 3 -5 4 68 151 37
3 0 2 -3 4 19 108 126
2 5 0 -4 4 29 156 70
1 6 2 -4 5 35 163 57
1 7 2 -4 7 41 157 55
基于上述表12,表19为MipSizeId为1,MIP模式编号为8和17时的修改后的偏置矩阵,如表22所示,编码器按照向下取整的计算规则,将表12中的每一个元素值B更新为B/2,从而获得MipSizeId为1,MIP模式编号为8和17时的修改后的偏置矩阵。
表19
-4 -5 -6 -6 -5 -7 -9 -9 -6 -8 -10 -11 -5 -9 -11 -11
在本申请的实施例中,进一步地,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,编码器按照预设计算规则获取修改后的权重矩阵和修改后的偏置矩阵的方法可以包括以下步骤:
步骤103c、按照向上取整的计算规则,将初始权重矩阵中的全部元素值修改为与其他权重矩阵元素值相同二进制数量级的值,以获得修改后的权重矩阵。
步骤103d、按照向上取整的计算规则,将初始偏置矩阵中的全部元素修改为与其他偏置矩阵元素值相同二进制数量级的值,以获得修改后的偏置矩阵。
在本申请的实施例中,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,编码器可以按照向上取整的计算规则,将初始权重矩阵中的全部元素值修改为与其他权重矩阵元素值相同二进制数量级的值,同时将初始偏置矩阵中的全部元素修改为与其他偏置矩阵元素值相同二进制数量级的值,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。
基于上述表9,表20为MipSizeId为1,MIP模式编号为3和12时的修改后的权重矩阵,如表20所示,编码器按照向上取整的计算规则,将表9中的每一个元素值A更新为A/2,从而获得MipSizeId为1,MIP模式编号为3和12时的修改后的权重矩阵。
表20
109 -28 5 -1 206 -38 6 -2
224 47 -22 3 12 -7 1 -1
0 238 39 -17 -2 -1 1 -1
1 -8 233 31 3 -2 1 -1
-19 1 -1 0 130 179 -38 4
61 -19 1 0 232 -12 -5 -1
203 27 -20 3 61 -16 1 -3
54 201 8 -6 2 -2 1 -3
3 0 0 0 -31 134 188 -36
-12 2 -2 0 54 233 -14 -5
29 -12 -1 0 209 48 -17 -1
151 9 -7 3 115 -10 -2 -3
0 -1 -1 -1 12 -47 146 149
2 1 -2 -1 -15 52 232 -14
-8 0 -3 0 21 215 35 -6
14 -2 -1 1 152 97 -6 0
基于上述表10,表21为MipSizeId为1,MIP模式编号为3和12时的修改后的偏置矩阵,如表21所示,编码器按照向上取整的计算规则,将表10中的每一个元素值B更新为B/2,从而获得MipSizeId为1,MIP模式编号为3和12时的修改后的偏置矩阵。
表21
1 1 2 1 1 2 2 2 1 2 2 2 2 3 3 3
基于上述表11,表22为MipSizeId为1,MIP模式编号为8和17时的修改后的权重矩阵,如表22所示,编码器按照向上取整的计算规则,将表11中的每一个元素值A更新为A/2,从而获得MipSizeId为1,MIP模式编号为8和17时的修改后的权重矩阵。
表22
-45 12 7 4 105 131 36 12
-13 -11 7 7 44 153 57 18
-8 9 -8 3 16 164 68 20
-5 6 15 -9 2 163 71 21
6 -2 1 1 -7 137 114 13
2 5 -1 -2 3 116 125 17
1 4 3 -4 5 107 131 19
0 6 2 -3 8 104 130 20
3 0 2 -2 3 46 170 39
2 3 1 -2 3 57 165 38
1 7 1 -4 3 62 160 38
1 7 3 -5 5 68 152 37
3 1 2 -2 4 19 109 126
2 5 1 -3 5 29 157 71
2 6 2 -4 6 35 164 57
1 7 2 -3 7 41 157 55
基于上述表12,表23为MipSizeId为1,MIP模式编号为8和17时的修改后的偏置矩阵,如表23所示,编码器按照向上取整的计算规则,将表12中的每一个元素值B更新为B/2,从而获得MipSizeId为1,MIP模式编号为8和17时的修改后的偏置矩阵。
表23
-3 -5 -5 -5 -5 -7 -8 -9 -5 -7 -9 -10 -5 -8 -10 -11
在本申请的实施例中,进一步地,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,编码器按照预设计算规则获取修改后的权重矩阵和修改后的偏置矩阵的方法可以包括以下步骤:
步骤103e、按照四舍五入的计算规则,将初始权重矩阵中的全部元素值修改为与其他权重矩阵元素值相同二进制数量级的值,以获得修改后的权重矩阵。
步骤103f、按照四舍五入的计算规则,将初始偏置矩阵中的全部元素修改为与其他偏置矩阵元素值相同二进制数量级的值,以获得修改后的偏置矩阵。
在本申请的实施例中,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,编码器可以按照四舍五入的计算规则,将初始权重矩阵中的全部元素值修改为与其他权重矩阵元素值相同二进制数量级的值,同时将初始偏置矩阵中的全部元素修改为与其他偏置矩阵元素值相同二进制数量级的值,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。
基于上述表9,表24为MipSizeId为1,MIP模式编号为3和12时的修改后的权重矩阵,如表24所示,编码器按照四舍五入的计算规则,将表9中的每一个元素值A更新为A/2,从而获得MipSizeId为1,MIP模式编号为3和12时的修改后的权重矩阵。
表24
109 -28 5 -2 206 -38 6 -2
224 47 -23 3 12 -8 1 -2
-1 238 39 -17 -3 -1 1 -2
1 -8 233 31 3 -2 1 -2
-19 1 -2 0 130 179 -39 4
61 -20 1 -1 232 -13 -6 -1
203 27 -21 3 61 -17 1 -3
54 201 8 -6 2 -2 1 -3
3 -1 -1 0 -31 134 188 -37
-13 2 -2 -1 54 233 -14 -6
29 -13 -2 -1 209 48 -18 -2
151 9 -8 3 115 -11 -2 -4
-1 -2 -1 -1 12 -48 146 149
2 1 -3 -1 -15 52 232 -15
-8 0 -3 0 21 215 35 -7
14 -3 -1 1 152 97 -7 -1
基于上述表10,表25为MipSizeId为1,MIP模式编号为3和12时的修改后的偏置矩阵,如表25所示,编码器按照四舍五入的计算规则,将表10中的每一个元素值B更新为B/2,从而获得MipSizeId为1,MIP模式编号为3和12时的修改后的偏置矩阵。
表25
1 1 2 1 1 2 2 2 1 2 2 2 2 3 3 3
基于上述表11,表26为MipSizeId为1,MIP模式编号为8和17时的修改后的权重矩阵,如表26所示,编码器按照四舍五入的计算规则,将表11中的每一个元素值A更新为A/2,从而获得MipSizeId为1,MIP模式编号为8和17时的修改后的权重矩阵。
表26
-46 12 7 4 105 131 36 12
-13 -11 7 7 44 153 57 18
-8 9 -8 3 16 164 68 20
-6 6 15 -10 2 163 71 21
6 -2 1 1 -7 137 114 13
2 5 -2 -3 3 116 125 17
1 4 3 -5 5 107 131 19
-1 6 2 -4 8 104 130 20
3 0 2 -2 3 46 170 39
2 3 1 -3 3 57 165 38
1 7 1 -4 3 62 160 38
1 7 3 -5 5 68 152 37
3 1 2 -3 4 19 109 126
2 5 1 -4 5 29 157 71
2 6 2 -4 6 35 164 57
1 7 2 -4 7 41 157 55
基于上述表12,表27为MipSizeId为1,MIP模式编号为8和17时的修改后的偏置矩阵,如表30所示,编码器按照四舍五入的计算规则,将表12中的每一个元素值B更新为B/2,从而获得MipSizeId为1,MIP模式编号为8和17时的修改后的偏置矩阵。
表27
-4 -5 -6 -6 -5 -7 -9 -9 -6 -8 -10 -11 -5 -9 -11 -11
本申请实施例提出的一种图像编码方法,编码器在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示;以及,在按照MIP模式进行编码处理时,根据偏移参数进行编码处理。由此可见,本申请提出的图像编解码方法,通过利用偏移参数对预测值的右移位数进行统一化修改,使不同尺寸、不同MIP模式编号的全部亮度块具有相同的sW值,从而在进行编解码处理时,不需要对sW值进行查询和调用,可以降低MIP算法的复杂度,能够在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
在本申请的另一个实施例中,图9为本申请实施例提出的一种图像解码方法的实现流程示意图一,如图9所示,在本申请的实施例中,解码器进行图像解码的方法可以包括以下步骤。
步骤201、在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示。
在本申请的实施例中,在按照MIP模式进行解码处理之前,解码器可以先对用于指示偏移位数的偏移参数进行设定。
需要说明的是,在本申请的实施例中,基于上述公式(2),偏移参数即为公式(2)中的sW,即偏移参数为整体预测值的右移量,也就是说,在对当前块进行亮度预测时, 偏移参数用于对当前块的整体预测值的右移位数进行指示。
进一步地,在本申请的实施例中,解码器可以在按照MIP模式进行解码处理之前,将偏移参数设定为一个固定的正整数。也就是说,解码器在对偏移参数进行设定之后,对于任意当前块,无论该当前块的尺寸大小为多少,也无论该当前块对应的MIP模式编号是多少,其使用的偏移参数都是确定的。
需要说明的是,在本申请的实施例中,解码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改时,可以将偏移参数设定为任意正整数。具体地,解码器可以优选将偏移参数sW设定为6,或者优选将偏移参数sW设定为7,或者优选将偏移参数sW设定为8,还可以优选将偏移参数sW设定为9。
现有技术中,不同的当前块对应的偏移参数sW可能不同,具体地,当且仅当MipSizeId等于1,即当前块为第二类亮度块,尺寸为4×8,8×4,8×8,且MIP模式编号为3,8,12,17时,sW的取值与其余所有MIP模式编号下的sW取值不同。因此,解码器在对当前块进行解码时,需要根据当前块的尺寸和MIP模式编号进行偏移参数sW的查询和调用,从而增加了整体时间,降低了编解码效率,同时,由于需要对sW的语法描述表进行存储,也增加了存储空间。与现有技术相比,本申请在按照MIP模式进行解码处理之前,可以先对偏移参数sW进行设定,将不同尺寸、不同MIP模式编号的所有亮度块所对应的偏移参数sW都设定为同一个值,从而在对当前块进行解码时,不再需要根据当前块的尺寸和MIP模式编号进行偏移参数sW的查询和调用,且解码器也不需要对sW的语法描述表进行存储,进而能够减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
需要说明的是,在本申请的实施例中,虽然解码器在进行偏移参数sW的设定时,是对不同尺寸、不同MIP模式编号所对应的全部偏移参数sW设置为同一个值,但是由于当且仅当MipSizeId等于1,即当前块为第二类亮度块,尺寸为4×8,8×4,8×8,且MIP模式编号为3,8,12,17时,sW的取值与其余所有MIP模式编号的sW取值不同,因此,解码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改sW时,是对尺寸为4×8,8×4,8×8,且MIP模式编号为3,8,12,17所对应的偏移参数sW进行设定。
由此可见,在本申请的实施例中,解码器按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改的过程,即为当初始右移参数和偏移参数不相同时,将初始右移参数修改为偏移参数,以使全部尺寸和全部MIP模式编号所对应的全部预测值的右移位数均相同。
步骤202、在按照MIP模式进行解码处理时,根据偏移参数进行解码处理。
在本申请的实施例中,解码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改之后,当解码器按照MIP模式进行解码处理时,可以基于设定的偏移参数进行解码处理。
需要说明的是,在本申请的实施例中,解码器在对偏移参数进行设定之后,在按照MIP模式进行解码处理时,便可以直接根据偏移参数对当前块进行解码处理。从而可以在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
在本申请的实施例中,进一步地,图10为本申请实施例提出的一种图像解码方法的实现流程示意图二,如图10所示,解码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改之后,即步骤201之后,解码器进行图像解码的方法还可以包括以下步骤:
步骤203、按照预设计算规则对初始权重矩阵和初始偏置矩阵进行修改,获得修改 后的权重矩阵和修改后的偏置矩阵;其中,初始权重矩阵和初始偏置矩阵与被统一化修改的初始右移参数相对应。
在本申请的实施例中,解码器在按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改之后,便可以按照预设计算规则对初始权重矩阵和初始偏置矩阵,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。
需要说明的是,在本申请的实施中,初始权重矩阵和初始偏置矩阵与被统一化修改的初始右移参数相对应。
需要说明的是,在本申请的实施例中,预设计算规则可以用于在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,更新对应的初始权重矩阵和初始偏置矩阵。
进一步地,在本申请的实施例中,解码器在对偏移参数进行设定,即改变了尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17所对应的偏移参数之后,为了防止编解码性能减低,可以进一步对相应地初始权重矩阵和初始偏置矩阵进行更新处理,从而获得修改后的权重矩阵和修改后的偏置矩阵。
需要说明的是,在本申请的实施例中,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,解码器在按照预设计算规则获取修改后的权重矩阵和修改后的偏置矩阵时,可以通过多种不同的方法更新对应的初始权重矩阵和初始偏置矩阵。例如,在尺寸为4×8、8×4或者8×8,且MIP模式编号为3、8、12或者17时,解码器可以按照向下取整的计算规则,将初始权重矩阵中的任一个元素值A更新为A/2,同时将初始偏置矩阵中的任一个元素值B更新为B/2,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。其中,A和B均为整数。进一步地,解码器也可以按照向上取整的计算规则,将初始权重矩阵中的任一个元素值A更新为A/2,同时将初始偏置矩阵中的任一个元素值B更新为B/2,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。进一步地,解码器还可以按照四舍五入的计算规则,将初始权重矩阵中的任一个元素值A更新为A/2,同时将初始偏置矩阵中的任一个元素值B更新为B/2,从而可以获得修改后的权重矩阵和修改后的偏置矩阵。
步骤204、根据偏移参数、修改后的权重矩阵以及修改后的偏置矩阵进行解码处理。
在本申请的实施例中,当解码器按照MIP模式进行解码处理时,可以基于设定的偏移参数、修改后的权重矩阵以及修改后的偏置矩阵进行解码处理。
需要说明的是,在本申请的实施例中,解码器在对偏移参数进行设定之后,为了放置编解码性能的降低,还将对应的初始权重矩阵和初始偏置矩阵进行更新,获得修改后的权重矩阵和修改后的偏置矩阵,然后在按照MIP模式进行解码处理时,便可以根据偏移参数、修改后的权重矩阵以及修改后的偏置矩阵对当前块进行解码处理。从而可以在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
需要说明的是,在本申请的实施例中,解码器在对偏移参数进行设定之后,也可以可以直接根据偏移参数、初始权重矩阵以及初始偏置矩阵对当前块进行解码处理。也就是说,解码器在完成偏移参数的设定之后,也可以不对相应地初始权重矩阵和初始偏置矩阵进行更新。
现有技术中,在通过MIP模式对当前块进行亮度预测值时,需要右移的位数不统一,即偏移参数sW不相同,而本申请提出的图像解码方法,将偏移参数进行统一设定,使得MIP模式的实现更加简洁统一;进一步地,正是由于现有技术中偏移参数sW不相同,因此需要存储表征右移位数的sW表,并在计算过程中,对当前块对应的sW进行查询和调用,从而确定MIP计算的预测值需要右移的位数,而本申请提出的图像解码方法, 由于将偏移参数进行统一设定,因此不再需要存储表征右移位数的sW表,从而节省存储空间,同时省去查询和调用sW的处理流程。
本申请实施例提出的一种图像解码方法,解码器在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示;以及,在按照MIP模式进行解码处理时,根据偏移参数进行解码处理。由此可见,本申请提出的图像编解码方法,通过利用偏移参数对预测值的右移位数进行统一化修改,使不同尺寸、不同MIP模式编号的全部亮度块具有相同的sW值,从而在进行编解码处理时,不需要对sW值进行查询和调用,可以降低MIP算法的复杂度,能够在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
基于上述实施例,在本申请的再一实施例中,图11为本申请实施例提出的编码器的组成结构示意图一,如图11所示,本申请实施例提出的编码器300可以包括第一修改部分301和编码部分302。
所述第一修改部分301,配置于在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示。
所述编码部分302,配置于在按照所述MIP模式进行编码处理时,根据所述偏移参数进行编码处理。
所述第一修改部分301,具体配置于当所述初始右移参数和所述偏移参数不相同时,将所述初始右移参数修改为所述偏移参数,以使全部尺寸和全部MIP模式编号所对应的全部预测值的右移位数均相同。
图12为本申请实施例提出的编码器的组成结构示意图二,如图12所示,本申请实施例提出的编码器300还可以包括第一处理器303、存储有第一处理器303可执行指令的第一存储器304、第一通信接口305,和用于连接第一处理器303、第一存储器304以及第一通信接口305的第一总线306。
进一步地,在本申请的实施例中,上述第一处理器303,用于在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;以及,在按照所述MIP模式进行编码处理时,根据所述偏移参数进行编码处理。
另外,在本实施例中的各功能模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。
集成的单元如果以软件功能模块的形式实现并非作为独立的产品进行销售或使用时,可以存储在一个计算机可读取存储介质中,基于这样的理解,本实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或processor(处理器)执行本实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
本申请实施例提供了一种编码器,该编码器在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示;以及,在按照MIP模式进行编码处理时,根据偏移参数进行编码处理。由此可见,本申请提出的图像编解码方法,通过利用 偏移参数对预测值的右移位数进行统一化修改,使不同尺寸、不同MIP模式编号的全部亮度块具有相同的sW值,从而在进行编解码处理时,不需要对sW值进行查询和调用,可以降低MIP算法的复杂度,能够在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
图13为本申请实施例提出的解码器的组成结构示意图一,如图13所示,本申请实施例提出的解码器400可以包括第二修改部分401和解码部分402。
所述第二修改部分401,配置于在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示。
所述解码部分402,配置于在按照所述MIP模式进行解码处理时,根据所述偏移参数进行解码处理。
所述第二修改部分401,具体配置于当所述初始右移参数和所述偏移参数不相同时,将所述初始右移参数修改为所述偏移参数,以使全部尺寸和全部MIP模式编号所对应的全部预测值的右移位数均相同。
图14为本申请实施例提出的解码器的组成结构示意图二,如图14所示,本申请实施例提出的解码器400还可以包括第二处理器403、存储有第二处理器403可执行指令的第二存储器404、第二通信接口405,和用于连接第二处理器403、第饿存储器404以及第二通信接口405的第二总线406。
进一步地,在本申请的实施例中,上述第二处理器403,用于在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;以及,在按照所述MIP模式进行解码处理时,根据所述偏移参数进行解码处理。
另外,在本实施例中的各功能模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。
集成的单元如果以软件功能模块的形式实现并非作为独立的产品进行销售或使用时,可以存储在一个计算机可读取存储介质中,基于这样的理解,本实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或processor(处理器)执行本实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
本申请实施例提供了一种编码器,该解码器在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;以及,在按照MIP模式进行解码处理时,根据偏移参数进行解码处理。由此可见,本申请提出的图像编解码方法,通过利用偏移参数对预测值的右移位数进行统一化修改,使不同尺寸、不同MIP模式编号的全部亮度块具有相同的sW值,从而在进行编解码处理时,不需要对sW值进行查询和调用,可以降低MIP算法的复杂度,能够在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。
本申请实施例提供计算机可读存储介质和计算机可读存储介质,其上存储有程序,该程序被处理器执行时实现如上述实施例所述的方法。
具体来讲,本实施例中的一种图像编码方法对应的程序指令可以被存储在光盘,硬盘,U盘等存储介质上,当存储介质中的与一种图像编码方法对应的程序指令被一电子 设备读取或被执行时,包括如下步骤:
在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;以及,
在按照所述MIP模式进行编码处理时,根据所述偏移参数进行编码处理。
具体来讲,本实施例中的一种图像解码方法对应的程序指令可以被存储在光盘,硬盘,U盘等存储介质上,当存储介质中的与一种图像解码方法对应的程序指令被一电子设备读取或被执行时,包括如下步骤:
在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;以及,
在按照所述MIP模式进行解码处理时,根据所述偏移参数进行解码处理。
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的实现流程示意图和/或方框图来描述的。应理解可由计算机程序指令实现流程示意图和/或方框图中的每一流程和/或方框、以及实现流程示意图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在实现流程示意图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在实现流程示意图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在实现流程示意图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
以上所述,仅为本申请的较佳实施例而已,并非用于限定本申请的保护范围。
工业实用性
本申请实施例提供了一种图像编解码方法、编码器、解码器以及存储介质,编码器在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,偏移参数用于对预测值的右移位数进行指示;以及,在按照MIP模式进行编码处理时,根据偏移参数进行编码处理。解码器在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;以及,在按照MIP模式进行解码处理时,根据偏移参数进行解码处理。由此可见,本申请提出的图像编解码方法,通过利用偏移参数对预测值的右移位数进行统一化修改,使不同尺寸、不同MIP模式编号的全部亮度块具有相同 的sW值,从而在进行编解码处理时,不需要对sW值进行查询和调用,可以降低MIP算法的复杂度,能够在保证编解码性能的基础上,减小编解码过程中所需要的存储空间和整体时间,有效地提高编解码效率。

Claims (16)

  1. 一种图像编码方法,应用于编码器,所述方法包括:
    在按照基于矩阵的帧内预测MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;以及,
    在按照所述MIP模式进行编码处理时,根据所述偏移参数进行编码处理。
  2. 根据权利要求1所述的方法,其中,所述按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改,包括:
    当所述初始右移参数和所述偏移参数不相同时,将所述初始右移参数修改为所述偏移参数,以使全部尺寸和全部MIP模式编号所对应的全部预测值的右移位数均相同。
  3. 根据权利要求1所述的方法,其中,所述按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改之后,所述方法还包括:
    按照预设计算规则对初始权重矩阵和初始偏置矩阵进行修改,获得修改后的权重矩阵和修改后的偏置矩阵;其中,所述初始权重矩阵和所述初始偏置矩阵与被统一化修改的初始右移参数相对应;
    根据所述偏移参数、所述修改后的权重矩阵以及所述修改后的偏置矩阵进行编码处理。
  4. 根据权利要求3所述的方法,其中,所述按照预设计算规则对初始权重矩阵和初始偏置矩阵进行修改,获取修改后的权重矩阵和修改后的偏置矩阵,包括:
    按照向下取整的计算规则,将所述初始权重矩阵中的全部元素值修改为与其他权重矩阵元素值相同二进制数量级的值,以获得所述修改后的权重矩阵;
    按照向下取整的计算规则,将所述初始偏置矩阵中的全部元素修改为与其他偏置矩阵元素值相同二进制数量级的值,以获得所述修改后的偏置矩阵。
  5. 根据权利要求3所述的方法,其中,所述按照预设计算规则获取修改后的权重矩阵和修改后的偏置矩阵,包括:
    按照向上取整的计算规则,将所述初始权重矩阵中的全部元素值修改为与其他权重矩阵元素值相同二进制数量级的值,以获得所述修改后的权重矩阵;
    按照向上取整的计算规则,将所述初始偏置矩阵中的全部元素修改为与其他偏置矩阵元素值相同二进制数量级的值,以获得所述修改后的偏置矩阵。
  6. 根据权利要求3所述的方法,其中,所述按照预设计算规则获取修改后的权重矩阵和修改后的偏置矩阵,包括:
    按照四舍五入的计算规则,将所述初始权重矩阵中的全部元素值修改为与其他权重矩阵元素值相同二进制数量级的值,以获得所述修改后的权重矩阵;
    按照四舍五入的计算规则,将所述初始偏置矩阵中的全部元素修改为与其他偏置矩阵元素值相同二进制数量级的值,以获得所述修改后的偏置矩阵;其中,所述B为整数。
  7. 一种图像解码方法,应用于解码器,所述方法包括:
    在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;以及,
    在按照所述MIP模式进行解码处理时,根据所述偏移参数进行解码处理。
  8. 根据权利要求7所述的方法,其中,所述按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改,包括:
    当所述初始右移参数和所述偏移参数不相同时,将所述初始右移参数修改为所述偏移参数,以使全部尺寸和全部MIP模式编号所对应的全部预测值的右移位数均相同。
  9. 根据权利要求8所述的方法,其中,所述按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改之后,所述方法还包括:
    按照预设计算规则对初始权重矩阵和初始偏置矩阵进行修改,获得修改后的权重矩阵和修改后的偏置矩阵;其中,所述初始权重矩阵和所述初始偏置矩阵与被统一化修改的初始右移参数相对应;
    根据所述偏移参数、所述修改后的权重矩阵以及所述修改后的偏置矩阵进行编码处理。
  10. 一种编码器,所述编码器包括:第一修改部分和编码部分,
    所述第一修改部分,配置于在按照MIP模式进行编码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;
    所述编码部分,配置于在按照所述MIP模式进行编码处理时,根据所述偏移参数进行编码处理。
  11. 根据权利要求10所述的编码器,其中,
    所述第一修改部分,具体配置于当所述初始右移参数和所述偏移参数不相同时,将所述初始右移参数修改为所述偏移参数,以使全部尺寸和全部MIP模式编号所对应的全部预测值的右移位数均相同。
  12. 一种解码器,所述解码器包括:第二修改部分和解码部分,
    所述第二修改部分,配置于在按照MIP模式进行解码处理之前,按照偏移参数对不同尺寸和不同MIP模式编号所对应的初始右移参数进行统一化修改;其中,所述偏移参数用于对预测值的右移位数进行指示;
    所述解码部分,配置于在按照所述MIP模式进行解码处理时,根据所述偏移参数进行解码处理。
  13. 根据权利要求12所述的解码器,其中,
    所述第二修改部分,具体配置于当所述初始右移参数和所述偏移参数不相同时,将所述初始右移参数修改为所述偏移参数,以使全部尺寸和全部MIP模式编号所对应的全部预测值的右移位数均相同。
  14. 一种编码器,所述编码器包括第一处理器、存储有所述第一处理器可执行指令的第一存储器、第一通信接口,和用于连接所述第一处理器、所述第一存储器以及所述第一通信接口的第一总线,当所述指令被所述第一处理器执行时,实现如权利要求1-6任一项所述的方法。
  15. 一种解码器,所述解码器包括第二处理器、存储有所述第二处理器可执行指令的第二存储器、第二通信接口,和用于连接所述第二处理器、所述第二存储器以及所述第一通信接口的第二总线,当所述指令被所述第二处理器执行时,实现如权利要求7-9任一项所述的方法。
  16. 一种计算机可读存储介质,其上存储有程序,应用于编码器和解码器中,所述程序被处理器执行时,实现如权利要求1-9任一项所述的方法。
PCT/CN2019/092689 2019-06-25 2019-06-25 图像编解码方法、编码器、解码器以及存储介质 WO2020258010A1 (zh)

Priority Applications (23)

Application Number Priority Date Filing Date Title
EP23170496.6A EP4228256A1 (en) 2019-06-25 2019-06-25 Image encoding method, image decoding method, decoder and storage medium for picture coding in mip mode
AU2019455073A AU2019455073A1 (en) 2019-06-25 2019-06-25 Image encoding method, image decoding method, encoder, decoder and storage medium
BR112021006724A BR112021006724A2 (pt) 2019-06-25 2019-06-25 Método de conversão de figuração em código aplicado a um codificador, método de decodificação de figuração aplicado a um decodificador, decodificador, e mídia de armazenamento legível por computador
KR1020217016992A KR20220023324A (ko) 2019-06-25 2019-06-25 이미지 인코딩 방법, 이미지 디코딩 방법, 인코더, 디코더 및 저장 매체
JP2021568185A JP7448563B2 (ja) 2019-06-25 2019-06-25 画像コーデック方法、エンコーダ、デコーダおよび記憶媒体
CN201980048358.2A CN112514381A (zh) 2019-06-25 2019-06-25 图像编解码方法、编码器、解码器以及存储介质
EP19935158.6A EP3820151B1 (en) 2019-06-25 2019-06-25 Image encoding method, image decoding method, encoder, decoder and storage medium
SG11202102562WA SG11202102562WA (en) 2019-06-25 2019-06-25 Image encoding method, image decoding method, encoder, decoder and storage medium
CN202210766458.2A CN115150612A (zh) 2019-06-25 2019-06-25 图像编解码方法、编码器、解码器以及存储介质
MX2021004541A MX2021004541A (es) 2019-06-25 2019-06-25 Metodo de codificacion de imagenes, metodo de decodificacion de imagenes, codificador, decodificador y medio de almacenamiento.
CN202110310256.2A CN113068032B (zh) 2019-06-25 2019-06-25 图像编解码方法、编码器、解码器以及存储介质
PCT/CN2019/092689 WO2020258010A1 (zh) 2019-06-25 2019-06-25 图像编解码方法、编码器、解码器以及存储介质
CA3208670A CA3208670A1 (en) 2019-06-25 2019-06-25 Image encoding method, image decoding method, encoder, decoder and storage medium
ES19935158T ES2950980T3 (es) 2019-06-25 2019-06-25 Método de codificación de imágenes, método de decodificación de imágenes, codificador, decodificador y medio de almacenamiento
CA3112849A CA3112849C (en) 2019-06-25 2019-06-25 Image encoding method, image decoding method, encoder, decoder and storage medium
IL281400A IL281400B2 (en) 2019-06-25 2019-06-25 Image encoding method, image decoding method, encoder, decoder and storage medium
PL19935158.6T PL3820151T3 (pl) 2019-06-25 2019-06-25 Sposób kodowania obrazu, sposób dekodowania obrazu, koder, dekoder i nośnik danych
IL309549A IL309549A (en) 2019-06-25 2019-06-25 Image encoding method, image decoding method, encoder, decoder and storage medium
PH12021550517A PH12021550517A1 (en) 2019-06-25 2021-03-10 Image encoding method, image decoding method, encoder, decoder and storage medium
ZA2021/01697A ZA202101697B (en) 2019-06-25 2021-03-12 Image encoding method, image decoding method, encoder, decoder and storage medium
US17/211,636 US11146798B2 (en) 2019-06-25 2021-03-24 Picture encoding method, picture decoding method, encoder, decoder and storage medium
US17/382,932 US20210352298A1 (en) 2019-06-25 2021-07-22 Picture encoding method, picture decoding method, encoder, decoder and storage medium
JP2024030632A JP2024059922A (ja) 2019-06-25 2024-02-29 画像コーデック方法、エンコーダ、デコーダおよび記憶媒体

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/092689 WO2020258010A1 (zh) 2019-06-25 2019-06-25 图像编解码方法、编码器、解码器以及存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/211,636 Continuation US11146798B2 (en) 2019-06-25 2021-03-24 Picture encoding method, picture decoding method, encoder, decoder and storage medium

Publications (1)

Publication Number Publication Date
WO2020258010A1 true WO2020258010A1 (zh) 2020-12-30

Family

ID=74059827

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/092689 WO2020258010A1 (zh) 2019-06-25 2019-06-25 图像编解码方法、编码器、解码器以及存储介质

Country Status (16)

Country Link
US (2) US11146798B2 (zh)
EP (2) EP4228256A1 (zh)
JP (2) JP7448563B2 (zh)
KR (1) KR20220023324A (zh)
CN (3) CN113068032B (zh)
AU (1) AU2019455073A1 (zh)
BR (1) BR112021006724A2 (zh)
CA (2) CA3112849C (zh)
ES (1) ES2950980T3 (zh)
IL (2) IL309549A (zh)
MX (1) MX2021004541A (zh)
PH (1) PH12021550517A1 (zh)
PL (1) PL3820151T3 (zh)
SG (1) SG11202102562WA (zh)
WO (1) WO2020258010A1 (zh)
ZA (1) ZA202101697B (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116738354A (zh) * 2023-08-15 2023-09-12 国网江西省电力有限公司信息通信分公司 一种电力物联网终端行为异常检测方法及系统

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113170101A (zh) * 2019-03-12 2021-07-23 Oppo广东移动通信有限公司 帧内预测方法及装置、计算机可读存储介质
US20220312003A1 (en) * 2019-06-19 2022-09-29 Electronics And Telecommunications Research Institute Intra prediction mode, and entropy encoding/decoding method and device
BR112021006724A2 (pt) * 2019-06-25 2022-02-01 Guangdong Oppo Mobile Telecommunications Corp Ltd Método de conversão de figuração em código aplicado a um codificador, método de decodificação de figuração aplicado a um decodificador, decodificador, e mídia de armazenamento legível por computador
WO2021034160A1 (ko) * 2019-08-22 2021-02-25 엘지전자 주식회사 매트릭스 인트라 예측 기반 영상 코딩 장치 및 방법
WO2021034158A1 (ko) * 2019-08-22 2021-02-25 엘지전자 주식회사 매트릭스 기반 인트라 예측 장치 및 방법
US11838541B2 (en) * 2019-08-30 2023-12-05 Alibaba Group Holding Limited Matrix weighted intra prediction of video signals
US20220094977A1 (en) * 2020-09-23 2022-03-24 Electronics And Telecommunications Research Institute Method, apparatus and storage medium for image encoding/decoding
WO2022257134A1 (zh) * 2021-06-11 2022-12-15 Oppo广东移动通信有限公司 一种视频编解码方法、装置、系统及存储介质
CN116046810B (zh) * 2023-04-03 2023-06-23 云南通衢工程检测有限公司 基于rpc盖板破坏荷载的无损检测方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107071417A (zh) * 2017-04-10 2017-08-18 电子科技大学 一种用于视频编码的帧内预测方法
CN107743705A (zh) * 2015-06-18 2018-02-27 高通股份有限公司 帧内预测及帧内模式译码
CN108781283A (zh) * 2016-01-12 2018-11-09 瑞典爱立信有限公司 使用混合帧内预测的视频编码

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3807117B2 (ja) * 1998-09-17 2006-08-09 ソニー株式会社 階層データの生成装置および方法、階層データの生成復元システムおよび方法
JP5053081B2 (ja) * 2004-06-18 2012-10-17 トムソン ライセンシング ビデオ・コーデック量子化のための方法および装置
CN101771867B (zh) * 2008-12-29 2012-10-03 富士通株式会社 缩小尺寸解码方法和系统
KR101441879B1 (ko) * 2009-12-09 2014-09-23 에스케이텔레콤 주식회사 영상 부호화 장치 및 방법, 및 거기에 이용되는 변환 부호화 장치 및 방법, 변환기저 생성장치 및 방법, 및 영상 복호화 장치 및 방법
GB2486733A (en) * 2010-12-24 2012-06-27 Canon Kk Video encoding using multiple inverse quantizations of the same reference image with different quantization offsets
GB2495990A (en) * 2011-10-28 2013-05-01 Canon Kk Motion compensated image coding with omission of coding mode cost calculation for a motion predictor in a set.
US9756327B2 (en) * 2012-04-03 2017-09-05 Qualcomm Incorporated Quantization matrix and deblocking filter adjustments for video coding
GB2552323B (en) * 2016-07-18 2020-04-29 Imagination Tech Ltd Mip map compression
EP3301915A1 (en) 2016-09-30 2018-04-04 Thomson Licensing Method and apparatus for omnidirectional video coding with adaptive intra most probable modes
CN113545052A (zh) * 2019-03-08 2021-10-22 韩国电子通信研究院 图像编码/解码方法和装置以及存储比特流的记录介质
CN114501000B (zh) * 2019-04-10 2022-11-22 北京达佳互联信息技术有限公司 用于视频编码的方法和电子装置
CN117336469A (zh) * 2019-04-12 2024-01-02 北京字节跳动网络技术有限公司 根据基于矩阵的帧内预测的变换编码
KR20210138115A (ko) * 2019-06-03 2021-11-18 엘지전자 주식회사 매트릭스 기반 인트라 예측 장치 및 방법
US11212545B2 (en) * 2019-06-07 2021-12-28 Tencent America LLC Method and apparatus for improved implicit transform selection
US11128868B2 (en) * 2019-06-11 2021-09-21 Mediatek Inc. Method and apparatus of matrix-based intra prediction for video coding
US11252410B2 (en) * 2019-06-11 2022-02-15 Tencent America LLC Method and apparatus for video coding
WO2020249633A1 (en) * 2019-06-14 2020-12-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Coding of intra-prediction modes
FI3989578T3 (fi) 2019-06-19 2023-11-02 Sony Group Corp Kuvankäsittelylaite ja kuvankäsittelymenetelmä
BR112021006724A2 (pt) * 2019-06-25 2022-02-01 Guangdong Oppo Mobile Telecommunications Corp Ltd Método de conversão de figuração em código aplicado a um codificador, método de decodificação de figuração aplicado a um decodificador, decodificador, e mídia de armazenamento legível por computador
EP4074045A4 (en) 2019-12-10 2022-10-19 Guangdong Oppo Mobile Telecommunications Corp., Ltd. METHODS OF ENCODING AND DECODING IMAGES AND RELATED DEVICE AND SYSTEMS

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107743705A (zh) * 2015-06-18 2018-02-27 高通股份有限公司 帧内预测及帧内模式译码
CN108781283A (zh) * 2016-01-12 2018-11-09 瑞典爱立信有限公司 使用混合帧内预测的视频编码
CN107071417A (zh) * 2017-04-10 2017-08-18 电子科技大学 一种用于视频编码的帧内预测方法

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
BROSS, BENJAMIN: "Versatile Video Coding (Draft 5)", JOINT VIDEO EXPERTS TEAM(JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11 14TH MEETING: GENEVA, CH, 19 March 2019 (2019-03-19), XP030257011 *
JIANLE CHEN; YAN YE; SEEING HWAN KIM: "Algorithm description for Versatile Video Coding and Test Model 5(VTM 5)", JOINT VIDEO EXPERTS TEAM(JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11 14TH MEETING: GENEVA, CH, 19 March 2019 (2019-03-19), pages 1 - 8, XP055766916, DOI: 20200225102145A *
PFAFF, JONATHAN ET AL.: "CE3: Affine linear weighted intra prediction (CE3-4.1, CE3-4.2)", JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, 19 March 2019 (2019-03-19), Geneva CH, pages 1 - 17, XP030202699 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116738354A (zh) * 2023-08-15 2023-09-12 国网江西省电力有限公司信息通信分公司 一种电力物联网终端行为异常检测方法及系统
CN116738354B (zh) * 2023-08-15 2023-12-08 国网江西省电力有限公司信息通信分公司 一种电力物联网终端行为异常检测方法及系统

Also Published As

Publication number Publication date
KR20220023324A (ko) 2022-03-02
CN115150612A (zh) 2022-10-04
US11146798B2 (en) 2021-10-12
CN113068032A (zh) 2021-07-02
EP3820151B1 (en) 2023-06-14
JP2024059922A (ja) 2024-05-01
PL3820151T3 (pl) 2023-08-14
IL281400B1 (en) 2024-01-01
CA3208670A1 (en) 2020-12-30
US20210218971A1 (en) 2021-07-15
EP3820151A4 (en) 2021-06-16
CA3112849A1 (en) 2020-12-30
JP2022542210A (ja) 2022-09-30
JP7448563B2 (ja) 2024-03-12
US20210352298A1 (en) 2021-11-11
AU2019455073A1 (en) 2021-04-08
BR112021006724A2 (pt) 2022-02-01
CN112514381A (zh) 2021-03-16
EP3820151A1 (en) 2021-05-12
CA3112849C (en) 2023-10-17
IL281400B2 (en) 2024-05-01
EP4228256A1 (en) 2023-08-16
SG11202102562WA (en) 2021-04-29
ZA202101697B (en) 2022-07-27
MX2021004541A (es) 2021-06-15
CN113068032B (zh) 2022-07-26
ES2950980T3 (es) 2023-10-17
IL309549A (en) 2024-02-01
PH12021550517A1 (en) 2022-02-21
IL281400A (en) 2021-04-29

Similar Documents

Publication Publication Date Title
WO2020258010A1 (zh) 图像编解码方法、编码器、解码器以及存储介质
US11882304B2 (en) Image coding/decoding method, coder, decoder, and storage medium
JP2023510666A (ja) 画像コンポーネント予測方法、エンコーダ、デコーダ及び記憶媒体
JP7481332B2 (ja) デコードのための予測方法及びその装置、並びにコンピュータ記憶媒体
CN114830663A (zh) 变换方法、编码器、解码器以及存储介质
JP2024503193A (ja) フレーム内予測方法、装置、及びデコーダとエンコーダ
CN113992914B (zh) 帧间预测方法及装置、设备、存储介质
KR20210070368A (ko) 비디오 이미지 요소 예측 방법 및 장치, 컴퓨터 저장 매체
WO2022077490A1 (zh) 一种帧内预测方法、编码器、解码器及存储介质
CN113395520B (zh) 解码预测方法、装置及计算机存储介质
RU2790323C2 (ru) Способ кодирования изображений, способ декодирования изображений, кодер, декодер и носитель данных
WO2020258001A1 (zh) 亮度分量预测方法、编码器、解码器以及存储介质
WO2021056224A1 (zh) 预测值的确定方法、编码器、解码器以及存储介质
TW202325023A (zh) 視頻編解碼系統中基於交叉分量線性模型的預測方法及裝置
KR20210114961A (ko) 예측 방향 결정 방법, 디코더 및 컴퓨터 저장 매체
JP2022541115A (ja) 画像成分の予測方法、装置およびコンピュータ記憶媒体
CN114830658A (zh) 变换方法、编码器、解码器以及存储介质

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 19935158.6

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19935158

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3112849

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2019455073

Country of ref document: AU

Date of ref document: 20190625

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112021006724

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2021568185

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 112021006724

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20210408