WO2021004153A1 - 图像预测方法、编码器、解码器以及存储介质 - Google Patents

图像预测方法、编码器、解码器以及存储介质 Download PDF

Info

Publication number
WO2021004153A1
WO2021004153A1 PCT/CN2020/090665 CN2020090665W WO2021004153A1 WO 2021004153 A1 WO2021004153 A1 WO 2021004153A1 CN 2020090665 W CN2020090665 W CN 2020090665W WO 2021004153 A1 WO2021004153 A1 WO 2021004153A1
Authority
WO
WIPO (PCT)
Prior art keywords
current block
mip mode
mip
type
mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/090665
Other languages
English (en)
French (fr)
Chinese (zh)
Inventor
余媛芳
刘阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to EP20837468.6A priority Critical patent/EP3975565A4/en
Priority to CN202411513473.1A priority patent/CN119629366A/zh
Priority to CN202411513518.5A priority patent/CN119402667B/zh
Priority to CN202511901564.7A priority patent/CN121691720A/zh
Priority to CN202080044380.2A priority patent/CN114467306A/zh
Priority to CN202210123294.1A priority patent/CN114786019B/zh
Priority to CN202511901524.2A priority patent/CN121728265A/zh
Priority to CN202511251840.XA priority patent/CN120956924A/zh
Priority to CN202511901544.XA priority patent/CN121691719A/zh
Priority to CN202511900561.1A priority patent/CN121691718A/zh
Priority to JP2021577825A priority patent/JP2022539768A/ja
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to KR1020217042822A priority patent/KR20220029589A/ko
Publication of WO2021004153A1 publication Critical patent/WO2021004153A1/zh
Priority to US17/646,222 priority patent/US12126836B2/en
Anticipated expiration legal-status Critical
Priority to US18/817,868 priority patent/US20240430487A1/en
Priority to JP2025049967A priority patent/JP2025106816A/ja
Priority to JP2025049891A priority patent/JP2025094208A/ja
Priority to JP2025049857A priority patent/JP2025094206A/ja
Priority to JP2025049936A priority patent/JP2025094210A/ja
Priority to US19/319,267 priority patent/US20260006253A1/en
Priority to US19/319,299 priority patent/US20260006254A1/en
Priority to US19/319,220 priority patent/US20260006252A1/en
Priority to US19/399,404 priority patent/US20260082082A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the embodiments of the present application relate to the technical field of video coding and decoding, and in particular to an image prediction method, an encoder, a decoder, and a storage medium.
  • MIP Matrix-based Intra Prediction
  • VVC Versatile Video Coding
  • MIP is based on neural
  • the intra-frame prediction technology of the network uses a multilayer neural network to predict the brightness value of the current block based on the adjacent reconstructed brightness block.
  • the input of MIP prediction is also the data of the adjacent brightness block in the previous row and the left column of the current block, and the output is the prediction of the brightness component of the current block. value.
  • the specific prediction process is divided into three steps: downsampling, matrix vector multiplication and interpolation.
  • the embodiments of the application provide an image prediction method, an encoder, a decoder, and a storage medium, which can reduce the complexity and reduce the storage space and overall time required in the encoding and decoding process on the basis of ensuring the encoding and decoding performance. Improve the coding and decoding efficiency.
  • an embodiment of the present application provides an image prediction method applied to an encoder, and the method includes:
  • the value of the MIP mode parameter is set to indicate the use of the MIP mode and write the code stream;
  • an embodiment of the present application provides an image prediction method applied to a decoder, and the method includes:
  • the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, parse the code stream, determine the MIP mode of the current block, and determine according to the MIP mode Prediction values of the luminance component and the chrominance component corresponding to the current block;
  • the current block is decoded.
  • an embodiment of the present application provides an encoder, the encoder includes: a setting part, a first determining part, and an encoding part,
  • the setting part is configured to, if the current block uses the MIP mode to determine the intra prediction value of the current block, set the value of the MIP mode parameter to indicate the use of the MIP mode and write the code stream;
  • the first determining part is configured to determine the MIP mode of the current block, and determine the prediction values of the luminance component and the chrominance component corresponding to the current block according to the MIP mode;
  • the encoding part is configured to write the MIP mode of the current block into a code stream.
  • an embodiment of the present application provides an encoder.
  • the encoder includes a first processor, and a first memory storing executable instructions of the first processor. When the instructions are When the processor is executed, the image prediction method described above is realized.
  • an embodiment of the present application provides a decoder, the decoder includes: a decoding part, a second determining part,
  • the decoding part is configured to analyze the code stream to determine the MIP mode parameter of the current block; and if the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, the code is analyzed Flow, determine the MIP mode of the current block;
  • the second determining part is configured to determine the predicted values of the luminance component and the chrominance component corresponding to the current block according to the MIP mode;
  • the decoding part is further configured to decode the current block according to the predicted value.
  • an embodiment of the present application provides a decoder.
  • the decoder includes a second processor and a second memory storing executable instructions of the second processor. When the instructions are When the processor is executed, the image prediction method described above is realized.
  • an embodiment of the present application provides a computer-readable storage medium with a program stored thereon, which is applied to an encoder and a decoder, and when the computer program is executed by a first processor, the image as described above is realized
  • the prediction method or, when executed by the second processor, implements the image prediction method as described above.
  • the embodiments of this application provide an image prediction method, encoder, decoder, and storage medium. If the current block uses the MIP mode to determine the intra prediction value of the current block, the encoder sets the value of the MIP mode parameter to indicate the use MIP mode and write the code stream; determine the MIP mode of the current block, and determine the predicted values of the luminance and chrominance components corresponding to the current block according to the MIP mode; write the MIP mode of the current block into the code stream.
  • the decoder parses the code stream and determines the MIP mode parameters of the current block; if the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, parses the code stream, determines the MIP mode of the current block, and determines the MIP mode of the current block according to the MIP
  • the mode determines the predicted value of the luminance component and chrominance component corresponding to the current block; according to the predicted value, the current block is decoded.
  • the encoder when the encoder performs intra-frame prediction on the current block, if it is determined that the current block uses the MIP mode, it can use the MIP mode to obtain the intra-frame prediction value of the current block while setting MIP mode parameters are written into the code stream and transmitted to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameter indicates that the current block uses the MIP mode, the decoder can use the MIP mode to determine the intra prediction of the current block value.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process, and reducing the complexity while ensuring the codec performance. , Reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • Figure 1 is a schematic diagram of the arrangement of 67 prediction modes in intra prediction
  • Figure 2 is a schematic flow chart of encoding in MIP mode
  • FIG. 3 is a schematic diagram of the arrangement of the adjacent brightness block on the upper side and the adjacent brightness block on the left side of the current block;
  • Figure 4 is a schematic diagram of the arrangement of determining the DM mode
  • Figure 5 is a schematic diagram of the structure of a video encoding system
  • Figure 6 is a schematic structural diagram of a video decoding system
  • Fig. 7 is a schematic diagram 1 of the implementation process of the image prediction method
  • Figure 8 is a second schematic diagram of the implementation process of the image prediction method
  • FIG. 9 is a schematic diagram 1 of the composition structure of the encoder proposed in an embodiment of the application.
  • FIG. 10 is a second schematic diagram of the composition structure of the encoder proposed in an embodiment of the application.
  • FIG. 11 is a schematic diagram 1 of the composition structure of the decoder proposed in an embodiment of the application.
  • FIG. 12 is a second schematic diagram of the composition structure of the decoder proposed in an embodiment of the application.
  • VVC Universal Video Coding VVC
  • ITU-T International Organization for Standardization
  • ISO International Organization for Standardization
  • IEC International Electrotechnical Commission
  • VVC Universal Video Coding VVC
  • Its purpose is to encode high-quality video with one or more of the characteristics of high resolution, high frame rate, high bit depth, high dynamic range, wide color gamut, and omnidirectional viewing angle, with the latest H.265
  • JVET is responsible for the standardization project.
  • Various intra-frame prediction modes and inter-frame prediction modes have been verified to achieve high compression efficiency when encoding high-quality videos, so work in VVC The draft was adopted.
  • VVC accepted the ray-like weighted intra prediction technology (Affine Linear Weighted Intra Prediction) proposed in the Joint Video Experts Team (JVET)-N0217, and changed its name to matrix-based intra prediction , Namely MIP technology, this technology adds a different number of matrix-based intra prediction modes in the intra-frame brightness prediction process according to the different sizes of intra-frame luminance coding blocks.
  • JVET Joint Video Experts Team
  • VVC expands the 33 kinds of intra-frame luminance prediction angle modes defined in the video compression standard (High Efficiency Video Coding, HEVC) to 65 kinds.
  • Figure 1 shows the intra-frame prediction.
  • these 67 prediction modes are referred to as traditional intra prediction modes.
  • MIP is an intra-frame prediction technology based on neural networks, which uses a multilayer neural network to predict the brightness value of the current block based on adjacent reconstructed pixels. Specifically, the MIP technology divides the brightness coding blocks into three categories according to the size of the brightness coding block in the frame. Set the size of the brightness coding block as W ⁇ H, where W is the width parameter and H is the height parameter, according to the size of the brightness coding block Luma coding blocks can be divided into three categories:
  • Luminance coding blocks with a size of 4 ⁇ 4 belong to the first type of luminance block
  • 8 ⁇ 4, 4 ⁇ 8 and 8 ⁇ 8 luminance coding blocks are classified as the second type of luminance block
  • other sizes of luminance coding blocks belong to the third type. Brightness block.
  • MIP technology is only applied to intra-frame brightness prediction.
  • the input of MIP prediction is also the previous row and left column of the current block, and the output is the predicted value of the current block.
  • the specific prediction process is divided into three Steps: averaging, matrix vector multiplication and interpolation. In other words, by performing these three operations on the input reconstructed brightness values of adjacent pixels in the upper row and the left column, the predicted value of the brightness component of the current block can be obtained.
  • FIG. 2 is a schematic flow chart of encoding in MIP mode. As shown in Figure 2, the specific implementation of brightness prediction in MIP mode is as follows:
  • Step 1 Perform averaging operation on the adjacent reference points on the upper side of the current block to obtain the vector bdry top with a total of N values; perform averaging operation on the adjacent reference points on the left side of the current block to obtain the vector bdry left with a total of N values.
  • N the first type of brightness code
  • N 4.
  • Vector bdry top and vector bdry left form a new vector bdry red and perform subsequent operations;
  • Step 2 Obtain the corresponding matrix A k and the offset b k through the mode number k of the MIP mode, and obtain the partial prediction value of the current block as shown in Figure 2 by the following formula (1):
  • Pred red A k ⁇ bdry red +b k (1)
  • Step 3 Obtain the remaining predicted value Predred in the current block through linear interpolation.
  • the decoder can determine which encoding mode is used by analyzing the mode information.
  • One mode whether it is a traditional mode or a MIP mode; if it is a traditional mode, which is the specific traditional mode; if it is a MIP mode, which is the specific MIP mode.
  • VVC intra-frame prediction the rate-distortion cost RDcost of 67 traditional modes and M MIP modes is compared for each luminance coding block, and the optimal mode is selected among 67 traditional modes and M MIP modes. coding.
  • VVC uses the most probable mode list (Most Probable Modes List, MPM)-based intra mode coding technology,
  • the optimal mode selected by the current block is the traditional mode, it is necessary to construct an MPM list containing the 6 most likely traditional modes;
  • the optimal mode selected by the block is the MIP mode, and a MIPMPM list containing the 3 most likely MIP modes needs to be constructed.
  • Fig. 3 is a schematic diagram of the arrangement of the adjacent luminance block on the upper side of the current block and the adjacent luminance block on the left side. As shown in Fig. 3, the above two lists are based on the upper adjacent luminance block of the current block as shown in Fig. 4 The optimal mode of the luminance block (A) and the adjacent luminance block (L) on the left is derived.
  • the MPM list needs to be constructed. In the process of constructing the MPM list, it is first necessary to obtain the traditional mode ABOVE corresponding to the optimal mode of the upper adjacent luminance block and the traditional mode LEFT corresponding to the optimal mode of the adjacent luminance block on the left.
  • the MIPMPM list in VVC intra prediction, if the optimal mode of the current block is the MIP mode, the MIPMPM list needs to be constructed. In the process of constructing the MIPMPM list, it is first necessary to obtain the MIP mode ABOVE_MIP corresponding to the optimal mode of the upper adjacent luminance block and the MIP mode LEFT_MIP corresponding to the optimal mode of the adjacent luminance block on the left.
  • MIPMPM the number in MIPMPM is the number of the MIP mode, and the number range is 0 to (M-1)
  • M-1 the number in MIPMPM
  • the number range is 0 to (M-1)
  • FIG. 4 is a schematic diagram of determining the arrangement of the DM mode. As shown in Figure 4, since the MIP technology is only applied to the luma coding block, when the frame at the CR position in Figure 4 When the intra prediction mode is the MIP mode, the MIP mode needs to be mapped to the traditional mode through the "MIP-traditional mapping table" to perform intra prediction of the current chrominance block.
  • DM Direct Mode
  • the MIP mode Due to the computational burden and storage cost required by the MIP technology, it is difficult to implement the MIP mode on devices with relatively low computing or storage capabilities. Therefore, the MIP mode cannot be effectively transmitted and controlled in the latest VVC working draft design, which makes it difficult to implement flexible codec implementation and dynamic video streaming.
  • the encoder when the encoder determines that the current block uses the MIP mode when performing intra prediction on the current block, it can use the MIP mode to obtain the intra prediction value of the current block at the same time, Set the MIP mode parameters and write them into the code stream and transmit them to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameters indicate that the current block uses the MIP mode, the decoder can use the MIP mode to determine the frame of the current block Predictive value. That is, in this application, the VVC bitstream conveys one or more syntax elements to enable or disable the MIP mode.
  • the syntax element may be located in a data unit in a video sequence layer, a picture layer and/or a sub-picture layer, a slice/tile/brick layer, where the sub-picture refers to an area covering a part of the picture.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process of the MIP mode, and can ensure the coding and decoding performance on the basis of Reduce the complexity, reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • FIG. 5 is a schematic structural diagram of a video encoding system.
  • the video encoding system 100 includes a transform and quantization module 101, an intra-frame estimation module 102, an intra-frame prediction module 103, a motion compensation module 104, and a motion estimation module 105, Inverse transform and inverse quantization module 106, filter control analysis module 107, deblocking filter and sample adaptive indentation (Sample Adaptive Offset, SAO) filter module 108, header information coding and context-based adaptive binary arithmetic coding (Context- Based on Adaptive Binary Arithmatic Coding, CABAC) encoding module 109 and decoded image buffer module 110;
  • Figure 6 is a schematic diagram of the structure of the video decoding system, as shown in Figure 6, the video decoding system 200 includes header information decoding and CABAC decoding module 201 , Inverse transform and inverse quantization module 202, intra-frame prediction module 203, motion compensation module 204, deblocking filter and SAO filter module 205, de
  • the video image passes through the transformation and quantization module 101, the intra-frame estimation module 102, the intra-frame prediction module 103, the motion compensation module 104, the motion estimation module 105, the deblocking filtering and SAO filtering module 108, the header information encoding and CABAC in the video encoding system 100
  • the module 109 and other parts it outputs the code stream of the video image;
  • the code stream is input into the video decoding system 200, and passes through the header information decoding and CABAC decoding module 201 in the video decoding system 200, the inverse transform and inverse quantization module 202, and the intraframe
  • the prediction module 203 and the motion compensation module 204 perform partial processing, and finally restore the original video image.
  • the image prediction method proposed in this application can affect the entropy coding process and the entropy decoding process in the encoding and decoding process.
  • the image prediction method proposed in this application can be in the structure of the video encoding system shown in FIG.
  • the position application can also be applied at position 201 in the structure of the video coding system shown in FIG. 6.
  • FIG. 7 is a schematic diagram of the implementation process of the image prediction method.
  • the method for the encoder to perform image prediction can be It includes the following steps:
  • Step 101 If the current block uses the MIP mode to determine the intra prediction value of the current block, set the value of the MIP mode parameter to indicate the use of the MIP mode and write the code stream.
  • the encoder can set the value of the MIP mode parameter to indicate the use of the MIP mode and write the code stream.
  • the current block may represent the current block to be encoded or the current block to be decoded.
  • the current block is the block to be encoded.
  • the encoder when the encoder encodes the current block, it may first select the optimal encoding mode in the traditional mode and the MIP mode.
  • an optimal mode can be selected for coding processing in the traditional mode and the MIP mode.
  • the traditional mode includes 67 intra prediction modes including Planar mode numbered 0, DC mode numbered 1, and 65 angle modes.
  • the encoder when the encoder selects the optimal mode, it can compare the Rdcost of 67 traditional modes and M MIP modes on the current block, so that the optimal mode can be selected according to the comparison result. And encode it.
  • the encoder can set the value of the MIP mode parameter to indicate the use of the MIP mode and write Code stream. That is, the encoder can use the syntax unit to indicate whether the current block uses the MIP mode, that is, the MIP mode parameter is used to indicate whether the current block uses the MIP mode.
  • the encoder can set the value of the MIP mode parameter to 1, and write it into the code stream, thereby facilitating Can instruct the current block to use MIP mode.
  • the encoder can set the value of the MIP mode parameter to indicate that the MIP mode is not used and write Code stream.
  • the encoder may set the value of the MIP mode parameter to 0 and write it into the code stream, thereby It can indicate that the current block does not use MIP mode.
  • the encoder may indicate the MIP mode parameter with one or more syntax units in the code stream. That is to say, after the encoder completes the setting of the MIP mode parameters according to whether the current block uses the MIP mode, it can indicate the MIP mode parameters with one or more syntax units in the code stream.
  • the syntax unit indicating the MIP mode parameter can be included in one or more data units in the following code streams: the data unit containing the current block, the slice header information data unit, the image Header information data unit, image layer parameter set, sequence layer parameter set and adaptive parameter set.
  • the data unit in the code stream contains the current block data unit
  • One or more data units in the set can indicate MIP mode parameters, so the MIP mode parameters set by the encoder can be adapted to it.
  • the MIP mode parameter can be indicated by sps_mip_enable_flag, so the decoder parses the sequence layer in the code stream After the data unit of the parameter set, the MIP mode parameter sps_mip_enable_flag can be determined.
  • the MIP mode parameter can be indicated by pps_mip_enable_flag, so the decoder parses the picture layer in the code stream After the data unit of the parameter set, the MIP mode parameter pps_mip_enable_flag can be determined.
  • the MIP mode parameters can be indicated by aps_mip_enable_flag, so the decoder parses the adaptive parameters in the code stream. After the data unit of the parameter set, the MIP mode parameter aps_mip_enable_flag can be determined.
  • the slice_mip_enable_flag can be used to indicate the MIP mode parameter, so the decoder parses the data unit of the slice header information data unit in the code stream After that, the MIP mode parameter slice_mip_enable_flag can be determined.
  • Step 102 Determine the MIP mode of the current block, and determine the predicted values of the luminance component and the chrominance component corresponding to the current block according to the MIP mode.
  • the encoder can further determine the MIP mode of the current block, and then determine the brightness component corresponding to the current block according to the MIP mode And the predicted value of the chrominance component.
  • the encoder when the encoder determines the MIP mode corresponding to the current block, it can first determine the size type of the current block; then construct a candidate MIP mode list based on the size type; finally, it can start from the candidate MIP mode The MIP mode of the current block is determined in the list.
  • the current block can be divided into three size types according to the size of the current block. Among them, if the size of the current block is W ⁇ H, where W is the width parameter and H is the height parameter , the current block with a size of 4 ⁇ 4 can be determined as the first type of brightness block, that is, the size type of the current block can be determined as the first type; it can also be the size of 8 ⁇ 4, 4 ⁇ 8 and 8 ⁇ 8
  • the current block is determined to be the second type of brightness block, that is, the size type of the current block is determined to be the second type; current blocks of other sizes may also be determined as the third type of brightness block, that is, the size type of the current block is determined to be the third type.
  • the current block can have 25 sizes.
  • the standard stipulates that the maximum brightness block is 128 ⁇ 128, but since the maximum size of the transform unit is 64 ⁇ 64 That is to say, the brightness block must be divided into a quadtree first in the size of 128 ⁇ 128, so the maximum brightness block size is 64 ⁇ 64.
  • Table 1 is a schematic table of the size of the brightness block, as shown in Table 1.
  • the MIP mode is restricted according to the height and width parameters of the current block. Specifically, if the aspect ratio of the current block is greater than 4, or the aspect ratio is greater than 4, the MIP mode is not used to encode the current block, Table 2 It is the limit of the brightness block size in MIP mode, as shown in Table 2.
  • the size type of the current block can be set It is the first type; if the width and height of the current block are both equal to 8, the size of the current block is 8 ⁇ 8, or the width of the current block is equal to 8 and the height is equal to 4, that is, the size of the current block is 8 ⁇ 4, or the current
  • the width of the block is equal to 4 and the height is equal to 8, that is, the size of the current block is 4 ⁇ 8, and the size type of the current block can be set to the second type; if the width and height of the current block do not meet the aforementioned conditions, the current block size If it is not 4 ⁇ 4, 8 ⁇ 8, 8 ⁇ 4, or 4 ⁇ 8, the size type of the current block can be set to the third type.
  • the current block when the encoder determines the size type of the current block, if the width and height of the current block are both equal to 4, the current block can be The size type of the block is set to the first type; if the width and height of the current block are both equal to 8, or one of the width and height of the current block is equal to 4, the size type of the current block can be set to the second type; The width and height of the block do not meet the aforementioned conditions, that is, the width and height of the current block are not equal to 4 or 8 at the same time, or the width and height of the current block are not equal to 4, then the size type of the current block can be set to all The third type.
  • the encoder can construct different candidate MIP mode lists.
  • the MIP technology adds M types to the 67 traditional intra prediction modes.
  • MIP mode in which, for different size types, the value of M is also different. Among them, the value of M can include 16, 8, 6.
  • the value of M is 16, that is, the candidate MIP mode list can be constructed according to 16 MIP modes; when the size type of the current block is the second type When the value of M is 8, the list of candidate MIP modes can be constructed according to 8 MIP modes; when the size type of the current block is the third type, the value of M is 6, which means that the candidate MIP modes can be constructed according to 6 MIP modes List.
  • the encoder after the encoder completes the construction of the candidate MIP mode list according to the size type of the current block, it can determine the MIP mode used by the current block from the candidate MIP mode list, so that the MIP can be used The mode performs image prediction processing on the current block to obtain the intra prediction value of the current block.
  • the encoder after the encoder constructs the candidate MIP mode list corresponding to the current block, it can select a MIP mode from the candidate MIP mode list, and then use the MIP mode to determine the MIP mode corresponding to the current block. Predicted values of luma and chroma components.
  • the encoder may first read the mode number k of the MIP mode from the candidate MIP mode list, so as to obtain the corresponding matrix Ak and the offset bk according to the above formula (1) Perform matrix-vector multiplication to obtain the predicted value of the brightness component corresponding to the current block.
  • the encoder can further set the MIP mode index number of the current block according to the MIP mode of the current block, and set the MIP mode index number of the current block.
  • the mode index number is written into the code stream.
  • the MIP mode index number of the current block can be used to indicate the specific MIP mode used by the current block. That is to say, on the encoding side, the encoder sets the MIP mode index number of the current block and writes it into the code stream, and transmits it to the decoding side. The decoder obtains the MIP mode index number of the current block by parsing the code stream, and then can obtain the MIP mode index number from the current block. The MIP mode indicated by the MIP mode index number is determined from the candidate MIP mode list.
  • Step 103 Write the MIP mode of the current block into the code stream.
  • the encoder can write the MIP mode of the current block into the code stream .
  • the encoder in the process of encoding the current block, not only needs to write whether the current block uses the MIP mode to the compressed code stream, but also needs to write which mode is used in the code.
  • the encoder In the stream, for example, when the MIP mode is used for intra prediction, which MIP mode is specifically used.
  • the embodiment of the application proposes an image prediction method. If the current block uses the MIP mode to determine the intra prediction value of the current block, the encoder sets the value of the MIP mode parameter to indicate the use of the MIP mode and writes the code stream; The MIP mode of the current block, and determine the predicted values of the luminance and chrominance components corresponding to the current block according to the MIP mode; write the MIP mode of the current block into the code stream.
  • the encoder when the encoder performs intra-frame prediction on the current block, if it is determined that the current block uses the MIP mode, it can use the MIP mode to obtain the intra-frame prediction value of the current block while setting MIP mode parameters are written into the code stream and transmitted to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameter indicates that the current block uses the MIP mode, the decoder can use the MIP mode to determine the intra prediction of the current block value.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process, and reducing the complexity while ensuring the codec performance. , Reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • another embodiment of the present application proposes an image prediction method.
  • the encoder determines to use the MIP mode to predict the intra prediction value of the current block, it can be used to indicate whether the current block uses the MIP mode.
  • the MIP mode parameters are written into one or more syntax elements in the code stream. That is, in this application, the VVC bitstream conveys one or more syntax elements to enable or disable the MIP mode.
  • the syntax element may be located in a data unit in a video sequence layer, a picture layer and/or a sub-picture layer, a slice/tile/brick layer, where the sub-picture refers to an area covering a part of the picture.
  • the encoder may determine whether to use the MIP mode when encoding the video sequence.
  • the entropy encoding unit may encode the flags in the parameter set that can be related to all slices in the video sequence.
  • Table 3 shows an implementation example of the syntax structure in the sequence parameter set (SPS), where u(1) represents the entropy coding method that has been specified in the VVC working draft.
  • the entropy coding unit may set sps_mip_enable_flag equal to 0 and write the value to be (indirectly) related to the slice in the video sequence
  • the entropy coding unit can set sps_mip_enable_flag equal to 1 and write this value to the video sequence. Slice (indirectly) related SPS.
  • the encoder after setting the value of the MIP mode parameter sps_mip_enable_flag, the encoder can indicate the MIP mode parameter with one or more syntax units in the code stream. That is, the encoder can write the MIP mode parameter sps_mip_enable_flag into the sequence layer parameter set in the code stream after completing the setting of the MIP mode parameter sps_mip_enable_flag according to whether the current block uses the MIP mode.
  • the encoder can determine whether to use the MIP mode when encoding a picture in a video sequence or a sub-picture in a picture.
  • the entropy encoding unit may encode flags in a parameter set that can be related to all slices in the picture or sub-picture.
  • Table 4 shows an implementation example of the syntax structure in the picture layer parameter set (PPS), where u(1) represents the entropy coding method that has been specified in the VVC working draft.
  • the entropy coding unit when the encoder determines that the MIP mode is not applied when encoding a picture or sub-picture, the entropy coding unit can set pps_mip_enable_flag equal to 0 and write the value to the slice related to the picture or sub-picture.
  • the entropy coding unit may set pps_mip_enable_flag equal to 1 and write the value in the picture or sub-picture
  • the slices are (indirectly) related to the PPS.
  • the encoder after the encoder completes the setting of the value of the MIP mode parameter pps_mip_enable_flag, it can indicate the MIP mode parameter with one or more syntax units in the code stream. That is, after setting the MIP mode parameter pps_mip_enable_flag according to whether the current block uses the MIP mode, the encoder can write the MIP mode parameter pps_mip_enable_flag into the picture layer parameter set in the code stream.
  • the encoder can determine whether to use the MIP mode when encoding a picture in a video sequence or a sub-picture in a picture.
  • the entropy encoding unit may encode flags in a parameter set that can be related to all slices in the picture or sub-picture.
  • Table 5 shows an implementation example of the grammatical structure in the adaptive parameter set (APS), where u(1) represents the entropy coding method that has been specified in the VVC working draft.
  • the entropy coding unit may set aps_mip_enable_flag equal to 0 and write the value to the slice related to the picture or sub-picture.
  • the entropy coding unit may set aps_mip_enable_flag equal to 1 and write the value in the picture or sub-picture
  • the slices are (indirectly) related to the APS.
  • the encoder after the encoder completes the setting of the value of the MIP mode parameter aps_mip_enable_flag, it can indicate the MIP mode parameter with one or more syntax units in the code stream. That is, after the encoder completes the setting of the MIP mode parameter aps_mip_enable_flag according to whether the current block uses the MIP mode, it can write the MIP mode parameter aps_mip_enable_flag into the adaptive parameter set in the code stream.
  • the encoder may determine whether to use the MIP mode when encoding a slice.
  • the entropy coding unit can encode the flag in the slice header.
  • Table 6 shows an implementation example of the syntax structure in the slice header, where u(1) represents the entropy coding method that has been specified in the VVC working draft.
  • the entropy encoding unit may set slice_mip_enable_flag equal to 0 and write the value into the slice header; when the encoder determines that the slice is being encoded When the MIP mode is applied during encoding, the entropy encoding unit may set slice_mip_enable_flag equal to 1 and write the value in the slice header.
  • the encoder after setting the value of the MIP mode parameter slice_mip_enable_flag, the encoder can indicate the MIP mode parameter in one or more syntax units in the code stream. That is, after the encoder finishes setting the MIP mode parameter slice_mip_enable_flag according to whether the current block uses the MIP mode, it can write the MIP mode parameter slice_mip_enable_flag into the slice header information data unit in the code stream.
  • the encoder determines whether to use the MIP mode, and the entropy coding unit may write similar MIP mode parameters to the tile representing the picture or sub-picture Or set the parameters of the segmentation of the bricks as part of it.
  • the entropy encoding unit may also write similar MIP mode parameters into the slice data related to the tiles or bricks in the slice to indicate whether to use the MIP mode when encoding the tiles or bricks.
  • the encoder may determine to apply the MIP mode when encoding a part of a picture or sub-picture in a video sequence.
  • the entropy coding unit may encode sps_mip_enable_flag in SPS to 1, and encode pps_mip_enable_flag in PPS or aps_mip_enable_flag in APS related to slices in a picture or sub-picture to 1, and at the same time encode it with other pictures or sub-pictures in the video sequence.
  • pps_mip_enable_flag in PPS or aps_mip_enable_flag in APS is coded as 0.
  • the entropy coding unit may encode slice_mip_enable_flag (or similar MIP mode parameter of a tile or brick in slice data) in a slice in a picture or sub-picture into 1, and convert the slice in the picture or sub-picture
  • slice_mip_enable_flag (or similar MIP mode parameter of the tile or brick in the slice data) is encoded as 0.
  • the encoder can also implicitly pass whether the MIP mode is used for other syntax elements (for example, indicating the grade/level/level of one or more parameter sets of the bitstream or sub-bitstream ( The video sequence in the syntax element of PTL) is encoded.
  • the MIP mode of the encoder is set to be disabled in one or more PTLs, and the MIP mode is set to be enabled in other PTLs.
  • the decoder when the encoder transmits to the bitstream an indication that the current block is encoded in the MIP mode, correspondingly, the decoder can use the MIP mode to decode the bitstream.
  • the embodiment of the application proposes an image prediction method. If the current block uses the MIP mode to determine the intra prediction value of the current block, the encoder sets the value of the MIP mode parameter to indicate the use of the MIP mode and writes the code stream; The MIP mode of the current block, and determine the predicted values of the luminance and chrominance components corresponding to the current block according to the MIP mode; write the MIP mode of the current block into the code stream.
  • the encoder when the encoder performs intra-frame prediction on the current block, if it is determined that the current block uses the MIP mode, it can use the MIP mode to obtain the intra-frame prediction value of the current block while setting MIP mode parameters are written into the code stream and transmitted to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameter indicates that the current block uses the MIP mode, the decoder can use the MIP mode to determine the intra prediction of the current block value.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process, and reducing the complexity while ensuring the codec performance. , Reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • FIG. 8 is a schematic diagram of the second implementation process of the image prediction method.
  • the decoder performs The method of image prediction may include the following steps:
  • Step 201 Parse the code stream to determine the MIP mode parameters of the current block.
  • the decoder parses the code stream to determine the MIP mode parameters of the current block.
  • the current block may represent the current block to be encoded or the current block to be decoded.
  • the current block is the block to be decoded.
  • the decoder can parse one or more syntax units in the code stream to determine the MIP mode parameter of the current block. That is to say, in this application, one or more syntax units can be used to indicate MIP mode parameters in the code stream.
  • the syntax unit indicating the MIP mode parameter may be included in one or more data units in the following code streams: the data unit containing the current block, the slice header information data unit, and the image header information Data unit, image layer parameter set, sequence layer parameter set and adaptive parameter set.
  • the MIP mode parameter is used to indicate whether the current block uses the MIP mode. Specifically, if the MIP mode parameter indicates that the MIP mode is used, the decoder can use the MIP mode to determine the intra prediction value of the current block. If the MIP mode parameter indicates that the MIP mode is not used, the decoder will not use the MIP mode to determine the current block Intra prediction value.
  • the decoder can determine whether the current block uses the MIP mode according to the value of the MIP mode parameter.
  • the decoder determines the MIP mode parameter, if the value of the MIP mode parameter is 1, it can indicate that the current block uses the MIP mode, and the decoder can use the MIP mode to determine the current The intra prediction value of the block.
  • the decoder determines the MIP mode parameter, if the value of the MIP mode parameter is 0, it can indicate that the current block does not use the MIP mode, and the decoder will not use the MIP mode. Determine the intra prediction value of the current block.
  • the data unit in the code stream contains the current block data unit
  • One or more data units in the set can indicate the MIP mode parameters, so the MIP mode parameters obtained by the decoder analysis can be adapted to it.
  • the encoder if the encoder writes the MIP mode parameter into the sequence layer parameter set, it can indicate the MIP mode parameter through sps_mip_enable_flag. Therefore, after the decoder parses the data unit of the sequence layer parameter set in the code stream, it can Determine the MIP mode parameter sps_mip_enable_flag.
  • the MIP mode parameter can be indicated by pps_mip_enable_flag. Therefore, after the decoder parses the data unit of the picture layer parameter set in the code stream, it can Determine the MIP mode parameter pps_mip_enable_flag.
  • the encoder writes the MIP mode parameters into the adaptive parameter set
  • the MIP mode parameters can be indicated by aps_mip_enable_flag. Therefore, after the decoder parses the data unit of the adaptive parameter set in the code stream, it can Determine the MIP mode parameter aps_mip_enable_flag.
  • the slice_mip_enable_flag can be used to indicate the MIP mode parameter, so the decoder parses the data unit of the slice header information data unit in the code stream After that, the MIP mode parameter slice_mip_enable_flag can be determined.
  • Step 202 If the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, analyze the code stream, determine the MIP mode of the current block, and determine the brightness component and chrominance corresponding to the current block according to the MIP mode The predicted value of the component.
  • the decoder can Continue to parse the code stream to determine the MIP mode of the current block, and then determine the predicted values of the luminance and chrominance components corresponding to the current block according to the MIP mode.
  • the decoder after the decoder analyzes the code stream and determines the MIP mode parameter of the current block, if the value of the MIP mode parameter indicates that the MIP mode is not used to determine the intra prediction value of the current block, The decoder will not use MIP mode for the current block.
  • the decoder parses the code stream. Not only can you obtain the MIP mode parameter indicating whether the current block uses the MIP mode, but also determine which mode the current block uses to write into the code stream, for example, when using the MIP mode for intra prediction, which one is used MIP mode.
  • an optimal mode can be selected for coding processing in the traditional mode and the MIP mode.
  • the traditional mode includes 67 intra prediction modes including Planar mode numbered 0, DC mode numbered 1, and 65 angle modes.
  • the decoder when the decoder uses the MIP mode to determine the intra prediction value of the current block, it can further determine the MIP mode of the current block by parsing the code stream, and then determine the current block according to the MIP mode. The predicted values of the luminance and chrominance components corresponding to the block.
  • the decoder when the decoder parses the code stream to determine the MIP mode of the current block, it can first obtain the MIP mode index number of the current block by analyzing the code stream, and then After the size type of the current block is determined, the MIP mode indicated by the MIP mode index number is determined as the MIP mode of the current block from the candidate MIP mode list corresponding to the size type.
  • the MIP mode index sequence number of the current block may be used to indicate the specific MIP mode used by the current block. That is to say, on the encoding side, the encoder sets the MIP mode index number of the current block and writes it into the code stream, and transmits it to the decoding side. The decoder obtains the MIP mode index number of the current block by parsing the code stream, and then can obtain the MIP mode index number from the current block. The MIP mode indicated by the MIP mode index number is determined from the candidate MIP mode list.
  • the decoder may first determine the size type of the current block. Specifically, based on the above Table 2, when the decoder determines the size type of the current block, if the width and height of the current block are both equal to 4, that is, the size of the current block is 4 ⁇ 4, the size type of the current block can be set It is the first type; if the width and height of the current block are both equal to 8, the size of the current block is 8 ⁇ 8, or the width of the current block is equal to 8 and the height is equal to 4, that is, the size of the current block is 8 ⁇ 4, or the current The width of the block is equal to 4 and the height is equal to 8, that is, the size of the current block is 4 ⁇ 8, then the size type of the current block can be set to the second type; if the width and height of the current block do not meet the aforementioned conditions, the current block If the size of is not 4 ⁇ 4, 8 ⁇ 8, 8 ⁇ 4, or 4 ⁇ 8,
  • the current block when the encoder determines the size type of the current block, if the width and height of the current block are both equal to 4, the current block can be The size type of the block is set to the first type; if the width and height of the current block are both equal to 8, or one of the width and height of the current block is equal to 4, the size type of the current block can be set to the second type; The width and height of the block do not meet the aforementioned conditions, that is, the width and height of the current block are not equal to 4 or 8 at the same time, or the width and height of the current block are not equal to 4, then the size type of the current block can be set to all The third type.
  • the decoder can construct different candidate MIP mode lists.
  • MIP technology adds M types to the 67 traditional intra prediction modes.
  • MIP mode in which, for different size types, the value of M is also different.
  • the value of M can include 16, 8, 6.
  • the value of M is 16, that is, the candidate MIP mode list can be constructed according to 16 MIP modes; when the size type of the current block is the second type When the value of M is 8, the list of candidate MIP modes can be constructed according to 8 MIP modes; when the size type of the current block is the third type, the value of M is 6, which means that the candidate MIP modes can be constructed according to 6 MIP modes List.
  • the decoder may first read the mode number k of the MIP mode from the candidate MIP mode list, so as to obtain the corresponding matrix Ak and the offset bk according to the above formula (1 ) Perform matrix vector multiplication to obtain the predicted value of the brightness component corresponding to the current block.
  • Step 203 Decode the current block according to the predicted value.
  • the decoder after the decoder analyzes the code stream to determine the MIP mode of the current block, and determines the predicted values of the luminance component and chrominance component corresponding to the current block according to the MIP mode, it can then determine the luminance component and chrominance component The predicted value of decodes the current block.
  • the embodiment of the application proposes an image prediction method.
  • the decoder parses the code stream to determine the MIP mode parameter of the current block; if the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, the code is analyzed Stream, determine the MIP mode of the current block, and determine the predicted value of the luminance component and chrominance component corresponding to the current block according to the MIP mode; decode the current block according to the predicted value.
  • the encoder when the encoder performs intra-frame prediction on the current block, if it is determined that the current block uses the MIP mode, it can use the MIP mode to obtain the intra-frame prediction value of the current block while setting MIP mode parameters are written into the code stream and transmitted to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameter indicates that the current block uses the MIP mode, the decoder can use the MIP mode to determine the intra prediction of the current block value.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process, and reducing the complexity while ensuring the codec performance. , Reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • another embodiment of the present application proposes an image prediction method.
  • the decoder parses the code stream and can obtain one or more syntaxes for indicating whether the current block uses the MIP mode to determine the predicted value of the current block element.
  • one or more syntax elements obtained by the decoder parsing may indicate whether to use the MIP mode when decoding a video sequence, one or more pictures, slices, tiles or bricks. That is, in this application, the VVC bitstream conveys one or more syntax elements to enable or disable the MIP mode.
  • the syntax element may be located in a data unit in a video sequence layer, a picture layer and/or a sub-picture layer, a slice/tile/brick layer, where the sub-picture refers to an area covering a part of the picture.
  • the decoder may obtain the MIP mode parameters from the parameter set related to all slices in the video sequence.
  • the decoder can obtain the MIP mode parameters from the SPS.
  • Table 3 an implementation example of the syntax structure in SPS is shown, where u(1) represents the entropy decoding method that has been specified in the VVC working draft.
  • the decoder When the decoder determines that the value of the MIP mode parameter sps_mip_enable_flag is equal to 0, the decoder will not use the MIP mode when decoding slices related to the SPS (indirectly); when the decoder determines that the value of the MIP mode parameter sps_mip_enable_flag is equal to 1, The decoder applies the MIP mode when decoding slices related to this SPS (indirect).
  • the decoder can determine the MIP mode parameter sps_mip_enable_flag after parsing the sequence layer parameter set in the code stream, and then can determine whether the current block uses the MIP mode for decoding according to the value of the MIP mode parameter sps_mip_enable_flag .
  • the decoder may obtain the MIP mode parameters from a parameter set related to all slices in a picture or sub-picture in a video sequence.
  • the decoder can obtain the MIP mode parameters from the PPS.
  • Table 4 the implementation of the syntax structure in PPS is shown, where u(1) represents the entropy decoding method that has been specified in the VVC working draft.
  • the decoder When the decoder determines that the value of the MIP mode parameter pps_mip_enable_flag is equal to 0, the decoder will not use the MIP mode when decoding slices related to the PPS; when the decoder determines that the value of the MIP mode parameter pps_mip_enable_flag is equal to 1, the decoder is The MIP mode is applied when decoding slices related to this PPS.
  • the decoder can determine the MIP mode parameter pps_mip_enable_flag after parsing the picture layer parameter set in the bitstream, and then can determine whether the current block uses the MIP mode for decoding processing according to the value of the MIP mode parameter pps_mip_enable_flag .
  • the decoder may obtain the MIP mode parameters from a parameter set related to all slices in a picture or sub-picture in a video sequence.
  • the decoder can obtain the MIP mode parameters from the APS.
  • Table 5 an implementation example of the syntax structure in the sequence parameter set APS is shown, where u(1) represents the entropy decoding method that has been specified in the VVC working draft.
  • the decoder When the decoder determines that the value of the MIP mode parameter aps_mip_enable_flag is equal to 0, the decoder will not use the MIP mode when decoding slices related to the APS; when the decoder determines that the value of the MIP mode parameter aps_mip_enable_flag is equal to 1, the decoder The MIP mode is applied when decoding slices related to this APS.
  • the decoder can determine the MIP mode parameter aps_mip_enable_flag after parsing the adaptive parameter set in the code stream, and then can determine whether the current block uses the MIP mode for decoding according to the value of the MIP mode parameter aps_mip_enable_flag .
  • the decoder may obtain the MIP mode parameters from the slice header.
  • Table 6 the implementation of the syntax structure in the slice header is shown, where u(1) represents the entropy decoding method that has been specified in the VVC working draft.
  • the decoder determines that the value of the MIP mode parameter slice_mip_enable_flag is equal to 0, the decoder will not use the MIP mode when decoding the slice; when the decoder determines that the value of the MIP mode parameter slice_mip_enable_flag is equal to 1, the decoder is The MIP mode is applied when decoding.
  • the decoder can determine the MIP mode parameter slice_mip_enable_flag after parsing the slice header information data unit in the bitstream, and then can determine whether the current block uses MIP mode for decoding according to the value of the MIP mode parameter slice_mip_enable_flag deal with.
  • the decoder when decoding tiles or bricks, can obtain similar MIP mode parameters, and the similar MIP mode parameters indicate that when the tiles or bricks are encoded to represent pictures or sub-pictures Whether to use MIP mode as part of the parameter set for the segmentation of tiles or bricks.
  • the decoder may also obtain similar MIP mode parameters from the slice data related to the tiles or tiles in the slice to indicate whether to use the MIP mode when encoding the tiles or tiles.
  • the decoder can obtain various MIP mode parameters from different data units in the input bitstream.
  • the decoder can obtain sps_mip_enable_flag in SPS equal to 1, pps_mip_enable_flag in PPS or aps_mip_enable_flag in APS related to slices in a picture or sub-picture equal to 1, and pps_mip_enable_flag or APS in PPS related to other pictures or sub-pictures Aps_mip_enable_flag in is equal to 0.
  • the decoder may apply the MIP mode when decoding a part of the pictures or sub-pictures in the input bitstream, and will not apply the MIP mode when decoding other pictures or sub-pictures.
  • the decoder can obtain the slice_mip_enable_flag (or similar MIP mode parameter of the tile or brick in the slice data) from the header of the slice in the picture or sub-picture, which is equal to 1, and the decoder can decode the slice.
  • the decoder can also obtain slice_mip_enable_flag from the slice header of another slice in the picture or sub-picture (or the similar MIP mode parameter of the tile or brick in the slice data) equal to 0.
  • the decoder decodes the slice MIP mode will not be applied.
  • the decoder can be implicitly informed whether the MIP mode is used to perform the matching of other syntax elements (for example, the syntax elements of the PTL in one or more parameter sets indicating a bitstream or a sub-bitstream).
  • Input bitstream for decoding For example, when decoding is performed in one or more PTLs, the MIP mode is set to be disabled, and when decoding is performed in other PTLs, the MIP mode is set to be enabled.
  • the embodiment of the application proposes an image prediction method.
  • the decoder parses the code stream to determine the MIP mode parameter of the current block; if the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, the code is analyzed Stream, determine the MIP mode of the current block, and determine the predicted value of the luminance component and chrominance component corresponding to the current block according to the MIP mode; decode the current block according to the predicted value.
  • the encoder when the encoder performs intra-frame prediction on the current block, if it is determined that the current block uses the MIP mode, it can use the MIP mode to obtain the intra-frame prediction value of the current block while setting MIP mode parameters are written into the code stream and transmitted to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameter indicates that the current block uses the MIP mode, the decoder can use the MIP mode to determine the intra prediction of the current block value.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process, and reducing the complexity while ensuring the codec performance. , Reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • the MIP mode can be configured feasibly during the session negotiation process, for example.
  • the transmitter including the encoder will generate a bit stream for the receiver according to the processing capability of the receiver.
  • the sender determines that the receiver cannot successfully enable MIP mode to process the bit stream (or when the receiver informs the sender that the receiver cannot successfully enable MIP mode to decode the bit stream)
  • the sender The bitstream will be generated by disabling the MIP mode, for example by setting sps_mip_enable_flag equal to zero.
  • the second exemplary system includes a transmitter, and the transmitter stores a plurality of bit streams in which the MIP mode is applied when decoding the entire or different parts of the bit stream.
  • the sender determines that the receiver cannot successfully enable the MIP mode to process the bit stream (or when the receiver informs the sender that the receiver cannot successfully enable the MIP mode to decode the bit stream), the sender will proceed Select to send a bit stream with MIP mode disabled, for example, a bit stream with sps_mip_enable_flag equal to 0.
  • the third exemplary system is a real-time communication system, such as video conferencing, video telephony, live video streaming, and so on.
  • the receiver is not always unable to process the bitstream encoded using the MIP mode.
  • the receiver may have a battery. When the energy in the battery is lower than the threshold (for example, 20% of the total power), the low energy causes the receiver to notify the transmitter that the receiver cannot process the bit stream encoded in the MIP mode.
  • the sender When receiving a request from the receiver, the sender generates a bitstream by disabling the MIP mode, for example, by including a new SPS with sps_mip_enable_flag equal to 0 to start a new encoding video sequence (CVS), or by generating a MIP
  • the receiver can inform the transmitter that the receiver is capable of processing the bitstream encoded using MIP mode.
  • the transmitter can use the MIP mode to generate the bit stream and set the corresponding flag in the SPS, PPS, APS, or slice header.
  • the transmitter may switch between different tracks containing different bitstreams generated by different MIP mode configurations to meet the requirements from the receiver.
  • the embodiment of the application proposes an image prediction method.
  • the encoder performs intra prediction on the current block, if it is determined that the current block uses the MIP mode, it can use the MIP mode to obtain the intra prediction value of the current block while setting MIP mode parameters are written into the code stream and transmitted to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameter indicates that the current block uses the MIP mode, the decoder can use the MIP mode to determine the intra prediction of the current block value.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process, and reducing the complexity while ensuring the codec performance. , Reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • FIG. 9 is a schematic diagram 1 of the composition structure of the encoder proposed in this embodiment of the application.
  • the encoder 300 proposed in this embodiment of the application may include Part 301, first determining part 302 and encoding part 303,
  • the setting part 301 is configured to, if the current block uses the MIP mode to determine the intra prediction value of the current block, then set the value of the MIP mode parameter to indicate the use of the MIP mode and write the code stream;
  • the first determining part 302 is configured to determine the MIP mode of the current block, and determine the prediction values of the luminance component and the chrominance component corresponding to the current block according to the MIP mode;
  • the encoding part 303 is configured to write the MIP mode of the current block into a code stream.
  • the setting part 301 is further configured to determine the intra prediction value of the current block if the current block does not use the MIP mode, then set the value of the MIP mode parameter Set to indicate not to use MIP mode and write code stream.
  • one or more syntax units are used to indicate the MIP mode parameter in the code stream.
  • the syntax unit is included in one or more data units in the following code stream: a data unit containing the current block, a slice header information data unit, and image header information Data unit, image layer parameter set, sequence layer parameter set and adaptive parameter set.
  • the first determining part 302 is specifically configured to determine the size type of the current block; construct the candidate MIP mode list based on the size type; from the candidate MIP mode The MIP mode of the current block is determined in the list.
  • the first determining part 302 is further specifically configured to construct the candidate MIP mode list according to 16 MIP modes when the size type of the current block is the first type; When the size type of the current block is the second type, construct the candidate MIP mode list according to 8 MIP modes; when the size type of the current block is the third type, construct the candidate MIP mode list according to 6 MIP modes List of MIP modes.
  • the first determining part 302 is further specifically configured to set the size type of the current block to the first when the width and height of the current block are both equal to 4.
  • One type when the width and height of the current block are both equal to 8, or the width of the current block is equal to 8 and the height is equal to 4, or the width of the current block is equal to 4 and the height is equal to 8, the current block
  • the size type of the block is set to the second type; when the width and height of the current block do not meet the foregoing conditions, the size type of the current block is set to the third type.
  • the first determining part 302 is further specifically configured to set the size type of the current block to the first when the width and height of the current block are both equal to 4.
  • a type when the width and height of the current block are both equal to 8, or one of the width and height of the current block is equal to 4, the size type of the current block is set to the second type; when the When the width and height of the current block do not meet the foregoing conditions, the size type of the current block is set to the third type.
  • FIG. 10 is a second schematic diagram of the composition structure of the encoder proposed in the embodiment of the application.
  • the encoder 300 proposed in the embodiment of the application may further include a first processor 304, and store the first processor 304 to execute The first memory 305 of instructions, the first communication interface 306, and the first bus 307 for connecting the first processor 304, the first memory 305, and the first communication interface 306.
  • the above-mentioned first processor 304 is configured to, if the current block uses the MIP mode to determine the intra prediction value of the current block, set the value of the MIP mode parameter to indicate the use of MIP Mode and write the code stream; determine the MIP mode of the current block, and determine the predicted values of the luminance and chrominance components corresponding to the current block according to the MIP mode; write the MIP mode of the current block into the code flow.
  • the functional modules in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be realized in the form of hardware or software function module.
  • the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this embodiment is essentially or correct
  • the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal A computer, a server, or a network device, etc.) or a processor (processor) execute all or part of the steps of the method in this embodiment.
  • the aforementioned storage media include: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.
  • the embodiment of the application provides an image encoder. If the current block uses the MIP mode to determine the intra prediction value of the current block, the encoder sets the value of the MIP mode parameter to indicate the use of the MIP mode and writes the code stream; Determine the MIP mode of the current block, and determine the predicted values of the luminance and chrominance components corresponding to the current block according to the MIP mode; write the MIP mode of the current block into the code stream.
  • the decoder parses the code stream and determines the MIP mode parameters of the current block; if the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, parses the code stream, determines the MIP mode of the current block, and determines the MIP mode of the current block according to the MIP
  • the mode determines the predicted value of the luminance component and chrominance component corresponding to the current block; according to the predicted value, the current block is decoded.
  • the encoder when the encoder performs intra-frame prediction on the current block, if it is determined that the current block uses the MIP mode, it can use the MIP mode to obtain the intra-frame prediction value of the current block while setting MIP mode parameters are written into the code stream and transmitted to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameter indicates that the current block uses the MIP mode, the decoder can use the MIP mode to determine the intra prediction of the current block value.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process, and reducing the complexity while ensuring the codec performance. , Reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • FIG. 11 is a schematic diagram 1 of the composition structure of the decoder proposed in this embodiment of the application.
  • the decoder 400 proposed in this embodiment of the present application may include decoding Part 401, second determining part 402,
  • the decoding part 401 is configured to analyze the code stream to determine the MIP mode parameter of the current block; and if the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, analyze The code stream, determining the MIP mode of the current block;
  • the second determining part 402 is configured to determine the predicted values of the luminance component and the chrominance component corresponding to the current block according to the MIP mode;
  • the decoding part 401 is further configured to decode the current block according to the predicted value.
  • the second determining part 402 is further configured to analyze the code stream to determine the MIP mode parameter of the current block, if the value of the MIP mode parameter indicates the current The block does not use the MIP mode to determine the intra prediction value of the current block, and it is determined that the current block does not use the MIP mode.
  • one or more syntax units are used to indicate the MIP mode parameter in the code stream.
  • the syntax unit is included in one or more data units in the following code stream: a data unit containing the current block, a slice header information data unit, and image header information Data unit, image layer parameter set, sequence layer parameter set and adaptive parameter set.
  • the decoding part 401 is specifically configured to parse the code stream to obtain the MIP mode index number of the current block; determine the size type of the current block; In the candidate MIP mode list corresponding to the type, the MIP mode indicated by the MIP mode index number is determined as the MIP mode of the current block.
  • the candidate MIP mode list when the size type of the current block is the first type, the candidate MIP mode list is constructed according to 16 MIP modes; when the size type of the current block is the second type When the current block size type is the third type, the candidate MIP mode list is constructed according to the 6 MIP modes.
  • the decoding part 401 is further specifically configured to set the size type of the current block to the first type when the width and height of the current block are both equal to 4. ;
  • the width and height of the current block are both equal to 8, or the width of the current block is equal to 8 and the height is equal to 4, or the width of the current block is equal to 4 and the height is equal to 8, the current block
  • the size type is set to the second type; when the width and height of the current block do not meet the foregoing conditions, the size type of the current block is set to the third type.
  • the decoding part 401 is further specifically configured to set the size type of the current block to the first type when the width and height of the current block are both equal to 4.
  • the size type of the current block is set to the second type; when the current block When the width and height of does not meet the foregoing conditions, the size type of the current block is set to the third type.
  • FIG. 12 is a second schematic diagram of the composition structure of the decoder proposed in the embodiment of the application.
  • the decoder 400 proposed in the embodiment of the present application may further include a second processor 403, which stores a second processor 403 for execution.
  • the second processor 403 is configured to parse the code stream and determine the MIP mode parameter of the current block; if the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine The intra prediction value of the current block is analyzed, the code stream is determined, the MIP mode of the current block is determined, and the prediction values of the luminance component and the chrominance component corresponding to the current block are determined according to the MIP mode; The predicted value is used to decode the current block.
  • the functional modules in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be realized in the form of hardware or software function module.
  • the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this embodiment is essentially or correct
  • the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal A computer, a server, or a network device, etc.) or a processor (processor) execute all or part of the steps of the method in this embodiment.
  • the aforementioned storage media include: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.
  • the embodiment of the application provides an image decoder, which parses the code stream to determine the MIP mode parameter of the current block; if the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, analyze Code stream, determine the MIP mode of the current block, and determine the predicted value of the luminance component and chrominance component corresponding to the current block according to the MIP mode; decode the current block according to the predicted value.
  • the encoder when the encoder performs intra-frame prediction on the current block, if it is determined that the current block uses the MIP mode, it can use the MIP mode to obtain the intra-frame prediction value of the current block while setting MIP mode parameters are written into the code stream and transmitted to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameter indicates that the current block uses the MIP mode, the decoder can use the MIP mode to determine the intra prediction of the current block value.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process, and reducing the complexity while ensuring the codec performance. , Reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.
  • the embodiments of the present application provide a computer-readable storage medium and a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the method as described in the foregoing embodiment is implemented.
  • the program instructions corresponding to an image prediction method in this embodiment can be stored on storage media such as optical disks, hard disks, USB flash drives, etc.
  • storage media such as optical disks, hard disks, USB flash drives, etc.
  • the value of the MIP mode parameter is set to indicate the use of the MIP mode and write the code stream;
  • the program instructions corresponding to an image prediction method in this embodiment can be stored on storage media such as optical disks, hard disks, USB flash drives, etc.
  • storage media such as optical disks, hard disks, USB flash drives, etc.
  • the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, parse the code stream, determine the MIP mode of the current block, and determine according to the MIP mode Prediction values of the luminance component and the chrominance component corresponding to the current block;
  • the current block is decoded.
  • this application can be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of hardware embodiments, software embodiments, or embodiments combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device realizes the functions specified in one or more processes in the schematic diagram and/or one block or more in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing functions specified in one or more processes in the schematic diagram and/or one block or more in the block diagram.
  • the embodiments of this application provide an image prediction method, encoder, decoder, and storage medium. If the current block uses the MIP mode to determine the intra prediction value of the current block, the encoder sets the value of the MIP mode parameter to indicate the use MIP mode and write the code stream; determine the MIP mode of the current block, and determine the predicted values of the luminance and chrominance components corresponding to the current block according to the MIP mode; write the MIP mode of the current block into the code stream.
  • the decoder parses the code stream and determines the MIP mode parameters of the current block; if the value of the MIP mode parameter indicates that the current block uses the MIP mode to determine the intra prediction value of the current block, parses the code stream, determines the MIP mode of the current block, and determines the MIP mode of the current block according to the MIP
  • the mode determines the predicted value of the luminance component and chrominance component corresponding to the current block; according to the predicted value, the current block is decoded.
  • the encoder when the encoder performs intra-frame prediction on the current block, if it is determined that the current block uses the MIP mode, it can use the MIP mode to obtain the intra-frame prediction value of the current block while setting MIP mode parameters are written into the code stream and transmitted to the decoding side; the decoder parses the code stream to obtain the MIP mode parameters. If the MIP mode parameter indicates that the current block uses the MIP mode, the decoder can use the MIP mode to determine the intra prediction of the current block value.
  • the image prediction method proposed in this application can use the syntax unit to indicate whether the current block uses the MIP mode in the code stream, thereby simplifying the image prediction process, and reducing the complexity while ensuring the codec performance. , Reduce the storage space and overall time required in the encoding and decoding process, and effectively improve the encoding and decoding efficiency.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
PCT/CN2020/090665 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质 Ceased WO2021004153A1 (zh)

Priority Applications (22)

Application Number Priority Date Filing Date Title
KR1020217042822A KR20220029589A (ko) 2019-07-07 2020-05-15 픽처 예측 방법, 인코더, 디코더 및 저장 매체
CN202411513518.5A CN119402667B (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质
CN202511901564.7A CN121691720A (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质
CN202080044380.2A CN114467306A (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质
CN202210123294.1A CN114786019B (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质
CN202511901524.2A CN121728265A (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质
CN202511251840.XA CN120956924A (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质
CN202511901544.XA CN121691719A (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质
CN202511900561.1A CN121691718A (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质
JP2021577825A JP2022539768A (ja) 2019-07-07 2020-05-15 画像予測方法、エンコーダ、デコーダ及び記憶媒体
CN202411513473.1A CN119629366A (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质
EP20837468.6A EP3975565A4 (en) 2019-07-07 2020-05-15 IMAGE PREDICTION METHOD, ENCODER, DECODER, AND INFORMATION HOLDER
US17/646,222 US12126836B2 (en) 2019-07-07 2021-12-28 Picture prediction method, encoder, decoder, and storage medium
US18/817,868 US20240430487A1 (en) 2019-07-07 2024-08-28 Picture prediction method, encoder, decoder, and storage medium
JP2025049891A JP2025094208A (ja) 2019-07-07 2025-03-25 画像予測方法、エンコーダ、デコーダ及び記憶媒体
JP2025049857A JP2025094206A (ja) 2019-07-07 2025-03-25 画像予測方法、エンコーダ、デコーダ及び記憶媒体
JP2025049936A JP2025094210A (ja) 2019-07-07 2025-03-25 画像予測方法、エンコーダ、デコーダ及び記憶媒体
JP2025049967A JP2025106816A (ja) 2019-07-07 2025-03-25 画像予測方法、エンコーダ、デコーダ及び記憶媒体
US19/319,267 US20260006253A1 (en) 2019-07-07 2025-09-04 Picture prediction method, encoder, decoder, and storage medium
US19/319,220 US20260006252A1 (en) 2019-07-07 2025-09-04 Picture prediction method, encoder, decoder, and storage medium
US19/319,299 US20260006254A1 (en) 2019-07-07 2025-09-04 Picture prediction method, encoder, decoder, and storage medium
US19/399,404 US20260082082A1 (en) 2019-07-07 2025-11-24 Picture prediction method, encoder, decoder, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962871177P 2019-07-07 2019-07-07
US62/871,177 2019-07-07

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US17/646,222 Continuation US12126836B2 (en) 2019-07-07 2021-12-28 Picture prediction method, encoder, decoder, and storage medium
US19/319,220 Continuation US20260006252A1 (en) 2019-07-07 2025-09-04 Picture prediction method, encoder, decoder, and storage medium

Publications (1)

Publication Number Publication Date
WO2021004153A1 true WO2021004153A1 (zh) 2021-01-14

Family

ID=74114397

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/090665 Ceased WO2021004153A1 (zh) 2019-07-07 2020-05-15 图像预测方法、编码器、解码器以及存储介质

Country Status (6)

Country Link
US (6) US12126836B2 (https=)
EP (1) EP3975565A4 (https=)
JP (5) JP2022539768A (https=)
KR (1) KR20220029589A (https=)
CN (9) CN121691718A (https=)
WO (1) WO2021004153A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023193254A1 (zh) * 2022-04-08 2023-10-12 Oppo广东移动通信有限公司 解码方法、编码方法、解码器以及编码器
JP2025511314A (ja) * 2022-04-08 2025-04-15 オッポ広東移動通信有限公司 デコーディング方法、エンコーディング方法、デコーダー及びエンコーダー

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020256466A1 (ko) * 2019-06-19 2020-12-24 한국전자통신연구원 화면 내 예측 모드 및 엔트로피 부호화/복호화 방법 및 장치
CN114600451B (zh) * 2019-08-22 2025-04-25 Lg电子株式会社 基于矩阵帧内预测的图像编码设备和方法
CN120166221A (zh) * 2019-08-22 2025-06-17 Lg 电子株式会社 基于矩阵的帧内预测设备和方法
EP4042681A1 (en) * 2019-10-11 2022-08-17 InterDigital VC Holdings France, SAS Deep intra predictor generating side information
CN116320438A (zh) * 2022-09-16 2023-06-23 浙江大华技术股份有限公司 帧内预测模式的确定方法、智能编码方法及智能解码方法
CN120202662A (zh) * 2022-10-12 2025-06-24 Lg 电子株式会社 基于帧内预测的图像编码/解码方法、传输比特流的方法以及存储比特流的记录介质
EP4714118A1 (en) * 2023-05-15 2026-03-25 MediaTek Inc. Methods and apparatus for selecting transform type in a video coding system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110677655A (zh) * 2019-06-21 2020-01-10 杭州海康威视数字技术股份有限公司 一种编解码方法、装置及存储介质

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103096051B (zh) * 2011-11-04 2017-04-12 华为技术有限公司 一种图像块信号分量采样点的帧内解码方法和装置
CN103369315B (zh) * 2012-04-06 2016-08-24 华为技术有限公司 色度分量的帧内预测模式的编码、解码方法、设备及系统
WO2015056955A1 (ko) * 2013-10-14 2015-04-23 삼성전자 주식회사 다시점 비디오 부호화 방법 및 장치, 다시점 비디오 복호화 방법 및 장치
WO2016200984A1 (en) * 2015-06-08 2016-12-15 Vid Scale, Inc. Intra block copy mode for screen content coding
WO2018080135A1 (ko) * 2016-10-28 2018-05-03 한국전자통신연구원 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
US20190089952A1 (en) * 2017-09-19 2019-03-21 Futurewei Technologies, Inc. Bidirectional Weighted Intra Prediction
WO2019098464A1 (ko) * 2017-11-14 2019-05-23 삼성전자 주식회사 부호화 방법 및 그 장치, 복호화 방법 및 그 장치
KR102622452B1 (ko) * 2018-09-13 2024-01-09 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. 아핀 선형 가중 인트라 예측
EP4340356A3 (en) * 2018-09-21 2024-05-29 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image signal encoding/decoding method and apparatus therefor
WO2020156516A1 (en) * 2019-01-31 2020-08-06 Beijing Bytedance Network Technology Co., Ltd. Context for coding affine mode adaptive motion vector resolution
US11616966B2 (en) * 2019-04-03 2023-03-28 Mediatek Inc. Interaction between core transform and secondary transform
US11134257B2 (en) * 2019-04-04 2021-09-28 Tencent America LLC Simplified signaling method for affine linear weighted intra prediction mode
MX2021012229A (es) * 2019-04-12 2021-11-03 Beijing Bytedance Network Tech Co Ltd Determinacion de modo de codificacion de croma basada en intraprediccion basada en matriz.
HUE064847T2 (hu) * 2019-04-16 2024-04-28 Lg Electronics Inc Transzformáció képkódolásnál végzett mátrix alapú intra-predikcióhoz
US11381808B2 (en) * 2019-04-25 2022-07-05 Hfi Innovation Inc. Method and apparatus of matrix based intra prediction in image and video processing
US11363284B2 (en) * 2019-05-09 2022-06-14 Qualcomm Incorporated Upsampling in affine linear weighted intra prediction
US11134275B2 (en) * 2019-06-04 2021-09-28 Tencent America LLC Method and apparatus for performing primary transform based on filtering of blocks
US11252410B2 (en) * 2019-06-11 2022-02-15 Tencent America LLC Method and apparatus for video coding
US20200404324A1 (en) * 2019-06-19 2020-12-24 Qualcomm Incorporated Signaling for intra coding of video data
US11197025B2 (en) * 2019-06-21 2021-12-07 Qualcomm Incorporated Signaling of matrix intra prediction parameters in video coding
EP3991406A1 (en) * 2019-06-25 2022-05-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Coding using matrix based intra-prediction and secondary transforms
JP7814937B2 (ja) * 2019-08-30 2026-02-17 アリババ グループ ホウルディング リミテッド 映像信号の行列加重イントラ予測
US20210092405A1 (en) * 2019-09-19 2021-03-25 Qualcomm Incorporated Matrix combination for matrix-weighted intra prediction in video coding
TWI848377B (zh) * 2019-09-24 2024-07-11 弗勞恩霍夫爾協會 基於矩陣之內部預測之高效實施技術
CN115280774B (zh) * 2019-12-02 2025-08-19 抖音视界有限公司 视觉媒体处理的方法、装置及非暂时性计算机可读存储介质
US11563957B2 (en) * 2021-01-13 2023-01-24 Lemon Inc. Signaling for decoder-side intra mode derivation
US11290736B1 (en) * 2021-01-13 2022-03-29 Lemon Inc. Techniques for decoding or coding images based on multiple intra-prediction modes

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110677655A (zh) * 2019-06-21 2020-01-10 杭州海康威视数字技术股份有限公司 一种编解码方法、装置及存储介质

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
HEO (LGE) J; NAM J; CHOI J; LIM J; KIM (LGE) S: "Non-CE3 : Clean-up intra type signaling", 15. JVET MEETING; 20190703 - 20190712; GOTHENBURG; (THE JOINT VIDEO EXPLORATION TEAM OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ), no. JVET-O0351-v2, 1 July 2019 (2019-07-01), Gothenburg SE, pages 1 - 6, XP030219311 *
JANGWON CHOI; JIN HEO; JAEHYUN LIM; SEUNG HWAN KIM: "Non-CE3: MIP mode reduction", 15. JVET MEETING; 20190703 - 20190712; GOTHENBURG; (THE JOINT VIDEO EXPLORATION TEAM OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ), no. JVET-O0397, 26 June 2019 (2019-06-26), Gothenburg SE, pages 1 - 9, XP030219453 *
JONATHAN PFAFF; BJORN STALLENBERGER; MICHAEL SCHAFER; PHILLIP MERKLE; PHILIPP HELLE; TOBIAS HINZ; HEIKO SCHWARZ; DETLEV MARPE; THO: "CE3: Affine linear weighted intra prediction (CE3-4.1, CE3-4.2)", JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, no. JVET-N0217, 27 March 2019 (2019-03-27), Geneva, CH, pages 1 - 17, XP030202699 *
See also references of EP3975565A4

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023193254A1 (zh) * 2022-04-08 2023-10-12 Oppo广东移动通信有限公司 解码方法、编码方法、解码器以及编码器
JP2025511315A (ja) * 2022-04-08 2025-04-15 オッポ広東移動通信有限公司 デコーディング方法、エンコーディング方法、デコーダー及びエンコーダー
JP2025511314A (ja) * 2022-04-08 2025-04-15 オッポ広東移動通信有限公司 デコーディング方法、エンコーディング方法、デコーダー及びエンコーダー

Also Published As

Publication number Publication date
US12126836B2 (en) 2024-10-22
JP2025094210A (ja) 2025-06-24
CN114786019A (zh) 2022-07-22
US20220191548A1 (en) 2022-06-16
EP3975565A4 (en) 2022-07-27
JP2025094206A (ja) 2025-06-24
JP2022539768A (ja) 2022-09-13
CN119402667A (zh) 2025-02-07
US20240430487A1 (en) 2024-12-26
CN119629366A (zh) 2025-03-14
CN121691719A (zh) 2026-03-17
EP3975565A1 (en) 2022-03-30
US20260006252A1 (en) 2026-01-01
US20260006254A1 (en) 2026-01-01
CN114786019B (zh) 2024-10-18
US20260006253A1 (en) 2026-01-01
CN114467306A (zh) 2022-05-10
KR20220029589A (ko) 2022-03-08
CN121691720A (zh) 2026-03-17
CN121728265A (zh) 2026-03-24
JP2025106816A (ja) 2025-07-16
CN121691718A (zh) 2026-03-17
JP2025094208A (ja) 2025-06-24
CN120956924A (zh) 2025-11-14
US20260082082A1 (en) 2026-03-19
CN119402667B (zh) 2026-02-03

Similar Documents

Publication Publication Date Title
WO2021004153A1 (zh) 图像预测方法、编码器、解码器以及存储介质
CN114830651B (zh) 帧内预测方法、编码器、解码器以及计算机存储介质
CN103548356B (zh) 使用跳跃模式的图像解码方法及使用该方法的装置
CN102857764B (zh) 帧内预测模式处理的方法和装置
WO2021004152A1 (zh) 图像分量的预测方法、编码器、解码器以及存储介质
JP2025010162A (ja) 行列ベースのイントラ予測と二次変換コア選択を調和させるエンコーダ、デコーダ、および対応する方法
CN105659606A (zh) 用于视频和图像编码和解码的基础颜色索引图模式的特征
JP2025061302A (ja) Ｖｖｃにおける色変換のための方法及び機器
US20240236378A1 (en) Encoding method, decoding method, and decoder
CN105230021A (zh) 屏幕内容的词典编码和解码
CN110650349A (zh) 一种图像编码方法、解码方法、编码器、解码器及存储介质
CN115151941A (zh) 用于视频编码的方法和设备
JP2024045388A (ja) 画像デコーディング方法、デコーダ及びコンピューター記憶媒体
KR101462637B1 (ko) 영상 부호화/복호화 방법 및 장치
JP2021519018A (ja) 効率的なデブロッキングを実行するための画像処理デバイス及び方法
CN112135128A (zh) 图像预测方法、编码树节点划分方法及其装置
WO2025217770A1 (zh) 编解码方法、编解码器以及存储介质
HK40075484B (zh) 视频处理的方法、计算机装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20837468

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021577825

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2020837468

Country of ref document: EP

Effective date: 20211222