WO2021244586A1 - 编解码方法及装置 - Google Patents

编解码方法及装置 Download PDF

Info

Publication number
WO2021244586A1
WO2021244586A1 PCT/CN2021/098009 CN2021098009W WO2021244586A1 WO 2021244586 A1 WO2021244586 A1 WO 2021244586A1 CN 2021098009 W CN2021098009 W CN 2021098009W WO 2021244586 A1 WO2021244586 A1 WO 2021244586A1
Authority
WO
WIPO (PCT)
Prior art keywords
current block
mode
transform skip
transform
skip mode
Prior art date
Application number
PCT/CN2021/098009
Other languages
English (en)
French (fr)
Inventor
曹小强
Original Assignee
杭州海康威视数字技术股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州海康威视数字技术股份有限公司 filed Critical 杭州海康威视数字技术股份有限公司
Priority to US17/928,446 priority Critical patent/US20230319259A1/en
Priority to JP2022574826A priority patent/JP7467687B2/ja
Priority to KR1020227043634A priority patent/KR20230008881A/ko
Publication of WO2021244586A1 publication Critical patent/WO2021244586A1/zh
Priority to JP2024060323A priority patent/JP2024081780A/ja

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • H04N19/122—Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/625—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96—Tree coding, e.g. quad-tree coding

Definitions

  • This application relates to video coding and decoding technology, and in particular to a coding and decoding method and device.
  • Video coding generally includes operations such as prediction, transformation, quantization, entropy coding, and filtering. Among them, prediction includes intra-frame prediction and inter-frame prediction.
  • Transformation refers to the conversion of an image described in the form of pixels in the spatial domain to the transform domain, which is expressed in the form of transform coefficients. Most images contain more flat areas and areas with slowly changing pixel values. Proper transformation can convert the scattered distribution of image energy in the spatial domain to a relatively concentrated distribution in the transform domain, removing the frequency domain between signals. Correlation, in conjunction with the quantization process, can effectively compress the code stream.
  • the implicit selection of transform skip mode (Implicit Selection of Transform Skip mode, referred to as ISTS) scheme instructs the encoding end device to perform transform skip processing or DCT2 transform processing on the current block through the parity of the non-zero transform coefficients of the current block.
  • the present application provides an encoding method, decoding method and device.
  • a decoding method including:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode, the current block is satisfied as a luminance block, and the width and height of the current block are both less than 64.
  • a decoding method including:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode, and it is satisfied that the current block is a luminance block, and the width and height of the current block are both less than 64.
  • a decoding method including:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode, the current block does not adopt the inter-frame prediction filtering mode, and it is satisfied that the current block is a luminance block, and the width and height of the current block are both less than 64.
  • a decoding method including:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode.
  • a decoding method including:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode.
  • a decoding method including:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode, and the current block does not adopt the inter-frame prediction filtering mode.
  • an encoding method including:
  • the current block meeting the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode, the current block is satisfied as a luminance block, and the width and height of the current block are both less than 64.
  • an encoding method including:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode, it is satisfied that the current block is a luminance block, and the width and height of the current block are both less than 64.
  • an encoding method including:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode, the current block does not use the inter-prediction filtering mode, and it is satisfied that the current block is a luminance block, and the current block is a luminance block.
  • the width and height of the block are both less than 64.
  • an encoding method including:
  • the current block meeting the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode.
  • an encoding method including:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode.
  • an encoding method including:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode, and the current block does not use the inter-frame prediction filtering mode.
  • a decoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable storage The medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode, the current block is satisfied as a luminance block, and the width and height of the current block are both less than 64.
  • a decoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable storage The medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode, and it is satisfied that the current block is a luminance block, and the width and height of the current block are both less than 64.
  • a decoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable storage The medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode, the current block does not adopt the inter-frame prediction filtering mode, and it is satisfied that the current block is a luminance block, and the width and height of the current block are both less than 64.
  • a decoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable storage The medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode.
  • a decoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable storage The medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode.
  • a decoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable storage The medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode, and the current block does not adopt the inter-frame prediction filtering mode.
  • an encoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable storage The medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • the current block meeting the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode, the current block is satisfied as a luminance block, and the width and height of the current block are both less than 64.
  • an encoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable storage The medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode, it is satisfied that the current block is a luminance block, and the width and height of the current block are both less than 64.
  • an encoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable The storage medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and when the processor executes the computer program, the computer program prompts:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode, the current block does not use the inter-prediction filtering mode, and it is satisfied that the current block is a luminance block, and the current block is a luminance block.
  • the width and height of the block are both less than 64.
  • an encoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable The storage medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and when the processor executes the computer program, the computer program prompts:
  • the current block meeting the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode.
  • an encoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable The storage medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and when the processor executes the computer program, the computer program prompts:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode.
  • an encoding device which is characterized by comprising: a processor, a communication interface, a machine-readable storage medium, and a communication bus, wherein the processor, the communication interface, and the machine-readable The storage medium communicates with each other through a communication bus; the machine-readable storage medium stores a computer program, and when the processor executes the computer program, the computer program prompts:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode, and the current block does not adopt the inter-frame prediction filtering mode.
  • a machine-readable storage medium having computer instructions stored thereon, and when the computer instructions are executed by a processor, the processor implements the method according to any of the above aspects. The method described.
  • the code stream is obtained, and the value of the inter-frame conversion skip mode enable flag bit is obtained from the code stream; when the value of the inter-frame conversion skip mode enable flag bit is the first value, and the current
  • inverse transform skip processing or DCT2 inverse transform processing is performed on the current block to obtain the transform coefficients of the current block, and
  • the transform coefficient is subjected to inverse quantization processing to obtain the residual coefficient of the current block; further, the reconstruction value of the current block is determined based on the prediction value of the current block and the residual coefficient of the current block.
  • the inter-frame conversion skip mode enable flag bit controls the conversion skip mode application for the inter prediction mode or/and the direct mode, which improves the conversion skip
  • the flexibility and controllability of the mode application thereby improving the flexibility and controllability of the ISTS solution
  • the application range of the ISTS solution is expanded. And can improve the coding performance and reduce the decoding delay.
  • FIGS. 1A to 1B are schematic diagrams showing block division according to an exemplary embodiment of the present application.
  • Figures 2A ⁇ 2B are schematic diagrams of the derivation of the DT division mode
  • Figure 2C is a schematic diagram of the transformation in the DT division mode
  • Fig. 3A is a schematic diagram showing sub-block division of a PBT mode according to an exemplary embodiment of the present application
  • FIG. 3B is a schematic diagram showing the sub-block division of the SBT mode according to an exemplary embodiment of the present application.
  • Fig. 4 is a schematic diagram of a coding and decoding method shown in an exemplary embodiment of the present application.
  • Fig. 5 is a schematic flowchart of an image processing method shown in an exemplary embodiment of the present application.
  • FIG. 6 is a schematic flowchart of another image processing method shown in another exemplary embodiment of the present application.
  • FIG. 7 is a schematic flowchart of another image processing method shown in another exemplary embodiment of the present application.
  • Fig. 8 is a schematic flowchart of a decoding method shown in an exemplary embodiment of the present application.
  • Fig. 9 is a schematic flowchart of an encoding method shown in an exemplary embodiment of the present application.
  • Fig. 10 is a schematic diagram showing the hardware structure of a decoding device according to an exemplary embodiment of the present application.
  • Fig. 11 is a schematic diagram of a functional structure of a decoding device shown in an exemplary embodiment of the present application.
  • Fig. 12 is a schematic diagram showing the hardware structure of an encoding device according to an exemplary embodiment of the present application.
  • Fig. 13 is a schematic diagram of a functional structure of an encoding device shown in an exemplary embodiment of the present application.
  • a CTU Coding Tree Unit, coding tree unit
  • CU Coding Tree Unit
  • the CU may be further divided into two or four PUs (Prediction Unit, prediction unit), and the same prediction information is used in the same PU.
  • Prediction Unit prediction unit
  • a CU can be further divided into multiple TUs (Transform Units).
  • the current image block in this application is a PU.
  • VVC Very Video Coding
  • a division structure that mixes binary tree/trinomial tree/quadtree replaces the original division mode, cancels the distinction between the original concepts of CU, PU, and TU, and supports a more flexible division of CU.
  • the CU can be divided into a square or a rectangle.
  • the CTU first divides the quadtree, and then the leaf nodes of the quadtree can be further divided into binary trees and ternary trees.
  • Figure 1A there are five types of CU divisions, namely quadtree division, horizontal binary tree division, vertical binary tree division, horizontal trinomial tree division, and vertical trinomial tree division.
  • a CU division within a CTU It can be any combination of the above five division types. Different division methods can be seen from the above, so that the shape of each PU is different, such as rectangles and squares of different sizes.
  • Transform kernel In video coding, transformation is an indispensable stage to achieve video data compression, which can make the signal energy more concentrated, and is based on discrete cosine transform (DCT)/discrete sine transform (Discrete Sine Transform, DST) transformation technology is the mainstream transformation technology of video coding. DCT and DST are specifically divided into multiple transformation cores according to different basis functions. The three commonly used transformation cores can be shown in Table 1:
  • Forward transform forward transform
  • inverse transform inverse transform
  • Positive transformation is to convert a two-dimensional residual signal (residual coefficient) into a two-dimensional spectrum signal (transform coefficient) with more concentrated energy.
  • the transform coefficient can effectively remove the high-frequency components, retain the middle and low-frequency components, and realize the video data compression.
  • the positive transformation can be expressed in the form of a matrix as the following formula:
  • f represents the original residual signal of NxM dimensions
  • M represents the width of the residual block
  • N represents the height of the residual block
  • F represents the frequency domain signal of NxM dimensions
  • a and B represent MxM and NxN dimensional transformation matrices, they all satisfy Orthogonality.
  • Inverse transformation also known as inverse transformation, is the inverse process of forward transformation, that is, the frequency domain signal F is converted into the time domain residual signal f through orthogonal transformation matrices A and B.
  • the inverse transformation can be expressed in the form of a matrix as the following formula:
  • the forward transformation of a two-dimensional signal can be realized by two one-dimensional forward transformations.
  • an M*N signal X is obtained, which removes the correlation between the pixels in the horizontal direction of the two-dimensional residual signal. It can be called a horizontal transformation, and A is called a horizontal transformation matrix; the second time The positive transformation removes the correlation between pixels in the vertical direction of the two-dimensional residual signal, and can be called a vertical transformation, and B is called a vertical transformation matrix.
  • Transform pair It can also be called transform check.
  • TU supports matrix blocks, so M is not necessarily equal to N, so the dimensions of A and B are not necessarily equal.
  • the next-generation video coding standard also supports: A and B are not the same transformation
  • H, V composed of the transformation cores corresponding to A and B in the transformation, where H is called the horizontal transformation kernel and V is called the vertical transformation kernel.
  • Secondary transformation is the technology adopted by AVS2.
  • AVS3 inherits the secondary transformation technology of AVS2 and uses different transformation cores for 4x4 blocks and non-4x4 blocks.
  • Derive tree (Derive Tree, DT for short) division mode: also called “derived mode”, which is a new division mode that generates new division shapes and can further gain performance gains.
  • the DT division mode may include a horizontal derivation mode and a vertical derivation mode, and the schematic diagram thereof may be as shown in FIG. 2A.
  • the DT division mode can be grown on the leaf nodes of a quadtree or a binary tree. As shown in Figure 2B, for I-frames or non-I frames, the DT division mode can be derived by combining and dividing the boundaries of CUs. Different PU partitions (2N ⁇ hN, 2N ⁇ nU, 2N ⁇ nD, hN ⁇ 2N, nL ⁇ 2N or nR ⁇ 2N).
  • the CU that uses the derivative mode for prediction can use 4 non-blocks for transform and quantization, and there is no need to introduce a new transform core.
  • the schematic diagram can be as shown in FIG. 2C.
  • a CU using the horizontal derivation mode must meet the following two conditions:
  • the height is greater than or equal to 16 and less than or equal to 64;
  • the CU using the vertical derivative mode must meet the following two conditions:
  • the width is greater than or equal to 16 and less than or equal to 64;
  • Position-Based Transform (PBT) mode For traditional inter-frame residual transform, the transform unit is the same as the coding unit, and is no longer divided.
  • the traditional DCT2 transform method is used for transform processing, but the inter-frame residual The difference is not a natural image, it does not have stable characteristics, and has diversity. Therefore, the traditional DCT2 transformation method is not necessarily the best transformation method, and the residual amplitude near the prediction boundary is relatively large. Therefore, for inter-frame residual blocks (blocks or non-blocks) within a certain size range, you can choose to use the PBT mode or choose to use the traditional DCT2 transformation method. You can use the rate-distortion optimization to select the best transformation method and identify all of them in the code stream. The selected transformation method.
  • the solid line boundary represents the boundary of the coding unit
  • the dotted line represents the sub-block boundary after PBT division.
  • the RDO is used to select whether to use the PBT mode or the DCT2 conversion method for the coding unit.
  • the sub-blocks divided by PBT are respectively identified as 0-3. According to the positions of the 0-3 sub-blocks, the transformation check information is determined, and there is no need to encode the index of the transformation check in the code stream.
  • Sub-Block Transform (SBT) mode The inter-frame residual block is divided into 2 sub-blocks, the residual of one sub-block is 0 by default, and the residual of the other sub-block is not 0 by default ; There are 8 options for the size and position of the non-zero residual sub-block (transmit these information in the code stream), the transformation of the non-zero residual sub-block is adaptively selected according to the position of the sub-block as the horizontal transformation method. And vertical transformation method.
  • the sub-block transformation modes may include 8 types.
  • Inter-prediction filtering mode Inter-prediction filtering technology is a technology adopted in AVS3. It is used in Direct mode to eliminate the spatial discontinuity between the prediction block and surrounding pixels caused by inter-prediction.
  • inter-frame prediction filtering is further divided into ordinary inter-frame prediction filtering and enhanced inter-frame prediction filtering:
  • Ordinary inter-frame prediction filtering refers to the use of inter-frame prediction to obtain the inter-frame prediction value, and then intra-frame prediction to obtain the intra-frame prediction value, and finally the inter-frame prediction value and intra-frame prediction value are weighted to obtain the final prediction value.
  • the general inter-frame prediction filtering process is as follows:
  • Pred_V(x,y) ((h-1-y)*Recon(x,-1)+(y+1)*Recon(-1,h)+(h>>1))>>log2(h )
  • Pred_H(x,y) ((w-1-x)*Recon(-1,y)+(x+1)*Recon(w,-1)+(w>>1))>>log2(w )
  • w and h are the width and height of the current block
  • x and y are the relative coordinates in the current block
  • Recon(x,y) are the surrounding reconstructed pixel values.
  • P(x,y) is the predicted value obtained by inter-frame prediction
  • P′(x,y) is the predicted value after filtering.
  • Enhanced inter-frame prediction filtering refers to the use of inter-frame prediction to obtain inter-frame prediction values, and then use a column of reconstructed pixels on the left side of the current block and a row of reconstructed pixels above as reference pixels, and use a 3-tap filter to filter the current prediction block.
  • the filtering process is as follows:
  • P'(x, y) is the predicted value after filtering
  • P(x, y) is the predicted value obtained from inter-frame prediction
  • f(x) and f(y) are filter coefficients
  • N is the predicted value of the block size.
  • the corresponding filter coefficients of the sizes of different prediction blocks and the distances between the prediction pixels of the position coordinates of (x, y) and the reference pixels may be as shown in Table 2:
  • the size of the prediction block represents the width or height of the intra prediction block; the distance from the reference pixel represents the prediction distance, and the maximum prediction distance is set to 10.
  • the coefficients in Table 2 are the filter coefficients after amplification.
  • the first column corresponding to size 4 indicates that the width (height) of the current prediction block is 4, and the corresponding horizontal (vertical) filter coefficient should use the coefficient corresponding to the first column according to the predicted distance;
  • the first row corresponding to distance 1 indicates When the prediction distance is 1, the coefficient corresponding to the first row should be used according to the width (height) of the current prediction block.
  • the identification method of inter-frame prediction filtering may be as shown in Table 3:
  • Filtering method index Filter type Stream ID 0 No filtering 0 1 Ordinary inter-frame prediction filtering 10 2 Enhanced inter-frame prediction filtering 11
  • the encoding end device selects the optimal filtering method through the RDO strategy and encodes the corresponding code stream identifier into the code stream, and the decoding end device decodes the code stream identifier to determine the final filtering method.
  • Transform Skip (TS for short) mode: After the residual block is obtained, the current block is not transformed (including the initial transformation and secondary transformation), but the residual coefficient of the current block is simply shifted Operation, transform skip and inverse transform skip operation process is as follows:
  • the matrix C is used as the transformation coefficient matrix CoeffMatrix for the quantization and entropy coding process.
  • Rate-distortion principle (RDO, Rate-Distortion Optimized): The index to evaluate coding efficiency includes: code rate and peak signal-to-noise ratio (Peak Signal to Noise Ratio, PSNR for short). The smaller the code rate, the greater the compression rate; the greater the PSNR, the better the quality of the reconstructed image. When choosing a model, the discriminant formula is essentially a comprehensive evaluation of the two.
  • D distortion
  • SSE Standard of Mean Squared Difference index
  • ⁇ the Lagrangian multiplier
  • R The actual number of bits required for image block coding in this mode, including the sum of bits required for coding mode information, motion information, residuals, etc.
  • the mode selection if the RDO principle is used to make a comparison decision on the coding mode, the best coding performance can usually be guaranteed.
  • Skip (Skip) mode The encoding end device does not transmit residual information, nor does it transmit motion vector residual (MVD), but only transmits the index of the motion information.
  • the decoding device can derive the motion information of the current block by analyzing the index of the motion information. After obtaining the motion information, use the motion information to determine the predicted value, and use the predicted value as the reconstructed value.
  • Direct mode The encoding end device needs to transmit residual information, but does not transmit MVD, but transmits the index of motion information.
  • the decoding device can derive the motion information of the current block by analyzing the index of the motion information. After obtaining the motion information, the motion information is used to determine the predicted value, and the predicted value is added to the residual value to obtain the reconstructed value.
  • Inter-frame prediction mode the encoding end equipment transmits the index, MVD and residual information of the motion information.
  • skip mode or direct mode the motion information of the current block is fully multiplexed with the motion information of an adjacent block in the time domain or the space domain.
  • the movement information of the block Therefore, in skip mode or direct mode, an index value can be coded to indicate which motion information in the motion information set is used by the current block, and the difference between skip mode and direct mode is that skip mode does not require coding residuals , While the direct mode requires coding residuals.
  • skip mode or direct mode can greatly save the coding overhead of motion information.
  • multiple prediction modes can be used to determine how to generate inter-frame prediction values, such as ordinary direct mode, sub-block mode, coding prediction (Merge with Motion Vector Difference, referred to as MMVD) mode, and inter-frame prediction filtering (interpf) Mode, inter-frame angle weighted prediction (Angular Weighted Prediction, referred to as AWP) mode, based on arbitrary geometric partitioning (Geometrical Partitioning, referred to as GEO) mode.
  • MMVD Motion with Motion Vector Difference
  • interpf inter-frame prediction filtering
  • AWP inter-frame angle weighted prediction
  • GEO geometric Partitioning
  • the sub-block mode may include an Affine mode or a sub-block-based temporal motion vector prediction (subblock-based temporal motion vector prediction, SbTMVP for short) mode.
  • Implicit Selection of Transform Skip mode (Implicit Selection of Transform Skip mode, referred to as ISTS): AVS-M5160 proposes the ISTS solution, and the encoder end device needs to use RDO to select (DCT2, DCT2) or transform skip mode.
  • DCT2, DCT2 the number of non-zero transform coefficients of the current block should be an even number. If the actual number of non-zero transform coefficients is odd, the encoding end device will pass the last The method of setting bit non-zero transform coefficients to zero makes the number of non-zero transform coefficients of the current block an even number.
  • the number of non-zero transform coefficients of the current block should be an odd number. If the actual number of non-zero transform coefficients is an even number, the encoding end device can pass the last bit The way of setting non-zero transform coefficients to zero makes the number of non-zero transform coefficients of the current block an odd number.
  • the selection method of ISTS transformation method can be as shown in Table 4:
  • the decoding end device counts the parity of the number of non-zero transform coefficients of the current block, and can obtain the transform mode used by the current block according to Table 3.
  • Video coding generally includes prediction, transformation, quantization, entropy coding and other processes. Further, the coding process can also be implemented in accordance with the framework of Figure 4 (b) .
  • Intra-frame prediction uses the surrounding coded blocks as a reference to predict the current uncoded block, effectively removing the redundancy in the spatial domain.
  • Inter-frame prediction is to use adjacent coded images to predict the current image, effectively removing redundancy in the time domain.
  • Transformation refers to transforming an image from the spatial domain to the transform domain, and using transform coefficients to represent the image. Most images contain more flat areas and areas with slowly changing pixel values. Appropriate transformation can transform the image from a scattered distribution in the spatial domain to a relatively concentrated distribution in the transform domain, removing the frequency domain correlation between signals. , With the quantization process, the code stream can be effectively compressed.
  • Entropy coding is a lossless coding method that can convert a series of element symbols into a binary code stream for transmission or storage.
  • the input symbols may include quantized transform coefficients, motion vector information, prediction mode information, transform and quantization related Grammar, etc. Entropy coding can effectively remove the redundancy of video element symbols.
  • video decoding usually includes entropy decoding, prediction, inverse quantization, inverse transformation, filtering, etc.
  • the implementation principle of each process is the same as or resemblance.
  • FIG. 5 is a schematic flowchart of an image processing method provided by an embodiment of this application.
  • the image processing method can be applied to an encoding end device or a decoding end device.
  • the image processing method may include the following steps :
  • Step S500 Determine the prediction mode of the current block.
  • Step S510 When it is determined that the prediction mode of the current block satisfies one of the following conditions, it is determined that the current block satisfies the transform skip mode condition: the prediction mode of the current block is the inter prediction mode, and the prediction mode of the current block is the direct mode.
  • the current image block is the encoding block; for the decoding end device, the current block is the decoding block, which will not be repeated below.
  • the ISTS scheme can be applied to the inter-frame prediction mode or/and the direct mode, instead of being limited to the intra-frame prediction mode or the IBC mode, so as to expand the application range of the ISTS scheme.
  • the prediction mode of the current block satisfies one of the foregoing conditions
  • the prediction mode of the current block may be selected based on the RDO principle.
  • the prediction mode of the current block can be determined by analyzing the code stream of the current block to obtain the prediction mode flag bit in the code stream.
  • the decoding end device can parse the flag bit used to indicate whether the current block adopts the skip mode (may be called the skip mode flag bit) from the code stream of the current block, and based on the skip mode
  • the value of the over mode flag determines whether the current block adopts the skip mode; if the current block does not adopt the skip mode, the flag bit used to indicate whether the current block adopts the direct mode is parsed from the code stream (can be called the direct mode flag ), and determine whether the current block adopts the direct mode based on the value of the direct mode flag bit; if the current block does not adopt the direct mode, the flag bit used to indicate that the current block adopts the intra prediction mode or the inter prediction mode is parsed from the code stream , And determine whether the current block adopts the intra prediction mode or the inter prediction mode based on the value of the flag bit.
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the inter prediction mode or the direct mode
  • the current block meeting the transform skip mode condition may also include:
  • the current block meets one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not use SBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block when the current block adopts the PBT mode, the current block needs to be divided into sub-blocks, and the transformations performed by the sub-blocks in different positions are not completely the same; and when the current block adopts the SBT mode, the inter-frame residual block needs to be Carry out sub-block division, and the residual of one sub-block is defaulted to 0, and the residual of the other sub-block is not 0 by default. Therefore, when the current block adopts PBT mode or SBT mode, the transform skip mode is adopted The complexity of will be very high, and the performance improvement brought by it is not obvious.
  • whether the current block adopts the PBT mode or the SBT mode can also be used as a determination condition for whether the current block satisfies the transform skip mode condition.
  • the current block may be selected to adopt the PBT mode, the SBT mode, or the DCT2 conversion mode based on the RDO principle.
  • the current block can be analyzed to obtain the value of the transformation mode flag in the code stream, so as to determine whether the current block adopts the PBT mode, the SBT mode, or the DCT2 transformation mode.
  • the decoding end device can parse the flag bit used to indicate whether the current block adopts the PBT mode from the code stream of the current block, and determine whether the current block adopts the PBT mode based on the value of the flag bit ; If the current block does not adopt the PBT mode, analyze the flag bit used to indicate whether the current block adopts the SBT mode from the code stream, and determine whether the current block adopts the SBT mode based on the value of the flag bit; if the current block does not adopt the SBT mode , It is determined that the current block adopts the DCT2 mode.
  • the prediction mode of the current block when the prediction mode of the current block is the direct mode, and the current block satisfies the transform skip mode condition, it may also include:
  • the current block does not use the inter-frame prediction filtering mode.
  • adopting the transform skip mode for the current block will basically not improve the performance of the current block, and will increase the complexity.
  • the prediction mode of the current block is the direct mode
  • whether the current block adopts the inter-frame prediction filtering mode can also be used as a determination condition for whether the current block satisfies the transform skip mode condition.
  • the filter type of the current block may be determined by parsing the code stream identifier corresponding to the filtering mode index of the current block from the code stream (may be as shown in Table 3).
  • the code stream identifier corresponding to the filtering mode index obtained by parsing the code stream of the current block is 0, it is determined that the current block does not use the inter-frame prediction filtering mode; if the code stream identifier obtained by the analysis If it is 10, it is determined that the current block adopts the inter-frame prediction filtering mode and is the ordinary inter-frame prediction filtering; if the code stream identifier obtained by the analysis is 11, it is determined that the current block adopts the inter-frame prediction filtering mode and is the enhanced inter-frame prediction filtering .
  • the prediction mode of the current block is the direct mode, and the current block does not adopt the inter-prediction filtering mode, it is determined that the current block satisfies the transform skip mode.
  • the prediction mode of the current block is the direct mode, and the current block does not adopt the inter prediction filtering mode, and the current block does not adopt the PBT mode, it is determined that the current block satisfies the transform skip mode.
  • the prediction mode of the current block is the direct mode, and the current block does not adopt the inter prediction filtering mode, and the current block does not adopt the SBT mode, it is determined that the current block satisfies the transform skip mode.
  • the prediction mode of the current block is the direct mode, and the current block does not use the inter-frame prediction filtering mode, and the current block does not use either the PBT mode or the SBT mode; or, when the current block satisfies the implementation According to the conditions in Example 1, and adopting the DCT2 transformation method for transformation, it is determined that the current block satisfies the transformation skip mode.
  • the current block meeting the transform skip mode condition may also include:
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • the width and height of the current block are both less than 64.
  • the current block may also be a luminance block or a chrominance block, and the size of the current block may be used as a determination condition for the current block to satisfy the transform skip mode condition.
  • the current block when the current block satisfies the conditions in any one of Embodiments 1 to 3, and the current block is a luminance block, it is determined that the current block satisfies the transform skip mode.
  • the current block when the current block satisfies the conditions in any one of Embodiments 1 to 3, and the current block is a luminance block, and the width and height of the current block are both less than 64, it is determined that the current block satisfies the transformation jump Over mode.
  • FIG. 6 is a schematic flow chart of an image processing method provided by an embodiment of this application.
  • the image processing method may be applied to an encoding end device or a decoding end device. As shown in FIG. 6, the image processing method may include the following steps :
  • Step S600 Determine the transformation mode of the current block.
  • Step S610 When it is determined that the transformation mode of the current block satisfies one of the following conditions, it is determined that the current block satisfies the transformation skip mode condition: the current block does not adopt the PBT mode, the current block does not adopt the SBT mode, and the current block does not adopt the PBT mode and is not adopted SBT mode, or the current block is transformed using the DCT2 transformation method.
  • the current block when the current block adopts the PBT mode, the current block needs to be divided into sub-blocks, and the transformations performed by the sub-blocks in different positions are not completely the same; and when the current block adopts the SBT mode, the inter-frame residuals need to be The difference block is divided into sub-blocks, and the residual of one of the sub-blocks is 0 by default, and the residual of the other sub-block is not 0 by default. Therefore, when the current block adopts the PBT mode or the SBT mode, the transformation jump is adopted. The complexity of the passing mode will be very high, and the performance improvement brought by it is not obvious.
  • the current block may be selected to adopt the PBT mode, the SBT mode, or the DCT2 conversion mode based on the RDO principle.
  • the current block can be analyzed to obtain the value of the transformation mode flag in the code stream, so as to determine whether the current block adopts the PBT mode, the SBT mode, or the DCT2 transformation mode.
  • the decoding end device can parse the flag bit used to indicate whether the current block adopts the PBT mode from the code stream of the current block, and determine whether the current block adopts the PBT mode based on the value of the flag bit ; If the current block does not adopt the PBT mode, analyze the flag bit used to indicate whether the current block adopts the SBT mode from the code stream, and determine whether the current block adopts the SBT mode based on the value of the flag bit; if the current block does not adopt the SBT mode , It is determined that the current block adopts the DCT2 mode.
  • the current block when the current block does not adopt the PBT mode, it is determined that the current block satisfies the transform skip mode.
  • the current block when the current block does not adopt the PBT mode and the SBT mode is not adopted; or, when the current block adopts the DCT2 transform mode for transformation, it is determined that the current block satisfies the transform skip mode.
  • the current block meeting the transform skip mode condition may also include:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode.
  • the ISTS scheme can be applied to the inter prediction mode or/and the direct mode, instead of being limited to the intra prediction mode or the IBC mode, so as to expand the application range of the ISTS scheme.
  • the prediction mode of the current block can also be used as a determination condition for whether the current block satisfies the transform skip mode condition.
  • the prediction mode of the current block may be selected based on the RDO principle.
  • the decoding device it is possible to obtain the value of the prediction mode flag bit in the code stream by analyzing the code stream of the current block, so as to determine the prediction mode of the current block.
  • the decoding end device can parse the flag bit used to indicate whether the current block adopts the skip mode (may be called the skip mode flag bit) from the code stream of the current block, and based on the skip mode
  • the value of the over mode flag determines whether the current block adopts the skip mode; if the current block does not adopt the skip mode, the flag bit used to indicate whether the current block adopts the direct mode is parsed from the code stream (can be called the direct mode flag ), and determine whether the current block adopts the direct mode based on the value of the direct mode flag bit; if the current block does not adopt the direct mode, the flag bit used to indicate that the current block adopts the intra prediction mode or the inter prediction mode is parsed from the code stream , And determine whether the current block adopts the intra prediction mode or the inter prediction mode based on the value of the flag bit.
  • the prediction mode is the inter prediction mode
  • the prediction mode is the inter prediction mode or the direct mode
  • the prediction mode of the current block when the prediction mode of the current block is the direct mode, and the current block satisfies the transform skip mode condition, it may also include:
  • the current block does not use the inter-frame prediction filtering mode.
  • adopting the transform skip mode for the current block will basically not improve the performance of the current block, and will increase the complexity.
  • whether the current block adopts the inter-frame prediction filtering mode can also be used as a determination condition for whether the current block satisfies the transform skip mode condition.
  • the filter type of the current block may be determined by parsing the code stream identifier corresponding to the filtering mode index of the current block from the code stream (may be as shown in Table 3).
  • the code stream identifier corresponding to the filtering mode index obtained by parsing the code stream of the current block is 0, it is determined that the current block does not use the inter-frame prediction filtering mode; if the code stream identifier obtained by the analysis If it is 10, it is determined that the current block adopts the inter-frame prediction filtering mode and is the ordinary inter-frame prediction filtering; if the code stream identifier obtained by the analysis is 11, it is determined that the current block adopts the inter-frame prediction filtering mode and is the enhanced inter-frame prediction filtering .
  • the current block when the current block satisfies the conditions of Embodiment 5 or Embodiment 6, and the current block does not adopt the inter prediction filtering mode, it is determined that the current block satisfies the transform skip mode.
  • the current block meeting the transform skip mode condition may also include:
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • the width and height of the current block are both less than 64.
  • the current block may also be a luminance block or a chrominance block, and the size of the current block may be used as a determination condition for the current block to satisfy the transform skip mode condition.
  • the current block when the current block satisfies the conditions in any one of Embodiment 5 to Embodiment 7, and the current block is a luminance block, it is determined that the current block satisfies the transform skip mode.
  • FIG. 7 is a schematic flowchart of an image processing method provided by an embodiment of this application.
  • the image processing method can be applied to an encoding end device or a decoding end device. As shown in FIG. 7, the image processing method may include the following steps :
  • Step 700 When the current block does not adopt the inter-frame prediction filtering mode, it is determined that the current block satisfies the transform skip mode condition.
  • adopting the transform skip mode for the current block will basically not improve the performance of the current block, and will increase the complexity.
  • the filter type of the current block may be determined by parsing the code stream identifier corresponding to the filtering mode index of the current block from the code stream (may be as shown in Table 3).
  • the code stream identifier corresponding to the filtering mode index obtained by parsing the code stream of the current block is 0, it is determined that the current block does not use the inter-frame prediction filtering mode; if the code stream identifier obtained by the analysis If it is 10, it is determined that the current block adopts the inter-frame prediction filtering mode and is the ordinary inter-frame prediction filtering; if the code stream identifier obtained by the analysis is 11, it is determined that the current block adopts the inter-frame prediction filtering mode and is the enhanced inter-frame prediction filtering .
  • the current block meeting the transform skip mode condition may also include:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode.
  • the ISTS scheme can be applied to the inter prediction mode or/and the direct mode, instead of being limited to the intra prediction mode or the IBC mode, so as to expand the application range of the ISTS scheme.
  • the prediction mode of the current block can also be used as a determination condition for whether the current block satisfies the transform skip mode condition.
  • the prediction mode of the current block may be selected based on the RDO principle.
  • the prediction mode of the current block can be determined by analyzing the code stream of the current block to obtain the prediction mode flag bit in the code stream.
  • the decoding end device can parse the flag bit used to indicate whether the current block adopts the skip mode (may be called the skip mode flag bit) from the code stream of the current block, and based on the skip mode
  • the value of the over mode flag determines whether the current block adopts the skip mode; if the current block does not adopt the skip mode, the flag bit used to indicate whether the current block adopts the direct mode is parsed from the code stream (can be called the direct mode flag ), and determine whether the current block adopts the direct mode based on the value of the direct mode flag bit; if the current block does not adopt the direct mode, the flag bit used to indicate that the current block adopts the intra prediction mode or the inter prediction mode is parsed from the code stream , And determine whether the current block adopts the intra prediction mode or the inter prediction mode based on the value of the flag bit.
  • the prediction mode is the inter prediction mode
  • the current block meeting the transform skip mode condition may also include:
  • the current block meets one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not use SBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block when the current block adopts the PBT mode, the current block needs to be divided into sub-blocks, and the transformations performed by the sub-blocks in different positions are not completely the same; and when the current block adopts the SBT mode, the inter-frame residual block needs to be Carry out sub-block division, and the residual of one sub-block is defaulted to 0, and the residual of the other sub-block is not 0 by default. Therefore, when the current block adopts PBT mode or SBT mode, the transform skip mode is adopted The complexity of will be very high, and the performance improvement brought by it is not obvious.
  • whether the current block adopts the PBT mode or the SBT mode can also be used as a determination condition for whether the current block satisfies the transform skip mode condition.
  • the current block may be selected to adopt the PBT mode, the SBT mode, or the DCT2 conversion mode based on the RDO principle.
  • the decoding device it is possible to obtain the transformation mode flag bit in the code stream by analyzing the code stream of the current block, so as to determine that the current block adopts the PBT mode, SBT mode or DCT2 transformation mode.
  • the decoding end device can parse the flag bit used to indicate whether the current block adopts the PBT mode from the code stream of the current block, and determine whether the current block adopts the PBT mode based on the value of the flag bit ; If the current block does not adopt the PBT mode, analyze the flag bit used to indicate whether the current block adopts the SBT mode from the code stream, and determine whether the current block adopts the SBT mode based on the value of the flag bit; if the current block does not adopt the SBT mode , It is determined that the current block adopts the DCT2 mode.
  • the current block meets the conditions in Embodiment 9 or Embodiment 10, and the SBT mode is not adopted; or, the current block meets the conditions in Embodiment 9 or Embodiment 10, and the DCT2 transformation method is used for transformation When it is determined that the current block satisfies the transform skip mode.
  • the current block meeting the transform skip mode condition may also include:
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • the width and height of the current block are both less than 64.
  • the current block can also be a luminance block or a chrominance block, and the size of the current block can be used as a determination condition for the current block to satisfy the transform skip mode condition.
  • the current block when the current block satisfies the conditions in any one of Embodiment 9 to Embodiment 11, and the current block is a luminance block, it is determined that the current block satisfies the transform skip mode.
  • the current block when the current block satisfies the conditions in any one of Embodiment 9 to Embodiment 11, and the current block is a luminance block, and the width and height of the current block are both less than 64, it is determined that the current block satisfies the transformation jump Over mode.
  • Fig. 8 is a schematic flowchart of a decoding method provided by an embodiment of this application.
  • the decoding method can be applied to a decoding end device. As shown in Fig. 8, the decoding method may include the following steps:
  • Step S800 Obtain a code stream
  • Step S810 Obtain the value of the enable flag bit of the inter-frame conversion skip mode from the code stream.
  • a flag for indicating whether the inter conversion skip mode is enabled can be set Bit.
  • the value of the flag bit may include at least a first value and a second value.
  • the first value indicates that the inter-frame conversion skip mode is enabled; the second value indicates that the inter-frame conversion skip mode is disabled. Value.
  • the flag bit When the value of the flag bit is the first value, it indicates that the transform skip mode can be applied to the inter prediction mode or/and the direct mode.
  • the inter-frame conversion skip mode enable flag bit can be implemented through sequence parameter set (Sequence Paramater Set, SPS for short) level grammar.
  • sequence parameter set Sequence Paramater Set, SPS for short
  • An image sequence uses an inter-frame conversion skip mode enable flag to identify the image Whether the sequence can apply the transform skip mode to the inter prediction mode or/and the direct mode to save coding bit consumption.
  • inter-frame conversion skip mode enable flag bit is not limited to be realized by SPS-level syntax, and it can also be realized by picture parameter set (Picture Parameter Set, referred to as PPS)-level syntax or slice (Slice)-level syntax, etc. .
  • PPS Picture Parameter Set
  • Slice slice-level syntax
  • the decoder device can parse the inter-frame conversion skip mode enable flag bit from the sequence header of the image sequence, and based on the parsed inter-frame conversion The value of the skip mode enable flag bit determines whether to enable the inter-frame conversion skip mode.
  • Step S820 When the value of the inter-frame transform skip mode enable flag is the first value, and the current block meets the transform skip mode condition, based on the parity of the number of non-zero transform coefficients of the current block, the current block Perform inverse transform skip processing or DCT2 inverse transform processing to obtain the transform coefficient of the current block, and perform inverse quantization processing on the transform coefficient to obtain the residual coefficient of the current block.
  • the decoder device when the value of the inter-frame conversion skip mode enable flag bit is the first value, even when the inter-frame conversion skip mode is enabled, the decoder device can determine whether the current block meets the conversion skip mode condition.
  • the encoding end device when it performs bitstream encoding, it can also encode the conversion skip mode enable flag bit.
  • the conversion skip mode enable flag bit is generally implemented through PPS-level syntax to identify whether a frame of image is enabled or not. The skip mode can be changed.
  • the conversion skip mode enable flag can also be parsed from the code stream of the frame image
  • the value of the conversion skip mode enable flag bit is a value that characterizes the enable conversion skip mode of the frame image, it is determined whether each block of the frame image satisfies the conversion skip mode condition.
  • the implementation of determining whether the current block satisfies the transform skip mode condition by the decoding end device may adopt the method described in any one of Embodiments 1 to 12.
  • the decoding end device can determine to perform inverse transform jump on the current block based on the parity of the number of non-zero transform coefficients (transform coefficients before inverse quantization) of the current block Over processing or DCT2 inverse transform processing.
  • the decoder device When the decoder device obtains the transform coefficients of the current block by performing inverse transform skip processing or DCT2 inverse change processing on the current block, it can obtain the residual coefficients of the current block through inverse quantization processing.
  • Step S830 Determine the reconstruction value of the current block based on the prediction value of the current block and the residual coefficient of the current block.
  • the decoding end device may determine the reconstruction value of the current block by using the predicted value of the current block obtained by prediction and the residual coefficient of the current block obtained in step S820.
  • the inter-frame conversion skip mode enable flag bit is used for the conversion of the inter-frame prediction mode or/and the direct mode.
  • the flexibility and controllability of the transformation skip mode application are improved, thereby improving the flexibility and controllability of the ISTS scheme application; in addition, by applying the ISTS scheme to the inter prediction mode or/and The direct mode expands the application range of the ISTS scheme, and can improve coding performance and reduce decoding delay.
  • FIG. 9 is a schematic flowchart of an encoding method provided by an embodiment of this application.
  • the encoding method may be applied to an encoding terminal device. As shown in FIG. 9, the encoding method may include the following steps:
  • Step S900 Encoding the inter-frame conversion skip mode enable flag bit.
  • a flag for indicating whether the inter conversion skip mode is enabled can be set Bit.
  • the value of the flag bit may include at least a first value and a second value.
  • the first value indicates that the inter-frame conversion skip mode is enabled; the second value indicates that the inter-frame conversion skip mode is disabled. Value.
  • the flag bit When the value of the flag bit is the first value, it indicates that the transform skip mode can be applied to the inter prediction mode or/and the direct mode.
  • the inter-frame conversion skip mode enable flag bit can be implemented through a sequence parameter set (Sequence Paramater Set, referred to as SPS) level grammar.
  • SPS Sequence Paramater Set
  • An image sequence uses an inter-frame conversion skip mode enable flag to identify the image Whether the sequence can apply the transform skip mode to the inter prediction mode or/and the direct mode to save coding bit consumption.
  • inter-frame conversion skip mode enable flag bit is not limited to be realized by SPS-level syntax, it can also be realized by picture parameter set (Picture Parameter Set, PPS)-level syntax or slice (Slice)-level syntax, etc. .
  • the encoder device can add the inter-frame conversion skip mode enable flag bit to the sequence header of the image sequence, and set the inter-frame conversion based on the configuration The value of the skip mode enable flag bit.
  • Step S910 When the value of the inter-frame transform skip mode enable flag is the first value and the current block meets the transform skip mode condition, select to perform transform skip processing or DCT2 transform processing on the current block based on the rate-distortion cost, To get the transform coefficient of the current block.
  • the encoding end device can determine whether the current block satisfies the conversion skip mode.
  • the encoding end device when it performs bitstream encoding, it can also encode the conversion skip mode enable flag bit.
  • the conversion skip mode enable flag bit is generally implemented through PPS-level syntax to identify whether a frame of image is enabled or not. The skip mode can be changed.
  • the encoding end device can determine whether each block of the frame image meets the transform skip mode condition.
  • the encoding terminal device can use the method described in any one of Embodiments 1 to 12 to determine whether the current block meets the conditions of the transform skip mode.
  • the encoding end device may choose to perform transform skip processing or DCT2 transform processing on the current block based on the RDO principle.
  • Step S920 When the parity of the number of non-zero transform coefficients of the current block does not match the selected transform mode, adjust the parity of the number of non-zero transform coefficients of the current block to make the number of non-zero transform coefficients of the current block The parity of the number matches the selected transformation method.
  • the ISTS scheme may be used to instruct the current block to select transform skip processing or DCT2 transform processing.
  • the number of non-zero transform coefficients (transform coefficients before quantization) of the current block needs to be an odd number; when the encoding end device chooses to perform transformation on the current block During DCT2 processing, it is necessary to make the number of non-zero transform coefficients of the current block an even number.
  • the encoding end device When the encoding end device chooses to perform transform skip processing or DCT2 transform processing on the current block based on the RDO principle, it can determine the parity of the number of non-zero transform coefficients of the current block and the selected transform mode (transform skip mode or DCT2 Transformation) whether it matches.
  • the encoding end device can adjust the parity of the number of non-zero transform coefficients of the current block to make the current block non-zero The parity of the number of transform coefficients matches the selected transform method.
  • the encoding end device when the encoding end device chooses to perform transform skip processing on the current block, and the number of non-zero transform coefficients of the current block is an even number, the encoding end device can set the last non-zero transform coefficient of the current block to zero, to Make the number of non-zero transform coefficients of the current block an odd number.
  • the encoding end device When the encoding end device chooses to perform DCT2 transform processing on the current block, and the number of non-zero transform coefficients of the current block is an odd number, the encoding end device can set the last non-zero transform coefficient of the current block to zero to make the current block The number of non-zero transform coefficients is an even number.
  • Step S930 Perform quantization and entropy coding on the transform coefficient of the current block to obtain the code stream of the current block.
  • the encoding end device when the parity of the number of non-zero transform coefficients of the current block matches the selected transform mode, the encoding end device can quantize and entropy encode the transform coefficients of the current block to obtain the code stream of the current block .
  • the inter-frame conversion skip mode enable flag bit is used for the conversion of the inter prediction mode or/and the direct mode.
  • the flexibility and controllability of the transformation skip mode application are improved, thereby improving the flexibility and controllability of the ISTS scheme application; in addition, by applying the ISTS scheme to the inter prediction mode or/and The direct mode expands the application range of the ISTS scheme, and can improve coding performance and reduce decoding delay.
  • the current block satisfies the conditions of the transform skip mode, including:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode
  • the prediction mode of the current block is the inter prediction mode or the direct mode.
  • the current block satisfies the conditions of the transform skip mode, including:
  • the transformation mode of the current block satisfies one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not adopt SBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block satisfies the conditions of the transform skip mode, including:
  • the current block does not use the inter-frame prediction filtering mode.
  • the current block satisfies the conditions of the transform skip mode, including:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode
  • the prediction mode of the current block is the inter prediction mode or the direct mode.
  • the transformation mode of the current block satisfies one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block satisfies the conditions of the transform skip mode, including:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode
  • the prediction mode of the current block is the inter prediction mode or the direct mode.
  • the current block does not use the inter-frame prediction filtering mode.
  • the current block satisfies the conditions of the transform skip mode, including:
  • the transformation mode of the current block satisfies one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block does not use the inter-frame prediction filtering mode.
  • the current block satisfies the conditions of the transform skip mode, including:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode
  • the prediction mode of the current block is the inter prediction mode or the direct mode.
  • the transformation mode of the current block satisfies one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block does not use the inter-frame prediction filtering mode.
  • the current block satisfies the conditions of the transform skip mode, including:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode
  • the prediction mode of the current block is the inter prediction mode or the direct mode.
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • the current block satisfies the conditions of the transform skip mode, including:
  • the transformation mode of the current block satisfies one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • the current block satisfies the conditions of the transform skip mode, including:
  • the current block does not use the inter-frame prediction filtering mode.
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • the current block satisfies the conditions of the transform skip mode, including:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode
  • the prediction mode of the current block is the inter prediction mode or the direct mode.
  • the transformation mode of the current block satisfies one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • the current block satisfies the conditions of the transform skip mode, including:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode
  • the prediction mode of the current block is the inter prediction mode or the direct mode.
  • the current block does not use the inter-frame prediction filtering mode.
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • the current block satisfies the conditions of the transform skip mode, including:
  • the transformation mode of the current block satisfies one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block does not use the inter-frame prediction filtering mode.
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • the current block satisfies the conditions of the transform skip mode, including:
  • the prediction mode of the current block satisfies one of the following conditions:
  • the prediction mode of the current block is the inter prediction mode
  • the prediction mode of the current block is the direct mode
  • the prediction mode of the current block is the inter prediction mode or the direct mode.
  • the transformation mode of the current block satisfies one of the following conditions:
  • the current block does not adopt the PBT mode
  • the current block does not adopt the PBT mode and the SBT mode; or, the current block adopts the DCT2 transformation method for transformation.
  • the current block does not use the inter-frame prediction filtering mode.
  • the current block meets one or more of the following conditions:
  • the current block is a brightness block
  • inter_ists_enable_flag the inter-frame transform skip enable flag inter_ists_enable_flag from the code stream. If inter_ists_enable_flag is true (for example, the value is 1) and the current block meets the transform skip mode condition, then based on the non-zero transform coefficient of the current block (this transform coefficient It is the parity of the number (num_nz) of the transform coefficient before inverse quantization to determine whether to perform the transform skip mode on the current block.
  • num_nz is an odd number, perform the inverse transform skip mode on the current block; otherwise, if num_nz is an even number, perform DCT2 inverse transform on the current block to obtain the transform coefficient of the current block (the transform coefficient before inverse quantization).
  • the residual coefficient of the current block is obtained, which is added to the predicted value of the current block to obtain the reconstruction value of the current block.
  • the decoding end device may use the method described in any one of Embodiment 15 to Embodiment 28 to determine that the current block meets the transform skip mode condition.
  • inter_ists_enable_flag for example, the value is 1
  • the current block is selected to perform transform skip processing or DCT2 transform processing by means of RDO.
  • the transform skip mode is identified by an implicit method, that is, by adjusting the parity of the number (num_nz) of the non-zero transform coefficients of the current block (this transform coefficient is the quantized transform coefficient) to make it equal to The transformation method of the current block matches.
  • the num_nz of the current block needs to be an odd number. If it is not an odd number, the non-zero transform coefficients are adjusted to make num_nz an odd number; similarly, if the current block is subjected to DCT2 transform processing , The num_nz of the current block needs to be an even number, if it is not an even number, adjust the non-zero transform coefficient to make num_nz an even number.
  • the encoding terminal device may use the method described in any one of Embodiment 15 to Embodiment 28 to determine that the current block satisfies the transform skip mode condition.
  • the decoding apparatus may include a processor 1001, a communication interface 1002, and a machine-readable storage medium 1003 storing machine-executable instructions.
  • the processor 1001, the communication interface 1002, and the machine-readable storage medium 1003 may communicate via a system bus 1004. And, by reading and executing the machine executable instructions corresponding to the decoding control logic in the machine-readable storage medium 1003, the processor 1001 can execute the decoding method described above.
  • the machine-readable storage medium 1003 mentioned herein may be any electronic, magnetic, optical, or other physical storage device, and may contain or store information, such as executable instructions, data, and so on.
  • the machine-readable storage medium can be: RAM (Radom Access Memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard drive), solid state hard drive, any type of storage disk (Such as CD, DVD, etc.), or similar storage media, or a combination of them.
  • the foregoing decoding device may include:
  • the obtaining unit 1101 is used to obtain a code stream
  • the decoding unit 1102 is configured to, when the value of the inter-frame transform skip mode enable flag bit is the first value, and the current block meets the transform skip mode condition, based on the number of non-zero transform coefficients of the current block.
  • the parity of the current block is subjected to inverse transform skip processing or discrete cosine transform DCT2 inverse transform processing, and inverse quantization processing is performed to obtain the residual coefficient of the current block; wherein, the first value represents Can transform the value of the skip mode; based on the prediction value of the current block and the residual coefficient of the current block, determine the reconstruction value of the current block.
  • the encoding device may include a processor 1201, a communication interface 1202, and a machine-readable storage medium 1203 storing machine-executable instructions.
  • the processor 1201, the communication interface 1202, and the machine-readable storage medium 1203 may communicate via the system bus 1204. Moreover, by reading and executing the machine executable instructions corresponding to the encoding control logic in the machine-readable storage medium 1203, the processor 1201 can execute the encoding method described above.
  • the foregoing encoding device may include:
  • the encoding unit 1301 is used to encode the inter-frame conversion skip mode enable flag bit
  • the transform unit 1302 is configured to select, when the value of the inter-frame transform skip mode enable flag bit is the first value, and the current block satisfies the transform skip mode condition, select to perform transform skip on the current block based on the rate-distortion cost After processing or discrete cosine transform DCT2 transform processing to obtain the transform coefficients of the current block; when the parity of the number of non-zero transform coefficients of the current block does not match the selected transform mode, adjust the current block The parity of the number of non-zero transform coefficients of the current block, so that the parity of the number of non-zero transform coefficients of the current block matches the selected transform mode;
  • the quantization unit 1303 is configured to quantize the transform coefficient of the current block
  • the coding unit is further configured to perform entropy coding on the quantized transform coefficient of the current block to obtain the code stream of the current block.
  • the machine-readable storage medium 1203 mentioned herein may be any electronic, magnetic, optical, or other physical storage device, and may contain or store information, such as executable instructions, data, and so on.
  • the machine-readable storage medium can be: RAM (Radom Access Memory), volatile memory, non-volatile memory, flash memory, storage drives (such as hard drives), solid state drives, and any type of storage disk (Such as CD, DVD, etc.), or similar storage media, or a combination of them.
  • a decoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode, the current block is satisfied as a luminance block, and the width and height of the current block are both less than 64.
  • a decoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode, and it is satisfied that the current block is a luminance block, and the width and height of the current block are both less than 64.
  • a decoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode, the current block does not adopt the inter-frame prediction filtering mode, and it is satisfied that the current block is a luminance block, and the width and height of the current block are both less than 64.
  • a decoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode.
  • a decoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode.
  • a decoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the conditions of the transform skip mode includes:
  • the prediction mode of the current block is the direct mode, and the current block does not adopt the inter-frame prediction filtering mode.
  • an encoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • the current block meeting the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode, the current block is satisfied as a luminance block, and the width and height of the current block are both less than 64.
  • an encoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode, it is satisfied that the current block is a luminance block, and the width and height of the current block are both less than 64.
  • an encoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode, the current block does not use the inter-prediction filtering mode, and it is satisfied that the current block is a luminance block, and the current block is a luminance block.
  • the width and height of the block are both less than 64.
  • an encoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • the current block meeting the transform skip mode condition includes: the prediction mode of the current block is an inter prediction mode.
  • an encoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode.
  • an encoding device including: a processor, a communication interface, a machine-readable storage medium, and a communication bus.
  • the processor, the communication interface, and the machine-readable storage medium communicate with each other through the communication bus.
  • the communication; the machine-readable storage medium stores a computer program, and the processor is prompted by the computer program when the computer program is executed:
  • determining that the current block satisfies the transform skip mode condition includes: the prediction mode of the current block is the direct mode, and the current block does not adopt the inter-frame prediction filtering mode.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Discrete Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Abstract

本申请提供一种编解码方法及装置，该解码方法包括：确定当前块的预测模式；当确定所述当前块的预测模式满足以下条件之一时，确定所述当前块满足变换跳过模式条件：所述当前块的预测模式为帧间预测模式；所述当前块的预测模式为直接模式。

Description

编解码方法及装置
相关申请的交叉引用
本专利申请要求于2020年6月5日提交的、申请号为202010508168.9、发明名称为“编码方法、解码方法及装置”的中国专利申请的优先权，该申请的全文以引用的方式并入本文中。
技术领域
本申请涉及视频编解码技术，尤其涉及一种编解码方法及装置。
背景技术
视频编码一般包括预测、变换、量化、熵编码、滤波等操作。其中，预测包括帧内预测和帧间预测。
变换是指将以空间域中像素形式描述的图像转换至变换域，以变换系数的形式来表示。而绝大多数图像都含有较多平坦区域和像素值缓慢变化的区域，适当的变换可以使图像能量在空间域的分散分布转换为在变换域的相对集中分布，去除了信号之间的频域相关性，配合量化过程，可以有效压缩码流。
目前在屏幕内容编码(Screen Content Coding，简称SCC)视频上，仍然使用的是基于离散余弦变换(Discrete Cosine Transform，DCT，简称DCT)2、DCT8或DST7变换核的变换方法，将时域信号通过变换变成能量更加集中的频域信号，配合量化和熵编码能够带来编码性能的提升。然而，对于SCC视频而言，本身纹理比较简单，并且配合帧内块复制(Intra Block Copy，简称IBC)预测模式，得到的残差块的残差系数都很小，因此很多情况下并不需要进行传统的变换操作，而是进行变换跳过处理，经过简单位移操作后即可进行量化和熵编码。这样不仅能够带来编码性能的提升，并且由于仅仅进行简单位移操作，并不会带来编码实现代价的提升，反而由于不需要进行变换操作而大大降低解码时间。因此提出基于编码单元级(cu-level)的隐式变换跳过模式，大大提升SCC视频的编码性能。
隐式选择变换跳过模式(Implicit Selection of Transform Skip mode，简称ISTS)方案通过当前块的非零变换系数的奇偶性指示编码端设备对当前块进行变换跳过处理或DCT2变换处理。
然而实践发现，目前的ISTS方案仅应用于帧内预测模式和IBC模式，应用限制较大。
发明内容
有鉴于此，本申请提供一种编码方法、解码方法及装置。
具体地，本申请是通过如下技术方案实现的：
根据本申请实施例的第一方面，提供一种解码方法，包括：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第二方面，提供一种解码方法，包括：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第三方面，提供一种解码方法，包括：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第四方面，提供一种解码方法，包括：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式。
根据本申请实施例的第五方面，提供一种解码方法，包括：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式。
根据本申请实施例的第六方面，提供一种解码方法，包括：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式，且所述当前块未采用帧间预测滤波模式。
根据本申请实施例的第七方面，提供一种编码方法，包括：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第八方面，提供一种编码方法，包括：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第九方面，提供一种编码方法，包括：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第十方面，提供一种编码方法，包括：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式。
根据本申请实施例的第十一方面，提供一种编码方法，包括：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式。
根据本申请实施例的第十二方面，提供一种编码方法，包括：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直 接模式，且所述当前块未采用帧间预测滤波模式。
根据本申请实施例的第十三方面，提供一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第十四方面，提供一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第十五方面，提供一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第十六方面，提供一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与 当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式。
根据本申请实施例的第十七方面，提供一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式。
根据本申请实施例的第十八方面，提供一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式，且所述当前块未采用帧间预测滤波模式。
根据本申请实施例的第十九方面，提供一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第二十方面，提供一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过 率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第二十一方面，提供一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
根据本申请实施例的第二十二方面，提供一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式。
根据本申请实施例的第二十三方面，提供一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式。
根据本申请实施例的第二十四方面，提供一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，且所述当前块未采用帧间预测滤波模式。
根据本申请实施例的第二十五方面，提供一种机器可读存储介质，其上存储有计算机指令，所述计算机指令在被处理器执行时，使所述处理器实现根据以上任一方面所述的方法。
本申请实施例的解码方法，获取码流，从码流中获取帧间变换跳过模式使能标志位的值；当帧间变换跳过模式使能标志位的值为第一值，且当前块满足变换跳过模式条件时，基于当前块的非零变换系数的个数的奇偶性，对当前块进行反变换跳过处理或DCT2反变换处理以得到所述当前块的变换系数，并对所述变换系数进行反量化处理，得到当前块的残差系数；进而，基于当前块的预测值和当前块的残差系数，确定当前块的重建值。通过增加帧间变换跳过模式使能标志位，通过该帧间变换跳过模式使能标志位对针对帧间预测模式或/和直接模式的变换跳过模式应用进行控制，提高了变换跳过模式应用的灵活性和可控性，从而提高了ISTS方案应用的灵活性和可控性；此外，通过将ISTS方案应用于帧间预测模式或/和直接模式，扩展了ISTS方案的应用范围，且可以提高编码性能，降低解码时延。
附图说明
图1A～1B是本申请示例性实施例示出的块划分的示意图；
图2A～2B是DT划分模式衍生示意图；
图2C是DT划分模式下的变换示意图；
图3A是本申请一示例性实施例示出的一种PBT模式的子块划分示意图；
图3B是本申请一示例性实施例示出的SBT模式的子块划分示意图；
图4是本申请一示例性实施例示出的一种编解码方法的示意图；
图5是本申请一示例性实施例示出的一种图像处理方法的流程示意图；
图6是本申请又一示例性实施例示出的另一种图像处理方法的流程示意图；
图7是本申请又一示例性实施例示出的另一种图像处理方法的流程示意图；
图8是本申请一示例性实施例示出的一种解码方法的流程示意图；
图9是本申请一示例性实施例示出的一种编码方法的流程示意图；
图10是本申请一示例性实施例示出的一种解码装置的硬件结构示意图；
图11是本申请一示例性实施例示出的一种解码装置的功能结构示意图；
图12是本申请一示例性实施例示出的一种编码装置的硬件结构示意图；
图13是本申请一示例性实施例示出的一种编码装置的功能结构示意图。
具体实施方式
这里将详细地对示例性实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。
在本申请使用的术语是仅仅出于描述特定实施例的目的，而非旨在限制本申请。在本申请和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式，除非上下文清楚地表示其他含义。
为了使本领域技术人员更好地理解本申请实施例提供的技术方案，下面先对现有视频编码标准中块划分技术、现有帧内子块划分方案以及本申请实施例涉及的部分技术术语进行简单说明。
一、现有视频编码标准中块划分技术
在HEVC中，一个CTU(Coding Tree Unit，编码树单元)使用四叉树递归划分成CU。在叶子节点CU级确定是否使用帧内编码或者帧间编码。CU可以进一步划分成两个或者四个PU(Prediction Unit，预测单元)，同一个PU内使用相同的预测信息。在预测完成后得到残差信息后，一个CU可进一步四叉划分成多个TU(Transform Units，变换单元)。例如，本申请中的当前图像块即为一个PU。
但是在最新提出的VVC(Versatile Video Coding，通用视频编码)中的块划分技术有了较大变化。一种混合了二叉树/三叉树/四叉树的划分结构取代了原先的划分模式，取消了原先CU，PU，TU的概念的区分，支持了CU的更灵活的划分方式。其中，CU可以是正方形也可以是矩形划分。CTU首先进行四叉树的划分，然后四叉树划分的叶子节点可以进一步进行二叉树和三叉树的划分。图1A所示，CU共有五种划分类型，分别为四叉树划分，水平二叉树划分，垂直二叉树划分，水平三叉树划分和垂直三叉树划分，如图1B所示，一种CTU内的CU划分可以是上述五种划分类型的任意组合由上可知不同的划分方式，使得各个PU的形状有所不同，如不同尺寸的矩形，正方形。
二、技术术语
1、变换核(transform kernel)：在视频编码中，变换是实现视频数据压缩必不可少的阶段，能够使信号的能量更加集中，而基于离散余弦变换(Discrete Cosine Transform，DCT)/离散正弦变换(Discrete Sine Transform，DST)的变换技术是视频编码主流的变换技术。DCT和DST根据基函数的不同又具体分为多种变换核。常用的3种变换核可以如表1所示：
Figure PCTCN2021098009-appb-000001
Figure PCTCN2021098009-appb-000002
表1
2、正变换(forward transform)和逆变换(inverse transform)：在视频编码过程中，包含了正变换和逆变换过程，又叫前向变换和反向变换。
正变换是将一个二维残差信号(残差系数)转换成能量更加集中的二维频谱信号(变换系数)，变换系数再经过量化过程可以有效去除高频成分，保留中低频成分，实现视频数据压缩。
示例性的，正变换可以通过矩阵形式表示为如下公式：
F＝B·f·A T
其中，f表示NxM维的原始残差信号，M表示残差块宽度，N表示残差块高度，F表示NxM维的频域信号；A和B表示MxM和NxN维的变换矩阵，它们均满足正交性。
逆变换又称反变换，是正变换的逆过程，即通过正交变换矩阵A和B，将频域信号F转换成时域残差信号f。
示例性的，逆变换可以通过矩阵形式表示为如下公式：
f＝B T·F·A
3、水平变换(Horizental transform)和垂直变换(Vertical transform)：在视频编码的变换阶段，输入的是一个二维残差信号，如下式所示，设X＝A·f T，则F＝B·X T，即：
F＝B·f·A T＝B·(A·f T) T
因此，一个二维信号的正变换可以通过两次一维的正变换方式实现。第一次正变换后得到一个M*N的信号X，去除了二维残差信号的水平方向像素之间的相关性，可以称为水平变换，并将A称为水平变换矩阵；第二次正变换去除了二维残差信号的垂 直方向像素之间的相关性，可以称为垂直变换，并将B称为垂直变换矩阵。
4、变换对(Transform pair)：也可以称为变换核对。在下一代视频编码标准中，TU支持矩阵块，因此M不一定等于N，因此A和B的维度不一定相等，除此之外，下一代视频编码标准还支持：A和B不是同一种变换核生成的变换矩阵，因此在变换中存在A和B对应的变换核组成的变换核对(H，V)，其中H称为水平变换核，V称为垂直变换核。
5、二次变换：二次变换是AVS2采纳的技术，AVS3继承了AVS2的二次变换技术并且针对4x4块和非4x4块使用了不同的变换核。
6、衍生树(Derive Tree，简称DT)划分模式：也称为“衍生模式”，是一种新的划分模式，产生新的划分形状，能够进一步获得性能增益。
示例性的，DT划分模式可以包括水平衍生模式和竖直衍生模式，其示意图可以如图2A所示。
示例性的，DT划分模式可以生长在四叉树或者二叉树的叶子节点上，如图2B所示，对于I帧或非I帧，DT划分模式可以通过对CU合并划分边界，来得到衍生模式的不同PU划分(2N×hN、2N×nU、2N×nD、hN×2N、nL×2N或nR×2N)。
示例性的，对于Intra模式，使用衍生模式进行预测的CU，可以使用4个非方块进行变换量化，并不需要引入新的变换核，其示意图可以如图2C所示。
示例性的，使用水平衍生模式的CU必须满足下面2个条件：
1)、高度大于等于16，且小于等于64；
2)、宽度与高度的比例小于4。
使用竖直衍生模式的CU必须满足下面2个条件：
1)、宽度大于等于16，且小于等于64；
2)、高度与宽度的比例小于4。
7、基于位置的变换(Position Based Transform，简称PBT)模式：对于传统的帧间残差变换，变换单元与编码单元相同，不再划分，使用传统的DCT2变换方式进行变换处理，然而帧间残差不是自然图象，不具有平稳的特性，存在多样性，因此使用传统的DCT2变换方式不一定是最佳变换方式，并且靠近预测边界的残差幅值较大。因此针对一定尺寸范围内的帧间残差块(方块或者非方块)，可选择使用PBT模式或者选择使用传统的DCT2变换方式，可以使用率失真优化选择最佳变换方式并在码流中标识所选择的变换方式。
示例性的，请参见图3A，实线边界表示的是编码单元的边界，虚线表示的是PBT划分后的子块边界。通过RDO来选择对于编码单元是使用PBT模式或DCT2变换方式。
如图3A所示，PBT划分后的子块分别标识为0-3。根据0-3子块的位置，确定变换核对信息，不需要在码流中编码变换核对的索引。
8、子块变换(Sub-Block Transform，简称SBT)模式：将帧间残差块划分为2个子块，其中一个子块的残差默认为0，另一个子块的残差默认不为0；非0残差子块的大小和位置有8种选择(在码流中传输这些信息)，非0残差子块的变换按照子块的 位置自适应选择DCT8/DST7变换方式作为水平变换方式和竖直变换方式。
示例性的，请参见图3B，子块变换模式可以包括8种。
9、帧间预测滤波模式：帧间预测滤波技术是AVS3中采纳的技术，应用于直接(Direct)模式下，消除了帧间预测导致的预测块与周围像素之间的空域不连续性问题。
示例性地，帧间预测滤波又分为普通帧间预测滤波和增强帧间预测滤波：
(1)普通帧间预测滤波(interpf)
普通帧间预测滤波是指采用帧间预测获取帧间预测值后，然后采用帧内预测获取帧内预测值，最后将帧间预测值和帧内预测值进行加权获取最终的预测值。
普通帧间预测滤波流程如下：
(a)使用帧内planar模式得到预测块Q
Q(x,y)＝(Pred_V(x,y)+Pred_H(x,y)+1)>>2
Pred_V(x，y)＝((h-1-y)*Recon(x，-1)+(y+1)*Recon(-1，h)+(h>>1))>>log2(h)
Pred_H(x，y)＝((w-1-x)*Recon(-1，y)+(x+1)*Recon(w，-1)+(w>>1))>>log2(w)
其中，w和h为当前块的宽度和高度，x和y为当前块内的相对坐标，Recon(x,y)为周围已重建像素值。
(b)基于帧间预测块P和帧内预测块Q进行5:3加权，得到最终预测块
P′(x，y)＝(P(x，y)*5+Q(x，y)*3+4)>>3
其中，P(x，y)为帧间预测得到的预测值，P′(x，y)为滤波后的预测值。
(2)增强帧间预测滤波(enhance interpf)
增强帧间预测滤波是指采用帧间预测获取帧间预测值后，然后利用当前块左侧的一列重建像素和上方的一行重建像素作为参考像素，使用3抽头滤波器对当前预测块进行滤波，滤波过程如下：
P′(x，y)＝f(x)·P(-1，y)+f(y)·P(x，-1)+(1-f(x)-f(y))·P(x，y)
0≤x，y＜N
其中，P′(x，y)为滤波后的预测值，P(x，y)为帧间预测得到的预测值，f(x)和f(y)为滤波器系数，N为预测块的尺寸。
示例性的，不同预测块的尺寸和(x,y)所在位置坐标的预测像素距离参考像素的距离的对应的滤波器系数可以如表2所示：
Figure PCTCN2021098009-appb-000003
Figure PCTCN2021098009-appb-000004
表2
其中，预测块的尺寸表示帧内预测块的宽或高的尺寸；距离参考像素的距离表示预测距离，最大预测距离设为10。
表2中的系数是经过放大之后的滤波器系数。例如，尺寸4对应的第一列表示当前预测块的宽(高)为4，对应的水平(竖直)滤波系数应该根据预测距离使用第一列对应的系数；距离1对应的第一行表示预测距离为1时，应该根据当前预测块的宽(高)使用第一行对应的系数。
示例性的，帧间预测滤波的标识方式可以如表3所示：
滤波方式索引 滤波类型 码流标识
0 不滤波 0
1 普通帧间预测滤波 10
2 增强帧间预测滤波 11
表3
编码端设备通过RDO策略选择最优的滤波方式并编码对应码流标识到码流中，解码端设备解码码流标识确定最终的滤波方式。
10、变换跳过(Transform Skip，简称TS)模式：在得到残差块以后，不对当前块进行变换操作(包括初始变换和二次变换)，而是对当前块的残差系数进行简单的位移操作，变换跳过和反变换跳过操作过程如下：
(1)变换跳过
a)计算移位shift，shift＝15–BitDepth–((logM1+logM2)>>1)，BitDepth为图像的比特深度，M1为当前块宽度，M2为当前块的高度；
b)若shift≥0，则进位因子rnd_factor＝1<<(shift–1)。由残差系数矩阵ResiMatrix得到矩阵C：
C ij＝(ResidueMatrix ij+rnd_factor)<<shift
c)若shift＜0，则令shift＝-shift，由残差系数矩阵ResiMatrix得到矩阵C：
C ij＝(ResidueMatrix ij+rnd_factor)>>shift
d)将矩阵C作为变换系数矩阵CoeffMatrix，用于量化及熵编码过程。
(2)反变换跳过
a)计算移位shift，shift＝15–BitDepth–((logM1+logM2)>>1)
b)若shift≥0，则进位因子rnd_factor＝1<<(shift–1)，由变换系数矩阵CoeffMatrix得到矩阵W：
W ij＝(CoeffMatrix ij+rnd_factor)>>shift
c)若shift＜0，则令shift＝-shift，由变换系数矩阵CoeffMatrix得到矩阵W：
W ij＝(CoeffMatrix ij+rnd_factor)<<shift
d)将矩阵W作为残差系数矩阵ResidueMatrix，用于重建过程。
11、率失真原则(RDO，Rate-Distortion Optimized)：评价编码效率的指标包括：码率和峰值信噪比(Peak Signal to Noise Ratio，简称PSNR)。码率越小，则压缩率越大；PSNR越大，重建图像质量越好。在模式选择的时候，判别公式实质上也就是对二者的综合评价。
模式对应的代价：J(mode)＝D+λ*R。其中，D表示失真(Distortion)，通常使用SSE(差值均方和)指标来衡量，SSE是指重建块与源图像块的差值均方和；λ是拉格朗日乘子；R就是该模式下图像块编码所需的实际比特数，包括编码模式信息、运动信息、残差等所需的比特总和。
在模式选择时，若使用RDO原则去对编码模式做比较决策，通常可以保证编码性能最佳。
12、跳过(Skip)模式：编码端设备不传输残差信息，也不传输运动矢量残差(MVD)，而是传输运动信息的索引即可。解码端设备通过解析运动信息的索引，即可推导当前块的运动信息，获取运动信息后，利用运动信息确定预测值，并将预测值作为重建值。
13、直接模式：编码端设备需要传输残差信息，但不传输MVD，而是传输运动信息的索引即可。解码端设备通过解析运动信息的索引，即可推导当前块的运动信息，获取运动信息后，利用运动信息确定预测值，将预测值加上残差值得到重建值。
14、帧间预测模式：编码端设备传输运动信息的索引、MVD以及残差信息等内容。
在跳过模式或者直接模式下，当前块的运动信息完全复用时域或空域某个相邻 块的运动信息，例如，可以从周围多个块的运动信息集合中，选择一个运动信息作为当前块的运动信息。因此，在跳过模式或直接模式下，可以编码一个索引值表示当前块使用运动信息集合中的哪个运动信息，而跳过模式和直接模式之间的区别在于：跳过模式不需要编码残差，而直接模式需要编码残差。显然，跳过模式或者直接模式可以大大节省运动信息的编码开销。
在直接模式下，可以采用多种预测模式确定如何生成帧间预测值，例如，普通直接模式、子块模式、编码预测(Merge with Motion Vector Difference，简称MMVD)模式、帧间预测滤波(interpf)模式，帧间角度加权预测(Angular Weighted Prediction，简称AWP)模式、基于任意几何划分形状(Geometrical Partitioning，简称GEO)的模式。
子块模式可以包括仿射(Affine)模式或者基于子块的时间运动矢量预测(subblock-based temporal motion vector prediction，简称SbTMVP)模式。
15、隐式选择变换跳过模式(Implicit Selection of Transform Skip mode，简称ISTS)：AVS-M5160提出了ISTS方案，编码端设备需要通过RDO来选择(DCT2，DCT2)还是变换跳过模式。为了隐藏ISTS标志位，当编码端设备选择(DCT2，DCT2)时，当前块的非零变换系数的个数应为偶数，若实际非零变换个数为奇数时，编码端设备通过将最后一位非零变换系数置零的方法使得当前块的非零变换系数的个数为偶数。同理，当编码端设备选择变换跳过模式时，当前块的非零变换系数的个数应为奇数，若实际非零变换系数的个数为偶数，则编码端设备可以通过将最后一位非零变换系数置零的方式使得当前块的非零变换系数的个数为奇数。
示例性的，ISTS的变换方式选择方式可以如表4所示：
非零变换系数的个数num_nz 变换方式
num_nz％2＝＝0 (DCT2，DCT2)
num_nz％2＝＝1 TS
表4
解码端设备通过统计当前块的非零变换系数的个数的奇偶性，根据表3可以得到当前块使用的变换方式。
三、现有视频编解码的主要流程
请参考图4中的(a)，以视频编码为例，视频编码一般包括预测、变换、量化、熵编码等过程，进一步地，编码过程还可以按照图4中的(b)的框架来实现。
其中，预测可以分为帧内预测和帧间预测，帧内预测是利用周围已编码块作为参考对当前未编码块进行预测，有效去除空域上的冗余。帧间预测是使用邻近已编码图像对当前图像进行预测，有效去除时域上的冗余。
变换是指将图像从空间域转换至变换域，利用变换系数对图像加以表示。绝大多数图像都含有较多平坦区域和像素值缓慢变化的区域，适当的变换可以使图像由在空间域的分散分布转换为在变换域的相对集中分布，去除信号之间的频域相关性，配合量化过程，可以有效压缩码流。
熵编码是一种无损编码方式，可以把一系列元素符号转变为一个用来传输或存储的二进制码流，输入的符号可能包括量化后的变换系数、运动矢量信息、预测模式信息，变换量化相关语法等。熵编码可以有效地去除视频元素符号的冗余。
上述是以编码为例进行介绍，视频解码与视频编码的过程是相对的，即视频解码通常包括熵解码、预测、反量化、反变换、滤波等过程，各个过程的实现原理与熵编码相同或相似。
为了使本申请实施例的上述目的、特征和优点能够更加明显易懂，下面结合附图对本申请实施例中技术方案作进一步详细的说明。
实施例1：
请参见图5，为本申请实施例提供的一种图像处理方法的流程示意图，该图像处理方法可以应用于编码端设备或解码端设备，如图5所示，该图像处理方法可以包括以下步骤：
步骤S500、确定当前块的预测模式。
步骤S510、当确定当前块的预测模式满足以下条件之一时，确定当前块满足变换跳过模式条件：当前块的预测模式为帧间预测模式、当前块的预测模式为直接模式。
本申请实施例中，对于编码端设备，当前图像块为编码块；对于解码端设备，当前块为解码块，下文不再复述。
本申请实施例中，可以将ISTS方案应用于帧间预测模式或/和直接模式，而不再将其限制在帧内预测模式或IBC模式，以扩展ISTS方案的应用范围。
当确定当前块的预测模式满足上述条件之一时，可以确定当前块满足变换跳过模式条件，即当前块允许使用变换跳过模式。
示例性的，对于编码端设备，可以基于RDO原则选择当前块的预测模式。
对于解码端设备，可以通过对当前块的码流进行解析，获取码流中的预测模式标志位，从而确定当前块的预测模式。
举例来说，以解码端设备为例，解码端设备可以从当前块的码流中解析用于指示当前块是否采用跳过模式的标志位(可以称为跳过模式标志位)，并基于跳过模式标志位的值确定当前块是否采用跳过模式；若当前块未采用跳过模式，则从码流中解析用于指示当前块是否采用直接模式的标志位(可以称为直接模式标志位)，并基于直接模式标志位的值确定当前块是否采用直接模式；若当前块未采用直接模式，则从码流中解析用于指示当前块采用帧内预测模式或帧间预测模式的标志位，并基于该标志位的值确定当前块采用帧内预测模式或帧间预测模式。
一个示例中，当确定当前块的预测模式为帧间预测模式时，确定当前块满足变换跳过模式条件。
在另一个示例中，当确定当前块的预测模式为直接模式时，确定当前块满足变换跳过模式条件。
在又一个示例中，当确定当前块的预测模式为帧间预测模式或直接模式时，确定当前块满足变换跳过模式条件。
可见，在图5所示方法流程中，通过将变换跳过模式应用于帧间预测模式或/和直接模式，扩展了ISTS方案的应用范围，并可以提高编码性能，降低解码时延。
实施例2：
作为一种可能的实施例，当前块满足变换跳过模式条件，还可以包括：
当前块满足以下条件之一：
当前块未采用PBT模式；
当前块未采用SBT模式；
当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
示例性的，考虑到当前块采用PBT模式时，需要对当前块进行子块划分，且不同位置的子块进行的变换不完全相同；而当前块采用SBT模式时，需要对帧间残差块进行子块划分，并将其中一个子块的残差默认为0，另一个子块的残差默认不为0，因此，在当前块采用PBT模式或SBT模式的情况下，采用变换跳过模式的复杂度会很高，而带来的性能提升并不明显。
因而，还可以将当前块是否采用PBT模式或SBT模式作为当前块是否满足变换跳过模式条件的判定条件。
示例性的，对于编码端设备，可以基于RDO原则选择当前块采用PBT模式、SBT模式或DCT2变换方式。
对于解码端设备，可以通过对当前块的码流进行解析，获取码流中的变换模式标志位的值，从而确定当前块采用PBT模式、SBT模式或DCT2变换方式。
举例来说，以解码端设备为例，解码端设备可以从当前块的码流中解析用于指示当前块是否采用PBT模式的标志位，并基于该标志位的值确定当前块是否采用PBT模式；若当前块未采用PBT模式，则从码流中解析用于指示当前块是否采用SBT模式的标志位，并基于该标志位的值确定当前块是否采用SBT模式；若当前块未采用SBT模式，则确定当前块采用DCT2模式。
在一个示例中，当当前块满足实施例1中的条件，且未采用PBT模式时，确定当前块满足变换跳过模式。
在另一个示例中，当当前块满足实施例1中的条件，且未采用SBT模式时，确定当前块满足变换跳过模式。
在又一个示例中，当当前块满足实施例1中的条件，且既未采用PBT模式，又未采用SBT模式；或，当当前块满足实施例1中的条件，且采用DCT2变换方式进行变换时，确定当前块满足变换跳过模式。
实施例3：
作为一种可能的实施例，当当前块的预测模式为直接模式时，当前块满足变换跳过模式条件，还可以包括：
当前块未采用帧间预测滤波模式。
示例性的，考虑到当当前块采用了帧间预测滤波模式时，对当前块采用变换跳过模式对当前块的性能基本不会带来提升，而且会提升复杂度。
因而，当当前块的预测模式为直接模式时，还可以将当前块是否采用帧间预测滤波模式作为当前块是否满足变换跳过模式条件的判定条件。
示例性的，对于解码端设备，可以通过从码流中解析与当前块的滤波方式索引对应的码流标识(可以如表3所示)，确定当前块的滤波类型。
对于编码端，可以基于RDO原则确定当前块是否采用帧间预测滤波模式。
举例来说，对于解码端设备，当从当前块的码流中解析得到的滤波方式索引对应的码流标识为0，则确定当前块未采用帧间预测滤波模式；若解析得到的码流标识为10，则确定当前块采用帧间预测滤波模式，且为普通帧间预测滤波；若解析得到的码流标识为11，则确定当前块采用帧间预测滤波模式，且为增强帧间预测滤波。
在一个示例中，当当前块的预测模式为直接模式，且当前块未采用帧间预测滤波模式时，确定当前块满足变换跳过模式。
在另一个示例中，当当前块的预测模式为直接模式，且当前块未采用帧间预测滤波模式，以及当前块未采用PBT模式时，确定当前块满足变换跳过模式。
在又一个示例中，当当前块的预测模式为直接模式，且当前块未采用帧间预测滤波模式，以及当前块未采用SBT模式时，确定当前块满足变换跳过模式。
在又一个示例中，当当前块的预测模式为直接模式，且当前块未采用帧间预测滤波模式，以及当前块既未采用PBT模式，又未采用SBT模式时；或，当当前块满足实施例1中的条件，且采用DCT2变换方式进行变换，确定当前块满足变换跳过模式。
实施例4：
作为一种可能的实施例，当前块满足变换跳过模式条件，还可以包括：
当前块满足以下条件之一或多个：
当前块为亮度块；
当前块的宽度和高度均小于64。
示例性的，考虑到通常图像的色度块的纹理比较简单，应用变换跳过模式带来的性能提升很小。
此外，对于宽度和高度较大，如大于64的块，应用变换跳过模式的复杂度提升相对性能提升更为明显。
因而，还可以将当前块为亮度块或色度块，以及当前块的尺寸作为当前块满足变换跳过模式条件的判定条件。
在一个示例中，当当前块满足实施例1～实施例3任一实施例中的条件，且当前块为亮度块时，确定当前块满足变换跳过模式。
在另一个示例中，当当前块满足实施例1～实施例3任一实施例中的条件，且当前块的宽度和高度均小于64时，确定当前块满足变换跳过模式。
在又一个示例中，当当前块满足实施例1～实施例3任一实施例中的条件，且当 前块为亮度块，以及当前块的宽度和高度均小于64时，确定当前块满足变换跳过模式。
实施例5：
请参见图6，为本申请实施例提供的一种图像处理方法的流程示意图，该图像处理方法可以应用于编码端设备或解码端设备，如图6所示，该图像处理方法可以包括以下步骤：
步骤S600、确定当前块的变换模式。
步骤S610、当确定当前块的变换模式满足以下条件之一时，确定当前块满足变换跳过模式条件：当前块未采用PBT模式，当前块未采用SBT模式，以及当前块未采用PBT模式且未采用SBT模式、或当前块采用DCT2变换方式进行变换。
本申请实施例中，考虑到当前块采用PBT模式时，需要对当前块进行子块划分，且不同位置的子块进行的变换不完全相同；而当前块采用SBT模式时，需要对帧间残差块进行子块划分，并将其中一个子块的残差默认为0，另一个子块的残差默认不为0，因此，在当前块采用PBT模式或SBT模式的情况下，采用变换跳过模式的复杂度会很高，而带来的性能提升并不明显。
因而，可以将当前块是否采用PBT模式或SBT模式作为当前块是否满足变换跳过模式条件的判定条件。
示例性的，对于编码端设备，可以基于RDO原则选择当前块采用PBT模式、SBT模式或DCT2变换方式。
对于解码端设备，可以通过对当前块的码流进行解析，获取码流中的变换模式标志位的值，从而确定当前块采用PBT模式、SBT模式或DCT2变换方式。
举例来说，以解码端设备为例，解码端设备可以从当前块的码流中解析用于指示当前块是否采用PBT模式的标志位，并基于该标志位的值确定当前块是否采用PBT模式；若当前块未采用PBT模式，则从码流中解析用于指示当前块是否采用SBT模式的标志位，并基于该标志位的值确定当前块是否采用SBT模式；若当前块未采用SBT模式，则确定当前块采用DCT2模式。
在一个示例中，当当前块未采用PBT模式时，确定当前块满足变换跳过模式。
在另一个示例中，当当前块未采用SBT模式时，确定当前块满足变换跳过模式。
在又一个示例中，当当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换时，确定当前块满足变换跳过模式。
实施例6：
作为一种可能的实施例，当前块满足变换跳过模式条件，还可以包括：
当前块的预测模式满足以下条件之一：
当前块的预测模式为帧间预测模式；
当前块的预测模式为直接模式。
示例性的，可以将ISTS方案应用于帧间预测模式或/和直接模式，而不再将其限制在帧内预测模式或IBC模式，以扩展ISTS方案的应用范围。
因而，还可以将当前块的预测模式作为当前块是否满足变换跳过模式条件的判定条件。
示例性的，对于编码端设备，可以基于RDO原则选择当前块的预测模式。
对于解码端设备，可以通过对当前块的码流进行解析，获取码流中的预测模式标志位的值，从而确定当前块的预测模式。
举例来说，以解码端设备为例，解码端设备可以从当前块的码流中解析用于指示当前块是否采用跳过模式的标志位(可以称为跳过模式标志位)，并基于跳过模式标志位的值确定当前块是否采用跳过模式；若当前块未采用跳过模式，则从码流中解析用于指示当前块是否采用直接模式的标志位(可以称为直接模式标志位)，并基于直接模式标志位的值确定当前块是否采用直接模式；若当前块未采用直接模式，则从码流中解析用于指示当前块采用帧内预测模式或帧间预测模式的标志位，并基于该标志位的值确定当前块采用帧内预测模式或帧间预测模式。
一个示例中，当当前块满足实施例5中的条件，且预测模式为帧间预测模式时，确定当前块满足变换跳过模式条件。
在另一个示例中，当当前块满足实施例5中的条件，且预测模式为直接模式时，确定当前块满足变换跳过模式条件。
在又一个示例中，当当前块满足实施例5中的条件，且预测模式为帧间预测模式或直接模式时，确定当前块满足变换跳过模式条件。
实施例7：
作为一种可能的实施例，当当前块的预测模式为直接模式时，当前块满足变换跳过模式条件，还可以包括：
当前块未采用帧间预测滤波模式。
示例性的，考虑到当当前块采用了帧间预测滤波模式时，对当前块采用变换跳过模式对当前块的性能基本不会带来提升，而且会提升复杂度。
因而，还可以将当前块是否采用帧间预测滤波模式作为当前块是否满足变换跳过模式条件的判定条件。
示例性的，对于解码端设备，可以通过从码流中解析与当前块的滤波方式索引对应的码流标识(可以如表3所示)，确定当前块的滤波类型。
对于编码端，可以基于RDO原则确定当前块是否采用帧间预测滤波模式。
举例来说，对于解码端设备，当从当前块的码流中解析得到的滤波方式索引对应的码流标识为0，则确定当前块未采用帧间预测滤波模式；若解析得到的码流标识为10，则确定当前块采用帧间预测滤波模式，且为普通帧间预测滤波；若解析得到的码流标识为11，则确定当前块采用帧间预测滤波模式，且为增强帧间预测滤波。
在一个示例中，当当前块满足实施例5或实施例6的条件，且当前块未采用帧间预测滤波模式时，确定当前块满足变换跳过模式。
实施例8：
作为一种可能的实施例，当前块满足变换跳过模式条件，还可以包括：
当前块满足以下条件之一或多个：
当前块为亮度块；
当前块的宽度和高度均小于64。
示例性的，考虑到通常图像的色度块的纹理比较简单，应用变换跳过模式带来的性能提升很小。
此外，对于宽度和高度较大，如大于64的块，应用变换跳过模式的复杂度提升相对性能提升更为明显。
因而，还可以将当前块为亮度块或色度块，以及当前块的尺寸作为当前块满足变换跳过模式条件的判定条件。
在一个示例中，当当前块满足实施例5～实施例7任一实施例中的条件，且当前块为亮度块时，确定当前块满足变换跳过模式。
在另一个示例中，当当前块满足实施例5～实施例7任一实施例中的条件，且当前块的宽度和高度均小于64时，确定当前块满足变换跳过模式。
在又一个示例中，当当前块满足实施例5～实施例7任一实施例中的条件，且当前块为亮度块，以及当前块的宽度和高度均小于64时，确定当前块满足变换跳过模式。
实施例9：
请参见图7，为本申请实施例提供的一种图像处理方法的流程示意图，该图像处理方法可以应用于编码端设备或解码端设备，如图7所示，该图像处理方法可以包括以下步骤：
步骤700、当当前块未采用帧间预测滤波模式时，确定当前块满足变换跳过模式条件。
本申请实施例中，考虑到当当前块采用了帧间预测滤波模式时，对当前块采用变换跳过模式对当前块的性能基本不会带来提升，而且会提升复杂度。
因而，可以将当前块是否采用帧间预测滤波模式作为当前块是否满足变换跳过模式条件的判定条件。
示例性的，对于解码端设备，可以通过从码流中解析与当前块的滤波方式索引对应的码流标识(可以如表3所示)，确定当前块的滤波类型。
对于编码端，可以基于RDO原则确定当前块是否采用帧间预测滤波模式。
举例来说，对于解码端设备，当从当前块的码流中解析得到的滤波方式索引对应的码流标识为0，则确定当前块未采用帧间预测滤波模式；若解析得到的码流标识为10，则确定当前块采用帧间预测滤波模式，且为普通帧间预测滤波；若解析得到的码流标识为11，则确定当前块采用帧间预测滤波模式，且为增强帧间预测滤波。
实施例10：
作为一种可能的实施例，当前块满足变换跳过模式条件，还可以包括：
当前块的预测模式满足以下条件之一：
当前块的预测模式为帧间预测模式；
当前块的预测模式为直接模式。
示例性的，可以将ISTS方案应用于帧间预测模式或/和直接模式，而不再将其限制在帧内预测模式或IBC模式，以扩展ISTS方案的应用范围。
因而，还可以将当前块的预测模式作为当前块是否满足变换跳过模式条件的判定条件。
示例性的，对于编码端设备，可以基于RDO原则选择当前块的预测模式。
对于解码端设备，可以通过对当前块的码流进行解析，获取码流中的预测模式标志位，从而确定当前块的预测模式。
举例来说，以解码端设备为例，解码端设备可以从当前块的码流中解析用于指示当前块是否采用跳过模式的标志位(可以称为跳过模式标志位)，并基于跳过模式标志位的值确定当前块是否采用跳过模式；若当前块未采用跳过模式，则从码流中解析用于指示当前块是否采用直接模式的标志位(可以称为直接模式标志位)，并基于直接模式标志位的值确定当前块是否采用直接模式；若当前块未采用直接模式，则从码流中解析用于指示当前块采用帧内预测模式或帧间预测模式的标志位，并基于该标志位的值确定当前块采用帧内预测模式或帧间预测模式。
一个示例中，当当前块满足实施例9中的条件，且预测模式为帧间预测模式时，确定当前块满足变换跳过模式条件。
在另一个示例中，当当前块满足实施例9中的条件，且预测模式为直接模式时，确定当前块满足变换跳过模式条件。
在又一个示例中，当当前块满足实施例9中的条件，且预测模式为帧间预测模式或直接模式时，确定当前块满足变换跳过模式条件。
实施例11：
作为一种可能的实施例，当前块满足变换跳过模式条件，还可以包括：
当前块满足以下条件之一：
当前块未采用PBT模式；
当前块未采用SBT模式；
当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
示例性的，考虑到当前块采用PBT模式时，需要对当前块进行子块划分，且不同位置的子块进行的变换不完全相同；而当前块采用SBT模式时，需要对帧间残差块进行子块划分，并将其中一个子块的残差默认为0，另一个子块的残差默认不为0，因此，在当前块采用PBT模式或SBT模式的情况下，采用变换跳过模式的复杂度会很高，而带来的性能提升并不明显。
因而，还可以将当前块是否采用PBT模式或SBT模式作为当前块是否满足变换 跳过模式条件的判定条件。
示例性的，对于编码端设备，可以基于RDO原则选择当前块采用PBT模式、SBT模式或DCT2变换方式。
对于解码端设备，可以通过对当前块的码流进行解析，获取码流中的变换模式标志位，从而确定当前块采用PBT模式、SBT模式或DCT2变换方式。
举例来说，以解码端设备为例，解码端设备可以从当前块的码流中解析用于指示当前块是否采用PBT模式的标志位，并基于该标志位的值确定当前块是否采用PBT模式；若当前块未采用PBT模式，则从码流中解析用于指示当前块是否采用SBT模式的标志位，并基于该标志位的值确定当前块是否采用SBT模式；若当前块未采用SBT模式，则确定当前块采用DCT2模式。
在一个示例中，当当前块满足实施例9或实施例10中的条件，且未采用PBT模式时，确定当前块满足变换跳过模式。
在另一个示例中，当当前块满足实施例9或实施例10中的条件，且未采用SBT模式；或，当前块满足实施例9或实施例10中的条件，且采用DCT2变换方式进行变换时，确定当前块满足变换跳过模式。
在又一个示例中，当当前块满足实施例9或实施例10中的条件，且既未采用PBT模式，又未采用SBT模式时，确定当前块满足变换跳过模式。
实施例12：
作为一种可能的实施例，当前块满足变换跳过模式条件，还可以包括：
当前块满足以下条件之一或多个：
当前块为亮度块；
当前块的宽度和高度均小于64。
示例性的，考虑到通常图像的色度块的纹理比较简单，应用变换跳过模式带来的性能提升很小。
此外，对于宽度和高度较大，如大于64的块，应用变换跳过模式的复杂度提升相对性能提升更为明显。
因而，还可以将当前块为亮度块或色度块，以及当前块的尺寸作为当前块满足变换跳过模式条件的判定条件。
在一个示例中，当当前块满足实施例9～实施例11任一实施例中的条件，且当前块为亮度块时，确定当前块满足变换跳过模式。
在另一个示例中，当当前块满足实施例9～实施例11任一实施例中的条件，且当前块的宽度和高度均小于64时，确定当前块满足变换跳过模式。
在又一个示例中，当当前块满足实施例9～实施例11任一实施例中的条件，且当前块为亮度块，以及当前块的宽度和高度均小于64时，确定当前块满足变换跳过模式。
实施例13：
请参见图8，为本申请实施例提供的一种解码方法的流程示意图，该解码方法可 以应用于解码端设备，如图8所示，该解码方法可以包括以下步骤：
步骤S800、获取码流；
步骤S810、从码流中获取帧间变换跳过模式使能标志位的值。
本申请实施例中，为了提高针对帧间预测模式或/和直接模式的变换跳过模式的应用的灵活性和可控性，可以设置一个用于指示是否使能帧间变换跳过模式的标志位。
示例性的，该标志位的值至少可以包括第一值和第二值，第一值为表征使能帧间变换跳过模式的值；第二值为表征不使能帧间变换跳过模式的值。
当该标志位的值为第一值时，表征变换跳过模式可以应用于帧间预测模式或/和直接模式。
在一个示例中，帧间变换跳过模式使能标志位可以通过序列参数集(Sequence Paramater Set，简称SPS)级语法实现，一个图像序列通过一个帧间变换跳过模式使能标志，标识该图像序列是否可以将变换跳过模式应用于帧间预测模式或/和直接模式，以节省编码比特消耗。
应该认识到，帧间变换跳过模式使能标志位并不限于通过SPS级语法实现，其也可以通过图像参数集(Picture Parameter Set，简称PPS)级语法或片(Slice)级语法等语法实现。
以帧间变换跳过模式使能标志位通过SPS级语法实现为例，解码端设备可以从图像序列的序列头中解析帧间变换跳过模式使能标志位，并基于解析得到的帧间变换跳过模式使能标志位的值，确定是否使能帧间变换跳过模式。
步骤S820、当帧间变换跳过模式使能标志位的值为第一值，且当前块满足变换跳过模式条件时，基于当前块的非零变换系数的个数的奇偶性，对当前块进行反变换跳过处理或DCT2反变换处理以得到所述当前块的变换系数，并对所述变换系数进行反量化处理，得到当前块的残差系数。
本申请实施例中，当帧间变换跳过模式使能标志位的值为第一值，即使能帧间变换跳过模式时，解码端设备可以确定当前块是否满足变换跳过模式条件。
需要说明的是，编码端设备进行码流编码时，还可以编码变换跳过模式使能标志位，该变换跳过模式使能标志位一般通过PPS级语法实现，用于标识一帧图像是否使能变换跳过模式。当解码端设备获取到的帧间变换跳过模式使能标志位的值为第一值时，对于任一帧图像，还可以从该帧图像的码流中解析变换跳过模式使能标志位，当该变换跳过模式使能标志位的值为表征该帧图像使能变换跳过模式的值时，再对该帧图像的各块进行是否满足变换跳过模式条件的判定。
示例性的，解码端设备判定当前块是否满足变换跳过模式条件的实现可以采用实施例1～实施例12中任一实施例中描述的方式。
当解码端设备确定当前块满足变换跳过模式条件时，解码端设备可以基于当前块的非零变换系数(反量化前的变换系数)的个数的奇偶性，确定对当前块进行反变换跳过处理或DCT2反变换处理。
示例性的，当当前块的非零变换系数的个数为奇数时，确定对当前块进行反变 换跳过处理。
当当前块的非零变换系数的个数为偶数时，确定对当前块进行DCT2反变换处理。
解码端设备通过对当前块进行反变换跳过处理或DCT2反变化处理，得到当前块的变换系数时，可以通过反量化处理，得到当前块的残差系数。
步骤S830、基于当前块的预测值和当前块的残差系数，确定当前块的重建值。
本申请实施例中，解码端设备可以通过预测得到的当前块的预测值，以及步骤S820中得到的当前块的残差系数，确定当前块的重建值。
可见，在图8所示方法流程中，通过增加帧间变换跳过模式使能标志位，通过该帧间变换跳过模式使能标志位对针对帧间预测模式或/和直接模式的变换跳过模式应用进行控制，提高了变换跳过模式应用的灵活性和可控性，从而提高了ISTS方案应用的灵活性和可控性；此外，通过将ISTS方案应用于帧间预测模式或/和直接模式，扩展了ISTS方案的应用范围，且可以提高编码性能，降低解码时延。
实施例14：
请参见图9，为本申请实施例提供的一种编码方法的流程示意图，该编码方法可以应用于编码端设备，如图9所示，该编码方法可以包括以下步骤：
步骤S900、对帧间变换跳过模式使能标志位进行编码。
本申请实施例中，为了提高针对帧间预测模式或/和直接模式的变换跳过模式的应用的灵活性和可控性，可以设置一个用于指示是否使能帧间变换跳过模式的标志位。
示例性的，该标志位的值至少可以包括第一值和第二值，第一值为表征使能帧间变换跳过模式的值；第二值为表征不使能帧间变换跳过模式的值。
当该标志位的值为第一值时，表征变换跳过模式可以应用于帧间预测模式或/和直接模式。
在一个示例中，帧间变换跳过模式使能标志位可以通过序列参数集(Sequence Paramater Set，简称SPS)级语法实现，一个图像序列通过一个帧间变换跳过模式使能标志，标识该图像序列是否可以将变换跳过模式应用于帧间预测模式或/和直接模式，以节省编码比特消耗。
应该认识到，帧间变换跳过模式使能标志位并不限于通过SPS级语法实现，其也可以通过图像参数集(Picture Parameter Set，简称PPS)级语法或片(Slice)级语法等语法实现。
以帧间变换跳过模式使能标志位通过SPS级语法实现为例，编码端设备可以在图像序列的序列头中增加帧间变换跳过模式使能标志位，并基于配置设置该帧间变换跳过模式使能标志位的值。
步骤S910、当帧间变换跳过模式使能标志位的值为第一值，且当前块满足变换跳过模式条件时，基于率失真代价选择对当前块进行变换跳过处理或DCT2变换处理，以得到当前块的变换系数。
本申请实施例中，当帧间变换跳过模式使能标志位的值为第一值，即使能帧间 变换跳过模式时，编码端设备可以确定当前块是否满足变换跳过模式。
需要说明的是，编码端设备进行码流编码时，还可以编码变换跳过模式使能标志位，该变换跳过模式使能标志位一般通过PPS级语法实现，用于标识一帧图像是否使能变换跳过模式。当该变换跳过模式使能标志位的值为表征该帧图像使能变换跳过模式的值时，编码端设备可以对该帧图像的各块进行是否满足变换跳过模式条件的判定。
示例性的，编码端设备判定当前块是否满足变换跳过模式条件的实现可以采用实施例1～实施例12中任一实施例中描述的方式。
当编码端设备确定当前块满足变换跳过模式条件时，编码端设备可以基于RDO原则选择对当前块进行变换跳过处理或DCT2变换处理。
步骤S920、当当前块的非零变换系数的个数的奇偶性与所选择变换方式不匹配时，调整当前块的非零变换系数的个数的奇偶性，以使当前块的非零变换系数的个数的奇偶性与所选择的变换方式匹配。
本申请实施例中，为了节省编码比特开销，可以通过ISTS方案指示当前块选择变换跳过处理或DCT2变换处理。
示例性的，当编码端设备选择对当前块进行变换跳过处理时，需要使当前块的非零变换系数(量化前的变换系数)的个数为奇数；当编码端设备选择对当前块进行DCT2处理时，需要使当前块的非零变换系数的个数为偶数。
编码端设备基于RDO原则选择了对当前块进行变换跳过处理或DCT2变换处理时，可以确定当前块的非零变换系数的个数的奇偶性与所选择的变换方式(变换跳过模式或DCT2变换)是否匹配。
当当前块的非零变换系数的个数的奇偶性与所选择的变换方式不匹配时，编码端设备可以调整当前块的非零变换系数的个数的奇偶性，以使当前块的非零变换系数的个数的奇偶性与所选择的变换方式匹配。
例如，当编码端设备选择对当前块进行变换跳过处理，且当前块的非零变换系数的个数为偶数时，编码端设备可以将当前块的最后一位非零变换系数置零，以使当前块的非零变换系数的个数为奇数。
当编码端设备选择对当前块进行DCT2变换处理，且当前块的非零变换系数的个数为奇数时，编码端设备可以将当前块的最后一位非零变换系数置零，以使当前块的非零变换系数的个数为偶数。
步骤S930、对当前块的变换系数进行量化及熵编码，得到当前块的码流。
本申请实施例中，当当前块的非零变换系数的个数的奇偶性与所选择变换方式匹配时，编码端设备可以对当前块的变换系数进行量化及熵编码，得到当前块的码流。
可见，在图9所示方法流程中，通过增加帧间变换跳过模式使能标志位，通过该帧间变换跳过模式使能标志位对针对帧间预测模式或/和直接模式的变换跳过模式应用进行控制，提高了变换跳过模式应用的灵活性和可控性，从而提高了ISTS方案应用的灵活性和可控性；此外，通过将ISTS方案应用于帧间预测模式或/和直接模式，扩展了ISTS方案的应用范围，且可以提高编码性能，降低解码时延。
为了使本领域技术人员更好地理解本申请实施例提供的技术方案，下面结合具体实例对本申请实施例提供的技术方案进行说明。
实施例15：
将ISTS应用于帧间预测模式或/和直接模式
当前块满足变换跳过模式条件，包括：
当前块的预测模式满足以下条件之一：
1、当前块的预测模式为帧间预测模式；
2、当前块的预测模式为直接模式；
3、当前块的预测模式为帧间预测模式或直接模式。
实施例16：
将ISTS应用于PBT模式或/和SBT模式之外的变换模式
当前块满足变换跳过模式条件，包括：
当前块的变换模式满足以下条件之一：
1、当前块未采用PBT模式；
2、当前块未采用SBT模式；
3、当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
实施例17：
将ISTS应用于帧间预测滤波模式之外的模式
当前块满足变换跳过模式条件，包括：
当前块未采用帧间预测滤波模式。
实施例18：
当前块满足变换跳过模式条件，包括：
1、当前块的预测模式满足以下条件之一：
1)、当前块的预测模式为帧间预测模式；
2)、当前块的预测模式为直接模式；
3)、当前块的预测模式为帧间预测模式或直接模式。
2、当前块的变换模式满足以下条件之一：
1)、当前块未采用PBT模式；
2)、当前块未采用SBT模式；
3)、当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
实施例19：
当前块满足变换跳过模式条件，包括：
1、当前块的预测模式满足以下条件之一：
1)、当前块的预测模式为帧间预测模式；
2)、当前块的预测模式为直接模式；
3)、当前块的预测模式为帧间预测模式或直接模式。
2、当前块未采用帧间预测滤波模式。
实施例20：
当前块满足变换跳过模式条件，包括：
1、当前块的变换模式满足以下条件之一：
1)、当前块未采用PBT模式；
2)、当前块未采用SBT模式；
3)、当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
2、当前块未采用帧间预测滤波模式。
实施例21：
当前块满足变换跳过模式条件，包括：
1、当前块的预测模式满足以下条件之一：
1)、当前块的预测模式为帧间预测模式；
2)、当前块的预测模式为直接模式；
3)、当前块的预测模式为帧间预测模式或直接模式。
2、当前块的变换模式满足以下条件之一：
1)、当前块未采用PBT模式；
2)、当前块未采用SBT模式；
3)、当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
3、当前块未采用帧间预测滤波模式。
实施例22：
当前块满足变换跳过模式条件，包括：
1、当前块的预测模式满足以下条件之一：
1)、当前块的预测模式为帧间预测模式；
2)、当前块的预测模式为直接模式；
3)、当前块的预测模式为帧间预测模式或直接模式。
2、当前块满足以下条件之一或多个：
1)、当前块为亮度块；
2)、当前块的宽度和高度均小于64。
实施例23：
当前块满足变换跳过模式条件，包括：
1、当前块的变换模式满足以下条件之一：
1)、当前块未采用PBT模式；
2)、当前块未采用SBT模式；
3)、当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
2、当前块满足以下条件之一或多个：
1)、当前块为亮度块；
2)、当前块的宽度和高度均小于64。
实施例24：
当前块满足变换跳过模式条件，包括：
1、当前块未采用帧间预测滤波模式。
2、当前块满足以下条件之一或多个：
1)、当前块为亮度块；
2)、当前块的宽度和高度均小于64。
实施例25：
当前块满足变换跳过模式条件，包括：
1、当前块的预测模式满足以下条件之一：
1)、当前块的预测模式为帧间预测模式；
2)、当前块的预测模式为直接模式；
3)、当前块的预测模式为帧间预测模式或直接模式。
2、当前块的变换模式满足以下条件之一：
1)、当前块未采用PBT模式；
2)、当前块未采用SBT模式；
3)、当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
3、当前块满足以下条件之一或多个：
1)、当前块为亮度块；
2)、当前块的宽度和高度均小于64。
实施例26：
当前块满足变换跳过模式条件，包括：
1、当前块的预测模式满足以下条件之一：
1)、当前块的预测模式为帧间预测模式；
2)、当前块的预测模式为直接模式；
3)、当前块的预测模式为帧间预测模式或直接模式。
2、当前块未采用帧间预测滤波模式。
3、当前块满足以下条件之一或多个：
1)、当前块为亮度块；
2)、当前块的宽度和高度均小于64。
实施例27：
当前块满足变换跳过模式条件，包括：
1、当前块的变换模式满足以下条件之一：
1)、当前块未采用PBT模式；
2)、当前块未采用SBT模式；
3)、当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
2、当前块未采用帧间预测滤波模式。
3、当前块满足以下条件之一或多个：
1)、当前块为亮度块；
2)、当前块的宽度和高度均小于64。
实施例28：
当前块满足变换跳过模式条件，包括：
1、当前块的预测模式满足以下条件之一：
1)、当前块的预测模式为帧间预测模式；
2)、当前块的预测模式为直接模式；
3)、当前块的预测模式为帧间预测模式或直接模式。
2、当前块的变换模式满足以下条件之一：
1)、当前块未采用PBT模式；
2)、当前块未采用SBT模式；
3)、当前块未采用PBT模式，且未采用SBT模式；或，当前块采用DCT2变换方式进行变换。
3、当前块未采用帧间预测滤波模式。
4、当前块满足以下条件之一或多个：
1)、当前块为亮度块；
2)、当前块的宽度和高度均小于64。
实施例29
解码流程：
接收码流。
从码流中获取帧间变换跳过使能标志位inter_ists_enable_flag，若inter_ists_enable_flag为真(例如，值为1)且当前块满足变换跳过模式条件，则基于当前块的非零变换系数(此变换系数为反量化前的变换系数)的个数(num_nz)的奇偶性来确定是否对当前块进行变换跳过模式。
若num_nz为奇数，对当前块进行反变换跳过模式；否则，num_nz为偶数，对当前块进行DCT2反变换，以得到当前块的变换系数(反量化前的变换系数)。
经过反量化后得到当前块的残差系数，与当前块的预测值相加得到当前块的重建值。
示例性的，解码端设备确定当前块满足变换跳过模式条件可以采用实施例15～实施例28任一实施例描述的方式。
实施例30：
编码流程：
编码帧间变换跳过使能标志位inter_ists_enable_flag。
若inter_ists_enable_flag为真(例如，值为1)且当前块满足变换跳过模式条件，则通过RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理。
示例性的，变换跳过模式通过隐式的方法进行标识，即通过调整当前块的非零变换系数(此变换系数为量化后的变换系数)的个数(num_nz)的奇偶性，使其与当前块的变换方式匹配。
示例性，若对当前块进行变换跳过处理，则当前块的num_nz需为奇数，若不为奇数，则通过调整非零变换系数使num_nz为奇数；同理，若对当前块进行DCT2变换处理，则当前块的num_nz需为偶数，若不为偶数，则通过调整非零变换系数使num_nz为偶数。
对当前块的变换系数进行量化及熵编码，得到当前块的码流。
示例性的，编码端设备确定当前块满足变换跳过模式条件可以采用实施例15～实施例28任一实施例描述的方式。
以上对本申请提供的方法进行了描述。下面对本申请提供的装置进行描述：
请参见图10，为本申请实施例提供的一种解码装置的硬件结构示意图。该解码装置可包括处理器1001、通信接口1002、存储有机器可执行指令的机器可读存储介质1003。处理器1001、通信接口1002与机器可读存储介质1003可经由系统总线1004通信。并且，通过读取并执行机器可读存储介质1003中与解码控制逻辑对应的机器可执行指令，处理器1001可执行上文描述的解码方法。
本文中提到的机器可读存储介质1003可以是任何电子、磁性、光学或其它物理存储装置，可以包含或存储信息，如可执行指令、数据，等等。例如，机器可读存储介质可以是：RAM(Radom Access Memory，随机存取存储器)、易失存储器、非易失性存储器、闪存、存储驱动器(如硬盘驱动器)、固态硬盘、任何类型的存储盘(如光盘、dvd等)，或者类似的存储介质，或者它们的组合。
如图11所示，从功能上划分，上述解码装置可以包括：
获取单元1101，用于获取码流；
解码单元1102，用于当所述帧间变换跳过模式使能标志位的值为第一值，且当前块满足变换跳过模式条件时，基于所述当前块的非零变换系数的个数的奇偶性，对所述当前块进行反变换跳过处理或离散余弦变换DCT2反变换处理，并进行反量化处理，得到所述当前块的残差系数；其中，所述第一值为表征使能帧间变换跳过模式的值；基于所述当前块的预测值和所述当前块的残差系数，确定所述当前块的重建值。
请参见图12，为本申请实施例提供的一种编码装置的硬件结构示意图。该编码装置可包括处理器1201、通信接口1202、存储有机器可执行指令的机器可读存储介质1203。处理器1201、通信接口1202与机器可读存储介质1203可经由系统总线1204通信。并且，通过读取并执行机器可读存储介质1203中与编码控制逻辑对应的机器可执行指令，处理器1201可执行上文描述的编码方法。
如图13所示，从功能上划分，上述编码装置可以包括：
编码单元1301，用于对帧间变换跳过模式使能标志位进行编码；
变换单元1302，用于当所述帧间变换跳过模式使能标志位的值为第一值，且当前块满足变换跳过模式条件时，基于率失真代价选择对所述当前块进行变换跳过处理或离散余弦变换DCT2变换处理，以得到所述当前块的变换系数；当所述当前块的非零变换系数的个数的奇偶性与所选择变换方式不匹配时，调整所述当前块的非零变换系数的个数的奇偶性，以使所述当前块的非零变换系数的个数的奇偶性与所选择的变换方式匹配；
量化单元1303，用于对所述当前块的变换系数进行量化；
所述编码单元，还用于对量化后的所述当前块的变换系数进行熵编码，得到所述当前块的码流。
本文中提到的机器可读存储介质1203可以是任何电子、磁性、光学或其它物理存储装置，可以包含或存储信息，如可执行指令、数据，等等。例如，机器可读存储介质可以是：RAM(Radom Access Memory，随机存取存储器)、易失存储器、非易失性存储器、闪存、存储驱动器(如硬盘驱动器)、固态硬盘、任何类型的存储盘(如光盘、dvd等)，或者类似的存储介质，或者它们的组合。
在本公开实施例中，还提供一种解码装置，包括：处理器、通信接口、机器可 读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
在本公开实施例中，还提供一种解码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
在本公开实施例中，还提供一种解码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
在本公开实施例中，还提供一种解码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式。
在本公开实施例中，还提供一种解码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式。
在本公开实施例中，还提供一种解码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
其中，判断当前块满足变换跳过模式条件，包括：
所述当前块的预测模式为直接模式，且所述当前块未采用帧间预测滤波模式。
在本公开实施例中，还提供一种编码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
在本公开实施例中，还提供一种编码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
在本公开实施例中，还提供一种编码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的 宽度和高度均小于64。
在本公开实施例中，还提供一种编码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式。
在本公开实施例中，还提供一种编码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式。
在本公开实施例中，还提供一种编码装置，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，且所述当前块未采用帧间预测滤波模式。

Claims (25)

  1. 一种解码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  2. 一种解码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：
    所述当前块的预测模式为直接模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  3. 一种解码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：
    所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  4. 一种解码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式。
  5. 一种解码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：
    所述当前块的预测模式为直接模式。
  6. 一种解码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：
    所述当前块的预测模式为直接模式，且所述当前块未采用帧间预测滤波模式。
  7. 一种编码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前 块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  8. 一种编码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  9. 一种编码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  10. 一种编码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式。
  11. 一种编码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式。
  12. 一种编码方法，其特征在于，包括：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，且所述当前块未采用帧间预测滤波模式。
  13. 一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预 测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  14. 一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：
    所述当前块的预测模式为直接模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  15. 一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：
    所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  16. 一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式。
  17. 一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：
    所述当前块的预测模式为直接模式。
  18. 一种解码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被 所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若满足变换跳过模式条件，则对当前块进行反变换跳过处理或DCT2反变换处理得到当前块的残差系数，将当前块的残差系数与当前块的预测值相加得到当前块的重建值；
    其中，判断当前块满足变换跳过模式条件，包括：
    所述当前块的预测模式为直接模式，且所述当前块未采用帧间预测滤波模式。
  19. 一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  20. 一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  21. 一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，所述当前块未采用帧间预测滤波模式，且满足所述当前块为亮度块，所述当前块的宽度和高度均小于64。
  22. 一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理得到当前块的变换系数，对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，当前块满足变换跳过模式条件，包括：所述当前块的预测模式为帧间预测模 式。
  23. 一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式。
  24. 一种编码装置，其特征在于，包括：处理器、通信接口、机器可读存储介质和通信总线，其中，处理器，通信接口，机器可读存储介质通过通信总线完成相互间的通信；所述机器可读存储介质存放有计算机程序，所述处理器在执行所述计算机程序时被所述计算机程序促使：
    判断当前块是否满足变换跳过模式条件，若当前块满足变换跳过模式条件，则通过率失真优化RDO的方式来选择对当前块进行变换跳过处理或DCT2变换处理，然后对当前块的变换系数进行量化及熵编码，得到当前块的码流；
    其中，判断当前块满足变换跳过模式条件，包括：所述当前块的预测模式为直接模式，且所述当前块未采用帧间预测滤波模式。
  25. 一种机器可读存储介质，其上存储有计算机指令，所述计算机指令在被处理器执行时，使所述处理器实现根据权利要求1-12中任一项所述的方法。
PCT/CN2021/098009 2020-06-05 2021-06-02 编解码方法及装置 WO2021244586A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US17/928,446 US20230319259A1 (en) 2020-06-05 2021-06-02 Coding and decoding methods and apparatuses
JP2022574826A JP7467687B2 (ja) 2020-06-05 2021-06-02 符号化・復号方法及び装置
KR1020227043634A KR20230008881A (ko) 2020-06-05 2021-06-02 인코딩 및 디코딩 방법 및 장치
JP2024060323A JP2024081780A (ja) 2020-06-05 2024-04-03 符号化・復号方法及び装置

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010508168.9A CN113766225B (zh) 2020-06-05 2020-06-05 编码方法、解码方法及装置
CN202010508168.9 2020-06-05

Publications (1)

Publication Number Publication Date
WO2021244586A1 true WO2021244586A1 (zh) 2021-12-09

Family

ID=78668979

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/098009 WO2021244586A1 (zh) 2020-06-05 2021-06-02 编解码方法及装置

Country Status (6)

Country Link
US (1) US20230319259A1 (zh)
JP (2) JP7467687B2 (zh)
KR (1) KR20230008881A (zh)
CN (3) CN113709477B (zh)
TW (1) TWI780742B (zh)
WO (1) WO2021244586A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7483029B2 (ja) 2020-08-21 2024-05-14 テンセント・テクノロジー・（シェンジェン）・カンパニー・リミテッド ビデオ復号方法、ビデオ符号化方法、装置、媒体、及び電子機器

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104509113A (zh) * 2012-06-22 2015-04-08 高通股份有限公司 视频压缩中的变换跳过模式
CN107835414A (zh) * 2011-10-18 2018-03-23 株式会社Kt 视频信号解码方法
CN108293109A (zh) * 2015-11-23 2018-07-17 联发科技（新加坡）私人有限公司 具有视频编解码中最小块尺寸的块分割方法及装置
CN108605123A (zh) * 2016-01-27 2018-09-28 韩国电子通信研究院 通过使用预测对视频进行编码和解码的方法和装置
WO2018235405A1 (ja) * 2017-06-23 2018-12-27 ソニー株式会社 画像処理装置と画像処理方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101550726B1 (ko) * 2011-10-17 2015-09-07 주식회사 케이티 영상 부호화/복호화 방법 및 그 장치
US10390046B2 (en) * 2011-11-07 2019-08-20 Qualcomm Incorporated Coding significant coefficient information in transform skip mode
US9264713B2 (en) * 2012-07-11 2016-02-16 Qualcomm Incorporated Rotation of prediction residual blocks in video coding with transform skipping
US9549182B2 (en) * 2012-07-11 2017-01-17 Qualcomm Incorporated Repositioning of prediction residual blocks in video coding
KR102230264B1 (ko) * 2015-08-28 2021-03-22 삼성전자주식회사 비디오 부호화 방법 및 장치, 비디오 복호화 방법 및 장치
US10616604B2 (en) * 2015-09-01 2020-04-07 Qualcomm Incorporated Coefficient level coding in video coding
RU2720066C1 (ru) * 2017-01-03 2020-04-23 ЭлДжи ЭЛЕКТРОНИКС ИНК. Способ обработки изображений и устройство для этого
CN107566846B (zh) * 2017-09-20 2020-04-14 北京字节跳动网络技术有限公司 视频编码跳过模式决策方法、装置、设备及存储介质
WO2019135628A1 (ko) * 2018-01-05 2019-07-11 에스케이텔레콤 주식회사 영상을 부호화 또는 복호화하는 방법 및 장치
CN113545089B (zh) * 2019-03-06 2024-07-02 韩国电子通信研究院 图像编码/解码方法和设备以及存储比特流的记录介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107835414A (zh) * 2011-10-18 2018-03-23 株式会社Kt 视频信号解码方法
CN104509113A (zh) * 2012-06-22 2015-04-08 高通股份有限公司 视频压缩中的变换跳过模式
CN108293109A (zh) * 2015-11-23 2018-07-17 联发科技（新加坡）私人有限公司 具有视频编解码中最小块尺寸的块分割方法及装置
CN108605123A (zh) * 2016-01-27 2018-09-28 韩国电子通信研究院 通过使用预测对视频进行编码和解码的方法和装置
WO2018235405A1 (ja) * 2017-06-23 2018-12-27 ソニー株式会社 画像処理装置と画像処理方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7483029B2 (ja) 2020-08-21 2024-05-14 テンセント・テクノロジー・（シェンジェン）・カンパニー・リミテッド ビデオ復号方法、ビデオ符号化方法、装置、媒体、及び電子機器

Also Published As

Publication number Publication date
CN113709476A (zh) 2021-11-26
JP7467687B2 (ja) 2024-04-15
CN113709477B (zh) 2022-12-23
TW202201960A (zh) 2022-01-01
CN113766225A (zh) 2021-12-07
US20230319259A1 (en) 2023-10-05
CN113709476B (zh) 2022-12-23
JP2024081780A (ja) 2024-06-18
CN113709477A (zh) 2021-11-26
CN113766225B (zh) 2023-02-28
KR20230008881A (ko) 2023-01-16
TWI780742B (zh) 2022-10-11
JP2023529183A (ja) 2023-07-07

Similar Documents

Publication Publication Date Title
JP6797993B2 (ja) サンプル適応オフセットの処理を実行するための情報を符号化する符号化方法
KR102412271B1 (ko) 인루프 필터링을 적용한 예측 방법을 이용한 영상 부호화/복호화 방법 및 장치
JP6724152B2 (ja) 走査順序選択のための方法及び装置
KR20150027530A (ko) Hevc 부호화 장치 및 이를 이용한 부호화 방법
JP2024081780A (ja) 符号化・復号方法及び装置
JP7286783B2 (ja) 符号化方法、復号化方法、デコーダ、エンコーダー及び記憶媒体
CN114827629B (zh) 编码方法、解码方法、装置及机器可读存储介质
RU2707719C1 (ru) Способ и устройство выбора порядка сканирования
CN111988618B (zh) 进行解码、编码的方法、解码端和编码端
CN111492658A (zh) 使用有效多个变换进行视频压缩的方法和装置
WO2021190518A1 (zh) 解码、编码、编解码方法、装置及其设备
WO2022140905A1 (zh) 预测方法、编码器、解码器以及存储介质
CN111669579B (zh) 进行编码和解码的方法、编码端、解码端和系统
KR101926017B1 (ko) 계층적 부호화 단위의 크기에 따른 비디오 부호화 방법과 그 장치, 및 비디오 복호화 방법과 그 장치
KR20160144952A (ko) 계층적 부호화 단위의 크기에 따른 비디오 부호화 방법과 그 장치, 및 비디오 복호화 방법과 그 장치
WO2020000487A1 (zh) 变换方法、反变换方法及装置
Kesireddy A new adaptive trilateral filter for in-loop filtering
KR20130070195A (ko) 문맥 기반의 샘플 적응적 오프셋 필터 방향 추론 및 적응적 선택에 대한 비디오 방법 및 장치
Zhang et al. Enhanced intra coding with joint line and pixel prediction
KR20150060615A (ko) 계층적 부호화 단위의 크기에 따른 비디오 부호화 방법과 그 장치, 및 비디오 복호화 방법과 그 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21818692

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022574826

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20227043634

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21818692

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 21818692

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05/07/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21818692

Country of ref document: EP

Kind code of ref document: A1