CN112929657B - H.266/VVC rapid CU partition decision method based on gradient and variance - Google Patents

H.266/VVC rapid CU partition decision method based on gradient and variance Download PDF

Info

Publication number
CN112929657B
CN112929657B CN202110086854.6A CN202110086854A CN112929657B CN 112929657 B CN112929657 B CN 112929657B CN 202110086854 A CN202110086854 A CN 202110086854A CN 112929657 B CN112929657 B CN 112929657B
Authority
CN
China
Prior art keywords
current
gradient
division
texture
variance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110086854.6A
Other languages
Chinese (zh)
Other versions
CN112929657A (en
Inventor
张秋闻
刘伟华
赵永博
崔腾耀
郭睿骁
赵进超
王晓
蒋斌
黄立勋
张伟伟
钱晓亮
吴庆岗
常化文
魏涛
孙丽君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou University of Light Industry
Original Assignee
Zhengzhou University of Light Industry
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou University of Light Industry filed Critical Zhengzhou University of Light Industry
Priority to CN202110086854.6A priority Critical patent/CN112929657B/en
Publication of CN112929657A publication Critical patent/CN112929657A/en
Application granted granted Critical
Publication of CN112929657B publication Critical patent/CN112929657B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/147Data rate or code amount at the encoder output according to rate distortion criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96Tree coding, e.g. quad-tree coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention provides a gradient and variance based H.266/VVC rapid CU partitioning method, which comprises the following steps: firstly, the homogeneity of the current CU is evaluated according to the variance value, and whether the further division of the current CU can be stopped in advance is judged. And then extracting gradient features of the current CU by using a Sobel operator, and judging whether the current CU can carry out QT division or not so as to skip BT and TT division. And finally, extracting the edge characteristics of the texture of the current CU by using a Canny operator, eliminating MT division in the vertical or horizontal division direction according to the trend of the texture of the current CU, taking MT division in the other direction as a candidate, and taking the division mode with the minimum RDO-cost as an optimal division mode. The invention makes a decision on the CU division step by step, accelerates the CU division process through early termination and early skipping, obviously reduces the complexity of CU division and greatly improves the coding efficiency under the condition of ensuring the coding quality.

Description

H.266/VVC rapid CU partition decision method based on gradient and variance
Technical Field
The invention relates to the technical field of image processing, in particular to an H.266/VVC fast CU partition decision method based on gradient and variance.
Background
With the development of multimedia devices and the popularization of high-quality videos, especially after ultra High Definition (HDR) videos are more widely applied, the conventional video coding standard h.265/HEVC can no longer effectively meet the video compression requirements of high quality and low bitrate. In order to meet the requirements of high-quality video application and development, a new generation of video coding standard h.266/VVC is established and gradually perfected, and the huge data volume and coding complexity along with the new generation of video coding standard hinder further development and application of video coding technology.
In order to reduce the complexity of intra-frame prediction in H.266/VVC and improve the coding efficiency on the premise of ensuring almost unchanged video quality, the invention designs a rapid method for partitioning a coding tree unit (CU). CU partitioning is the basis of intra prediction or even the entire video compression coding process. H.266/VV introduces a multi-branch tree partition structure, adds four CU partition modes and adds an asymmetric CU partition structure. CU partitioning evolves from single, fixed partitioning towards flexible partitioning approaches. The evolution of the CU partition structure is beneficial to more accurately partitioning the image structure and more efficiently adapting to image coding and decoding with different resolutions and different characteristics. However, the coding quality is improved, and meanwhile, huge computational complexity is brought, and higher requirements are put forward on coding and decoding. Therefore, when designing fast algorithms, it is often necessary to strike a balance between coding quality and coding efficiency for practical application scenarios or algorithm trends.
Many fast CU partitioning methods have been proposed to speed up the coding process of CU partitioning. All the methods can achieve different degrees of coding time reduction, and simultaneously control the distortion of the compressed video within a certain range. However, these algorithms usually have a significant short board, and often cannot achieve a good balance between coding quality and coding efficiency.
Research on fast CU partitioning methods has been developed. Fan et al propose a gradient method based on texture complexity and a gradient-based preprocessing step to reduce the number of intra mode candidates and make early decisions for CU partitioning. Min et al propose a texture-based fast CU partitioning algorithm, in which the edge complexity of a CU in the vertical, horizontal, 45 ° and 135 ° diagonal directions is used as an important texture feature to determine CU partitioning. Shen uses the temporal and spatial information as conditions for determining the CU depth range. CU depths that are used less frequently will be skipped or terminated early. Ruiz et al propose a direction-based algorithm that utilizes local direction variance along a predetermined line. The direction with the lowest directional variance is considered the dominant direction, so the number of intra mode candidates that require Rate Distortion Optimization (RDO) processing is correspondingly reduced. Wang et al uses the intra prediction mode of the neighboring CU to adaptively select a small set of candidates to enter the RDO process. Lee et al studied the relationship between the impossible mode of the current CU and the distortion distribution of Sub-coding Units (Sub-Code Units, Sub-CUs) to skip or terminate unnecessary partitions. Sun proposes a preprocessing method based on the complexity of the texture extracted from the macroblock and the directional energy distribution along a specific direction. According to the texture complexity, an early termination strategy for CU partition is proposed. Wang et al introduced the Otsu method to measure the texture complexity of each LCU, skipping some CU depth levels according to the texture complexity. Meanwhile, a modified Sobel operator is applied to measure the gradient direction of the PU to reduce some candidate intra modes.
Disclosure of Invention
Aiming at the defects in the background art, the invention provides an H.266/VVC fast CU partition decision method based on gradient and variance, and solves the technical problems of large coding time expenditure and poor rate-distortion control of the existing fast CU partition technology.
The technical scheme of the invention is realized as follows:
a gradient and variance based H.266/VVC fast CU partition decision method comprises the following steps:
the method comprises the following steps: calculating the variance of the current CU, and comparing the variance of the current CU with a set threshold value T h 1, comparing, if the variance of the current CU is less than the threshold value T h 1, the texture of the current CU is homogeneous, the current CU is not divided, and otherwise, the step two is executed;
step two: extracting absolute gradients of all pixels in the current CU and the total gradient of the current CU by using a Sobel operator, and setting a threshold value T h 2 and T h 3, and judging whether the absolute gradient and the total gradient satisfy a threshold value T h 2 and T h 3, if the judgment condition is met, executing a quadtree partitioning mode by the current CU, otherwise, executing a step three;
step three: extracting an edge feature image of the current CU by using a Canny operator, judging whether the texture trend of the current CU is a horizontal texture trend or a vertical texture trend through the edge feature image, if the texture trend of the current CU is the horizontal texture trend, vertically dividing the multi-branch tree into candidate division modes of the current CU, and executing the step four, otherwise, judging that the texture trend of the current CU is the vertical texture trend, horizontally dividing the multi-branch tree into the candidate division modes of the current CU, and executing the step five;
step four: respectively calculating rate distortion optimization loss values of binary tree vertical partitions and ternary tree vertical partitions contained in candidate partition mode multi-branch tree vertical partitions, and selecting the candidate partition mode with the minimum rate distortion optimization loss value as the optimal partition mode of the current CU;
step five: and respectively calculating rate distortion optimization loss values of binary tree horizontal division and ternary tree horizontal division contained in the candidate division mode multi-branch tree horizontal division, and selecting the candidate division mode with the minimum rate distortion optimization loss value as the optimal division mode of the current CU.
The method for calculating the variance of the current CU comprises the following steps:
Figure BDA0002911160100000021
where V is the variance of the current CU, W is the width of the current CU, H is the height of the current CU, μ is the average of all pixels in the current CU, and X (i, j) is the pixel value with coordinates (i, j) in the current CU.
The absolute gradient of all pixels in the current CU is:
Figure BDA0002911160100000031
Figure BDA0002911160100000032
wherein, F x (i, j) is the absolute gradient in the horizontal direction, F y (i, j) is the absolute gradient in the vertical direction, A i,j Is the original pixel matrix centered at coordinate (i, j) with a step size of 3.
The total gradient of the current CU is:
Figure BDA0002911160100000033
Figure BDA0002911160100000034
wherein, F X Total gradient in horizontal direction, F Y Abs (-) is a function of absolute value for the total gradient in the vertical direction.
The threshold T h 2 and T h The judgment condition constituted by 3 is: 1) f X /F Y <T h 2 or F Y /F X <T h 2,2)T h 3<F X and T h 3<F Y
The method for extracting the edge feature image of the current CU by using the Canny operator comprises the following steps:
Figure BDA0002911160100000035
Figure BDA0002911160100000036
wherein ve i Is the texture value in the vertical direction, he i Is a texture value in the horizontal direction, V E For vertical grain trends, H E For horizontal texture trend, can (x, y) represents the pixel value of coordinate (x, y) in the edge feature image of the current CU, max (·) is a maximum function, and min (·) is a minimum function.
Judging condition for judging texture trend of current CU through edge feature image is H E /V E When H is present E /V E <When 1, the texture trend of the current CU is a horizontal texture trend, and when H is E /V E >1, the texture trend of the current CU is a vertical texture trend.
Compared with the prior art, the invention has the following beneficial effects: the method judges the attribute of the texture of the CU by using the variance and gradient characteristics extracted by the Sobel operator and the Canny operator, accordingly divides the dividing process of the CU into three steps which are gradually and progressively advanced, realizes the early termination or skipping of unnecessary dividing modes, effectively reduces the complexity, has almost unchanged Rate Distortion (RD) performance, and achieves good balance between the coding efficiency and the coding quality.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of the present invention;
FIG. 2 is a comparison of the overall coding time savings of the present invention compared to the EQBP, FCPD, FPDS methods;
FIG. 3 is a comparison of the BDBR increase of the present invention with the EQBP, FCPD, FPDS methods;
FIG. 4 shows the comparison result of the overall saving of encoding time and the comparison result of the increase of BDBR compared with the CNN method according to the present invention;
FIG. 5 is a graph comparing the relationship between the rate distortion and the PSNR of the rendering view of the video based on "BQTerace" in the method of the present invention and VTM 7.0;
FIG. 6 is a graph comparing the relationship between the rate distortion and the PSNR of the rendering view of the video based on "Kristen AndSare" in the present invention and VTM7.0 method;
FIG. 7 is a graph comparing rate distortion and PSNR of a rendering view based on PartScene video according to the method of the present invention and VTM 7.0;
FIG. 8 is a graph comparing rate distortion and rendering view PSNR of the present invention and VTM7.0 method based on 'BlowingBubbles' video.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art based on the embodiments of the present invention without inventive step, are within the scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a gradient and variance based h.266/VVC fast CU partition decision method, which uses variance and gradient to determine the properties of CU texture, so as to implement early termination or skipping of unnecessary partition modes, and speed up the CU partition process while ensuring the coding quality. The invention provides three methods, namely early termination of CU partition based on variance, early skip of MT partition based on gradient features extracted by Sobel operators and determination of partition direction based on Canny operators. The method comprises the following specific steps:
the method comprises the following steps: early termination of CU partitioning based on variance. Calculating the variance of the current CU, and comparing the variance of the current CU with a set threshold value T h 1, comparing, if the variance of the current CU is less than the threshold value T h 1, the texture of the current CU is homogeneous, the current CU is not divided, and otherwise, the step two is executed;
and reflecting the performance of the whole texture according to the variance and the gradient, and selecting the variance as an index to evaluate and judge the homogeneity of the current CU. If the current CU is homogeneous, further partitioning of the current CU is terminated. For this purpose, a threshold value T is set h 1, variance of current CU is less than threshold T h When 1, the current CU texture is considered homogeneous, and the five partition modes are terminated early.
The method for calculating the variance of the current CU comprises the following steps:
Figure BDA0002911160100000051
where V is the variance of the current CU, W is the width of the current CU, H is the height of the current CU, μ is the average of all pixels in the current CU, and X (i, j) is the pixel value with coordinates (i, j) in the current CU.
For threshold value T h The choice of 1 is determined by analyzing the test results of 10 different types of video sequences. Obtaining a threshold range according to the test of the VTM7.0 anchor method, and continuously adjusting T in the range h A value of 1 was tested. Found in the test to be either T h How 1 changes within the range has a limited effect on the encoding time. The coding quality is taken as a main reference index for selecting a threshold value, and the point 10QP at which the coding quality starts to be remarkably reduced is selected as T h 1。
Step two: extracting absolute gradients of all pixels in the current CU and the total gradient of the current CU by using a Sobel operator, and setting a threshold value T h 2 and T h 3, and judging whether the absolute gradient and the total gradient satisfy a threshold value T h 2 and T h 3, if the judgment condition is met, executing a Quad Tree (QT) partitioning mode by the current CU, otherwise, executing a third step;
MT partition is skipped early based on gradient features extracted by Sobel operator. And extracting absolute gradients of all pixels in the CU and the total gradient of the current CU by using a Sobel operator, and judging the texture characteristics of the current CU according to the gradient trend.
The absolute gradient of all pixels in the current CU is:
Figure BDA0002911160100000052
Figure BDA0002911160100000053
wherein, F x (i, j) is the absolute gradient in the horizontal direction, F y (i, j) is the absolute gradient in the vertical direction, A i,j Is the original pixel matrix centered at coordinate (i, j) with a step size of 3.
The total gradient of the current CU is:
Figure BDA0002911160100000054
Figure BDA0002911160100000055
wherein, F X Total gradient in horizontal direction, F Y Abs (-) is a function of absolute value for the total gradient in the vertical direction.
Setting two thresholds T h 2 and T h 3, the larger one of the total gradients in the horizontal and vertical directions is used to make a quotient with the other value if the ratio is smaller than T h 2, and the total gradient values in two directions are both greater than T h 3, i.e. satisfies the threshold T h 2 and T h The judgment condition formed by 3 is: 1) f X /F Y <T h 2 or F Y /F X <T h 2,2)T h 3<F X and T h 3<F Y Then QT partition is performed skipping MT partition early.
Threshold value T h 2 and T h The selection method of 3 is as follows: selection of T h Principle of 2 and T h Similarly, considering the execution space of the next step of the algorithm and the frequency of selecting the QT partition, the inflection point 3.5 where the coding quality is significantly deteriorated is selected as T h A value of 2. Different from T h 1 and T h 2,T h 3 represents the requirement of the step on the complexity of the texture of the CU, and the influence on the coding precision is larger. Therefore, the point 33000 with the least BDBR growth is selected as T h A value of 3.
Step three: extracting an edge feature image of the current CU by using a Canny operator, judging whether the texture trend of the current CU is a Horizontal texture trend or a Vertical texture trend through the edge feature image, if the texture trend of the current CU is the Horizontal texture trend, dividing a Multi-Tree Vertical (MT _ V) into candidate division modes of the current CU, and executing a step four, otherwise, if the texture trend of the current CU is the Vertical texture trend, dividing a Multi-Tree Horizontal (MT _ H) into candidate division modes of the current CU, and executing a step five;
a method for block-based Canny operator determination of partition direction. The traditional Canny algorithm is improved, a non-maximum inhibition process and a dual-threshold selection process in the traditional Canny algorithm are eliminated, and isolation inhibition is used for replacing the two key steps. The working steps of the block-based Canny algorithm are as follows:
1) smoothing the input image using gaussian filtering;
2) calculating gradient values and directions of all pixels;
3) setting all contour pixel values with the gray value larger than 20 in the current CU to be 0;
4) the pixel values of no contour pixels within the current CU are set to 0.
The method for extracting the edge feature image of the current CU by using the Canny operator comprises the following steps:
Figure BDA0002911160100000061
Figure BDA0002911160100000062
wherein ve i Is the texture value in the vertical direction, he i Is a texture value in the horizontal direction, V E For vertical grain trends, H E For the horizontal texture tendency, can (x, y) represents the pixel value of the coordinate (x, y) in the edge feature image of the current CU, max (·) is a maximum function, and min (·) is a minimum function.
Judging condition for judging texture trend of current CU through edge feature image is H E /V E When H is present E /V E <When 1, the texture trend of the current CU is a horizontal texture trend, and when H is E /V E >1, the texture trend of the current CU is a vertical texture trend.
Step four: respectively calculating rate-distortion optimization loss values of Binary Tree Vertical (BT _ V) partitions and Ternary Tree Vertical (TT _ V) partitions contained in the candidate partition modes MT _ V, and selecting the candidate partition mode (BT _ V or TT _ V) with the minimum rate-distortion optimization loss value (RDO-cost) as the best partition mode of the current CU;
step five: rate-distortion optimization loss values of Binary Tree level (BT _ H) partitions and Ternary Tree level (TT _ H) partitions contained in the candidate partition pattern MT _ H are calculated, respectively, and the candidate partition pattern (BT _ H or TT _ H) with the smallest rate-distortion optimization loss value is selected as the best partition pattern of the current CU.
To evaluate the performance of the proposed method, the invention tests the experiment on the official encoder VTM7.0, performing a simulation experiment using 6 sets of 13 universal test sequences. These test sequences include 1920 × 1080, 832 × 480, 416 × 240, 1280 × 720 of four different resolutions. The test conditions were as follows: and starting a full frame mode by adopting a general test condition.
The coding performance of the proposed ensemble scheme of the present invention, which can greatly save the coding run time, has a similar RD performance to the original VTM7.0, is listed in table 1. Figure 1 illustrates the workflow of the present invention. Table 2 shows the performance comparison of E, B, C and D four groups of test video sequences with other image feature correlation-based fast CU partitioning methods in the present invention, and the comparison results are visually shown in fig. 2 and fig. 3. As shown in fig. 2 and 3, the present invention is superior to the other three methods in terms of time saving and rate distortion performance, and achieves a good balance between encoding time and encoding quality. Table 3 shows the performance comparison of E, B, C and F test video sequences in the present invention and the CNN-based fast CU partitioning method, and the data results are shown in fig. 4. As shown in fig. 4, the coding time of the present invention is much shorter than that of the CNN method under almost the same rate-distortion premise. Fig. 5, fig. 6, fig. 7, fig. 8 show the RD performance of four representative different resolution video sequences based on "bqtrerace", "KristenAndSara", "PartScene", and "blowingbunbles" in the present invention and VTM7.0, respectively. Compared to VTM7.0, the present invention can achieve consistent runtime savings from a low bit rate range to a high bit rate, and with nearly similar RD performance. In general, the method of the present invention has the best coding time saving, whether for the conventional algorithm based on image feature correlation or for the CNN algorithm, and the average BDBR loss is negligible.
Table 1 encoding results of the present invention and the original encoder
Figure BDA0002911160100000071
Figure BDA0002911160100000081
TABLE 2 coding results of the present invention and other fast CU partition methods based on image feature correlation
Figure BDA0002911160100000082
Table 3 coding results of the present invention and CNN fast method
Figure BDA0002911160100000083
Figure BDA0002911160100000091
The invention uses a fast CU partition decision method based on variance and gradient to gradually analyze and judge the texture attribute of the H.266/VVC current CU and skip unnecessary partition modes, so as to effectively reduce the complexity of the encoder, and simultaneously, the RD performance loss is negligible.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and should not be taken as limiting the scope of the present invention, which is intended to cover any modifications, equivalents, improvements, etc. within the spirit and scope of the present invention.

Claims (4)

1. A gradient and variance based H.266/VVC fast CU partition decision method is characterized by comprising the following steps:
the method comprises the following steps: calculating the variance of the current CU, and comparing the variance of the current CU with a set threshold value T h 1, if the variance of the current CU is less than the threshold value T h 1, the texture of the current CU is homogeneous, the current CU is not divided, and otherwise, the step two is executed;
step two: extracting absolute gradients of all pixels in the current CU and the total gradient of the current CU by using a Sobel operator, and setting a threshold value T h 2 and T h 3, and judging whether the absolute gradient and the total gradient satisfy a threshold value T h 2 and T h 3: 1) f X /F Y <T h 2 or F Y /F X <T h 2,2)T h 3<F X and T h 3<F Y (ii) a If 1) and 2) are simultaneously met, executing a quadtree partitioning mode by the current CU, and otherwise, executing a step three;
the absolute gradient of all pixels in the current CU is:
Figure FDA0003791823470000011
Figure FDA0003791823470000012
wherein, F x (i, j) is the absolute gradient in the horizontal direction, F y (i, j) is the absolute gradient in the vertical direction, A i,j Is an original pixel matrix with coordinates (i, j) as the center and step length of 3;
the total gradient of the current CU is:
Figure FDA0003791823470000013
Figure FDA0003791823470000014
wherein, F X Total gradient in horizontal direction, F Y For the total gradient in the vertical direction, abs (-) is an absolute value function, W represents the width of the current CU, and H represents the height of the current CU;
step three: extracting an edge feature image of the current CU by using a Canny operator, judging whether the texture trend of the current CU is a horizontal texture trend or a vertical texture trend through the edge feature image, if the texture trend of the current CU is the horizontal texture trend, vertically dividing the multi-branch tree into candidate division modes of the current CU, and executing the step four, otherwise, judging that the texture trend of the current CU is the vertical texture trend, horizontally dividing the multi-branch tree into the candidate division modes of the current CU, and executing the step five;
step four: respectively calculating rate distortion optimization loss values of binary tree vertical partitions and ternary tree vertical partitions contained in candidate partition mode multi-branch tree vertical partitions, and selecting the candidate partition mode with the minimum rate distortion optimization loss value as the optimal partition mode of the current CU;
step five: and respectively calculating rate distortion optimization loss values of binary tree horizontal division and ternary tree horizontal division contained in the candidate division mode multi-branch tree horizontal division, and selecting the candidate division mode with the minimum rate distortion optimization loss value as the optimal division mode of the current CU.
2. The gradient and variance based h.266/VVC fast CU partition decision method according to claim 1, wherein the variance of the current CU is calculated by:
Figure FDA0003791823470000021
where V is the variance of the current CU, W is the width of the current CU, H is the height of the current CU, μ is the average of all pixels in the current CU, and X (i, j) is the pixel value with coordinates (i, j) in the current CU.
3. The H.266/VVC fast CU partition decision method based on gradient and variance as claimed in claim 2, wherein the method for extracting the edge feature image of the current CU by Canny operator is:
Figure FDA0003791823470000022
Figure FDA0003791823470000023
wherein ve i Is the texture value in the vertical direction, he i Is a texture value in the horizontal direction, V E For vertical grain trends, H E For horizontal texture trend, can (x, y) represents the pixel value of coordinate (x, y) in the edge feature image of the current CU, max (·) is a maximum function, and min (·) is a minimum function.
4. According to claim 3The H.266/VVC rapid CU division decision method based on gradient and variance is characterized in that the judgment condition for judging the texture trend of the current CU through the edge feature image is H E /V E When H is present E /V E <When 1, the texture trend of the current CU is a horizontal texture trend, and when H is E /V E >1, the texture trend of the current CU is a vertical texture trend.
CN202110086854.6A 2021-01-22 2021-01-22 H.266/VVC rapid CU partition decision method based on gradient and variance Active CN112929657B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110086854.6A CN112929657B (en) 2021-01-22 2021-01-22 H.266/VVC rapid CU partition decision method based on gradient and variance

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110086854.6A CN112929657B (en) 2021-01-22 2021-01-22 H.266/VVC rapid CU partition decision method based on gradient and variance

Publications (2)

Publication Number Publication Date
CN112929657A CN112929657A (en) 2021-06-08
CN112929657B true CN112929657B (en) 2022-09-27

Family

ID=76164602

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110086854.6A Active CN112929657B (en) 2021-01-22 2021-01-22 H.266/VVC rapid CU partition decision method based on gradient and variance

Country Status (1)

Country Link
CN (1) CN112929657B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113691811B (en) * 2021-07-30 2023-03-24 浙江大华技术股份有限公司 Coding block dividing method, device, system and storage medium
CN113747177B (en) * 2021-08-05 2023-06-20 中山大学 Intra-frame coding speed optimization method, device and medium based on historical information

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014190468A1 (en) * 2013-05-27 2014-12-04 Microsoft Corporation Video encoder for images
CN110708551A (en) * 2019-10-22 2020-01-17 腾讯科技(深圳)有限公司 Video encoding method, video encoding device, computer-readable storage medium, and computer apparatus
WO2020130710A1 (en) * 2018-12-21 2020-06-25 한국전자통신연구원 Image encoding/decoding method and device, and recording medium in which bitstream is stored

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9615090B2 (en) * 2012-12-28 2017-04-04 Qualcomm Incorporated Parsing syntax elements in three-dimensional video coding
CN105187826B (en) * 2015-07-31 2018-11-16 郑州轻工业学院 For the fast intra mode decision method of high efficiency video encoding standard
CN110351556B (en) * 2018-04-02 2021-03-02 腾讯科技(北京)有限公司 Method for determining coding cost of coding unit and related device
CN108881904A (en) * 2018-06-25 2018-11-23 中山大学 Quick decision method, device and storage medium in frame based on Sobel operator
CN111147867B (en) * 2019-12-18 2022-10-18 重庆邮电大学 Multifunctional video coding CU partition rapid decision-making method and storage medium
CN111654698B (en) * 2020-06-12 2022-03-22 郑州轻工业大学 Fast CU partition decision method for H.266/VVC

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014190468A1 (en) * 2013-05-27 2014-12-04 Microsoft Corporation Video encoder for images
WO2020130710A1 (en) * 2018-12-21 2020-06-25 한국전자통신연구원 Image encoding/decoding method and device, and recording medium in which bitstream is stored
CN110708551A (en) * 2019-10-22 2020-01-17 腾讯科技(深圳)有限公司 Video encoding method, video encoding device, computer-readable storage medium, and computer apparatus

Also Published As

Publication number Publication date
CN112929657A (en) 2021-06-08

Similar Documents

Publication Publication Date Title
CN112929657B (en) H.266/VVC rapid CU partition decision method based on gradient and variance
CN103297781B (en) A kind of HEVC inner frame coding method based on grain direction, device and system
CN109302610B (en) Fast coding method for screen content coding interframe based on rate distortion cost
KR101516347B1 (en) Method and Apparatus of Intra Coding for HEVC
CN105120292A (en) Video coding intra-frame prediction method based on image texture features
CN109040764B (en) HEVC screen content intra-frame rapid coding algorithm based on decision tree
CN100574447C (en) Fast intraframe predicting mode selecting method based on the AVS video coding
CN108174208B (en) Efficient video coding method based on feature classification
US20150208094A1 (en) Apparatus and method for determining dct size based on transform depth
Mu et al. Fast coding unit depth decision for HEVC
CN112601087B (en) Fast CU splitting mode decision method for H.266/VVC
Ni et al. High efficiency intra CU partition and mode decision method for VVC
Yuan et al. Dynamic computational resource allocation for fast inter frame coding in video conferencing applications
CN113132725A (en) Deblocking filtering optimization method, device, equipment and medium
CN106878754A (en) A kind of 3D video depths image method for choosing frame inner forecast mode
CN114827603A (en) CU block division method, device and medium based on AVS3 texture information
CN111246218B (en) CU segmentation prediction and mode decision texture coding method based on JND model
Gou et al. A novel fast intra algorithm for VVC based on histogram of oriented gradient
Duvar et al. Fast inter mode decision exploiting intra-block similarity in HEVC
Wang et al. Gradient-based fast intra coding decision algorithm for HEVC
CN110035285B (en) Depth prediction method based on motion vector sensitivity
Fan et al. Fast coding unit size decision in HEVC intra coding
CN113709482B (en) Method for determining coding unit division mode in hardware-oriented intra-frame coding mode
CN110958454B (en) Intra-frame prediction method, system and computer readable storage medium
CN111757129B (en) VVC-oriented rapid intra-frame prediction method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant