CN112714314A - Multi-type tree structure block partition mode decision-making early termination method - Google Patents

Multi-type tree structure block partition mode decision-making early termination method Download PDF

Info

Publication number
CN112714314A
CN112714314A CN202011586141.8A CN202011586141A CN112714314A CN 112714314 A CN112714314 A CN 112714314A CN 202011586141 A CN202011586141 A CN 202011586141A CN 112714314 A CN112714314 A CN 112714314A
Authority
CN
China
Prior art keywords
mode
current
partitioning
met
partition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011586141.8A
Other languages
Chinese (zh)
Other versions
CN112714314B (en
Inventor
姚英彪
王娇娇
杜晨杰
徐欣
冯维
许晓荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Dianzi University
Original Assignee
Hangzhou Dianzi University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Dianzi University filed Critical Hangzhou Dianzi University
Priority to CN202011586141.8A priority Critical patent/CN112714314B/en
Publication of CN112714314A publication Critical patent/CN112714314A/en
Application granted granted Critical
Publication of CN112714314B publication Critical patent/CN112714314B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96—Tree coding, e.g. quad-tree coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention discloses a method for deciding and terminating a multi-type tree structure block partition mode in advance, which comprises the following steps: s1, obtaining an optimal decision threshold value by taking the first frame in the image group as a key frame; s2, initializing all selectable partition modes of the current CU; s3, selecting the ith mode from all the selectable dividing modes S as the dividing mode of the current CU; s4, according to the selected mode, carrying out corresponding judgment for horizontal division or vertical division so as to carry out quick partition decision; and S5, correspondingly judging whether the selected mode is binary tree division or ternary tree division so as to carry out quick partition decision. According to the invention, the threshold value is controlled through the first frame of the image group, so that the threshold value is more suitable for the current image frame, unnecessary partition mode prediction is avoided by utilizing the spatial texture information of the image, the calculation complexity of a coding algorithm can be effectively reduced on the premise of ensuring the coding effect, the coding time is greatly saved, and the performance loss of coding is negligible.

Description

Multi-type tree structure block partition mode decision-making early termination method
Technical Field
The invention belongs to the technical field of video compression, and particularly relates to a method for deciding and terminating in advance by a multi-type tree structure block partition mode.
Background
The advent of ultra-high resolution video, such as high definition, ultra-high definition, and 4K video, on the one hand, means that a larger bandwidth is required to transmit video data, and on the other hand, means that a larger storage space is required to store video data. In order to alleviate the resource requirements of video transmission and storage, a video coding standard is used as a common effective means of a video compression technology, and the aim is to improve the video compression ratio to the greatest extent possible under the condition of not reducing the video quality after video decoding. In the development process of video coding standards, new breakthroughs are always sought in the search for innovation, such as MPEG-1, MPEG-2, MPEG-4, H.261, H.263, H.264, H.265 and the like. Currently, the latest version of video is the H.266/VVC (scalable video coding) standard.
In VVC, nested multi-type trees mtt (multiple partition units) and qt (quaternary tree) of Binary Tree (BT) and Ternary Tree (TT) structures are used, and the partition structure of the quaternary tree of hevc (high efficiency video coding) is replaced with a partition method (as shown in fig. 1). The multi-type tree structure comprises four division modes, namely vertical ternary tree division (SPLIT _ TT _ VER), vertical binary tree division (SPLIT _ BT _ VER), horizontal ternary tree division (SPLIT _ TT _ HOR), horizontal binary tree division (SPLIT _ BT _ HOR) and the like. VVC eliminates the difference between cu (coding unit), pu (prediction unit), and tu (transform unit) of HEVC. The MTT structure provides greater flexibility for CU partitioning schemes, but also greatly increases encoder time complexity. Therefore, an effective method is urgently needed to be found to solve the problem of extremely high time complexity in the decision process of the multi-type tree structure block division mode of the VTM.
Disclosure of Invention
In order to solve the problem of extremely high time complexity in the decision process of the multi-type tree structure block division mode of the VTM, the invention discloses an H.266/VVC multi-type tree structure block division mode decision early termination method. The method can effectively reduce the computational complexity of the coding algorithm on the premise of ensuring the coding effect.
The invention adopts the following technical scheme: a multi-type tree structure block partition mode choice early termination method comprises the following steps:
s1, taking the first frame in the image group as a key frame to obtain an optimal decision threshold;
s2, initializing all optional partition MODEs S of the current CU, where all optional partition MODEs S include 4 optional multi-tree block partition MODEs and 1 quad-tree partition MODE, and setting the number MT _ NUM _ MODE of the optional multi-tree block partition MODEs to 4, setting a FAST block partition ENABLE flag bit FAST _ ENABLE of a multi-tree structure to True, where the current CU is a CU in a frame number other than a first frame in the group of pictures;
s3, selecting the ith mode from all the selectable dividing modes S as the dividing mode of the current CU;
s4, judging whether the current CU partition mode is a quadtree partition mode, if so, partitioning by an H.266/VVC reference block partition method, then deleting the current partition mode from all the optional partition modes S, returning to the step S3, and if not, executing the step S5;
s5, determining FAST _ ENABLE as tube or False, if FAST _ ENABLE is False, setting MT _ NUM _ MODE as MT _ NUM _ MODE-1, and partitioning by h.266/VVC reference block partitioning method, then deleting the current partitioning MODE from all selectable partitioning MODEs S, and returning to step S3, if not, executing step S6;
s6, when MT _ NUM _ MODE is 4, executing step S7, and when MT _ NUM _ MODE is 2, executing step S8;
s7, calculating the first characteristic F of the current CU block1And according to F1And is optimizedJudging whether a preset termination condition is met or not by a decision threshold, if so, skipping the current partitioning MODE, deleting the current partitioning MODE from all the selectable partitioning MODEs S and setting MT _ NUM _ MODE to be 2, then returning to the step S3, if not, setting FAST _ ENABLE to be False and MT _ NUM _ MODE to be 3, partitioning by an H.266/VVC reference block partitioning method, then deleting the current partitioning MODE from all the selectable partitioning MODEs S, and returning to the step S3;
s8, setting FAST _ ENABLE to False, MT _ NUM _ MODE to 1, and determining the current partitioning MODE, if the MODE is a horizontal binary tree partitioning MODE or a horizontal ternary tree partitioning MODE, performing step S9, and if the MODE is a vertical binary tree partitioning MODE or a vertical ternary tree partitioning MODE, performing step S10;
s9, calculating a second characteristic F of the current CU block2And according to F2Judging whether the preset termination condition is met with the optimal decision threshold, if yes, skipping the current division mode, deleting the current division mode from all the selectable division modes S, returning to the step S3, if not, dividing by using an H.266/VVC reference block division method, then deleting the current division mode from all the selectable division modes S, and returning to the step S3;
s10, calculating a third feature F of the current CU block3And according to F3And judging whether the preset termination condition is met with the optimal decision threshold, if so, skipping the current division mode, deleting the current division mode from all the optional division modes S, returning to the step S3, if not, dividing by using an H.266/VVC reference block division method, then deleting the current division mode from all the optional division modes S, and returning to the step S3.
Preferably, in step S2, the 4 selectable multi-way tree block division modes are: SPLIT _ TT _ VER, SPLIT _ BT _ VER, SPLIT _ TT _ HOR and SPLIT _ BT _ HOR, wherein SPLIT _ TT _ VER is a vertical ternary tree division mode, SPLIT _ BT _ VER is a vertical binary tree division mode, SPLIT _ TT _ HOR is a horizontal ternary tree division mode, and SPLIT _ BT _ HOR is a horizontal binary tree division mode.
Preferably, in step S1, the step of taking the first frame in the image group as a key frame to obtain the optimal decision threshold specifically includes the following steps:
s1.1, dividing all CUs in the key frame by an H.266/VVC reference block dividing method;
s1.2, judging which division mode all CUs in the key frame are finally divided into, and if the division mode is SPLIT _ TT _ HOR, calculating the characteristic F1And F2And respectively stored in corresponding lists T12_ buf and T21_ buf; if the partition mode is SPLIT _ BT _ HOR, the feature F is calculated1And F2And respectively stored in the lists T12_ buf and T22_ buf; if the partition mode is SPLIT _ TT _ VER, the feature F is calculated1And F3And respectively stored in the lists T11_ buf and T31_ buf; if the partition mode is SPLIT _ BT _ VER, the feature F is calculated1And F3And respectively stored in the lists T11_ buf and T32_ buf;
s1.3, setting an optimal decision threshold T according to the following formulai1、Ti2，i＝1,2,3：
Tij＝(TH_Tij_buf_High+TH_Tij_buf_Low)/2，
Wherein TH _ TijBuf _ High and TH _ TijBuf _ Low is the maximum and minimum of the list Tij _ buf, respectively.
Preferably, in step S7, the first feature F is calculated according to the spatial feature FsobelX and the spatial feature FsobelY of the current CU block1The calculation formulas of the spatial feature FsobelX and the spatial feature FsobelY are as follows:
Figure BDA0002866096740000041
Figure BDA0002866096740000042
where f (i, j) represents the pixel value at location (i, j), and H and W are the height and width of the CU;
first feature F1The calculation formula of (a) is as follows:
F1＝FsobelX/FsobelY。
preferably, in step S7, the method is according to F1And judging whether the preset termination condition is met with the optimal decision threshold, and specifically comprising the following steps of:
s7.1, judging a current partitioning mode, performing the step S7.2 when the current partitioning mode is a horizontal partitioning mode, and performing the step S7.3 when the current partitioning mode is a vertical partitioning mode, wherein the horizontal partitioning mode comprises a horizontal binary tree partitioning mode and a horizontal ternary tree partitioning mode, and the vertical partitioning mode comprises a vertical binary tree partitioning mode and a vertical ternary tree partitioning mode;
s7.2, judgment F1＞T11If the result is true, the preset termination condition is met, and if the result is false, the preset termination condition is not met;
s7.3, judgment F1＜T12And if the condition is not met, the preset termination condition is met, and if the condition is not met, the preset termination condition is not met.
Preferably, in step S9, the spatial features F are divided according to a horizontal binary tree of the current CU blockBHAnd spatial features F of horizontal treelet partitioningTHCalculating a second feature F2Wherein:
spatial feature F of horizontal binary tree partitioning of current CU blockBHThe calculation method is as follows: dividing a luminance CU with the size of H multiplied by W into two horizontal sub-blocks with the area ratio of 1:1, and then calculating the spatial characteristics F of the horizontal binary tree division of the current luminance CU block according to the following formulaBH：
Figure BDA0002866096740000051
Spatial feature F of horizontal treeing partition of current CU blockTHThe calculation method is as follows: dividing a luminance CU with the size of H multiplied by W into three horizontal sub-blocks with the area ratio of 1:2:1, and then calculating the spatial characteristics F of the horizontal ternary tree division of the current luminance CU block according to the following formulaTH：
Figure BDA0002866096740000052
Where f (i, j) represents the pixel value at location (i, j), and H and W are the height and width of the CU;
second characteristic F2The calculation formula of (2) is as follows: f2＝FBH/FTH。
Preferably, in step S9, the method is according to F2And judging whether the preset termination condition is met with the optimal decision threshold, and specifically comprising the following steps of:
s9.1, judging a current partitioning mode, and performing the step S9.2 when the current partitioning mode is a horizontal binary tree partitioning mode, and performing the step S10.3 when the current partitioning mode is a horizontal ternary tree partitioning mode;
s9.2, judgment F2＞T21If the result is true, the preset termination condition is met, and if the result is false, the preset termination condition is not met;
s9.3, judgment F2＜T22And if the condition is not met, the preset termination condition is met, and if the condition is not met, the preset termination condition is not met.
Preferably, in step S10, the spatial feature F is divided according to a vertical binary tree of the current CU blockBVAnd spatial features F of vertical treble partitioningTVCalculating a third feature F3Wherein:
spatial feature F of vertical binary tree partitioning of current CU blockBVThe calculation method is as follows: dividing a luminance CU with the size of H multiplied by W into two vertical sub-blocks with the area ratio of 1:1, and then calculating the vertical binary tree division spatial feature F of the luminance CU block according to the following formulaBV：
Figure BDA0002866096740000061
Spatial feature F of vertical treeing partition of current CU blockTVThe calculation method is as follows: dividing a luminance CU with the size of H multiplied by W into three vertical sub-blocks with the area ratio of 1:2:1, and then calculating the vertical ternary tree division spatial characteristic F of the luminance CU according to the following formulaTV：
Figure BDA0002866096740000062
Where f (i, j) represents the pixel value at position (i, j), and H and W are the height and width of the luminance CU.
Preferably, in step S10, the third feature F3The calculation formula of (2) is as follows: f3＝FBV/FTV。
Preferably, in step S10, the method is according to F3And judging whether the preset termination condition is met with the optimal decision threshold, and specifically comprising the following steps of:
s10.1, judging a current partitioning mode, and performing the step S10.2 when the partitioning mode is a vertical binary tree partitioning mode, and performing the step S10.3 when the partitioning mode is a vertical ternary tree partitioning mode;
s10.2, judgment F3＞T31If the result is true, the preset termination condition is met, and if the result is false, the preset termination condition is not met;
s10.3, judgment F3＜T32And if the condition is not met, the preset termination condition is met, and if the condition is not met, the preset termination condition is not met.
The invention has the beneficial effects that: the first part makes a corresponding judgment for horizontal partitioning or vertical partitioning according to the selected mode to make a fast partitioning decision. And the second part carries out corresponding judgment according to whether the selected mode is binary tree division or ternary tree division so as to carry out quick partitioning decision. The threshold value is controlled through the first frame of the GOP, so that the threshold value is more suitable for the current image frame. By utilizing the spatial texture information of the image, unnecessary partition mode prediction is avoided, the coding time is greatly saved, and the performance loss of coding is negligible.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of a multi-type tree structure block partition mode decision early termination method;
FIG. 2 is a schematic diagram of a VVC block partitioning scheme;
FIG. 3 is a schematic diagram of the alternation of a threshold calculation phase and a fast partitioning phase;
FIG. 4 is a schematic diagram of horizontal spatial feature partitioning;
FIG. 5 is a schematic diagram of a vertical spatial feature partitioning approach;
Detailed Description
The following description of the embodiments of the present invention is provided by way of specific examples, and other advantages and effects of the present invention will be readily apparent to those skilled in the art from the disclosure herein. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
Referring to fig. 2, 5 CU block partition structures of h.266/VVC are shown, and are composed of 1 quadtree, 2 binary trees, and 2 ternary trees, where the 2 binary trees and the 2 ternary trees are the multiple-branch tree partition modes to be selected according to the present invention. The 4 optional multi-way tree block division modes are respectively as follows: SPLIT _ TT _ VER, SPLIT _ BT _ VER, SPLIT _ TT _ HOR and SPLIT _ BT _ HOR, wherein SPLIT _ TT _ VER is a vertical ternary tree division mode, SPLIT _ BT _ VER is a vertical binary tree division mode, SPLIT _ TT _ HOR is a horizontal ternary tree division mode, and SPLIT _ BT _ HOR is a horizontal binary tree division mode. The quadtree partitioning pattern is SPLIT _ QT.
Referring to fig. 1, the present embodiment provides a method for deciding and terminating a multi-type tree structure block partition mode in advance, including the steps of:
s1, taking the first frame in the image group as a key frame to obtain an optimal decision threshold;
s2, initializing all optional partition MODEs S of the current CU, where all optional partition MODEs S include 4 optional multi-tree block partition MODEs and 1 quad-tree partition MODE, and setting the number MT _ NUM _ MODE of the optional multi-tree block partition MODEs to 4, setting a FAST block partition ENABLE flag bit FAST _ ENABLE of a multi-tree structure to True, where the current CU is a CU in a frame number other than a first frame in the group of pictures;
s3, selecting the ith mode from all the selectable dividing modes S as the dividing mode of the current CU;
s4, judging whether the current CU partition mode is a quadtree partition mode, if so, partitioning by an H.266/VVC reference block partition method, then deleting the current partition mode from all the optional partition modes S, returning to the step S3, and if not, executing the step S5;
s5, determining FAST _ ENABLE as tube or False, if FAST _ ENABLE is False, setting MT _ NUM _ MODE as MT _ NUM _ MODE-1, and partitioning by h.266/VVC reference block partitioning method, then deleting the current partitioning MODE from all selectable partitioning MODEs S, and returning to step S3, if not, executing step S6;
s6, when MT _ NUM _ MODE is 4, executing step S7, and when MT _ NUM _ MODE is 2, executing step S8;
s7, calculating the first characteristic F of the current CU block1And according to F1Judging whether preset termination conditions are met with the optimal decision threshold, if yes, skipping the current partitioning MODE, deleting the current partitioning MODE from all the selectable partitioning MODEs S and setting MT _ NUM _ MODE to be 2, then returning to the step S3, if not, setting FAST _ ENABLE to be False and MT _ NUM _ MODE to be 3, partitioning by an H.266/VVC reference block partitioning method, then deleting the current partitioning MODE from all the selectable partitioning MODEs S, and returning to the step S3;
s8, setting FAST _ ENABLE to False, MT _ NUM _ MODE to 1, and determining the current partitioning MODE, if the MODE is a horizontal binary tree partitioning MODE or a horizontal ternary tree partitioning MODE, performing step S9, and if the MODE is a vertical binary tree partitioning MODE or a vertical ternary tree partitioning MODE, performing step S10;
s9, calculating a second characteristic F of the current CU block2And according to F2Judging whether the optimal decision threshold value meets the preset termination condition, if so, judging whether the optimal decision threshold value meets the preset termination conditionSkipping the current division mode, deleting the current division mode from all the selectable division modes S, returning to the step S3, if not, dividing by using the H.266/VVC reference block division method, then deleting the current division mode from all the selectable division modes S, and returning to the step S3;
s10, calculating a third feature F of the current CU block3And according to F3And judging whether the preset termination condition is met with the optimal decision threshold, if so, skipping the current division mode, deleting the current division mode from all the optional division modes S, returning to the step S3, if not, dividing by using an H.266/VVC reference block division method, then deleting the current division mode from all the optional division modes S, and returning to the step S3.
Specifically, the method comprises the following steps:
referring to fig. 3, in step S1, the step of using the first frame in the image group as a key frame to obtain the optimal decision threshold specifically includes the following steps:
s1.1, dividing all CUs in the key frame by an H.266/VVC reference block dividing method;
s1.2, judging which division mode all CUs in the key frame are finally divided into, and if the division mode is SPLIT _ TT _ HOR, calculating the characteristic F1And F2And respectively stored in corresponding lists T12_ buf and T21_ buf; if the partition mode is SPLIT _ BT _ HOR, the feature F is calculated1And F2And respectively stored in the lists T12_ buf and T22_ buf; if the partition mode is SPLIT _ TT _ VER, the feature F is calculated1And F3And respectively stored in the lists T11_ buf and T31_ buf; if the partition mode is SPLIT _ BT _ VER, the feature F is calculated1And F3And are stored in the lists T11_ buf and T32_ buf, respectively, as shown in table 1 below:
TABLE 1 partitioning method selected by CU and FiCorrespondence table for calculation and buffer
Block division mode Computing features Correspondence list Computing features Correspondence list
SPLIT_TT_HOR F1 T12_buf F2 T21_buf
SPLIT_BT_HOR F1 T12_buf F2 T22_buf
SPLIT_TT_VER F1 T11_buf F3 T31_buf
SPLIT_BT_VER F1 T11_buf F3 T32_buf
S1.3, setting an optimal decision threshold T according to the following formulai1、Ti2，i＝1,2,3：
Tij＝(TH_Tij_buf_High+TH_Tij_buf_Low)/2，
Wherein TH _ TijBuf _ High and TH _ TijBuf _ Low is the maximum and minimum of the list Tij _ buf, respectively.
Specifically, the threshold value T11、T12、T21、T22、T31、T32The calculation method of (c) is as follows:
T11＝(TH_T11_buf_High+TH_T11_buf_Low)/2
T12＝(TH_T12_buf_High+TH_T12_buf_Low)/2
T21＝(TH_T21_buf_High+TH_T21_buf_Low)/2
T22＝(TH_T22_buf_High+TH_T22_buf_Low)/2
T31＝(TH_T31_buf_High+TH_T31_buf_Low)/2
T32＝(TH_T32_buf_High+TH_T32_buf_Low)/2。
in step S7, a first feature F is calculated according to the spatial feature FsobelX and the spatial feature FsobelY of the current CU block1The calculation formulas of the spatial feature FsobelX and the spatial feature FsobelY are as follows:
Figure BDA0002866096740000111
Figure BDA0002866096740000112
where f (i, j) represents the pixel value at location (i, j), and H and W are the height and width of the CU;
first feature F1The calculation formula of (a) is as follows:
F1＝FsobelX/FsobelY。
in step S7, the method according to F1And judging whether the preset termination condition is met with the optimal decision threshold, and specifically comprising the following steps of:
s7.1, judging a current partitioning mode, performing the step S7.2 when the current partitioning mode is a horizontal partitioning mode, and performing the step S7.3 when the current partitioning mode is a vertical partitioning mode, wherein the horizontal partitioning mode comprises a horizontal binary tree partitioning mode and a horizontal ternary tree partitioning mode, and the vertical partitioning mode comprises a vertical binary tree partitioning mode and a vertical ternary tree partitioning mode;
s7.2, judgment F1＞T11If the result is true, the preset termination condition is met, and if the result is false, the preset termination condition is not met;
s7.3, judgment F1＜T12And if the condition is not met, the preset termination condition is met, and if the condition is not met, the preset termination condition is not met.
In step S9, the spatial features F are divided according to the horizontal binary tree of the current CU blockBHAnd spatial features F of horizontal treelet partitioningTHCalculating a second feature F2Wherein:
spatial feature F of horizontal binary tree partitioning of current CU blockBHThe calculation method is as follows: dividing a luminance CU of size H × W into two horizontal sub-blocks with an area ratio of 1:1 (see fig. 4 (a)), and then calculating a spatial feature F of horizontal binary tree division of the current luminance CU block according to the following formulaBH：
Figure BDA0002866096740000121
Spatial feature F of horizontal treeing partition of current CU blockTHThe calculation method is as follows: dividing a luminance CU of size H × W into three horizontal sub-blocks with an area ratio of 1:2:1 (see fig. 4 (b)), and then calculating a spatial feature F of horizontal treeing division of the current luminance CU block according to the following equationTH：
Figure BDA0002866096740000122
Where f (i, j) represents the pixel value at location (i, j), and H and W are the height and width of the CU;
second characteristic F2The calculation formula of (2) is as follows: f2＝FBH/FTH。
In step S9, the method according to F2And judging whether the preset termination condition is met with the optimal decision threshold, and specifically comprising the following steps of:
s9.1, judging a current partitioning mode, and performing the step S9.2 when the current partitioning mode is a horizontal binary tree partitioning mode, and performing the step S10.3 when the current partitioning mode is a horizontal ternary tree partitioning mode;
s9.2, judgment F2＞T21If the result is true, the preset termination condition is met, and if the result is false, the preset termination condition is not met;
s9.3, judgment F2＜T22And if the condition is not met, the preset termination condition is met, and if the condition is not met, the preset termination condition is not met.
In step S10, the spatial features F are divided according to the vertical binary tree of the current CU blockBVAnd spatial features F of vertical treble partitioningTVCalculating a third feature F3Wherein:
spatial feature F of vertical binary tree partitioning of current CU blockBVThe calculation method is as follows: dividing the luminance CU with size H × W into two vertical sub-blocks with area ratio of 1:1 (see fig. 5 (a)), and then calculating the vertical binary tree partition spatial feature F of the luminance CU block according to the following formulaBV：
Figure BDA0002866096740000131
Spatial feature F of vertical treeing partition of current CU blockTVThe calculation method is as follows: dividing the luminance CU with size H × W into three vertical sub-blocks with area ratio of 1:2:1 (see fig. 5 (b)), and calculating the vertical trifurcations of the luminance CU blocks according to the following formulaTree partition spatial feature FTV：
Figure BDA0002866096740000132
Where f (i, j) represents the pixel value at position (i, j), and H and W are the height and width of the luminance CU.
Third feature F3The calculation formula of (2) is as follows: f3＝FBV/FTV。
In step S10, the method according to F3And judging whether the preset termination condition is met with the optimal decision threshold, and specifically comprising the following steps of:
s10.1, judging a current partitioning mode, and performing the step S10.2 when the partitioning mode is a vertical binary tree partitioning mode, and performing the step S10.3 when the partitioning mode is a vertical ternary tree partitioning mode;
s10.2, judgment F3＞T31If the result is true, the preset termination condition is met, and if the result is false, the preset termination condition is not met;
s10.3, judgment F3＜T32And if the condition is not met, the preset termination condition is met, and if the condition is not met, the preset termination condition is not met.
The experimental result shows that compared with the VTM5.0 (a VVC reference model), the coding time of the algorithm provided by the invention is greatly shortened (about 45% on average), the coding bit Rate BD-Rate is only slightly increased (about 1.3% on average), and the computational complexity of the coding algorithm can be effectively reduced on the premise of ensuring the coding effect.
The above-mentioned embodiments are merely illustrative of the preferred embodiments of the present invention, and do not limit the scope of the present invention, and various modifications and improvements of the technical solutions of the present invention by those skilled in the art should fall within the protection scope of the present invention without departing from the design spirit of the present invention.

Claims (10)

1. A multi-type tree structure block partition mode decision early termination method is characterized by comprising the following steps:
s1, taking the first frame in the image group as a key frame to obtain an optimal decision threshold;
s2, initializing all optional partition MODEs S of the current CU, where all optional partition MODEs S include 4 optional multi-tree block partition MODEs and 1 quad-tree partition MODE, and setting the number MT _ NUM _ MODE of the optional multi-tree block partition MODEs to 4, setting a FAST block partition ENABLE flag bit FAST _ ENABLE of a multi-tree structure to True, where the current CU is a CU in a frame number other than a first frame in the group of pictures;
s3, selecting the ith mode from all the selectable dividing modes S as the dividing mode of the current CU;
s4, judging whether the current CU partition mode is a quadtree partition mode, if so, partitioning by an H.266/VVC reference block partition method, then deleting the current partition mode from all the optional partition modes S, returning to the step S3, and if not, executing the step S5;
s5, determining FAST _ ENABLE as tube or False, if FAST _ ENABLE is False, setting MT _ NUM _ MODE as MT _ NUM _ MODE-1, and partitioning by h.266/VVC reference block partitioning method, then deleting the current partitioning MODE from all selectable partitioning MODEs S, and returning to step S3, if not, executing step S6;
s6, when MT _ NUM _ MODE is 4, executing step S7, and when MT _ NUM _ MODE is 2, executing step S8;
s7, calculating the first characteristic F of the current CU block1And according to F1Judging whether preset termination conditions are met with the optimal decision threshold, if yes, skipping the current partitioning MODE, deleting the current partitioning MODE from all the selectable partitioning MODEs S and setting MT _ NUM _ MODE to be 2, then returning to the step S3, if not, setting FAST _ ENABLE to be False and MT _ NUM _ MODE to be 3, partitioning by an H.266/VVC reference block partitioning method, then deleting the current partitioning MODE from all the selectable partitioning MODEs S, and returning to the step S3;
s8, setting FAST _ ENABLE to False, MT _ NUM _ MODE to 1, and determining the current partitioning MODE, if the MODE is a horizontal binary tree partitioning MODE or a horizontal ternary tree partitioning MODE, performing step S9, and if the MODE is a vertical binary tree partitioning MODE or a vertical ternary tree partitioning MODE, performing step S10;
s9, calculating a second characteristic F of the current CU block2And according to F2Judging whether the preset termination condition is met with the optimal decision threshold, if yes, skipping the current division mode, deleting the current division mode from all the selectable division modes S, returning to the step S3, if not, dividing by using an H.266/VVC reference block division method, then deleting the current division mode from all the selectable division modes S, and returning to the step S3;
s10, calculating a third feature F of the current CU block3And according to F3And judging whether the preset termination condition is met with the optimal decision threshold, if so, skipping the current division mode, deleting the current division mode from all the optional division modes S, returning to the step S3, if not, dividing by using an H.266/VVC reference block division method, then deleting the current division mode from all the optional division modes S, and returning to the step S3.
2. The method for multi-type tree structure block partition mode decision early termination according to claim 1, wherein in step S2, the 4 selectable multi-way tree block partition modes are: SPLIT _ TT _ VER, SPLIT _ BT _ VER, SPLIT _ TT _ HOR and SPLIT _ BT _ HOR, wherein SPLIT _ TT _ VER is a vertical ternary tree division mode, SPLIT _ BT _ VER is a vertical binary tree division mode, SPLIT _ TT _ HOR is a horizontal ternary tree division mode, and SPLIT _ BT _ HOR is a horizontal binary tree division mode.
3. The multi-type tree structure block partition mode decision early termination method according to claim 2, wherein in step S1, the step of using the first frame in the image group as a key frame to obtain the optimal decision threshold specifically comprises the following steps:
s1.1, dividing all CUs in the key frame by an H.266/VVC reference block dividing method;
s1.2, judging which division mode all CUs in the key frame are finally divided into, and if the division mode is SPLIT _ TT _ HOR, calculating the characteristic F1And F2And respectively stored in corresponding lists T12_ buf and T21_ buf;if the partition mode is SPLIT _ BT _ HOR, the feature F is calculated1And F2And respectively stored in the lists T12_ buf and T22_ buf; if the partition mode is SPLIT _ TT _ VER, the feature F is calculated1And F3And respectively stored in the lists T11_ buf and T31_ buf; if the partition mode is SPLIT _ BT _ VER, the feature F is calculated1And F3And respectively stored in the lists T11_ buf and T32_ buf;
s1.3, setting an optimal decision threshold T according to the following formulai1、Ti2，i＝1,2,3：
Tij＝(TH_Tij_buf_High+TH_Tij_buf_Low)/2，
Wherein TH _ TijBuf _ High and TH _ TijBuf _ Low is the maximum and minimum of the list Tij _ buf, respectively.
4. The method of claim 3, wherein the deciding of the early termination according to the multi-type tree structure block partition mode in step S7 is based on the spatial feature F of the current CU blocksobelXAnd spatial feature FsobelYCalculating a first feature F1Wherein the spatial feature FsobelXAnd spatial feature FsobelYThe calculation formula of (a) is as follows:
Figure FDA0002866096730000031
Figure FDA0002866096730000032
where f (i, j) represents the pixel value at location (i, j), and H and W are the height and width of the CU;
first feature F1The calculation formula of (a) is as follows:
F1＝FsobelX/FsobelY。
5. the multi-type tree structure block partitioning pattern decision making early termination according to claim 4Method, characterized in that in step S7, said method is according to F1And judging whether the preset termination condition is met with the optimal decision threshold, and specifically comprising the following steps of:
s7.1, judging a current partitioning mode, performing the step S7.2 when the current partitioning mode is a horizontal partitioning mode, and performing the step S7.3 when the current partitioning mode is a vertical partitioning mode, wherein the horizontal partitioning mode comprises a horizontal binary tree partitioning mode and a horizontal ternary tree partitioning mode, and the vertical partitioning mode comprises a vertical binary tree partitioning mode and a vertical ternary tree partitioning mode;
s7.2, judgment F1＞T11If the result is true, the preset termination condition is met, and if the result is false, the preset termination condition is not met;
s7.3, judgment F1＜T12And if the condition is not met, the preset termination condition is met, and if the condition is not met, the preset termination condition is not met.
6. The multi-type tree structure block partition mode decision early termination method according to claim 3, wherein in step S9, the spatial feature F is divided according to the horizontal binary tree of the current CU blockBHAnd spatial features F of horizontal treelet partitioningTHCalculating a second feature F2Wherein:
spatial feature F of horizontal binary tree partitioning of current CU blockBHThe calculation method is as follows: dividing a luminance CU with the size of H multiplied by W into two horizontal sub-blocks with the area ratio of 1:1, and then calculating the spatial characteristics F of the horizontal binary tree division of the current luminance CU block according to the following formulaBH：
Figure FDA0002866096730000041
Spatial feature F of horizontal treeing partition of current CU blockTHThe calculation method is as follows: dividing a luminance CU with the size of H multiplied by W into three horizontal sub-blocks with the area ratio of 1:2:1, and then calculating the spatial characteristics F of the horizontal ternary tree division of the current luminance CU block according to the following formulaTH：
Figure FDA0002866096730000042
Where f (i, j) represents the pixel value at location (i, j), and H and W are the height and width of the CU;
second characteristic F2The calculation formula of (2) is as follows: f2＝FBH/FTH。
7. The multi-type tree structure block partition mode decision early termination method according to claim 6, characterized in that in step S9, the decision according to F2And judging whether the preset termination condition is met with the optimal decision threshold, and specifically comprising the following steps of:
s9.1, judging a current partitioning mode, and performing the step S9.2 when the current partitioning mode is a horizontal binary tree partitioning mode, and performing the step S10.3 when the current partitioning mode is a horizontal ternary tree partitioning mode;
s9.2, judgment F2＞T21If the result is true, the preset termination condition is met, and if the result is false, the preset termination condition is not met;
s9.3, judgment F2＜T22And if the condition is not met, the preset termination condition is met, and if the condition is not met, the preset termination condition is not met.
8. The multi-type tree structure block partition mode decision early termination method according to claim 3, wherein in step S10, the spatial feature F is the spatial feature of the vertical binary tree partition according to the current CU blockBVAnd spatial features F of vertical treble partitioningTVCalculating a third feature F3Wherein:
spatial feature F of vertical binary tree partitioning of current CU blockBVThe calculation method is as follows: dividing a luminance CU with the size of H multiplied by W into two vertical sub-blocks with the area ratio of 1:1, and then calculating the vertical binary tree division spatial feature F of the luminance CU block according to the following formulaBV：
Figure FDA0002866096730000051
Spatial feature F of vertical treeing partition of current CU blockTVThe calculation method is as follows: dividing a luminance CU with the size of H multiplied by W into three vertical sub-blocks with the area ratio of 1:2:1, and then calculating the vertical ternary tree division spatial characteristic F of the luminance CU according to the following formulaTV：
Figure FDA0002866096730000052
Where f (i, j) represents the pixel value at position (i, j), and H and W are the height and width of the luminance CU.
9. The multi-type tree structure block partition mode decision early termination method according to claim 8, wherein in step S10, the third feature F3The calculation formula of (2) is as follows: f3＝FBV/FTV。
10. The method of deciding on early termination according to the multi-type tree structure block partition mode of claim 9, wherein in step S10, the method decides according to F3And judging whether the preset termination condition is met with the optimal decision threshold, and specifically comprising the following steps of:
s10.1, judging a current partitioning mode, and performing the step S10.2 when the partitioning mode is a vertical binary tree partitioning mode, and performing the step S10.3 when the partitioning mode is a vertical ternary tree partitioning mode;
s10.2, judgment F3＞T31If the result is true, the preset termination condition is met, and if the result is false, the preset termination condition is not met;
s10.3, judgment F3＜T32And if the condition is not met, the preset termination condition is met, and if the condition is not met, the preset termination condition is not met.
CN202011586141.8A 2020-12-28 2020-12-28 Multi-type tree structure block partition mode decision-making early termination method Active CN112714314B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011586141.8A CN112714314B (en) 2020-12-28 2020-12-28 Multi-type tree structure block partition mode decision-making early termination method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011586141.8A CN112714314B (en) 2020-12-28 2020-12-28 Multi-type tree structure block partition mode decision-making early termination method

Publications (2)

Publication Number Publication Date
CN112714314A true CN112714314A (en) 2021-04-27
CN112714314B CN112714314B (en) 2022-07-26

Family

ID=75545978

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011586141.8A Active CN112714314B (en) 2020-12-28 2020-12-28 Multi-type tree structure block partition mode decision-making early termination method

Country Status (1)

Country Link
CN (1) CN112714314B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113542753A (en) * 2021-07-27 2021-10-22 杭州当虹科技股份有限公司 AVS3 video coding method and encoder
WO2023005709A1 (en) * 2021-07-28 2023-02-02 腾讯科技（深圳）有限公司 Video encoding method and apparatus, medium, and electronic device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160261861A1 (en) * 2015-03-06 2016-09-08 Qualcomm Incorporated Adaptive mode checking order for video encoding
CN111147867A (en) * 2019-12-18 2020-05-12 重庆邮电大学 Multifunctional video coding CU partition rapid decision-making method and storage medium
CN111246219A (en) * 2020-01-17 2020-06-05 南华大学 Quick dividing method for depth of CU (Central Unit) in VVC (variable valve timing) frame
CN111818332A (en) * 2020-06-09 2020-10-23 复旦大学 Fast algorithm for intra-frame prediction partition judgment suitable for VVC standard
CN112104868A (en) * 2020-11-05 2020-12-18 电子科技大学 Quick decision-making method for VVC intra-frame coding unit division

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160261861A1 (en) * 2015-03-06 2016-09-08 Qualcomm Incorporated Adaptive mode checking order for video encoding
CN111147867A (en) * 2019-12-18 2020-05-12 重庆邮电大学 Multifunctional video coding CU partition rapid decision-making method and storage medium
CN111246219A (en) * 2020-01-17 2020-06-05 南华大学 Quick dividing method for depth of CU (Central Unit) in VVC (variable valve timing) frame
CN111818332A (en) * 2020-06-09 2020-10-23 复旦大学 Fast algorithm for intra-frame prediction partition judgment suitable for VVC standard
CN112104868A (en) * 2020-11-05 2020-12-18 电子科技大学 Quick decision-making method for VVC intra-frame coding unit division

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113542753A (en) * 2021-07-27 2021-10-22 杭州当虹科技股份有限公司 AVS3 video coding method and encoder
CN113542753B (en) * 2021-07-27 2022-07-08 杭州当虹科技股份有限公司 AVS3 video coding method and encoder
WO2023005709A1 (en) * 2021-07-28 2023-02-02 腾讯科技（深圳）有限公司 Video encoding method and apparatus, medium, and electronic device

Also Published As

Publication number Publication date
CN112714314B (en) 2022-07-26

Similar Documents

Publication Publication Date Title
US11770556B2 (en) Method and apparatus for processing intra prediction mode
CN110572659B (en) Flexible tree
WO2020253828A1 (en) Coding and decoding method and device, and storage medium
TW202025777A (en) Ultimate motion vector expression based pruning for video coding
JP2005184857A (en) Method and system for estimation, transmission, and formation in picture intra-prediction mode
CN112714314B (en) Multi-type tree structure block partition mode decision-making early termination method
WO2023065891A1 (en) Multimedia data processing method and apparatus, device, computer-readable storage medium and computer program product
CN113170212A (en) Decoding method, device and system with merging mode
CN117793359A (en) Video encoding and decoding method, computer readable storage medium, and data transmission method
WO2020143585A1 (en) Video encoder, video decoder, and corresponding method
CN111903123B (en) Image processing method based on inter prediction mode and apparatus therefor
CN114885172A (en) Fast coding unit dividing method for H.266/VVC intra-frame prediction coding
CN114205629A (en) Constrained coding tree for video coding
EP4111690A1 (en) Signaling constraints and sequence parameter set sharing in video coding
CN114071158A (en) Motion information list construction method, device and equipment in video coding and decoding
WO2024104503A1 (en) Image coding and decoding
WO2020108168A9 (en) Video image prediction method and device
CN104954806A (en) Intra-frame video optimization coding method
WO2016142977A1 (en) Video image encoding device, video image encoding method and video image encoding program
TW202234886A (en) Adaptive loop filter with fixed filters
KR20230162988A (en) Multimedia data processing methods and apparatus, computer devices, and computer-readable storage media
CN114079788A (en) Motion information list construction method, device and equipment in video coding and decoding

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant