WO2021056211A1

WO2021056211A1 - Video coding and decoding methods and apparatuses, and electronic device

Info

Publication number: WO2021056211A1
Application number: PCT/CN2019/107597
Authority: WO
Inventors: 蔡文婷; 朱建清
Original assignee: 富士通株式会社; 蔡文婷; 朱建清
Priority date: 2019-09-24
Filing date: 2019-09-24
Publication date: 2021-04-01

Abstract

Video coding and decoding methods and apparatuses, and an electronic device. The coding method comprises: for a chrominance coding unit whose size is equal to a virtual pipeline data unit (VPDU), coding a chrominance coding unit split flag (split_chroma_cu_flag); when the value of the chrominance coding unit split flag is 1, performing quaternary tree split on the chrominance coding unit and a luminance coding unit corresponding to the chrominance coding unit; and when the value of the chrominance coding unit split flag is 0, performing quaternary tree split on the luminance coding unit corresponding to the chrominance coding unit but not performing the split on the chrominance coding unit.

Description

Video encoding and decoding method and device, electronic equipment

Technical field

The present invention relates to the field of information technology.

Background technique

In the draft of the new generation video coding standard (VVC, Versatile Video Coding), the image will be divided into a series of coding tree units (CTU, coding tree unit), each CTU contains the luminance component and the chrominance component, and two trees can be used (Dual-tree) structure or single-tree (Single-tree) structure divides the luminance CTU and chrominance CTU into coding units (CU, coding unit); for a single tree structure, the luminance CTU and chrominance CTU share a division instruction Signal; For two tree structures, the luminance CTU and the chrominance CTU each use an independent segmentation indicator signal.

Figure 1 is a schematic diagram of the existing two tree structure and a single tree structure. Specifically, as shown in Figure 1, the left side is a two-tree structure, and the right side is a single-tree structure. Whether it is a two-tree structure or a single-tree structure, a quadtree is first performed on the luminance CTU and chrominance CTU ( quaternary tree) segmentation; then, in the two tree structure, each node after the quadtree segmentation is independently multi-type tree (MTT, multi-type tree) segmentation. In a single tree structure, After splitting, each node undergoes the same MTT split. MTT splits include vertical binary tree (BT, binary tree) split (SPLIT_BT_VER), horizontal binary tree split (SPLIT_BT_HOR), and vertical tri-tree (TT, ternary tree) split. (SPLIT_TT_VER) and the horizontal tri-tree division (SPLIT_TT_HOR). These nodes obtained after segmentation are called coding units (CU, coding unit).

In addition, in the existing technology (JVET-K0556), a virtual pipeline data unit (VPDU, Virtual Pipeline Data Unit) is defined. In an image, each VPDU does not overlap with each other, and each VPDU includes, for example, 64×64 A sample to be processed with a pixel size of 64×64 luma sample or 32×32 chroma sample. When designing the hardware of an electronic device including an encoder or a decoder, consider sequentially processing each VPDU, that is, a 64×64 image block.

It should be noted that the above introduction to the technical background is only set forth to facilitate a clear and complete description of the technical solutions of the present invention and to facilitate the understanding of those skilled in the art. It should not be considered that the above technical solutions are well-known to those skilled in the art just because these solutions are described in the background art part of the present invention.

Summary of the invention

At present, for 4:2:0 format video images, it is possible to perform quad-tree segmentation on luminance CTU and chrominance CTU without explicit segmentation indication signals, and then use two tree structures to separate the luminance CU and chrominance CTU after segmentation. The chroma CU is divided independently. Fig. 2 is a schematic diagram of a method for dividing a video image in 4:2:0 format. As shown in Fig. 2, the difference from Fig. 1 is that the CTU is divided into a quad-tree without using a division indication signal to obtain a luminance CU with a size of 64×64 and a chroma CU with a size of 32×32. After that, two tree structures are used to separate the divided luminance CU and chrominance CU separately.

In order to improve video coding and decoding performance, a segmentation method has been proposed. When the size of the CTU or CU does not exceed the size of the VPDU, the two tree division structures are directly used to separately divide the luminance component and the chrominance component, and each coding unit after further division is used as a unit for encoding or decoding. Fig. 3 is a schematic diagram of the proposed segmentation method. As shown in Fig. 3, for each luminance CTU and chrominance CTU, or the luminance CU and chrominance CU after quadtree segmentation, the method includes: step 301, judging Whether the size of each CTU or CU exceeds the size of the VPDU, if the judgment result is yes, go to step 302, otherwise go to step 303; step 302, divide the CTU or CU with a size larger than the VPDU into a quadtree, and return to step 301; Step 303: Use the first tree to further divide the luminance CTU whose size does not exceed the VPDU, or the luminance CU whose size after division does not exceed the VPDU, and use the second tree to further divide the chrominance CTU whose size does not exceed the VPDU, or The chrominance CU of the VPDU whose size after division does not exceed is further divided.

In the encoding process of the two tree structure used for the I frame, if the size of the luminance CTU and its corresponding chrominance CTU are larger than the size of the VPDU, the CTU of each I frame is divided into four CUs without trust. Order until the size of the luminance CU is not greater than the size of the VPDU. Then, the encoding process is performed in the order of "luminance CU first, then chroma CU". In this way, it is necessary to significantly increase the hardware area of the pipeline stage, for example, increase to 4 times the hardware area required in Figure 2; in addition, the VPDU size chroma CU has two partitioning modes, namely quadtree partitioning and no partitioning. Alternatively, other segmentation modes can also be added. Therefore, the entropy method of the chrominance CU of the VPDU size can be considered separately from other CUs to improve the performance of the codec.

Embodiments of the present invention provide a video encoding and decoding method and device, and electronic equipment. For a 4:2:0 format video image, when the flag split_qt_flag is 1, the luminance CTU of 128×128 and the chrominance CTU of 64×64 are provided. After being divided by the quadtree, a luma CU with a size of 64×64 and a chroma CU with a size of 32×32 are obtained, and then two tree structures are used to separately separate the divided luma CU and chroma CU. Based on this, for the chroma coding unit whose size is equal to the virtual pipeline data unit (VPDU), the chroma coding unit split flag (split_chroma_cu_flag) is introduced and encoded. When the value of the chroma coding unit split flag is 1, Perform quadtree division on the chrominance coding unit and the luminance coding unit corresponding to the chrominance coding unit; when the value of the chrominance coding unit division flag is 0, quadtree the luminance coding unit corresponding to the chrominance coding unit Tree segmentation does not split the chroma coding unit. In addition, when the chroma coding unit split flag split_chroma_cu_flag is 1, in each group of data blocks including the luma data block and the chroma data block, according to the first luma data block The order of the chrominance data blocks is processed group by group, and when the value of the split_chroma_cu_flag of the chroma coding unit split_chroma_cu_flag is 0, the chrominance data block is processed after all the luminance data blocks are processed. In this way, the entropy method of the chrominance CU of the VPDU size can be considered separately from other CUs, thereby improving the performance of video coding and decoding, and can be easily supported by the hardware decoder architecture of the VPDU size.

In the embodiment of the present invention, a data unit (DU) may include a luminance data block of the size of a VPDU and two chrominance data blocks of a corresponding size. For example, in the 420 format, the corresponding size of the chrominance data block is 1/4 of the VPDU size.

For example, the luminance data block may be a luminance CU of the size of a VPDU, or may be composed of multiple luminance CUs obtained by further dividing the luminance CU of the size of the VPDU; the chrominance data block may be a chrominance CU of a corresponding size, It may also be composed of multiple chrominance CUs obtained by further dividing the chrominance CU. According to a first aspect of the embodiments of the present invention, a video encoding method is provided, the method comprising: encoding a chroma coding unit split flag (split_chroma_cu_flag) for a chroma coding unit whose size is equal to a virtual pipeline data unit (VPDU) When the value of the chroma coding unit split flag is 1, the chroma coding unit and the luminance coding unit corresponding to the chroma coding unit are quadtree partitioned; when the chroma coding unit is divided When the value of the flag is 0, the luma coding unit corresponding to the chroma coding unit is quad-tree partitioned without partitioning the chroma coding unit.

According to a second aspect of the embodiments of the present invention, there is provided a video encoding device, the device comprising: a first encoding unit configured to encode chrominance for a chrominance encoding unit whose size is equal to a virtual pipeline data unit (VPDU) The unit split flag (split_chroma_cu_flag) is encoded; the first split unit is used for when the value of the split flag of the chroma coding unit is 1, the chroma coding unit and the brightness corresponding to the chroma coding unit The coding unit performs quadtree partitioning; and a second partitioning unit configured to perform quadtree partitioning on the luma coding unit corresponding to the chroma coding unit when the value of the chroma coding unit partition flag is 0 Instead of dividing the chrominance coding unit.

According to a third aspect of the embodiments of the present invention, there is provided an electronic device including the apparatus according to the second aspect of the embodiments of the present invention.

The beneficial effect of the present invention is that for the chroma coding unit whose size is equal to the virtual pipeline data unit (VPDU), the chroma coding unit split flag (split_chroma_cu_flag) is introduced and encoded, when the value of the chroma coding unit split flag is When it is 1, the chroma coding unit and the luma coding unit corresponding to the chroma coding unit are quadtree partitioned; when the value of the chroma coding unit segmentation flag is 0, the luma corresponding to the chroma coding unit is encoded The unit performs quad-tree partitioning without partitioning the chroma coding unit. In addition, when the split_chroma_cu_flag value of the chroma coding unit split_chroma_cu_flag is 1, in each group of data blocks including the luma data block and the chroma data block according to The order of the luminance data block and then the chrominance data block is processed group by group. When the value of the split_chroma_cu_flag of the chroma coding unit split_chroma_cu_flag is 0, the chrominance data block is processed after all the luminance data blocks are processed. In this way, the entropy method of the chrominance CU of the VPDU size can be considered separately from other CUs, thereby improving the performance of video coding and decoding, and can be easily supported by the hardware decoder architecture of the VPDU size.

With reference to the following description and drawings, specific embodiments of the present invention are disclosed in detail, indicating the ways in which the principles of the present invention can be adopted. It should be understood that the scope of the embodiments of the present invention is not limited thereby. Within the spirit and scope of the terms of the appended claims, the embodiments of the present invention include many changes, modifications and equivalents.

Features described and/or shown for one embodiment can be used in one or more other embodiments in the same or similar manner, combined with features in other embodiments, or substituted for features in other embodiments .

It should be emphasized that the term "comprising/comprising" when used herein refers to the existence of a feature, a whole, a step or a component, but does not exclude the existence or addition of one or more other features, a whole, a step or a component.

Description of the drawings

The included drawings are used to provide a further understanding of the embodiments of the present invention, which constitute a part of the specification, are used to illustrate the embodiments of the present invention, and together with the text description, explain the principle of the present invention. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor. In the attached picture:

Figure 1 is a schematic diagram of the existing two tree structure and a single tree structure;

Fig. 2 is a schematic diagram of a method for dividing a video image in 4:2:0 format;

Figure 3 is a schematic diagram of the proposed segmentation method;

FIG. 4 is a schematic diagram of a video encoding method according to Embodiment 1 of the present invention;

FIG. 5 is another schematic diagram of the video encoding method according to Embodiment 1 of the present invention;

FIG. 6 is another schematic diagram of the video encoding method according to Embodiment 1 of the present invention;

FIG. 7 is a schematic diagram of the data processing sequence of Embodiment 1 of the present invention; FIG.

FIG. 8 is a schematic diagram of a video encoding device according to Embodiment 2 of the present invention;

FIG. 9 is a schematic diagram of an electronic device according to Embodiment 3 of the present invention;

FIG. 10 is a schematic block diagram of the system configuration of the electronic device according to Embodiment 3 of the present invention.

detailed description

With reference to the drawings, the foregoing and other features of the present invention will become apparent through the following description. In the specification and drawings, specific embodiments of the present invention are specifically disclosed, which indicate some embodiments in which the principles of the present invention can be adopted. It should be understood that the present invention is not limited to the described embodiments. On the contrary, the present invention is not limited to the described embodiments. The invention includes all modifications, variations and equivalents falling within the scope of the appended claims.

Example 1

The embodiment of the present invention provides a video encoding and decoding method.

In this implementation, the encoding method is taken as an example for description. The decoding method may correspond to the encoding method.

Fig. 4 is a schematic diagram of a video encoding method according to Embodiment 1 of the present invention. As shown in Figure 4, the method includes:

Step 401: Encoding the chroma coding unit split flag (split_chroma_cu_flag) for the chroma coding unit whose size is equal to the virtual pipeline data unit (VPDU);

Step 402: When the value of the chroma coding unit split flag is 1, perform quadtree partition on the chroma coding unit and the luma coding unit corresponding to the chroma coding unit; and

Step 403: When the value of the chroma coding unit division flag is 0, perform quadtree division on the luma coding unit corresponding to the chroma coding unit without dividing the chroma coding unit.

At the beginning of encoding or decoding, for the coding tree unit CTU that contains the luma CTU and the chroma CTU, if the size of the CTU is large, for example, the size of the luma CTU is 128×128, and the size of the chroma CTU is 64×64 , First, perform quadtree segmentation on both the luminance CTU and the chrominance CTU.

In this embodiment, when the CTU size is large and undergoes quadtree division, or when the CTU size is small and does not need to be divided, for a chrominance CU with a size larger than one VPDU, the chrominance The CU and its corresponding luma CU continue to perform quadtree division, and for the chroma CU whose size is equal to one VPDU, a chroma coding unit split flag (split_chroma_cu_flag) is introduced. When the value of the split_chroma_cu_flag of the chroma coding unit split_chroma_cu_flag is 1, the processing is performed group by group in the order of the first luminance data block and then the chrominance data block in each group of data blocks including the luminance data block and the chrominance data block. When the value of the split_chroma_cu_flag of the chroma coding unit split flag is 0, the chroma data block is processed after all the luma data blocks are processed.

In this embodiment, one data unit (DU) may include one luminance data block with the size of a VPDU and two chrominance data blocks with corresponding sizes. For example, in the 420 format, the corresponding size of the chrominance data block is 1/4 of the VPDU size.

For example, the luminance data block may be a luminance CU of the size of a VPDU, or may be composed of multiple luminance CUs obtained by further dividing the luminance CU of the size of the VPDU; the chrominance data block may be a chrominance CU of a corresponding size, It may also be composed of multiple chrominance CUs obtained by further dividing the chrominance CU.

In this embodiment, the chroma coding unit split flag (split_chroma_cu_flag) is valid for chroma CU whose size is equal to VPDU, and is invalid for chroma CU whose size is not equal to VPDU. In addition, for chroma CU whose size is not equal to VPDU, For the degree CU, the coding unit split flag (split_cu_flag) can be used to determine whether to split.

In this embodiment, for the chrominance CU whose size is equal to the VPDU, cross-component linear model (CCLM, Cross-component linear model) prediction is not allowed.

For a chroma CU with a size equal to the VPDU, the value of the chroma coding unit split flag split_chroma_cu_flag indicates whether to perform quadtree split on the chroma CU. When split_chroma_cu_flag is 1, it means that the chroma CU is divided into a quadtree, and when split_chroma_cu_flag is 0, it means that the chroma CU is not divided. In addition, regardless of whether split_chroma_cu_flag is 1 or 0, as long as split_chroma_cu_flag is valid, the luminance CU corresponding to the chroma CU is inferred to perform quadtree division.

In this embodiment, the values of the chroma coding unit split flag split_chroma_cu_flag and the coding unit split flag split_cu_flag are predetermined. For example, the maximum value of the chroma coding unit split flag split_chroma_cu_flag and the coding unit split flag split_cu_flag is determined through search traversal. Merit.

In step 401, the chroma coding unit split flag (split_chroma_cu_flag) is encoded for the chroma CU whose size is equal to the VPDU, that is, the chroma coding unit split flag split_chroma_cu_flag is encoded into the code stream.

In this embodiment, a context model (context model) may be used to perform entropy coding (entropy coding) on the chroma coding unit segmentation flag.

The index corresponding to the context model can be determined according to the neighboring CU of the current chrominance CU, so that more bits can be saved.

For example, three context models can be used to entropy encode split_chroma_cu_flag.

Table 1

As shown in Table 1, the index corresponding to the context model used in Method 1 is not determined based on the neighboring CUs of the current chroma CU, and the index corresponding to the context model used in

Methods

1 and 2 is determined based on the neighboring CUs of the current CU, for example , Determined according to the upper chromaticity CU and/or the left chromaticity CU of the current chromaticity CU.

In this embodiment, three methods can be used to encode split_chroma_cu_flag. In the first method, the context model with index 0 is used for entropy coding;

In the second method, two models, the context model with index 0 and the context model with index 1, can be used for entropy coding. The specific selection method of the corresponding index of the model is shown in Table 2. When the size of the upper chroma CU <VPDU and the size of the left chroma CU <VPDU, use the context model with index 0; when the size of the upper chroma CU <VPDU and the size of the left chroma CU ≥ VPDU, or the size of the upper chroma CU When ≥VPDU and the size of the left chroma CU<VPDU, or the size of the upper chroma CU≥VPDU and the size of the left chroma CU≥VPDU, the context model with index 1 is used.

Table 2

In the third method, three models: a context model with an index of 0, a context model with an index of 1, and a context model with an index of 2 can be used for entropy coding. The specific selection method of the index corresponding to the model is shown in Table 2. When the size of the upper chroma CU<VPDU and the size of the left chroma CU<VPDU, the context model with an index of 0 is used; when the size of the upper chroma CU ＜VPDU and the size of the left chroma CU ≥ VPDU, or, the size of the upper chroma CU ≥ VPDU and the size of the left chroma CU ＜ VPDU, use the context model with index 1; when the size of the upper chroma CU ≥ When the size of VPDU and the left chroma CU ≥ VPDU, the context model with index 2 is used.

table 3

In this embodiment, which method among methods 1 to 3 is used to encode split_chroma_cu_flag can be determined according to actual conditions.

In addition, the initial coefficients of each context model can be set according to actual conditions. For example, it is determined according to the quantizer parameter (QP, Quantizer Parameter) and the resolution of the video image.

Through step 401, the chroma coding unit split flag (split_chroma_cu_flag) is encoded, and it can be determined whether the value of the chroma coding unit split flag (split_chroma_cu_flag) is 0 or 1.

In step 402, when the value of the chroma coding unit split flag split_chroma_cu_flag is 1, the chroma CU and the luma CU corresponding to the chroma CU are quad-tree partitioned. In step 403, when the chroma CU is When the value of the coding unit split flag split_chroma_cu_flag is 0, the luma CU corresponding to the chroma CU is quadtree partitioned without splitting the chroma CU.

After step 402, the method may further include:

Step 404: For the divided luma CU and chroma CU, the coding unit split flag (split_cu_flag) is coded.

After step 403, the method may further include:

Step 405: For the divided luminance CU, encode the coding unit split flag (split_cu_flag). Among them, for the branch of step 403, for the chroma CU, since it is no longer divided, step 405 does not need to be performed;

After step 404, the method may further include:

Step 406: When the value of the coding unit division flag is 1, use two tree structures to divide the divided luma CU and chroma CU respectively, and return to step 404 after the division ends; and

Step 407: When the value of the coding unit division flag is 0, code the divided luma CU and chroma CU.

After step 405, the method may further include:

Step 408: When the value of the segmentation flag of the coding unit is 1, further segment the segmented luminance CU, and return to step 405 after the segmentation ends;

Step 409: When the value of the coding unit division flag is 0, encode the divided luminance CU. In step 404 and step 405, the coding unit split flag split_cu_flag is encoded. The specific encoding method can refer to the prior art, which will not be described in detail here.

In this embodiment, the coding unit split flag split_cu_flag is valid for non-VPDU size chroma CU and non-420 format luma CU of corresponding size.

In this embodiment, the value of the coding unit split flag split_cu_flag indicates whether to split the current CU (luminance CU or chroma CU). When the value of the coding unit split flag split_cu_flag is 1, it indicates that the current CU is split. When the value of the coding unit split flag split_cu_flag is 0, it indicates that the current CU will not be split. The segmentation method is, for example, different segmentation of luma CU and chroma CU based on two tree structures.

In the foregoing step 407 and step 409, the specific method of encoding the CU can refer to the prior art, and the embodiment of the present invention does not limit the specific method of encoding.

After the above step 409, the method may further include:

Step 410: When the luma CU is encoded, for the chroma CU of the VPDU size, when the value of the chroma coding unit split flag split_chroma_cu_flag is 0, encode the chroma CU.

Step 411: For chroma CUs of other sizes, when the value of the coding unit split flag split_cu_flag is 1, the chroma CU is further divided, and when the value of the coding unit split flag split_cu_flag is 0, the chroma CU is encoded .

FIG. 5 is another schematic diagram of the video encoding method according to Embodiment 1 of the present invention. As shown in Figure 5, the method includes:

Step 501: Determine whether the size of the current chrominance CU is greater than the size of the VPDU; when the judgment result is "Yes", go to step 502, and when the judgment result is "No", go to step 503;

Step 502: Perform quadtree division on the current chrominance CU and the luminance CU corresponding to the chrominance CU;

Step 503: For the current chroma CU, encode the chroma coding unit split flag split_chroma_cu_flag;

Step 504: Determine whether the value of the split_chroma_cu_flag of the chroma coding unit split_chroma_cu_flag is 1, when the judgment result is "No", go to step 505, and when the judgment result is "Yes", go to step 506;

Step 505: Perform quadtree division on the luminance CU corresponding to the chrominance CU;

Step 506: Perform quadtree division on the chrominance CU and the luminance CU corresponding to the chrominance CU;

Step 507: Encoding the coding unit split flag split_cu_flag for the luma CU and chroma CU obtained by segmentation in step 506, and for the luma CU obtained by segmentation in step 505;

Step 508: Determine whether the value of the coding unit split flag split_cu_flag is 1, and when the judgment result is "Yes", go to step 509, and when the judgment result is "No", go to step 510;

Step 509: further divide the luminance CU and chrominance CU obtained by dividing in step 506, and the luminance CU obtained by dividing in step 505;

Step 510: Encoding the luma CU and the chroma CU, where for the case where split_chroma_cu_flag is 1, the luma CU and the chroma CU obtained by the division in step 506 are encoded; for the case where split_chroma_cu_flag is 0, first step 505 and Encoding the luma CU obtained by segmentation in step 509, and then encoding the chrominance CU that has not been segmented in step 505 and the segmented chroma CU obtained in step 509;

Step 511: Determine whether the luminance CU has completed encoding, when the judgment result is "Yes", go to step 512, and when the judgment result is "No", return to step 510;

Step 512: Determine whether the chroma CU has completed encoding, when the judgment result is "No", go to step 513, and when the judgment result is "Yes", end the process;

Among them, taking Fig. 2 as an example, according to luminance data block 1 (luminance CU1), chrominance data block 1 (chrominance CU1), luminance data block 2 (luminance CU2), chrominance data block 2 (chrominance CU2), luminance Data block 3 (luminance CU3), chroma data block 3 (chroma CU3), luma data block 4 (chroma CU4), chroma data block 4 (chroma CU4) are processed in the order, and luma data block 1 is processed first (Luminance CU1). If the luminance data block 1 (luminance CU1) contains CUs, it is determined whether all CUs of the luminance data block 1 (luminance CU1) have been processed. When all CUs of the luminance data block 1 (luminance CU1) have been processed, Reprocess chroma data block 1 (chroma CU1). If chroma data block 1 (chroma CU1) contains CUs, determine whether all CUs of chroma data block 1 (chroma CU1) have been processed. When the data is processed When all the CUs of the block CU1 (chroma CU1) are processed, the luminance data block 2 (luminance CU2) is processed, and so on, until the chroma data block 4 is processed, the process ends. Step 513: For the chrominance CU of the VPDU size, judge whether the value of the chrominance coding unit split flag split_chroma_cu_flag is 0, when the judgment result is "Yes", go to step 510, and when the judgment result is "No", go back to step 507 prior to.

In this embodiment, the specific implementation of the above steps 501-513 can refer to the implementation of each step in FIG. 4, and the description will not be repeated here.

FIG. 6 is another schematic diagram of the video encoding method according to Embodiment 1 of the present invention. As shown in Figure 6, the method includes:

Step 601: Encode the chroma coding unit split flag (split_chroma_cu_flag);

Step 602: When the value of the chrominance coding unit division flag is 1, in each group of data blocks including the luminance data block and the chrominance data block, processing is performed group by group in the order of the luminance data block and then the chrominance data block;

Step 603: When the value of the division flag of the chroma coding unit is 0, process the chroma data block after all the luma data blocks are processed.

In step 602, when the value of the chroma coding unit segmentation flag is 1, the processing may be performed sequentially in units of data units (DU), and each data unit includes one luminance data block and two chrominance data blocks.

In step 603, when the value of the chroma coding unit segmentation flag is 0, the processing can also be performed sequentially in units of data units (DU), and all the luma data blocks are processed first, and then the chroma data blocks are processed. In this case, each DU only contains a luma data block, or only a chroma coding unit of the size of a VPDU.

For example, for a luma CTU with a size of 128×128, a chroma CTU with a size of 64×64, and a VPDU with a size of 64×64, when the value of the chroma coding unit split flag split_chroma_cu_flag is 1, the data unit (DU) is processed sequentially in units. Each DU includes a luma CU that has undergone quadtree division and a chrominance CU that has undergone quadtree division; when the value of the chroma coding unit split flag split_chroma_cu_flag is 0, DU The processing is performed sequentially as a unit. Each DU includes a luma CU that has undergone quadtree division or an unsegmented chroma CU, and each luma CU that has undergone quadtree division is processed first, and then the unsegmented chroma CU.

FIG. 7 is a schematic diagram of the data processing sequence of Embodiment 1 of the present invention. As shown in Figure 7, the size of the current luma CU is 128×128, the size of the chroma CU is 64×64, and the size of the VPDU is 64×64. With a DU as a unit, DU1, DU2, DU3, and DU4 To process. In this example, the data block is a CU. When the value of the chroma coding unit split flag split_chroma_cu_flag is 1, DU1 includes the luma CU1 after the quadtree split and the chroma CU2 after the quadtree split, and DU2 includes the luma CU3 after the quadtree split and the chroma CU2 after the quadtree split. The chrominance CU4 of the fork tree segmentation, DU3 includes the luminance CU5 after the quadtree segmentation and the chrominance CU6 after the quadtree segmentation. DU4 includes the luminance CU7 after the quadtree segmentation and the chrominance after the quadtree segmentation. CU8; when the value of the chroma coding unit split flag split_chroma_cu_flag is 0, DU1 includes the brightness CU1 after the quadtree split, DU2 includes the brightness CU2 after the quadtree split, and DU3 includes the brightness after the quadtree split CU3 and DU4 include luma CU4 after quadtree division, and DU5 includes chrominance CU5 without division. In this way, when the value of the split_chroma_cu_flag of the chroma coding unit split flag is 1, it can be compatible with the original design (Figure 2) at a small cost, and at the same time, the maximum chroma transformation block processed can reach the VPDU without increasing the DU size. size.

It can be seen from the above embodiment that for the chroma coding unit whose size is equal to the virtual pipeline data unit (VPDU), the chroma coding unit split flag (split_chroma_cu_flag) is introduced and encoded. When the value of the chroma coding unit split flag is When 1, the chroma coding unit and the luma coding unit corresponding to the chroma coding unit are divided into a quadtree; when the value of the chroma coding unit segmentation flag is 0, the luma coding unit corresponding to the chroma coding unit is Perform quadtree partitioning without partitioning the chroma coding unit. In addition, when the chroma coding unit split flag split_chroma_cu_flag is 1, in each group of data blocks including the luminance data block and the chroma data block according to the previous The luminance data blocks are processed group by group in the order of the chrominance data blocks. When the value of the split_chroma_cu_flag of the chroma coding unit split_chroma_cu_flag is 0, the chrominance data blocks are processed after all the luminance data blocks are processed. In this way, the entropy method of the chrominance CU of the VPDU size can be considered separately from other CUs, thereby improving the performance of video coding and decoding, and can be easily supported by the hardware decoder architecture of the VPDU size.

Example 2

The embodiment of the present invention also provides a video encoding device, which corresponds to the video encoding method of Embodiment 1. Fig. 8 is a schematic diagram of a video encoding device according to Embodiment 2 of the present invention. As shown in FIG. 8, the device 800 includes:

The first encoding unit 801 is configured to encode the chroma coding unit split flag (split_chroma_cu_flag) for a chroma coding unit whose size is equal to a virtual pipeline data unit (VPDU);

The first division unit 802 is configured to perform quadtree division on the chroma coding unit and the luminance coding unit corresponding to the chroma coding unit when the value of the chroma coding unit division flag is 1; and

The second segmentation unit 803 is configured to perform quadtree segmentation on the luma coding unit corresponding to the chroma coding unit without segmenting the chroma coding unit when the value of the chroma coding unit segmentation flag is 0.

In this embodiment, the implementation of the functions of the above-mentioned components can refer to the implementation of the steps of the video encoding method in Embodiment 1, which will not be repeated here.

In addition, for the sake of simplicity, FIG. 8 only exemplarily shows the connection relationship between the various components or modules, but it should be clear to those skilled in the art that, for example, various related technologies such as bus connection can be used. The above-mentioned various components or modules may be implemented by hardware facilities such as a processor and a memory; the implementation of the present invention does not limit this.

In this embodiment, the video encoding device may be a device for encoding an image of a video or a part of the device. For example, the video encoding device is an encoder.

In addition, an embodiment of the present invention also provides a video decoding device, which corresponds to the above-mentioned video encoding device. The video decoding device may be a device for decoding an image of a video or a part of the device. For example, the video decoding device is a decoder.

It can be seen from the above embodiment that for the chroma coding unit whose size is equal to the virtual pipeline data unit (VPDU), the chroma coding unit split flag (split_chroma_cu_flag) is introduced and encoded. When the value of the chroma coding unit split flag split_chroma_cu_flag is When the value is 1, each group of data blocks including the luminance data block and the chrominance data block is processed group by group in the order of the first luminance data block and then the chrominance data block. When the value of the split_chroma_cu_flag of the chroma coding unit is When it is 0, the chrominance data block will be processed after all the luma data blocks have been processed. When the value of the chroma coding unit split flag is 1, the chroma coding unit and the luminance coding unit corresponding to the chroma coding unit are quad-tree partitioned; when the value of the chroma coding unit split flag is 0, Quadtree partitioning is performed on the luma coding unit corresponding to the chroma coding unit without partitioning the chroma coding unit. In this way, the entropy method of the chrominance CU of the VPDU size can be considered separately from other CUs, thereby improving the performance of video coding and decoding, and can be easily supported by the hardware decoder architecture of the VPDU size.

Example 3

The embodiment of the present invention also provides an electronic device. FIG. 9 is a schematic diagram of the electronic device of Embodiment 3 of the present invention. As shown in FIG. 9, the electronic device 900 includes a video encoding device 901, wherein the structure and function of the video encoding device 901 are the same as those described in Embodiment 2, and will not be repeated here.

FIG. 10 is a schematic block diagram of the system configuration of the electronic device according to Embodiment 3 of the present invention. As shown in FIG. 10, the electronic device 1000 may include a processor 1001 and a memory 1002; the memory 1002 is coupled to the processor 1001. This figure is exemplary; other types of structures can also be used to supplement or replace this structure to implement telecommunication functions or other functions.

As shown in FIG. 10, the electronic device 1000 may further include: an input unit 1003, a display 1004, and a power supply 1005.

In an implementation manner, the functions of the video encoding device described in Embodiment 2 may be integrated into the processor 1001. The processor 1001 may be configured to encode a chroma coding unit split flag (split_chroma_cu_flag) for a chroma coding unit whose size is equal to a virtual pipeline data unit (VPDU); when the value of the chroma coding unit split flag is When 1, the chroma coding unit and the luma coding unit corresponding to the chroma coding unit are quad-tree partitioned; and when the value of the chroma coding unit split flag is 0, the chroma coding unit corresponds to the chroma coding unit. The luma coding unit is divided into a quadtree without dividing the chrominance coding unit.

For example, the processor 1001 may also be configured to: encode the chroma coding unit split flag (split_chroma_cu_flag); when the value of the chroma coding unit split flag is 1, when the value of the chroma coding unit split flag is 1, the Each group of data blocks is processed group by group in the order of first luminance data block and then chrominance data block; when the value of the division flag of the chrominance coding unit is 0, the chrominance is processed after all the luminance data blocks are processed. data block.

For example, when the value of the chroma coding unit division flag is 1, the data unit (DU) is used as the unit to process sequentially, and each data unit includes a luminance data block and two chrominance data blocks; when the color When the value of the division flag of the degree coding unit is 0, the data unit (DU) is used as a unit to process sequentially, and all the luminance data blocks are processed first, and then the chrominance data unit is processed.

For example, encoding the chroma coding unit split flag (split_chroma_cu_flag) includes: using a context model to perform entropy coding on the chroma coding unit split flag.

For example, the index corresponding to the context model is determined according to the neighboring coding units of the current chrominance coding unit.

For example, the index corresponding to the context model is determined according to the upper chroma coding unit and/or the left chroma coding unit of the current chroma coding unit.

For example, the chroma coding unit split flag (split_chroma_cu_flag) is valid for a chroma coding unit whose size is equal to a virtual pipeline data unit, and is invalid for a chroma coding unit whose size is not equal to a virtual pipeline data unit.

For example, for a chroma coding unit whose size is equal to a virtual pipeline data unit, the value of the chroma coding unit split flag (split_chroma_cu_flag) indicates whether the chroma coding unit is quadtree split.

For example, when the chroma coding unit split flag (split_chroma_cu_flag) is valid, the luma coding unit corresponding to the chroma coding unit is estimated to perform quadtree division.

In another embodiment, the video encoding device described in Embodiment 2 can be configured separately from the processor 1001. For example, the video encoding device can be configured as a chip connected to the processor 1001, and the video encoding can be realized through the control of the processor 1001. The function of the device.

In this embodiment, the electronic device 1000 does not necessarily include all the components shown in FIG. 10.

As shown in FIG. 10, the processor 1001 is sometimes referred to as a controller or an operating control, and may include a microprocessor or other processor device and/or logic device. The processor 1001 receives input and controls the operation of each component of the electronic device 1000. .

The memory 1002, for example, may be one or more of a cache, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory, or other suitable devices. In addition, the processor 1001 can execute the program stored in the memory 1002 to implement information storage or processing. The functions of other components are similar to the existing ones, so I won't repeat them here. Each component of the electronic device 1000 may be implemented by dedicated hardware, firmware, software, or a combination thereof, without departing from the scope of the present invention.

In this embodiment, the electronic device includes an encoding device as an example for description. In addition, the electronic device may also include a decoding device corresponding to the encoding device.

It can be seen from the above embodiment that for the chroma coding unit whose size is equal to the virtual pipeline data unit (VPDU), the chroma coding unit split flag (split_chroma_cu_flag) is introduced and encoded. When the value of the chroma coding unit split flag split_chroma_cu_flag is When the value is 1, each group of data blocks including the luminance data block and the chrominance data block is processed group by group in the order of the first luminance data block and then the chrominance data block. When the value of the split_chroma_cu_flag of the chroma coding unit is When it is 0, the chrominance data block will be processed after all the luma data blocks have been processed. In addition, when the value of the chroma coding unit split flag is 1, the chroma coding unit and the luma coding unit corresponding to the chroma coding unit are quad-tree partitioned; when the value of the chroma coding unit split flag is 0 In this case, the luma coding unit corresponding to the chroma coding unit is quad-tree partitioned without partitioning the chroma coding unit. In this way, the entropy method of the chrominance CU of the VPDU size can be considered separately from other CUs, thereby improving the performance of video coding, and can be easily supported by the hardware decoder architecture of the VPDU size.

The embodiment of the present invention also provides a computer readable program, wherein when the program is executed in the video encoding apparatus or electronic equipment, the program causes the computer to execute the embodiment 1 in the video encoding apparatus or electronic equipment. The described video coding method.

An embodiment of the present invention also provides a storage medium storing a computer-readable program, wherein the computer-readable program enables a computer to execute the video encoding method described in Embodiment 1 in a video encoding device or an electronic device.

The method for encoding in a video encoding device described in conjunction with the embodiment of the present invention may be directly embodied in hardware, a software module executed by a processor, or a combination of the two. For example, one or more of the functional block diagrams and/or one or more combinations of the functional block diagrams shown in FIG. 8 may correspond to each software module of the computer program flow, or may correspond to each hardware module. These software modules can respectively correspond to the steps shown in FIG. 4. These hardware modules can be implemented by solidifying these software modules by using a field programmable gate array (FPGA), for example.

The software module can be located in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM or any other form of storage medium known in the art. A storage medium may be coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium may be a component of the processor. The processor and the storage medium may be located in the ASIC. The software module can be stored in the memory of the mobile terminal, or can be stored in a memory card that can be inserted into the mobile terminal. For example, if the device (such as a mobile terminal) uses a larger-capacity MEGA-SIM card or a large-capacity flash memory device, the software module can be stored in the MEGA-SIM card or a large-capacity flash memory device.

One or more of the functional block diagrams described in FIG. 8 and/or one or more combinations of the functional block diagrams can be implemented as general-purpose processors, digital signal processors (DSP), and special-purpose processors for performing the functions described in this application. Integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or any suitable combination thereof. One or more of the functional block diagrams described in FIG. 8 and/or one or more combinations of the functional block diagrams can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, multiple microprocessors, One or more microprocessors or any other such configuration combined with DSP communication.

The present invention has been described above in conjunction with specific embodiments, but it should be clear to those skilled in the art that these descriptions are all exemplary and do not limit the protection scope of the present invention. Those skilled in the art can make various variations and modifications to the present invention based on the spirit and principle of the present invention, and these variations and modifications are also within the scope of the present invention.

Claims

A video encoding method, the method includes:

Step 1. For the chroma coding unit whose size is equal to the virtual pipeline data unit (VPDU), encode the chroma coding unit split flag (split_chroma_cu_flag);

Step 2. When the value of the chroma coding unit division flag is 1, perform quadtree division on the chroma coding unit and the luma coding unit corresponding to the chroma coding unit; and

Step 3. When the value of the chrominance coding unit division flag is 0, perform quadtree division on the luminance coding unit corresponding to the chrominance coding unit without dividing the chrominance coding unit.
The method of claim 1, wherein:

After step 2, the method further includes:

Step 4. For the divided luma coding unit and chroma coding unit, encode the coding unit split flag (split_cu_flag);

Step 6. When the value of the coding unit division flag is 1, the divided luminance coding unit and the chrominance coding unit are respectively divided by two tree structures; and

Step 7. When the value of the coding unit division flag is 0, code the divided luminance coding unit and chrominance coding unit.
The method of claim 1, wherein:

After step 3, the method further includes:

Step 5. For the divided luminance coding unit, encode the coding unit split flag (split_cu_flag);

Step 8. When the value of the coding unit division flag is 1, further divide the divided luminance coding unit; and

Step 9. When the value of the coding unit division flag is 0, code the divided luminance coding unit.
The method of claim 3, wherein:

After step 9, the method further includes:

Step 10. When the coding of the luminance coding unit is completed, for the chroma coding unit of the VPDU size, when the value of the chroma coding unit split flag is 0, the chroma coding unit is coded; and

Step 11. For chroma coding units of other sizes, when the value of the coding unit split flag is 1, further partition the chroma coding unit, and when the value of the coding unit split flag is 0, perform the chroma coding The unit is encoded.
The method according to claim 1, wherein said encoding a chroma coding unit split flag (split_chroma_cu_flag) comprises:

Entropy coding is performed on the chroma coding unit segmentation flag using a context model.
The method of claim 5, wherein:

The index corresponding to the context model is determined according to adjacent coding units of the current chrominance coding unit.
The method according to claim 6, wherein:

The index corresponding to the context model is determined according to the upper chroma coding unit and/or the left chroma coding unit of the current chroma coding unit.
The method of claim 1, wherein:

The chroma coding unit split flag (split_chroma_cu_flag) is valid for a chroma coding unit whose size is equal to a virtual pipeline data unit, and is invalid for a chroma coding unit whose size is not equal to a virtual pipeline data unit.
The method according to claim 8, wherein:

For a chroma coding unit whose size is equal to a virtual pipeline data unit, the value of the chroma coding unit split flag (split_chroma_cu_flag) indicates whether the chroma coding unit is quadtree split.
The method according to claim 8, wherein:

When the chroma coding unit split flag (split_chroma_cu_flag) is valid, the luma coding unit corresponding to the chroma coding unit is estimated to perform quadtree division.
A video encoding method, the method includes:

Encoding the chroma coding unit split flag (split_chroma_cu_flag);

When the value of the chroma coding unit segmentation flag is 1, in each group of data blocks including a luminance data block and a chrominance data block, processing is performed group by group in the order of the luminance data block and then the chrominance data block; and

When the value of the division flag of the chrominance coding unit is 0, the chrominance data block is processed after all the luminance data blocks are processed.
The method of claim 11, wherein:

When the value of the division flag of the chrominance coding unit is 1, the data unit (DU) is used as a unit to process sequentially, and each data unit includes a luminance data block and two chrominance data blocks;

When the value of the chrominance coding unit division flag is 0, the processing is performed in sequence in units of data units (DU), and all the luminance data blocks are processed first, and then the chrominance data blocks are processed.
A video encoding device, the device comprising:

The first coding unit is used for coding the chroma coding unit split flag (split_chroma_cu_flag) for a chroma coding unit with a size equal to a virtual pipeline data unit (VPDU);

A first division unit, configured to perform quadtree division on the chrominance coding unit and the luminance coding unit corresponding to the chrominance coding unit when the value of the chrominance coding unit division flag is 1; and

The second division unit, which is used to perform quad-tree division on the luminance coding unit corresponding to the chrominance coding unit without performing the quadtree division on the chrominance coding unit when the value of the chrominance coding unit division flag is 0 segmentation.
The device according to claim 13, wherein:

The first coding unit uses a context model to perform entropy coding on the chroma coding unit segmentation flag.
The device according to claim 14, wherein:

The index corresponding to the context model is determined according to adjacent coding units of the current chrominance coding unit.
The device according to claim 15, wherein:

The index corresponding to the context model is determined according to the upper chroma coding unit and/or the left chroma coding unit of the current chroma coding unit.
The device according to claim 13, wherein:

The chroma coding unit split flag (split_chroma_cu_flag) is valid for a chroma coding unit whose size is equal to a virtual pipeline data unit, and is invalid for a chroma coding unit whose size is not equal to a virtual pipeline data unit.
The device of claim 17, wherein:

For a chroma coding unit whose size is equal to a virtual pipeline data unit, the value of the chroma coding unit split flag (split_chroma_cu_flag) indicates whether the chroma coding unit is quadtree split.
The device of claim 17, wherein:

When the chroma coding unit split flag (split_chroma_cu_flag) is valid, the luma coding unit corresponding to the chroma coding unit is estimated to perform quadtree division.