WO2015196424A1 - Methods for the transmission of flags related to dbbp - Google Patents
Methods for the transmission of flags related to dbbp Download PDFInfo
- Publication number
- WO2015196424A1 WO2015196424A1 PCT/CN2014/080862 CN2014080862W WO2015196424A1 WO 2015196424 A1 WO2015196424 A1 WO 2015196424A1 CN 2014080862 W CN2014080862 W CN 2014080862W WO 2015196424 A1 WO2015196424 A1 WO 2015196424A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- dbbp
- mode
- flag
- part mode
- partition
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Definitions
- the invention relates generally to Multi-view video coding and Three-Dimensional (3D) video coding.
- the present invention relates to optimized methods for depth-based block partitioning in 3D video coding.
- 3D video coding is developed for encoding or decoding video data of multiple views simultaneously captured by several cameras. Since all cameras capture the same scene for both the input texture videos and depth videos, the depth information can be utilized to improve the motion compensation efficiency of texture videos. Especially, the corresponding depth block of the texture block can represent the pixel level object segmentation, so it is reasonable to realize pixel-level segment based motion compensation by utilizing the depth information. Therefore, a depth-based block partitioning (DBBP) is adopted for texture video coding in the current 3D- HEVC.
- DBBP depth-based block partitioning
- a single flag is added to the coding syntax to signal to the decoder that a block uses DBBP for prediction.
- the corresponding partition size is set to SIZE_2Nx2N and bi-prediction is inherited.
- DBBP flag dbbp flag has no dependency with part mode.
- part mode ae(v) if( depth based bhVpart flag[ nuh layer id ] && CuPredMode[ xO ][ yO ] !
- depth_based_blk_part_flag[ layerld ] 0 specifies that depth based block partitioning is not used for the layer with nuh layer id equal to layerld.
- depth_based_blk_part_flag[ layerld ] 1 specifies that depth based block partitioning might be used for the layer with nuh layer id equal to layerld.
- the value of depth_based_blk_part_flag[ layerld ] is inferred to be equal to 0.
- the partition mode is not decided by the part mode, which originally indentifies the prediction partition of the current inter CU.
- the virtual depth block which DBBP gets from depth block will be utilized to determine the final partition among Nx2N and 2NxN.
- Fig. 1 is a diagram illustrating the suggested encoding and decoder order of part mode and dbbp flag.
- Fig. 2 is a diagram illustrating when dbbp flag is transmitted before part mode, if dbbp flag is equal to 1, part mode only identifies two partition patterns for DBBP, Nx2N or 2NxN.
- dbbp flag is still transmitted after part mode but only in the case when the part_mode specifies a 2NxN or Nx2N prediction unit(PU) partition, as shown in Fig.
- dbbp flag is still transmitted after part mode but only in the case when the part_mode identifies a prediction unit partition belonging to a subset of ⁇ 2Nx2N, Nx2N, 2NxN, NxN, 2NxnU, 2NxnD, nLx2N and nRx2N ⁇ .
- the PU partition which the part mode identifies is just the prediction partition which DBBP utilizes.
- the dbbp flag is transmitted before part mode, but part mode is transmitted only when dbbp flag equal to 1.
- the prediction partition which DBBP utilizes is derived from virtual depth block.
- the binarization of part mode is different when dbbp flag is equal to 0 and 1.
- the part mode when the dbbp flag is transmitted before part mode, if the dbbp flag is equal to 1, the part mode only identifies two partition patterns for DBBP, Nx2N or 2NxN, as shown in Fig. 2. For example, part mode equal to 1 when the partition for DBBP is 2NxN.
- the context utilized for coding part mode is different when dbbp flag is equal to 0 and 1.
- the dbbp flag when the dbbp flag is transmitted after part mode, the dbbp flag is signalized in cu extention syntax table, and transmitted only in case of the current prediction mode is not intra and part mode only identifies two partition patterns for DBBP, e.g., Nx2N or 2NxN.
- the dbbp flag when the dbbp flag is transmitted after part mode, the dbbp flag is signalized in cu extention syntax table, and transmitted only in case of the current prediction mode is not intra and part_mode does not identify 2Nx2N or NxN PU partition.
- any methods belonging to the first to ninth embodiments are combined together.
- an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein.
- An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
- DSP Digital Signal Processor
- the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA).
- processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
- the software code or firmware codes may be developed in different programming languages and different format or style.
- the software code may also be compiled for different target platform.
- different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Methods of depth-based block partitioning (DBBP) for multi-view video coding and 3D video coding are disclosed. Several methods are proposed for the transmission and specifying relationship between dbbp_flag and part_mode.
Description
METHODS FOR THE TRANSMISSION OF FLAGS RELATED TO
DBBP
FIELD OF INVENTION
The invention relates generally to Multi-view video coding and Three-Dimensional (3D) video coding. In particular, the present invention relates to optimized methods for depth-based block partitioning in 3D video coding.
BACKGROUND OF THE INVENTION
3D video coding is developed for encoding or decoding video data of multiple views simultaneously captured by several cameras. Since all cameras capture the same scene for both the input texture videos and depth videos, the depth information can be utilized to improve the motion compensation efficiency of texture videos. Especially, the corresponding depth block of the texture block can represent the pixel level object segmentation, so it is reasonable to realize pixel-level segment based motion compensation by utilizing the depth information. Therefore, a depth-based block partitioning (DBBP) is adopted for texture video coding in the current 3D- HEVC.
A single flag is added to the coding syntax to signal to the decoder that a block uses DBBP for prediction. When current coding unit is coded with the DBBP mode, the corresponding partition size is set to SIZE_2Nx2N and bi-prediction is inherited.
Whether the DBBP mode is used is signaled on coding unit as shown in Table 1. In currently design, the DBBP flag dbbp flag has no dependency with part mode.
Table 1
MODE INTRA)
dbbp_flag[xO][yO] ae(v) if( sdcEnableFlag )
sdc_flag[xO][yO] ae(v) if( CuPredMode[ xO ][ yO ] = = MODE INTRA ) {
if( PartMode = = PART 2Nx2N && pcm enabled flag &&
log2CbSize >= Log2MinIpcmCbSizeY &&
log2CbSize <= Log2MaxIpcmCbSizeY )
pcm_flag[ xO ][ yO ] ae(v) if(pcm_flag[xO][yO] ){
while( !byte_aligned( ) )
pcm alignment zero bit f(l) pcm_sample( xO, yO, log2CbSize )
} else {
pbOffset = ( PartMode = = PART NxN ) ? ( nCbS 12) : nCbS
log2PbSize = log2CbSize - ( ( PartMode = = PART NxN ) ? 1 : 0 )
for( j = 0; j < nCbS; j = j + pbOffset )
for( i = 0; i < nCbS; i = i + pbOffset ) {
if( vps_depth_modes_flag[ nuh layer id ] )
intra_mode_ext( xO + i , y0+ j , log2PbSize )
if( dim_not_present_flag[ xO + i ] [ yO + j ] )
prev intra luma pred _flag[ xO + i ][ yO + j ] ae(v)
}
for( j = 0; j < nCbS; j = j + pbOffset )
for( i = 0; i < nCbS; i = i + pbOffset )
if( dim_not_present_flag[ xO + i ] [ yO + j ] ) {
if( prev_intra_luma_pred_flag[ xO + i ] [ yO + j ] )
mpm_idx[ xO + i ] [ yO + j ] ae(v) else
rem_intra_luma_pred_mode[ xO + i ][ yO + j ] ae(v)
}
if( !sdc_flag[xO][yO] )
intra_chroma_pred_mode[ xO ][ yO ] ae(v)
}
} else {
if( PartMode == PART_2Nx2N)
prediction_unit( xO, yO, nCbS, nCbS )
else if( PartMode = = PART_2NxN ) {
prediction_unit( xO, yO, nCbS, nCbS / 2 )
prediction_unit( xO, yO + ( nCbS / 2 ), nCbS, nCbS / 2 )
} else if( PartMode = = PART_Nx2N ) {
prediction_unit( xO, yO, nCbS / 2, nCbS )
prediction_unit( xO + ( nCbS / 2 ), yO, nCbS / 2, nCbS )
} else if( PartMode = = PART_2NxnU ) {
prediction_unit( xO, yO, nCbS, nCbS / 4 )
prediction_unit( xO, yO + ( nCbS / 4 ), nCbS, nCbS * 3 / 4 )
} else if( PartMode = = PART_2NxnD ) {
prediction_unit( xO, yO, nCbS, nCbS * 3 / 4 )
depth_based_blk_part_flag[ layerld ] equal to 0 specifies that depth based block partitioning is not used for the layer with nuh layer id equal to layerld. depth_based_blk_part_flag[ layerld ] equal to 1 specifies that depth based block partitioning might be used for the layer with nuh layer id equal to layerld. When not present, the value of depth_based_blk_part_flag[ layerld ] is inferred to be equal to 0.
In the current design, when dbbp flag is equal to 1, the partition mode is not decided by the part mode, which originally indentifies the prediction partition of the current inter CU. In such case, the virtual depth block which DBBP gets from depth block will be utilized to determine the final partition among Nx2N and 2NxN.
However, such design produces the redundancy in transmitting part mode or dbbp flag, since dbbp flag does not rely on the part mode.
SUMMARY OF THE INVENTION
It is proposed to reduce the redundancy in transmitting dbbp flag by only transmitting dbbp_flag when the part_mode identifies a 2NxN or Nx2N PU partition, especially when the
part mode identifies the partition which DBBP utilizes.
Other aspects and features of the invention will become apparent to those with ordinary skill in the art upon review of the following descriptions of specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
The invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
Fig. 1 is a diagram illustrating the suggested encoding and decoder order of part mode and dbbp flag.
Fig. 2 is a diagram illustrating when dbbp flag is transmitted before part mode, if dbbp flag is equal to 1, part mode only identifies two partition patterns for DBBP, Nx2N or 2NxN.
DETAILED DESCRIPTION
The following description is of the best-contemplated mode of carrying out the invention.
This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
There are kinds of methods proposed for transmitting and specifying the flags of part mode and dbbp flag for DBBP.
In a first embodiment, dbbp flag is still transmitted after part mode but only in the case when the part_mode specifies a 2NxN or Nx2N prediction unit(PU) partition, as shown in Fig.
1.
In a second embodiment, dbbp flag is still transmitted after part mode but only in the case when the part_mode identifies a prediction unit partition belonging to a subset of {2Nx2N, Nx2N, 2NxN, NxN, 2NxnU, 2NxnD, nLx2N and nRx2N}.
In a third embodiment, when dbbp flag is T, the PU partition which the part mode identifies is just the prediction partition which DBBP utilizes.
In a fourth embodiment, the dbbp flag is transmitted before part mode, but part mode is transmitted only when dbbp flag equal to 1. In this case, the prediction partition which DBBP utilizes is derived from virtual depth block.
In a fifth embodiment, when the dbbp flag is transmitted before part mode, the binarization of part mode is different when dbbp flag is equal to 0 and 1.
In a sixth embodiment, when the dbbp flag is transmitted before part mode, if the
dbbp flag is equal to 1, the part mode only identifies two partition patterns for DBBP, Nx2N or 2NxN, as shown in Fig. 2. For example, part mode equal to 1 when the partition for DBBP is 2NxN.
In a seventh embodiment, when the dbbp flag is transmitted before part mode, the context utilized for coding part mode is different when dbbp flag is equal to 0 and 1.
In an eighth embodiment, when the dbbp flag is transmitted after part mode, the dbbp flag is signalized in cu extention syntax table, and transmitted only in case of the current prediction mode is not intra and part mode only identifies two partition patterns for DBBP, e.g., Nx2N or 2NxN.
In a ninth embodiment, when the dbbp flag is transmitted after part mode, the dbbp flag is signalized in cu extention syntax table, and transmitted only in case of the current prediction mode is not intra and part_mode does not identify 2Nx2N or NxN PU partition.
In a tenth embodiment, any methods belonging to the first to ninth embodiments are combined together.
The proposed method described above can be used in a video encoder as well as in a video decoder. Embodiments of the method according to the present invention as described above may be implemented in various hardware, software codes, or a combination of both. For example, an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein. An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention. The software code or firmware codes may be developed in different programming languages and different format or style. The software code may also be compiled for different target platform. However, different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. To the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art). Therefore, the scope of
the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.
Claims
1. A method of depth-based block partition for multi-view video coding or 3D video coding comprising, transmission of dbbp flag and part mode has dependency, no matter whether depth-based block partitioning (DBBP)utilizes part mode as its prediction partition or not.
2. The method of as claimed in claim 1, wherein when dbbp flag is T, a prediction unit (PU) partition which part mode identifies is just a prediction partition which DBBP utilizes.
3. The method of as claimed in claim 1, wherein dbbp flag is transmitted after part mode but only in the case when part mode identifies a prediction unit partition belonging to a subset of {2Nx2N, Nx2N, 2NxN, NxN, 2NxnU, 2NxnD, nLx2N and nRx2N}.
4. The method of as claimed in claim 2, wherein dbbp flag is transmitted after part mode, but only in the case when part_mode identifies partitions with two segments comprising Nx2N, 2NxN, 2NxnU, 2NxnD, nLx2N or nRx2N.
5. The method of as claimed in claim 2, wherein dbbp flag is transmitted after part mode, but only in the case when part_mode does not identify 2Nx2N or NxN prediction unit partition.
6. The method of as claimed in claim 2, wherein dbbp flag is transmitted after part mode when a current prediction mode is inter prediction, dbbp is available and part mode does not identify 2Nx2N or NxN prediction unit partition.
7. The method of as claimed in claim 2, wherein dbbp flag is transmitted after part mode, but only in the case when part_mode identifies a 2NxN or Nx2N prediction unit partition.
8. The method of as claimed in claim 1, wherein dbbp flag is transmitted before part mode, but part mode is transmitted only when dbbp flag equal to 1, wherein a prediction partition which DBBP utilizes is derived from virtual depth block.
9. The method of as claimed in claim 2, wherein dbbp flag is transmitted before part mode, binarization of part mode is different when dbbp flag is equal to 0 and 1.
10. The method of as claimed in claim 9, wherein when dbbp flag is transmitted before part mode, if dbbp flag is equal to 1, part mode only specifies two limited partition patterns of
2Nx2N, Nx2N, 2NxN, NxN, 2NxnU, 2NxnD, nLx2N and nRx2N.
11. The method of as claimed in claim 10, wherein when dbbp flag is transmitted before part mode, if dbbp flag is equal to 1, part mode only specifies two partition patterns for DBBP,
Nx2N or 2NxN, wherein part_mode equal to 1 when the partition for DBBP is 2NxN.
12. The method of as claimed in claim 9, wherein when dbbp flag is transmitted before part mode, contexts utilized for coding part mode are different when dbbp flag is equal to 0
and 1.
13. The method of as claimed in claim 2, wherein dbbp flag is transmitted after part mode in a syntax table of cu_extension, but only in the case when part_mode identifies a 2NxN or Nx2N prediction unit partition.
14. The method of as claimed in claim 2, wherein dbbp flag is transmitted after part mode in a syntax table of cu extension, but only in the case when part mode is not intra prediction and does not identify a 2Nx2N or NxN PU partition.
15. The method of as claimed in claim 2, wherein dbbp flag is transmitted after part mode in a syntax table of cu extension, but only in the case when part mode is not intra prediction and identifies the partitions with two segments.
16. The method of as claimed in claim 10, wherein when dbbp flag is transmitted before part mode, if dbbp flag is equal to 1, part mode only specifies partition pattern with 2 segments.
17. The method of as claimed in claim 10, wherein when dbbp flag is transmitted before part mode, if dbbp flag is equal to 1, part mode does not specifies partition pattern of NxN or 2Nx2N for DBBP.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2014/080862 WO2015196424A1 (en) | 2014-06-26 | 2014-06-26 | Methods for the transmission of flags related to dbbp |
CN201510099936.9A CN104935940B (en) | 2014-03-17 | 2015-03-06 | The signal transfer method of block segmentation based on depth |
US14/656,993 US9838712B2 (en) | 2014-03-17 | 2015-03-13 | Method of signaling for depth-based block partitioning |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2014/080862 WO2015196424A1 (en) | 2014-06-26 | 2014-06-26 | Methods for the transmission of flags related to dbbp |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015196424A1 true WO2015196424A1 (en) | 2015-12-30 |
Family
ID=54936486
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2014/080862 WO2015196424A1 (en) | 2014-03-17 | 2014-06-26 | Methods for the transmission of flags related to dbbp |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2015196424A1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103281541A (en) * | 2013-05-10 | 2013-09-04 | 北方工业大学 | Wedge-shaped block intra-frame prediction method based on depth images |
CN103299634A (en) * | 2010-11-22 | 2013-09-11 | 联发科技(新加坡)私人有限公司 | Apparatus and method of constrained partition size for high efficiency video coding |
WO2014005248A1 (en) * | 2012-07-02 | 2014-01-09 | Qualcomm Incorporated | Intra-coding of depth maps for 3d video coding |
CN103621093A (en) * | 2011-06-15 | 2014-03-05 | 联发科技股份有限公司 | Method and apparatus of texture image compression in 3D video coding |
WO2014053095A1 (en) * | 2012-10-03 | 2014-04-10 | Mediatek Inc. | Method and apparatus for inter-component motion prediction in three-dimensional video coding |
CN103780910A (en) * | 2014-01-21 | 2014-05-07 | 华为技术有限公司 | Method and device for determining block segmentation mode and optical prediction mode in video coding |
-
2014
- 2014-06-26 WO PCT/CN2014/080862 patent/WO2015196424A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103299634A (en) * | 2010-11-22 | 2013-09-11 | 联发科技(新加坡)私人有限公司 | Apparatus and method of constrained partition size for high efficiency video coding |
CN103621093A (en) * | 2011-06-15 | 2014-03-05 | 联发科技股份有限公司 | Method and apparatus of texture image compression in 3D video coding |
WO2014005248A1 (en) * | 2012-07-02 | 2014-01-09 | Qualcomm Incorporated | Intra-coding of depth maps for 3d video coding |
WO2014053095A1 (en) * | 2012-10-03 | 2014-04-10 | Mediatek Inc. | Method and apparatus for inter-component motion prediction in three-dimensional video coding |
CN103281541A (en) * | 2013-05-10 | 2013-09-04 | 北方工业大学 | Wedge-shaped block intra-frame prediction method based on depth images |
CN103780910A (en) * | 2014-01-21 | 2014-05-07 | 华为技术有限公司 | Method and device for determining block segmentation mode and optical prediction mode in video coding |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11234002B2 (en) | Method and apparatus for encoding and decoding a texture block using depth based block partitioning | |
US9743110B2 (en) | Method of 3D or multi-view video coding including view synthesis prediction | |
KR101706309B1 (en) | Method and apparatus of inter-view candidate derivation for three-dimensional video coding | |
WO2015192781A1 (en) | Method of sub-pu syntax signaling and illumination compensation for 3d and multi-view video coding | |
US10085041B2 (en) | Method for depth lookup table signaling | |
WO2015176678A1 (en) | Method of intra block copy with flipping for image and video coding | |
WO2015062002A1 (en) | Methods for sub-pu level prediction | |
WO2016008157A1 (en) | Methods for motion compensation using high order motion model | |
WO2015109598A1 (en) | Methods for motion parameter hole filling | |
WO2015003383A1 (en) | Methods for inter-view motion prediction | |
WO2015123806A1 (en) | Methods for depth based block partitioning | |
WO2015100731A1 (en) | Methods for determining the prediction partitions | |
US20150264399A1 (en) | Method of signaling for depth-based block partitioning | |
WO2015100710A1 (en) | Existence of inter-view reference picture and availability of 3dvc coding tools | |
WO2015135175A1 (en) | Simplified depth based block partitioning method | |
US9716884B2 (en) | Method of signaling for mode selection in 3D and multi-view video coding | |
WO2015192372A1 (en) | A simplified method for illumination compensation in multi-view and 3d video coding | |
WO2014029086A1 (en) | Methods to improve motion vector inheritance and inter-view motion prediction for depth map | |
WO2015196424A1 (en) | Methods for the transmission of flags related to dbbp | |
WO2016123801A1 (en) | Methods for partition mode coding | |
WO2015103747A1 (en) | Motion parameter hole filling | |
WO2015192314A1 (en) | A simplified method for depth based block partitioning | |
WO2015139183A1 (en) | Method of signaling of depth-based block partitioning mode for three-dimensional and multi-view video coding | |
WO2015096093A1 (en) | Simplified cabac contexts in 3dvc | |
WO2015113245A1 (en) | Methods for merging candidates list construction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14895593 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14895593 Country of ref document: EP Kind code of ref document: A1 |