WO2014166100A1 - A flexible dlt signaling method - Google Patents
A flexible dlt signaling method Download PDFInfo
- Publication number
- WO2014166100A1 WO2014166100A1 PCT/CN2013/074125 CN2013074125W WO2014166100A1 WO 2014166100 A1 WO2014166100 A1 WO 2014166100A1 CN 2013074125 W CN2013074125 W CN 2013074125W WO 2014166100 A1 WO2014166100 A1 WO 2014166100A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- dlt
- slice
- signalled
- transmitted
- level
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
- G06T9/004—Predictors, e.g. intraframe, interframe coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
Definitions
- the invention relates generally to Three-Dimensional (3D) video processing.
- the present invention relates to the depth lookup table in the simplified depth coding.
- SDC Simplified depth coding
- DLT depth lookup table
- the DLT is constructed based on an initial analysis of the input depth map and is then coded in a sequence parameter set (SPS).
- SPS sequence parameter set
- DLT is an optional coding tool.
- the encoder will not use DLT if more than half the values from 0 to MAX_DEPTH_VALUE (e.g. , 255 for 8-bit depth samples) appear in the original depth map at the analysis step. Otherwise, DLT will be coded in SPS.
- the number of valid depth values is coded with Exp-Golomb code first. Then each valid depth value is also coded with an exp-Golomb code.
- DLT Depth Lookup Table
- Fig. 1 is a diagram illustrating an example of DLT, there are five valid values appears in depth samples at the analysis step, therefore, there are five items in DLT in the order: 50, 108, 110, 112 and 200.
- a flexible DLT signalling method is proposed, which can keep both the benefits of signalling DLT in the intra- slice header and in SPS.
- one or more DLTs may be constructed based on an initial analysis, and then these DLTs are coded in SPS. Alternately, there may be no DLT coded in SPS.
- a flag is signalled in the slice header to indicate whether a DLT coded in SPS is used for this slice, or a new DLT coded in the slice header is used. In the former case, an additional index is signalled to indicate which one is selected if there are more than one DLTs coded in SPS.
- RCBM [3] is used to code DLT.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
In this proposal, a flexible Depth Lookup Table (DLT) signalling method is proposed. By signalling DLT in SPS or in the slice header optionally, DLT can be more robust to scene change without introducing too many overhead bits. Experimental results show that the coding performance is similar to the anchor.
Description
A FLEXIBLE DLT SIGNALING METHOD
TECHNICAL FIELD
[0001] The invention relates generally to Three-Dimensional (3D) video processing. In particular, the present invention relates to the depth lookup table in the simplified depth coding.
BACKGROUND
[0002] Simplified depth coding (SDC) and a depth lookup table (DLT) are adopted into HTM [1] [2] . For each depth coding unit (CU), if SDC is selected, one of three different prediction modes, DC, Planar and DMM-1 can be selected. After the prediction, the residual is not coded using transform. As the SDC prediction stage always results in one or two depth segments per coded block, a single residual DC depth value is coded for each of these segments. Moreover, the DLT is used to map coded depth values in SDC to valid depth values of the original depth map. Fig.l demonstrates an example of DLT approach.
[0003] The DLT is constructed based on an initial analysis of the input depth map and is then coded in a sequence parameter set (SPS).
[0004] DLT is an optional coding tool. In the current HTM, the encoder will not use DLT if more than half the values from 0 to MAX_DEPTH_VALUE (e.g. , 255 for 8-bit depth samples) appear in the original depth map at the analysis step. Otherwise, DLT will be coded in SPS. In order to code DLT, the number of valid depth values is coded with Exp-Golomb code first. Then each valid depth value is also coded with an exp-Golomb code.
[0005] To make the DLT coding more efficient, it is proposed to code DLT with a range constrained bit map (RCBM) approach in C0142 [3] . It has been shown that RCBM can reduce DLT bits significantly.
[0006] To make the DLT robust to scene change, it is proposed to signal DLT in the intra-slice header instead of the SPS in C0093 [4] . As the Core Experiment (CE) 6 [5] described, it should also be under consideration to signal DLT in all slice headers. Despite of the adaptation to varying scene, signalling DLT in the intra-slice header
results in much more DLT bits compared with in SPS.
SUMMARY
[0007] In light of the previously described problems, this contribution presents a flexible Depth Lookup Table (DLT) signalling method in 3D-HEVC. First, one or more DLTs may be constructed based on an initial analysis, and then these DLTs are coded in SPS. Alternately, there may be no DLT coded in SPS. Second, a flag is signalled in the slice header to indicate whether a DLT coded in SPS is used for this slice, or a new DLT coded in the slice header is used. In the former case, an additional index is signalled to indicate which one is selected if there are more than one DLTs coded in SPS. The proposed method can make the DLT robust to scene change without introducing too many overhead bits. Experimental results show that the coding performance is similar to the anchor.
[0008] Other aspects and features of the invention will become apparent to those with ordinary skill in the art upon review of the following descriptions of specific embodiments.
BRIEF DESCRIPTION OF DRAWINGS
The invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
[0009] Fig. 1 is a diagram illustrating an example of DLT, there are five valid values appears in depth samples at the analysis step, therefore, there are five items in DLT in the order: 50, 108, 110, 112 and 200.
DETAILED DESCRIPTION [0010] The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general
principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
[0011] A flexible DLT signalling method is proposed, which can keep both the benefits of signalling DLT in the intra- slice header and in SPS. First, one or more DLTs may be constructed based on an initial analysis, and then these DLTs are coded in SPS. Alternately, there may be no DLT coded in SPS. Second, a flag is signalled in the slice header to indicate whether a DLT coded in SPS is used for this slice, or a new DLT coded in the slice header is used. In the former case, an additional index is signalled to indicate which one is selected if there are more than one DLTs coded in SPS. RCBM [3] is used to code DLT.
Claims
1. A method of signalling depth lookup table (DLT) in three-dimensional video coding (3DVC).
2. The method as claimed in claim 1, wherein more than one DLT is signalled for one depth component.
3. The method as claimed in claim 1, wherein the DLT is signalled in more than one syntax structure for one depth component.
4. The method as claimed in claim 3, wherein the DLT is signalled in video, view, sequences, or picture level, comprising view parameter set (VPS), sequence parameter set (SPS) or picture parameter set (PPS).
5. The method as claimed in claim 3, wherein the DLT is signalled in slice level or slice header.
6. The method as claimed in claim 1, wherein different slices use different DLTs.
7. The method as claimed in claim 1, wherein a current slice uses DLT signalled in sequence level and signalled in slice level adaptively.
8. The method as claimed in claim 7, wherein a flag is transmitted from an encoder to a decoder to indicate whether the DLT is signalled in sequence level or slice level for the current slice.
9. The method as claimed in claim 7, wherein the DLT is signalled in a current slice if it is indicated that the DLT signalled in slice level is used; and the DLT is not signalled in the current slice if it is indicated that the DLT signalled in sequence level is used.
10. The method as claimed in claim 9, wherein the DLT is only signalled if the current slice is an I-slice.
11. The method as claimed in claim 7, wherein additional information is transmitted from an encoder to a decoder if it is indicated that a DLT signalled in sequence level is used and more than one DLT are signalled in sequence level; and the additional information indicates which DLT signalled in sequence level is used in the current slice; wherein the additional information is transmitted in slice level or slice header.
12. The method as claimed in claim 7, wherein the DLT is not signalled in the current slice if it is indicated that the DLT signalled in slice level is used, and a DLT used in a reference picture is used in the current slice.
13. The method as claimed in claim 12, wherein only one DLT is used for all slices belonging to a picture.
14. The method as claimed in claim 12, wherein additional information is transmitted from an encoder to decoder to indicate whether DLT is signalled or not in the current slice, if DLT is not signalled in the current slice, a DLT used in a reference picture is used in the current slice; the additional information is transmitted in slice level or slice header.
15. The method as claimed in claim 12, wherein additional information is transmitted from an encoder to a decoder to indicate the DLT used in which reference picture is used in the current slice; and the additional information is transmitted in slice level or slice header.
16. The method as claimed in claim 15, wherein the reference picture is indicated by a reference list and reference index.
17. The method as claimed in claim 1, wherein a set of DLT is transmitted in a
SPS level, and a syntax is first transmitted to indicate the number of DLTs to be transmitted in a SPS header; each DLT is coded and transmitted sequentially in the SPS header.
18. The method as claimed in claim 1, wherein a flag is signaled in a slice header to indicate whether a DLT transmitted is SPS is used or not; if none of the DLT transmitted is SPS is used, a second flag is signaled to indicate whether the DLT is inherited from a previous coded picture/slice or a new DLT is coded in the current slice header.
19. The method as claimed in claim 18, wherein when the DLT is inherited from the previous coded picture, the DLT is inherited from the previous coded I- picture/slice with a smallest POC distance.
20. The method as claimed in claim 18, wherein when the DLT is inherited from previous coded picture, a flag is transmitted to indicate which reference picture list is selected and another flag is also transmitted to indicate the DLT is inherited from which reference picture in the selected reference picture list.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2013/074125 WO2014166100A1 (en) | 2013-04-12 | 2013-04-12 | A flexible dlt signaling method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2013/074125 WO2014166100A1 (en) | 2013-04-12 | 2013-04-12 | A flexible dlt signaling method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2014166100A1 true WO2014166100A1 (en) | 2014-10-16 |
Family
ID=51688872
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2013/074125 Ceased WO2014166100A1 (en) | 2013-04-12 | 2013-04-12 | A flexible dlt signaling method |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2014166100A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3108656A4 (en) * | 2014-03-18 | 2017-08-02 | HFI Innovation Inc. | Method for depth lookup table signaling in 3d video coding based on high efficiency video coding standard |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090002368A1 (en) * | 2007-06-26 | 2009-01-01 | Nokia Corporation | Method, apparatus and a computer program product for utilizing a graphical processing unit to provide depth information for autostereoscopic display |
| US20090161989A1 (en) * | 2007-12-21 | 2009-06-25 | Samsung Electronics Co., Ltd. | Method, medium, and apparatus representing adaptive information of 3D depth image |
| CN102292993A (en) * | 2009-01-20 | 2011-12-21 | Lg电子株式会社 | Three-dimensional subtitle display method and three-dimensional display device for implementing the same |
-
2013
- 2013-04-12 WO PCT/CN2013/074125 patent/WO2014166100A1/en not_active Ceased
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090002368A1 (en) * | 2007-06-26 | 2009-01-01 | Nokia Corporation | Method, apparatus and a computer program product for utilizing a graphical processing unit to provide depth information for autostereoscopic display |
| US20090161989A1 (en) * | 2007-12-21 | 2009-06-25 | Samsung Electronics Co., Ltd. | Method, medium, and apparatus representing adaptive information of 3D depth image |
| CN102292993A (en) * | 2009-01-20 | 2011-12-21 | Lg电子株式会社 | Three-dimensional subtitle display method and three-dimensional display device for implementing the same |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3108656A4 (en) * | 2014-03-18 | 2017-08-02 | HFI Innovation Inc. | Method for depth lookup table signaling in 3d video coding based on high efficiency video coding standard |
| US9800896B2 (en) | 2014-03-18 | 2017-10-24 | Hfi Innovation Inc. | Method for depth lookup table signaling |
| US10085041B2 (en) | 2014-03-18 | 2018-09-25 | Hfi Innovation Inc. | Method for depth lookup table signaling |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11968385B2 (en) | Encoder and decoder and methods thereof for encoding/decoding a picture of a video sequence | |
| JP2017525248A5 (en) | ||
| US20200336748A1 (en) | Coded-block-flag coding and derivation | |
| CA2893011C (en) | Method and apparatus for efficient coding of depth lookup table | |
| JP2017523672A5 (en) | ||
| WO2015139187A1 (en) | Low latency encoder decision making for illumination compensation and depth look-up table transmission in video coding | |
| RU2014133415A (en) | CODING SETS OF PARAMETERS AND TITLES OF NAL UNITS FOR VIDEO ENCODING | |
| WO2008051381A4 (en) | Picture management for multi-view video coding | |
| JP2017513352A5 (en) | ||
| WO2014166119A1 (en) | Stereo compatibility high level syntax | |
| WO2016165603A1 (en) | Encoding and decoding method and device for video data | |
| WO2012171463A4 (en) | Method and apparatus for coding of intra prediction mode | |
| KR20140085456A (en) | reference picture list handling | |
| WO2008048515B1 (en) | Method for reference picture management involving multiview video coding | |
| JP2015507428A5 (en) | ||
| RU2015115522A (en) | BIT FLOW TEST | |
| JP2015523012A5 (en) | ||
| KR20170073723A (en) | Apparatus, method, and computer readable medium for encoding | |
| BR112016021113B1 (en) | DEPTH CODING METHOD AND APPARATUS USING A DEPTH LOOKUP TABLE (DLT) | |
| JP2015527806A (en) | Video signal processing method and apparatus | |
| KR20090099547A (en) | Method and apparatus for video error correction in multiview coding video | |
| CN104396242A (en) | Encoding and decoding a video sequence including a set of reference pictures | |
| US10499075B2 (en) | Method for coding a depth lookup table | |
| WO2014089805A1 (en) | A new reference management method for video coding | |
| WO2016003130A1 (en) | Method and apparatus for performing arithmetic coding by limited carry operation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13881539 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 13881539 Country of ref document: EP Kind code of ref document: A1 |