WO2014166100A1 - A flexible dlt signaling method - Google Patents

A flexible dlt signaling method Download PDF

Info

Publication number
WO2014166100A1
WO2014166100A1 PCT/CN2013/074125 CN2013074125W WO2014166100A1 WO 2014166100 A1 WO2014166100 A1 WO 2014166100A1 CN 2013074125 W CN2013074125 W CN 2013074125W WO 2014166100 A1 WO2014166100 A1 WO 2014166100A1
Authority
WO
WIPO (PCT)
Prior art keywords
dlt
slice
signalled
transmitted
level
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2013/074125
Other languages
French (fr)
Inventor
Kai Zhang
Yu-Wen Huang
Jian-Liang Lin
Jicheng An
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Singapore Pte Ltd
Original Assignee
MediaTek Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MediaTek Singapore Pte Ltd filed Critical MediaTek Singapore Pte Ltd
Priority to PCT/CN2013/074125 priority Critical patent/WO2014166100A1/en
Publication of WO2014166100A1 publication Critical patent/WO2014166100A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding
    • G06T9/004Predictors, e.g. intraframe, interframe coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding

Definitions

  • the invention relates generally to Three-Dimensional (3D) video processing.
  • the present invention relates to the depth lookup table in the simplified depth coding.
  • SDC Simplified depth coding
  • DLT depth lookup table
  • the DLT is constructed based on an initial analysis of the input depth map and is then coded in a sequence parameter set (SPS).
  • SPS sequence parameter set
  • DLT is an optional coding tool.
  • the encoder will not use DLT if more than half the values from 0 to MAX_DEPTH_VALUE (e.g. , 255 for 8-bit depth samples) appear in the original depth map at the analysis step. Otherwise, DLT will be coded in SPS.
  • the number of valid depth values is coded with Exp-Golomb code first. Then each valid depth value is also coded with an exp-Golomb code.
  • DLT Depth Lookup Table
  • Fig. 1 is a diagram illustrating an example of DLT, there are five valid values appears in depth samples at the analysis step, therefore, there are five items in DLT in the order: 50, 108, 110, 112 and 200.
  • a flexible DLT signalling method is proposed, which can keep both the benefits of signalling DLT in the intra- slice header and in SPS.
  • one or more DLTs may be constructed based on an initial analysis, and then these DLTs are coded in SPS. Alternately, there may be no DLT coded in SPS.
  • a flag is signalled in the slice header to indicate whether a DLT coded in SPS is used for this slice, or a new DLT coded in the slice header is used. In the former case, an additional index is signalled to indicate which one is selected if there are more than one DLTs coded in SPS.
  • RCBM [3] is used to code DLT.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

In this proposal, a flexible Depth Lookup Table (DLT) signalling method is proposed. By signalling DLT in SPS or in the slice header optionally, DLT can be more robust to scene change without introducing too many overhead bits. Experimental results show that the coding performance is similar to the anchor.

Description

A FLEXIBLE DLT SIGNALING METHOD
TECHNICAL FIELD
[0001] The invention relates generally to Three-Dimensional (3D) video processing. In particular, the present invention relates to the depth lookup table in the simplified depth coding.
BACKGROUND
[0002] Simplified depth coding (SDC) and a depth lookup table (DLT) are adopted into HTM [1] [2] . For each depth coding unit (CU), if SDC is selected, one of three different prediction modes, DC, Planar and DMM-1 can be selected. After the prediction, the residual is not coded using transform. As the SDC prediction stage always results in one or two depth segments per coded block, a single residual DC depth value is coded for each of these segments. Moreover, the DLT is used to map coded depth values in SDC to valid depth values of the original depth map. Fig.l demonstrates an example of DLT approach.
[0003] The DLT is constructed based on an initial analysis of the input depth map and is then coded in a sequence parameter set (SPS).
[0004] DLT is an optional coding tool. In the current HTM, the encoder will not use DLT if more than half the values from 0 to MAX_DEPTH_VALUE (e.g. , 255 for 8-bit depth samples) appear in the original depth map at the analysis step. Otherwise, DLT will be coded in SPS. In order to code DLT, the number of valid depth values is coded with Exp-Golomb code first. Then each valid depth value is also coded with an exp-Golomb code.
[0005] To make the DLT coding more efficient, it is proposed to code DLT with a range constrained bit map (RCBM) approach in C0142 [3] . It has been shown that RCBM can reduce DLT bits significantly.
[0006] To make the DLT robust to scene change, it is proposed to signal DLT in the intra-slice header instead of the SPS in C0093 [4] . As the Core Experiment (CE) 6 [5] described, it should also be under consideration to signal DLT in all slice headers. Despite of the adaptation to varying scene, signalling DLT in the intra-slice header results in much more DLT bits compared with in SPS.
SUMMARY
[0007] In light of the previously described problems, this contribution presents a flexible Depth Lookup Table (DLT) signalling method in 3D-HEVC. First, one or more DLTs may be constructed based on an initial analysis, and then these DLTs are coded in SPS. Alternately, there may be no DLT coded in SPS. Second, a flag is signalled in the slice header to indicate whether a DLT coded in SPS is used for this slice, or a new DLT coded in the slice header is used. In the former case, an additional index is signalled to indicate which one is selected if there are more than one DLTs coded in SPS. The proposed method can make the DLT robust to scene change without introducing too many overhead bits. Experimental results show that the coding performance is similar to the anchor.
[0008] Other aspects and features of the invention will become apparent to those with ordinary skill in the art upon review of the following descriptions of specific embodiments.
BRIEF DESCRIPTION OF DRAWINGS
The invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
[0009] Fig. 1 is a diagram illustrating an example of DLT, there are five valid values appears in depth samples at the analysis step, therefore, there are five items in DLT in the order: 50, 108, 110, 112 and 200.
DETAILED DESCRIPTION [0010] The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
[0011] A flexible DLT signalling method is proposed, which can keep both the benefits of signalling DLT in the intra- slice header and in SPS. First, one or more DLTs may be constructed based on an initial analysis, and then these DLTs are coded in SPS. Alternately, there may be no DLT coded in SPS. Second, a flag is signalled in the slice header to indicate whether a DLT coded in SPS is used for this slice, or a new DLT coded in the slice header is used. In the former case, an additional index is signalled to indicate which one is selected if there are more than one DLTs coded in SPS. RCBM [3] is used to code DLT.

Claims

1. A method of signalling depth lookup table (DLT) in three-dimensional video coding (3DVC).
2. The method as claimed in claim 1, wherein more than one DLT is signalled for one depth component.
3. The method as claimed in claim 1, wherein the DLT is signalled in more than one syntax structure for one depth component.
4. The method as claimed in claim 3, wherein the DLT is signalled in video, view, sequences, or picture level, comprising view parameter set (VPS), sequence parameter set (SPS) or picture parameter set (PPS).
5. The method as claimed in claim 3, wherein the DLT is signalled in slice level or slice header.
6. The method as claimed in claim 1, wherein different slices use different DLTs.
7. The method as claimed in claim 1, wherein a current slice uses DLT signalled in sequence level and signalled in slice level adaptively.
8. The method as claimed in claim 7, wherein a flag is transmitted from an encoder to a decoder to indicate whether the DLT is signalled in sequence level or slice level for the current slice.
9. The method as claimed in claim 7, wherein the DLT is signalled in a current slice if it is indicated that the DLT signalled in slice level is used; and the DLT is not signalled in the current slice if it is indicated that the DLT signalled in sequence level is used.
10. The method as claimed in claim 9, wherein the DLT is only signalled if the current slice is an I-slice.
11. The method as claimed in claim 7, wherein additional information is transmitted from an encoder to a decoder if it is indicated that a DLT signalled in sequence level is used and more than one DLT are signalled in sequence level; and the additional information indicates which DLT signalled in sequence level is used in the current slice; wherein the additional information is transmitted in slice level or slice header.
12. The method as claimed in claim 7, wherein the DLT is not signalled in the current slice if it is indicated that the DLT signalled in slice level is used, and a DLT used in a reference picture is used in the current slice.
13. The method as claimed in claim 12, wherein only one DLT is used for all slices belonging to a picture.
14. The method as claimed in claim 12, wherein additional information is transmitted from an encoder to decoder to indicate whether DLT is signalled or not in the current slice, if DLT is not signalled in the current slice, a DLT used in a reference picture is used in the current slice; the additional information is transmitted in slice level or slice header.
15. The method as claimed in claim 12, wherein additional information is transmitted from an encoder to a decoder to indicate the DLT used in which reference picture is used in the current slice; and the additional information is transmitted in slice level or slice header.
16. The method as claimed in claim 15, wherein the reference picture is indicated by a reference list and reference index.
17. The method as claimed in claim 1, wherein a set of DLT is transmitted in a
SPS level, and a syntax is first transmitted to indicate the number of DLTs to be transmitted in a SPS header; each DLT is coded and transmitted sequentially in the SPS header.
18. The method as claimed in claim 1, wherein a flag is signaled in a slice header to indicate whether a DLT transmitted is SPS is used or not; if none of the DLT transmitted is SPS is used, a second flag is signaled to indicate whether the DLT is inherited from a previous coded picture/slice or a new DLT is coded in the current slice header.
19. The method as claimed in claim 18, wherein when the DLT is inherited from the previous coded picture, the DLT is inherited from the previous coded I- picture/slice with a smallest POC distance.
20. The method as claimed in claim 18, wherein when the DLT is inherited from previous coded picture, a flag is transmitted to indicate which reference picture list is selected and another flag is also transmitted to indicate the DLT is inherited from which reference picture in the selected reference picture list.
PCT/CN2013/074125 2013-04-12 2013-04-12 A flexible dlt signaling method Ceased WO2014166100A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2013/074125 WO2014166100A1 (en) 2013-04-12 2013-04-12 A flexible dlt signaling method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2013/074125 WO2014166100A1 (en) 2013-04-12 2013-04-12 A flexible dlt signaling method

Publications (1)

Publication Number Publication Date
WO2014166100A1 true WO2014166100A1 (en) 2014-10-16

Family

ID=51688872

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/074125 Ceased WO2014166100A1 (en) 2013-04-12 2013-04-12 A flexible dlt signaling method

Country Status (1)

Country Link
WO (1) WO2014166100A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3108656A4 (en) * 2014-03-18 2017-08-02 HFI Innovation Inc. Method for depth lookup table signaling in 3d video coding based on high efficiency video coding standard

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090002368A1 (en) * 2007-06-26 2009-01-01 Nokia Corporation Method, apparatus and a computer program product for utilizing a graphical processing unit to provide depth information for autostereoscopic display
US20090161989A1 (en) * 2007-12-21 2009-06-25 Samsung Electronics Co., Ltd. Method, medium, and apparatus representing adaptive information of 3D depth image
CN102292993A (en) * 2009-01-20 2011-12-21 Lg电子株式会社 Three-dimensional subtitle display method and three-dimensional display device for implementing the same

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090002368A1 (en) * 2007-06-26 2009-01-01 Nokia Corporation Method, apparatus and a computer program product for utilizing a graphical processing unit to provide depth information for autostereoscopic display
US20090161989A1 (en) * 2007-12-21 2009-06-25 Samsung Electronics Co., Ltd. Method, medium, and apparatus representing adaptive information of 3D depth image
CN102292993A (en) * 2009-01-20 2011-12-21 Lg电子株式会社 Three-dimensional subtitle display method and three-dimensional display device for implementing the same

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3108656A4 (en) * 2014-03-18 2017-08-02 HFI Innovation Inc. Method for depth lookup table signaling in 3d video coding based on high efficiency video coding standard
US9800896B2 (en) 2014-03-18 2017-10-24 Hfi Innovation Inc. Method for depth lookup table signaling
US10085041B2 (en) 2014-03-18 2018-09-25 Hfi Innovation Inc. Method for depth lookup table signaling

Similar Documents

Publication Publication Date Title
US11968385B2 (en) Encoder and decoder and methods thereof for encoding/decoding a picture of a video sequence
JP2017525248A5 (en)
US20200336748A1 (en) Coded-block-flag coding and derivation
CA2893011C (en) Method and apparatus for efficient coding of depth lookup table
JP2017523672A5 (en)
WO2015139187A1 (en) Low latency encoder decision making for illumination compensation and depth look-up table transmission in video coding
RU2014133415A (en) CODING SETS OF PARAMETERS AND TITLES OF NAL UNITS FOR VIDEO ENCODING
WO2008051381A4 (en) Picture management for multi-view video coding
JP2017513352A5 (en)
WO2014166119A1 (en) Stereo compatibility high level syntax
WO2016165603A1 (en) Encoding and decoding method and device for video data
WO2012171463A4 (en) Method and apparatus for coding of intra prediction mode
KR20140085456A (en) reference picture list handling
WO2008048515B1 (en) Method for reference picture management involving multiview video coding
JP2015507428A5 (en)
RU2015115522A (en) BIT FLOW TEST
JP2015523012A5 (en)
KR20170073723A (en) Apparatus, method, and computer readable medium for encoding
BR112016021113B1 (en) DEPTH CODING METHOD AND APPARATUS USING A DEPTH LOOKUP TABLE (DLT)
JP2015527806A (en) Video signal processing method and apparatus
KR20090099547A (en) Method and apparatus for video error correction in multiview coding video
CN104396242A (en) Encoding and decoding a video sequence including a set of reference pictures
US10499075B2 (en) Method for coding a depth lookup table
WO2014089805A1 (en) A new reference management method for video coding
WO2016003130A1 (en) Method and apparatus for performing arithmetic coding by limited carry operation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13881539

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13881539

Country of ref document: EP

Kind code of ref document: A1