WO2008049271A1 - New syntax elements to svc to support color bit depth scalability - Google Patents

New syntax elements to svc to support color bit depth scalability Download PDF

Info

Publication number
WO2008049271A1
WO2008049271A1 PCT/CN2006/002848 CN2006002848W WO2008049271A1 WO 2008049271 A1 WO2008049271 A1 WO 2008049271A1 CN 2006002848 W CN2006002848 W CN 2006002848W WO 2008049271 A1 WO2008049271 A1 WO 2008049271A1
Authority
WO
WIPO (PCT)
Prior art keywords
bit
bit depth
color bit
svc
depth
Prior art date
Application number
PCT/CN2006/002848
Other languages
French (fr)
Inventor
Yongying Gao
Yuwen Wu
Original Assignee
Thomson Licensing
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing filed Critical Thomson Licensing
Priority to EP06805054A priority Critical patent/EP2084909A4/en
Priority to CNA2006800561993A priority patent/CN101601298A/en
Priority to PCT/CN2006/002848 priority patent/WO2008049271A1/en
Priority to KR1020097008505A priority patent/KR20090086960A/en
Priority to JP2009533639A priority patent/JP2010507939A/en
Priority to US12/311,922 priority patent/US8306107B2/en
Priority to BRPI0622064-9A priority patent/BRPI0622064A2/en
Publication of WO2008049271A1 publication Critical patent/WO2008049271A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • This invention relates to the bechn ⁇ cal field of digital video coding. It presents a technical solution for a novel type of scalability: color bit depth scalability. Two new syntax elements are presented to be added to SVC.
  • This invention presents a scalable solution to encode the whole 12-bit raw video once to generate one bitstream that contains an H.264/AVC compatible base layer and a scalable enhancement layer. If an H.264 /AVC decoder is available at the client end, only the base layer sub- bitstream is decoded and the decoded 8-bit video can be viewed on a conventional 8-bit display device; if the color bit depth scalable decoder is available at the client end, both the base layer and the enhancement layer sub-bitstreams will be decoded to obtain the 12-bit video and it can be viewed on a -high quality display device that supports more than eight bit.
  • Figure 1 illustrates a framework of color bit depth scalable coding
  • the M-bit video is encoded as the base layer using the inside H.264/AVC encoder.
  • the N-bit video is encoded as the enhancement layer using the scalable encoder.
  • the coding efficiency of the enhancement layer can be significantly improved by utilizing the information of the base layer. We call the utilization of the base layer information in encoding the enhancement layer inter-layer prediction.
  • Each picture a group of Macroblocks (MBs) — will have two access units, one for the base layer and the other one for the enhancement layer.
  • the coded bitstreams will be multiplexed to form a scalable bitstream.
  • base layer decoder will use only the base layer sub-bitstream which is extracted from the whole bitstream, to provide a M-bit reconstructed video. By decoding the whole bitstream, N-bit video can be reconstructed.
  • bit_depth_scalability_flag bit_depth_pred__idc
  • bit_depth_scalability_flag 1 specifies that process of color bit depth prediction shall be invoked in the inter-layer prediction. Otherwise (equal to 0) specified that no process of color bit depth prediction shall be invoked (default) .
  • bit_depth_pred_idc 0 specifies that the operation of bit-shift is utilized as the color bit depth inter-layer prediction (default) . Otherwise is reserved for advanced color bit depth prediction.

Abstract

This invention presents a scalable solution to encode the whole 12-bit raw video once to generate one bitstream that contains an H.264/AVC compatible base layer and a scalable enhancement layer. If an H.264/AVC decoder is available at the client end, only the base layer sub- bitstream is decoded and the decoded 8-bit video can be viewed on a conventional 8-bit display device; if the color bit depth scalable decoder is available at the client end, both the base layer and the enhancement layer sub-bitstreams will be decoded to obtain the 12-bit video and it can be viewed on a high quality display device that supports more than eight bit.

Description

New Syntax Elements to SVC to Support Color Bit Depth
Scalability Field of this Invention
This invention relates to the bechnάcal field of digital video coding. It presents a technical solution for a novel type of scalability: color bit depth scalability. Two new syntax elements are presented to be added to SVC.
Background of the Invention
In recent years, higher bit color depth rather than the conventional eight bit color depth is more and more desirable in many fields, such as scientific imaging, digital cinema, high-quality-video-enabled computer games, and professional studio and home theatre related applications. Accordingly, the state-of-the-art video coding standard - H.264/AVC - has already included Fidelity Range Extensions, which support up to 14 bits per sample and up to 4:4:4 chroma sampling.
However, none of the existing high bit coding solutions supports color bit depth scalability. Assume that we have a scenario with 2 different decoders (or clients with different requests for the color bit depth, e.g. 12 bit) for the same raw video. The existing H.264/AVC solution is to encoder the 12-bit raw video to generate bitstream no. 1 and then convert the 12-bit raw video to an 8-bit raw video and encode the 8-bit counterpart to generate bitstream no. 2. If we want to deliver the video to different clients that request different bit depths, we have to deliver it twice, or put the 2 bitstreams in one disk together. It is of low efficiency regarding both the compression ratio and the operational complexity.
Summary of the Invention
This invention presents a scalable solution to encode the whole 12-bit raw video once to generate one bitstream that contains an H.264/AVC compatible base layer and a scalable enhancement layer. If an H.264 /AVC decoder is available at the client end, only the base layer sub- bitstream is decoded and the decoded 8-bit video can be viewed on a conventional 8-bit display device; if the color bit depth scalable decoder is available at the client end, both the base layer and the enhancement layer sub-bitstreams will be decoded to obtain the 12-bit video and it can be viewed on a -high quality display device that supports more than eight bit.
Brief description of the drawings
Figure 1 illustrates a framework of color bit depth scalable coding
Detailed description of the preferred embodiment
The framework of the presented color bit depth scalable coding is shown in Figure 1. In Figure 1, two videos will be used as an input to the video codec: N-bit raw video and M-bit (usually 8-bit) video (N>M) . The M-bit video can be either converted from the N-bit raw video or given by other ways . _ _
The M-bit video is encoded as the base layer using the inside H.264/AVC encoder. The N-bit video is encoded as the enhancement layer using the scalable encoder. The coding efficiency of the enhancement layer can be significantly improved by utilizing the information of the base layer. We call the utilization of the base layer information in encoding the enhancement layer inter-layer prediction. Each picture — a group of Macroblocks (MBs) — will have two access units, one for the base layer and the other one for the enhancement layer. The coded bitstreams will be multiplexed to form a scalable bitstream.
During the decoding process, base layer decoder will use only the base layer sub-bitstream which is extracted from the whole bitstream, to provide a M-bit reconstructed video. By decoding the whole bitstream, N-bit video can be reconstructed.
In this part, we present the technical solution to color bit depth scalability. Two new syntax elements are added to SVC SPS in SVC extension (seq_parameter_set_svc_extension ( )) to support color bit depth scalability: bit_depth_scalability_flag and bit_depth_pred__idc, as highlighted. - -
Figure imgf000005_0001
- -
Figure imgf000006_0001
bit_depth_scalability_flag equal to 1 specifies that process of color bit depth prediction shall be invoked in the inter-layer prediction.. Otherwise (equal to 0) specified that no process of color bit depth prediction shall be invoked (default) . bit_depth_pred_idc equal to 0 specifies that the operation of bit-shift is utilized as the color bit depth inter-layer prediction (default) . Otherwise is reserved for advanced color bit depth prediction.

Claims

_ _Claims
1. A method to provide a technical solution to H.264 /AVC scalable extension (SVC) to support color bit depth scalability .
2. The method as claimed in claiml, wherein two news syntax elements are added to SVC SPS syntax — seq parameter_set_svc_extension ( ) :
- bit_depth_scalability_flag to signal the process of color bit depth scalability. It is equal to 1 to specify that process of color bit depth prediction shall be invoked in the inter-layer prediction. Otherwise (equal to 0) specified that no process of color bit depth prediction shall be invoked (default) ;
- bit_depth_pred_idc to specify the approach for color bit depth inter-layer prediction. It is equal to 0 to specify that the operation of bit-shift is utilized as the color bit depth inter-layer prediction (default) . Otherwise is reserved for advanced color bit depth prediction.
PCT/CN2006/002848 2006-10-25 2006-10-25 New syntax elements to svc to support color bit depth scalability WO2008049271A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
EP06805054A EP2084909A4 (en) 2006-10-25 2006-10-25 New syntax elements to svc to support color bit depth scalability
CNA2006800561993A CN101601298A (en) 2006-10-25 2006-10-25 The SVC new syntax elements of support color bit depth gradability
PCT/CN2006/002848 WO2008049271A1 (en) 2006-10-25 2006-10-25 New syntax elements to svc to support color bit depth scalability
KR1020097008505A KR20090086960A (en) 2006-10-25 2006-10-25 New syntax elements to svc to support color bit depth scalability
JP2009533639A JP2010507939A (en) 2006-10-25 2006-10-25 New syntax element to SVC that supports color bit depth scalability
US12/311,922 US8306107B2 (en) 2006-10-25 2006-10-25 Syntax elements to SVC to support color bit depth scalability
BRPI0622064-9A BRPI0622064A2 (en) 2006-10-25 2006-10-25 NEW SYNTAX ELEMENTS FOR VIDEO ENCODING STANDARDS WITH SUPPORTING SUPPORT FOR COLOR BIT DEPTH CAPABILITY

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2006/002848 WO2008049271A1 (en) 2006-10-25 2006-10-25 New syntax elements to svc to support color bit depth scalability

Publications (1)

Publication Number Publication Date
WO2008049271A1 true WO2008049271A1 (en) 2008-05-02

Family

ID=39324094

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2006/002848 WO2008049271A1 (en) 2006-10-25 2006-10-25 New syntax elements to svc to support color bit depth scalability

Country Status (7)

Country Link
US (1) US8306107B2 (en)
EP (1) EP2084909A4 (en)
JP (1) JP2010507939A (en)
KR (1) KR20090086960A (en)
CN (1) CN101601298A (en)
BR (1) BRPI0622064A2 (en)
WO (1) WO2008049271A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2127395A1 (en) * 2007-01-10 2009-12-02 Thomson Licensing Video encoding method and video decoding method for enabling bit depth scalability
CN102224731A (en) * 2009-09-22 2011-10-19 松下电器产业株式会社 Image coding apparatus, image decoding apparatus, image coding method, and image decoding method
US9124899B2 (en) 2012-09-28 2015-09-01 Sharp Laboratories Of America, Inc. Motion derivation and coding for scaling video

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101512833B1 (en) * 2007-10-16 2015-04-16 톰슨 라이센싱 Methods and Apparatus for Artifact Removal for Bit Depth Scalability
JP2012060261A (en) 2010-09-06 2012-03-22 Sony Corp Image processing apparatus and method
CN104054338B (en) * 2011-03-10 2019-04-05 杜比实验室特许公司 Locating depth and color scalable video
TWI575933B (en) 2011-11-04 2017-03-21 杜比實驗室特許公司 Layer decomposition in hierarchical vdr coding
US9414058B2 (en) * 2012-12-25 2016-08-09 Mediatek Inc. Video processing apparatus capable of generating output video pictures/sequence with color depth different from color depth of encoded video bitstream
CA2883580A1 (en) * 2013-07-12 2015-01-15 Sony Corporation Image coding apparatus and method
GB2516424A (en) 2013-07-15 2015-01-28 Nokia Corp A method, an apparatus and a computer program product for video coding and decoding

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003036980A1 (en) * 2001-10-26 2003-05-01 Koninklijke Philips Electronics N.V. Spatial scalable compression scheme using spatial sharpness enhancement techniques
US20050259729A1 (en) * 2004-05-21 2005-11-24 Shijun Sun Video coding with quality scalability

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004343451A (en) * 2003-05-15 2004-12-02 Matsushita Electric Ind Co Ltd Moving image decoding method and moving image decoding device
KR100643291B1 (en) * 2005-04-14 2006-11-10 삼성전자주식회사 Apparatus and method of video encoding and decoding for minimizing random access delay

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003036980A1 (en) * 2001-10-26 2003-05-01 Koninklijke Philips Electronics N.V. Spatial scalable compression scheme using spatial sharpness enhancement techniques
US20050259729A1 (en) * 2004-05-21 2005-11-24 Shijun Sun Video coding with quality scalability

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2084909A4 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2127395A1 (en) * 2007-01-10 2009-12-02 Thomson Licensing Video encoding method and video decoding method for enabling bit depth scalability
EP2127395A4 (en) * 2007-01-10 2013-01-16 Thomson Licensing Video encoding method and video decoding method for enabling bit depth scalability
CN102224731A (en) * 2009-09-22 2011-10-19 松下电器产业株式会社 Image coding apparatus, image decoding apparatus, image coding method, and image decoding method
US8446958B2 (en) 2009-09-22 2013-05-21 Panasonic Corporation Image coding apparatus, image decoding apparatus, image coding method, and image decoding method
US9124899B2 (en) 2012-09-28 2015-09-01 Sharp Laboratories Of America, Inc. Motion derivation and coding for scaling video
US9516344B2 (en) 2012-09-28 2016-12-06 Sharp Laboratories Of America, Inc. Motion derivation and coding for scaling video

Also Published As

Publication number Publication date
EP2084909A1 (en) 2009-08-05
JP2010507939A (en) 2010-03-11
US20090323804A1 (en) 2009-12-31
CN101601298A (en) 2009-12-09
US8306107B2 (en) 2012-11-06
EP2084909A4 (en) 2012-11-21
KR20090086960A (en) 2009-08-14
BRPI0622064A2 (en) 2014-05-27

Similar Documents

Publication Publication Date Title
US8306107B2 (en) Syntax elements to SVC to support color bit depth scalability
US8477853B2 (en) Method and apparatus for encoding and/or decoding bit depth scalable video data using adaptive enhancement layer prediction
EP1933563A1 (en) Method and apparatus for encoding and/or decoding bit depth scalable video data using adaptive enhancement layer residual prediction
US8737474B2 (en) Method and apparatus for encoding and/or decoding video data using enhancement layer residual prediction for bit depth scalability
US20100091840A1 (en) Video encoding method and video decoding method for enabling bit depth scalability
JP5036826B2 (en) Method and apparatus for encoding and / or decoding video data using enhancement layer residual prediction for bit depth scalability
US8798149B2 (en) Enhancement layer residual prediction for bit depth scalability using hierarchical LUTs
JP5232797B2 (en) Method and apparatus for encoding and / or decoding video data using adaptive prediction order of spatial prediction and bit depth prediction
WO2008077273A1 (en) Device for encoding video data, device for decoding video data, stream of digital data
EP1933565A1 (en) Method and apparatus for encoding and/or decoding bit depth scalable video data using adaptive enhancement layer prediction

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680056199.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 06805054

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 12311922

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2006805054

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2009533639

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 1020097008505

Country of ref document: KR

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: PI0622064

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20090414