WO2008128388A1 - Method for encoding video data in a scalable manner - Google Patents

Method for encoding video data in a scalable manner Download PDF

Info

Publication number
WO2008128388A1
WO2008128388A1 PCT/CN2007/002031 CN2007002031W WO2008128388A1 WO 2008128388 A1 WO2008128388 A1 WO 2008128388A1 CN 2007002031 W CN2007002031 W CN 2007002031W WO 2008128388 A1 WO2008128388 A1 WO 2008128388A1
Authority
WO
WIPO (PCT)
Prior art keywords
layer
supplemental enhancement
information message
enhancement information
scalable
Prior art date
Application number
PCT/CN2007/002031
Other languages
French (fr)
Inventor
Lihua Zhu
Jiheng Yang
Zhibo Chen
Original Assignee
Thomson Licensing
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US12/450,870 priority Critical patent/US20100142613A1/en
Application filed by Thomson Licensing filed Critical Thomson Licensing
Priority to EP07721598A priority patent/EP2160902A4/en
Priority to BRPI0721501-0A priority patent/BRPI0721501A2/en
Priority to JP2010503332A priority patent/JP2010531554A/en
Publication of WO2008128388A1 publication Critical patent/WO2008128388A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation

Definitions

  • the invention concerns a method to encode video data in a scalable manner.
  • the invention concerns mainly the field of video coding when data can be coded in a scalable manner. Coding video data according to several layers can be of a great help when terminals for which data are intended have different capacities and therefore cannot decode full data stream but only part of it.
  • the receiving terminal can extract from the received bit-stream the data according to its profile.
  • H.264/SVC also referenced as ITU-T H.264 standard.
  • the transmission of several layers requests the transmission of many headers in order to transmit all the parameters requested by the different layers.
  • one header comprises the parameters corresponding to all the layers. So, when one needs to transmit only the base layer, all the information related to the enhancement layers have to be transmitted. Therefore, it creates a big overload on the network to transmit all the parameters for all the layers even if all layers data are not requested by the different devices to which the data are addressed.
  • the invention proposes to solve at least one of these drawbacks.
  • the invention proposes a method for encoding video data in a scalable manner according to H.264/SVC standard.
  • the method comprises the steps of
  • the Supplemental Enhancement Information message comprises a reference to the Sequence Parameter Set (SPS) that said layer is linked to.
  • SPS Sequence Parameter Set
  • the Supplemental Enhancement Information message comprises the video usability information as defined in the H264/SVC standard.
  • the parameters for all the layers are all transmitted as a whole, no matter how many layers are transmitted. Therefore, this creates a big overload on the network. This is mainly due to the fact that some of the parameters are layer dependant and some others are common to all layers and therefore, one header being defined for all parameters, all layer dependant and independent parameters are transmitted together.
  • the layer dependant parameters are only transmitted when needed, that is when the data coded according to these layers are transmitted instead of transmitting the whole header comprising the parameters for all the layers.
  • FIG. 1 represents the structure of the NAL unit used for scalable layers coding according to the prior art
  • - Figure 2 represent an embodiment of the structure as proposed in the current invention
  • - Figure 3 represents an overview of the scalable video coder according to a preferred embodiment of the invention
  • FIG. 4 represents an overview of the data stream according to a preferred embodiment of the invention
  • FIG. 5 represents an example of a bitstream according to a preferred embodiment of the invention
  • the video data are coded according to H264/SVC.
  • SVC proposes the transmission of video data according to several spatial levels, temporal levels, and quality levels. For one spatial level, one can code according to several temporal levels and for each temporal level according to several quality levels. Therefore when m spatial levels are defined, n temporal levels and O quality levels, the video data can be coded according to m*n*O different levels.
  • different layers are transmitted up to a certain level corresponding to the maximum of the client capabilities.
  • SPS is a syntax structure which contains syntax elements that apply to zero or more entire coded video sequences as determined by the content of a seq_parameter_set_id syntax element found in the picture parameter set referred to by the pic_parameter_set_id syntax element found in each slice header.
  • the values of some syntax elements conveyed in the SPS are layer dependant. These syntax elements include but are not limited to, the timing information, HRD (standing for "Hypothetical Reference Decoder") parameters, bitstream restriction information. Therefore, it is necessary to allow the transmission of the aforementioned syntax elements for each layer.
  • One Sequence Parameter Set comprises all the needed parameters for all the corresponding spatial (Dj) 1 temporal (Tj) and quality (Qi) levels whenever all the layers are transmitted or not
  • SPS comprises the VUI (standing for Video Usability Information) parameters for all the layers.
  • the VUI parameters represent a very important quantity of data as they comprise the HRD parameters for all the layers.
  • HRD Video Usability Information
  • SPS represent a basic syntax element in SVC, it is transmitted as a whole. Therefore, no matter which layer is transmitted, the HRD parameters for all the layers are transmitted.
  • the invention proposes to use a nesting_sei prefix/suffix NAL and to store the VUI parameters in a SEI message.
  • the scalablejiesting also called nesting SEI (and represented as
  • NSEI on the drawings
  • the scalable__nesting is linked, thanks to the vui_parameter_sei() field, to the vui__parameter_sei message comprising all the properties of the layer specified by the nesting SEI.
  • the following table 1 illustrates the scalablejiesting as defined by the prefix/suffix NAL.
  • a scalable nesting SEI message concerns an access unit. When present, this SEI message appears before any VCL NAL unit of the corresponding access unit. Scalable nesting SEI is contained in a NAL unit. The scope to which the nested SEI message applies is indicated by the syntax elements all_pictures_in_au_flag, and num_pictures, dependency_id[ i ] and quality_id[ i ], when present.
  • all_pictures_in_au_flag 1 indicates that the nested SEI message applies to all the coded pictures of the access unit.
  • all_pictures_in_au_flag 0 indicates that the applicable scope of the nested SEI message is signaled by the syntax elements num_pictures, dependency_id[ i ] and quality_id[ i ].
  • - num_pictures_minus1 indicates the number of coded pictures to which the nested SEI message applies.
  • dependency_id[ i ] and quality_id[ i ] indicate, respectively, the dependencyjd (spatial level) and the qualityjd of the i-th coded picture to which the nested SEI message applies.
  • the following table illustrates the sei message containing the parameters specific to each layer.
  • the sequence_parameter_set_id identifies the sequence parameter set (SPS) which current vui_parameter__sei message maps to and includes the common sequence parameter properties for the current layer.
  • SPS sequence parameter set
  • the vui_parameter_sei is defined as being of type 30. In other embodiments of the invention, it can be any other field which is still made available by the standard H.264/SVC.
  • FIG. 3 shows an embodiment of a scalable video coder 1 according to the invention.
  • a video is received at the input of the scalable video coder 1.
  • the video is coded according to different spatial levels. Spatial levels mainly refer to different levels of resolution of the same video. For example, as the input of a scalable video coder, one can have a CIF sequence (352 per
  • Each of the spatial level is sent to a hierarchical motion compensated prediction module.
  • the spatial level 1 is sent to the hierarchical motion compensated prediction module 2"
  • the spatial level 2 is sent to the hierarchical motion compensated prediction module 2'
  • the spatial level n is sent to the hierarchical motion compensated prediction module 2.
  • the spatial levels being coded on 3 bits, using the dependencyjd, therefore the maximum number of spatial levels is 8.
  • the data are coded according to a base layer and to an enhancement layer.
  • data are coded through enhancement layer coder 3" and base layer coder 4"
  • data are coded through enhancement layer coder 3' and base layer coder 4'
  • data are coded through enhancement layer coder 3 and base layer coder 4.
  • the headers are prepared and for each of the spatial layer, a SPS and a PPS messages are created and several NSEI-VUI_SEI messages.
  • NSEI - VUIJSEI 2 ⁇ 0 are also created according to this embodiment of the invention.
  • SPS and PPS 5 are created and a set of NSEI - VUIJSEIJ 1 , NSEI - VUIJSEi; ,... , NSEI -VUI-SEI J ⁇ 0 are also created according to this embodiment of the invention.
  • the bitstreams encoded by the base layer coding modules and the enhancement layer coding modules are following the plurality of SPS, PPS and SUP_SPS headers in the global bitstream.
  • 8 comprises SPS and PPS 5", NSEI-VUI_SEI
  • 8' comprises SPS and PPS 5', NSEI -VUI_SEI 2 , NSEI - VUI_SEI 2 ,... , NSEI - VULSEI n , 6' and bitstream T which constitute all the encoded data associated with spatial level 2.
  • 8 comprises SPS and PPS 5, NSEI -VULSEi; , NSEI - VUI_SEI!
  • the different NSEI-VUI_SEI headers are compliant with the headers described in the above tables.
  • Figure 4 represents a bitstream as coded by the scalable video encoder of figure 3.
  • the bitstream comprises one SPS for each of the spatial levels.
  • the bitstream comprises SPS1 , SPS2 and SPSm represented by 10, 10' and 10" on figure 4.
  • each SPS coding the general information relative to the spatial level is followed by a header 10 of NSEI-VUI_SEI type itself followed by the corresponding encoded video data corresponding each to one temporal level and one quality level.
  • the corresponding header is also not transmitted as there is one header NSEI-VUI_SEI corresponding to each level.
  • Figure 5 illustrates the transmission of the following levels.
  • the references indicated in the bitstream correspond to the references used in figure 2.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A method for encoding video data in a scalable manner according to H.264/SVC standard comprises the steps of: inserting a scalable nesting Supplemental Enhancement Information message for each layer of the data stream comprising at least one reference to the layer and a link to a Supplemental Enhancement Information message, following the nesting Supplemental Enhancement Information message, inserting the Supplemental Enhancement Information message for each scalable nesting Supplemental Enhancement Information message comprising the video usability information for the layer.

Description

Method for encoding video data in a scalable manner
FIELD OF THE INVENTION
The invention concerns a method to encode video data in a scalable manner.
BACKGROUND OF THE INVENTION
The invention concerns mainly the field of video coding when data can be coded in a scalable manner. Coding video data according to several layers can be of a great help when terminals for which data are intended have different capacities and therefore cannot decode full data stream but only part of it. When the video data are coded according to several layers in a scalable manner, the receiving terminal can extract from the received bit-stream the data according to its profile.
Several video coding standards exist today which can code video data according to different layers and/or profiles. Among them, one can cite H.264/SVC, also referenced as ITU-T H.264 standard.
However, one existing problem is the overload that it creates by transmitting more data than often needed at the end-side.
Indeed, for instance in H.264/SVC or MVC (SVC standing for scalable video coding and MVC standing for multi view video coding), the transmission of several layers requests the transmission of many headers in order to transmit all the parameters requested by the different layers. In the current release of the standard, one header comprises the parameters corresponding to all the layers. So, when one needs to transmit only the base layer, all the information related to the enhancement layers have to be transmitted. Therefore, it creates a big overload on the network to transmit all the parameters for all the layers even if all layers data are not requested by the different devices to which the data are addressed.
The invention proposes to solve at least one of these drawbacks. SUMMARY OF THE INVENTION
To this end, the invention proposes a method for encoding video data in a scalable manner according to H.264/SVC standard. According to the invention, the method comprises the steps of
- inserting a scalable nesting Supplemental Enhancement Information message for each layer of the data stream comprising at least one reference to the layer and a link to a Supplemental Enhancement Information message,
- following the nesting Supplemental Enhancement Information message, inserting said Supplemental Enhancement Information message for each scalable nesting Supplemental Enhancement Information message comprising the video usability information for said layer.
According to a preferred embodiment, the Supplemental Enhancement Information message comprises a reference to the Sequence Parameter Set (SPS) that said layer is linked to.
According to a preferred embodiment, the Supplemental Enhancement Information message comprises the video usability information as defined in the H264/SVC standard.
In some coding methods, the parameters for all the layers are all transmitted as a whole, no matter how many layers are transmitted. Therefore, this creates a big overload on the network. This is mainly due to the fact that some of the parameters are layer dependant and some others are common to all layers and therefore, one header being defined for all parameters, all layer dependant and independent parameters are transmitted together.
Thanks to the invention, the layer dependant parameters are only transmitted when needed, that is when the data coded according to these layers are transmitted instead of transmitting the whole header comprising the parameters for all the layers.
BRIEF DESCRIPTION OF THE DRAWINGS Other characteristics and advantages of the invention will appear through the description of a non-limiting embodiment of the invention, which will be illustrated, with the help of the enclosed drawings:
- Figure 1 represents the structure of the NAL unit used for scalable layers coding according to the prior art,
- Figure 2 represent an embodiment of the structure as proposed in the current invention, - Figure 3 represents an overview of the scalable video coder according to a preferred embodiment of the invention,
- Figure 4 represents an overview of the data stream according to a preferred embodiment of the invention,
- Figure 5 represents an example of a bitstream according to a preferred embodiment of the invention,
DETAILED DESCRIPTION OF PREFERED EMBODIMENTS According to the preferred embodiment described here, the video data are coded according to H264/SVC. SVC proposes the transmission of video data according to several spatial levels, temporal levels, and quality levels. For one spatial level, one can code according to several temporal levels and for each temporal level according to several quality levels. Therefore when m spatial levels are defined, n temporal levels and O quality levels, the video data can be coded according to m*n*O different levels. According to the client capabilities, different layers are transmitted up to a certain level corresponding to the maximum of the client capabilities.
As shown on figure 1 representing the prior art of the invention, currently in SVC, SPS is a syntax structure which contains syntax elements that apply to zero or more entire coded video sequences as determined by the content of a seq_parameter_set_id syntax element found in the picture parameter set referred to by the pic_parameter_set_id syntax element found in each slice header. In SVC, the values of some syntax elements conveyed in the SPS are layer dependant. These syntax elements include but are not limited to, the timing information, HRD (standing for "Hypothetical Reference Decoder") parameters, bitstream restriction information. Therefore, it is necessary to allow the transmission of the aforementioned syntax elements for each layer. One Sequence Parameter Set (SPS) comprises all the needed parameters for all the corresponding spatial (Dj)1 temporal (Tj) and quality (Qi) levels whenever all the layers are transmitted or not
SPS comprises the VUI (standing for Video Usability Information) parameters for all the layers. The VUI parameters represent a very important quantity of data as they comprise the HRD parameters for all the layers. In practical applications, as the channel rate is constrained, only certain layers are transmitted through the network. As SPS represent a basic syntax element in SVC, it is transmitted as a whole. Therefore, no matter which layer is transmitted, the HRD parameters for all the layers are transmitted.
As shown on figure 2, in order to reduce the overload of the Sequence Parameter set (SPS) for scalable video coding, the invention proposes to use a nesting_sei prefix/suffix NAL and to store the VUI parameters in a SEI message. The scalablejiesting, also called nesting SEI (and represented as
NSEI on the drawings) is acting as a header of a prefix/suffix type NAL unit indicating the layer information. The scalable__nesting is linked, thanks to the vui_parameter_sei() field, to the vui__parameter_sei message comprising all the properties of the layer specified by the nesting SEI. The following table 1 illustrates the scalablejiesting as defined by the prefix/suffix NAL.
Figure imgf000006_0001
Table 1
A scalable nesting SEI message concerns an access unit. When present, this SEI message appears before any VCL NAL unit of the corresponding access unit. Scalable nesting SEI is contained in a NAL unit. The scope to which the nested SEI message applies is indicated by the syntax elements all_pictures_in_au_flag, and num_pictures, dependency_id[ i ] and quality_id[ i ], when present.
- all_pictures_in_au_flag equal to 1 indicates that the nested SEI message applies to all the coded pictures of the access unit. all_pictures_in_au_flag equal to 0 indicates that the applicable scope of the nested SEI message is signaled by the syntax elements num_pictures, dependency_id[ i ] and quality_id[ i ].
- num_pictures_minus1 indicates the number of coded pictures to which the nested SEI message applies.
- dependency_id[ i ] and quality_id[ i ] indicate, respectively, the dependencyjd (spatial level) and the qualityjd of the i-th coded picture to which the nested SEI message applies.
- sei_nesting_zero_bit is equal to 0.
The following table illustrates the sei message containing the parameters specific to each layer.
Figure imgf000007_0001
Table 2
The sequence_parameter_set_id identifies the sequence parameter set (SPS) which current vui_parameter__sei message maps to and includes the common sequence parameter properties for the current layer.
The other parameters mentioned in table 2 are defined in the standard H.264/SVC.
The following table 3 illustrates the modification to be done to the existing definition of the sei_payload as currently defined in the standard
H.264/SVC. The vui_parameter_sei is defined as being of type 30. In other embodiments of the invention, it can be any other field which is still made available by the standard H.264/SVC.
Figure imgf000008_0001
Table 3
Figure 3 shows an embodiment of a scalable video coder 1 according to the invention. A video is received at the input of the scalable video coder 1.
The video is coded according to different spatial levels. Spatial levels mainly refer to different levels of resolution of the same video. For example, as the input of a scalable video coder, one can have a CIF sequence (352 per
288) or a QCIF sequence (176 per 144) which represent each one spatial level.
Each of the spatial level is sent to a hierarchical motion compensated prediction module. The spatial level 1 is sent to the hierarchical motion compensated prediction module 2", the spatial level 2 is sent to the hierarchical motion compensated prediction module 2' and the spatial level n is sent to the hierarchical motion compensated prediction module 2.
The spatial levels being coded on 3 bits, using the dependencyjd, therefore the maximum number of spatial levels is 8.
Once hierarchical motion predicted compensation is done, two kinds of data are generated, one being motion which describes the disparity between the different layers, the other being texture, which is the estimation error.
For each of the spatial level, the data are coded according to a base layer and to an enhancement layer. For spatial level 1, data are coded through enhancement layer coder 3" and base layer coder 4", for spatial level 2, data are coded through enhancement layer coder 3' and base layer coder 4', for spatial level 1 , data are coded through enhancement layer coder 3 and base layer coder 4.
After the coding, the headers are prepared and for each of the spatial layer, a SPS and a PPS messages are created and several NSEI-VUI_SEI messages.
For spatial level 1 , as represented on figure 3, SPS and PPS 5" are created and a set of NSEI - VUI_SEI{ , NSEI -VUI_SEI^ ,... , NSEI - VUIJSEIjnS0 , are also created according to this embodiment of the invention.
For spatial level 2, as represented on figure 3, SPS and PPS 5' are created and a set of NSEI
Figure imgf000009_0001
, NSEI - VUI-SEI2. ,... ,
NSEI - VUIJSEI2^0 are also created according to this embodiment of the invention. For spatial level n, as represented on figure 3, SPS and PPS 5 are created and a set of NSEI - VUIJSEIJ1 , NSEI - VUIJSEi; ,... , NSEI -VUI-SEI J^0 are also created according to this embodiment of the invention.
The bitstreams encoded by the base layer coding modules and the enhancement layer coding modules are following the plurality of SPS, PPS and SUP_SPS headers in the global bitstream.
On figure 3, 8" comprises SPS and PPS 5", NSEI-VUI_SEI| .NSEI-VULSEI1^... , NSEI -VULSElIn 6" and bitstream 7" which constitute all the encoded data associated with spatial level 1.
On figure 3, 8' comprises SPS and PPS 5', NSEI -VUI_SEI2 , NSEI - VUI_SEI2 ,... , NSEI - VULSEIn, 6' and bitstream T which constitute all the encoded data associated with spatial level 2.
On figure 3, 8 comprises SPS and PPS 5, NSEI -VULSEi; , NSEI - VUI_SEI!| ,... , NSEI - VULSEIn; 6 and bitstream 7 which constitute all the encoded data associated with spatial level n. The different NSEI-VUI_SEI headers are compliant with the headers described in the above tables.
Figure 4 represents a bitstream as coded by the scalable video encoder of figure 3.
The bitstream comprises one SPS for each of the spatial levels. When m spatial levels are encoded, the bitstream comprises SPS1 , SPS2 and SPSm represented by 10, 10' and 10" on figure 4.
In the bitstream, each SPS coding the general information relative to the spatial level, is followed by a header 10 of NSEI-VUI_SEI type itself followed by the corresponding encoded video data corresponding each to one temporal level and one quality level.
Therefore, when one level corresponding to one quality level is not transmitted, the corresponding header is also not transmitted as there is one header NSEI-VUI_SEI corresponding to each level.
So, let's take an example to illustrate the data stream to be transmitted as shown on figure 5.
Figure 5 illustrates the transmission of the following levels. The references indicated in the bitstream correspond to the references used in figure 2.
The following layers are transmitted:
• spatial layer 1
■ temporal level 1 o Quality level 1 ■ temporal level 2 o Quality level 1
• spatial layer 2
■ temporal level 1 o quality level 1
• spatial layer 3
■ temporal level 1 o Quality level 1 ■ temporal level 2 o Quality level 1
■ temporal level 3 o Quality level 1
Therefore, one can see that not all the different parameters for all the layers are transmitted but only the ones corresponding to the requested layers as they are comprised in the NSEI-VUI_SEI messages and no more in the SPS messages.

Claims

Claims
1. Method for encoding video data in a scalable manner according to H.264/SVC standard characterized in that it comprises the steps of
- inserting a scalable nesting Supplemental Enhancement Information message for each layer of the data stream comprising at least one reference to the layer and a link to a Supplemental Enhancement Information message,
- following the nesting Supplemental Enhancement Information message, inserting said Supplemental Enhancement Information message for each scalable nesting Supplemental Enhancement Information message comprising the video usability information for said layer.
2. Method according to claim 1 characterized in that said Supplemental Enhancement Information message comprises a reference to the Sequence
Parameter Set (SPS) that said layer is linked to.
3. Method according to claim 2 characterized in that said Supplemental Enhancement Information message comprises the video usability information as defined in the H264/SVC standard.
PCT/CN2007/002031 2007-04-18 2007-06-29 Method for encoding video data in a scalable manner WO2008128388A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US12/450,870 US20100142613A1 (en) 2007-04-18 2007-06-20 Method for encoding video data in a scalable manner
EP07721598A EP2160902A4 (en) 2007-04-18 2007-06-29 Method for encoding video data in a scalable manner
BRPI0721501-0A BRPI0721501A2 (en) 2007-04-18 2007-06-29 Method for scaling video data in a scalable manner
JP2010503332A JP2010531554A (en) 2007-04-18 2007-06-29 A method for scalable encoding of video data

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US92399307P 2007-04-18 2007-04-18
US60/923993 2007-04-18

Publications (1)

Publication Number Publication Date
WO2008128388A1 true WO2008128388A1 (en) 2008-10-30

Family

ID=39875050

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2007/002031 WO2008128388A1 (en) 2007-04-18 2007-06-29 Method for encoding video data in a scalable manner

Country Status (7)

Country Link
US (1) US20100142613A1 (en)
EP (1) EP2160902A4 (en)
JP (1) JP2010531554A (en)
KR (1) KR20100015642A (en)
CN (2) CN101653002A (en)
BR (1) BRPI0721501A2 (en)
WO (1) WO2008128388A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8619871B2 (en) 2007-04-18 2013-12-31 Thomson Licensing Coding systems
EP2853091A4 (en) * 2012-07-02 2016-03-09 Sony Corp Video coding system with temporal layers and method of operation thereof
US9473752B2 (en) 2011-11-30 2016-10-18 Qualcomm Incorporated Activation of parameter sets for multiview video coding (MVC) compatible three-dimensional video coding (3DVC)
CN107465932A (en) * 2011-11-25 2017-12-12 三星电子株式会社 Method for encoding images and device and picture decoding method and device
US9967583B2 (en) 2012-07-10 2018-05-08 Qualcomm Incorporated Coding timing information for video coding
US10110890B2 (en) 2012-07-02 2018-10-23 Sony Corporation Video coding system with low delay and method of operation thereof
RU2720605C2 (en) * 2012-12-26 2020-05-12 Сони Корпорейшн Image processing device and method
US10863203B2 (en) 2007-04-18 2020-12-08 Dolby Laboratories Licensing Corporation Decoding multi-layer images
JP2022548405A (en) * 2019-09-24 2022-11-18 ホアウェイ・テクノロジーズ・カンパニー・リミテッド Scalable Nesting for Suffix SEI Messages

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012095053A (en) * 2010-10-26 2012-05-17 Toshiba Corp Stream transmission system, transmitter, receiver, stream transmission method, and program
CN102595203A (en) * 2011-01-11 2012-07-18 中兴通讯股份有限公司 Method and equipment for transmitting and receiving multi-media data
US20130113882A1 (en) * 2011-11-08 2013-05-09 Sony Corporation Video coding system and method of operation thereof
DK3793200T3 (en) 2012-04-13 2023-02-13 Ge Video Compression Llc Low latency image coding
KR20130116782A (en) 2012-04-16 2013-10-24 한국전자통신연구원 Scalable layer description for scalable coded video bitstream
US9602827B2 (en) * 2012-07-02 2017-03-21 Qualcomm Incorporated Video parameter set including an offset syntax element
WO2014007596A1 (en) * 2012-07-06 2014-01-09 삼성전자 주식회사 Method and apparatus for coding multilayer video, and method and apparatus for decoding multilayer video
US9554146B2 (en) * 2012-09-21 2017-01-24 Qualcomm Incorporated Indication and activation of parameter sets for video coding
US9351005B2 (en) 2012-09-24 2016-05-24 Qualcomm Incorporated Bitstream conformance test in video coding
JP6290088B2 (en) * 2012-09-28 2018-03-07 シャープ株式会社 Image decoding apparatus, image decoding method, and recording medium
CN103959796B (en) * 2012-09-29 2017-11-17 华为技术有限公司 The coding/decoding method joining method and device of digital video bit stream
KR20140048802A (en) * 2012-10-08 2014-04-24 삼성전자주식회사 Method and apparatus for multi-layer video encoding, method and apparatus for multi-layer video decoding
US9154785B2 (en) 2012-10-08 2015-10-06 Qualcomm Incorporated Sub-bitstream applicability to nested SEI messages in video coding
CN104718747B (en) * 2012-10-10 2019-06-18 中兴通讯股份有限公司 Encapsulation for media transmission and the videoscanning format information of storage
KR20140087971A (en) * 2012-12-26 2014-07-09 한국전자통신연구원 Method and apparatus for image encoding and decoding using inter-prediction with multiple reference layers
KR20140092198A (en) * 2013-01-07 2014-07-23 한국전자통신연구원 Video Description for Scalable Coded Video Bitstream
US9521393B2 (en) * 2013-01-07 2016-12-13 Qualcomm Incorporated Non-nested SEI messages in video coding
US9894370B2 (en) * 2014-03-24 2018-02-13 Qualcomm Incorporated Generic use of HEVC SEI messages for multi-layer codecs
US9918091B2 (en) 2014-06-20 2018-03-13 Qualcomm Incorporated Systems and methods for assigning a minimum value to a syntax structure in a parameter set
US9716900B2 (en) * 2014-06-20 2017-07-25 Qualcomm Incorporated Extensible design of nesting supplemental enhancement information (SEI) messages
US10554981B2 (en) * 2016-05-10 2020-02-04 Qualcomm Incorporated Methods and systems for generating regional nesting messages for video pictures
CN111669603B (en) * 2019-03-07 2023-03-21 阿里巴巴集团控股有限公司 Multi-angle free visual angle data processing method and device, medium, terminal and equipment
JP7392124B2 (en) * 2019-09-24 2023-12-05 華為技術有限公司 Scalable nesting SEI messages for specified layers
WO2021061390A1 (en) * 2019-09-24 2021-04-01 Futurewei Technologies, Inc. Sei message for single layer ols

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1666195A (en) * 2002-04-29 2005-09-07 索尼电子有限公司 Supporting advanced coding formats in media files
WO2007046957A1 (en) * 2005-10-12 2007-04-26 Thomson Licensing Method and apparatus for using high-level syntax in scalable video encoding and decoding

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040006575A1 (en) * 2002-04-29 2004-01-08 Visharam Mohammed Zubair Method and apparatus for supporting advanced coding formats in media files
EP1773063A1 (en) * 2005-06-14 2007-04-11 Thomson Licensing Method and apparatus for encoding video data, and method and apparatus for decoding video data
US20080095228A1 (en) * 2006-10-20 2008-04-24 Nokia Corporation System and method for providing picture output indications in video coding
EP2153658B1 (en) * 2007-04-13 2013-08-14 Nokia Corporation A video coder

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1666195A (en) * 2002-04-29 2005-09-07 索尼电子有限公司 Supporting advanced coding formats in media files
WO2007046957A1 (en) * 2005-10-12 2007-04-26 Thomson Licensing Method and apparatus for using high-level syntax in scalable video encoding and decoding

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ITU-T H.264: "ITU-T Recommendation H.264: Advanced video coding for generic audiovisual services", ITU-T RECOMMENDATION H.264, XX, XX, 1 March 2005 (2005-03-01), XX, XP008095420, Retrieved from the Internet <URL:www.itu.int/rec/T-REC-H.264/en> *
See also references of EP2160902A4 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11412265B2 (en) 2007-04-18 2022-08-09 Dolby Laboratories Licensing Corporaton Decoding multi-layer images
US8619871B2 (en) 2007-04-18 2013-12-31 Thomson Licensing Coding systems
US10863203B2 (en) 2007-04-18 2020-12-08 Dolby Laboratories Licensing Corporation Decoding multi-layer images
CN107465932A (en) * 2011-11-25 2017-12-12 三星电子株式会社 Method for encoding images and device and picture decoding method and device
CN107517388A (en) * 2011-11-25 2017-12-26 三星电子株式会社 Method for encoding images and device and picture decoding method and device
US10499062B2 (en) 2011-11-25 2019-12-03 Samsung Electronics Co., Ltd. Image coding method and device for buffer management of decoder, and image decoding method and device
US10200708B2 (en) 2011-11-30 2019-02-05 Qualcomm Incorporated Sequence level information for multiview video coding (MVC) compatible three-dimensional video coding (3DVC)
US9473752B2 (en) 2011-11-30 2016-10-18 Qualcomm Incorporated Activation of parameter sets for multiview video coding (MVC) compatible three-dimensional video coding (3DVC)
US10154276B2 (en) 2011-11-30 2018-12-11 Qualcomm Incorporated Nested SEI messages for multiview video coding (MVC) compatible three-dimensional video coding (3DVC)
US10158873B2 (en) 2011-11-30 2018-12-18 Qualcomm Incorporated Depth component removal for multiview video coding (MVC) compatible three-dimensional video coding (3DVC)
US9912941B2 (en) 2012-07-02 2018-03-06 Sony Corporation Video coding system with temporal layers and method of operation thereof
US10327005B2 (en) 2012-07-02 2019-06-18 Sony Corporation Video coding system with temporal layers and method of operation thereof
US10110890B2 (en) 2012-07-02 2018-10-23 Sony Corporation Video coding system with low delay and method of operation thereof
US10542251B2 (en) 2012-07-02 2020-01-21 Sony Corporation Video coding system with low delay and method of operation thereof
US10659799B2 (en) 2012-07-02 2020-05-19 Sony Corporation Video coding system with temporal layers and method of operation thereof
US10805604B2 (en) 2012-07-02 2020-10-13 Sony Corporation Video coding system with low delay and method of operation thereof
EP2853091A4 (en) * 2012-07-02 2016-03-09 Sony Corp Video coding system with temporal layers and method of operation thereof
US9967583B2 (en) 2012-07-10 2018-05-08 Qualcomm Incorporated Coding timing information for video coding
RU2720605C2 (en) * 2012-12-26 2020-05-12 Сони Корпорейшн Image processing device and method
JP2022548405A (en) * 2019-09-24 2022-11-18 ホアウェイ・テクノロジーズ・カンパニー・リミテッド Scalable Nesting for Suffix SEI Messages

Also Published As

Publication number Publication date
EP2160902A4 (en) 2010-11-03
CN101663893A (en) 2010-03-03
CN101653002A (en) 2010-02-17
BRPI0721501A2 (en) 2013-02-26
KR20100015642A (en) 2010-02-12
US20100142613A1 (en) 2010-06-10
EP2160902A1 (en) 2010-03-10
CN101663893B (en) 2013-05-08
JP2010531554A (en) 2010-09-24

Similar Documents

Publication Publication Date Title
EP2160902A1 (en) Method for encoding video data in a scalable manner
WO2009005627A1 (en) Method for encoding video data in a scalable manner
US8619871B2 (en) Coding systems
KR20190009378A (en) METHOD FOR ENCODING MEDIA CONTENT, DEVICE, AND COMPUTER PROGRAM
CN107770545B (en) Method of decoding image and apparatus using the same
US20230345017A1 (en) Low complexity enhancement video coding
US20220337815A1 (en) Constraints on signaling of hypothetical reference decoder parameters in video bitstreams
US20090290648A1 (en) Method and a device for transmitting image data
US20220329868A1 (en) Profile, tier and layer indication in video coding
US10609394B2 (en) Encoding and deriving parameters for coded multi-layer video sequences
US20190320207A1 (en) Decoding multi-layer images
CN114205598A (en) Sub-picture entity group signaling in coded video
EP2100460A1 (en) Device for encoding video data, device for decoding video data, stream of digital data
CN110915221B (en) Transmission device, transmission method, reception device, and reception method
WO2013109126A1 (en) Method for transmitting video information, video decoding method, video encoder and video decoder
WO2022089396A1 (en) Decoder configuration information in vvc video coding
EP4324210A1 (en) A method, an apparatus and a computer program product for video encoding and video decoding

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200780052621.2

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07721598

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2010503332

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2007721598

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20097021632

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 12450870

Country of ref document: US

ENP Entry into the national phase

Ref document number: PI0721501

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20091014