JP2017153087A - Coding device and coding method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide much more flexibility to be used for a vps_extension() syntax structure regarding use in each layer or at each operation point in a profile_tier_level syntax structure of a high efficiency video coding (HEVC) syntax structure.SOLUTION: In a step 100, a content is acquired. In a step 102, a flag instructing a level is utilized to generate VPS data. Further, the VPS data are generated by using an additional flag and data for instructing a level and/or an operation point. The VPS data includes various HEVC extension information in extensible video coding, multi-viewpoint coding and 3D video coding fields, thereby providing flexibility in profile/hierarchy/level information.SELECTED DRAWING: Figure 1

Description

[Cross-reference to related applications]
This application is filed under US Patent Provisional Application No. 61 / 748,878, filed Jan. 4, 2013 under the name "JCTVC-L0XXX: VPS_EXTENSION with profile-hierarchy-level syntax structure update" and "Profile- Claims priority to US patent application Ser. No. 14 / 035,740 filed Sep. 24, 2013 under the name “JCTVC-L0227: VPS_EXTENSION with layer-level syntax structure update”. Each of the above cited applications is hereby incorporated herein by reference in its entirety for all purposes.

  The present invention relates to the field of video coding. The present invention more specifically relates to high efficiency video coding.

  A “video parameter set (VPS)” has been added as metadata to describe the overall characteristics of the encoded video sequence, including dependencies between temporal sublayers. The main purpose of this is, for example, that the base layer of the future extended scalable or multi-view video bitstream needs to be decodable by a conventional decoder, but only in the latest decoder in that regard. It is to allow compatibility extensibility of standards for signaling at the system layer when additional information regarding the relevant bitstream structure is considered to be ignored.

  The profile_tier_level syntax structure of the “High Efficiency Video Coding (HEVC)” syntax structure is updated to provide more flexibility for use in the vps_extension () syntax structure for use at each layer or operating point. A new flag “LevelPresentFlag” has been added to the profile_tier_level syntax structure to support variations in level parameters that are separate from profile / hierarchy parameters. An update to the profile_tier_level syntax structure provides flexibility in selecting the profile_tier and level parameters for HEVC selection in the extensible video coding, multi-view coding, and 3D video coding fields.

  In one aspect, when a profile presence flag is 0, a code that generates an encoded bitstream using a syntax indicating that profile information about a current layer is equal to profile information about a reference layer referenced by the current layer There is provided an encoding device including an encoding unit and a transmission unit that transmits the encoded bitstream generated by the encoding unit.

  In another aspect, when the level presence flag is 0, an encoded bitstream is generated using a syntax indicating that level information regarding a current layer is equal to level information regarding a reference layer referenced by the current layer An encoding device is provided that includes an encoding unit and a transmission unit that transmits the encoded bitstream generated by the encoding unit.

  In another aspect, when the profile presence flag is 0, an encoded bitstream is generated using a syntax indicating that profile information regarding a current layer is equal to profile information regarding a reference layer referenced by the current layer And transmitting the encoded bitstream generated by the encoding unit is provided.

  In another aspect, when the level presence flag is 0, an encoded bitstream is generated using a syntax indicating that level information regarding a current layer is equal to level information regarding a reference layer referenced by the current layer And transmitting the generated encoded bitstream is provided.

  In another aspect, when the profile presence flag is 0, the encoded bitstream is generated using a syntax indicating that the profile information regarding the operation point is equal to the profile information regarding the reference operation point referenced by the operation point There is provided an encoding device that includes an encoding unit that performs transmission and a transmission unit that transmits the encoded bitstream generated by the encoding unit.

  In another aspect, when the level presence flag is 0, the encoded bitstream is generated using a syntax indicating that the level information regarding the operation point is equal to the level information regarding the reference operation point referred to by the operation point There is provided an encoding device that includes an encoding unit that performs transmission and a transmission unit that transmits the encoded bitstream generated by the encoding unit.

  In another aspect, when the profile presence flag is 0, the encoded bitstream is generated using a syntax indicating that the profile information regarding the operation point is equal to the profile information regarding the reference operation point referenced by the operation point And transmitting the generated encoded bitstream is provided.

  In another aspect, when the level presence flag is 0, the encoded bitstream is generated using a syntax indicating that the level information regarding the operation point is equal to the level information regarding the reference operation point referred to by the operation point And transmitting the generated encoded bitstream is provided.

3 is a flow diagram of a method for utilizing a modified VPS syntax according to some embodiments. FIG. 3 is a block diagram of an exemplary computing device configured to implement a modified VPS method according to some embodiments. 1 is an overall view of a HEVC encoder according to some embodiments. FIG. 2 is an overall view of a HEVC decoder according to some embodiments. FIG.

  Described herein are updates to the profile_tier_level syntax structure to support additional flexibility for HEVC extensions while being used in the vps_extensions () syntax structure for each layer or operating point.

  The following is the profile_tier_level syntax structure presented in the current “International Standard Draft (DIS)” specification for “High Efficiency Video Coding (HEVC)”.

  The existence of the profile_tier_level related syntax structure is currently conditioned (restricted) by the external parameter flag of the profilePresentFlag used as a “temporary” parameter in the profile_tier_level related syntax structure in DIS. The following table shows which parameters can be conditioned when using this syntax structure in the vps_extension () syntax structure to support various HEVC extension requirements.

  Obviously, one of the group of parameters called “general_profile_tier”, which contains the general syntax for “profile_tier_only”, cannot be a reliable choice for use in the vps_extension () syntax structure. In other words, not all possible choices may be possible using the existing profile_tier_level syntax structure. This is due to the absence of “levelPresentFlag” which is another conditional flag as an external temporary parameter similar to profilePresentFlag or as additional syntax inside the profile_tier_level syntax structure.

  In the current HEVC specification, profile and hierarchy related parameters can be changed from layer to layer or operating point based on setting profilePresentFlag to 1 or 0. In the general case, the level parameter is always adapted, and if the sub_layer_level_present_flag is present, the sublayer related level parameter can be changed.

  However, with profile / hierarchy / level descriptions, level parameters can be common to some profile / hierarchy cases and can be changed for other cases. For the general case, there is a possibility that the level parameter can be changed separately from the profile / hierarchy parameter change. In other words, the level parameter can be changed by setting a new flag of levelPresentFlag to 1 or 0.

  The following table shows all possible combinations of profile_tier parameters and level parameters in the modified profile_tier_level syntax structure when “levelPresentFlag” exists as a temporary parameter similar to “profilePresentFlag” or as an additional syntax inside the profile_tier_level syntax structure: , Shows a possible method during application in this combination vps_extension ().

  1) profilePresentFlag allows for the restriction (existence) of profile and hierarchical syntax in the syntax structure described above for both general and sub-layer cases.

  2) There are no flags that affect (limit) LevelIDC syntax parameters for both general and sub-layer cases in the current_profile_tier_level syntax structure. Therefore, no restriction on the presence of LevelIDC can be given for either the layer or the operating point (OP) in vps_extension ().

  3) The profile_tier_level syntax structure can be updated as follows: use of “levelPresentFlag” as a temporary parameter similar to “profilePresentFlag” or insertion of levelPresentFlag as a new 1-bit syntax.

  Similar to profilePresentFlag, the update profile_tier_level syntax structure is shown below using levelPresentFlag as a temporary parameter.

  The previously defined vps_extension () uses the vps_profile_tier syntax structure where profilePresentFlag is always set to 1 for all layers (i = 1 to vps_max_layers_minus1), as shown below. In the general case, there are no restrictions on profile_tier or level syntax parameters.

  In the following sections, a modified profile_tier_level syntax structure is used for vps_extension () with layer specific or operating point (OP) specific updates, while restricting such syntax parameters of profile_tier and / or level 2 One method is implemented.

In the above syntax structure, four new syntax parameters are introduced.
vps_profile_present_flag [i]: When this flag is equal to 1, this parameter specifies that profile information for layer i is present in the profile_tier_level () syntax structure. When this flag is equal to 0, this parameter specifies that profile information for layer i is not present in the profile_tier_level () syntax structure.
vps_profile_ref_layer_num [i]: When vps_profile_present_flag [i] is equal to 0, the profile information for layer i is inferred to be equal to the layer profile information indicated by vps_profile_ref_layer_num [i], but the layer number was previously sent Used as an index to the reference profile-hierarchy_Level lookup table for storing such information of layers.
vps_level_present_flag [i]: When this flag is equal to 1, this parameter specifies that level information for layer i is present in the profile_tier_level () syntax structure. When this flag is equal to 0, this parameter specifies that level information for layer i is not present in the profile_tier_level () syntax structure.
vps_level_ref_layer_num [i]: When vps_level_present_flag [i] is equal to 0, the level information for layer i is inferred to be equal to the level information for the layer indicated by vps_level_ref_layer_num [i], but the layer number was previously sent Used as an index to the reference profile-hierarchy_Level lookup table for storing such information of layers.

  The combined effect of the value of vps_profile_present_flag and the value of vps_level_present_flag is shown in the following table, and such syntax parameter flags are present in the modified vps_extension () syntax structure shown above.

  As an example, if both “vps_profile_present_flag” and “vps_level_present_flag” are 0 (above chart), the available syntax parameter is “(reference-profile / hierarchy, LevelIdc)”, which is It means that all such parameters are available from the stored lookup table or “reference” lookup table when such parameters were previously sent. Such reference parameters are already described in two syntax parameters, vps_profile_ref_layer_num and vps_level_ref_layer_num. Such use of “vps_profile_present_flag” and “vps_level_present_flag” is effective in preventing an unrecognized condition.

The syntax structure described above introduces four new syntax parameters similar to the “level specific update” in the previous section.
vps_profile_present_flag [i]: When this flag is equal to 1, this parameter specifies that profile information for operating point i (or OP i) is present in the profile_tier_level () syntax structure. When this flag is equal to 0, this parameter specifies that no profile information for OP i exists in the profile_tier_level () syntax structure.
vps_profile_ref_op_num [i]: When vps_profile_present_flag [i] is equal to 0, the profile information for OP i is assumed to be equal to the profile information of the OP indicated by vps_profile_refjayer_num [i], and the OP number was previously sent Is used as an index to the reference profile-hierarchy-level lookup table for storing such information.
vps_level_present_flag [i]: When this flag is equal to 1, this parameter specifies that level information about OP i is present in the profile_tier_level () syntax structure. When this flag is equal to 0, this parameter specifies that no level information about OP i is present in the profile_tier_level () syntax structure.
vps_level_ref_op_num [i]: When vps_level_present_flag [i] is equal to 0, the level information for OP i is assumed to be equal to the OP level information indicated by vps_level_ref_layer_num [i], but the OP number was sent before It is used as an index to the reference profile-hierarchy_Level lookup table for storing such information of the OP.

  When this new flag of “levelPresentFlag” is used for the “profile_tier_level” syntax structure, this flag is initialized in VPS and SPS as follows:

  As described herein, an update on the profile_tier_level syntax structure is an additional in selecting profile_tier and level parameters for HEVC extensions in the extensible video coding, multi-view coding, and 3D video coding fields. Made to support flexibility. After this update, the modified syntax structure is used in the vps_extension () syntax structure, where the profile_tier and level parameters are limited in two possible ways for each layer or each operating point.

  FIG. 1 is a flow diagram of a method for utilizing a modified VPS syntax according to some embodiments. In step 100, content (eg, video) is obtained. The content can be obtained in any way such as copied, downloaded, or captured using sensors or any other method. In step 102, VPS data is generated using a flag indicating a level. In addition, VPS data is generated using additional flags and data to indicate levels and / or operating points. VPS data includes various HEVC extension information in the fields of scalable video coding, multi-view coding, and 3D video coding. In some embodiments, VPS data provides flexibility in profile / hierarchy / level information. In some embodiments, additional or fewer steps are performed. In some embodiments, the order of steps is modified.

  FIG. 2 is a block diagram of an exemplary computing device configured to implement a modified VPS method according to some embodiments. The computing device 200 can be used to obtain, store, calculate, process, communicate, and / or display information such as images and videos. In general, a preferred hardware configuration for implementing computer device 200 includes network interface 202, memory 204, processor 206, I / O device 208, bus 210, and storage device 212. The choice of processor is not critical as long as a preferred processor with sufficient speed is selected. The memory 204 can be any conventional computer memory known in the art. The storage device 212 may include a hard disk drive, CDROM, CDRW, DVD, DVDRW, Blu-ray®, flash memory card, or any other storage device. The computing device 200 can include one or more network interfaces 202. Examples of network interfaces include network cards connected to Ethernet or other types of LANs. The I / O device 208 may include one or more of the following: keyboard, mouse, monitor, screen, printer, modem, touch screen, button interface, and other devices. . The modified VPS application 230 used to implement the modified VPS method is probably stored in the storage device 212 and memory 204 and processed so that the application is typically processed. The computing device 200 may include more or fewer components than those shown in FIG. In some embodiments, modified VPS hardware 220 is included. The computer device 200 in FIG. 2 includes an application 230 and hardware 220 for a modified VPS method, but the modified VPS method is implemented on the computer device in hardware, firmware, software, or any combination thereof. Can be implemented. For example, in some embodiments, the modified VPS application 230 is programmed into memory and executed using a processor. In another example, in some embodiments, the modified VPS hardware 220 is a programmed hardware logic circuit that includes a gate specifically designed to implement a modified VPS method.

  In some embodiments, the modified VPS application 230 includes a number of applications and / or modules. In some embodiments, the module also includes one or more submodules. In some embodiments, fewer or additional modules may be included.

  Examples of suitable computing devices are personal computers, laptop computers, computer workstations, servers, mainframe computers, handheld computers, personal digital assistants, cellular / mobile phones, smart appliances, game consoles, digital cameras, digital camcorders, Camera phone, smart phone, portable music player, tablet computer, mobile device, video player, video disc writer / player (eg, DVD writer / player, high-definition disc writer / player, super High definition disc writer / player), television, home entertainment system, smart jewelry (eg, smart watch), or any other suitable computing device.

  FIG. 3 is an overall view of a HEVC encoder according to some embodiments. Encoder 300 includes general encoder control component, transform scaling and quantization component, scaling and inverse transform component, intra picture estimation component, filter control analysis component, intra picture prediction component, deblock and SAO filter Includes components, motion compensation components, motion estimation components, and header formatting and CABAC components. The input video signal is received by the encoder 300 and divided into “coding tree units (CTUs)”. The HEVC encoder component processes the video data using the modified VPS and generates an encoded bitstream.

  FIG. 4 is an overall view of a HEVC decoder according to some embodiments. The decoder 400 includes an entropy decoding component, an inverse quantization component, an inverse transform component, a current frame component, an intra prediction component, a past frame component, a motion compensation component, a deblock filter, an SAO component, and Includes an adaptive loop filter. An input bitstream (eg, encoded video) is received at decoder 400 and a decoded bitstream for display is generated. In some embodiments, a modified VPS is used while being decoded.

  To take advantage of the modified VPS method, the device can access parameters in the VPS and its extended information for scalable video coding, multi-view coding, 3D video coding, and mixed video sequences. The modified VPS method is automatically used when video processing is performed or at other times. The modified VPS method can be performed automatically without user intervention.

  In operation, the VPS and vps_extension () syntax structures are updated with some cleanup for HEVC extensions in the extensible video coding, multi-view coding, and 3D video coding fields. A VPS is generated using a modified syntax structure.

  US patent application Ser. No. 14 / 035,680 filed Sep. 24, 2013 and “JCTVC-L0226: VPS” entitled “Video Parameter Set (VPS) Syntax Reordering for Easy Access of Extended Parameters”. And U.S. Patent Application No. 14 / 035,711, filed September 24, 2013, under the name "and VPS_EXTENSION Update", are hereby incorporated by reference in their entirety for all purposes.

JCTVC-L0227: Some embodiments of VPS_EXTENSION with profile-hierarchy-level syntax structure updates a. Acquiring content; b. Generating a video parameter set of the content using a level flag indicating a level in the content.
2. The method of clause 1, wherein the flag is an external temporary parameter.
3. The method of clause 1, wherein the flag is an additional syntax in the profile_tier_level syntax structure.
4). Generating the video parameter set includes using a profile presence flag, and when the profile presence flag is equal to 1, the profile information for the layer is present in the profile hierarchy level syntax structure and the profile presence flag is 0. The method of clause 1, wherein the profile information about the layer is not present in the profile hierarchy level syntax structure when equal to.
5. Generating the video parameter set includes using a profile reference layer number, and when the profile presence flag is equal to 0, the profile information about the layer is included in the profile information of the layer indicated by the profile reference layer number. Clause 4 method presumed to be equal.
6). Generating the video parameter set includes using a level presence flag, and further, when the level presence flag is equal to 1, level information about the layer is present in the profile hierarchy level syntax structure and the level presence flag is 0. The method of clause 1, wherein level information about the layer is not present in the profile hierarchy level syntax structure.
7). Generating the video parameter set includes using a level reference layer number, and when the level reference layer number is equal to 0, the level information about the layer is the level information of the layer indicated by the level reference layer number. Clause 1 method presumed to be equal to
8). Generating the video parameter set includes using a profile presence flag, and when this flag is equal to 1, profile information about the operating point is present in the profile hierarchy level syntax structure and this flag is set to 0. Clause 1 method where, when equal, profile information about the operating point does not exist in the profile hierarchy level syntax structure.
9. Generating the video parameter set includes using a profile reference layer number, and when the profile presence flag is equal to 0, the profile information regarding the operating point is the profile of the operating point indicated by the profile reference layer number. Clause 8 method presumed to be equal to information.
10. Generating the video parameter set includes using a level presence flag, and further, when the level presence flag is equal to 1, level information about the operating point is present in the profile hierarchy level syntax structure, and the level presence flag is The clause 1 method, wherein when equal to 0, no level information about the operating point exists in the profile hierarchy level syntax structure.
11. Generating the video parameter set includes using a level reference layer number, and further, when the level reference layer number is equal to 0, the level information regarding the operating point is that of the operating point indicated by the level reference layer number. Clause 1 method presumed to be equal to level information.
12 Devices include personal computers, laptop computers, computer workstations, servers, mainframe computers, handheld computers, personal digital assistants, cellular / mobile phones, smart home appliances, game consoles, digital cameras, digital camcorders, camera phones, smartphones, Portable music player, tablet computer, mobile device, video player, video disc writer / reproducer, high-definition disc writer / reproducer, ultra-high-definition disc writer / reproducer, television, home entertainment The method of clause 1, comprising a system or smart watch.
13. a. Acquiring content; b. Generating a video parameter set of the content using a level flag indicating a level in the content, wherein generating the video parameter set includes using a profile presence flag; When is equal to 1, the profile information about the layer is present in the profile hierarchy level syntax structure, and when the profile presence flag is equal to 0, the profile information about the layer is not present in the profile hierarchy level syntax structure. When the flag is equal to 0, the profile information about the layer is inferred to be equal to the profile information of the layer indicated by the profile reference layer number, and when the level presence flag is equal to 1, the level information about the layer Exists in the profile hierarchy level syntax structure, and when the level presence flag is equal to 0, the level information about the layer does not exist in the profile hierarchy level syntax structure, and when the level reference layer number is equal to 0, the level related to the layer A method programmed into the persistent memory of the device comprising the above generating step wherein the information is assumed to be equal to the level information of the layer indicated by the level reference layer number.
14 a. i) acquire content, and ii. A persistent memory for storing an application for generating a video parameter set of the content using a level flag indicating a level in the content; b. And a processing component coupled to the memory and configured to process the application.
15. The device of clause 14, wherein the flag is an external temporary parameter.
16. The apparatus of clause 14, wherein the flag is an additional syntax in the profile_tier_level syntax structure.
17. Generating the video parameter set includes using a profile presence flag, and further, when the profile presence flag is equal to 1, the profile information for the layer is present in the profile hierarchy level syntax structure and the profile presence flag is 0. The device of clause 14 wherein profile information about the layer is not present in the profile hierarchy level syntax structure.
18. Generating the video parameter set includes using the profile reference layer number, and when the profile presence flag is equal to 0, the profile information for the layer is included in the profile information of the layer indicated by the profile reference layer number. The apparatus of clause 17 that is assumed to be equal.
19. Generating the video parameter set includes using a level presence flag, and further, when the level presence flag is equal to 1, level information about the layer is present in the profile hierarchy level syntax structure and the level presence flag is 0. The device of clause 14, wherein level information about the layer is not present in the profile hierarchy level syntax structure.
20. Generating the video parameter set includes using a level reference layer number, and when the level reference layer number is equal to 0, the level information about the layer is the level information of the layer indicated by the level reference layer number. The device of clause 14 that is presumed to be equal to.
21. Generating the video parameter set includes using a profile presence flag, and when this flag is equal to 1, profile information about the operating point is present in the profile hierarchy level syntax structure and this flag is set to 0. The device of clause 14, wherein the profile information about the operating point does not exist in the profile hierarchy level syntax structure when equal.
22. Generating the video parameter set includes using a profile reference layer number, and further, when the profile presence flag is equal to 0, the profile information regarding the operating point is the profile of the operating point indicated by the profile reference layer number. The device of clause 21 that is presumed to be equal to the information.
23. Generating the video parameter set includes using a level presence flag, and further, when the level presence flag is equal to 1, level information about the operating point is present in the profile hierarchy level syntax structure, and the level presence flag is Clause 14 apparatus, when level equal to 0, no level information about the operating point exists in the profile hierarchy level syntax structure.
24. Generating the video parameter set includes using a level reference layer number, and further, when the level reference layer number is equal to 0, the level information regarding the operating point is that of the operating point indicated by the level reference layer number. The device of clause 14 that is presumed to be equal to the level information.

  The invention has been described in terms of specific embodiments incorporating details to facilitate an understanding of the principles of construction and operation of the invention. Such references to specific embodiments and details thereof herein are not intended to limit the scope of the appended claims. It will be readily apparent to those skilled in the art that various other modifications can be made to the exemplary embodiments selected without departing from the spirit and scope of the invention as defined by the claims.

100 stage of acquiring content 102 stage of generating VPS data using a flag indicating a level VPS video parameter set

Claims (11)

An encoding unit that generates an encoded bitstream using a syntax indicating that profile information related to a current layer is equal to profile information related to a reference layer referenced by the current layer when the profile presence flag is 0;
A transmission unit for transmitting the encoded bitstream generated by the encoding unit;
An encoding device comprising:   The encoding apparatus according to claim 1, wherein the profile presence flag indicates that profile information relating to the current layer does not exist in a profile hierarchy level syntax structure by a value of 0.   The encoding apparatus according to claim 2, wherein the profile presence flag indicates that profile information regarding the current layer exists in a profile hierarchy level syntax structure by a value of 1.   The encoding apparatus according to claim 3, wherein the encoding unit generates the encoded bitstream in units of encoding tree units. An encoding unit that generates an encoded bitstream using a syntax indicating that level information about a current layer is equal to level information about a reference layer referenced by the current layer when a level presence flag is 0;
A transmission unit for transmitting the encoded bitstream generated by the encoding unit;
An encoding device comprising: Generating an encoded bitstream using a syntax indicating that profile information about a current layer is equal to profile information about a reference layer referenced by the current layer when the profile presence flag is 0;
Transmitting the generated encoded bitstream;
An encoding method including: Generating a coded bitstream using a syntax indicating that level information about a current layer is equal to level information about a reference layer referenced by the current layer when the level presence flag is 0;
Transmitting the generated encoded bitstream;
An encoding method including: An encoding unit that generates an encoded bitstream using a syntax indicating that profile information relating to an operation point is equal to profile information relating to a reference operation point referenced by the operation point when the profile presence flag is 0; ,
A transmission unit for transmitting the encoded bitstream generated by the encoding unit;
An encoding device comprising: An encoding unit that generates an encoded bitstream using a syntax indicating that level information about an operation point is equal to level information about a reference operation point referenced by the operation point when the level presence flag is 0; ,
A transmission unit for transmitting the encoded bitstream generated by the encoding unit;
An encoding device comprising: Generating an encoded bitstream using a syntax indicating that profile information relating to an operating point is equal to profile information relating to a reference operating point referenced by the operating point when the profile presence flag is 0;
Transmitting the generated encoded bitstream;
An encoding method including: Generating a coded bitstream using a syntax indicating that level information about an operating point is equal to level information about a reference operating point referenced by the operating point when the level presence flag is 0;
Transmitting the generated encoded bitstream;
An encoding method including:

Images