JP2023521420A - Coding Instantaneous Decoding Update Subpictures - Google Patents

Abstract

SUMMARY A method and apparatus for video processing are described. This processing may include video encoding, video decoding, or video transcoding. One exemplary video processing method includes converting between a video including one or more subpictures and a bitstream of the video, the one or more pictures and/or the one or more subpictures. Subpictures are included in this bitstream according to an ordering rule, which is the position of the current Instantaneous Decoding Update (IDR) picture or current IDR subpicture in this bitstream. defines the relationship between another picture referenced by an entry in the reference picture list for the current slice of . [Selection drawing] Fig. 3

Description

CROSS-REFERENCE TO RELATED APPLICATIONS Under applicable patent law and/or regulations under the Paris Convention, this application timely claims priority to and benefit from U.S. Provisional Patent Application No. 63/008799, filed April 12, 2020. intended to make a claim. For all statutory purposes, the entire disclosure of the above application is incorporated by reference as part of the disclosure of this specification.

This patent specification relates to image and video coding and decoding.

Digital video accounts for the largest bandwidth usage on the Internet and other digital communication networks. It is expected that the bandwidth demand for digital video usage will continue to grow as the number of connected user devices capable of receiving and displaying video increases.

This application discloses techniques that can be used by video encoders and decoders to process coded representations of video using control information useful for decoding the coded representations.

In one exemplary aspect, a video decoding method is disclosed. The method includes converting between a video consisting of one or more layers of one or more video regions and a coded representation of the video according to format rules, where the format rules define corresponding video regions. It specifies that one or more syntax elements are included in the coded representation at one or more video-domain levels corresponding to the allowed slice types of .

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more layers of one or more video pictures forming one or more video slices and a coded representation of the video according to format rules. Including, the format rules stipulate that, according to a second rule, syntax elements relating to enabling or using coding modes at the slice level shall be included at most once during either a picture header or a slice header.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between one or more video pictures containing one or more video slices and a coded representation of the video according to format rules, the format rules being allowed in the video pictures. The specified slice type controls whether the reference picture list is signaled in this coded representation or can be generated from this coded representation.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more video pictures including one or more subpictures and a coded representation of the video, the coded representation conforming to the format rules and the Format rules specify the treatment of non-coded sub-pictures of a video picture.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more subpictures and a bitstream of the video, the one or more pictures and/or the one or more subpictures according to an ordering rule. Included in this bitstream, this ordering rule is for the current slice of the current Instantaneous Decoding Update (IDR) picture or current subpicture at the position of the current instantaneous decoding update (IDR) picture or current subpicture in this bitstream. defines the relationship between another picture referenced by an entry in the Reference Picture List of the .

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more pictures including one or more subpictures and/or one or more slices and a bitstream of the video based on format rules. The format rule includes an access unit indication indicating whether this access unit is an intra-random access point (IRAP) access unit or a gradual decoding update (GDR) access unit for each access unit in this video. allow to include

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more pictures including one or more subpictures and/or one or more slices and a bitstream of the video based on format rules. Including, the format rules specify that an indication of whether a slice type is allowed in a picture is selectively included in the bitstream based on the picture conditions of that picture.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more pictures including one or more subpictures and/or one or more slices and a bitstream of the video, the format rules comprising: For an ALF (Adaptive Loop Filter) adaptive parameter set, it is provided to set at least one of two or four syntax elements to a specific value.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more pictures and a bitstream of the video according to formatting rules, the formatting rules signaling an indication of filter presence flags and/or filter coefficients. Specifies that whether and/or how to signal depends on pre-coded information with adaptive loop filtering data structures and/or syntax elements in the adaptive parameter set RBSP (Raw Byte Array Payload) do.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more pictures and a bitstream of the video according to format rules, the format rules for video regions smaller than the pictures, adaptive parameters It is possible to refer to multiple APSs corresponding to coding tools whose side information is included in the set (APS).

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more pictures including one or more subpictures and a bitstream of the video according to format rules, the format rules including in-loop filtering. A method for inferring the value of a first variable indicating whether a subpicture of a coded picture is to be treated as a picture in a decoding process excluding motion dependent on a second variable indicating the presence of subpicture information in the bitstream. stipulate.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more pictures including one or more subpictures and a bitstream of the video according to format rules, the format rules including one or more is satisfied, the variable indicating the applicability of the deblocking filter to pictures referencing this picture parameter set indicates that the deblocking filter should be applied to slices referencing this picture parameter set. It is specified to have a first value or a second value indicating that this deblocking filter is disabled for slices that reference this picture parameter set.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more video units including one or more slices and a bitstream of the video according to format rules, the format rules including joint saturation It specifies that the quantization parameter offsets used for residual coding are contained at one or more video unit levels greater than the slice level.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video containing one or more pictures and a bitstream of this video according to format rules, which format rules are: (i) LMCS (chroma saturation) at the picture header level; Intensity Mapping with Scaling) defines a fixed or variable length of one or more bits used to code a variable that indicates mode identification and (ii) the range of values for this variable.

In another exemplary aspect, another video processing method is disclosed. The method includes converting between a video including one or more pictures and a bitstream of the video according to format rules, which format rules include: (i) a scaling list mode identification at picture header level; and (ii) the range of values for this variable.

In yet another exemplary aspect, a video encoder (encoding) apparatus is disclosed. The video encoder comprises a processing device configured to implement the method described above.

In yet another exemplary aspect, a video decoder (decoding) apparatus is disclosed. The video decoder comprises a processing device configured to implement the method described above.

In yet another exemplary aspect, a computer-readable medium having code stored thereon is disclosed. This code implements one of the methods described herein in the form of processor executable code.

These and other features are described throughout this specification.

1 is a block diagram illustrating an example video processing system; FIG. 1 is a block diagram of a video processing device; FIG. 4 is a flow chart showing an example of a video processing method; 1 is a block diagram illustrating a video coding system according to some embodiments of the invention; FIG. 1 is a block diagram illustrating an encoder according to some embodiments of the invention; FIG. FIG. 4 is a block diagram illustrating a decoder according to some embodiments of the invention; 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology. 4 illustrates a flow chart of an exemplary method of video processing, in accordance with some implementations of the disclosed technology.

1. introduction

The present specification relates to video coding technology. Specifically, it relates to allowed slice type signaling and related coding tool improvements applicable only to bi-predictive slices, and support for non-coded subpictures. This idea may be applied individually or in various combinations to any video coding convention or non-standard video codec that supports multi-layer video coding, such as Versatile Video Coding (VVC) currently being developed.

2. Abbreviations

ALF Adaptive Loop Filter
APS Adaptation Parameter Set
AU Access Unit
AUD Access Unit Delimiter
AVC Advanced Video Coding
CLVS Coded Layer Video Sequence
CPB Coded Picture Buffer
CRA Clean Random Access
CTU Coding Tree Unit
CVS Coded Video Sequence
CVSS Coded Video Sequence Start
DCI Decoding Capability Information
DPB Decoded Picture Buffer
DU Decoding Unit
EOB End Of Bitstream
EOS End Of Sequence
GDR Gradual Decoding Refresh
HEVC High Efficiency Video Coding
HRD Hypothetical Reference Decoder
IDR Instantaneous Decoding Refresh
JEM Joint Exploration Model
LMCS Luma Mapping with Chroma Scaling
MCTS Motion-Constrained Tile Sets
NAL Network Abstraction Layer
OLS Output Layer Set
PH Picture Header
PPS Picture Parameter Set
PTL Profile, Tier and Level
PU Picture Unit
RADL Random Access Decodable Leading (picture)
RAP Random Access Point
RASL Random Access Skipped Leading (picture)
RBSP Raw Byte Sequence Payload
RPL Reference Picture List
SAO Sample Adaptive Offset
SEI Supplemental Enhancement Information
SPS Sequence Parameter Set
STSA Step-wise Temporal Sublayer Access
SVC Scalable Video Coding
VCL Video Coding Layer
VPS Video Parameter Set
VTM VVC Test Model
VUI Video Usability Information
VVC Versatile Video Coding

3. initial consultation

Video coding standards have evolved primarily through the development of well-known ITU-T and ISO/IEC standards. The ITU-T is H.264. 261 and H. 263, ISO/IEC created MPEG-1 and MPEG-4 Visual, and both groups created H.263. 262/MPEG-2 Video and H.262/MPEG-2 Video. 264/MPEG-4 AVC (Advanced Video Coding) and H.264/MPEG-4 AVC (Advanced Video Coding). H.265/HEVC standard was co-created. H. Since H.262, the video coding standard is based on a hybrid video coding structure in which temporal prediction and transform coding are utilized. In 2015, VCEG and MPEG jointly established JVET (Joint Video Exploration Team) to explore future video coding technology beyond HEVC. Since then, many new methods have been adopted by JVET and incorporated into the reference software called JEM (Joint Exploration Model). JVET meets quarterly and the new coding standard aims at a 50% bitrate reduction compared to HEVC. At the JVET conference in April 2018, we formally named the new video coding standard "VVC (Versatile Video Coding)" and released the first version of the VVC test model (VTM) at that time. As efforts continue to contribute to the standardization of VVC, new coding techniques are adopted in the VVC standard at every JVET conference. After each meeting, update the VVC working draft and the test model VTM. The latest VVC Working Draft JVET-Q2001_vE can be downloaded from:

http://phenix. it-sudparis. eu/jvet/doc_end_user/documents/17_Brussels/wg11/JVET-Q2001-v15. zip

The VVC project is currently targeting completion of technology (FDIS) at the July 2020 meeting.

3.1. parameter set

AVC, HEVC, VVC define parameter sets. Types of parameter sets are SPS, PPS, APS, VPS, and so on. SPS and PPS are supported by all of AVC, HEVC and VVC. VPS was introduced from HEVC and is included in both HEVC and VVC. APS was not included in AVC or HEVC, but is included in the text of recent VVC drafts.

SPS was designed to carry sequence-level header information, and PPS was designed to carry picture-level header information that does not change frequently. With SPS and PPS, redundant signaling of this information can be avoided, as frequently changing information does not need to be repeated for each sequence or picture. Additionally, using SPS and PPS enables out-of-band transmission of critical header information, thereby avoiding the need for redundant transmissions as well as improving error resilience.

VPS was introduced to carry sequence-level header information that is common to all layers of a multi-layer bitstream.

APS was introduced to carry such picture-level or slice-level information, which requires significant bits to code and can be shared by multiple pictures. And there can be a great many different variations in the sequence.

3.1.1. Video parameter set (VPS)

The syntax table of the latest VVC draft text (JVET-Q2001-vE/v15) and the semantics of multiple syntax elements are defined as follows.

3.1.2. Sequence parameter set (SPS)

The syntax table of the latest VVC draft text (JVET-Q2001-vE/v15) and the semantics of multiple syntax elements are defined as follows.

3.1.3. general constraint flag

no_bdof_constraint_flag equal to 1 specifies that sps_bdof_enabled_flag is equal to 0. no_bdof_constraint_flag equal to 0 imposes no such constraint.
no_dmvr_constraint_flag equal to 1 specifies that sps_dmvr_enabled_flag is equal to 0. no_dmvr_constraint_flag equal to 0 imposes no such constraint.
no_bcw_constraint_flag equal to 1 specifies that sps_bcw_enabled_flag is equal to 0. no_bcw_constraint_flag equal to 0 imposes no such constraint.
no_ciip_constraint_flag equal to 1 specifies that sps_ciip_enabled_flag is equal to 0. no_cipp_constraint_flag equal to 0 imposes no such constraint.
no_gpm_constraint_flag equal to 1 specifies that sps_gpm_enabled_flag is equal to 0. no_gpm_constraint_flag equal to 0 imposes no such constraint.

3.1.4. Picture Parameter Set (PPS)

The syntax table of the latest VVC draft text (JVET-Q2001-vE/v15) and the semantics of multiple syntax elements are defined as follows.

num_ref_idx_active_minus1[i] equal to 0 specifies the inference value of the variable NumRefIdxActive[0] in the P or B slice with num_ref_idx_active_override_flag=0 if i is equal to 0 and num_ref_idx_active_overri equal to 0 de_flag, if i equals 1, Define the inference value of the B slice variable NumRefIdxActive[1] with num_ref_idx_active_override_flag=0. The value of num_ref_idx_default_active_minus1[i] shall be in the range 0-14.
sps_weighted_bipred_flag equal to 0 specifies that no explicit weighted prediction is applied for B slices referencing the PPS. sps_weighted_bipred_flag equal to 1 specifies that explicit weighted prediction is applied for B slices referencing the PPS. The value of pps_weighted_bipred_flag shall be equal to 0 if sps_weighted_bipred_flag is equal to 0.

3.1.5. DPB parameter syntax

The syntax table of the latest VVC draft text (JVET-Q2001-vE/v15) and the semantics of multiple syntax elements are defined as follows.

7.4.5 DPB Parameter Semantics

The dpb_parameters() syntax structure provides DPB size, maximum picture rearrangement and maximum latency information for one or more OLS.
If the dpb_parameters() syntactic structure is included in the VPS, the OLS to which this dpb_parameters() syntactic structure applies is defined by the VPS. If the SPS contains the dpb_parameters() syntax structure, it applies to the OLS that contains only the lowest layer among the layers that reference the SPS, and this lowest layer is an independent layer.

max_dec_pic_buffering_minus1[i] plus 1 specifies the maximum required size of the DPB in units of picture storage buffers when Htid equals i. The value of max_dec_pic_buffering_minus1[i] shall be in the range of 0 to MaxDpbSize-1. However, MaxDpbSize is defined in Clause A.1. As defined in 4.2. If i is greater than 0, max_dec_pic_buffering_minus1[i] shall be greater than or equal to max_dec_pic_buffering_minus1[i]. For i in the range 0 to maxSubLayersMinus1-1, if max_dec_pic_buffering_minus1[i] does not exist, it is inferred to be equal to max_dec_pic_buffering_minus1[maxSubLayersMinus1] because subLayerInfoFlag is equal to 0 .

max_num_reorder_pics[i] specifies the maximum allowed number of pictures in the OLS that can precede any picture in the OLS in decoding order and follow that picture in output order if Htid is equal to i. The value of max_num_reorder_pics[i] shall be in the range 0 to max_dec_pic_buffering_minus1[i]. If i is greater than 0, max_num_reorder_pics[i] shall be greater than or equal to max_num_reorder_pics[i]. When i is in the range 0 to maxSubLayersMinus1-1, subLayerInfoFlag is equal to 0, so if max_num_reorder_pics[i] does not exist, it is inferred to be equal to max_num_reorder_pics[maxSubLayersMinus1].

A non-zero max_latency_increase_plus1[i] is used to calculate the value of MaxLatencyPictures[i], the maximum number that can precede any picture in the OLS in output order and follow that picture in decoding order if Htid is equal to i. defines the picture of
If max_latency_increase_plus1[i] is non-zero, the value of MaxLatencyPictures[i] is defined as follows.
MaxLatencyPictures[i]=max_num_reorder_pics[i]+max_latency_increase_plus1[i]-1 (7-110)
If max_latency_increase_plus1[i] is equal to 0, no corresponding limit is expressed.
The value of max_latency_increase_plus1[i] is between 0 and 2 ³² −2. If max_latency_increase_plus1[i] does not exist where i ranges from 0 to maxSubLayersMinus1−, it is inferred to be equal to max_latency_increase_plus1[maxSubLayersMinus1] because subLayerInfoFlag is equal to 0.

3.2. Picture Header (PH) and Slice Header (SH) in VVC

Similar to HEVC, the slice header in VVC conveys information about a particular slice. This includes slice address, slice type, slice QP, picture order count (POC) least significant bit (LSB), RPS and RPL information, weighted prediction parameters, loop filtering parameters, tile entry offsets, WPP, and so on.

VVC introduced a picture header (PH) containing header parameters for a particular picture. Each picture must have one PH or only one PH. PH basically carries the parameters that would have been in the slice header if PH had not been introduced, each having the same value for all slices of a picture. These are IRAP/GDR picture indication, inter/intra slice grant flag, POC LSB and optionally POC MSB, RPL, deblocking, SAO, ALF, QP delta, and weighted prediction, coding block partition information, virtual boundaries, It contains information about co-located picture information, etc. Each picture in the entire sequence of pictures often contains only one slice. In such cases, the PH syntax structure can be included in either the PH NAL unit or the slice header to disallow having at least two NAL units in each picture.

In VVC, the co-located picture information used for temporal motion vector prediction is signaled in either the picture header or the slice header.

3.2.1. picture header (PH)

The syntax table and the semantics of multiple syntax elements in the latest VVC Working Draft () are defined as follows.

3.2.2. Slice header (SH)

The syntax table and the semantics of multiple syntax elements in the latest VVC Working Draft () are defined as follows.

slice_type defines the coding type of the slice according to Table 9.

If not present, the value of slice_type is assumed to be equal to two.
If ph_intra_slice_allowed_flag is equal to 0, the value of slice_type shall be equal to 0 or 1. slice_type shall be equal to 2 if nal_unit_type is in the range of IDR_W_RADL to CRA_NUT and vps_independent_layer_flag[GeneralLayerIdx[nuh_layer_id]] is equal to 1;

3.3 Recent progress in JVET-R0052

In method #2 of JVET-R0052, it is proposed to add one allowed type index (i.e., ph_allowed_slice_types_idc), and whether to use B slices in one picture is determined from the newly added syntax element can be derived.

We also add a new syntax element ph_multiple_slice_types_in_pic_flag to the PH structure to specify whether multiple slice types can exist in the current picture. ph_multiple_slice_types_in_pic_flag=1 specifies that coded slices of a picture may have different slice_type values. ph_multiple_slice_types_in_pic_flag=0 specifies that all coded slices of a picture have the same slice_type value. If ph_multiple_slice_types_in_pic_flag is equal to 0, ph_slice_type is also signaled to specify the value of slice_type for all slices of the picture, and is inferred to be equal to the value of ph_slice_type since slice_type in the slice header is not coded.

7.4.3.7 Picture header structure semantics

[[ ph_inter_slice_allowed_flag equal to 0 specifies that slice_type is 2 for all coded slices of the picture. ph_inter_slice_allowed_flag equal to 1 specifies that pictures with slice_type equal to 0 or 1 may or may not have one or more coded slices. [Ed. (YK): Double check the necessity/correctness of the syntax element inference rules contingent on this flag being equal to zero. ]

ph_intra_slice_allowed_flag equal to 0 specifies that all coded slices of the picture have slice_type equal to 0 or 1; ph_intra_slice_allowed_flag equal to 1 specifies that one or more coding slices with slice_type equal to 2 may or may not be present in the picture. If not present, the value of ph_intra_slice_allowed_flag is inferred to be equal to one. [Ed. (YK): Double check the necessity/correctness of the syntax element inference rules contingent on this flag being equal to one. ]]]

7.4.8.1 General slice header semantics

slice_type defines the coding type of the slice according to Table 9.

[[If ph_intra_slice_allowed_flag is equal to 0, the value of slice_type shall be equal to 0 or 1; ]] slice_type shall be equal to 2 if nal_unit_type is in the range of IDR_W_RADL to CRA_NUT and vps_independent_layer_flag[GeneralLayerIdx[nuh_layer_id]] is equal to 1.

7.4.8.2 Weight prediction parameter semantics

num_l1_weights specifies the number of weights signaled for an entry in reference picture list 1 when pps_weighted_bipred_flag and wp_info_in_ph_flag are both equal to one. The value of num_l1_weight shall be in the range 0 to Min(15, num_ref_entries[1][RplsIdx[1]]).

In the PPS, a new syntax element pps_multiple_slice_types_in_pic_flag can also be signaled. If pps_multiple_slice_types_in_pic_flag is equal to 0, then ph_multiple_slice_types_in_pic_flag is inferred to be equal to 0 for all PHs that reference the PPS.

Relevant amendments to VVC Draft 8, written in red and highlighted in yellow, are provided below.

PH of Method 1

7.3.2.7 Picture header structure syntax

PH of Method 2

7.4.3.4 Picture parameter set RBSP semantics

3.4. Uncoded subpictures and potential applications in JVET-R0151

In this application, we show how VVC can be extended by a mechanism that enables uncoded subpictures. If the sub-picture does not completely fill the picture, the uncoded sub-picture can be used for efficient coding by providing a completely unused area. An example of OMAF use case and 4×3 cubemap 360° video coding is shown. Additionally, uncoded subpictures can be used to reserve space that is filled with content generated from already coded content rather than coded data. Here we present an example of high-level efficient geometry padding for 360° video.

3.5 APS

Syntax table for ALF APS data

Syntax Table for Explicit Scaling List APS Data

Use of ALF APS (on/off control and optionally one or more APS indices) is signaled to either PH or SH, but not both. Multiple ALF APS can be signaled for one picture/slice. For explicit scaling list and LMCS, a flag is signaled in the PH to indicate the explicit scaling list and LMCS is enabled for at least one slice. Also, if enabled, one APS index is additionally signaled.

4. Technical problem solved by the disclosed technical solution

The current VVC body and recent advances in JVET have the following problems.

1. The latest VVC draft text (JVET-Q2001-vE/v15) contains two PH syntax elements for allowed slice types: ph_inter_slice_allowed_flag and ph_intra_slice_allowed_flag, as expressed in the picture header structure syntax. These two flags cause syntax elements related to I-slice coding to be signaled only when ph_intra_slice_allowed_flag is true, and syntax elements related to inter-slice coding to be signaled only when ph_inter_slice_allowed_flag is true. However, if ph_inter_slice_allowed_flag is equal to 1, the decoder does not know if the picture contains B slices. Some applications, such as online gaming, video conferencing, video surveillance often use only P and I slices. Thus, given an indication of whether B slices are allowed, decoders for such applications may choose to request/use only bitstreams that do not contain B slices, and furthermore this Indications can be used to avoid sending multiple unnecessary parameters.

2. In JVET-R0052, the recommended changes apply only to PH and SH. There is no higher level control over whether one can only have the same slice type within a picture and/or what kinds of allowed slice types are enabled within a picture. . Also, it does not describe how values are inferred if certain syntax elements related only to bi-prediction are not present.

3. In item 1 of JVET-R0191, it is proposed to replace the constraint that the value of sps_ptl_dpb_hrd_params_present_flag is equal to vps_independent_layer_flag[GeneralLayerIdx[nuh_layer_id] by:
The value of sps_ptl_dpb_hrd_params_present_flag shall be equal to 1 if there is an OLS containing only one layer and its layer ID equals the nuh_layer_id of the SPS.
However, this change introduces a VPS dependency with the condition "if there is an OLS containing only one layer". Another issue is that for single layer bitstreams, the value of sps_ptl_dpb_hrd_params_present_flag must be equal to 1, which is not caught by the modified constraints.

4. The following constraints were proposed in JVET-R0267. If the current picture is an IDR picture and sps_idr_rpl_present_flag is 1, either RefPicList[0] or RefPicList[1], in output order or decoding order, precedes the previous IRAP picture (if any) in decoding order The picture referenced by the entry does not exist.
However, this constraint only applies to single-layer bitstreams.

5. The following changes to VVC were proposed in JVET-R0042.
1) For each picture type, a corresponding sub-picture type is defined.
2) The terms "associated GDR sub-picture" and "associated IRAP sub-picture" are also defined.
3) The content of a NAL unit with nal_unit_type equal to CRA_NUT is called a "coded slice or subpicture of a CRA picture" rather than a "coded slice of a CRA picture". The same is true for other VCL NAL unit types.
4) Any two adjacent sub-pictures with different NAL unit types within one picture must both have subpic_transport_as_pic_flag[ ] equal to 1;
5) Similar constraints on relative decoding order, output order, and prediction relationship for pictures of different types and pictures of the same layer in preceding and succeeding AUs apply to different types of sub-pictures and same sub-pictures in preceding and succeeding AUs Defined in the subpicture domain for subpictures of the same sublayer with indices.
However, there are no restrictions on RPL entries for IDR subpictures.

6. JVET-R0065 proposed the following changes to VVC.
1) Each GDR AU needs to be complete (ie has a picture for each layer present in the CVS). That is, an incomplete AU composed of GDR pictures is not a GDR AU, just as an incomplete AU composed of IRAP pictures in current VVC text is not an IRAP AU.
2) Add a flag named irap_or_gdr_au_flag to the AUD to specify whether the AU is an IRAP or a GDR AU, mandating the presence of an AUD NAL unit in each IRAP or GDR AU if vps_max_layers_minus1 is greater than zero.
However, if there is no need to complete an IRAP or GDR AU, but each picture in the AU is required to be an IRAP or GDR picture, then after receiving the first VCL NAL unit of the first picture, the AU An indication of whether an AU is an IRAP or a GDR AU is still needed so that the decoder can understand that is an IRAP or a GDR AU. Without such an indication, the decoder either receives the last picture of the AU (if the last picture received is in the top layer of the OLS) or receives the first NAL unit of the next AU. It is not possible to know this until later (when the last picture received is not in the top layer of the OLS).

7. JVET-R0063 proposes to replace the PH flag ph_lmcs_enabled_flag with a 2-bit ph_lmcs_mode_idc to define three modes: disabled (mode 0), used for all slices (mode 1), and enabled (mode 2). rice field. In mode 1, LMCS is used for all slices of a picture and no signaling of the LMCS control flag is required in SH. The semantics of slice_lmcs_enabled_flag are changed accordingly. Additionally, fixing the semantics of ph_chroma_residual_scale_flag was proposed to reflect the intent to enable/disable chroma residual scaling for a picture or slice. However, the ph_lmcs_mode_idc proposed in JVET-R0063 may be ue(v) coded.

8. JVET-R0064 proposes to replace the PH flag ph_explicit_scaling_list_enabled_flag with a 2-bit ph_explicit_scaling_list_mode_idc to define three modes: disabled (mode 0), used for all slices (mode 1) and enabled (mode 2). rice field. In Mode 1, explicit scaling lists are used for all slices of a picture and no scaling list signaling is required in SH. However, ph_explicit_scaling_list_mode_idc proposed in JVET-R0064 may be ue(v) coded.

5. Illustrative List of Solutions and Embodiments

In order to solve the above problems, the following methods have been disclosed. These following items are examples to illustrate the general concept and should not be interpreted narrowly. Further, these items may be applied individually or combined in any manner.

whether only X (e.g., I, or B or P) slices are allowed in a picture in the parameter set (e.g., SPS, VPS, PPS, APS, DCI) and/or general constraint information syntax; and/ Or one or more syntax elements can be added to indicate the allowed set of slice types within a picture.

In parameter sets and general constraint information syntax

1. In SPS, PPS, etc. video units, add one or more syntax elements (eg, sps_allowed_slice_idc) to specify the allowed slice types in CLVS pictures.
1) In one example, adding a first syntax element (e.g., sps_allowed_slice_idc) whose semantics is that sps_allowed_slice_idc equals X allows pictures only the following allowed slice types, or any combination thereof: stipulate that
i. {all I}, {all P}, {all B}, {I, P}, {I, B}, {P, B}, {I, B, P}
ii. In one example, the first syntax element may be fixed-length coded (eg, u(1), u(2), or U(3)), unary coded, truncated unary coded, and EG coded.
iii. Alternatively, the signaling and/or semantics and/or inference of one or more syntax elements signaled in the SPS or PPS are signaled only if the first syntax element satisfies a condition. May be changed.
a. In one example, the one or more syntax elements refer to coding tools that require multiple prediction signals, e.g., bi-prediction or mixed intra-inter coding, or prediction with linear/non-linear weighting from multiple prediction blocks. It is to make it possible.
b. In one example, one or more syntax elements can include, but are not limited to:
a) sps_weighted_bipred_flag
b) sps_bdof_enabled_flag
c) sps_smvd_enabled_flag
d) sps_dmvr_enabled_flag
e) sps_bcw_enabled_flag
f) sps_ciip_enabled_flag
g) sps_gpm_enabled_flag
c. In one example, one or more syntax elements can be signaled only if the first syntax element specifies that the CLVS associated with the video unit can contain one or more B slices. . Otherwise, signaling is skipped and the value of the syntax element is inferred.
d. In one example, if sps_b_slice_allowed_flag is equal to 0, the syntax elements sps_weighted_bipred_flag, sps_bdof_enabled_flag, sps_SMVD_enabled_flag, sps_bcw_enabled_flag, sps_chip_enabled_ flag, and sps_gpm_enabled_flag are not signaled and their values are inferred.
a) In one example, they are inferred to be all 0 if absent.

v. Alternatively or additionally, if the first syntax element specifies that the CLVS does not include B slices (e.g., only sps_allowed_slice_idc equal to X representing {I, P}, {all I}, {all P}), One or more syntax elements signaled in the general constraint information syntax must equal one.
a. In one example, one or more syntax elements can include, but are not limited to:
a) no_bcw_constraint_flag
b) no_ciip_constraint_flag
c) no_gpm_constraint_flag
d) no_bdof_constraint_flag
e) no_dmvr_constraint_flag
vi. Alternatively, in addition, the signaling and semantics of one or more syntax elements signaled in dpb_parameters() may be changed such that the first syntax element is only signaled if it meets certain conditions. .
a. In one example, one or more syntax elements can include, but are not limited to:
a) max_num_reorder_pics
b. In one example, if the first syntax element says that B slices are not allowed, max_num_reorder_pics is not signaled and is inferred to be zero.

in PH/SH

2. In PH/SH, a variable X is used to indicate whether B-slices are allowed/used in a picture/slice, and this variable defines the SPS syntax elements and/or the allowed slice types in the new PH It may be derived from syntax elements (eg, ph_allowed_slice_idc), and/or other syntax elements (BSliceAllowed as used in JVET-R0052).
1) In one example, a new PH syntax element is added and how to signal this syntax element may depend on the slice types allowed in the SPS.
2) Alternatively, the signaling and/or semantics and/or reasoning of one or more syntax elements signaled in the PH may be altered based on variables.
i. In one example, the one or more syntax elements refer to coding tools that require multiple prediction signals, e.g., bi-prediction or mixed intra-inter coding, or prediction with linear/non-linear weighting from multiple prediction blocks. It is to make it possible.
ii. In one example, one or more syntax elements can include, but are not limited to:
a) ph_collocated_from_l0_flag
b) mvd_l1_zero_flag
c) ph_disable_bdof_flag
d) ph_disable_dmvr_flag
e) num_l1_weights

iv. In one example, if X equals 0 (or is false), mvd_l1_zero_flag is not signaled and its value is inferred to be 1.

Effects of syntax elements

3. For syntax elements associated with coding tool X and/or syntax elements that may be present in either A (e.g. PH) or B (e.g. SH) but not both, if A is in B , at least one of the indications of the presence of those syntax elements is not signaled and may be inferred to be present in 0, ie B.
1) In one example, coding tool X may include one of the following:
i. In-loop filter technology e.g. deblocking filter, ALF, SAO
ii. weight prediction iii. QP delta information iv. RPL Information 2) In one example, the condition "A is contained in B" may be defined as "a slice header indicating that the PPS contains a PH syntax structure" or "the current picture is one "consisting only of slices".
3) In one example, "indicate the presence of these syntactical elements" may be defined as one or more of the following syntactical elements:
i. qp_delta_info_in_ph_flag, rpl_info_in_ph_flag, dbf_info_in_ph_flag, sao_info_in_ph_flag, wp_info_in_ph_flag, alf_info_in_ph_flag

4. A conforming bitstream requires NoOutputOfPriorPicsFlag to be set equal to 1 for splicing-piont pictures that are CLVS AUs in the spliced bitstream if its POC value is greater than the POC value of the previous picture. Shall follow the rules.
1) If the current AU is a coded video sequence start (CVSS) AU and the current AU's PicOrderCntVal is greater than the previous picture's PicOrderCntVal in decoding order, the value of NoOutputOfPriorPicsFlag is set regardless of other conditions (e.g., set equal to 1, regardless of the no_output_of_prior_pics_flag of the picture in the current AU).

5. Whether it is allowed to signal syntax elements indicating Inter-slice/B-slice/P-slice in a picture and/or RPL/WP information and/or an indication of the presence of RPL/WP information depends on the type of picture. and may depend on whether layer independence is enabled.

1) Whether it is allowed to signal syntax elements indicating Inter-slice/B-slice/P-slice in a picture and/or RPL/WP information and/or an indication of the presence of RPL/WP information is and whether the layers are independent layers and whether the CLVS contains only one layer.
2) In one example, the syntax element may be signaled in the picture header (PH) or PPS.
3) In one example, whether to signal a syntax element may depend on one or more syntax elements signaled in a higher level video unit (eg, SPS).

4) In one example, syntax elements are not signaled for IRAP pictures and layer independence is enabled.
i. Conversely, syntax elements are not signaled for IRAP pictures or slices in independent layers.
ii. In one example, the ph_inter_slice_allowed_flag in VVC is not signaled for IRAP pictures and layer independence is enabled.
iii. In one example, slice_type in VVC is not signaled for IRAP pictures and layer independence is enabled.
iv. In one example, ph_slice_type in JVET-R0052 is not signaled for IRAP pictures and layer independence is enabled.
v. In one example, ph_inter_slice_allowed_flag in VVC is an IRAP picture (i.e., a layer where vps_independent_layer_flag[GeneralLayerIdx[nuh_layer_id]] equals 1) in an independent layer (i.e., all coded slice NAL units NAL unit type equal to _NUT ) and is inferred to be equal to 0.
vi. In one example, slice_type in VVC is not signaled and is inferred to be equal to 2 for IRAP slices in independent layers (i.e., coded slice NAL units with nal_unit_type equal to IDR_W_RADL, IDR_N_LP, or CRA_NUT).
vii. In one example, ph_slice_type in JVET-R0052 is inferred to be equal to 2, not signaled for IRAP pictures in independent layers.

5) In one example, syntax elements are not signaled for IRAP pictures or slices in single-layer CLVS.
i. In one example, the ph_inter_slice_allowed_flag in VVC is set to NAL for IRAP pictures (i.e., all coded slice NAL units equal to IDR_W_RADL, IDR_N_LP or CRA_NUT) if the CLVS contains only one layer (i.e., sps_video_parameter_set_id equals 0). picture with unit type) and is inferred to be equal to 0.
ii. In one example, if the CLVS contains only one layer, slice_type in VVC is not signaled for IRAP slices (i.e., coded slice NAL units with nal_unit_type equal to IDR_W_RADL, IDR_N_LP, or CRA_NUT).
iii. In one example, ph_slice_type in JVET-R0052 is not signaled for IRAP pictures when the CLVS contains only one layer.

6) In one example, syntax elements are not signaled for IRAP pictures, layer independence is enabled, and the presence of such information also indicates that they are in the PH.
i. In one example, syntax elements are not signaled for IRAP pictures in independent layers, even if the presence of such information indicates that the IRAP picture is in the PH.
ii. If gdr_or_irap_pic_flag equals 1 and gdr_pic_flag equals 0, we propose a new flag called idr_pic_flag to specify whether the picture associated with the picture header is an IDR picture. and the following may apply:
a. If sps_idr_rpl_present_flag is equal to 0, layer independence is enabled and idr_pic_flag is equal to 1, no RPL signaling is present in the PH even if the value of rpl_info_in_ph_flag is equal to 1.
b. If sps_idr_rpl_present_flag is equal to 0, layer independence is enabled and idr_pic_flag is equal to 1, WP signaling is not present in the PH even if the value of wp_info_in_ph_flag is equal to 1.
c. If sps_idr_rpl_present_flag equals 0, the current layer is an independent layer (i.e., vps_independent_layer_flag[GeneralLayerIdx[nuh_layer_id]] equals 1) and idr_pic_flag equals 1, the RPL signaling is rpl_info_in_ if the value of ph_flag is equal to 1 is not present in the PH.
d. If sps_idr_rpl_present_flag equals 0, the current layer is an independent layer, and idr_pic_flag equals 1, then WP signaling is not present in the PH even though wp_info_in_ph_flag has a value of 1.

7) In one example, the syntax element is not signaled for an IRAP picture in a single layer CLVS, even if the presence of such information indicates that the IRAP picture is in the PH.
i. If gdr_or_irap_pic_flag equals 1 and gdr_pic_flag equals 0, we propose a new flag called idr_pic_flag to specify whether the picture associated with the picture header is an IDR picture. and the following may apply:
a. If sps_idr_rpl_present_flag equals 0, the CLVS contains only one layer (i.e., sps_video_parameter_set_id equals 0), and idr_pic_flag equals 1, no RPL signaling is present in the PH even if the value of rpl_info_in_ph_flag equals 1.
b. If sps_idr_rpl_present_flag is equal to 0, CLVS contains only one layer, and idr_pic_flag is equal to 1, no WP signaling is present in the PH even if the value of wp_info_in_ph_flag is equal to 1.

6. sps_ptl_dpb_hrd_params_pres if there is an OLS containing only one layer with sps_video_parameter_set_id greater than 0 and nuh_layer_id equal to the nuh_layer_id of the SPS or if sps_video_parameter_set_id is equal to 0 A value of 1 for ent_flag is suggested.

Related reference list

7. Signaling and/or generation of the reference picture list may depend on the allowed slice types in CLVS pictures.
1) For example, if B slices are not allowed in CLVS, then one or more syntax elements for building Reference List 1 may not be signaled.
2) For example, if B-slices are not allowed in CLVS, one or more procedures to build Reference List 1 may not be performed.

Related APS

8. No two APSs are required to have the same APS_id in a sequence, CLVS or bitstream.
1) Alternatively, two APSs with the same APS type (eg ALF APS or LMCS APS) should not have the same APS_id in the sequence, CLVS or bitstream.
2) Alternatively, two APSs with the same APS type (e.g. ALF APS or LMCS APS) are allowed to have the same APS_id but must have the same content in sequence, CLVS or bitstream .
3) Alternatively, two APSs with the same APS type (eg, ALF APS or LMCS APS) are allowed to have the same APS_id. The earlier signaled APS is then replaced with the later signaled APS.
4) Alternatively, two APSs with the same APS type (eg, ALF APS or LMCS APS) are allowed to have the same APS_id. APSs signaled later are then ignored.

9. Two different parameter sets (e.g., APS and SPS) may be dependent on each other, such that syntax elements or variables derived based on syntax elements in the first parameter set are used by other syntax elements in the second parameter set. May be used to conditionally signal an element.
1) Alternatively, a syntax element or a variable derived according to a syntax element in a first parameter set can be used to derive the value of another syntax element in a second parameter set.

Related subpictures not coded

10. It is proposed that the boundaries of non-coding subpictures should be treated as picture boundaries.

11. It is proposed that loop filtering (eg, ALF/deblcoking/SAO) cannot cross non-coding sub-picture boundaries.

12. If there is only one subpicture, it must not be a non-coding subpicture.

13. It is necessary that non-coding subpictures cannot be extracted.

14. It is proposed that information related to non-coding sub-pictures may be signaled in SEI messages.

15. It is required that one non-coding subpicture can only have one slice.

16. It is required that the top left sub-picture cannot be a non-coding sub-picture.

17. At least one subpicture must not be a non-coding subpicture.

18. Whether and/or how to code the side information related sub-picture may depend on whether the sub-picture is a non-coding sub-picture.
1) In one example, if it is a non-coding sub-picture, no side information needs to be signaled.

19. The above requirement may also be amended to conditionally signal according to the above cases.

Associated IDR pictures and IDR subpictures

20. The following constraints are required:
The current picture with nuh_layer_id equal to the specified value layerId is an IDR picture, and if sps_idr_rpl_present_flag is equal to 1, the picture referenced by an entry in RefPicList[0] or RefPicList[1], in output order or decoding order: There shall be no pictures preceding any preceding IRAP picture (if any) in decoding order with nuh_layer_id equal to layerId.

21. The following constraints are required:
Referenced by an entry in RefPicList[0] or RefPicList[1] if the current subpicture with nuh_layer_id equal to a particular value layerId and subpicture index equal to a particular value subpicIdx is an IDR subpicture and sps_idr_rpl_present_flag is 1 There shall be no pictures that precede any IRAP picture (if any) that precedes it in decoding order with nuh_layer_id equal to layerId, either in output order or decoding order.

Associated IDR or GDR AU

22. IRAP AUs need not be complete, GDR AUs need not be complete, an indication of whether an AU is an IRAP or a GDR AU may be signaled to each IRAP or GDR AU, and , the PH of the lowest layer picture specified in the VPS or in the SEI message.
1) In one example, the signaling of this indication is optional.
2) In one example, the following changes are proposed to VVC (added or modified characters are highlighted in italics and bold, deleted parts are marked with double brackets (e.g. , [a] represents deletion of the letter "a")).
Coded Video Sequence Start (CVSS) AU: [[There is a PU for each layer of CVS]] an AU where the coded picture of each PU is a CLVSS picture.
Intra Random Access Point (IRAP) AU: [[There is a PU for each layer of CVS]] an AU where the coded picture of each PU is an IRAP picture.
The AUD syntax and semantics are modified as follows.

The order of AUs and their association to CVS is changed as follows.
A bitstream consists of one or more CVSs.
A CVS consists of one or more AUs. The order of PUs and their association with AUs is described in clause 7.4.2.4.3.
The first AU in CVS is the CVSS AU, and each current PU is a CLVSS PU, either an IRAP PU with NoOutputBeforeRecoveryFlag equal to 1, or a GDR PU with NoOutputBeforeRecoveryFlag equal to 1.
[[Each CVSS AU has one PU for each layer present in the CVS. ]]

About Allowable Slice Types

23. Whether to signal an indication of X allowed slice types in a picture (e.g., X is intra/inter/B/P) depends on the layout of the slices in the picture and whether the current picture is IRAP or inter-layer It may depend on whether the dependency is valid or invalid.
1) In one example, whether to signal an indication of allowed slice types within a picture (e.g., ph_intra_slice_allowed_flag) determines whether the PPS applies only slices per picture and/or whether picture partitioning is used. and/or whether rectangular slices and only one slice is used per picture and/or whether the picture is divided into rectangular slices.

2) In one example, whether to signal an indication of allowed slice types within a picture (e.g., ph_intra_slice_allowed_flag) is one or more constructs signaled in a higher level video unit (e.g., SPS) May depend on elements.
i. Alternatively, if there is no allowed slice type indication, the inferred value of the allowed slice type indication depends on the syntax element signaled to the higher level video unit.
3) In one example, whether to signal an indication of allowed slice types in a picture (eg, ph_inter_slice_allowed_flag) indicates whether the current picture is an IRAP picture and inter-layer for all slices in this picture. Depends on whether dependencies are disabled.
i. Alternatively or additionally, if the current picture is an IRAP picture and inter-layer dependencies are disabled for all slices in the picture, the inference value of ph_inter_slice_allowed_flag is set to 0/false.

24. Whether to signal an indication of slice types allowed X in a picture (eg, X is Inter/B/P) and/or the inference value of this indication depends on the number of reference pictures (eg, num_ref_entries[0 ][RplsIdx[0]] and/or num_ref_entries[1][RplsIdx[1]]).
1) In one example, if both num_ref_entries[0][RplsIdx[0]] and/or num_ref_entries[1][RplsIdx[1]] are equal to 0, then X allowed (e.g., X is inter/B/P ) slice type indication is not signaled and/or even inferred to be false.
2) In one example, if both num_ref_entries[0][RplsIdx[0]] and/or num_ref_entries[1][RplsIdx[1]] are equal to 0, then X allowed (e.g., X is inter/B/P is) the signaled indication of the slice type is equal to 0.
3) In one example, if num_ref_entries[1][RplsIdx[1]] is equal to 0, the allowed X (eg, X is B) slice type indication is not signaled and/or false. It is further inferred that there is
4) In one example, if num_ref_entries[1][RplsIdx[1]] equals 0, add a constraint that the signaled indication of allowed X (eg, X is B) slice type equals 0 be done.
5) In one example, if num_ref_entries[1][RplsIdx[1]] is equal to 0, then mvd_11_zero_flag and/or ph_collocated_from_10_flag, and/or ph_disable_bdof_flag and/or ph_disable_bdof_flag, and /or ph_disable_dmvr_flag shall be equal to one.

About ALF APS

25. For ALF APS, at least one of the four syntax elements (alf_luma_filter_signal_flag, alf_chroma_filter_signal_flag, alf_cc_cb_filter_signal_flag, alf_cc_cr_filter_signal_flag in VVC) shall be equal to 1 You can add constraints.
1) Alternatively, for ALF APS, we may add a constraint that at least one of the two syntax elements (alf_luma_filter_signal_flag, alf_chroma_filter_signal_flag) is equal to 126. Whether/how to signal the filter presence flag and/or the indication of the filter coefficients is pre-coded using the alf_data() structure and/or syntax element in the adaptive parameter set (APS) RBSP syntax. information may be relied upon.
1) Alternatively, additionally, in the absence of indication coefficients and/or filter coefficients, the inference value may also rely on pre-coded information with the alf_data( ) structure.
2) In one example, whether to signal alf_cc_cr_filter_signal_flag depends on all three syntax elements (alf_luma_filter_signal_flag, alf_chroma_filter_signal_flag, alf_cc_cb_filter_signal_flag in VVC) being 0. may depend on whether there is
i. Further, if all three of these are equal to 0, then the alf_cc_cr_filter_signal_flag signaling is skipped and/or further inferred to be true.
3) In one example, whether to signal alf_chroma_filter_signal_flag may depend on whether alf_luma_filter_signal_flag in VVC is equal to zero.
i. If alf_luma_filter_signal_flag is equal to 0, the signaling of alf_chroma_filter_signal_flag is skipped and/or further inferred to be true.

Scaling list/About LMCS APS

27. Multiple Xs in one picture/slice/tile/subpicture/brick/other video unit smaller than one picture (e.g., X is an explicit scaling list signaling side information in APS and/or LMCS and/or other coding tools).
1) Alternatively, the X APS to be utilized may also be signaled in the bitstream (eg, in PH/SH).
2) Alternatively, the index of the X APS to be used may also be signaled in the bitstream (eg, in PH/SH).

28. X to be used (e.g., where X is an explicit scaling list and/or LMCS and/or other coding tools whose side information is signaled in APS). Good things are suggested.
1) In one example, the luminance and saturation color components may select different XAPS.
2) In one example, the number of X APS to be utilized for luma and chroma components may be signaled separately in the bitstream (eg, in PH/SH).
i. Or, additionally, whether to signal the number for the chroma component may depend on whether prediction/inheritance from APS for the luma component is enabled.
ii. Or, additionally, whether to signal the number for the chroma component may depend on whether the number of APS for the luminance component is not equal to zero or greater than zero.
3) In one example, the XAPS indices to be utilized for luma and chroma components may be signaled separately in the bitstream (eg, in PH/SH).

29. X to be used (e.g., where X is ALF/CC-ALF/explicit scaling list and/or LMCS, and/or other coding tools with side information signaled in APS) Whether to signal may depend on the subpicture.
1) In one example, for each sub-picture, we may choose to use its on/off control and corresponding XAPS.
i. Alternatively, the on/off control and/or XAPS used may be signaled for each subpicture.

About subpictures

About deblocking filters

31. pps_deblocking_filter_disabled_flag equal to 1 specifies that the deblocking filter operation is disabled for the slice, or pps_deblocking_filter_disabled_flag equal to 0 specifies that the deblocking filter operation is disabled for the slice referencing the PPS, if It is proposed to specify invalid.
1) slice_deblocking_filter_disabled_flag and ph_deblocking_filter_disabled_flag do not exist.
2) blocking_filter_override_enabled_flag equals 0 3) debugging_filter_override_enabled_flag equals 1, dbf_info_in_ph_flag equals 1, ph_deblocking_filter_disabled_flag equals equal to 1.
4) blocking_filter_override_enabled_flag equals 1, dbf_info_in_ph_flag equals 0, and slice_deblocking_filter_disabled_flag equals 1;

32. pps_deblocking_filter_disabled_flag equal to 0 indicates that the deblocking filter operation is applied to slices referencing the PPS, or pps_deblocking_filter_disabled_flag equal to 0 indicates that the deblocking filter operation is enabled for slices referencing the PPS if It is proposed to specify that
1) slice_deblocking_filter_disabled_flag and ph_deblocking_filter_disabled_flag do not exist.
2) blocking_filter_override_enabled_flag equals 0 3) debugging_filter_override_enabled_flag equals 1, dbf_info_in_ph_flag equals 1, ph_deblocking_filter_disabled_flag equals equal to 0.
4) blocking_filter_override_enabled_flag equals 1, dbf_info_in_ph_flag equals 0, and slice_deblocking_filter_disabled_flag equals 1;

About JCCR

33. The QP offset used for joint chroma residual coding (JCCR) may be signaled not only at the slice level, but also at the video unit (larger than the slice) (ie slice_joint_cbcr_qp_offset in VVC).
1) In one example, it may be signaled at the sequence/picture level, such as in SPS/VPS/DCI/PPS/PH.
2) In one example, it may be signaled at multiple levels (eg, picture and slice level).
i. Alternatively, in addition, whether to signal at the second level may depend on whether to signal at the first level.
a. In one example, it may be signaled at only one level out of multiple levels.
b. In one example, an indication of which level to signal the QP offset may be signaled in the bitstream.
ii. Alternatively, an override mechanism is applied, i.e., signaled at a first level (higher) and a second (lower An override flag may be signaled to indicate whether to signal at the (eg, slice) level.
a. In one example, the override flag may be set to a first level and/or a second level.

About LMCS and scaling list control

34. It is proposed that the ph_lmcs_mode_idc of JVET-R0063 may be ue(v) coded and the value of ph_lmcs_mode_idc may be specified in the range from 0 to 2 or less. The semantics for ph_lmcs_mode_idc equal to 0,1,2 are the same as in JVET-R0063.
1) Alternatively, ue(v) code ph_lmcs_mode_idc from JVET-R0063 and set the value of ph_lmcs_mode_idc to be in the range 0 to 1 if the picture is known to contain only one slice, 0 otherwise. It may be specified to be within the range of 2 from . The semantics for ph_lmcs_mode_idc equal to 0,1,2 are the same as in JVET-R0063.
2) Alternatively, if the picture is known to contain only one slice, ph_lmcs_mode_idc in JVET-R0063 uses u(1), i.e. using only one bit like a flag, to set the value may be coded equal to 0 or 1, otherwise ph_lmcs_mode_idc in JVET-R0063 is coded with ue(v) and the value of ph_lmcs_mode_idc may be specified in the range from 0 to 2 or less. good. The semantics for ph_lmcs_mode_idc equal to 0,1,2 are the same as in JVET-R0063.

35. It is proposed that the ph_explicit_scaling_list_mode_idc in JVET-R0064 may be ue(v) coded and the value of ph_explicit_scaling_list_mode_idc may be specified in the range from 0 to 2 or less. The semantics for ph_explicit_scaling_list_mode_idc equal to 0, 1, 2 are the same as in JVET-R0064.
1) Alternatively, ph_explicit_scaling_list_mode_idc in JVET-R0064 may be ue(v) coded and the value of ph_explicit_scaling_list_mode_idc is in the range 0 to 1 if the picture is known to contain only one slice, otherwise In the case of , it may be specified to be within the range of 0 to 2. The semantics for ph_explicit_scaling_list_mode_idc equal to 0, 1, 2 are the same as in JVET-R0064.
2) Alternatively, if the picture is known to contain only one slice, ph_explicit_scaling_mode_idc in JVET-R0064 uses u(1), i.e. using only one bit like a flag, The value may be coded equal to 0 or 1, otherwise ue(v) code ph_explicit_scaling_list_mode_idc in JVET-R0064 and the value of ph_explicit_scaling_list_mode_idc may be specified in the range from 0 to 2 or less. proposed. The semantics for ph_explicit_scaling_list_mode_idc equal to 0, 1, 2 are the same as in JVET-R0064.

6. embodiment

6.1. Embodiment #1

Next, preferred examples are listed in some embodiments.

The following section presents exemplary embodiments of the techniques described in the previous section. The following section presents exemplary embodiments of the techniques described in the previous section (eg, item 1).

1. The method includes converting between a video consisting of one or more layers of one or more video regions and a coded representation of the video according to format rules, the format rules determining the allowables of the corresponding video regions. It specifies that one or more syntax elements are included in the coding representation at one or more video domain levels corresponding to the slice type.

2. 2. The method of clause 1, wherein the format rules provide that the one or more syntax elements include a first syntax element having a value indicating a combination of slice types allowed in the corresponding video region.

The following section presents exemplary embodiments of the techniques described in the previous section (eg, item 2).

3. The format rules provide for inclusion of a syntax element in a picture or slice header to indicate whether a bi-predictive (B) slice ae is allowed or used for the corresponding picture or slice. , the method according to any one of clauses 1-2.

4. 4. The method of clause 3, wherein the syntax elements in the sequence parameter set control the presence of syntax elements included in picture headers or slice headers.

The following section presents exemplary embodiments of the techniques described in the previous section (eg, item 3).

5. The video processing method converts between a video including one or more layers of one or more video pictures forming one or more video slices and a coded representation of the video according to format rules. and the format rules specify that, according to a second rule, a syntax element for enabling or using a coding mode at the slice level is included at most once during either a picture header or a slice header.

6. 6. The method of clause 5, wherein the coding mode comprises an in-loop filter, a weighted prediction mode, or a quantization parameter delta mode.

The following section presents exemplary embodiments of the techniques described in the previous section (eg, item 7).

7. including converting between one or more video pictures containing one or more video slices and a coded representation of the video according to format rules, wherein the allowed slice types in a video picture are , controlling whether a reference picture list is signaled in this coding representation or can be generated from this coding representation.

8. 8. The method of clause 7, wherein the format rules specify that syntax elements corresponding to reference picture list 1 are omitted from the coded representation for allowable slice types other than bidirectional slices (B-slices).

9. The format rules specify that the procedure for generating reference picture list 1 for video pictures is disabled for allowable slice types except bidirectional slices (B-slices).

The following clauses present exemplary embodiments of the techniques described in the previous chapter (eg, items 10-15).

10. Converting between a video containing one or more video pictures containing one or more subpictures and a coded representation of this video, the coded representation conforming to the formatting rules and conforming to the formatting rules. is a video processing method that specifies the processing of non-coded subpictures of a video picture.

11. 11. The method of clause 10, wherein the format rules specify that boundaries of the non-coding sub-pictures are treated as picture boundaries during the transformation.

12. 11. The method of clause 10, wherein the format rules specify disabling loop filtering across boundaries of the non-coded pictures.

13. 11. The method of clause 10, wherein the format rules do not allow the non-coding sub-picture to be the only sub-picture of the video picture.

14. 14. The method of clauses 10-13, wherein the format rules specify that decoding assistance information for the non-coded sub-pictures is included in supplemental enhancement information syntax elements of the coded representation.

15. 11. The method of clause 10, wherein the format rules specify that the non-coding sub-pictures are allowed to have at most one slice.

The following clauses present exemplary embodiments of the techniques described in the previous chapter (eg, items 20-22).

16. said one or more video pictures and/or said one or more video pictures comprising converting between one or more video pictures comprising one or more sub-pictures and a video comprising a coded representation of said video; are inserted into the coded representation according to an order rule, the order rule defining a relationship between a current instantaneously decoded update picture (IDR) or a current IDR sub-picture position in the coded representation , image processing method.

17. The order rule provides that the coded representation does not include pictures referenced by entries in a reference picture list of the current IDR picture that precede an intra-random access point picture that precedes them in order. , clause 16.

18. The order rule is such that the coded representation is a picture referenced by an entry in a reference picture list of the current IDR picture, precedes a preceding intra random access point picture in order, and precedes the current IDR sub-picture. 18. The method of clauses 16-17, providing that pictures with subpictures with the same layer id and the same subpicture index are not included.

The following clauses present exemplary embodiments of the techniques described in the previous chapter (eg, items 23-24).

19. Converting between a video comprising one or more video pictures comprising one or more subpictures and/or one or more slices and a coded representation of said video, said coded representation being in a format A video processing method according to a rule, wherein the format rule provides for selectively including in the coded representation an indication of whether a slice type is allowed in a picture based on a picture condition of the picture.

20. 20. The method of clause 19, wherein the picture conditions include layout of slices in the picture.

21. 21. The method of clauses 19-20, wherein the picture conditions include whether the picture is an intra-random access point picture and whether inter-layer dependencies are allowed for the transform.

22. 22. The method of any of clauses 19-21, wherein the picture condition comprises a plurality of reference pictures used to code the picture.

23. 23. The method of any of clauses 19-22, wherein the slice types include intra-coded slices, inter-coded slices, B-slices or P-slices.

The following section presents exemplary embodiments of the techniques described in the previous section (eg, item 25).

24. Converting between a video comprising one or more video pictures comprising one or more subpictures and/or one or more slices and a coded representation of said video, said coded representation being defined by formatting rules. and the format rules specify that one of at least four syntax elements be set to 1 if an adaptive loop filter is signaled in an adaptive parameter set in the coding representation. Method.

25. 25. The method of clause 24, wherein the at least four syntax elements include a luma filter signal flag, a chroma filter signal flag, a cc and cb filter signal flag, and a cc and cr signal flag.

The following section presents exemplary embodiments of the techniques described in the previous section (eg, item 33).

26. Converting between a video comprising one or more video units comprising one or more slices and a coding representation of said video, said coding representation complying with formatting rules, said formatting rules comprising: , defining a quantization parameter offset value for joint chroma residual coding used for said one or more slices at said video unit level in said coding representation.

27. 27. The method of clause 26, wherein the video unit corresponds to a video picture, video sequence, sequence parameter set, video parameter set, picture header, picture parameter set or decoding capability information syntax structure.

28. A method as in the preceding clause, wherein the video region comprises a video picture or video slice.

29. 29. The method of any of clauses 1-28, wherein said transforming comprises encoding said video into said coding representation.

30. 29. The method of any of clauses 1-28, wherein said transforming comprises decoding said coding representation to produce pixel values of said video.

31. A video decoding device comprising a processor configured to implement the method according to one or more of clauses 1-30.

32. A video decoding device comprising a processor configured to implement the method according to one or more of clauses 1-30.

33. In a computer program product having computer code stored thereon, when said code is executed by a processor, said processor implements the method of any of Clauses 1-30.

34. A method, apparatus or system described herein.

The second section presents exemplary implementations of the techniques discussed in the previous section (eg, Sections 20-35).

1. A video processing method (e.g., method 700 shown in FIG. 7A) including converting between a video including one or more sub-pictures and a bitstream of the video, wherein the one or more pictures and /or The one or more subpictures are included in this bitstream according to an ordering rule, which is the current Instantaneous Decoding Update (IDR) picture or the current IDR subpicture position in this bitstream. A method of defining a relationship between an IDR picture or another picture referenced by an entry in a reference picture list for a current slice of a current sub-picture.

2. The order rule, responsive to a condition being met, includes in the bitstream a picture referenced by the entry in the reference picture list of the current slice, decoded into the current IDR sub-picture. 2. The method of clause 1, providing that intra random access point (IRAP) pictures that precede in order do not include pictures that precede them in output order or decoding order.

3. the condition includes a presence flag indicating that an RPL (Reference Picture List) syntax element is allowed to be present in a slice header of a slice with a NAL (Network Abstraction Layer) unit type equal to IDR_N_LP or IDR_W_RADL. 2. The method described in 2.

4. 3. The condition of clause 2, wherein the presence flag indicates that no RPL (Reference Picture List) syntax element is present in the slice header of a slice with a NAL (Network Abstraction Layer) unit type equal to IDR_N_LP or IDR_W_RADL. Method.

5. 5. The method of any of clauses 2-4, wherein the current IDR picture and IRAP picture have a NAL (network abstraction layer) unit header layer identifier equal to a particular value.

6. The ordering rule is such that the bitstream is a picture referenced by a second entry in a second reference picture list of a second slice of clean random access pictures, the second preceding the clean random access picture in decoding order. 2. The method of clause 1, providing that intra random access point (IRAP) pictures do not include pictures that precede them in output order or decoding order.

7. The ordering rule is such that the bitstream includes pictures referenced by the entries in the reference picture list of the current slice that include intra random access point (IRAP) sub-pictures in response to a condition being satisfied. 2. The method of clause 1, providing that a picture that includes a picture precedes in output order or decoding order a picture that includes the current IDR sub-picture and that the picture that includes the current IDR sub-picture does not include a picture that precedes in the decoding order.

8. the condition includes a presence flag indicating that an RPL (Reference Picture List) syntax element is allowed to be present in a slice header of a slice having a NAL (Network Abstraction Layer) unit type equal to IDR_N_LP or IDR_W_RADL; The method of Clause 7.

9. 8. The condition of clause 7, wherein a presence flag indicates that no RPL (reference picture list) syntax element is present in a slice header of a slice with a network abstraction layer (NAL) unit type equal to IDR_N_LP or IDR_W_RADL. Method.

10. of Clauses 7-9, wherein the IRAP sub-picture and the current IDR sub-picture have a NAL (network abstraction layer) unit header layer identifier equal to a particular identification value and a sub-picture index equal to a particular index value. Any method described.

11. The ordering rule is such that the bitstream includes pictures referenced by third entries in a reference picture list of a third slice of clean random access pictures that include third intra random access point (IRAP) subpictures. in output order or decoding order, and wherein said clean random access pictures do not include pictures that precede in said decoding order.

12. A video processing method (e.g., method 700 shown in FIG. 7B) for processing a video including one or more pictures including one or more subpictures and/or one or more slices and a video including one or more subpictures and/or one or more slices based on formatting rules. including converting 712 to and from the bitstream of the video, the format rule being that this access unit is an intra-random access point (IRAP) access unit for each access unit in this video or progressively Allows inclusion of an indication of the access unit indicating whether it is a decryption update (GDR) access unit.

13. 13. The method of clause 12, wherein the IRAP access unit need not be complete and contains at least one IRAP picture.

14. 13. The method of clause 12, wherein the GDR access units need not be complete and contain at least one GDR picture.

15. 13. The method of clause 12, wherein the format rules specify the indication to include in access unit delimiters picture headers of lowest layer pictures defined in a video parameter set.

16. A video processing method (e.g., method 720 shown in FIG. 7C) for processing a video including one or more pictures including one or more subpictures and/or one or more slices and the The format rules include converting 722 to and from a video bitstream, where the format rules indicate whether a slice type is allowed in a picture, optionally depending on picture conditions for this picture. A method that defines what is included in a bitstream.

17. 17. The method of clause 16, wherein the slice types include intra-coded slices, inter-coded slices, B slices, or P slices.

18. 18. The method of Clause 16 or Clause 17, wherein the picture condition comprises a layout of slices in the picture.

19. 19. Any of clauses 16-18, wherein the picture conditions include whether the picture is an intra-random access point (IRAP) picture and whether inter-layer dependencies are allowed for the transform. Method.

20. The picture condition may be i) whether the picture parameter set indicates that only slices are to be applied per picture, and/or ii) no picture partitioning is used, and/or iii) rectangular slices and 1 slice per picture. 20. A method according to any of clauses 16-19, wherein only one slice is used and/or iv) said picture is divided into rectangular slices.

21. 20. The method of any one of clauses 16-19, wherein the picture condition comprises one or more syntax elements signaled in a higher level video unit.

22. 18. The method of Clause 16 or Clause 17, wherein the picture condition comprises a plurality of reference pictures used to code the picture.

23. wherein the number of reference pictures is based on a first field indicating the number of entries in a first reference picture list syntax structure and/or a second field indicating the number of entries in a second reference picture list syntax structure; 22. The method according to 22.

24. A video processing method (eg, method 730 shown in FIG. 7D) between a video including one or more pictures including one or more subpictures and/or one or more slices and a bitstream of this video. The formatting rule is to set at least one of two or four syntax elements to a particular value for an ALF (adaptive loop filter) adaptive parameter set. A method to define.

25. The at least four syntax elements are a luma filter signal flag that specifies whether a luma filter set is signaled, a chroma filter signal flag that specifies whether a chroma filter is signaled, and a Cb color component. cc and cb filter signal flags that specify whether cross-component filters for are signaled; cc and cr signal flags that specify whether cross-component filters for Cr color components are signaled; 25. The method of clause 24, comprising

26. A video processing method (e.g., method 740 shown in FIG. 7E) comprising converting (742) between a video including one or more pictures and a bitstream of the video according to format rules; The format rules determine whether and/or how to signal the filter presence flag and/or the indication of the filter coefficients depends on the adaptive loop filtering data structure and/or in the adaptive parameter set RBSP (Raw Byte Array Payload). or to rely on pre-coded information with syntax elements.

27. 27. The method of clause 26, wherein the format rules further provide for inferring the value of the indication based on pre-coded information comprising the adaptive loop filtering data structure if the indication is not present.

28. The format rules define whether to signal the cross-component filter for the Cr color component. Whether to signal the cc and cr filter signal flags determines whether all three syntax elements are equal to a constant value. and the three syntax elements are a luma filter signal flag, which defines whether to signal a luma filter set, and a chroma filter signal, which defines whether to signal a chroma filter. 27. The method of clause 26, comprising a flag and a cc and cb filter signal flag defining whether to signal a cross-component filter for the Cb color component.

29. The format rules define whether the chroma filter signal flag defines whether the chroma filter is signaled.The value of the luma filter signal flag defines whether the luma filter set is signaled. 27. The method of clause 26, further comprising relying on

30. A video processing method (e.g., method 750 shown in FIG. 7F), comprising converting (752) between a video including one or more pictures and a bitstream of the video according to format rules; A method wherein, for video regions smaller than a picture, the format rules allow referencing multiple APSs corresponding to coding tools whose side information is included in the adaptive parameter set (APS).

31. 31. The method of clause 30, wherein the plurality of APSs includes scaling APSs, LMCS (Luminance Mapping with Chroma Scaling) APSs, and/or APSs corresponding to other coding tools.

32. 31. The method of clause 30, wherein the format rules specify that the bitstream includes a number of the referenced APSs.

33. 31. The method of clause 30, wherein the format rules specify that the bitstream includes indices of the referenced APSs.

34. 31. The method of clause 30, wherein said format rules further define that said plurality of APSs used for said conversion depends on color components of said video.

35. 35. The method of clause 34, wherein the formatting rules further specify using different APSs for luminance and chroma components of the video.

36. 35. The method of clause 34, wherein the formatting rules further provide for separately signaling in the bitstream the number and/or index of the plurality of APSs used for luma and chroma components.

37. 31. The method of clause 30, wherein said format rules further define how to use said plurality of APSs depending on sub-pictures of said picture.

38. 31. The method of clause 30, wherein said format rules further provide for selecting or signaling for each sub-picture the on/off control and/or said plurality of APSs to be used.

39. A video processing method (e.g., method 760 shown in FIG. 7G) that transforms between a video including one or more pictures including one or more subpictures and a bitstream of the video according to format rules. 762, wherein the format rule sets the value of a first variable indicating whether to treat sub-pictures of a coded picture as pictures in the decoding process excluding in-loop filtering operations as sub-pictures in the bitstream. A video processing method defining a method of reasoning dependent on a second variable indicating the presence of information.

40. 40. The method of clause 39, wherein the formatting rules provide that if the first variable does not exist, the value of the first variable is inferred to be equal to the value of the second variable.

41. A video processing method (e.g., method 770 shown in FIG. 7H) that transforms between a video including one or more pictures including one or more subpictures and a bitstream of the video according to format rules. Doing 772, the format rule is responsive to one or more conditions being met, where a variable indicating the applicability of a deblocking filter to a picture that references the picture parameter set is set to this picture a first value indicating that the deblocking filter is applied to slices that reference the parameter set, or a second value that indicates that the deblocking filter is disabled for slices that reference this picture parameter set; A method that provides for having

42. 42. The method of clause 41, wherein the first value is one and the second value is equal to zero.

43. The one or more conditions include: 1) no deblocking filter disable flag indicating disabling of the deblocking filter is present at the slice level and picture header level; 3) said deblocking filter override enable flag indicates that said deblocking behavior for pictures referencing said picture parameter set is allowed to be overridden. , the deblocking filter present flag indicates that deblocking filter information is present in the picture header syntax structure, and the deblocking filter disabled flag at picture header level indicates that said deblocking filter is disabled for the picture. or 4) the deblocking filter override enable flag indicates that the deblocking behavior for pictures that reference the picture parameter set is allowed to be overridden, and the deblocking filter present flag indicates that deblocking filter information is in the picture header syntax 43. The method of clause 42, wherein a slice-level deblocking filter disabled flag present in a structure indicates that the deblocking filter is disabled for the picture.

44. 42. The method of clause 41, wherein the first value is zero and the second value is equal to zero.

45. The one or more conditions include: 1) no deblocking filter disable flag indicating disabling of the deblocking filter is present at the slice level and picture header level; 3) said deblocking filter override enable flag indicates that said deblocking behavior for pictures referencing said picture parameter set is allowed to be overridden. , the deblocking filter present flag indicates that deblocking filter information is present in the picture header syntax structure, and the deblocking filter disabled flag at picture header level indicates that said deblocking filter is enabled for the current picture. or 4) the deblocking filter override enable flag indicates that overriding of the deblocking behavior for pictures that reference the picture parameter set is allowed, and the deblocking filter present flag indicates that the deblocking filter information indicates that the picture 45. The method of clause 44, wherein a slice-level deblocking filter disabled flag not present in a header syntax structure indicates that the deblocking filter is enabled for the picture.

46. A video processing method (e.g., method 780 shown in FIG. 7I) that converts between a video including one or more video units including one or more slices and a bitstream of the video according to formatting rules. and performing 782, wherein the format rules specify that quantization parameter offsets used for joint chroma residual coding are contained at one or more video unit levels that are greater than the slice level. .

47. 47. The method of clause 46, wherein the one or more video units correspond to a video picture, a video sequence, a sequence parameter set, a video parameter set, a picture header, a picture parameter set, or a decoding capability information syntax structure.

48. The one or more video unit levels include a first level and a second level, and the format rule determines whether to signal the quantization parameter offset value of the second level. 47. The method of clause 46, further defining depending on whether a parameter offset value is signaled at said first level.

49. The one or more video unit levels include a first level and a second level that is lower than the first level, and the format rule specifies that the quantization parameter offset value is a signal at the first level. Signaling an override flag to indicate whether to signal the second level quantization parameter offset value to be signaled and to override the first level signaled value. 46. The method of clause 46, further defining

50. A video processing method (e.g., method 790 shown in FIG. 7J) comprising converting 792 between a video containing one or more pictures and a bitstream of the video, the format rules comprising: (i) a fixed or variable length of one or more bits used to code a variable that indicates the LMCS (Luminance Mapping with Chroma Scaling) mode identification at picture header level; A method that specifies a range of values.

51. 51. The method of clause 50, wherein the formatting rules specify that the variable is coded using ue(v) and that the value of the variable ranges from 0 to 2, inclusive.

52. The format rule is that the variable is coded using ue(v), and that the value of the variable ranges from 0 to 1 (inclusive) if a picture contains only one slice. and otherwise this range is 0 to 2, inclusive.

53. The format rule is to code the variable using u(1) such that the value of the variable is 0 or 1 if the picture contains only one slice, otherwise use ue(v). 51. The method of clause 50, wherein the variable is coded such that the value of the variable ranges from 0 to 2.

54. A video processing method (e.g., method 800 shown in FIG. 7K) comprising converting (802) between a video including one or more pictures and a bitstream of the video according to format rules; The format rules specify (i) a fixed or variable length of one or more bits used to code a variable that indicates scaling list mode identification at the picture header level, and (ii) a range of values for this variable. A video processing method that defines,

55. 55. The method of clause 54, wherein the formatting rules specify that the variable is coded using ue(v) and that the value of the variable ranges from 0 to 2, inclusive.

56. The format rule is that the variable is coded using ue(v), and if a picture contains only one slice, the value of the variable ranges from 0 to 1 (inclusive). 55, and otherwise providing that the range is 0 to 2, inclusive.

57. The format rules code the variable using u(1) such that the value of the variable is 0 or 1 if the picture contains only one slice, and ue(v) otherwise. 55. The method of clause 54, wherein the variable is coded such that the value of the variable ranges from 0 to 2, inclusive.

58. 58. The method of any of clauses 1-57, wherein converting comprises encoding the video into a bitstream.

59. 58. The method of any one of clauses 1-57, wherein said transforming comprises decoding said video from said bitstream.

60. 58. The method of any of clauses 1-57, wherein the converting comprises generating the bitstream from video, and the method further comprises storing the bitstream on a non-transitory computer-readable recording medium. Method.

61. 61. A video processing device comprising a processing device configured to perform the method according to any one or more of Clauses 1-60.

62. 61. The method of any of clauses 1-60 and a method of storing a video bitstream, further comprising storing the bitstream on a non-transitory computer readable recording medium.

63. A computer readable medium containing program code that, when executed, causes a processing device to perform the method recited in any one or more of Clauses 1 through 60.

64. A computer-readable medium storing a bitstream generated according to any of the methods described above.

65. A video processing device for storing a bitstream representation, configured to implement the method according to one or more of clauses 1 to 60.

As used herein, the term "video processing" may refer to video encoding, video decoding, video compression, or video decompression. For example, a video compression algorithm may be applied during conversion from a pixel representation of a video to a corresponding bitstream representation, or vice versa. The bitstream representation of the current video block may, for example, correspond to bits spread in the same place or different places in the bitstream, as defined by the syntax. For example, one macroblock may be encoded in terms of the transformed and coded error residual values and using bits in the header and other fields in the bitstream. Moreover, during the transform, the decoder parses the bitstream with the knowledge that some fields may or may not be present based on decisions, as described in the solution above. You may Similarly, the encoder may determine whether a particular syntactic field should be included and generate the coded representation accordingly by whether or not to include the syntactic field in the coded representation. good.

The disclosed and other solutions, examples, embodiments, modules, and implementations of functional operations described herein, including the structures disclosed herein and their structural equivalents, It may be implemented in digital electronic circuitry, or computer software, firmware, or hardware, or in a combination of one or more thereof. The disclosed and other embodiments may be encoded on computer readable media for implementation by, or for controlling the operation of, one or more computer program products, i.e., data processing devices. can be implemented as one or more modules of computer program instructions. The computer-readable medium may be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that provides a propagating machine-readable signal, or a combination of one or more thereof. The term "data processor" includes all apparatus, devices and machines for processing data including, for example, a programmable processor, computer, or multiple processors or computers. In addition to hardware, the apparatus includes code that creates an execution environment for the computer program, such as processor firmware, protocol stacks, database management systems, operating systems, or code that constitutes a combination of one or more of these. can be done. A propagated signal is an artificially generated signal, eg, a machine-generated electrical, optical, or electromagnetic signal, produced to encode information for transmission to an appropriate receiving device.

A computer program (also called a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted language, and it can be written as a stand-alone program. , or in any form including as modules, components, subroutines or other units suitable for use in a computing environment. Computer programs do not necessarily correspond to files in a file system. A program may be recorded in part of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), or it may be recorded in a single file dedicated to that program. It may be stored in multiple coordination files (eg, files containing one or more modules, subprograms, or portions of code). A computer program can also be deployed to be executed on one computer located at one site or on multiple computers distributed across multiple sites and interconnected by a communication network.

The processing and logic flows described herein may be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output. can be done. The processing and logic flow can also be performed by special purpose logic circuits, such as FPGAs (Field Programmable Gate Arrays) or ASICs (Application Specific Integrated Circuits), and the device can also be implemented as special purpose logic circuits. can.

Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor receives instructions and data from read-only memory and/or random-access memory. The essential elements of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Generally, a computer may include one or more mass storage devices, such as magnetic, magneto-optical or optical disks, for storing data on or receiving data from these mass storage devices. , or may be operatively coupled to transfer data to them. However, a computer need not have such devices. Computer readable media suitable for storing computer program instructions and data include all forms of non-volatile memories, media and memory devices such as EPROM, EEPROM, flash storage devices, magnetic disks such as internal hard disks or removable It includes semiconductor storage devices such as disks, magneto-optical disks, and CD-ROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, application-specific logic circuitry.

While this patent specification contains many details, these should not be construed as limiting the scope of any subject matter or claims, but rather specific to particular embodiments of particular technologies. It should be construed as a description of possible features. Certain features that are described in this patent document in the context of separate embodiments may also be implemented in combination in a single example. Conversely, various features that are described in the context of a single example can also be implemented in multiple embodiments separately or in any suitable subcombination. Further, although features are described above as working in particular combinations, and may initially be claimed as such, one or more features from the claimed combination may sometimes be Can be excerpted and claimed combinations may be directed to sub-combinations or variations of sub-combinations.

Similarly, although acts have been shown in the figures in a particular order, it is understood that such acts are performed in the specific order shown or in a sequential order to achieve a desired result; or should not be construed as requiring that all acts shown be performed. Also, the separation of various system components in the examples described in this patent specification should not be understood to require such separation in all embodiments.

Only some implementations and examples are described and other embodiments, extensions and variations are possible based on the content described and illustrated in this patent document.

Cross-reference to related applications
This application is based on International Patent Application No. PCT/US2021/026534 filed April 9, 2021 and has priority to and benefit from U.S. Provisional Patent Application No. 63/008799 filed April 12, 2020 claim . All of the aforementioned patent applications are hereby incorporated by reference in their entirety.

Claims (65)

A video processing method,
converting between a video including one or more subpictures and a bitstream of said video;
the one or more pictures and/or the one or more subpictures are included in the bitstream according to an ordering rule;
In the reference picture list for the current slice of the current IDR picture or current sub-picture of the position of the current instantaneous decoding update (IDR) picture or current IDR sub-picture in the bitstream. specifying a relationship between another picture referenced by the entry;
Method. The ordering rule is such that, in response to a condition being met, the bitstream is the picture referenced by the entry in the reference picture list of the current slice, which is the picture referenced by the current IDR sub-picture in decoding order. specify that the preceding Intra Random Access Point (IRAP) picture in the
The method of claim 1. Said conditions include the presence flag indicating that the RPL (Reference Picture List) syntax element is allowed to be present in the slice header of a slice with a NAL (Network Abstraction Layer) unit type equal to IDR_N_LP or IDR_W_RADL. ,
3. The method of claim 2. the condition includes that a presence flag indicates that an RPL (Reference Picture List) syntax element is not present in a slice header of a slice having a NAL (Network Abstraction Layer) unit type equal to IDR_N_LP or IDR_W_RADL;
3. The method of claim 2. the current IDR picture and the IRAP picture have a NAL (network abstraction layer) unit header layer identifier equal to a particular value;
The method according to any one of claims 2-4. The ordering rule is such that the bitstream is a picture referenced by a second entry in a second reference picture list of a second slice of clean random access pictures, the second preceding the clean random access picture in decoding order. specifying that an Intra Random Access Point (IRAP) picture does not contain pictures that precede it in output order or decoding order;
The method of claim 1. The ordering rule is such that the bitstream includes pictures referenced by the entries in the reference picture list of the current slice that include intra random access point (IRAP) sub-pictures in response to a condition being satisfied. specifying that a picture that contains a picture precedes in output order or decoding order, and that the picture that contains the current subpicture does not contain a picture that precedes it in decoding order;
The method of claim 1. Said conditions include the presence flag indicating that a RPL (Reference Picture List) syntax element is allowed to be present in the slice header of a slice having a NAL (Network Abstraction Layer) unit type equal to IDR_N_LP or IDR_W_RADL. ,
8. The method of claim 7. the condition includes that a presence flag indicates that an RPL (Reference Picture List) syntax element is not present in a slice header of a slice having a NAL (Network Abstraction Layer) unit type equal to IDR_N_LP or IDR_W_RADL;
8. The method of claim 7. the IRAP sub-picture and the current IDR sub-picture have a NAL (network abstraction layer) unit header layer identifier equal to a particular identification value and a sub-picture index equal to a particular index value;
The method according to any one of claims 7-9. The ordering rule specifies that the bitstream is a picture referenced by a third entry in a reference picture list of a third slice of a clean random access picture, the picture including a third intra random access point (IRAP) subpicture. preceding in output order or decoding order, and specifying that said clean random access pictures do not include pictures preceding said decoding order;
The method of claim 1. A video processing method,
converting between a video comprising one or more pictures comprising one or more subpictures and/or one or more slices and a bitstream of said video based on format rules;
The format rules include an access unit indication indicating whether an access unit is an intra-random access point (IRAP) access unit or a gradual decoding update (GDR) access unit for each access unit in the video. allow the
Method. the IRAP access unit need not be complete and contains at least one IRAP picture;
13. The method of claim 12. the GDR access unit need not be complete and contains at least one GDR picture;
13. The method of claim 12. the format rules specify the indication to include the picture header of the lowest layer picture specified in the video parameter set in the access unit delimiter;
13. The method of claim 12. A video processing method,
converting between a video comprising one or more pictures comprising one or more subpictures and/or one or more slices and a bitstream of said video based on format rules;
the format rules specify that an indication of whether a slice type is allowed in a picture is selectively included in the bitstream based on a picture condition of the picture;
Method. the slice type includes an intra-coded slice, an inter-coded slice, a B slice, or a P slice;
17. The method of claim 16. the picture condition includes a layout of slices in the picture;
18. A method according to claim 16 or 17. the picture conditions include whether the picture is an intra-random access point (IRAP) picture and whether inter-layer dependencies are allowed for the transform;
The method according to any one of claims 16-18. The picture condition is
i) whether the picture parameter set indicates that only slices are applied per picture and/or
ii) no picture segmentation is used and/or
iii) only rectangular slices and one slice are used per picture; and/or
iv) dividing the picture into rectangular slices;
The method according to any one of claims 16-19. the picture condition includes one or more syntax elements signaled in a higher level video unit;
The method according to any one of claims 16-19. the picture condition includes a plurality of reference pictures used to code the picture;
18. A method according to claim 16 or claim 17. the number of reference pictures is based on a first field indicating the number of entries in a first reference picture list syntax structure and/or a second field indicating the number of entries in a second reference picture list syntax structure;
23. The method of claim 22. A video processing method,
converting between a video comprising one or more pictures comprising one or more subpictures and/or one or more slices and a bitstream of said video;
The format rules specify setting one of at least two or four syntax elements to a specific value for an ALF (Adaptive Loop Filter) adaptive parameter set.
Method. The at least four syntactic elements are
a luma filter signal flag that specifies whether a luma filter set is signaled;
a saturation filter signal flag that specifies whether the saturation filter is signaled;
cc and cb filter signal flags that specify whether the cross-component filter for the Cb color component is signaled;
cc and cr signal flags that specify whether the cross-component filter for the Cr color component is signaled;
25. The method of claim 24. converting between a video comprising one or more pictures and a bitstream of said video according to format rules;
The format rules determine whether and/or how to signal a filter presence flag and/or an indication of filter coefficients depends on the adaptive loop filtering data structure in the adaptive parameter set RBSP (raw byte array payload) and / or provide to rely on pre-coded information with syntax elements,
Method. the format rules further provide that if the indication is not present, infer the value of the indication based on pre-coded information using the adaptive loop filtering data structure;
27. The method of claim 26. The format rules define whether to signal the cross-component filter for the Cr color component. Whether to signal the cc and cr filter signal flags determines whether all three syntax elements are equal to a constant value. provided that it depends on
The three syntax elements are a luma filter signal flag that specifies whether to signal a luma filter set, a chroma filter signal flag that specifies whether to signal a chroma filter, and a cc and cb filter signal flags that define whether to signal the cross-component filter;
27. The method of claim 26. The format rules define whether the chroma filter signal flag defines whether the chroma filter is signaled.The value of the luma filter signal flag defines whether the luma filter set is signaled. further stipulate that it depends on
27. The method of claim 26. A video processing method,
converting between a video comprising one or more pictures and a bitstream of said video according to format rules;
The format rules allow, for video regions smaller than a picture, to refer to multiple adaptive parameter sets (APS) corresponding to coding tools whose side information is included in the APS.
Method. the plurality of APSs includes scaling APSs, LMCS (Luminance Mapping with Chroma Scaling) APSs, and/or APSs corresponding to other coding tools;
31. The method of claim 30. the format rules specify that the bitstream includes a number of the APSs referenced;
31. The method of claim 30. the format rules specify that the bitstream includes indices of the referenced APSs;
31. The method of claim 30. the format rules further define that the plurality of APSs used for the conversion depends on color components of the video;
31. The method of claim 30. the format rules further specify using different APSs for luminance and chroma components of the video;
35. The method of claim 34. the format rules further provide for separately signaling in the bitstream the number and/or index of the plurality of APSs used for luma and chroma components;
35. The method of claim 34. said format rules further define how to use said plurality of APSs depends on sub-pictures of said picture;
31. The method of claim 30. the format rules further define for each sub-picture to select or signal the on/off control and/or the plurality of APSs to be used;
31. The method of claim 30. A video processing method,
converting between a video including one or more pictures including one or more subpictures and a bitstream of the video according to format rules;
The format rule sets the value of a first variable indicating whether sub-pictures of a coded picture are treated as pictures in a decoding process excluding in-loop filtering operations to a second variable indicating the presence of sub-picture information in the bitstream. prescribe how to make inferences depending on the variables of
Method. 40. The method of claim 39, wherein the formatting rules specify that the value of the first variable is inferred to be equal to the value of the second variable if the first variable does not exist. A video processing method,
converting between a video including one or more pictures including one or more subpictures and a bitstream of the video according to format rules;
The format rule is such that a variable indicating applicability of a deblocking filter to a picture referencing a picture parameter set is de-allocated to a slice referencing the picture parameter set in response to one or more conditions being met. having a first value indicating to apply a blocking filter or a second value indicating that the deblocking filter is disabled for slices referencing the picture parameter set;
Method. the first value is 1 and the second value is 0;
42. The method of claim 41. The one or more conditions are
1) there is no deblocking filter invalid flag indicating invalidation of the deblocking filter at the slice level and picture header level;
2) a deblocking filter override enable flag indicates that the deblocking behavior of pictures referencing said picture parameter set has not been overridden;
3) said deblocking filter override enable flag indicates to allow overriding of said deblocking behavior for pictures referencing said picture parameter set, and said deblocking filter present flag indicates that deblocking filter information is included in the picture header syntax structure a deblocking filter disabled flag at the picture header level indicates that the deblocking filter is disabled for the picture; or
4) the deblocking filter override enable flag indicates that overriding of the deblocking behavior for pictures that reference the picture parameter set is allowed, and the deblocking filter present flag indicates that deblocking filter information is present in the picture header syntax structure; , a slice-level deblocking filter disabled flag indicates that the deblocking filter is disabled for the picture;
43. The method of claim 42. the first value is 0 and the second value is 0;
42. The method of claim 41. The one or more conditions are
1) there is no deblocking filter invalid flag indicating invalidation of the deblocking filter at the slice level and picture header level;
2) a deblocking filter override enable flag indicates that the deblocking behavior of pictures referencing said picture parameter set has not been overridden;
3) said deblocking filter override enable flag indicates to allow overriding of said deblocking behavior for pictures referencing said picture parameter set, and said deblocking filter present flag indicates that deblocking filter information is included in the picture header syntax structure a deblocking filter disabled flag at the picture header level indicates that the deblocking filter is enabled for the current picture; or
4) the deblocking filter override enable flag indicates that overriding of the deblocking behavior for pictures that reference the picture parameter set is allowed, and the deblocking filter present flag indicates that deblocking filter information is not present in the picture header syntax structure; first, a slice-level deblocking filter disabled flag indicates that the deblocking filter is enabled for the picture;
45. The method of claim 44. A video processing method,
converting between a video comprising one or more video units comprising one or more slices and a bitstream of said video according to format rules;
The format rules specify that quantization parameter offset values used for joint chroma residual coding are contained at one or more video unit levels that are greater than the slice level.
Method. the one or more video units correspond to a video picture, a video sequence, a sequence parameter set, a video parameter set, a picture header, a picture parameter set, or a decoding capability information syntax structure;
47. The method of claim 46. the one or more video unit levels including a first level and a second level;
The format rule further wherein whether to signal the quantization parameter offset value at the second level depends on whether the quantization parameter offset value is signaled at the first level. prescribe,
47. The method of claim 46. the one or more video unit levels including a first level and a second level that is lower than the first level;
The format rule comprises a quantization parameter offset value for the second level such that the quantization parameter offset value is signaled at a first level and overrides the signaled value for the first level. further stipulate signaling an override flag to indicate whether to signal
47. The method of claim 46. A video processing method,
converting between a video comprising one or more pictures and a bitstream of said video according to format rules;
Said format rules include (i) a fixed or variable length of one or more bits used to code a variable that indicates a LMCS (Luminance Mapping with Chroma Scaling) mode identification at the picture header level; ii) defining a range of values for said variable;
Method. the formatting rules specify that the variable is coded using ue(v) and the range of the value of the variable is 0 to 2, inclusive;
51. The method of claim 50. the format rule is that the variable is coded with ue(v), and the range of the value of the variable is 0 to 1 if a picture contains only one slice; otherwise, providing that the range is 0 to 2, inclusive;
51. The method of claim 50. The format rules code the variable using u(1) such that the value of the variable is 0 or 1 if a picture contains only one slice; providing that the variable is coded using u(v) such that the range of values is 0 to 2, inclusive;
51. The method of claim 50. A video processing method,
converting between a video comprising one or more pictures and a bitstream of said video according to format rules;
Said format rules include (i) a fixed or variable length of one or more bits used to code a variable indicating scaling list mode identification at picture header level, and (ii) a range of values for said variable. and
Method. the formatting rules specify that the variable is coded using ue(v) and the range of the value of the variable is 0 to 2, inclusive;
55. The method of claim 54. The format rule is that the variable is coded using ue(v), and if the picture contains only one slice, the range of the value of the variable is 0 to 1 (inclusive). otherwise, the range is 0 to 2;
55. The method of claim 54. The format rules code the variable using u(1) such that the value of the variable is 0 or 1 if a picture contains only one slice; providing that the variable is coded using u(v) such that the range of the value of is between 0 and 2, inclusive;
55. The method of claim 54. the transforming includes encoding the video into the bitstream;
The method of any of claims 1-57. the transforming includes decoding the video from the bitstream;
The method of any of claims 1-57. the transforming includes generating the bitstream from the video;
The method further includes storing the bitstream on a non-transitory computer-readable medium.
The method of any of claims 1-57. A processing device configured to implement the method of any one or more of claims 1-60,
Video processing equipment. A method of storing a bitstream of video, comprising:
comprising the method of any one of claims 1-60,
further comprising storing the bitstream on a non-transitory computer-readable medium;
Method. A computer readable medium storing program code,
causing a processing device to implement the method of any one or more of claims 1 to 60 when the program code is executed;
computer readable medium. storing a bitstream generated according to any of the methods described above;
computer readable medium. A video processing device for storing a bitstream representation, comprising:
configured to implement the method of any one or more of claims 1-60,
Video processing equipment.

Images