JPWO2021234132A5 - - Google Patents

Description

The present invention relates to video encoding and video decoding, and in particular to video encoders, video decoders, methods for encoding and decoding, and video data streams for implementing advanced video encoding concepts.

H. H.265/HEVC (HEVC = High Efficiency Video Coding) is a video codec that already provides tools to improve or even enable parallelism in encoders and/or decoders. For example, HEVC supports subdivision of a picture into an array of tiles that are encoded independently of each other. Another concept supported by HEVC is related to WPP, according to which a CTU row or CTU line of a picture has some minimum CTU offset in the processing of consecutive CTU lines (CTU = coding tree unit). Subject to compliance, they may be processed left to right in parallel, eg in stripes. However, it is preferable to have a video codec on hand that supports the parallel processing capabilities of a video encoder and/or video decoder even more efficiently.

In the following, the introduction of VCL splitting according to the state of the art is described (VCL = video coding layer).

Generally, in video coding, the process of encoding picture samples requires smaller partitions, where the samples are divided into several rectangular regions for joint processing such as prediction or transform coding. A picture is thus divided into blocks of a certain size that is constant during the encoding of the video sequence. H. In the H.264/AVC standard, fixed-size blocks of 16×16 samples, so-called macroblocks, are used (AVC=Advanced Video Coding).

In the state-of-the-art HEVC standard (see [1]) there is a Coding Tree Block (CTB) or Coding Tree Unit (CTU) with a maximum size of 64x64 samples. Further discussion of HEVC uses the more general term CTU for such types of blocks.

The CTUs are processed in raster scan order starting from the top left CTU, linearly processing the CTUs in the picture to the bottom right CTU.

Encoded CTU data is organized into a kind of container called a slice. Essentially, in conventional video coding standards, a slice means a segment containing one or more consecutive CTUs of a picture. Slices are used to segment the encoded data. From another point of view, a complete picture can also be defined as one large segment, so historically the term slice still applies. In addition to the coded picture samples, a slice also contains additional information related to the coding process of the slice itself located in a so-called slice header.

According to the state of the art, VCL (Video Coding Layer) also includes techniques for fragmentation and spatial division. Such partitioning can be applied, for example, to video coding for a variety of reasons, among them handling load balancing in parallelization, CTU size matching in network transmission, and error mitigation.

Another example relates to RoI (RoI=Region of Interest) coding, where, for example, the central region of the picture that the viewer can select, for example by a zoom-in operation (decoding only the RoI), Or, intra data (generally put into one frame of a video sequence) can e.g. swipe over a picture plane and reset the temporal prediction chain locally in the same way that an intra picture does it for the entire picture plane. There is a gradual decoder refresh (GDR) that is temporally distributed over several consecutive frames as a series of intra blocks. In the latter case, there are two regions in each picture, one that has recently been reset and one that may be affected by errors and error propagation.

Reference picture resampling (RPR) is used in video coding to adapt the video quality/rate by not only using coarser quantization parameters, but also potentially adapting the resolution of each transmitted picture. It is a technology that is used. Therefore, the reference used for inter prediction may have a different size than the picture currently predicted for encoding. Basically, RPR requires a resampling process within the prediction loop, eg upsampling and downsampling filters to be defined.

Depending on the peculiarities, RPR can lead to changes in the encoded picture size in any picture, or in some cases, such as only at certain locations bounded by segment boundary adaptive HTTP streaming. It can be restricted to occur only in certain pictures.

It is an object of the invention to provide improved concepts for video encoding and video decoding.

The object of the invention is solved by the subject matter of the independent claims.

According to a first aspect of the invention, an apparatus is provided for receiving an input video data stream. The input video data stream contains encoded video. The device is configured to generate an output video data stream from an input video data stream. Further, the apparatus is adapted to determine whether pictures of the video preceding the dependent random access picture should be output.

Additionally, a video data stream is provided. The video is encoded in this video data stream. The video data stream includes an indication of whether or not pictures of the video preceding the dependent random access pictures should be output.

Additionally, a video encoder is provided. A video encoder is configured to encode video into a video data stream. Further, the video encoder is configured to generate the video data stream such that the video data stream includes an indication of whether pictures of the video preceding the dependent random access pictures are to be output.

A video decoder is also provided for receiving a video data stream containing video. A video decoder is configured to decode the video from the video data stream. A video decoder is configured to decode the video in response to an indication of whether a picture of the video preceding the dependent random access picture should be output.

Additionally, a method is provided for receiving an input video data stream. The input video data stream contains encoded video. The method includes generating an output video data stream from an input video data stream. Additionally, the method includes determining whether a picture of the video preceding the dependent random access picture should be output.

Additionally, a method is provided for encoding video into a video data stream. The method includes generating the video data stream such that the video data stream includes an indication of whether pictures of the video preceding the dependent random access pictures are to be output.

Additionally, a method is provided for receiving a video data stream containing video. The method includes decoding video from a video data stream. Decoding the video is performed in response to an indication of whether pictures of the video preceding the dependent random access pictures are to be output.

Further provided is a computer program for performing one of the aforementioned methods when run on a computer or signal processor.

According to a second aspect of the invention, an apparatus is provided for receiving one or more input video data streams. Input video is encoded into each of one or more input video data streams. The apparatus is configured to generate an output video data stream from one or more input video data streams, the output video data stream encoding the output video, the apparatus converting the output video from the one or more input video data streams. generating an output video data stream such that the input video is encoded in one of the input video data streams, or the output video depends on at least one of the one or more input video data streams; configured to Further, the apparatus is configured to determine a current picture access unit removal time of the plurality of pictures of the output video from the coded picture buffer. The apparatus is configured to determine whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer.

Additionally, a video data stream is provided. The video is encoded in this video data stream. The video data stream contains coded picture buffer delay offset information.

Further provided is a video decoder for receiving a video data stream stored in the video. A video decoder is configured to decode the video from the video data stream. Further, the video decoder is configured to decode the video according to a current picture access unit removal time of the plurality of pictures of the video from the coded picture buffer. A video decoder is configured to decode the video in response to an indication of whether to use the coded picture buffer delay offset information to determine an access unit removal time for a current picture from the coded picture buffer. be.

Additionally, a method is provided for receiving one or more input video data streams. Input video is encoded into each of one or more input video data streams. The method includes generating an output video data stream from one or more input video data streams, the output video data stream encoding the output video, generating the output video data stream wherein the output video is one or more or the output video is dependent on at least one of the one or more input video data streams. be Further, the method includes determining an access unit removal time for a current picture of the plurality of pictures of the output video from the encoded picture buffer. Further, the method includes determining whether to use the coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer.

Further, a method is provided for encoding video into a video data stream according to an embodiment. The method includes generating a video data stream such that the video data stream includes encoded picture buffer delay offset information.

Additionally, a method is provided for receiving a video data stream stored in a video. The method includes decoding video from a video data stream. Decoding the video is performed in response to an access unit removal time from a coded picture buffer of a current picture of the plurality of pictures of the video. Further, decoding the video is performed in response to an indication of whether to use the coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer.

Further provided is a computer program for performing one of the aforementioned methods when run on a computer or signal processor.

According to a third aspect of the invention, a video data stream is provided. The video is encoded in this video data stream. Additionally, the video data stream includes an initial coded picture buffer removal delay. Additionally, the video data stream includes an initial coded picture buffer removal offset. Additionally, the video data stream includes information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods.

Additionally, a video encoder is provided. A video encoder is configured to encode video into a video data stream. Additionally, the video encoder is configured to generate the video data stream such that the video data stream includes the initial encoded picture buffer removal delay. Additionally, the video encoder is configured to generate the video data stream such that the video data stream includes the initial coded picture buffer removal offset. Additionally, the video encoder indicates whether the video data stream is defined such that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. It is configured to generate a video data stream containing the information.

Further, an apparatus is provided for receiving two input video data streams, a first input video data stream and a second input video data stream. An input video is encoded into each of the two input video data streams. The apparatus is configured to generate an output video data stream from two input video data streams, the output video data stream encoding the output video, the apparatus generating a first input video data stream and a second input video data stream. and streams to generate an output video data stream. Additionally, the apparatus is configured to generate the output video data stream such that the output video data stream includes the initial encoded picture buffer removal delay. Additionally, the apparatus is configured to generate the output video data stream such that the output video data stream includes the initial coded picture buffer removal offset. In addition, the apparatus provides information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods in the output video data stream. is configured to generate an output video data stream such that

Further provided is a video decoder for receiving a video data stream stored in the video. A video decoder is configured to decode the video from the video data stream. Additionally, the video data stream includes an initial coded picture buffer removal delay. Additionally, the video data stream includes an initial coded picture buffer removal offset. Additionally, the video data stream includes information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. Further, the video decoder may determine whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. is configured to decode the

Additionally, a method is provided for encoding video into a video data stream. The method includes generating a video data stream such that the video data stream includes an initial encoded picture buffer removal delay. Additionally, the method includes generating the video data stream such that the video data stream includes the initial coded picture buffer removal offset. Further, the method indicates whether the video data stream is defined such that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. Generating a video data stream to include the information.

Further, a method is provided for receiving two input video data streams, a first input video data stream and a second input video data stream. An input video is encoded into each of the two input video data streams. The method includes generating an output video data stream from two input video data streams, the output video data stream encoding the output video, the apparatus receiving the first input video data stream and the second input video data stream. and to generate an output video data stream. Additionally, the method includes generating the output video data stream such that the output video data stream includes the initial encoded picture buffer removal delay. Additionally, the method includes generating the output video data stream such that the output video data stream includes the initial coded picture buffer removal offset. Further, the method determines whether the output video data stream is defined such that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. Generating an output video data stream to include the indicative information.

Additionally, a method is provided for receiving a video data stream stored in a video. The method includes decoding video from a video data stream. A video data stream includes an initial coded picture buffer removal delay. Additionally, the video data stream includes an initial coded picture buffer removal offset. Additionally, the video data stream includes information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. The method decodes the video in response to information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. including the step of

Further provided is a computer program for performing one of the aforementioned methods when run on a computer or signal processor.

According to a fourth aspect of the invention, a video data stream is provided. The video is encoded in this video data stream. Further, the video data stream is not scalable nested in network abstraction layer units of one access unit of the plurality of access units of the one encoded video sequence of the one or more encoded video sequences of the video data stream. including an indication of whether the picture timing supplemental enhancement information message is defined to apply to all output layer sets of the plurality of output layer sets of the access unit. if the indication has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit is applied to all output layer sets of the plurality of output layer sets of the access unit; is defined as If an indication has a value different from a first value, an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit's multiple output layer sets all of the access unit's output layer sets. Undefined whether or not it applies to the output layerset.

Additionally, a video encoder is provided. A video encoder is configured to encode video into a video data stream. Further, the video encoder provides a scalable non-nested picture of a network abstraction layer unit of one access unit of the plurality of access units of the one encoded video sequence of the one or more encoded video sequences of the video data stream. generating a video data stream such that the video data stream includes an indication of whether a timing supplement enhancement information message is defined to apply to all output layer sets of the plurality of output layer sets of the access unit; configured as if the indication has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit is applied to all output layer sets of the plurality of output layer sets of the access unit; is defined as If an indication has a value different from a first value, an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit's multiple output layer sets all of the access unit's output layer sets. Undefined whether or not it applies to the output layerset.

Also provided is an apparatus for receiving an input video data stream. The input video data stream contains encoded video. The device is configured to generate a processed video data stream from an input video data stream. Further, the apparatus is scalable non-nested network abstraction layer units of one access unit of the plurality of access units of the one encoded video sequence of the one or more encoded video sequences of the processed video data stream. processed video, such that the processed video data stream includes an indication of whether a picture timing supplemental enhancement information message is defined to apply to all output layer sets of the plurality of output layer sets of the access unit; configured to generate a data stream; if the indication has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit is applied to all output layer sets of the plurality of output layer sets of the access unit; is defined as If an indication has a value different from a first value, an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit's multiple output layer sets all of the access unit's output layer sets. Undefined whether or not it applies to the output layerset.

A video decoder is also provided for receiving a video data stream containing video. A video decoder is configured to decode the video from the video data stream. The video data stream includes scalable non-nested picture timing of network abstraction layer units of one access unit of a plurality of access units of one of the one or more encoded video sequences of the video data stream. including an indication of whether the supplemental enhancement information message is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. if the indication has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit is applied to all output layer sets of the plurality of output layer sets of the access unit; is defined as If an indication has a value different from a first value, an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit's multiple output layer sets all of the access unit's output layer sets. Undefined whether or not it applies to the output layerset.

Additionally, a method is provided for encoding video into a video data stream. The method is a method wherein the video data stream is scalable network abstraction layer units of one access unit of a plurality of access units of an encoded video sequence of one or more encoded video sequences of the video data stream. generating a video data stream to include an indication of whether non-nested picture timing supplemental enhancement information messages are defined to apply to all output layer sets of the plurality of output layer sets of the access unit; Including steps. if the indication has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit is applied to all output layer sets of the plurality of output layer sets of the access unit; is defined as If an indication has a value different from a first value, an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit's multiple output layer sets all of the access unit's output layer sets. Undefined whether or not it applies to the output layerset.

Additionally, a method is provided for receiving an input video data stream. The input video data stream contains encoded video. The method includes generating a processed video data stream from an input video data stream. Further, the method includes scalable nesting of network abstraction layer units of one access unit of a plurality of access units of an encoded video sequence of one or more encoded video sequences of the processed video data stream. such that the processed video data stream includes an indication of whether a picture timing supplemental enhancement information message is defined to apply to all output layer sets of the plurality of output layer sets of the access unit. Generating a video data stream. if the indication has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit is applied to all output layer sets of the plurality of output layer sets of the access unit; is defined as If an indication has a value different from a first value, an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit's multiple output layer sets all of the access unit's output layer sets. Undefined whether or not it applies to the output layerset.

Additionally, a method is provided for receiving a video data stream containing video. The method includes decoding video from a video data stream. The video data stream includes scalable non-nested picture timing of network abstraction layer units of one access unit of a plurality of access units of one of the one or more encoded video sequences of the video data stream. including an indication of whether the supplemental enhancement information message is defined to apply to all output layer sets of a plurality of output layer sets of said access unit. if the indication has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit is applied to all output layer sets of the plurality of output layer sets of the access unit; is defined as If an indication has a value different from a first value, an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit's multiple output layer sets all of the access unit's output layer sets. Undefined whether or not it applies to the output layerset.

Further provided is a computer program for performing one of the aforementioned methods when run on a computer or signal processor.

According to a fifth aspect of the invention, a video data stream is provided. The video is encoded in this video data stream. Additionally, the video data stream includes one or more scalable nested Supplemental Enhancement Information messages. One or more scalable nested supplemental extension information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size in each of the video data stream or the scalable nested supplemental enhancement information messages of the part of the video data stream. Defined.

Additionally, a video encoder is provided. A video encoder is configured to encode video into a video data stream. Further, the video encoder is configured to generate the video data stream such that the video data stream comprises one or more scalable nested supplemental enhancement information messages. Further, the video encoder is configured to generate the video data stream such that one or more scalable nested supplemental enhancement information messages include multiple syntax elements. Further, the video encoder may determine that each syntax element of the one or more syntax elements of the plurality of syntax elements is in each scalable nested supplemental enhancement information message of the video data stream or part of the video data stream. It is configured to generate video data streams, defined as having the same size.

Also provided is an apparatus for receiving an input video data stream. The input video data stream contains encoded video. The device is configured to generate an output video data stream from an input video data stream. A video data stream includes one or more scalable nested Supplemental Enhancement Information messages. One or more scalable nested supplemental extension information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size in each of the video data stream or the scalable nested supplemental enhancement information messages of the part of the video data stream. Defined. The apparatus is configured to process one or more scalable nested supplemental enhancement information messages.

A video decoder is also provided for receiving a video data stream containing video. A video decoder is configured to decode the video from the video data stream. A video data stream includes one or more scalable nested Supplemental Enhancement Information messages. One or more scalable nested supplemental extension information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size in each of the video data stream or the scalable nested supplemental enhancement information messages of the part of the video data stream. Defined. A video decoder is configured to decode video in response to one or more syntax elements of the plurality of syntax elements.

Additionally, a method is provided for encoding video into a video data stream. The method includes generating a video data stream such that the video data stream includes one or more scalable nested supplemental enhancement information messages. Additionally, the method includes generating the video data stream such that one or more scalable nested supplemental enhancement information messages include multiple syntax elements. Further, the method is characterized in that each syntax element of the one or more syntax elements of the plurality of syntax elements is the same in each of the scalable nested supplemental enhancement information messages of the video data stream or part of the video data stream. Generating a video data stream as defined to have a size.

Additionally, a method is provided for receiving an input video data stream. The input video data stream contains encoded video. The method includes generating an output video data stream from an input video data stream. A video data stream includes one or more scalable nested Supplemental Enhancement Information messages. One or more scalable nested supplemental extension information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size in each of the video data stream or the scalable nested supplemental enhancement information messages of the part of the video data stream. Defined. The method includes processing one or more scalable nested supplemental enhancement information messages.

Additionally, a method is provided for receiving a video data stream containing video. The method includes decoding video from a video data stream. A video data stream includes one or more scalable nested Supplemental Enhancement Information messages. One or more scalable nested supplemental extension information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size in each of the video data stream or the scalable nested supplemental enhancement information messages of the part of the video data stream. Defined. Decoding the video is performed in response to one or more syntax elements of the plurality of syntax elements.

Further provided is a computer program for performing one of the aforementioned methods when run on a computer or signal processor.

Preferred embodiments are provided in the dependent claims.

Embodiments of the invention are described in detail below with reference to the drawings.
1 illustrates a video encoder for encoding video into a video data stream according to one embodiment; 1 illustrates an apparatus for receiving an input video data stream according to one embodiment; 1 illustrates a video decoder for receiving a video data stream containing video according to one embodiment. 4 shows the original bitstream (shown at the top of FIG. 4) and the bitstream after dropping pictures according to one embodiment (shown at the bottom of FIG. 4). FIG. 4 illustrates splicing of two bitstreams after pictures are dropped from one of the two bitstreams according to one embodiment. FIG. Fig. 4 shows splicing of two bitstreams according to another embodiment; 2 shows two sets of HRD SEI, scalable nested SEI and scalable non-nested SEI in a two-layer bitstream according to one embodiment. Indicates a video encoder. 1 shows a video decoder. Fig. 1 shows the relationship between a reconstructed signal, such as a reconstructed picture, on the one hand, and a combination of a prediction residual signal and a prediction signal, signaled in a data stream, on the other hand.

The following figure descriptions are of descriptions of an encoder and decoder of a block-based predictive codec for encoding pictures of video to form an example encoding framework in which embodiments of the present invention may be incorporated. Start with a presentation. Each of the encoder and decoder will be described with reference to FIGS. Descriptions of embodiments of the inventive concepts are presented below, along with descriptions of how such concepts can be incorporated into the encoders and decoders of FIGS. 8 and 9, respectively, while FIGS. The embodiments described below can also be used to form encoders and decoders that do not operate according to the underlying encoding framework of the encoders and decoders of FIGS.

FIG. 8 shows a video encoder, an apparatus for predictively encoding pictures 12 into a data stream 14 using exemplary transform-based residual coding. The device or encoder is indicated using reference number 10 . FIG. 9 shows a corresponding video decoder 20, e.g., an apparatus 20 configured to predictively decode pictures 12' from a data stream 14 also using transform-based residual decoding, where the apostrophe indicates that the decoder 20 is used to show that the picture 12' reconstructed by there is Although FIGS. 8 and 9 exemplarily use transform-based predictive residual coding, embodiments of the present application are not limited to this kind of predictive residual coding. This is also the case for other details discussed with respect to Figures 8 and 9, as outlined below.

Encoder 10 is configured to spatial-spectrum transform the prediction residual signal and encode the prediction residual signal thus obtained into data stream 14 . Similarly, decoder 20 is configured to decode the prediction residual signal from data stream 14 and spectral-space transform the prediction residual signal thus obtained.

Internally, encoder 10 may comprise a prediction residual signal former 22 that generates prediction residuals 24 to measure the deviation of prediction signal 26 from the original signal from picture 12, for example. The prediction residual signal former 22 may, for example, be a subtractor that subtracts the prediction signal from the original signal, eg picture 12 . Encoder 10 then further includes transformer 28 that spatio-spectrally transforms prediction residual signal 24 to obtain a spectral-domain prediction residual signal 24 ′ that is quantized by quantizer 32 also included in encoder 10 . Prepare. The prediction residual signal 24 ″ thus quantized is encoded into the bitstream 14 . To this end, encoder 10 may optionally comprise an entropy coder 34 for entropy encoding the prediction residual signal that is transformed and quantized into data stream 14 . The prediction signal 26 is generated by the prediction stage 36 of the encoder 10 based on the prediction residual signal 24'' encoded in the data stream 14 and decodable therefrom. To this end, the prediction stage 36 converts the prediction residual signal 24'' to obtain a spectral domain prediction residual signal 24'' corresponding to the non-quantized loss signal 24', as shown in FIG. An inverse quantizer 38 for inverse quantizing and inverting the latter prediction residual signal 24'' to obtain a prediction residual signal 24''' corresponding to the original prediction residual signal 24 without the quantization loss. An inverse transformer 40 for applying a transform, for example a spectral space transform, may be included therein. A combiner 42 of the prediction stage 36 then recombines the prediction signal 26 and the prediction residual signal 24'''', such as by addition, to obtain a reconstructed signal 46, eg, a reconstruction of the original signal 12. do. Reconstructed signal 46 may correspond to signal 12'. Prediction module 44 of prediction stage 36 then generates prediction signal 26 based on signal 46, e.g., by using spatial prediction, e.g., intra-picture prediction, and/or temporal prediction, e.g., inter-picture prediction. do.

Similarly, the decoder 20 may be internally constructed from components corresponding to the prediction stages 36 and interconnected in a manner corresponding to the prediction stages, as shown in FIG. In particular, entropy decoder 50 of decoder 20 is capable of entropy decoding quantized spectral-domain prediction residual signal 24'' from the data stream, with inverse quantizer 52, inverse transformer 54, combiner 56 and prediction module 58 are interconnected and cooperate in the manner previously described with respect to the modules of prediction stage 36 to recover a reconstructed signal based on prediction residual signal 24'', thereby providing , the output of combiner 56 provides the reconstructed signal, picture 12'.

Although not specifically described above, encoder 10 may, for example, predict mode, It is readily apparent that several encoding parameters can be set, including motion parameters and the like. For example, encoder 10 and decoder 20 and corresponding modules 44, 58, respectively, may support different prediction modes, such as intra-coding and inter-coding modes. The granularity at which the encoder and decoder switch between these prediction mode types may correspond to the subdivision of pictures 12 and 12' into coded segments or blocks, respectively. In units of these coded segments, for example, a picture can be subdivided into blocks that are intra-coded and blocks that are inter-coded. Intra-coded blocks are predicted based on the spatially already encoded/decoded neighborhood of the respective block, as outlined in more detail below. There are several intra-encoding modes, including a directional intra-encoding mode or an angular intra-encoding mode, and these modes may be selected for respective intra-encoded segments, and according to those modes, respective directional intra-encoding modes may be selected. Each segment is filled by extrapolating neighboring sample values along a particular direction specific to the intra-coding mode into each intra-coded segment. The intra-coding mode may be, for example, a DC-coding mode in which the prediction of each intra-coded block assigns a DC value to all samples in each intra-coded segment, and/or the prediction of each block. is the spatial distribution of sample values described by a two-dimensional linear function over the sample positions of each intra-coded block with the driving slope and offset of the plane defined by the two-dimensional linear function based on neighboring samples. One or more additional modes, such as a planar intra-coding mode that is approximated or determined to be, may also be included. In comparison, inter-coded blocks can be predicted temporally, for example. For inter-coded blocks, a motion vector can be signaled in the data stream, the motion vector indicating the spatial displacement of the portion of the previously coded picture of the video to which picture 12 belongs, and the previously coded block. The coded/decoded picture is sampled to obtain a prediction signal for each inter-coded block. This means that in addition to the residual signal encoding included in the data stream 14, such as the entropy-encoded transform coefficient levels representing the quantized spectral domain prediction residual signal 24'', the data stream 14 uses the encoding mode Controls and signals several prediction parameters of blocks, such as coding mode parameters to assign to various blocks, motion parameters of inter-coded segments, and subdivision of pictures 12 and 12' into their respective segments. This means that optional further parameters may be encoded, such as parameters for . Using these parameters, decoder 20 subdivides the picture in the same way that the encoder did, assigns the same prediction modes to the segments, and performs the same prediction to yield the same prediction signal.

FIG. 10 shows the relationship between a reconstructed signal such as a reconstructed picture 12 ′ on the one hand and a combination of a prediction residual signal 24 ′″ and a prediction signal 26 signaled in the data stream 14 on the other hand. As already mentioned above, the combination may be additive. In FIG. 10, the prediction signal 26 is shown as subdividing the picture area into intra-coded blocks exemplarily shown with hatching and inter-coded blocks exemplarily shown without hatching. It is Subdivision may be a regular subdivision of the picture area into rows and columns of square or non-square blocks, or a tree root block into multiple leaf blocks of various sizes, such as a quadtree subdivision. It could be any subdivision, such as the multi-tree subdivision of picture 12, a mixture of which is shown in FIG. 10, where the picture area is first subdivided into rows and columns of tree root blocks, then , is further subdivided into one or more leaf blocks according to recursive multi-tree subdivision.

Again, data stream 14 may have an intra-coding mode encoded for intra-coded block 80, which is one of several supported intra-coding modes. One is assigned to each intra-coded block 80 . For inter-coded blocks 82 , one or more motion parameters are encoded in data stream 14 . Generally speaking, inter-coded blocks 82 are not limited to being temporally coded. Alternatively, inter-coded block 82 may be a previously encoded picture of the video to which picture 12 belongs, or another view or hierarchically below if the encoder and decoder are respectively scalable encoders and decoders. It may be any block predicted from a previously coded portion beyond the current picture 12 itself, such as a picture of a layer of .

The prediction residual signal 24 ″″ of FIG. 10 is also shown as a subdivision of the picture area into blocks 84 . These blocks are sometimes called transform blocks to distinguish them from encoding blocks 80 and 82 . In effect, FIG. 10 shows that encoder 10 and decoder 20 subdivide picture 12 and picture 12 ′ into two different subdivisions into blocks, one subdivision into encoding blocks 80 and 82 and one subdivision into transform block 84 . It shows that we can use the other subdivision into . Both subdivisions may be the same, for example each encoded block 80 and 82 may form transform block 84 at the same time, but FIG. Form an extension of the subdivision into blocks 80, 82, so that any boundary between two blocks 80 and 82 overlaps the boundary between two blocks 84, or each block 80, 82 Matching one of the transform blocks 84 or matching a cluster of transform blocks 84 is shown. However, these partitions may also be determined or selected independently of each other, such that transform block 84 may alternatively cross the block boundary between blocks 80,82. Thus, as far as the subdivision into transform block 84 is concerned, the same statements as given for the subdivision into blocks 80, 82 apply, e.g., block 84 (with or without arrangement into rows and columns) It may be the result of regular subdivision of the picture area into blocks, the result of recursive multi-tree subdivision of the picture area, or a combination thereof, or any other kind of blocking. Just as an aside, it should be noted that blocks 80, 82, and 84 are not limited to quadratic, rectangular, or any other shape.

FIG. 10 further shows that the combination of the prediction signal 26 and the prediction residual signal 24'''' directly yields the reconstructed signal 12'. However, it should be noted that according to an alternative embodiment, multiple prediction signals 26 can be combined with prediction residual signals 24''' into picture 12'.

In FIG. 10, transform block 84 has the following meaning. The transformer 28 and the inverse transformer 54 perform transforms in units of these transform blocks 84 . For example, many codecs use some kind of DST or DCT for all transform blocks 84 . Some codecs allow skipping transforms for some of the transform blocks 84 so that the prediction residual signal is encoded directly in the spatial domain. However, according to embodiments described below, encoder 10 and decoder 20 are configured such that they support several transforms. For example, the transforms supported by encoder 10 and decoder 20 are:
o DCT-II (or DCT-III), where DCT stands for Discrete Cosine Transform o DST-IV, where DST stands for Discrete Sine Transform o DCT-IV
o DST-VII
o Identity Transformation (IT)
can include

Of course, transformer 28 supports all forward transform versions of these transforms, while decoder 20 or inverse transform 54 supports the corresponding reverse or inverse versions of:
o inverse DCT-II (or inverse DCT-III)
o Reverse DST-IV
o Inverse DCT-IV
o Reverse DST-VII
o Identity Transformation (IT).

The discussion below provides further details on which transforms may be supported by encoder 10 and decoder 20. FIG. Note that in any case, the set of supported transforms can include only one transform, such as one spectral-to-spatial transform or a spatial-to-spectral transform.

As already outlined above, FIGS. 8-10 are presented as examples in which the inventive concepts further described below may be implemented to form specific examples of encoders and decoders in accordance with the present application. . To that extent, the encoders and decoders of FIGS. 8 and 9, respectively, can represent possible implementations of the encoders and decoders described later in this document. However, FIGS. 8 and 9 are examples. However, encoders according to embodiments of the present application can perform block-based encoding of picture 12 differently than the encoder of FIG. 8, using concepts outlined in more detail below, which are , in that it is not a video encoder but a still picture encoder, that it does not support inter prediction, or that the subdivision into blocks 80 is performed differently than illustrated in FIG. . Similarly, a decoder according to embodiments of the present application may perform block-based decoding of pictures 12' from data stream 14 using encoding concepts further outlined below, but for example the same is a still picture decoder rather than a video decoder, the same does not support intra-prediction, or the same subdivides picture 12' into blocks in a different way than described with respect to FIG. and/or that the same does not derive prediction residuals from the data stream 14 in the spatial domain, but for example in the transform domain.

FIG. 1 shows a video encoder 100 for encoding video into a video data stream according to one embodiment. Video encoder 100 is configured to generate the video data stream such that the video data stream includes an indication of whether or not pictures of the video preceding the dependent random access pictures are to be output.

FIG. 2 shows an apparatus 200 for receiving an input video data stream according to one embodiment. The input video data stream contains encoded video. Apparatus 200 is configured to generate an output video data stream from an input video data stream.

FIG. 3 illustrates a video decoder 300 for receiving a video data stream containing video, according to one embodiment. Video decoder 300 is configured to decode video from a video data stream. Video decoder 300 is configured to decode the video in response to an indication of whether pictures of the video preceding the dependent random access picture should be output.

Further, a system is provided according to one embodiment. The system comprises the device of FIG. 2 and the video decoder of FIG. Video decoder 300 of FIG. 3 is configured to receive the output video data stream of the apparatus of FIG. Video decoder 300 of FIG. 3 is configured to decode video from the output video data stream of apparatus 200 of FIG.

In one embodiment, the system may further comprise video encoder 100 of FIG. 1, for example. Apparatus 200 of FIG. 2 may, for example, be configured to receive a video data stream from video encoder 100 of FIG. 1 as an input video data stream.

An (optional) intermediate device 210 of apparatus 200 may, for example, be configured to receive a video data stream from video encoder 100 as an input video data stream and to generate an output video data stream from the input video data stream. For example, the intermediate device may be configured, for example, to modify (header/metadata) information of the input video data stream and/or, for example, to remove pictures from the input video data stream. and/or may be configured to mix/splice the input video data stream with a further secondary bitstream in which the secondary video is encoded.

The (optional) video decoder 221 may be configured, for example, to decode video from an output video data stream.

The (optional) hypothetical reference decoder 222 may, for example, be configured to determine timing information for the video in response to the output video data stream, or the video or portion of the video stored, for example. It may be configured to determine buffer information for the buffer.

The system comprises video encoder 101 of FIG. 1 and video decoder 151 of FIG.

Video encoder 101 is configured to generate an encoded video signal. Video decoder 151 is configured to decode the encoded video signal to reconstruct pictures of the video.

A first aspect of the invention is described in aspects 1-38.

A second aspect of the invention is described in aspects 39-78.

A third aspect of the present invention is described in aspects 79-108.

A fourth aspect of the present invention is described in aspects 109-134.

A fifth aspect of the present invention is described in aspects 135-188.

The first aspect of the present invention will be described in detail below.

According to a first aspect of the invention, an apparatus 200 is provided for receiving an input video data stream. The input video data stream contains encoded video. Apparatus 200 is configured to generate an output video data stream from an input video data stream. Further, the apparatus 200 determines whether the picture of the video preceding the dependent random access picture should be output.

According to an embodiment, the apparatus 200 may for example be configured to determine a first variable (eg NoOutputBeforeDrapFlag) indicating whether or not pictures of video preceding the dependent random access picture should be output. .

In one embodiment, the apparatus 200 may, for example, include an indication that the output video data stream may, for example, indicate whether or not pictures of the video preceding the dependent random access pictures should be output. , can be configured to generate an output video data stream.

According to one embodiment, the apparatus 200 provides supplemental enhancement information including an indication that can indicate whether the output video data stream should, for example, output pictures of the video preceding the dependent random access pictures. can be configured to generate an output video data stream such that it can include a

In one embodiment, the picture of the video that precedes the dependent random access picture may be, for example, an independent random access picture. Apparatus 200 may, for example, be configured to generate an output video data stream whereby the output video data stream, for example, contains a predetermined value (eg, 0) in the picture headers of independent random access pictures. a flag (e.g. ph_pic_output_flag), whereby a predetermined value (e.g. 0) of the flag (e.g. ph_pic_output_flag) directly precedes said dependent random access picture in e.g. a video data stream For independent random access pictures, it can be indicated that said independent random access pictures should not be output.

According to one embodiment, the flag may be, for example, the first flag, and the device 200 may, for example, detect that the output video data stream includes further flags, for example, in the picture parameter set of the video data stream. and a further flag, e.g. whether a first flag (e.g. ph_pic_output_flag) is present in the picture header of the independent random access picture can be shown.

In one embodiment, the apparatus 200 may, for example, display the output video data stream's It may include a supplementary enhancement information flag in the supplementary enhancement information, or a picture parameter set flag in the picture parameter set of the output video data stream, or a sequence parameter set flag in the sequence parameter set of the output video data stream, or an external means flag. As such, it can be configured to generate an output video data stream, and the value of the external means flag can be set by an external unit external to the device 200, for example.

According to an embodiment, the apparatus 200 is configured to determine the value of a second variable (eg, PictureOutputFlag) of a picture of a video preceding a dependent random access picture, eg, depending on a first variable (eg, NoOutputBeforeDrapFlag). and a second variable (e.g. PictureOutputFlag) may e.g. The picture may be configured to be output or not to be output according to PictureOutputFlag).

In one embodiment, the picture of the video that precedes the dependent random access picture may be, for example, an independent random access picture. A first variable (eg, NoOutputBeforeDrapFlag) may indicate, for example, that independent random access pictures should not be output.

According to one embodiment, the picture of the video preceding the dependent random access picture may be, for example, an independent random access picture. The apparatus 200 may, for example, set the first variable (eg, NoOutputBeforeDrapFlag) such that the first variable (eg, NoOutputBeforeDrapFlag) may indicate, for example, that independent random access pictures should be output. can be configured to

In one embodiment, apparatus 200 may, for example, be configured to signal to video decoder 300 whether pictures of video preceding dependent random access pictures should be output.

Additionally, a video data stream is provided. The video is encoded in this video data stream. The video data stream includes an indication of whether or not pictures of the video preceding the dependent random access pictures should be output.

According to one embodiment, the video data stream may include supplemental enhancement information including, for example, an indication that may indicate whether or not pictures of the video preceding the dependent random access pictures should be output.

In one embodiment, the picture of the video that precedes the dependent random access picture may be, for example, an independent random access picture. A video data stream may include, for example, a flag (eg, ph_pic_output_flag) having a predetermined value (eg, 0) in the picture header of an independent random access picture, such that the flag (eg, ph_pic_output_flag) has a predetermined A value (eg, 0) may indicate, for example, for an independent random access picture that directly precedes said independent random access picture in a video data stream, said independent random access picture should not be output.

According to an embodiment the flag may for example be a first flag, the video data stream may for example comprise a further flag within a picture parameter set of the video data stream, the further flag can, for example, indicate whether a first flag (eg, ph_pic_output_flag) is present in the picture header of an independent random access picture.

In one embodiment, the video data stream includes supplemental extensions in the output video data stream's supplemental extension information as an indication that can indicate, for example, whether pictures of the video preceding the dependent random access pictures should be output or not. An information flag, or a picture parameter set flag in the picture parameter set of the output video data stream, or a sequence parameter set flag in the sequence parameter set of the output video data stream, or an external means flag, the value of the external means flag can be set by an external unit external to the device 200, for example.

A video encoder 100 is also provided. Video encoder 100 may, for example, be configured to encode video into a video data stream. Further, the video encoder 100 is configured to generate the video data stream such that, for example, the video data stream includes an indication of whether pictures of the video preceding the dependent random access pictures should be output. obtain.

According to one embodiment, the video encoder 100 may, for example, output supplemental enhancement information including an indication that may indicate whether the video data stream should, for example, output pictures of the video that precede the dependent random access pictures. can be configured to generate a video data stream such that it can include

In one embodiment, the picture of the video that precedes the dependent random access picture may be, for example, an independent random access picture. The video encoder 100 may, for example, include a flag (eg, ph_pic_output_flag) having a predetermined value (eg, 0) in the picture headers of, for example, independent random access pictures. so that a predetermined value (e.g. 0) of a flag (e.g. ph_pic_output_flag) is for example an independent random access picture directly preceding said independent random access picture in the video data stream. capable of indicating, for a picture, that the independent random access picture should not be output;

According to one embodiment, the flag may be, for example, a first flag, and the video encoder 100 may, for example, detect that the video data stream includes further flags, for example, in the picture parameter set of the video data stream. and a further flag, e.g., whether a first flag (e.g., ph_pic_output_flag) is present in the picture header of an independent random access picture. can be shown.

In one embodiment, video encoder 100 outputs, for example, output video data as an indication that can indicate, for example, whether a video data stream should output pictures of video that precedes, for example, dependent random access pictures. including supplementary enhancement information flags in the supplementary enhancement information of the stream, or picture parameter set flags in the picture parameter set of the output video data stream, or sequence parameter set flags in the sequence parameter set of the output video data stream, or external means flags As can be done, the value of the external means flag can be set by an external unit external to the device 200, for example.

Additionally, a video decoder 300 is provided for receiving a video data stream containing video. Video decoder 300 is configured to decode video from a video data stream. Video decoder 300 is configured to decode the video in response to an indication of whether pictures of the video preceding the dependent random access picture should be output.

According to one embodiment, the video decoder 300 decodes the video, eg, depending on a first variable (eg, NoOutputBeforeDrapFlag) indicating whether pictures of the video preceding the dependent random access picture should be output. can be configured as

In one embodiment, the video data stream may include, for example, an indication that may indicate whether or not pictures of the video preceding the dependent random access pictures should be output. Video decoder 300 may be configured, for example, to decode video in response to representations within a video data stream.

According to one embodiment, the video data stream may include supplemental enhancement information including, for example, an indication that may indicate whether or not pictures of the video preceding the dependent random access pictures should be output. Video decoder 300 may, for example, be configured to decode the video in response to supplemental enhancement information.

In one embodiment, the picture of the video that precedes the dependent random access picture may be, for example, an independent random access picture. A video data stream may include, for example, a flag (eg, ph_pic_output_flag) having a predetermined value (eg, 0) in the picture header of an independent random access picture, such that the flag (eg, ph_pic_output_flag) has a predetermined A value (eg, 0) may indicate, for example, for an independent random access picture that directly precedes said independent random access picture in a video data stream, said independent random access picture should not be output. Video decoder 300 may, for example, be configured to decode the video in response to the flag.

According to an embodiment the flag may for example be a first flag, the video data stream may for example comprise a further flag within a picture parameter set of the video data stream, the further flag can, for example, indicate whether a first flag (eg, ph_pic_output_flag) is present in the picture header of an independent random access picture. Video decoder 300 may, for example, be configured to decode the video in response to additional flags.

In one embodiment, the video data stream includes supplemental extensions in the output video data stream's supplemental extension information as an indication that can indicate, for example, whether pictures of the video preceding the dependent random access pictures should be output or not. An information flag, or a picture parameter set flag in the picture parameter set of the output video data stream, or a sequence parameter set flag in the sequence parameter set of the output video data stream, or an external means flag, the value of the external means flag can be set by an external unit external to the device 200, for example. Video decoder 300 may be configured, for example, to decode video in response to representations within a video data stream.

According to one embodiment, video decoder 300 may be configured, for example, to reconstruct video from a video data stream. Video decoder 300 may, for example, be configured to output or not output pictures of the video preceding the dependent random access picture depending on a first variable (eg, NoOutputBeforeDrapFlag).

In one embodiment, video decoder 300 determines the value of a second variable (eg, PictureOutputFlag) of a picture of video preceding a dependent random access picture, eg, according to a first variable (eg, NoOutputBeforeDrapFlag). A second variable (eg, PictureOutputFlag) may, for example, indicate for said picture whether said picture should be output, and the apparatus 200 may, for example, indicate a second variable (eg, PictureOutputFlag ), whether or not to output the picture.

According to one embodiment, the picture of the video preceding the dependent random access picture may be, for example, an independent random access picture. Video decoder 300 may, for example, be configured to decode the video in response to a first variable (eg, NoOutputBeforeDrapFlag) indicating that independent random access pictures should not be output.

In one embodiment, the picture of the video that precedes the dependent random access picture may be, for example, an independent random access picture. Video decoder 300 may, for example, be configured to decode the video in response to a first variable (eg, NoOutputBeforeDrapFlag) that indicates that independent random access pictures should be output.

Further, a system is provided. The system comprises an apparatus 200 as previously described and a video decoder 300 as previously described. Video decoder 300 is configured to receive the output video data stream of device 200 . Further, video decoder 300 is configured to decode video from the output video data stream of device 200 .

According to one embodiment, the system may further comprise a video encoder 100, for example. Apparatus 200 may, for example, be configured to receive a video data stream from video encoder 100 as an input video data stream.

In particular, a first aspect of the invention relates to DRAP-initiated CVS and to omitting the IDR output in decoding and conformance testing.

If a bitstream contains pictures marked as DRAP (i.e., using the previous IRAP only as a basis for DRAP and from there in the bitstream), mark these DRAP pictures for random access functionality with lower rate overhead. can be used for However, when using several target DRAPs to randomly access the stream, it is undesirable to display any initial pictures before the target DRAP (i.e., the target DRAP's associated IRAP) at the decoder output. , because the temporal distance between these pictures leads to jerky/jerky video playback when the video is played back at the rate of the original video until it plays smoothly from the target DRAP.

Therefore, it is desirable to omit the output of the picture before the DRAP picture. This aspect of the invention presents means for controlling the decoder accordingly.

In one embodiment, an external means of setting the PicOutputFlag variable of an IRAP picture is made available to implementations using the following.
- If some external means not specified herein is available for setting the picture's variable NoOutputBeforeDrapFlag to a value, the picture's NoOutputBeforeDrapFlag is set equal to the value provided by the external means.
[...]
- The variable PictureOutputFlag of the current picture is derived as follows.
- sps_video_parameter_set_id is greater than 0 and the current layer is not an output layer (i.e. nuh_layer_id is OutputLayerIdInOls[TargetOls Idx][i] equal to None), or if one of the following conditions is true, PictureOutputFlag is set equal to 0:
- the current picture is a RASL picture and the NoOutputBeforeRecoveryFlag of the associated IRAP picture is equal to 1;
- The current picture is a GDR picture with a NoOutputBeforeRecoveryFlag of 1 or a restored picture of a GDR picture with a NoOutputBeforeRecoveryFlag of 1.
- The current picture is an IRAP picture with a NoOutputBeforeDrapFlag of 1.
- Otherwise, PictureOutputFlag is set equal to ph_pic_output_flag.

In another embodiment, the NoOutputBeforeDrapFlag is set by external means only for the first IRAP picture in the CVS and is set to 0 otherwise.
- If some external means not specified herein is available to set the variable NoOutputBeforeDrapFlag of the picture to a value, the NoOutputBeforeDrapFlag of the first picture in the CVS equals the value provided by the external means set. Otherwise, the NoOutputBeforeDrapFlag is set to zero.

The aforementioned flag NoOutputBeforeDrapFlag can also be associated with the use of alternative HRD timings conveyed in the bitstream in case of removal of pictures between IRAP and DRAP pictures, eg the flag UseAltCpbParamsFlag in the VVC specification.

In an alternative embodiment, the constraint is that the IRAP picture immediately preceding a DRAP picture without an intervening non-DRAP picture has a value of 0 in the output flag ph_pic_output_flag in the picture header. In this case, whenever the extractor or player uses DRAP for random access, i.e. removes intermediate pictures between IRAP and DRAP from the bitstream, the respective output flag is set to 0. It is also required to verify or coordinate that the IRAP output is omitted.

To simplify this operation, the original bitstream should be prepared accordingly. More specifically, the pps_output_flag_present_flag, which determines the presence of the flag ph_pic_output_flag in the picture header, is equal to 1 so that the picture header can be easily changed without the need to change the parameter set as well. i.e.
It is a bitstream conformance requirement that the value of pps_output_flag_present_flag must be equal to 1 if a PPS is referenced by a picture in a CVSS AU with an associated DRAP AU.

In addition to the above options, in another embodiment the parameter set PPS or SPS indicates whether the first AU in the bitstream, i.e. the CRA or IDR constituting the CLVS start, should be output after decoding. Therefore, instead of system integration requiring relatively low-level syntax such as PH to also be changed when parsing files of file format ISOBMFF for example, only parameter sets need to be adjusted. so it's easier.

１に等しいｓｐｓ＿ｐｉｃ＿ｉｎ＿ｃｖｓｓ＿ａｕ＿ｎｏ＿ｏｕｔｐｕｔ＿ｆｌａｇは、ＳＰＳを参照するＣＶＳＳ ＡＵ内のピクチャが出力されないことを指定する。０に等しいｓｐｓ＿ｐｉｃ＿ｉｎ＿ｃｖｓｓ＿ａｕ＿ｎｏ＿ｏｕｔｐｕｔ＿ｆｌａｇは、ＳＰＳを参照するＣＶＳＳ ＡＵ内のピクチャが出力されてもされなくてもよいことを指定する。 An example is shown below.

sps_pic_in_cvss_au_no_output_flag equal to 1 specifies that pictures in the CVSS AU that reference the SPS are not output. sps_pic_in_cvss_au_no_output_flag equal to 0 specifies that pictures in the CVSS AU that reference the SPS may or may not be output.

It is a bitstream compatibility requirement that the value of sps_pic_in_cvss_au_no_output_flag should be the same for any SPS referenced by any output layer in the OLS.

In 8.1.2—the current picture variable PictureOutputFlag is derived as follows.
- sps_video_parameter_set_id is greater than 0 and the current layer is not an output layer (i.e. nuh_layer_id is OutputLayerIdInOls[TargetOls Idx][i] equal to None), or if one of the following conditions is true, PictureOutputFlag is set equal to 0:
- the current picture is a RASL picture and the NoOutputBeforeRecoveryFlag of the associated IRAP picture is equal to 1;
- The current picture is a GDR picture with a NoOutputBeforeRecoveryFlag of 1 or a restored picture of a GDR picture with a NoOutputBeforeRecoveryFlag of 1.
- Otherwise, if the current AU is a CVSS AU and sps_pic_in_cvss_au_no_output_flag is equal to 1, PictureOutputFlag is set equal to 0.
- Otherwise, PictureOutputFlag is set equal to ph_pic_output_flag.
Note—In one implementation, the decoder can output pictures that do not belong to the output layer. For example, if there is only one output layer in the AU and no picture of the output layer is available, e.g., due to loss or layer downswitching, the decoder may select PictureOutputFlag may be set to 1 for the picture with the highest nuh_layer_id value and ph_pic_output_flag equal to 1, and PictureOutputFlag may be set to 0 for all other pictures in the AU available to the decoder.

In another embodiment, the requirements can be defined, for example, as follows.
It is a bitstream conformance requirement that the value of ph_pic_output_flag must be equal to 0 if the picture belongs to an IRAP AU and the IRAP AU immediately precedes the DRAP AU.

The second aspect of the present invention will be described in detail below.

According to a second aspect of the invention, an apparatus 200 is provided for receiving one or more input video data streams. Input video is encoded into each of one or more input video data streams. The apparatus 200 is configured to generate an output video data stream from one or more input video data streams, the output video data stream encoding the output video, and the apparatus converting the output video into the one or more input video data streams. or the output video depends on at least one of the one or more input video data streams. configured to generate Further, the apparatus 200 is configured to determine an access unit removal time of a current picture of the plurality of pictures of the output video from the coded picture buffer. Apparatus 200 is configured to determine whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer.

According to one embodiment, the apparatus 200, for example, converts groups of one or more pictures of the input video of the first video data stream of the one or more input video data streams to generate the output video data stream. It can be configured to drop. Apparatus 200 may be configured to determine an access unit removal time for at least one of a plurality of pictures of an output video from a coded picture buffer, eg, depending on coded picture buffer delay offset information.

In one embodiment, the first video received by device 200 is, for example, a preprocessed video resulting from an original video in which one or more groups of pictures have been dropped to produce the preprocessed video. may be Apparatus 200 may be configured to determine an access unit removal time for at least one of a plurality of pictures of an output video from a coded picture buffer, eg, depending on coded picture buffer delay offset information.

According to one embodiment, the buffer delay offset information depends on the number of dropped pictures of the input video.

In one embodiment, the one or more input video data streams are two or more input video data streams. The apparatus 200 may be configured, for example, to splice the processed video and the input video of a second one of the two or more input video data streams to obtain an output video, For example, it can be configured to encode the output video into an output video data stream.

According to one embodiment, the apparatus 200 uses coded picture buffer delay offset information to determine the access unit removal time of the current picture, e.g. depending on the position of the current picture in the output video. can be configured to determine whether Alternatively, the apparatus 200 may use the coded picture buffer delay offset value of the coded picture buffer delay offset information to determine the access unit removal time of the current picture, e.g., depending on the position of the current picture in the output video. should be set to zero.

In one embodiment, the apparatus 200 uses the coded picture to determine the access unit removal time for the current picture, e.g., depending on the position of the previous non-discardable picture that precedes the current picture in the output video. It may be configured to determine whether to use buffer delay offset information.

According to one embodiment, the apparatus 200 determines whether the previous non-discardable picture preceding the current picture in the output video can be, for example, the first picture in the previous buffering period. depending on whether to use the coded picture buffer delay offset information to determine the access unit removal time for the current picture.

In one embodiment, the apparatus 200 is configured to determine whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture, for example depending on the concatenation flag. and the current picture is the first picture of the input video of the second video data stream.

According to an embodiment, the apparatus 200 may be configured, for example, to determine the access unit removal time of the current picture according to the removal time of the preceding picture.

In one embodiment, the apparatus 200 may be configured to determine the access unit removal time for the current picture, for example, depending on the initial coded picture buffer removal delay information.

According to one embodiment, the apparatus 200 performs the initial encoding depending on clock ticks, for example, to obtain temporary coded picture buffer removal delay information to determine the access unit removal time of the current picture. It may be configured to update picture buffer removal delay information.

According to one embodiment, if the concatenation flag is set to a first value, the apparatus 200 is configured to determine one or more removal times using the coded picture buffer delay offset information. If the concatenation flag is set to a second value different from the first value, the apparatus 200 is configured not to use the coded picture buffer delay offset information to determine one or more removal times. .

In one embodiment, the apparatus 200 signals the video decoder 300 whether to use the coded picture buffer delay offset information, for example, to determine the access unit removal time of the current picture from the coded picture buffer. can be configured to

According to one embodiment, the current picture may be placed at the splicing point of the output video, for example two input videos spliced together.

Additionally, a video data stream is provided. The video is encoded in this video data stream. The video data stream contains coded picture buffer delay offset information.

According to one embodiment, the video data stream may include, for example, concatenation flags.

In one embodiment, the video data stream may include, for example, initial coded picture buffer removal delay information.

According to one embodiment, if the concatenated flag is set to a first value (eg, 0), the concatenated flag indicates, for example, that some pictures (eg, RASL photos) were known to be dropped. , the coded picture buffer delay offset information should be used to determine one or more (picture or access unit) removal times. If the concatenated flag is set to a second value (eg, 1) different from the first value, the concatenated flag indicates, eg, regardless of offset signaling and, eg, whether a RASL picture has been dropped. indicates that the specified offset is not used to determine one or more (picture or access unit) removal times. If no pictures are dropped, for example, no offset is used.

Additionally, a video encoder 100 is provided. Video encoder 100 is configured to encode video into a video data stream. Video encoder 100 is configured to generate a video data stream such that the video data stream includes encoded picture buffer delay offset information.

According to one embodiment, video encoder 100 may be configured to generate a video data stream, eg, such that the video data stream may include, eg, concatenation flags.

In one embodiment, video encoder 100 may be configured to generate a video data stream, eg, such that the video data stream may include, eg, encoded picture buffer delay offset information.

A video decoder 300 is also provided for receiving a video data stream containing video. Video decoder 300 is configured to decode video from a video data stream. Further, the video decoder 300 is configured to decode the video according to the access unit removal time of the current picture of the multiple pictures of the video from the coded picture buffer. The video decoder 300 is configured to decode the video in response to an indication of whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer. be done.

According to one embodiment, the access unit removal time for at least one of the pictures of the video from the coded picture buffer depends on the coded picture buffer delay offset information.

In one embodiment, video decoder 300 may or may not use coded picture buffer delay offset information to determine the access unit removal time for the current picture as a function of the position of the current picture within the video. configured to decode video;

According to one embodiment, the video decoder 300 may, for example, decode the video depending on whether the coded picture buffer delay offset value in the coded picture buffer delay offset information may be set to 0, for example. can be configured to

In one embodiment, video decoder 300 uses the coded picture to determine the access unit removal time for the current picture, e.g., depending on the position of the previous non-discardable picture that precedes the current picture in the video. It may be configured to determine whether to use buffer delay offset information.

According to one embodiment, video decoder 300 determines whether the previous non-discardable picture preceding the current picture in the video may, for example, be the first picture in the previous buffering period. Accordingly, it may be configured to determine whether to use the coded picture buffer delay offset information to determine the access unit removal time for the current picture.

In one embodiment, video decoder 300 is configured to determine whether to use coded picture buffer delay offset information to determine the access unit removal time for the current picture, eg, depending on the concatenation flag. and the current picture is the first picture of the input video of the second video data stream.

According to one embodiment, the video decoder 300 may be configured to determine the access unit removal time of the current picture depending on the removal time of the previous picture, for example.

In one embodiment, video decoder 300 may be configured, for example, to determine the access unit removal time for the current picture as a function of initial coded picture buffer removal delay information.

According to one embodiment, video decoder 300 may, for example, generate an initial code in response to clock ticks to obtain temporary coded picture buffer removal delay information to determine access unit removal time for the current picture. may be configured to update the normalized picture buffer removal delay information.

According to one embodiment, if the concatenation flag is set to a first value, video decoder 300 is configured to determine one or more removal times using coded picture buffer delay offset information. be. If the concatenation flag is set to a second value different than the first value, video decoder 300 is configured not to use the coded picture buffer delay offset information to determine one or more removal times. be.

Further, a system is provided. The system comprises an apparatus 200 as previously described and a video decoder 300 as previously described. Video decoder 300 is configured to receive the output video data stream of device 200 . Further, video decoder 300 is configured to decode video from the output video data stream of device 200 .

According to one embodiment, the system may further comprise a video encoder 100, for example. Apparatus 200 may, for example, be configured to receive a video data stream from video encoder 100 as an input video data stream.

In particular, the second aspect of the present invention is that prevNonDiscardable for alternative timings may already contain an alternative offset (CpbDelayOffset) (if it is not the BP start), so for AUs with congestion_flag==1, CpbDelayOffset should be set to 0 in time.

When splicing of two bitstreams occurs, the derivation of the AU removal time from the CPB is done differently than for non-spliced bitstreams. At the splicing point, the buffering period SEI message (BP SEI message; SEI=supplemental enhancement information) contains a condensationFlag equal to one. Then the decoder should check the two values and take the larger of both:
- previous non-discardable Pic (prevNonDiscardablePic) removal time + delta signaled in BP SEI message (auCpbRemovalDelayDeltaMinus1 + 1), or - preceding Pic removal time + InitCpbRemovalDelay

However, previous Pics with BP SEI messages indicated that alternate timing was used for the derivation of the removal time AU (i.e. the second timing information used when RASL pictures or pictures up to DRAP were dropped). ), then an offset is used (CpbDelayOffset) to calculate each removal time as a delta relative to the previous Pic with buffering period, i. Calculated.

FIG. 4 shows the original bitstream (top of FIG. 4) and the bitstream after dropping pictures (bottom of FIG. 4). Incorporate the offset into the calculation of the removal delay after dropping the AU (lines 1, 2, and 3 in the original bitstream).

Since the removal time is calculated using the delta to the removal time of the picture called firstPicInPrevBuffPeriod, an offset is added and then some AUs are dropped, so CpbDelayOffset is changed to account for (compensate for) the AU drop. is necessary.

FIG. 5 shows the first bitstream (middle left in FIG. 5) and the second bitstream (middle left in FIG. 5) after pictures have been dropped from the original first bitstream (middle left in FIG. 5). 5 middle, middle, right) shows the splicing of the two bitstreams (at different positions).

An example of using the previous Pic removal time instead of the previous non-discardable picture as an anchor is similar and does not require a '-3' correction factor (CpbDelayOffset) either.

However, for splicing as shown in FIG. 5, the two derivatives do not necessarily use the AU removal time (firstPicInPrevBuffPeriod) associated with the BP SEI message. As described, for splicing, a delta is added to either the prevNonDiscardablePic or the previous Pic. This is because if prevNonDiscardablePic is not firstPicInPrevBuffPeriod, CpbDelayOffset is used to get the current It means that the removal time cannot be derived from the AU's CPB. Here, similar to if the current AU (i.e. the splicing point with the new BP SEI message) has an InitialCpbRemovalDelay that forces the current AU's removal time after the desired removal time, the preceding Pic removal time is instead Assuming it is used, equidistant removal times are achieved (if prevNonDiscardablePic is used instead). In such cases, the current AU's removal time cannot be less than the time calculated using the preceding Pic removal time plus InitCpbRemovalDelay. This is because it can lead to buffer underruns (AUs not in the buffer before they need to be removed). Therefore, as part of the present invention, CpbDelayOffset is either not used in the calculation or is considered equal to 0 in this case.

To summarize the embodiments herein, when RASL AUs are dropped from the bitstream, or when AUs between IRAP AUs and DRAP AUs are dropped depending on the check, for AU removal time calculation One is to use CpbDelayOffset. A check to determine if CpbDelayOffset is not used or is considered equal to 0 is one of the following.
prevNonDiscardablePic is not firstPicInPrevBuffPeriod Preceding Pic removal time + InitCpbRemovalDelay is used to calculate removal of current AU

Implementations herein may be as follows.
– If AU n is the first AU of a BP that does not initialize the HRD, the following applies.
The nominal removal time of AU n from the CPB is specified by:
if(!concatenationFlag){
baseTime = AuNominalRemovalTime[firstPicInPrevBuffPeriod]
tmpCpbRemovalDelay = AuCpbRemovalDelayVal
tmpCpbDelayOffset = CpbDelayOffset
}else{
baseTime1 = AuNominalRemovalTime[prevNonDiscardablePic]
tmpCpbRemovalDelay1 = (auCpbRemovalDelayDeltaMinus1+1)
baseTime2 = AuNominalRemovalTime[n-1]
tmpCpbRemovalDelay2 = (C.10)
Ceil((InitCpbRemovalDelay[Htid][ScIdx]÷90000+
AuFinalArrivalTime[n-1]-AuNominalRemovalTime[n-1])÷ClockTick)
if(baseTime1+ClockTick*tmpCpbRemovalDelay1<
baseTime2+ClockTick*tmpCpbRemovalDelay2){
baseTime = baseTime2
tmpCpbRemovalDelay = tmpCpbRemovalDelay2
tmpCpbDelayOffset = 0
}else{
baseTime = baseTime1
tmpCpbRemovalDelay = tmpCpbRemovalDelay1
tmpCpbDelayOffset = ((prevNonDiscardablePic =
= firstPicInPrevBuffPeriod)?CpbDelayOffset:0)
}
}
AuNominalRemovalTime[n] =
baseTime+(ClockTick*tmpCpbRemovalDelay-tmpCpbDelayOffset
)

Alternatively, in another embodiment shown in FIG. 6, the AU removal time when RASL AUs are dropped from the bitstream, or the time between IRAP AUs and DRAP AUs, depending on different checks, including checking the condensationFlag. CpbDelayOffset for calculating the AU removal time when an AU is dropped.

In that case, the deltas in the bitstream when the concatenationFlag is set to 1 were considered CpbDelayOffset because CpbDelayOffset does not apply to that shape or is not considered to be 0 (FIGS. 5 and 5). As can be seen by comparing 6, it is necessary to match the appropriate value as ).

Implementations herein may be as follows.
– If AU n is the first AU of a BP that does not initialize the HRD, the following applies.
The nominal removal time of AU n from the CPB is specified by:
if(!concatenationFlag){
baseTime = AuNominalRemovalTime[firstPicInPrevBuffPeriod]
tmpCpbRemovalDelay = AuCpbRemovalDelayVal
tmpCpbDelayOffset = CpbDelayOffset
}else{
baseTime1 = AuNominalRemovalTime[prevNonDiscardablePic]
tmpCpbRemovalDelay1 = (auCpbRemovalDelayDeltaMinus1+1)
baseTime2 = AuNominalRemovalTime[n-1]
tmpCpbRemovalDelay2 = (C.10)
Ceil((InitCpbRemovalDelay[Htid][ScIdx]÷90000+

AuFinalArrivalTime[n-1]-AuNominalRemovalTime[n-1])÷ClockTick)
if(baseTime1+ClockTick*tmpCpbRemovalDelay1<
baseTime2+ClockTick*tmpCpbRemovalDelay2){
baseTime = baseTime2
tmpCpbRemovalDelay = tmpCpbRemovalDelay2
}else{
baseTime = baseTime1
tmpCpbRemovalDelay = tmpCpbRemovalDelay1
}
tmpCpbDelayOffset = 0
}
AuNominalRemovalTime[n] =
baseTime+(ClockTick*tmpCpbRemovalDelay-tmpCpbDelayOffset

The third aspect of the present invention will be described in detail below.

According to a third aspect of the invention, a video data stream is provided. The video is encoded in this video data stream. Additionally, the video data stream includes an initial coded picture buffer removal delay. Additionally, the video data stream includes an initial coded picture buffer removal offset. Additionally, the video data stream includes information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods.

According to one embodiment, the initial coded picture buffer removal delay elapses before sending the first access unit of a picture of a video data stream initializing video decoder 300 to video decoder 300, for example. You can indicate the time you need to

In one embodiment, a video data stream may be defined such that, for example, the sum of an initial coded picture buffer removal delay and an initial coded picture buffer removal offset is constant over, for example, two or more buffering periods. A single indication can be included that can indicate whether or not.

According to one embodiment, the video data stream is defined such that, for example, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over, for example, two or more buffering periods. For example, it can include a concatenation flag as a single indication. If the concatenated flag is equal to the first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. If the concatenation flag is different than the first value, the concatenation flag defines whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. do not.

In one embodiment, if no single indication indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods, A video data stream may include, for example, continuously updated information regarding initial coded picture buffer removal delay information and continuously updated information regarding initial coded picture buffer removal offset information.

According to one embodiment, information indicating that the video data stream is defined such that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. , the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may be defined to be constant, eg, starting from the current position within the video data stream.

A video encoder 100 is also provided. Video encoder 100 is configured to encode video into a video data stream. Additionally, video encoder 100 is configured to generate the video data stream such that the video data stream includes the initial encoded picture buffer removal delay. Additionally, video encoder 100 is configured to generate the video data stream such that the video data stream includes the initial coded picture buffer removal offset. Additionally, video encoder 100 determines whether the video data stream is defined such that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. A video data stream is configured to generate the video data stream to include the information indicated.

According to one embodiment, the initial coded picture buffer removal delay elapses before sending the first access unit of a picture of a video data stream initializing video decoder 300 to video decoder 300, for example. You can indicate the time you need to

In one embodiment, the video encoder 100, for example, determines that the video data stream is such that, for example, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant, for example, over two or more buffering periods. may be configured to generate a video data stream such that it may include a single indication that may indicate whether or not it may be defined as

According to one embodiment, video encoder 100 may be configured to generate a video data stream, eg, such that the video data stream may comprise concatenated flags, eg, as a single representation. A concatenation flag may, for example, indicate whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset may be defined as constant over, for example, two or more buffering periods. If the concatenated flag is equal to the first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. If the concatenation flag is different than the first value, the concatenation flag defines whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. do not.

In one embodiment, if no single indication indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods, Video encoder 100 may, for example, determine that the video data stream includes, for example, continuously updated information regarding initial coded picture buffer removal delay information and continuously updated information regarding initial coded picture buffer removal offset information. can be configured to generate a video data stream such that

According to one embodiment, the video data stream is defined such that, for example, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. With the information that can be indicated, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant starting from the current position within the video data stream.

Further, an apparatus 200 is provided for receiving two input video data streams, a first input video data stream and a second input video data stream. An input video is encoded into each of the two input video data streams. The apparatus 200 is configured to generate an output video data stream from two input video data streams, the output video data stream encoding the output video, the apparatus generating a first input video data stream and a second input video data stream. and to generate an output video data stream. Further, the apparatus 200 is configured to generate the output video data stream such that the output video data stream includes the initial coded picture buffer removal delay. Further, the apparatus 200 is configured to generate the output video data stream such that the output video data stream includes the initial coded picture buffer removal offset. Further, the apparatus 200 determines whether the output video data stream is defined such that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. is configured to generate an output video data stream to include the information indicated.

According to one embodiment, the initial coded picture buffer removal delay is, e.g. You can indicate how much time should elapse.

In one embodiment, the apparatus 200 is configured such that the output video data stream is such that, for example, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant, for example, over two or more buffering periods. may be configured to generate an output video data stream such that it may include a single indication that may indicate whether or not it may be defined as .

According to one embodiment, the apparatus 200 is configured such that the output video data stream is such that the output video data stream, e.g., the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset, e.g. The output video data stream may be configured to include, for example, a concatenation flag as a single indication, which may indicate whether or not it may be defined as constant over time. If the concatenated flag is equal to the first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. If the concatenation flag is different than the first value, the concatenation flag defines whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. do not.

In one embodiment, if no single indication indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods, Apparatus 200 processes the output video data such that the output video data stream includes continuously updated information regarding the initial coded picture buffer removal delay information and continuously updated information regarding the initial coded picture buffer removal offset information. Configured to generate streams.

According to one embodiment, information indicating that the video data stream is defined such that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. , the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant starting from the current position within the video data stream.

A video decoder 300 is also provided for receiving a video data stream containing video. Video decoder 300 is configured to decode video from a video data stream. Additionally, the video data stream includes an initial coded picture buffer removal delay. Additionally, the video data stream includes an initial coded picture buffer removal offset. Additionally, the video data stream includes information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. Video decoder 300 may also determine whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over multiple buffering periods. and is configured to decode the video.

According to one embodiment, the initial coded picture buffer removal delay is, e.g. You can indicate how much time should elapse.

In one embodiment, a video data stream may be defined such that, for example, the sum of an initial coded picture buffer removal delay and an initial coded picture buffer removal offset is constant over, for example, two or more buffering periods. A single indication can be included that can indicate whether or not. Video decoder 300 may be configured, for example, to decode video according to a single presentation.

According to one embodiment, the video data stream is defined such that, for example, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over, for example, two or more buffering periods. For example, it can include a concatenation flag as a single indication. If the concatenated flag is equal to the first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. If the concatenation flag is different than the first value, the concatenation flag defines whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. do not. Video decoder 300 is configured to decode the video in response to the concatenation flag.

In one embodiment, if no single indication indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. , the video data stream includes continuously updated information on initial coded picture buffer removal delay information and continuously updated information on initial coded picture buffer removal offset information. Video decoder 300 is configured to decode video in response to continuously updated information regarding initial coded picture buffer removal delay information and continuously updated information regarding initial coded picture buffer removal offset information. be.

According to one embodiment, information indicating that the video data stream is defined such that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over two or more buffering periods. , the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant starting from the current position within the video data stream.

Further, a system is provided. The system comprises an apparatus 200 as previously described and a video decoder 300 as previously described. Video decoder 300 is configured to receive the output video data stream of device 200 . Further, video decoder 300 is configured to decode video from the output video data stream of device 200 .

According to one embodiment, the system may further comprise a video encoder 100, for example. The apparatus 200 according to any one of aspects 221-226, for example configured to receive a video data stream as an input video data stream from the video encoder 100 according to any one of aspects 211-216. can be done.

In particular, the third aspect of the invention relates to splicing, initial Cpb removal delay and initial Cpb removal offset.

Presently, this specification shows that the sum of the initial Cpb removal delay and the initial Cpb removal offset is constant within the CVS. Similar constraints are expressed for alternative timings. The initial Cpb removal delay indicates the time that must elapse for the first AU in the bitstream to initialize the decoder before sending the first AU for decoding. The initial Cpb removal offset is a bitstream property that means that the earliest arrival time of an AU at the decoder is not necessarily equidistant to time 0 when the first AU arrives at the decoder. This helps determine when the first bit of the AU can reach the decoder earliest.

Current constraints in the VVC draft specification dictate that the sum of these two values must be constant within CVS.
Across CVS, for each value pair of i and j, the sum of nal_initial_cpb_removal_delay[i][j] and nal_initial_cpb_removal_offset[i][j] is constant, and nal_initial_alt_cpb_removal_delay[i][j] and nal_initial_ alt_cpb_removal_offset[i][j ] is constant.

This problem appears when editing or splicing bitstreams to form a new joint bitstream. It is also desirable to be able to indicate whether this property is satisfied across the CVS boundaries of the bitstream, as having different values of the sum can cause buffer underruns or overflows.

Thus, in one embodiment, from some point in the bitstream (e.g., a splicing point), the value constraint on the constant sum of InitCpbRemovalDelay and InitCpbRemovalDelayOffset is reset to indicate that the sum before and after the point in the bitstream may be different. is carried in the bitstream. The sum remains constant as long as this indication is not present in the bitstream.

for example,
When the concatenationFlag is equal to 0, the bitstream conformance constraint is that the sum of InitCpbRemovalDelay and InitCpbRemovalDelayOffset be constant over the buffering period.

Otherwise, the sum of InitCpbRemovalDelay and InitCpbRemovalDelayOffset need not be constant over the buffering period. The values of InitCpbRemovalDelay and InitCpbRemovalDelayOffset are updated to take into account the arrival time.

In one embodiment, if several bitstreams are spliced, at each splicing point a concatenation flag can define, for example, whether the sum remains constant or not.

The fourth aspect of the present invention will be described in detail below.

According to a fourth aspect of the invention, a video data stream is provided. The video is encoded in this video data stream. Further, the video data stream includes scalable non-nested picture timing of network abstraction layer units of one access unit of a plurality of access units of one encoded video sequence of one or more encoded video sequences of the video data stream. including an indication (eg, general_same_pic_timing_in_all_ols_flag) indicating whether the supplemental enhancement information message is defined to apply to all output layer sets of the multiple output layer sets of the access unit. If the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit outputs all outputs of the access unit's multiple output layer sets. Defined to apply to layer sets. If an indication (eg, general_same_pic_timing_in_all_ols_flag) has a different value than a first value, then an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit has multiple It does not define whether it applies to all output layer sets in the output layer set.

According to one embodiment, for example, if the indication (eg general_same_pic_timing_in_all_ols_flag) has a first value, the network abstraction layer unit does not contain other supplemental enhancement information messages different from picture timing supplemental enhancement information messages. .

In one embodiment, for example, if the indication (eg general_same_pic_timing_in_all_ols_flag) has a first value, the network abstraction layer unit does not include any other supplemental enhancement information messages.

According to one embodiment, for example, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, for each access unit of a plurality of access units of one encoded video sequence of one or more encoded video sequences, for each network abstraction layer unit containing a scalable non-nested picture timing supplemental enhancement information message, said network abstraction layer unit does not contain any other supplemental enhancement information message different from the picture timing supplemental enhancement information message; or does not contain any other Supplemental Extension Information messages.

In one embodiment, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, scalable non-nested picture timing for each access unit of each of the plurality of access units of one or more encoded video sequences of the video data stream. For each network abstraction layer unit containing a supplemental enhancement information message, said network abstraction layer unit does not contain any other supplemental enhancement information message different from the picture timing supplemental enhancement information message or any other supplemental enhancement information message. It also does not contain extended information messages.

Further, for example, a video encoder 100 may be provided. Video encoder 100 is configured to encode video into a video data stream. Furthermore, the video encoder 100 is configured such that the video data stream is a network abstraction layer unit of one access unit among a plurality of access units of one encoded video sequence of one or more encoded video sequences of the video data stream. To include an indication (e.g., general_same_pic_timing_in_all_ols_flag) indicating whether a scalable non-nested picture timing supplemental enhancement information message is defined to apply to all output layer sets of the multiple output layer sets of the access unit. , configured to generate a video data stream. If the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit outputs all outputs of the access unit's multiple output layer sets. Defined to apply to layer sets. If an indication (eg, general_same_pic_timing_in_all_ols_flag) has a different value than a first value, then an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit has multiple It does not define whether it applies to all output layer sets in the output layer set.

According to one embodiment, for example, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, video encoder 100 determines that the network abstraction layer unit is any other supplemental enhancement information message that differs from the picture timing supplemental enhancement information message. It is configured to generate the video data stream such that it also does not contain extended information messages.

In one embodiment, for example, if an indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, video encoder 100 controls the video data stream such that the network abstraction layer unit does not contain any other supplemental enhancement information messages. is configured to generate

According to one embodiment, for example, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, video encoder 100 may perform multiple accesses of one encoded video sequence, eg, one or more encoded video sequences. For each network abstraction layer unit containing a non-scalable nested picture timing supplemental enhancement information message, for each access unit of the unit, said network abstraction layer unit contains any other supplemental information different from the picture timing supplemental enhancement information message. It may be configured to generate the video data stream without the extended information message or without any other supplemental extended information message.

In one embodiment, for example, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, video encoder 100 may, for example, control each of the multiple access units of each of the one or more encoded video sequences of the video data stream. For each network abstraction layer unit containing a non-scalable nested picture timing supplemental enhancement information message of an access unit, said network abstraction layer unit contains another supplemental enhancement information message different from the picture timing supplemental enhancement information message. , or without any other supplemental enhancement information messages.

Additionally, an apparatus 200 is provided for receiving an input video data stream. The input video data stream contains encoded video. Apparatus 200 is configured to generate a processed video data stream from an input video data stream. Furthermore, the apparatus 200 performs scalable non-nested pictures of network abstraction layer units of one access unit of a plurality of access units of one encoded video sequence of one or more encoded video sequences of the processed video data stream. The processed video data stream includes an indication (e.g., general_same_pic_timing_in_all_ols_flag) indicating whether the timing supplemental enhancement information message is defined to apply to all output layer sets of the plurality of output layer sets of the access unit. so as to generate a processed video data stream. If the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit outputs all outputs of the access unit's multiple output layer sets. Defined to apply to layer sets. If an indication (eg, general_same_pic_timing_in_all_ols_flag) has a different value than a first value, then an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit has multiple It does not define whether it applies to all output layer sets in the output layer set.

According to one embodiment, for example, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, the apparatus 200 detects any other supplemental enhancement information that the network abstraction layer unit is different from the picture timing supplemental enhancement information message. It is configured to generate a processed video data stream that also contains no messages.

In one embodiment, for example, if an indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, apparatus 200 performs processing of the processed video data stream such that said network abstraction layer unit does not contain other supplemental enhancement information messages. is configured to generate

According to an embodiment, for example, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, the apparatus 200 may control multiple access units of one encoded video sequence of one or more encoded video sequences, for example. for each network abstraction layer unit containing a non-scalable nested picture timing supplemental enhancement information message for each access unit in It can be configured to generate the processed video data stream without information messages or without any other supplemental enhancement information messages.

In one embodiment, for example, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, the apparatus 200 may, for example, determine the number of access units for each of the one or more encoded video sequences of the processed video data stream. For each network abstraction layer unit containing a non-scalable nested picture timing supplemental enhancement information message, for each access unit, said network abstraction layer unit contains any other supplemental enhancement information different from the picture timing supplemental enhancement information message. It can be configured to generate the processed video data stream without messages or without any other supplemental enhancement information messages.

Additionally, a video decoder 300 is provided for receiving a video data stream containing video. Video decoder 300 is configured to decode video from a video data stream. A video data stream is a scalable non-nested picture timing supplemental extension of a network abstraction layer unit of one of a plurality of access units of a plurality of access units of a coded video sequence of one or more coded video sequences of the video data stream. An indication (eg, general_same_pic_timing_in_all_ols_flag) indicating whether the information message is defined to apply to all output layer sets of the plurality of output layer sets of the access unit. If the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, then the network abstraction layer unit scalable non-nested picture timing supplemental enhancement information message of the access unit outputs all outputs of the access unit's multiple output layer sets. Defined to apply to layer sets. If an indication (eg, general_same_pic_timing_in_all_ols_flag) has a different value than a first value, then an indication is that the network abstraction layer unit's scalable non-nested picture timing supplemental enhancement information message of the access unit has multiple It does not define whether it applies to all output layer sets in the output layer set. Video decoder 300 is configured to decode the video in response to said representation.

According to one embodiment, for example, if the indication (eg general_same_pic_timing_in_all_ols_flag) has a first value, the network abstraction layer unit does not contain other supplemental enhancement information messages different from picture timing supplemental enhancement information messages. .

In one embodiment, for example, if the indication (eg general_same_pic_timing_in_all_ols_flag) has a first value, the network abstraction layer unit does not include any other supplemental enhancement information messages. Video decoder 300 is configured to decode the video in response to said representation.

According to one embodiment, for example, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, for each access unit of a plurality of access units of one encoded video sequence of one or more encoded video sequences, for each network abstraction layer unit containing a scalable non-nested picture timing supplemental enhancement information message, said network abstraction layer unit does not contain any other supplemental enhancement information message different from the picture timing supplemental enhancement information message; or does not contain any other Supplemental Extension Information messages.

In one embodiment, for example, if the indication (eg, general_same_pic_timing_in_all_ols_flag) has a first value, the scalable non-nested For each network abstraction layer unit containing a picture timing supplemental enhancement information message, said network abstraction layer unit does not contain any other supplemental enhancement information message different from the picture timing supplemental enhancement information message, or any other Supplementary extended information messages are also not included.

Further, a system is provided. The system comprises an apparatus 200 as previously described and a video decoder 300 as previously described. Video decoder 300 is configured to receive the processed video data stream of device 200 . Further, video decoder 300 is configured to decode video from the output video data stream of device 200 .

According to one embodiment, the system may further comprise a video encoder 100, for example. Apparatus 200 may, for example, be configured to receive a video data stream from video encoder 100 as an input video data stream.

In particular, the fourth aspect of the present invention relates to constraining PT SEIs from being paired with other HRD SEIs when general_same_pic_timing_in_all_ols_flag is equal to one.

The VVC draft specification includes a flag called general_same_pic_timing_in_all_ols_flag in the general HRD parameter structure with the following semantics. i.e.
general_same_pic_timing_in_all_ols_flag equal to 1 specifies that scalable non-nested PT SEI messages in each AU apply to AUs of any OLS in the bitstream and there are no scalable nested PT SEI messages. general_same_pic_timing_in_all_ols_flag equal to 0 indicates that the scalable non-nested PT SEI messages in each AU may or may not apply to any OLS AU in the bitstream, and if scalable nested PT SEI messages are present Also specify that

In general, when an OLS sub-bitstream is extracted from the original bitstream (including OLS and non-OLS data), the buffering period, picture timing, and decoding units encapsulated in a so-called scalable nested SEI message The corresponding HRD related timing/buffer information of the target OLS in the form of information SEI messages is decapsulated. This decapsulated SEI message is then used to replace the scalable non-nested HRD SEI information in the original bitstream. However, in many scenarios, the content of some messages, such as picture timing SEI messages, may remain the same when a layer is dropped, i.e. dropped from one OLS to its subset. So general_same_pic_timing_in_all_ols_flag provides a shortcut so that only BP and DUI SEI messages are replaced, but PT SEI in the original bitstream can remain valid, i.e. during extraction when general_same_pic_timing_in_all_ols_flag is equal to 1 not removed by Therefore, there is no need to encapsulate replacement PT SEI messages in scalable nested SEI messages that carry replacement BP and DUI SEI messages, and no bitrate overhead is introduced for this information.

However, in the state of the art, PT SEI messages are allowed to be carried within one SEI NAL unit (NAL unit = network abstraction layer unit) together with other HRD SEI messages, i.e. BP, PT and SEI messages may all be encapsulated within the same Prefix SEI NAL unit. Therefore, the extractor has to examine such SEI NAL units more deeply in order to understand the contained messages, and only one of the contained messages (PT) is retained during the extraction procedure. If it should, then we actually need to rewrite the show SEI NAL units (ie remove non-PT SEI messages). To avoid this cumbersome low-level processing and allow the extractor to operate entirely on the non-parameter set part of the bitstream at the NAL unit level, bitstream constraints permit such bitstream construction. Not doing so is part of the invention. In one embodiment, the constraints are expressed as follows. i.e.
general_same_pic_timing_in_all_ols_flag equal to 1 specifies that scalable non-nested PT SEI messages in each AU apply to AUs of any OLS in the bitstream and there are no scalable nested PT SEI messages. general_same_pic_timing_in_all_ols_flag equal to 0 indicates that the scalable non-nested PT SEI messages in each AU may or may not apply to any OLS AU in the bitstream, and if scalable nested PT SEI messages are present to specify that When general_same_pic_timing_in_all_ols_flag is equal to 1, all general SEI messages in the bitstream that contain SEI messages (Picture Timing) with payload_type equal to 1 do not contain SEI messages with payload_type not equal to 1. constraints.

The fifth aspect of the present invention will be described in detail below.

According to a fifth aspect of the invention, a video data stream is provided. The video is encoded in this video data stream. Additionally, the video data stream includes one or more scalable nested Supplemental Enhancement Information messages. One or more scalable nested supplemental extension information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size in each of the video data stream or the scalable nested supplemental enhancement information messages of the part of the video data stream. Defined.

According to one embodiment, a video data stream may include, for example, one or more scalable non-nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements, in each scalable nested Supplemental Enhancement Information message of the video data stream or part of the video data stream, and It is defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages that are part of the video data stream.

In one embodiment, a video data stream may, for example, comprise a plurality of access units, each access unit of the plurality of access units being assigned to, for example, one of a plurality of pictures of the video. A portion of the video data stream may be, for example, an access unit of a plurality of access units of the video data stream. Each syntax element of one or more syntax elements of the plurality of syntax elements may be defined, for example, to have the same size in each of the scalable nested supplemental enhancement information messages of the access unit.

According to one embodiment, a video data stream may include, for example, one or more scalable non-nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements, e.g. can be defined to have the same size.

In one embodiment, the portion of the video data stream may be, for example, an encoded video sequence of the video data stream. Each syntax element of one or more syntax elements of the plurality of syntax elements may be defined to have the same size in each of the scalable nested supplemental enhancement information messages of the encoded video sequence, for example.

According to one embodiment, a video data stream may include, for example, one or more scalable non-nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements, e.g., in each scalable nested supplemental enhancement information message of the encoded video sequence and not scalable nested of the encoded video sequence It may be defined to have the same size in each of the Supplemental Extension Information messages.

In one embodiment, each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size, e.g., in each of the scalable nested supplemental enhancement information messages of the video data stream. can be defined.

According to one embodiment, each syntax element of the one or more syntax elements of the plurality of syntax elements, for example, in each scalable nested supplemental enhancement information message of the video data stream and the video data It may be defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of a stream.

In one embodiment, a video data stream or part of a video data stream may for example comprise at least one buffering period supplemental enhancement information message, said buffering period supplemental enhancement information message comprising a plurality of syntax elements defines the size of each syntax element for one or more syntax elements in .

According to one embodiment, the buffering period supplemental extension information message defines a size for each syntax element of one or more syntax elements of the plurality of syntax elements,
bp_cpb_initial_removal_delay_length_minus1 element;
bp_cpb_removal_delay_length_minus1 element,
bp_dpb_output_delay_length_minus1 element,
bp_du_cpb_removal_delay_increment_length_minus1 element,
bp_dpb_output_delay_du_length_minus1 element.

In one embodiment, for each access unit of a plurality of access units of a video data stream comprising a scalable nested buffering period supplemental extension information message, said access unit for example includes a scalable non-nested buffering period supplemental extension Informational messages can also be included.

According to one embodiment, for each single layer access unit of a plurality of single layer access units of a video data stream comprising a scalable nested buffering period supplemental enhancement information message, said single layer access unit is for example: A scalable non-nested buffering period supplemental extension information message may also be included.

A video encoder 100 is also provided. Video encoder 100 is configured to encode video into a video data stream. Further, video encoder 100 is configured to generate the video data stream such that the video data stream comprises one or more scalable nested supplemental enhancement information messages. Further, video encoder 100 is configured to generate this video data stream such that one or more scalable nested supplemental enhancement information messages include multiple syntax elements. Further, the video encoder 100 may determine that each syntax element of one or more syntax elements of the plurality of syntax elements is scalable nested supplemental extension information of the video data stream or part of the video data stream. It is configured to generate a video data stream, defined to have the same size in each of the messages.

According to one embodiment, video encoder 100 may be configured to generate a video data stream such that, for example, the video data stream may comprise one or more scalable non-nested supplemental enhancement information messages. Video encoder 100 may generate the video data stream such that, for example, one or more scalable nested supplemental enhancement information messages and one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. can be configured to Video encoder 100 may, for example, determine that each syntax element of one or more syntax elements of the plurality of syntax elements is, for example, a scalable nested supplemental enhancement information message of a video data stream or part of a video data stream. and in each of the scalable non-nested Supplemental Enhancement Information messages of the video data stream or part of the video data stream may be defined to have the same size.

In one embodiment, video encoder 100 may be configured to generate a video data stream such that, for example, a video data stream may include, for example, multiple access units, each of the multiple access units. An access unit may, for example, be assigned to one of multiple pictures of a video. A portion of the video data stream may be, for example, an access unit of a plurality of access units of the video data stream. Video encoder 100 assumes, for example, that each syntax element of one or more syntax elements of the plurality of syntax elements has the same size, for example, in each of the scalable nested supplemental enhancement information messages of the access unit. As defined, it may be configured to generate a video data stream.

According to one embodiment, video encoder 100 may be configured to generate a video data stream such that, for example, the video data stream may comprise one or more scalable non-nested supplemental enhancement information messages. Video encoder 100 may generate the video data stream such that, for example, one or more scalable nested supplemental enhancement information messages and one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. can be configured to Video encoder 100, for example, each syntax element of one or more syntax elements of the plurality of syntax elements, for example, in each of the scalable nested supplemental enhancement information messages of the access unit and It may be configured to generate a video data stream such that in each of the scalable non-nested Supplemental Enhancement Information messages may be defined to have the same size.

In one embodiment, the portion of the video data stream may be, for example, an encoded video sequence of the video data stream. Video encoder 100 may, for example, ensure that each syntax element of one or more of the plurality of syntax elements has the same size, for example, in each of the scalable nested supplemental enhancement information messages of the encoded video sequence. may be configured to generate a video data stream as defined to have;

According to one embodiment, video encoder 100 may be configured to generate a video data stream such that, for example, the video data stream may comprise one or more scalable non-nested supplemental enhancement information messages. Video encoder 100 may generate the video data stream such that, for example, one or more scalable nested supplemental enhancement information messages and one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. can be configured to Video encoder 100 may, for example, determine that each syntax element of one or more syntax elements of the plurality of syntax elements, for example, in each scalable nested supplemental enhancement information message of the encoded video sequence, and It may be configured to generate a video data stream such that each of the scalable non-nested Supplemental Enhancement Information messages of the encoded video sequence may be defined to have the same size.

In one embodiment, video encoder 100 may, for example, ensure that each syntax element of one or more syntax elements of the plurality of syntax elements is, for example, each of scalable nested supplemental enhancement information messages of the video data stream. may be configured to generate video data streams as defined to have the same size in .

According to one embodiment, video encoder 100 may, for example, ensure that each syntax element of one or more syntax elements of the plurality of syntax elements is, for example, a scalable nested supplemental enhancement information message of the video data stream. , and in each of the scalable non-nested Supplemental Enhancement Information messages of the video data stream may be defined to have the same size.

In one embodiment, the video encoder 100 may, for example, generate a video data stream such that the video data stream or a portion of the video data stream may include, for example, at least one buffering period supplemental enhancement information message. Configurable, the buffering period supplemental extension information message defines a size of each syntax element of one or more syntax elements of the plurality of syntax elements.

According to one embodiment, video encoder 100 determines, for example, that the Buffering Period Supplemental Extension Information message defines a size for each syntax element of one or more of the plurality of syntax elements. in order to
bp_cpb_initial_removal_delay_length_minus1 element,
bp_cpb_removal_delay_length_minus1 element,
bp_dpb_output_delay_length_minus1 element,
bp_du_cpb_removal_delay_increment_length_minus1 element,
bp_dpb_output_delay_du_length_minus1 elements.

In one embodiment, the video encoder 100 may be configured, for example, to generate a video data stream whereby multiple access units of the video data stream containing scalable nested buffering period supplemental enhancement information messages. , said access unit may also include, for example, a scalable non-nested buffering period supplemental enhancement information message.

According to one embodiment, video encoder 100, for each single layer access unit of a plurality of single layer access units of a video data stream, including, for example, a scalable nested buffering period supplemental enhancement information message; The layer access unit may for example be configured to generate the video data stream such that it may also contain scalable non-nested buffering period supplemental enhancement information messages.

Additionally, an apparatus 200 is provided for receiving an input video data stream. The input video data stream contains encoded video. Apparatus 200 is configured to generate an output video data stream from an input video data stream. A video data stream includes one or more scalable nested Supplemental Enhancement Information messages. One or more scalable nested supplemental extension information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size in each of the video data stream or the scalable nested supplemental enhancement information messages of the part of the video data stream. Defined. Apparatus 200 is configured to process one or more scalable nested supplemental enhancement information messages.

According to one embodiment, a video data stream may include, for example, one or more scalable non-nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements, in each scalable nested Supplemental Enhancement Information message of the video data stream or part of the video data stream, and It is defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages that are part of the video data stream. Apparatus 200 is configured to process one or more scalable nested supplemental enhancement information messages and one or more scalable non-nested supplemental enhancement information messages.

In one embodiment, a video data stream may, for example, comprise a plurality of access units, each access unit of the plurality of access units being assigned to, for example, one of a plurality of pictures of the video. A portion of the video data stream may be, for example, an access unit of a plurality of access units of the video data stream. Each syntax element of one or more syntax elements of the plurality of syntax elements may be defined, for example, to have the same size in each of the scalable nested supplemental enhancement information messages of the access unit.

According to one embodiment, a video data stream may include, for example, one or more scalable non-nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements, e.g. can be defined to have the same size. Apparatus 200 may, for example, be configured to process one or more scalable nested supplemental enhancement information messages and one or more scalable non-nested supplemental enhancement information messages.

In one embodiment, the portion of the video data stream may be, for example, an encoded video sequence of the video data stream. Each syntax element of one or more syntax elements of the plurality of syntax elements may be defined to have the same size in each of the scalable nested supplemental enhancement information messages of the encoded video sequence, for example.

According to one embodiment, a video data stream may include, for example, one or more scalable non-nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements, e.g., in each scalable nested supplemental enhancement information message of the encoded video sequence and not scalable nested of the encoded video sequence It may be defined to have the same size in each of the Supplemental Extension Information messages. Apparatus 200 may, for example, be configured to process one or more scalable nested supplemental enhancement information messages and one or more scalable non-nested supplemental enhancement information messages.

In one embodiment, each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size, e.g., in each of the scalable nested supplemental enhancement information messages of the video data stream. can be defined.

According to one embodiment, each syntax element of the one or more syntax elements of the plurality of syntax elements, for example, in each scalable nested supplemental enhancement information message of the video data stream and the video data It may be defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of a stream. Apparatus 200 may, for example, be configured to process one or more scalable nested supplemental enhancement information messages and one or more scalable non-nested supplemental enhancement information messages.

In one embodiment, a video data stream or part of a video data stream may for example comprise at least one buffering period supplemental enhancement information message, said buffering period supplemental enhancement information message comprising a plurality of syntax elements defines the size of one or more of Apparatus 200 may, for example, be configured to process at least one buffering period supplemental enhancement information message.

According to one embodiment, the Buffering Period Supplemental Extension Information message, to define the size of the one or more of the plurality of syntax elements, comprises:
bp_cpb_initial_removal_delay_length_minus1 element,
bp_cpb_removal_delay_length_minus1 element,
bp_dpb_output_delay_length_minus1 element,
bp_du_cpb_removal_delay_increment_length_minus1 element,
bp_dpb_output_delay_du_length_minus1 element.

In one embodiment, for each access unit of a plurality of access units of a video data stream comprising a scalable nested buffering period supplemental extension information message, said access unit for example includes a scalable non-nested buffering period supplemental extension Informational messages can also be included. Apparatus 200 may be configured, for example, to process scalable nested supplemental enhancement information messages and scalable non-nested supplemental enhancement information messages.

According to one embodiment, for each single layer access unit of a plurality of single layer access units of a video data stream comprising a scalable nested buffering period supplemental enhancement information message, said single layer access unit is for example: A scalable non-nested buffering period supplemental extension information message may also be included. Apparatus 200 may be configured, for example, to process scalable nested supplemental enhancement information messages and scalable non-nested supplemental enhancement information messages.

Additionally, a video decoder 300 is provided for receiving a video data stream containing video. Video decoder 300 is configured to decode video from a video data stream. A video data stream includes one or more scalable nested Supplemental Enhancement Information messages. One or more scalable nested supplemental extension information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size in each of the video data stream or the scalable nested supplemental enhancement information messages of the part of the video data stream. Defined. Video decoder 300 is configured to decode video in response to one or more syntax elements of a plurality of syntax elements.

According to one embodiment, a video data stream may include, for example, one or more scalable non-nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements, for example, in each scalable nested Supplemental Enhancement Information message of the video data stream or part of the video data stream, and the video data It may be defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of a stream or part of a video data stream.

In one embodiment, a video data stream may, for example, comprise a plurality of access units, each access unit of the plurality of access units being assigned to, for example, one of a plurality of pictures of the video. A portion of the video data stream may be, for example, an access unit of a plurality of access units of the video data stream. Each syntax element of one or more syntax elements of the plurality of syntax elements may be defined, for example, to have the same size in each of the scalable nested supplemental enhancement information messages of the access unit.

According to one embodiment, a video data stream may include, for example, one or more scalable non-nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements, e.g. can be defined to have the same size.

In one embodiment, the portion of the video data stream may be, for example, an encoded video sequence of the video data stream. Each syntax element of one or more syntax elements of the plurality of syntax elements may be defined to have the same size in each of the scalable nested supplemental enhancement information messages of the encoded video sequence, for example.

According to one embodiment, a video data stream may include, for example, one or more scalable non-nested supplemental enhancement information messages. The one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include multiple syntax elements. Each syntax element of the one or more syntax elements of the plurality of syntax elements, e.g., in each scalable nested supplemental enhancement information message of the encoded video sequence and not scalable nested of the encoded video sequence It may be defined to have the same size in each of the Supplemental Extension Information messages.

In one embodiment, each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size, e.g., in each of the scalable nested supplemental enhancement information messages of the video data stream. can be defined.

According to one embodiment, each syntax element of the one or more syntax elements of the plurality of syntax elements, for example, in each scalable nested supplemental enhancement information message of the video data stream and the video data It may be defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of a stream.

In one embodiment, a video data stream or part of a video data stream may for example comprise at least one buffering period supplemental enhancement information message, said buffering period supplemental enhancement information message comprising a plurality of syntax elements defines the size of each syntax element for one or more syntax elements in .

According to one embodiment, the buffering period supplemental extension information message defines a size for each syntax element of one or more syntax elements of the plurality of syntax elements,
bp_cpb_initial_removal_delay_length_minus1 element,
bp_cpb_removal_delay_length_minus1 element,
bp_dpb_output_delay_length_minus1 element,
bp_du_cpb_removal_delay_increment_length_minus1 element,
bp_dpb_output_delay_du_length_minus1 element.

In one embodiment, for each access unit of a plurality of access units of a video data stream comprising a scalable nested buffering period supplemental extension information message, said access unit for example includes a scalable non-nested buffering period supplemental extension Informational messages can also be included.

According to one embodiment, for each single layer access unit of a plurality of single layer access units of a video data stream comprising a scalable nested buffering period supplemental enhancement information message, said single layer access unit is for example: A scalable non-nested buffering period supplemental extension information message may also be included.

Further, a system is provided. The system comprises an apparatus 200 as previously described and a video decoder 300 as previously described. Video decoder 300 is configured to receive the output video data stream of device 200 . Further, video decoder 300 is configured to decode video from the output video data stream of device 200 .

According to one embodiment, the system may further comprise a video encoder 100, for example. Apparatus 200 may, for example, be configured to receive a video data stream from video encoder 100 as an input video data stream.

In particular, the fifth aspect of the present invention makes all BP SEI messages in a bitstream represent the same length of a particular variable-length encoded syntax element, without scalable non-nested transformations within the same AU. Regarding constraining not to be scalable nested.

The buffering period SEI, picture timing SEI, and decoding unit information SEI messages provide precise timing information for NAL units in the bitstream to control their transition through the decoder's buffers in conformance tests. used to Some syntax elements in the PT and DUI SEI messages are variable length encoded and the length of these syntax elements is conveyed in the BP SEI message. This analytical dependency is a design trade-off. Save sending those length syntax elements in each PT or DUI SEI message for the cost of not allowing parsing of PT and DUI SEI messages without first parsing the associated BP SEI message Advantages are achieved. BP SEI messages (once for multiple frames) are sent much less frequently than PT messages (once for each frame) or DUI SEI messages (multiple times per frame), so many slices Bit savings are achieved through this common design trade-off, similar to how the picture header structure can reduce the bit cost of slice headers when is used.

More specifically, the BP SEI message in the current VVC draft specification contains the following syntax elements that are the root of the parsing dependencies.
bp_cpb_initial_removal_delay_length_minus1, which specifies the encoded length of the AU's alternative timing initial CPB removal delay in the PT SEI message;
o bp_dpb_output_delay_length_minus1, which specifies the encoded length of the AU's DPB output delay in the PT SEI message;
- bp_du_cpb_removal_delay_increment_length_minus1, which specifies the encoded length of the DU's individual and common CPB removal delays in the PT SEI message and the DU's CPB removal delay in the DUI SEI message;
• bp_dpb_output_delay_du_length_minus1, which specifies the encoding length DPB output delay of the AU in the PT SEI and DU SEI messages.

However, a problem arises when the bitstream comprises multiple OLS. BP/PT/DUI SEI messages applied to OLS representing bitstreams are carried verbatim within the bitstream, making it easy to track parsing dependencies, but OLS representing (sub)bitstreams Other pairs of BP/PT/DUI SEI messages corresponding to are carried in encapsulated form in so-called scalable nesting SEI messages. Nonetheless, given that parsing dependencies apply and the number of OLS can be very high, the correct Keeping track of encapsulated BP SEI messages is a significant burden for decoders or parsers. In particular, these messages can also be encapsulated in different scalable nesting SEI messages.

Therefore, as part of the present invention, in one embodiment, the encoded value of each syntax element describing length shall be the same for all scalable nested and non-scalably nested BP SEI messages within an AU. A bitstream constraint is established that Therefore, the decoder or parser only needs to store the respective length value when parsing the first non-scalable BP SEI message in the AU, whether encapsulated in a scalable nesting SEI message or not. , the parsing dependencies of all PT and DUI SEI messages within the buffering period starting at the respective AU can be resolved. Below are examples of the respective specification text.
All scalable nested and non-scalable nested buffering period SEI messages within an AU must have the following syntax elements: bp_cpb_initial_removal_delay_length_minus1, bp_cpb_removal_delay_length_minus1, bp_dpb_output_delay_length_min Having the same respective values for us1, bp_du_cpb_removal_delay_increment_length_minus1, bp_dpb_output_delay_du_length_minus1 is a bitstream conformance requirement .

In another embodiment, the constraint is expressed only for scalable nested BP SEI messages that are within the buffering period that the current scalable non-nested BP SEI message determines as follows.
All scalable nested buffering period SEI messages within a buffering period have the same syntax elements as the scalable non-scalable nested buffering period SEI messages in the buffering period bp_cpb_initial_removal_delay_length_minus1, bp_cpb_removal_delay_length_minus1, bp_dpb_output _delay_length_minus1, bp_du_cpb_removal_delay_increment_length_minus1, bp_dpb_output_delay_du_length_minus1 is a bitstream conformance requirement.

Here, the BPs of the bitstream define the range of scalable nested BP constraints from one scalable nested BP to the next scalable nested BP.

In another embodiment, the constraint is expressed for all AUs of the bitstream, for example:
All scalable nested and non-scalable nested buffering period SEI messages in the bitstream are defined by the syntax elements bp_cpb_initial_removal_delay_length_minus1, bp_cpb_removal_delay_length_minus1, bp_dpb_output_delay_length_minus 1, bp_du_cpb_removal_delay_increment_length_minus1, bp_dpb_output_delay_du_length_minus1 having the same respective values is a bitstream conformance requirement. be.

In another embodiment, since constraints are expressed only for AUs in CVS, the smart encoder calculates the difference in duration of BPs in the bitstream for encoding of the associated delay and offset syntax elements. It can still be made easier. The specification text follows.
All scalable nested and non-scalable nested buffering period SEI messages in CVS have the syntax elements bp_cpb_initial_removal_delay_length_minus1, bp_cpb_removal_delay_length_minus1, bp_dpb_output_delay_length_m Having the same respective values for inus1, bp_du_cpb_removal_delay_increment_length_minus1, bp_dpb_output_delay_du_length_minus1 is a bitstream conformance requirement .

Here, the constraint range is CVS.

Specifically, the buffering period, or BP SEI message, defines a so-called buffering period in which the timing of each picture anchors the picture at the beginning of the buffering period. The start of the buffering period is useful, for example, for testing the suitability of random access functions in the bitstream.

FIG. 7 shows two sets of HRD SEI, scalable nested SEI and scalable non-nested SEI in a two-layer bitstream according to one embodiment.

For example, in a multi-layer scenario as shown in Figure 7, the scalable nested HRD SEI is different from the scalable non-nested SEI (POC 0 only) used when only layer L0 is extracted from POC 3 and played. Provide different buffering period settings (via BP at POC 0 and POC 3).

However, this also increases the complexity cost of tracking parsing dependencies between PT messages and individual BP messages as explained above, which is undesirable. Therefore, as part of the present invention, in one embodiment, having scalable nested BP SEI messages within an AU without scalable non-nested BP SEI messages is prohibited as follows.
It is a bitstream conformance requirement that no scalable nested BP SEI message is in an AU that does not contain a scalable non-nested BP SEI message.

Since the above usage scenario is limited to multi-layer bitstreams, in another embodiment the relevant constraints are limited to single-layer bitstreams as follows.
It is a bitstream conformance requirement that no scalable nested BP SEI message is in a single layer AU that does not contain a scalable non-nested BP SEI message.

Although some aspects have been described in the context of an apparatus, it is clear that these aspects also represent descriptions of corresponding methods, where blocks or devices correspond to method steps or features of method steps. Similarly, aspects described in the context of method steps also represent descriptions of corresponding blocks or items or features of the corresponding apparatus. Some or all of the method steps may be performed by (or using) hardware devices such as microprocessors, programmable computers, or electronic circuits. In some embodiments, one or more of the most critical method steps may be performed by such apparatus.

Depending on certain implementation requirements, embodiments of the invention can be implemented in hardware or software, at least partially in hardware, or at least partially in software. Implementation may be performed using a digital storage medium, such as a floppy disk, DVD, Blu-Ray, CD, ROM, PROM, EPROM, EEPROM or flash memory, on which electronically readable control signals are stored. , which cooperate (or can cooperate) with a programmable computer system such that the respective methods are performed. As such, the digital storage medium may be computer readable.

Some embodiments according to the present invention have electronically readable control signals operable to cooperate with a programmable computer system to perform one of the methods described herein. Including data carrier.

Generally, embodiments of the present invention can be implemented as a computer program product having program code that, when the computer program product is run on a computer, performs one of the methods. Operate. Program code may be stored, for example, in a machine-readable carrier.

Another embodiment includes a computer program stored on a machine-readable carrier for performing one of the methods described herein.

In other words, one embodiment of the method of the present invention therefore comprises a computer program having program code for performing one of the methods described herein when the computer program is run on a computer. is.

A further embodiment of the method of the invention is therefore a data carrier (or digital storage medium or computer readable medium) containing recorded thereon a computer program for carrying out one of the methods described herein. . A data carrier, digital storage medium or recording medium is typically tangible and/or non-transitory.

A further embodiment of the method of the invention is therefore a data stream or signal sequence representing the computer program for performing one of the methods described herein. The data stream or signal sequence may, for example, be arranged to be transferred over a data communication connection, for example over the Internet.

Further embodiments include processing means, such as a computer or programmable logic device, configured or adapted to perform one of the methods described herein.

A further embodiment includes a computer installed with a computer program for performing one of the methods described herein.

A further embodiment according to the present invention relates to an apparatus configured to transfer (e.g. electronically or optically) to a receiver a computer program for performing one of the methods described herein or system. A receiver may be, for example, a computer, mobile device, memory device, or the like. The device or system may, for example, comprise a file server for transferring computer programs to receivers.

In some embodiments, programmable logic devices (eg, field programmable gate arrays) can be used to perform some or all of the functions of the methods described herein. In some embodiments, a field programmable gate array can cooperate with a microprocessor to perform one of the methods described herein. In general, the methods are preferably performed by any hardware device.

The devices described herein may be implemented using a hardware device, using a computer, or using a combination of hardware devices and computers.

The methods described herein can be performed using a hardware apparatus, using a computer, or using a combination of hardware apparatus and computer.

The foregoing embodiments are merely illustrative of the principles of the invention. It is understood that modifications and variations of the configurations and details described herein will be apparent to those skilled in the art. It is therefore intended to be limited only by the scope of the impending claims and not by the specific details presented in the description and description of the embodiments herein.

References [1] ISO/IEC, ITU-T. High efficiency video coding. ITU-T Recommendation H. 265 | ISO/IEC 23008 10 (HEVC), 1st Edition, 2013; 2nd Edition, 2014.

Embodiments of the present invention are exemplified below.

<Aspect 1>
An apparatus (200) for receiving an input video data stream, comprising:
the input video data stream is video encoded;
said device (200) being configured to generate an output video data stream from said input video data stream;
The apparatus (200) determines whether pictures of the video preceding dependent random access pictures should be output.
A device (200).

<Aspect 2>
2. The apparatus (200) of aspect 1, wherein the apparatus (200) is configured to determine a first variable (NoOutputBeforeDrapFlag) indicating whether the picture of the video preceding the dependent random access picture is to be output. device (200).

<Aspect 3>
The apparatus (200) generates the output video data stream such that the output video data stream includes an indication of whether the pictures of the video preceding the dependent random access pictures are to be output. The apparatus (200) of aspect 2, configured to:

<Aspect 4>
The apparatus (200) is configured such that the output video data stream includes supplemental enhancement information including the indication of whether the picture of the video preceding the dependent random access picture should be output. The apparatus (200) of aspect 3, configured to generate a video data stream.

<Aspect 5>
a picture of the video preceding the dependent random access picture is an independent random access picture;
The apparatus (200) is configured to generate the output video data stream such that the output video data stream includes a flag (ph_pic_output_flag) having a predetermined value (0) in picture headers of the independent random access pictures. wherein said predetermined value (0) of said flag (ph_pic_output_flag) indicates that said independent random access picture is output for said independent random access picture directly preceding said dependent random access picture in said video data stream. indicate that it should not be
The apparatus (200) of aspect 3.

<Aspect 6>
wherein said flag is a first flag and said device (200) is adapted to generate said output video data stream such that said output video data stream includes a further flag within a picture parameter set of said video data stream. 6. The apparatus (200) of aspect 5, wherein the further flag is configured to indicate whether the first flag (ph_pic_output_flag) is present in the picture header of the independent random access picture.

<Aspect 7>
Said apparatus (200) as said indication indicating whether said output video data stream should output said picture of said video preceding said dependent random access picture:
a supplemental enhancement information flag within the supplemental enhancement information of said output video data stream; or
a picture parameter set flag within a picture parameter set of said output video data stream; or
a sequence parameter set flag within a sequence parameter set of said output video data stream; or
an external means flag, the value of the external means flag being set by an external unit external to said device (200);
configured to generate the output video data stream to include
The apparatus (200) of aspect 3.

<Aspect 8>
The apparatus (200) is configured to determine a value of a second variable (PictureOutputFlag) for the picture of the video preceding the dependent random access picture in dependence on the first variable (NoOutputBeforeDrapFlag); A second variable (PictureOutputFlag) indicates for said picture whether said picture should be output or not, and said device (200) outputs or outputs said picture depending on said second variable (PictureOutputFlag). configured not to
The apparatus (200) of any of aspects 2-7.

<Aspect 9>
the picture of the video preceding the dependent random access picture is an independent random access picture;
the first variable (NoOutputBeforeDrapFlag) indicates that the independent random access picture should not be output;
The apparatus (200) of any of aspects 2-8.

<Aspect 10>
the picture of the video preceding the dependent random access picture is an independent random access picture;
The apparatus (200) is configured to set the first variable (NoOutputBeforeDrapFlag) such that the first variable (NoOutputBeforeDrapFlag) indicates that the independent random access picture is to be output. ,
The apparatus (200) of any of aspects 2-8.

<Aspect 11>
11. according to any of the aspects 1-10, wherein the apparatus (200) is configured to signal to a video decoder (300) whether pictures of the video preceding dependent random access pictures should be output or not. device (200).

<Aspect 12>
a video data stream,
a video is encoded in the video data stream;
the video data stream includes an indication of whether pictures of the video preceding dependent random access pictures are to be output;
video data stream.

<Aspect 13>
13. The video data stream of aspect 12, wherein the output video data stream includes supplemental enhancement information including the indication of whether the pictures of the video preceding the dependent random access pictures should be output.

<Aspect 14>
a picture of the video preceding the dependent random access picture is an independent random access picture;
The video data stream includes a flag (ph_pic_output_flag) having a predetermined value (0) in a picture header of the independent random access picture, whereby the predetermined value (0) of the flag (ph_pic_output_flag) is equal to the for the independent random access picture that directly precedes the dependent random access picture in a video data stream, indicating that the independent random access picture should not be output;
A video data stream according to aspect 12.

<Aspect 15>
The flag is a first flag, and the video data stream includes a further flag within a picture parameter set of the video data stream, the further flag is that the first flag (ph_pic_output_flag) is the independent random 15. The video data stream of aspect 14, indicating whether present in said picture header of an access picture.

<Aspect 16>
a video data stream comprising: as said indication indicating whether said pictures of said video preceding said dependent random access pictures should be output;
a supplemental enhancement information flag within the supplemental enhancement information of said output video data stream; or
a picture parameter set flag within a picture parameter set of said output video data stream; or
a sequence parameter set flag within a sequence parameter set of said output video data stream; or
an external means flag, the value of the external means flag being set by an external unit external to the device (200);
including,
A video data stream according to aspect 12.

<Aspect 17>
A video encoder (100) comprising:
said video encoder (100) configured to encode video into a video data stream;
The video encoder (100) is configured to generate the video data stream such that the video data stream includes an indication of whether pictures of the video preceding dependent random access pictures are to be output. to be
A video encoder (100).

<Aspect 18>
The video encoder (100) is configured such that the video data stream includes supplemental enhancement information including the indication of whether the picture of the video preceding the dependent random access picture is to be output. 18. The video encoder (100) of aspect 17, configured to generate a data stream.

<Aspect 19>
the picture of the video preceding the dependent random access picture is an independent random access picture;
The video encoder (100) generates the video data stream such that the output video data stream includes a flag (ph_pic_output_flag) having a predetermined value (0) in picture headers of the independent random access pictures. wherein said predetermined value (0) of said flag (ph_pic_output_flag) indicates that said independent random access picture is output for said independent random access picture directly preceding said dependent random access picture in said video data stream. indicate that it should not be
18. A video encoder (100) according to aspect 17.

<Aspect 20>
The flag is a first flag, and the video encoder (100) is configured to generate the video data stream such that the video data stream includes a further flag within a picture parameter set of the video data stream. 20. The video encoder (100) of aspect 19, wherein said further flag indicates whether said first flag (ph_pic_output_flag) is present in said picture header of said independent random access picture.

<Aspect 21>
The video encoder (100), as the indication of whether the video data stream is to output the picture of the video that precedes the dependent random access picture,
a supplemental enhancement information flag within the supplemental enhancement information of said output video data stream; or
a picture parameter set flag within a picture parameter set of said output video data stream; or
a sequence parameter set flag within a sequence parameter set of said output video data stream; or
an external means flag, the value of the external means flag being set by an external unit external to the device (200);
configured to generate said video data stream to include
18. A video encoder (100) according to aspect 17.

<Aspect 22>
A video decoder (300) for receiving a video data stream containing video, comprising:
said video decoder (300) configured to decode said video from said video data stream;
wherein said video decoder (300) is configured to decode said video in response to an indication indicating whether a picture of said video preceding a dependent random access picture is to be output;
A video decoder (300).

<Aspect 23>
The video decoder (300) is configured to decode the video according to a first variable (NoOutputBeforeDrapFlag) indicating whether the picture of the video preceding the dependent random access picture is to be output. 23. The video decoder (300) of aspect 22.

<Aspect 24>
said video data stream includes said indication indicating whether said pictures of said video preceding said dependent random access pictures are to be output;
24. The video decoder (300) of aspect 23, wherein said video decoder (300) is configured to decode said video in response to said representation in said video data stream.

<Aspect 25>
the video data stream includes supplemental enhancement information including the indication of whether the picture of the video preceding the dependent random access picture is to be output;
25. The video decoder (300) of aspect 24, wherein the video decoder (300) is configured to decode the video in response to the supplemental enhancement information.

<Aspect 26>
the picture of the video preceding the dependent random access picture is an independent random access picture;
The video data stream includes a flag (ph_pic_output_flag) having a predetermined value (0) in a picture header of the independent random access picture, whereby the predetermined value (0) of the flag (ph_pic_output_flag) is equal to the indicating, for said independent random access picture that directly precedes said dependent random access picture in a video data stream, that said independent random access picture should not be output;
the video decoder (300) is configured to decode the video in response to the flag;
25. The video decoder (300) of aspect 24.

<Aspect 27>
The flag is a first flag, and the video data stream includes a further flag within a picture parameter set of the video data stream, the further flag is that the first flag (ph_pic_output_flag) is the independent random indicating whether it is present in the picture header of an access picture;
said video decoder (300) being configured to decode said video in response to said further flag;
27. The video decoder (300) of aspect 26.

<Aspect 28>
wherein the video data stream includes, as the indication of whether the picture of the video preceding the dependent random access picture is to be output,
a supplemental enhancement information flag within the supplemental enhancement information of said output video data stream; or
a picture parameter set flag within a picture parameter set of said output video data stream; or
a sequence parameter set flag within a sequence parameter set of said output video data stream; or
an external means flag, the value of said external means flag being set by an external unit external to the device (200);
including
the video decoder (300) is configured to decode the video in response to the representation in the video data stream;
25. The video decoder (300) of aspect 24.

<Aspect 29>
said video decoder (300) configured to reconstruct said video from said video data stream;
said video decoder (300) is configured to output or not output said picture of said video preceding said dependent random access picture, depending on said first variable (NoOutputBeforeDrapFlag);
29. A video decoder (300) according to any of aspects 23-28.

<Aspect 30>
said video decoder (300) is configured to determine a value of a second variable (PictureOutputFlag) for said picture of said video preceding said dependent random access picture as a function of said first variable (NoOutputBeforeDrapFlag); The second variable (PictureOutputFlag) indicates for the picture whether the picture should be output, and the device (200) outputs the picture depending on the second variable (PictureOutputFlag) or 30. The video decoder (300) of any of aspects 23-29, wherein the video decoder (300) is configured not to output.

<Aspect 31>
the picture of the video preceding the dependent random access picture is an independent random access picture;
31. Any of aspects 23-30, wherein the video decoder (300) is configured to decode the video in response to the first variable (NoOutputBeforeDrapFlag) indicating that the independent random access picture should not be output. A video decoder (300) according to any preceding claim.

<Aspect 32>
the picture of the video preceding the dependent random access picture is an independent random access picture;
31. of aspects 23-30, wherein the video decoder (300) is configured to decode the video in response to the first variable (NoOutputBeforeDrapFlag) indicating that the independent random access picture is to be output. A video decoder (300) according to any of the preceding claims.

<Aspect 33>
A device (200) according to any of aspects 1-11;
A video decoder (300) according to any of aspects 22-32;
with
A video decoder (300) according to any of aspects 22-32, configured to receive an output video data stream of the apparatus (200) according to any of aspects 1-11,
A video decoder (300) according to any of aspects 22-32, configured to decode said output video data stream to said video of the apparatus (200) according to any of aspects 1-11,
system.

<Aspect 34>
The system further comprising a video encoder (100) according to any of aspects 17-21;
The apparatus (200) according to any of aspects 1-11 is arranged to receive, as said input video data stream, said video data stream from a video encoder (100) according to any of aspects 17-21. Ru
34. The system of aspect 33.

<Aspect 35>
1. A method for receiving an input video data stream, said input video data stream being video encoded,
The method includes generating an output video data stream from the input video data stream;
The method includes determining whether pictures of the video preceding dependent random access pictures should be output.
Method.

<Aspect 36>
A method for encoding video into a video data stream, comprising:
The method includes generating the video data stream such that the video data stream includes an indication of whether pictures of the video preceding dependent random access pictures are to be output.
Method.

<Aspect 37>
A method for receiving a video data stream containing video, comprising:
The method includes decoding the video from the video data stream;
said step of decoding said video is performed in response to an indication indicating whether pictures of said video preceding dependent random access pictures are to be output;
Method.

<Aspect 38>
38. A computer program for implementing the method of any of aspects 35-37 when run on a computer or signal processor.

<Aspect 39>
An apparatus (200) for receiving one or more input video data streams, each of said one or more input video data streams having an encoded input video,
The apparatus (200) is configured to generate an output video data stream from the one or more input video data streams, the output video data stream encoding an output video, the apparatus configured to convert the output video into the such that the input video is encoded in one of the one or more input video data streams, or the output video is the input of at least one of the one or more input video data streams. configured to generate said output video data stream as dependent on the video;
The apparatus (200) is configured to determine a current picture access unit removal time of a plurality of pictures of the output video from a coded picture buffer;
The apparatus (200) is configured to determine whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer. ,
A device (200).

<Aspect 40>
The apparatus (200) is configured to drop groups of one or more pictures of the input video of a first video data stream of the one or more input video data streams to generate the output video data stream. configured,
The apparatus (200) is configured to determine an access unit removal time for at least one of the plurality of pictures of the output video from the coded picture buffer as a function of the coded picture buffer delay offset information. consists of
40. Apparatus (200) according to aspect 39.

<Aspect 41>
said first video received by said device (200) being a preprocessed video resulting from an original video in which one or more groups of pictures have been dropped to produce a processed video;
The apparatus (200) is configured to determine an access unit removal time for at least one of the plurality of pictures of the output video from the coded picture buffer as a function of the coded picture buffer delay offset information. Ru
40. Apparatus (200) according to aspect 39.

<Aspect 42>
42. The apparatus (200) of aspect 40 or 41, wherein the buffer delay offset information is dependent on the number of dropped pictures of the input video.

<Aspect 43>
said one or more input video data streams being two or more input video data streams;
The apparatus (200) is configured to splice the processed video and the input video of a second one of the two or more input video data streams to obtain the output video. and configured to encode the output video into the output video data stream;
43. The apparatus (200) of any of aspects 40-42.

<Aspect 44>
The apparatus (200) determines whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture according to the position of the current picture within the output video. configured to determine, or
The apparatus (200) stores the coded picture buffer delay offset information in the coded picture buffer for determining the access unit removal time of the current picture according to the position of the current picture in the output video. configured to determine whether to set the delay offset value to 0;
44. Apparatus (200) according to aspect 43.

<Aspect 45>
Said apparatus (200) comprises a coded picture buffer for determining said access unit removal time for said current picture according to the position of a previous non-discardable picture preceding said current picture in said output video. 45. Apparatus (200) according to aspect 43 or 44, configured to determine whether to use delay offset information.

<Aspect 46>
Said apparatus (200) controls said current picture according to whether said previous non-discardable picture preceding said current picture in said output video is the first picture in a previous buffering period. 46. The apparatus (200) of aspect 45, configured to determine whether to use coded picture buffer delay offset information to determine the access unit removal time of .

<Aspect 47>
The apparatus (200) is configured to determine whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture in response to a concatenated flag; is the first picture of the input video of the second video data stream.

<Aspect 48>
48. The apparatus (200) according to any of aspects 39-47, wherein the apparatus (200) is configured to determine the access unit removal time for the current picture according to a removal time for a previous picture.

<Aspect 49>
49. The apparatus (200) according to any of aspects 39-48, wherein the apparatus (200) is configured to determine the access unit removal time for the current picture in dependence on initial coded picture buffer removal delay information. ).

<Aspect 50>
The apparatus (200) is configured to obtain temporary coded picture buffer removal delay information to determine the access unit removal time of the current picture, the initial coded picture buffer removal delay according to clock ticks. 50. Apparatus (200) according to aspect 49, configured to update information.

<Aspect 51>
if said concatenation flag is set to a first value, said apparatus (200) is configured to determine one or more removal times using said coded picture buffer delay offset information;
If said concatenation flag is set to a second value different from said first value, said apparatus (200) uses said coded picture buffer delay offset information to determine said one or more removal times. 48. Apparatus (200) according to aspect 47, configured for non-use.

<Aspect 52>
The apparatus (200) instructs a video decoder (300) whether to use the coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer. 52. Apparatus (200) according to any of aspects 39-51, configured to signal.

<Aspect 53>
53. The apparatus (200) of aspect 52, wherein the current picture is located at a splicing point of the output video to which two input videos were spliced.

<Aspect 54>
a video data stream,
a video is encoded in the video data stream;
wherein the video data stream includes coded picture buffer delay offset information;
video data stream.

<Aspect 55>
55. A video data stream according to aspect 54, wherein said video data stream includes a concatenation flag.

<Aspect 56>
56. A video data stream according to aspect 54 or 55, wherein said video data stream comprises initial coded picture buffer removal delay information.

<Aspect 57>
if the concatenated flag is set to a first value, the concatenated flag indicates that the coded picture buffer delay offset information should be used to determine one or more removal times;
When the concatenation flag is set to a second value different from the first value, the concatenation flag indicates that the indicated offset is not used to determine the one or more removal times. ,
56. A video data stream according to aspect 55.

<Aspect 58>
A video encoder (100) comprising:
said video encoder (100) configured to encode video into a video data stream;
The video encoder (100) is configured to generate the video data stream such that the video data stream includes encoded picture buffer delay offset information.
A video encoder (100).

<Aspect 59>
59. The video encoder (100) of aspect 58, wherein the video encoder (100) is configured to generate the video data stream such that the video data stream includes a concatenation flag.

<Aspect 60>
60. A video encoder (100) according to aspect 58 or 59, wherein said video encoder (100) is configured to generate said video data stream such that said video data stream includes encoded picture buffer delay offset information.

<Aspect 61>
if the concatenated flag is set to a first value, the concatenated flag indicates that the coded picture buffer delay offset information should be used to determine one or more removal times;
When the concatenation flag is set to a second value different from the first value, the concatenation flag indicates that the indicated offset is not used to determine the one or more removal times. ,
60. A video encoder (100) according to aspect 59.

<Aspect 62>
A video decoder (300) for receiving a video data stream in which video is stored, comprising:
said video decoder (300) configured to decode said video from said video data stream;
The video decoder (300) is configured to decode the video according to a current picture access unit removal time of a plurality of pictures of the video from an encoded picture buffer;
The video decoder (300), in response to an indication indicating whether to use the coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer. configured to decode said video;
A video decoder (300).

<Aspect 63>
63. The video decoder (300) of aspect 62, wherein the access unit removal time of at least one of the plurality of pictures of the video from the coded picture buffer is dependent on the coded picture buffer delay offset information.

<Aspect 64>
The video decoder (300) whether to use coded picture buffer delay offset information to determine the access unit removal time for the current picture depending on the position of the current picture within the video. 64. A video decoder (300) according to aspect 62 or 63, configured to decode said video accordingly.

<Aspect 65>
aspect 62, wherein the video decoder (300) is configured to decode the video depending on whether a coded picture buffer delay offset value of the coded picture buffer delay offset information is set to zero or A video decoder (300) according to 63.

<Aspect 66>
The video decoder (300) is configured in a coded picture buffer for determining the access unit removal time for the current picture according to the position of a previous non-discardable picture that precedes the current picture in the video. 66. A video decoder (300) according to any of aspects 62-65, configured to determine whether to use delay offset information.

<Aspect 67>
The video decoder (300) determines whether the previous non-discardable picture preceding the current picture in the video is the first picture in the previous buffering period. 67. The video decoder (300) of aspect 66, configured to determine whether to use coded picture buffer delay offset information to determine said access unit removal time.

<Aspect 68>
said video decoder (300) being configured to determine, depending on a concatenated flag, whether to use coded picture buffer delay offset information to determine said access unit removal time for said current picture; 68. The video decoder (300) of any of aspects 62-67, wherein the current picture is the first picture of the input video of the second video data stream.

<Aspect 69>
69. A video decoder (300) according to any of aspects 62-68, wherein said video decoder (300) is configured to determine said access unit removal time for said current picture depending on a removal time of a previous picture. ).

<Aspect 70>
70. A video decoder according to any of aspects 62-69, wherein said video decoder (300) is configured to determine said access unit removal time for said current picture as a function of initial coded picture buffer removal delay information. (300).

<Aspect 71>
The video decoder (300) updates the initial coded picture buffer removal delay information according to clock ticks to obtain temporary coded picture buffer removal delay information, and removes the access unit of the current picture. 71. The video decoder (300) of aspect 70, configured to determine time.

<Aspect 72>
if the concatenation flag is set to a first value, the video decoder (300) is configured to use the coded picture buffer delay offset information to determine one or more removal times;
If the concatenated flag is set to a second value different from the first value, the video decoder (300) uses the coded picture buffer delay offset information to determine the one or more removal times. 69. The video decoder (300) of aspect 68, wherein the video decoder (300) is configured not to use

<Aspect 73>
A device (200) according to any of aspects 39-53;
A video decoder (300) according to any of aspects 62-72;
with
A video decoder (300) according to any of aspects 62-72, configured to receive an output video data stream of an apparatus (200) according to any of aspects 39-53,
The video decoder (300) according to any of aspects 62-72, configured to decode said video from said output video data stream of the apparatus (200) according to any of aspects 39-53,
system.

<Aspect 74>
The system further comprising a video encoder (100) according to any of aspects 58-61;
The apparatus (200) according to any of aspects 39-53 is arranged to receive, as said input video data stream, said video data stream from a video encoder (100) according to any of aspects 58-61. Ru
74. The system of aspect 73.

<Aspect 75>
A method for receiving one or more input video data streams, each of said one or more input video data streams having an encoded input video;
The method includes generating an output video data stream from the one or more input video data streams, wherein the output video data stream encodes an output video, and generating the output video data stream comprises: video is the input video encoded within one of the one or more input video data streams; or the output video is the one or more input video data streams. dependent on said input video of at least one of
The method includes determining an access unit removal time for a current picture of a plurality of pictures of the output video from a coded picture buffer;
The method includes determining whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer;
Method.

<Aspect 76>
A method for encoding video into a video data stream, comprising:
The method includes generating the video data stream such that the video data stream includes encoded picture buffer delay offset information.
Method.

<Aspect 77>
A method for receiving a video data stream in which video is stored, comprising:
The method includes decoding the video from the video data stream;
decoding the video is performed in response to an access unit removal time of a current picture of a plurality of pictures of the video from an encoded picture buffer;
Decoding the video is performed in response to an indication indicating whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer. to be
Method.

<Aspect 78>
78. A computer program for implementing the method of any of aspects 75-77 when run on a computer or signal processor.

<Aspect 79>
a video data stream,
a video is encoded in the video data stream;
wherein the video data stream includes an initial coded picture buffer removal delay;
the video data stream includes an initial coded picture buffer removal offset;
The video data stream includes information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. ,
video data stream.

<Aspect 80>
The initial coded picture buffer removal delay elapses before sending the first access unit of a picture of the video data stream to the video decoder (300) to initialize the video decoder (300). 80. The video data stream according to aspect 79, indicating the time when it needs to

<Aspect 81>
The video data stream has a unit that indicates whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined as constant over the two or more buffering periods. 81. A video data stream according to aspect 80, comprising one display.

<Aspect 82>
A concatenation indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over the two or more buffering periods. including a flag as said single indication;
if the concatenated flag is equal to a first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over the two or more buffering periods;
If the concatenated flag differs from the first value, the concatenated flag indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over the two or more buffering periods. undefined whether or not
82. A video data stream according to aspect 81.

<Aspect 83>
if the single indication does not indicate that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over the two or more buffering periods; 83. Aspect 81 or 82, wherein said video data stream comprises continuously updated information regarding said initial coded picture buffer removal delay information and continuously updated information regarding said initial coded picture buffer removal offset information. The video data stream described in .

<Aspect 84>
The video data stream includes said information indicating that said sum of said initial coded picture buffer removal delay and said initial coded picture buffer removal offset is defined to be constant over said two or more buffering periods. of aspects 79-83, wherein the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant starting from a current position within the video data stream. A video data stream according to any one of the preceding claims.

<Aspect 85>
A video encoder (100) comprising:
said video encoder (100) configured to encode video into a video data stream;
the video encoder (100) is configured to generate the video data stream such that the video data stream includes an initial coded picture buffer removal delay;
the video encoder (100) is configured to generate the video data stream such that the video data stream includes an initial coded picture buffer removal offset;
Information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. is configured to generate the video data stream such that the video data stream includes
A video encoder (100).

<Aspect 86>
The initial coded picture buffer removal delay elapses before sending the first access unit of a picture of the video data stream to the video decoder (300) to initialize the video decoder (300). 86. The video encoder (100) of aspect 85, wherein the video encoder (100) of aspect 85 indicates a time when it needs to

<Aspect 87>
The video encoder (100) determines whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined as constant over the two or more buffering periods. 87. A video encoder (100) according to aspect 86, configured to generate said video data stream such that said video data stream comprises a single representation of an image.

<Aspect 88>
The video encoder (100) determines whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined as constant over the two or more buffering periods. configured to generate the video data stream such that the video data stream includes as the single representation a concatenated flag indicating
if the concatenated flag is equal to a first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over the two or more buffering periods;
If the concatenated flag differs from the first value, the concatenated flag indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over the two or more buffering periods. 88. The video encoder (100) of aspect 87, undefined.

<Aspect 89>
if the single indication does not indicate that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over the two or more buffering periods; The video encoder (100) outputs continuously updated information about the initial coded picture buffer removal delay information and continuously updated information about the initial coded picture buffer removal offset information to the video data stream. 89. A video encoder (100) according to aspect 87 or 88, configured to generate said video data stream, comprising:

<Aspect 90>
The video data stream includes said information indicating that said sum of said initial coded picture buffer removal delay and said initial coded picture buffer removal offset is defined to be constant over said two or more buffering periods. of aspects 85-89, wherein the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant starting from a current position within the video data stream. A video encoder (100) according to any of the preceding claims.

<Aspect 91>
Apparatus (200) for receiving two input video data streams, a first input video data stream and a second input video data stream, each of said two input video data streams comprising an input video data stream is encoded and
Said apparatus (200) is configured to generate an output video data stream from said two input video data streams, said output video data stream encoding an output video, said apparatus comprising: said first input video data stream; and the second input video data stream to generate an output video data stream;
The apparatus (200) is configured to generate the output video data stream such that the output video data stream includes an initial coded picture buffer removal delay;
The apparatus (200) is configured to generate the output video data stream such that the output video data stream includes an initial coded picture buffer removal offset;
The apparatus (200) provides information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. configured to generate the output video data stream, such that the output video data stream comprises;
A device (200).

<Aspect 92>
The initial coded picture buffer removal delay is for initializing the video decoder (300) for the first access unit of a picture of the output video data stream before sending the first access unit to the video decoder (300). 92. Apparatus (200) according to aspect 91, indicating the time that needs to elapse.

<Aspect 93>
The apparatus (200) indicates whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined as constant over the two or more buffering periods. 93. Apparatus (200) according to aspect 92, configured to generate said output video data stream such that said output video data stream comprises a single representation.

<Aspect 94>
The apparatus (200) indicates whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined as constant over the two or more buffering periods. configured to generate the output video data stream such that the output video data stream includes a concatenated flag as the single representation;
if the concatenated flag is equal to a first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over the two or more buffering periods;
If the concatenated flag differs from the first value, the concatenated flag indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over the two or more buffering periods. undefined whether or not
94. Apparatus (200) according to aspect 93.

<Aspect 95>
if the single indication does not indicate that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over the two or more buffering periods; The apparatus (200) provides continuously updated information about the initial coded picture buffer removal delay information and continuously updated information about the initial coded picture buffer removal offset information into the output video data stream. 95. Apparatus (200) according to aspect 93 or 94, configured to generate said output video data stream, comprising:

<Aspect 96>
The video data stream includes said information indicating that said sum of said initial coded picture buffer removal delay and said initial coded picture buffer removal offset is defined to be constant over said two or more buffering periods. of aspects 91-95, wherein the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant starting from a current position within the video data stream. A device (200) according to any of the preceding claims.

<Aspect 97>
A video decoder (300) for receiving a video data stream in which video is stored, comprising:
said video decoder (300) configured to decode said video from said video data stream;
wherein the video data stream includes an initial coded picture buffer removal delay;
the video data stream includes an initial coded picture buffer removal offset;
the video data stream includes information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods;
The video decoder (300) determines whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined as constant over the two or more buffering periods. configured to decode the video in response to indicating information;
A video decoder (300).

<Aspect 98>
The initial coded picture buffer removal delay is prior to sending the first access unit of a picture of the output video data stream to the video decoder (300) to initialize the video decoder (300). 98. The video decoder (300) of aspect 97, indicating the time that needs to elapse.

<Aspect 99>
The video data stream has a unit that indicates whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined as constant over the two or more buffering periods. including an indication of
the video decoder (300) is configured to decode the video according to the single representation;
99. A video decoder (300) according to aspect 98.

<Aspect 100>
A concatenation indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over the two or more buffering periods. including a flag as said single indication;
if the concatenated flag is equal to a first value, the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over the two or more buffering periods;
If the concatenated flag differs from the first value, the concatenated flag indicates that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is constant over the two or more buffering periods. without defining whether or not there is
the video decoder (300) is configured to decode the video in response to the concatenation flag;
100. A video decoder (300) according to aspect 99.

<Aspect 101>
if the single indication does not indicate that the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over the two or more buffering periods; the video data stream includes continuously updated information about the initial coded picture buffer removal delay information and continuously updated information about the initial coded picture buffer removal offset information;
The video decoder (300) is responsive to the continuously updated information regarding the initial coded picture buffer removal delay information and the continuously updated information regarding the initial coded picture buffer removal offset information. , configured to decode said video;
100. A video decoder (300) according to aspect 99 or 100.

<Aspect 102>
The video data stream includes said information indicating that said sum of said initial coded picture buffer removal delay and said initial coded picture buffer removal offset is defined to be constant over said two or more buffering periods. 102. of aspects 97-101, wherein the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant starting from a current position within the video data stream. A video decoder (300) according to any of the preceding claims.

<Aspect 103>
A device (200) according to any of aspects 91-96;
A video decoder (300) according to any of aspects 97-102;
with
A video decoder (300) according to any of aspects 97-102, configured to receive an output video data stream of an apparatus (200) according to any of aspects 91-96,
A video decoder (300) according to any of aspects 97-102, wherein the video decoder (300) according to any of aspects 91-96 is configured to decode said video from said output video data stream of the apparatus (200) according to any of aspects 91-96,
system.

<Aspect 104>
The system further comprising a video encoder (100) according to any of aspects 85-90,
96. The apparatus (200) according to any of aspects 91-96 is arranged to receive said video data stream from a video encoder (100) according to any of aspects 85-90 as said input video data stream. Ru
104. The system of aspect 103.

<Aspect 105>
A method for encoding video into a video data stream, comprising:
The method includes generating the video data stream such that the video data stream includes an initial coded picture buffer removal delay;
The method includes generating the video data stream such that the video data stream includes an initial coded picture buffer removal offset;
The method includes transmitting information to the video data indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. generating said video data stream so that the stream contains
Method.

<Aspect 106>
A method for receiving two input video data streams, a first input video data stream and a second input video data stream, each of said two input video data streams encoding an input video. ,
The method includes generating an output video data stream from the two input video data streams, wherein the output video data stream encodes an output video, and an apparatus for generating the first input video data stream and the second input video data stream. configured to generate an output video data stream by concatenating the input video data stream of
The method includes generating the output video data stream such that the output video data stream includes an initial coded picture buffer removal delay;
The method includes generating the output video data stream such that the output video data stream includes an initial coded picture buffer removal offset;
The method includes transmitting information to the output video indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. generating said output video data stream such that the data stream comprises;
Method.

<Aspect 107>
A method for receiving a video data stream in which video is stored, comprising:
The method includes decoding the video from the video data stream;
wherein the video data stream includes an initial coded picture buffer removal delay;
the video data stream includes an initial coded picture buffer removal offset;
The video data stream includes information indicating whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over two or more buffering periods. ,
The method further includes determining whether the sum of the initial coded picture buffer removal delay and the initial coded picture buffer removal offset is defined to be constant over the two or more buffering periods. decoding the video in response;
Method.

<Aspect 108>
108. A computer program for implementing the method of any of aspects 105-107 when run on a computer or signal processor.

<Aspect 109>
a video data stream,
a video is encoded in the video data stream;
The video data stream comprises a scalable nest of network abstraction layer units of one access unit of the plurality of access units of an encoded video sequence of one or more encoded video sequences of the video data stream. an indication (general_same_pic_timing_in_all_ols_flag) indicating whether a picture timing supplemental enhancement information message is defined to be applied to all output layer sets of the plurality of output layer sets of the access unit;
If the indication (general_same_pic_timing_in_all_ols_flag) has a first value, then the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit indicates all of the plurality of output layer sets of the access unit. defined to apply to the output layer set,
If the indication (general_same_pic_timing_in_all_ols_flag) has a value different from the first value, then the indication is that the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit is the undefined whether to apply to all output layer sets of multiple output layer sets,
video data stream.

<Aspect 110>
110. The video data of aspect 109, wherein if the indication (general_same_pic_timing_in_all_ols_flag) has the first value, then the network abstraction layer unit does not include any other supplemental enhancement information message different from a picture timing supplemental enhancement information message. stream.

<Aspect 111>
111. A video data stream according to aspect 109 or 110, wherein if said indication (general_same_pic_timing_in_all_ols_flag) has said first value, said network abstraction layer unit does not include any other supplemental enhancement information messages.

<Aspect 112>
if the indication (general_same_pic_timing_in_all_ols_flag) has the first value, scalable non-nested picture timing of each access unit of the plurality of access units of one coded video sequence among the one or more coded video sequences; For each network abstraction layer unit containing a supplemental enhancement information message, said network abstraction layer unit does not contain any other supplemental enhancement information message different from the picture timing supplemental enhancement information message or any other 112. The video data stream according to any of aspects 109-111, which also does not include Supplemental Enhancement Information messages.

<Aspect 113>
if the indication (general_same_pic_timing_in_all_ols_flag) has the first value, a scalable non-nested picture timing supplemental extension of each access unit of the plurality of access units of each of the one or more encoded video sequences of the video data stream. For each network abstraction layer unit containing an information message, said network abstraction layer unit does not contain any other supplemental enhancement information message different from the picture timing supplemental enhancement information message or any other supplemental enhancement information message. 112. A video data stream according to any of aspects 109-111, not comprising:

<Aspect 114>
A video encoder (100) comprising:
said video encoder (100) configured to encode video into a video data stream;
the video encoder (100) for network abstraction layer units of one access unit of the plurality of access units of an encoded video sequence of one or more encoded video sequences of the video data stream; such that the video data stream includes an indication (general_same_pic_timing_in_all_ols_flag) indicating whether a scalable non-nested picture timing supplemental enhancement information message is defined to apply to all output layer sets of the multiple output layer sets of the access unit; and configured to generate said video data stream,
If the indication (general_same_pic_timing_in_all_ols_flag) has a first value, then the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit indicates all of the plurality of output layer sets of the access unit. defined to be applied to the output layer set,
If the indication (general_same_pic_timing_in_all_ols_flag) has a value different from the first value, then the indication is that the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit is the undefined whether to apply to all output layer sets of multiple output layer sets,
A video encoder (100).

<Aspect 115>
115. The video encoder of aspect 114, wherein if the indication (general_same_pic_timing_in_all_ols_flag) has the first value, then the network abstraction layer unit does not include any other supplemental enhancement information message different from a picture timing supplemental enhancement information message. (100).

<Aspect 116>
116. The video encoder (100) of aspect 114 or 115, wherein if said indication (general_same_pic_timing_in_all_ols_flag) has said first value, said network abstraction layer unit does not include any other supplemental enhancement information message.

<Aspect 117>
If the indication (general_same_pic_timing_in_all_ols_flag) has the first value, the video encoder (100) controls each access of the plurality of access units of one encoded video sequence among the one or more encoded video sequences. For each network abstraction layer unit containing a non-scalable nested picture timing supplemental enhancement information message of a unit, said network abstraction layer unit contains any other supplemental enhancement information message different from the picture timing supplemental enhancement information message. 117. A video encoder (100) according to any of aspects 114-116, wherein the video encoder (100) is configured to generate said video data stream without or without any other supplemental enhancement information messages.

<Aspect 118>
If the indication (general_same_pic_timing_in_all_ols_flag) has the first value, the video encoder (100) controls each access unit of the plurality of access units of each of the one or more encoded video sequences of the video data stream. , for each network abstraction layer unit containing a scalable non-nested picture timing supplemental enhancement information message, said network abstraction layer unit does not contain any other supplemental enhancement information message different from the picture timing supplemental enhancement information message or any other 117. A video encoder (100) according to any of aspects 114-116, configured to generate said video data stream such that it also does not include supplemental enhancement information messages.

<Aspect 119>
An apparatus (200) for receiving an input video data stream, said input video data stream being video encoded,
said apparatus (200) being configured to generate a processed video data stream from said input video data stream;
The apparatus (200) performs a network abstraction layer unit of one access unit of the plurality of access units of an encoded video sequence of one or more encoded video sequences of the processed video data stream. an indication (general_same_pic_timing_in_all_ols_flag) indicating whether the scalable non-nested picture timing supplemental enhancement information message is defined to apply to all output layer sets of the plurality of output layer sets of the access unit; configured to generate said processed video data stream, such that the stream comprises;
If the indication (general_same_pic_timing_in_all_ols_flag) has a first value, then the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit indicates all of the plurality of output layer sets of the access unit. defined to be applied to the output layer set,
If the indication (general_same_pic_timing_in_all_ols_flag) has a value different from the first value, then the indication is that the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit is the undefined whether to apply to all output layer sets of multiple output layer sets,
A device (200).

<Aspect 120>
If said indication (general_same_pic_timing_in_all_ols_flag) has said first value, said apparatus (200) is configured such that said network abstraction layer unit does not include any other Supplemental Enhancement Information message different from a Picture Timing Supplemental Enhancement Information message. 120. The apparatus (200) of aspect 119, configured to generate said processed video data stream.

<Aspect 121>
if said indication (general_same_pic_timing_in_all_ols_flag) has said first value, said apparatus (200) generates said processed video data stream such that said network abstraction layer unit does not contain any other supplemental enhancement information messages; 121. Apparatus (200) according to aspect 119 or 120, configured to:

<Aspect 122>
When the indication (general_same_pic_timing_in_all_ols_flag) has the first value, the apparatus (200) controls each access unit of the plurality of access units of one coded video sequence among the one or more coded video sequences. , for each network abstraction layer unit containing a non-scalable nested picture timing supplemental enhancement information message, said network abstraction layer unit does not contain any other supplemental enhancement information message different from the picture timing supplemental enhancement information message or any 122. The apparatus (200) according to any of aspects 119-121, configured to generate said processed video data stream such that it also does not include other supplemental enhancement information messages.

<Aspect 123>
If said indication (general_same_pic_timing_in_all_ols_flag) has said first value, said apparatus (200) controls each access unit of said plurality of access units of each of said one or more encoded video sequences of said processed video data stream. , for each network abstraction layer unit containing a non-scalable nested picture timing supplemental enhancement information message, said network abstraction layer unit does not contain any other supplemental enhancement information message different from the picture timing supplemental enhancement information message 122. The apparatus (200) according to any of aspects 119-121, configured to generate said processed video data stream so as not to include any other supplemental enhancement information message.

<Aspect 124>
A video decoder (300) for receiving a video data stream containing video, comprising:
said video decoder (300) configured to decode said video from said video data stream;
The video data stream comprises a scalable nest of network abstraction layer units of one access unit of the plurality of access units of an encoded video sequence of one or more encoded video sequences of the video data stream. an indication (general_same_pic_timing_in_all_ols_flag) indicating whether a picture timing supplemental enhancement information message is defined to be applied to all output layer sets of the plurality of output layer sets of the access unit;
If the indication (general_same_pic_timing_in_all_ols_flag) has a first value, then the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit indicates all of the plurality of output layer sets of the access unit. defined to apply to the output layer set,
If the indication (general_same_pic_timing_in_all_ols_flag) has a value different from the first value, then the indication is that the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit is the plurality of does not define whether it applies to all output layer sets in the output layer set of
the video decoder (300) is configured to decode the video in response to the representation;
A video decoder (300).

<Aspect 125>
125. The video decoder of aspect 124, wherein if the indication (general_same_pic_timing_in_all_ols_flag) has the first value, then the network abstraction layer unit does not include any other supplemental enhancement information message different from a picture timing supplemental enhancement information message. (300).

<Aspect 126>
126. A video decoder (300) according to aspect 124 or 125, wherein if said indication (general_same_pic_timing_in_all_ols_flag) has said first value, said network abstraction layer unit does not include any other supplemental enhancement information message.

<Aspect 127>
if the indication (general_same_pic_timing_in_all_ols_flag) has the first value, scalable non-nested picture timing of each access unit of the plurality of access units of one coded video sequence among the one or more coded video sequences; For each network abstraction layer unit containing a Supplemental Enhancement Information message, the network abstraction layer does not contain any other Supplemental Enhancement Information message different from the Picture Timing Supplemental Enhancement Information message or any other Supplementary Enhancement Information message. 127. The video decoder (300) of any of aspects 124-126, not comprising:

<Aspect 128>
if the indication (general_same_pic_timing_in_all_ols_flag) has the first value, a scalable non-nested picture timing supplemental extension of each access unit of the plurality of access units of each of the one or more encoded video sequences of the video data stream. For each network abstraction layer unit containing an information message, said network abstraction layer unit does not contain or contains any other supplemental enhancement information message different from the picture timing supplemental enhancement information message. 127. The video decoder (300) of any of aspects 124-126, wherein:

<Aspect 129>
A device (200) according to any of aspects 119-123;
A video decoder (300) according to any of aspects 124-128;
with
The video decoder (300) according to any of aspects 124-128 is configured to receive the processed video data stream of the apparatus (200) according to any of aspects 119-123,
The video decoder (300) according to any of aspects 124-128 is configured to decode video from an output video data stream of the apparatus (200) according to any of aspects 119-123,
system.

<Aspect 130>
119. The system further comprises a video encoder (100) according to any of aspects 114-118,
The apparatus (200) according to any of aspects 119-123, wherein the apparatus (200) is configured to receive, as said input video data stream, said video data stream from a video encoder (100) according to any of aspects 114-118. 130. The system according to aspect 129.

<Aspect 131>
A method for encoding video into a video data stream, comprising:
The method comprises scalable non-nested pictures of network abstraction layer units of one access unit of the plurality of access units of an encoded video sequence of one or more encoded video sequences of the video data stream. wherein the video data stream includes an indication (general_same_pic_timing_in_all_ols_flag) indicating whether a timing supplemental enhancement information message is defined to be applied to all output layer sets of the plurality of output layer sets of the access unit; generating a video data stream;
If the indication (general_same_pic_timing_in_all_ols_flag) has a first value, then the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit indicates all of the plurality of output layer sets of the access unit. defined to be applied to the output layer set,
If the indication (general_same_pic_timing_in_all_ols_flag) has a value different from the first value, then the indication is that the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit is the undefined whether to apply to all output layer sets of multiple output layer sets,
Method.

<Aspect 132>
1. A method for receiving an input video data stream, said input video data stream being video encoded,
The method includes generating a processed video data stream from the input video data stream;
The method comprises scalable nesting of network abstraction layer units of one access unit of the plurality of access units of an encoded video sequence of one or more encoded video sequences of the processed video data stream. The processed video data stream includes an indication (general_same_pic_timing_in_all_ols_flag) indicating whether a picture timing supplemental enhancement information message is defined to be applied to all output layer sets of the plurality of output layer sets of the access unit. generating the processed video data stream as
If the indication (general_same_pic_timing_in_all_ols_flag) has a first value, then the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit indicates all of the plurality of output layer sets of the access unit. defined to be applied to the output layer set,
If the indication (general_same_pic_timing_in_all_ols_flag) has a value different from the first value, then the indication is that the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit is the undefined whether to apply to all output layer sets of multiple output layer sets,
Method.

<Aspect 133>
A method for receiving a video data stream containing video, comprising:
The method includes decoding the video from the video data stream;
The video data stream comprises a scalable nest of network abstraction layer units of one access unit of the plurality of access units of an encoded video sequence of one or more encoded video sequences of the video data stream. an indication (general_same_pic_timing_in_all_ols_flag) indicating whether a picture timing supplemental enhancement information message is defined to be applied to all output layer sets of the plurality of output layer sets of the access unit;
If the indication (general_same_pic_timing_in_all_ols_flag) has a first value, then the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit indicates all of the plurality of output layer sets of the access unit. defined to be applied to the output layer set,
If the indication (general_same_pic_timing_in_all_ols_flag) has a value different from the first value, then the indication is that the scalable non-nested picture timing supplemental enhancement information message of the network abstraction layer unit of the access unit is the plurality of does not define whether it applies to all output layer sets in the output layer set of
decoding the video is performed in response to the display;
Method.

<Aspect 134>
134. A computer program for implementing the method of any of aspects 131-133 when run on a computer or signal processor.

<Aspect 135>
a video data stream,
a video is encoded in the video data stream;
the video data stream includes one or more scalable nested Supplemental Enhancement Information messages;
the one or more scalable nested supplemental extension information messages comprising a plurality of syntax elements;
each syntax element of one or more syntax elements of the plurality of syntax elements is the same size in each of the scalable nested supplemental enhancement information messages of the video data stream or part of the video data stream; defined to have
video data stream.

<Aspect 136>
the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages comprise the plurality of syntax elements;
each syntax element of the one or more syntax elements of the plurality of syntax elements in each of the scalable nested supplemental enhancement information messages of the video data stream or the portion of the video data stream; and defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of the video data stream or the portion of the video data stream;
136. A video data stream according to aspect 135.

<Aspect 137>
said video data stream comprising a plurality of access units, each access unit of said plurality of access units being assigned to one of a plurality of pictures of said video;
said part of said video data stream being an access unit among said plurality of access units of said video data stream;
each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in each of the scalable nested supplemental enhancement information messages of the access unit;
136. A video data stream according to aspect 135.

<Aspect 138>
the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages comprise the plurality of syntax elements;
Each syntax element of said one or more syntax elements of said plurality of syntax elements includes each of said scalable nested supplemental extension information messages of said access unit and said scalable non-nested supplemental extension of said access unit. defined to have the same size in each of the information messages,
138. A video data stream according to aspect 137.

<Aspect 139>
said portion of said video data stream is an encoded video sequence of said video data stream;
each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in each of the scalable nested supplemental enhancement information messages of the encoded video sequence; Ru
136. A video data stream according to aspect 135.

<Aspect 140>
the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages comprise the plurality of syntax elements;
Each syntax element of the one or more syntax elements of the plurality of syntax elements is a respective one of the scalable nested supplemental enhancement information messages of the encoded video sequence and the scalable extension information message of the encoded video sequence. defined to have the same size in each of the non-nested Supplemental Extension Information messages,
A video data stream according to aspect 139.

<Aspect 141>
Each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in each of the scalable nested supplemental enhancement information messages of the video data stream. , aspect 135. The video data stream of aspect 135.

<Aspect 142>
each syntax element of the one or more syntax elements of the plurality of syntax elements is each of the scalable nested supplemental enhancement information messages of the video data stream and the scalable non-nested of the video data stream; 142. The video data stream of aspect 141, defined to have the same size in each of the Supplemental Enhancement Information messages.

<Aspect 143>
The video data stream or the portion of the video data stream includes at least one buffering period supplemental enhancement information message, the buffering period supplemental enhancement information message comprising the one of the plurality of syntax elements. 143. A video data stream according to any of aspects 135-142, defining said size of each syntax element of the above syntax elements.

<Aspect 144>
the buffering period supplemental extension information message to define the size for each syntax element of the one or more syntax elements of the plurality of syntax elements;
bp_cpb_initial_removal_delay_length_minus1 element,
bp_cpb_removal_delay_length_minus1 element,
bp_dpb_output_delay_length_minus1 element,
bp_du_cpb_removal_delay_increment_length_minus1 element,
bp_dpb_output_delay_du_length_minus 1 element
144. The video data stream of aspect 143, comprising at least one of:

<Aspect 145>
wherein for each access unit of a plurality of access units of said video data stream comprising a scalable nested buffering period supplemental enhancement information message, said access unit also comprising a scalable non-nested buffering period supplemental enhancement information message, an aspect 143 or 144 video data stream.

<Aspect 146>
For each single layer access unit of a plurality of single layer access units of said video data stream comprising a scalable nested buffering period supplemental extension information message, said single layer access unit includes a scalable non nested buffering period supplemental extension 145. A video data stream according to aspect 143 or 144, also comprising information messages.

<Aspect 147>
A video encoder (100) comprising:
said video encoder (100) configured to encode video into a video data stream;
the video encoder (100) is configured to generate the video data stream such that the video data stream includes one or more scalable nested supplemental enhancement information messages;
the video encoder (100) is configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages include a plurality of syntax elements;
The video encoder (100) is configured such that each syntax element of one or more syntax elements of the plurality of syntax elements is the scalable nested supplemental extension of the video data stream or a portion of the video data stream. configured to generate the video data stream as defined to have the same size in each of the information messages;
A video encoder (100).

<Aspect 148>
the video encoder (100) is configured to generate the video data stream such that the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
The video encoder (100) is configured to convert the video data stream such that the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include the plurality of syntax elements. is configured to generate
The video encoder (100) is configured such that each syntax element of the one or more syntax elements of the plurality of syntax elements is the scalable nested of the video data stream or the portion of the video data stream. the video data stream as defined to have the same size in each of the Supplemental Enhancement Information messages and in each of the scalable non-nested Supplementary Enhancement Information messages of the video data stream or the portion of the video data stream; configured to generate
147. The video encoder (100) of aspect 147.

<Aspect 149>
The video encoder (100) is configured to generate the video data stream such that the video data stream comprises a plurality of access units, each access unit of the plurality of access units being a plurality of pictures of the video. is assigned to one of
said portion of said video data stream is one access unit of said plurality of access units of said video data stream;
the video encoder (100) wherein each syntax element of the one or more syntax elements of the plurality of syntax elements has the same size in each of the scalable nested supplemental enhancement information messages of the access unit; configured to generate the video data stream as defined as comprising
147. The video encoder (100) of aspect 147.

<Aspect 150>
the video encoder (100) is configured to generate the video data stream such that the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
The video encoder (100) is configured to convert the video data stream such that the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include the plurality of syntax elements. is configured to generate
The video encoder (100) determines that each syntax element of the one or more syntax elements of the plurality of syntax elements is in each of the scalable nested supplemental enhancement information messages of the access unit and the access unit. configured to generate the video data stream as defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of a unit;
149. The video encoder (100) of aspect 149.

<Aspect 151>
said portion of said video data stream is an encoded video sequence of said video data stream;
The video encoder (100) determines that each syntax element of the one or more syntax elements of the plurality of syntax elements is the same in each of the scalable nested supplemental enhancement information messages of the encoded video sequence. configured to generate said video data stream as defined to have a size;
147. The video encoder (100) of aspect 147.

<Aspect 152>
the video encoder (100) is configured to generate the video data stream such that the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
The video encoder (100) is configured to convert the video data stream such that the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages include the plurality of syntax elements. is configured to generate
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is in each of the scalable nested supplemental enhancement information messages of the encoded video sequence; and configured to generate the video data stream as defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of the encoded video sequence;
152. The video encoder (100) of aspect 151.

<Aspect 153>
The video encoder (100) determines that each syntax element of the one or more syntax elements of the plurality of syntax elements is the same size in each of the scalable nested supplemental enhancement information messages of the video data stream. 148. The video encoder (100) of aspect 147, configured to generate said video data stream, defined as having:

<Aspect 154>
The video encoder (100) determines that each syntax element of the one or more syntax elements of the plurality of syntax elements is in each of the scalable nested supplemental enhancement information messages of the video data stream and the 154. The video encoder (100) of aspect 153, configured to generate the video data stream as defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of a video data stream.

<Aspect 155>
The video encoder (100) is configured to generate the video data stream such that the video data stream or the portion of the video data stream includes at least one buffering period supplemental enhancement information message; 155. The video encoder according to any of aspects 147-154, wherein the ring period supplemental extension information message defines the size of each syntax element of the one or more syntax elements of the plurality of syntax elements ( 100).

<Aspect 156>
wherein the buffering period supplemental extension information message to define the size for each syntax element of the one or more syntax elements of the plurality of syntax elements comprises:
bp_cpb_initial_removal_delay_length_minus1 element,
bp_cpb_removal_delay_length_minus1 element,
bp_dpb_output_delay_length_minus1 element,
bp_du_cpb_removal_delay_increment_length_minus1 element,
bp_dpb_output_delay_du_length_minus 1 element
156. The video encoder (100) of aspect 155, configured to generate said video data stream to include at least one of:

<Aspect 157>
The video encoder (100) performs, for each access unit of a plurality of access units of the video data stream, including a scalable nested buffering period supplemental enhancement information message, a buffering period supplemental buffering period in which the access unit is not scalable nested. 157. Video encoder (100) according to aspect 155 or 156, configured to generate said video data stream to also include an enhancement information message.

<Aspect 158>
The video encoder (100) for each single layer access unit of a plurality of single layer access units of the video data stream comprising a scalable nested buffering period supplemental enhancement information message. 157. Video encoder (100) according to aspect 155 or 156, configured to generate said video data stream to also include non-nested buffering period supplemental enhancement information messages.

<Aspect 159>
An apparatus (200) for receiving an input video data stream, said input video data stream being video encoded,
said device (200) being configured to generate an output video data stream from said input video data stream;
the video data stream includes one or more scalable nested Supplemental Enhancement Information messages;
the one or more scalable nested supplemental extension information messages comprising a plurality of syntax elements;
each syntax element of one or more syntax elements of the plurality of syntax elements is the same size in each of the scalable nested supplemental enhancement information messages of the video data stream or part of the video data stream; is defined to have
said apparatus (200) is configured to process said one or more scalable nested supplemental enhancement information messages;
A device (200).

<Aspect 160>
the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages comprise the plurality of syntax elements;
each syntax element of the one or more syntax elements of the plurality of syntax elements in each of the scalable nested supplemental enhancement information messages of the video data stream or the portion of the video data stream; and defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of the video data stream or the portion of the video data stream;
said apparatus (200) is configured to process said one or more scalable nested supplemental enhancement information messages and said one or more scalable non-nested supplemental enhancement information messages;
160. Apparatus (200) according to aspect 159.

<Aspect 161>
said video data stream comprising a plurality of access units, each access unit of said plurality of access units being assigned to one of a plurality of pictures of said video;
said portion of said video data stream is one access unit of said plurality of access units of said video data stream;
each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in each of the scalable nested supplemental enhancement information messages of the access unit;
160. Apparatus (200) according to aspect 159.

<Aspect 162>
the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages comprise the plurality of syntax elements;
each syntax element of said one or more syntax elements of said plurality of syntax elements is included in each of said scalable nested supplemental enhancement information messages of said access unit and said scalable non-nested supplement of said access unit; defined to have the same size in each of the Extended Information messages,
said apparatus (200) is configured to process said one or more scalable nested supplemental enhancement information messages and said one or more scalable non-nested supplemental enhancement information messages;
162. Apparatus (200) according to aspect 161.

<Aspect 163>
said portion of said video data stream is an encoded video sequence of said video data stream;
each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in each of the scalable nested supplemental enhancement information messages of the encoded video sequence; Ru
160. Apparatus (200) according to aspect 159.

<Aspect 164>
the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages comprise the plurality of syntax elements;
Each syntax element of the one or more syntax elements of the plurality of syntax elements is included in each of the scalable nested supplemental enhancement information messages of the encoded video sequence and of the encoded video sequence. defined to have the same size in each of the scalable non-nested Supplemental Extension Information messages,
said apparatus (200) is configured to process said one or more scalable nested supplemental enhancement information messages and said one or more scalable non-nested supplemental enhancement information messages;
164. Apparatus (200) according to aspect 163.

<Aspect 165>
Each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in each of the scalable nested supplemental enhancement information messages of the video data stream. 160. The apparatus (200) according to claim 159, aspect 159.

<Aspect 166>
each syntax element of said one or more syntax elements of said plurality of syntax elements in each of said scalable nested supplemental enhancement information messages of said video data stream and in said scalable nest of said video data stream; defined to have the same size in each of the Supplemental Extension Information messages that are not
said apparatus (200) is configured to process said one or more scalable nested supplemental enhancement information messages and said one or more scalable non-nested supplemental enhancement information messages;
166. Apparatus (200) according to aspect 165.

<Aspect 167>
The video data stream or the portion of the video data stream includes at least one buffering period supplemental enhancement information message, the buffering period supplemental enhancement information message comprising the one of the plurality of syntax elements. Define a size above,
said device (200) is configured to process said at least one buffering period supplemental enhancement information message;
167. The apparatus (200) according to any of aspects 159-166.

<Aspect 168>
the Buffering Period Supplemental Extension Information message to define the size of the one or more of the plurality of syntax elements;
bp_cpb_initial_removal_delay_length_minus1 element,
bp_cpb_removal_delay_length_minus1 element,
bp_dpb_output_delay_length_minus1 element,
bp_du_cpb_removal_delay_increment_length_minus1 element,
bp_dpb_output_delay_du_length_minus 1 element
168. Apparatus (200) according to aspect 167, comprising at least one of:

<Aspect 169>
for each access unit of a plurality of access units of said video data stream comprising a scalable nested buffering period supplemental enhancement information message, said access unit also comprising a scalable non-nested buffering period supplemental enhancement information message;
said apparatus (200) is configured to process said scalable nested supplemental enhancement information message and said scalable non-nested supplemental enhancement information message;
169. Apparatus (200) according to aspect 167 or 168.

<Aspect 170>
For each single layer access unit of a plurality of single layer access units of said video data stream comprising a scalable nested buffering period supplemental extension information message, said single layer access unit includes a scalable non nested buffering period supplemental extension including informational messages,
said apparatus (200) is configured to process said scalable nested supplemental enhancement information message and said scalable non-nested supplemental enhancement information message;
169. Apparatus (200) according to aspect 167 or 168.

<Aspect 171>
A video decoder (300) for receiving a video data stream containing video, comprising:
said video decoder (300) configured to decode said video from said video data stream;
the video data stream includes one or more scalable nested Supplemental Enhancement Information messages;
the one or more scalable nested supplemental extension information messages comprising a plurality of syntax elements;
each syntax element of one or more syntax elements of the plurality of syntax elements is the same size in each of the scalable nested supplemental enhancement information messages of the video data stream or part of the video data stream; is defined to have
the video decoder (300) is configured to decode the video in response to the one or more syntax elements of the plurality of syntax elements;
A video decoder (300).

<Aspect 172>
the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages comprise the plurality of syntax elements;
each syntax element of the one or more syntax elements of the plurality of syntax elements in each of the scalable nested supplemental enhancement information messages of the video data stream or the portion of the video data stream; and defined to have the same size in each of the scalable non-nested Supplemental Enhancement Information messages of the video data stream or the portion of the video data stream;
172. The video decoder (300) of aspect 171.

<Aspect 173>
said video data stream comprising a plurality of access units, each access unit of said plurality of access units being assigned to one of a plurality of pictures of said video;
said portion of said video data stream is one access unit of said plurality of access units of said video data stream;
each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in each of the scalable nested supplemental enhancement information messages of the access unit;
172. The video decoder (300) of aspect 171.

<Aspect 174>
the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages comprise the plurality of syntax elements;
each syntax element of said one or more syntax elements of said plurality of syntax elements is included in each of said scalable nested supplemental enhancement information messages of said access unit and said scalable non-nested supplement of said access unit; defined to have the same size in each of the extended information messages,
173. The video decoder (300) of aspect 173.

<Aspect 175>
said portion of said video data stream is an encoded video sequence of said video data stream;
each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in each of the scalable nested supplemental enhancement information messages of the encoded video sequence; Ru
172. The video decoder (300) of aspect 171.

<Aspect 176>
the video data stream includes one or more scalable non-nested supplemental enhancement information messages;
the one or more scalable nested supplemental enhancement information messages and the one or more scalable non-nested supplemental enhancement information messages comprise the plurality of syntax elements;
Each syntax element of the one or more syntax elements of the plurality of syntax elements is included in each of the scalable nested supplemental enhancement information messages of the encoded video sequence and of the encoded video sequence. defined to have the same size in each of the scalable non-nested Supplemental Extension Information messages,
175. The video decoder (300) of aspect 175.

<Aspect 177>
Each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in each of the scalable nested supplemental enhancement information messages of the video data stream. 172. The video decoder (300) of claim 1, aspect 171.

<Aspect 178>
each syntax element of said one or more syntax elements of said plurality of syntax elements in each of said scalable nested supplemental enhancement information messages of said video data stream and in said scalable nest of said video data stream; 178. The video decoder (300) of aspect 177, defined to have the same size in each of the Supplemental Enhancement Information messages that are not supported.

<Aspect 179>
The video data stream or the portion of the video data stream includes at least one buffering period supplemental enhancement information message, the buffering period supplemental enhancement information message comprising the one of the plurality of syntax elements. 179. A video decoder (300) according to any of aspects 171-178, wherein said size of each syntax element of said syntax elements is defined.

<Aspect 180>
the buffering period supplemental extension information message to define the size for each syntax element of the one or more syntax elements of the plurality of syntax elements;
bp_cpb_initial_removal_delay_length_minus1 element,
bp_cpb_removal_delay_length_minus1 element,
bp_dpb_output_delay_length_minus1 element,
bp_du_cpb_removal_delay_increment_length_minus1 element,
bp_dpb_output_delay_du_length_minus 1 element
179. The video decoder (300) of aspect 179, comprising at least one of:

<Aspect 181>
wherein for each access unit of a plurality of access units of said video data stream comprising a scalable nested buffering period supplemental enhancement information message, said access unit also comprising a scalable non-nested buffering period supplemental enhancement information message, an aspect 180. A video decoder (300) according to 179 or 180.

<Aspect 182>
For each single layer access unit of a plurality of single layer access units of said video data stream comprising a scalable nested buffering period supplemental extension information message, said single layer access unit includes a scalable non nested buffering period supplemental extension 181. A video decoder (300) according to aspect 179 or 180, also comprising an information message.

<Aspect 183>
A device (200) according to any of aspects 159-170;
A video decoder (300) according to any of aspects 171-182;
with
182. The video decoder (300) according to any of aspects 171-182, configured to receive said output video data stream of the apparatus (200) according to any of aspects 159-170,
182. The video decoder (300) according to any of aspects 171-182, configured to decode said video from said output video data stream of the apparatus (200) according to any of aspects 159-170,
system.

<Aspect 184>
159. The system further comprises a video encoder (100) according to any of aspects 147-158,
170. The apparatus (200) according to any of aspects 159-170 is arranged to receive, as said input video data stream, said video data stream from a video encoder (100) according to any of aspects 147-158. Ru
184. The system of aspect 183.

<Aspect 185>
A method for encoding video into a video data stream, comprising:
The method includes generating the video data stream such that the video data stream includes one or more scalable nested supplemental enhancement information messages;
The method includes generating the video data stream such that the one or more scalable nested supplemental enhancement information messages include a plurality of syntax elements;
The method further comprises: each syntax element of one or more syntax elements of the plurality of syntax elements each of the scalable nested supplemental enhancement information messages of the video data stream or part of the video data stream; generating said video data stream as defined to have the same size in
Method.

<Aspect 186>
1. A method for receiving an input video data stream, said input video data stream being video encoded,
The method includes generating an output video data stream from the input video data stream;
the video data stream includes one or more scalable nested Supplemental Enhancement Information messages;
the one or more scalable nested supplemental extension information messages comprising a plurality of syntax elements;
each syntax element of one or more syntax elements of the plurality of syntax elements is the same size in each of the scalable nested supplemental enhancement information messages of the video data stream or part of the video data stream; is defined to have
the method includes processing the one or more scalable nested supplemental enhancement information messages;
Method.

<Aspect 187>
A method for receiving a video data stream containing video, comprising:
The method includes decoding the video from the video data stream;
the video data stream includes one or more scalable nested Supplemental Enhancement Information messages;
the one or more scalable nested supplemental extension information messages comprising a plurality of syntax elements;
each syntax element of one or more syntax elements of the plurality of syntax elements is the same size in each of the scalable nested supplemental enhancement information messages of the video data stream or part of the video data stream; is defined to have
decoding the video is performed in response to the one or more syntax elements of the plurality of syntax elements;
Method.

<Aspect 188>
188. A computer program for implementing the method of any of aspects 185-187 when run on a computer or signal processor.

Claims (18)

A video decoder (300) for receiving a video data stream in which video is stored, comprising:
said video decoder (300) configured to decode said video from said video data stream;
The video decoder (300) is configured to decode the video according to a current picture access unit removal time of a plurality of pictures of the video from an encoded picture buffer;
The video decoder (300), in response to an indication indicating whether to use the coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer. configured to decode said video;
A video decoder (300). The video decoder (300) is configured to determine, depending on a concatenated flag, whether to use the coded picture buffer delay offset information to determine the access unit removal time for the current picture. 2. The video decoder (300) of claim 1, wherein If the concatenation flag is set to a first value, the video decoder (300) is configured to use the coded picture buffer delay offset information to determine one or more access unit removal times. ,
If the concatenated flag is set to a second value different from the first value, the video decoder (300) uses the coded picture buffer delay to determine the one or more access unit removal times. 3. The video decoder (300) of claim 2, configured not to use offset information. 4. The method of any of claims 1-3, wherein the access unit removal time of at least one of the plurality of pictures of the video from the coded picture buffer is dependent on the coded picture buffer delay offset information. A video decoder (300). said video decoder (300) configured to decode said video depending on whether to use coded picture buffer delay offset information to determine said access unit removal time for said current picture; A video decoder (300) according to any preceding claim, wherein the access unit removal time of a current picture depends on the position of the current picture within the video. A video encoder (100) comprising:
said video encoder (100) configured to encode video into a video data stream;
the video encoder (100) is configured to generate the video data stream such that the video data stream includes encoded picture buffer delay offset information;
The video encoder (100) uses the video data stream to determine the access unit removal time of the current picture from a coded picture buffer used to decode the video at the decoder side. configured to generate the video data stream to include an indication of whether to use picture buffer delay offset information;
A video encoder (100). 7. The video encoder (100) of claim 6, wherein the video encoder (100) is configured to generate the video data stream such that the video data stream includes a concatenation flag. if the concatenation flag is set to a first value, the concatenation flag indicates that the coded picture buffer delay offset information should be used to determine one or more access unit removal times;
When the concatenation flag is set to a second value different from the first value, the concatenation flag indicates that the indicated offset is not used to determine the one or more access unit removal times. indicates a
A video encoder (100) according to claim 7. The video encoder comprises a coded picture buffer delay offset that the video data stream can use to determine an access unit removal time of at least one of the plurality of pictures of the video from the coded picture buffer. A video encoder (100) according to any of claims 6 to 8, adapted to generate said video data stream to include information of . The video encoder converts the video data stream such that the video data stream includes information of the position of the current picture within the video that can be used to determine an access unit removal time for the current picture. A video encoder (100) according to any of claims 6 to 9, adapted to generate . a video data stream,
a video is encoded in the video data stream;
the video data stream includes coded picture buffer delay offset information;
The video data stream uses the coded picture buffer delay offset information to determine a current picture access unit removal time from a coded picture buffer used to decode the video at a decoder side. including an indication of whether
video data stream. 12. The video data stream of claim 11, wherein said video data stream includes concatenation flags. if the concatenation flag is set to a first value, the concatenation flag indicates that the coded picture buffer delay offset information should be used to determine one or more access unit removal times;
When the concatenation flag is set to a second value different from the first value, the concatenation flag indicates that the indicated offset is not used to determine the one or more access unit removal times. indicates a
Video data stream according to claim 12. the video data stream includes information of the coded picture buffer delay offset that can be used to determine an access unit removal time of at least one of the plurality of pictures of the video from the coded picture buffer; Video data stream according to claim 13. The video data stream is configured to generate the video data stream such that it includes information of the position of the current picture within the video that can be used to determine an access unit removal time for the current picture. A video encoder according to any of claims 11-14, wherein the video encoder is A method for receiving a video data stream in which video is stored, comprising:
The method includes decoding the video from the video data stream;
decoding the video is performed in response to an access unit removal time of a current picture of a plurality of pictures of the video from an encoded picture buffer;
Decoding the video is performed in response to an indication indicating whether to use coded picture buffer delay offset information to determine the access unit removal time of the current picture from the coded picture buffer. to be
Method. A method for encoding video into a video data stream, comprising:
The method includes generating the video data stream such that the video data stream includes encoded picture buffer delay offset information;
The step of generating the video data stream comprises the step of determining the access unit removal time of a current picture from a coded picture buffer that the video data stream is used to decode the video at a decoder side. including an indication of whether to use coded picture buffer delay offset information;
Method. Computer program for implementing the method of claim 16 or 17 when run on a computer or signal processor.