KR20150008331A - Method for signalling of scalable bitstream information in a video bitstream - Google Patents

Method for signalling of scalable bitstream information in a video bitstream Download PDF

Info

Publication number
KR20150008331A
KR20150008331A KR20140000412A KR20140000412A KR20150008331A KR 20150008331 A KR20150008331 A KR 20150008331A KR 20140000412 A KR20140000412 A KR 20140000412A KR 20140000412 A KR20140000412 A KR 20140000412A KR 20150008331 A KR20150008331 A KR 20150008331A
Authority
KR
South Korea
Prior art keywords
layer
layers
bitstream
sub
time
Prior art date
Application number
KR20140000412A
Other languages
Korean (ko)
Inventor
강정원
이진호
이하현
최진수
김진웅
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority to KR20140072591A priority Critical patent/KR20150008805A/en
Publication of KR20150008331A publication Critical patent/KR20150008331A/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability

Abstract

The present invention is a technology related to a method for adaptively converting and decoding image-coded bit streams of a multi-layered structure including a time hierarchy. The present invention relates to a signaling method capable of informing hierarchical information existing in a bit stream which is, after a hierarchical bit stream is adaptively converted in an extractor, adaptively converted to another extractor or decoder; and to a technology related to signaling for notifying the change of a direct referring hierarchy of a certain hierarchy.

Description

[0001] The present invention relates to a video bitstream,

The present invention relates to image processing techniques.

In signaling the layer information changed during bitstream coding or adaptive conversion in the prior art, signaling information of all layers including the changed layer (i.e., unaltered layer), or time layer information among changed layer related information, There is a problem that can not be done.

In order to solve the problems of the prior art described above, the present invention provides a method and apparatus for signaling only information on a layer that has changed, not all layers, during bitstream coding or adaptive conversion, or signaling time- The present invention is directed to an adaptive transform and a decoding method, and more particularly, to an adaptive transform or decoding method.

According to an embodiment of the present invention, a method of hierarchical information representation of a video bitstream is provided.

According to the present invention, when bitstream coding or adaptive conversion is performed, signaling is performed only on information on a changed layer, not on all layers, or signaling time-layer information among changed layer-related information and adaptive conversion is performed by another adaptive converter, The layer information included in the bitstream transmitted through the signaled information is grasped and utilized for adaptive conversion or decoding.

□ Hierarchical information representation of adaptive transformed video bitstream

Figure pat00001

[ E1 ] Space / image quality, viewpoint, time Scalability  At least one of Scaler Encoding to support capability

In encoding a video signal, the basic unit of the encoded bitstream is a Network Abstraction Layer (NAL) unit. When each NAL unit includes specific layers, a space / image quality or a view layer is integrated And the temporal_id information identifying the layer_id and the time (sub) layer (the temporal layer is referred to as the temporal sub-layer).

Each layer_id value is information for mapping information to identifiers (e.g., dependencyId for a spatial / picture quality layer identifier, ViewId for a view layer identifier, etc.) for identifying layers existing in the bit stream among space / picture quality or view layer, signaling from the parameter set (VPS).

Later sets of layers can be configured with extractable layers, and one or more layer sets configured can be signaled in VPS.

Each layer set includes one or more layers (having a specific layer_id), and a lower layer for decoding the highest layer of the layer set is included in the same layer set, and a bit composed of layers included in the layer set A stream may also contain a layer set of sub-sets of layers included.

The bit stream composed of the layers included in each layer set may be a conformance bitstream capable of normally decoding the highest layer in the decoder.

The layer corresponding to each layer_id may have a time sub-layer, and the maximum number of temporal sub-layers for each layer corresponding to each layer_id in the entire bit stream may be different .

[Figure 1]

Figure pat00002

[ E2 ] Encoded Bitstream  Adaptive transform (extract) to include the desired space / image quality, viewpoint, time layer

[E2-1] The adaptive converter takes as input the encoded bit stream, the layer set to be extracted, and the maximum time sublayer identifier to extract, and selects a time sub-layer among all layers having layer_id values included in the layer set It is possible to extract and output only the NAL units whose temporal identifiers (temporal_id) are equal to or smaller than the inputted maximum time sublayer identifier.

[E2-2] It is possible to generate signaling informing the layers included in the extracted bitstream and the time sublayer.

Signals indicating the layers included in the extracted bit stream and the time sub-layer may be as shown in FIG.

Layer_not_present_flag is signaled as 0 in the layer included in the currently extracted bitstream for the layers (0th to vps_max_layers_minus1th layer) generated in the bitstream coding, and layer_not_present_flag is signaled as 1 when the layer_not_present_flag is not included have.

(Max_sub_layers_minus1, which is the value of the maximum number of time sub-layers included in the extracted bit stream, minus one).

[Figure 2]

Figure pat00003

Signals indicating the layers included in the extracted bit stream and the time sub-layer may be the same as in [FIG. 3].

It is possible to signal the changed_layers_flag indicating whether at least one layer among the entire layers has been changed.

In addition, the number of time sub-layers in the extracted bit stream can be signaled as changed_max_sub_layers_flag, which indicates whether or not the number of time sub-layers differs from the number of time sub-layers included in the entire bit stream generated at the time of encoding.

If the changed_layers_flag is 1, layer_not_present_flag is signaled as 0 in the layer included in the currently extracted bitstream for the layers (0th to vps_max_layers_minus 1th layer) generated in the bitstream coding, and if layer_not_present_flag is not included layer_present_flag can be signaled as 1.

When the number of time sub-layers in the extracted bit stream is different from the number of time sub-layers included in the entire bit stream generated at the time of encoding (changed_max_sub_alyers_flag = 1), a new_vps_max_sub_layers_minus1 Signaling.

[Figure 3]

Figure pat00004

Signals indicating the layers included in the extracted bit stream and the time sub-layer may be the same as in [FIG. 4].

Layer_not_present_flag is signaled as 0 in the layer included in the currently extracted bitstream for the layers (0th to vps_max_layers_minus1th layer) generated in the bitstream coding, and layer_not_present_flag is signaled as 1 when the layer_not_present_flag is not included have.

It is possible to signal (for example, through changed_max_sub_layer_flag) that the number of time sub-layers in the extracted bit stream is different from the number of time sub-layers included in the entire bit stream generated at the time of encoding. That is, when changed_max_sub_layer_flag is 1, it means that the number of time sub-layers is different from that of a bit stream generated at the time of encoding, and when it is 0, it means that the number of time sub-layers is the same.

When the number of time sub-layers is different from the bit stream generated at the time of encoding, new_max_sub_layers_flag [i] is generated for the ith layer whose number of time sub-layers is changed with respect to the layers (0th to vps_max_layers_minus first layer) Can be signaled as 1 and signaled to 0 for the same layer. At this time, signaling (for example, new_sub_layers_vps_max_minus1 [i]) indicating that the time sublayer is signaled (for example, new_max_sub_layers_flag [i] = 1) .

[Figure 4]

Figure pat00005

Signals indicating the layers included in the extracted bit stream and the time sub-layer may be the same as in [FIG. 5].

In addition to the FIG. 4 embodiment, signaling a changed_layers_flag indicating whether at least one layer among all layers has been changed.

If the changed_layers_flag is 1, layer_not_present_flag is signaled as 0 in the layer included in the currently extracted bitstream for the layers (0th to vps_max_layers_minus first layer) generated in the bitstream coding, The signal layer_not_present_flag can be signaled as 1 to the layer_not_present_flag.

[Figure 5]

Figure pat00006

Signals indicating the layers included in the extracted bit stream and the time sub-layer may be the same as in [FIG. 6].

In the embodiment shown in FIG. 5, max_sub_layers_predict_flag [i] may be signaled instead of new_max_sub_layers_flag [i].

If max_sub_layers_predict_flag [i] is 1, new_max_sub_layers_minus1 [i] is inferred as new_max_sub_layers_minus1 [i-1] or vps_max_sub_layers_minus1, and if it is 0, new_max_sub_layers_minus1 [i] can be directly signaled. In addition, when new_max_sub_layers_minus1 [i] is inferred as new_max_sub_layers_minus1 [i-1], new_max_sub_layers_minus1 [0] = 0 can be determined.

[Figure 6]

Figure pat00007

In a similar or opposite form to the embodiments of FIGS. 2 to 6, instead of signaling indicating the number of layers and maximum time sub-layers included in the extracted bit stream, And signaling informing layers and time sub-layers that are not included in the extracted bit stream among the time sub-layers.

The generated signaling can be inserted into the extracted (output) bit stream, and the extracted bit stream can be received by another adaptive converter or a video decoder.

The generated signaling can be transmitted to other adaptive transducers or video decoders without being inserted into the extracted (output) bitstream.

[E2-3] Signaling indicating layer dependency change can be generated as shown in FIG.

it can signal change_info_available_flag [i] indicating whether the layer dependency of the i-layer has been changed.

If the change_info_available_flage [i] is 1, it indicates that the layer dependency of the i layer has been changed, and signaling the changed layer dependency can be signaled.

For example, if the jth reference layer of the i th layer signaled at the VPS is not the direct reference layer of the i th layer, then ref_layer_disable_flag [i] [j] can be signaled as 1 have. On the other hand, ref_layer_disable_flag [i] [j] can be signaled as 0 if the jth reference layer is still not the direct reference layer of the ith layer

At this time, the direct reference layers of the i-th layer changed by the signaling may be a subset of the direct reference layers of the i-th layer signaled in the VPS.

If the change_info_available_flage [i] is 0, it indicates that the layer dependency of the i-th layer has not been changed or signaling for the dependency is unnecessary.

In the case where the direct reference layer is changed and signaling layer dependency change information as described above, the bitstream is adaptively transformed, or when it is desired to change the reference layer directly from a specific access unit (AU) during bitstream coding, Or may be included in the bitstream and signaled immediately before the corresponding AU signaling.

[Figure 7]

Figure pat00008

The extracted bitstream can be used as an input of another adaptive converter to perform [E2-1] and [E2-2].

[ E3 ] Extracted Bitstream  Decryption step

The extracted bitstream may be transmitted to a video decoder to decode the highest layer included in the bitstream. At this time, the decoder may know the layer information included in the bitstream before decrypting the signaling informing the layers and the time sublayer included in the extracted bitstream by referring to the information, and can decode referring to the corresponding signaling information have. The frame rate of the decoded bitstream may be equal to the frame rate that can be supported by the maximum time sublayer identifier included in the highest layer.

When the video decoder receives signaling that the direct reference layer of a specific layer has been changed, it can decode it using the layered dependency change SEI message signaled in addition to the signaled direct reference layer information to the VPS.

Claims (1)

A method for hierarchical information representation of a video bitstream.
KR20140000412A 2013-07-12 2014-01-02 Method for signalling of scalable bitstream information in a video bitstream KR20150008331A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR20140072591A KR20150008805A (en) 2013-07-12 2014-06-16 Method for signalling of scalable bitstream information in a video bitstream

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20130082392 2013-07-12
KR1020130082392 2013-07-12

Publications (1)

Publication Number Publication Date
KR20150008331A true KR20150008331A (en) 2015-01-22

Family

ID=52572024

Family Applications (2)

Application Number Title Priority Date Filing Date
KR20140000412A KR20150008331A (en) 2013-07-12 2014-01-02 Method for signalling of scalable bitstream information in a video bitstream
KR20140072591A KR20150008805A (en) 2013-07-12 2014-06-16 Method for signalling of scalable bitstream information in a video bitstream

Family Applications After (1)

Application Number Title Priority Date Filing Date
KR20140072591A KR20150008805A (en) 2013-07-12 2014-06-16 Method for signalling of scalable bitstream information in a video bitstream

Country Status (1)

Country Link
KR (2) KR20150008331A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108920478A (en) * 2018-04-16 2018-11-30 宁波三星医疗电气股份有限公司 Batch data segmented acquisition approach based on mini system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108920478A (en) * 2018-04-16 2018-11-30 宁波三星医疗电气股份有限公司 Batch data segmented acquisition approach based on mini system
CN108920478B (en) * 2018-04-16 2022-01-28 宁波三星医疗电气股份有限公司 Batch data segmented acquisition method based on small system

Also Published As

Publication number Publication date
KR20150008805A (en) 2015-01-23

Similar Documents

Publication Publication Date Title
JP6233984B2 (en) Virtual reference decoder for multiview video coding
JP5926856B2 (en) Level signaling for layered video coding
US9179157B2 (en) Hypothetical reference decoder for scalable video coding
JP5143829B2 (en) Method and apparatus for decoding scalable video coded bitstream
US9491147B2 (en) DRM content stream transmission apparatus, method, and transmission and reception system
KR20210024510A (en) Method and apparatus for inter-layer prediction based on temporal sub-layer information
TW201804789A (en) Apparatus for multi-view video coding processing
JP2019134444A (en) Method for decoding image and apparatus using the same
WO2015194179A1 (en) Bitstream partitions operation
CN113892260A (en) Method for random access point and picture type identification
WO2020142358A1 (en) Adaptive picture resolution rescaling for inter-prediction and display
KR20120018281A (en) Apparatus and method for encoding/decoding multi-layer videos
IL290796B2 (en) Layered coding and data structure for compressed higher-order ambisonics sound or sound field representations
US20170063958A1 (en) Systems and methods for constraining a bitstream
CN116018782A (en) Method and apparatus for audio mixing
US20140092995A1 (en) Electronic devices for signaling a random access point picture message
CN112118454B (en) Video decoding method, apparatus and computer-readable storage medium
KR20150008331A (en) Method for signalling of scalable bitstream information in a video bitstream
CN113545066A (en) Decoded picture buffer management in video coding
CN113994686A (en) Data unit and parameter set design for point cloud coding
CN113678447A (en) Network abstraction layer unit header
CN113491128A (en) Syntax controlled decoded picture buffer management method
EP4131964A1 (en) Image encoding/decoding method and device for signaling hrd parameters, and computer-readable recording medium in which bitstream is stored
CN114667738A (en) MPD validity expiration processing model
WO2015136945A1 (en) Systems and methods for constraining a bitstream