EP1897377A1 - Method for providing and using information about inter-layer prediction for video signal - Google Patents
Method for providing and using information about inter-layer prediction for video signalInfo
- Publication number
- EP1897377A1 EP1897377A1 EP06747456A EP06747456A EP1897377A1 EP 1897377 A1 EP1897377 A1 EP 1897377A1 EP 06747456 A EP06747456 A EP 06747456A EP 06747456 A EP06747456 A EP 06747456A EP 1897377 A1 EP1897377 A1 EP 1897377A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- layer
- inter
- constrained
- indication information
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
Definitions
- the present invention relates to a method for providing and using information about inter-layer prediction when providing a video signal to a plurality of layers by encoding the video signal .
- a video signal is encoded with a best video quality in such a manner that a low quality video can be presented even though parts of picture sequences (frame sequences intermittently selected from among the picture sequences) derived from the encoding are decoded.
- a motion compensated temporal filter (or filtering) (MCTF) is one of encoding schemes suggested for the SVC scheme .
- an additional assistant picture sequence having a low transmission rate such as a small-sized video and/or a ' picture sequence having the smaller number of frames per second, may be provided in a hierarchy structure having at least one layer
- an assistance sequence (a lower layer sequence) and a main picture sequence (an upper layer sequence) are called a base layer and an enhancement layer, respectively.
- a base layer and an enhancement layer are obtained by encoding the same video source, redundancy information exists in video signals of both layers. Accordingly, in order to improve the coding rate of the enhanced layer, the video signal of the enhanced layer is coded using coding information of the base layer. This is one of inter-layer prediction schemes.
- the current macro block is coded into residual data using image data of a corresponding block in an intra mode of the base layer (this corresponding block temporarily simultaneous with and identical to the macro block of the enhanced layer) .
- the coded macro block is called an 'intra BL mode block', and the specification of the intra BL mode for the macro block may be limited or not.
- the inter-layer prediction may be constrained by allowing the inter-layer prediction only when the corresponding block of the base layer is coded in the intra mode.
- the inter-layer prediction may not be constrained by allowing the inter-layer prediction when the corresponding block of the base layer is coded in an inter mode as well as in an intra mode .
- a encoding mode (in the side of an encoder) or a decoding mode (in the side of a decoder) is determined from one of modes shown in FIGs .
- IA and IB based on the value of a ⁇ constrained_intra_pred_flag' of the base layer.
- both the upper layer (Ll) and the middle layer (L2) are coded by employing the lower layer (L3) as a prediction layer and then are provided to the decoder
- both the upper layer (Ll) and the middle layer (L2) are constrained in a coding scheme for an intra mode block of the lower layer (L3) .
- the constrained_intra__pred_flag of the lower layer (L3) is ⁇ l'
- prediction-constraint is assigned to the upper layer (Dl) and the middle layer (L2) so that the upper layer (Ll) and the middle layer (L2) are coded through a constrained scheme as shown in PIG. IA.
- prediction-unconstraint is assigned to the upper layer (Ll) and the middle layer (L2) so that the upper layer (Ll) and the middle layer (L2) are coded through an unconstraint scheme as shown in FIG. IB.
- the upper layers of the lower layer cannot individually select the inter-layer prediction constraint or the inter-layer prediction unconstraint.
- inter-layer prediction constraint (unconstraint) is determined for "constrained_intra_pred_flag" having a different attribute
- the upper layer may loss the degree of freedom for the inter-layer prediction constraint. In other words, only one of inter-layer prediction constraint and inter-layer prediction unconstraint is forcibly determined for the upper layer.
- an object of the present invention is to provide a method for transmitting information about inter-layer prediction constraint for a video signal through a prediction coded layer and decoding the video signal using the transmitted information.
- a method for encoding an image signal to bit streams of a first layer and a second layer comprising the steps of (1) coding an image block in a picture of the first layer into residual data based on image data of a block of the second layer corresponding to the vide block; and (2) providing indication information through the bit stream of the first layer, the indication information representing whether the coding is achieved in inter-layer prediction constraint or inter-layer prediction unconstraint .
- a method for decoding encoded bit streams of a first layer and a second layer by receiving the encoded bit streams comprising the steps of:(l) determining indication information representing that all or a part of data of the first layer are coded in an inter-layer prediction constraint state or in an inter-layer prediction unconstraint state, the indication information being provided through the bit stream of the first layer,- and (2) determining whether an inter mode block of the second layer is reconstructed first or not in order to reconstruct a corresponding block having a specific mode in a picture of the first layer.
- a method for decoding encoded bit streams of a first layer and a second layer by receiving the encoded bit streams comprising the steps of: (1) determining indication information indicating that use of adjacent inter mode block data is constrained when an intra mode block is reconstructed, the flag being included in the bit stream of the second layer; and (2) determining indication information representing that all or a part of data of the first layer are coded in an inter-layer prediction constraint state or in an inter-layer prediction unconstraint state, the indication information being provided through the bit stream of the first layer if the determined indication information of step (1) indicates that the use of the adjacent inter mode block data is constrained.
- the indication information is allocated with different values depending on types of pictures .
- the types of the pictures are classified into two types including a key picture (or a picture having a low band component) and a non-key picture (or a picture having a high band component) .
- the indication information is classified according to the types of the pictures and has a value representing that the pictures are coded in an inter-layer prediction constraint/unconstraint .
- FIG. IA is a view illustrating a scheme of predicting an intra mode block based on a lower layer according to inter-layer prediction constraint
- FIG. IB is a view illustrating a scheme of predicting an intra mode block based on a lower layer according to inter-layer prediction unconstraint
- FIG. 2 is a view illustrating an example of an inter-layer prediction scheme of upper layers when a video signal is encoded and transmitted through a plurality of layers including at least three layers
- FIG. 3 is a block diagram illustrating the structure of a video signal encoding device employing a scalable coding scheme for a video signal according to the present invention
- FIG. 4 is a block diagram illustrating the structure of a decoder for decoding a data stream transmitted and encoded by the encoding device shown in FIG. 3 ;
- FIG. 5 is a view illustrating an example of syntax used for determining by a decoder whether or not inter-layer prediction is constrained according to an embodiment of the present invention.
- FIG. 6 is a view illustrating an example of syntax used for determining by a decoder whether or not inter-layer prediction is constrained according to another embodiment of the present invention.
- FIG. 3 is a block diagram illustrating the structure of a video signal encoding device employing a video signal scalable coding scheme according to the present invention.
- the device shown in FIG. 3 codes an input video signal in two layers, the following principle of the present invention is applicable between layers even if the device codes the input signal in three layers or more.
- the video signal encoding device shown in FIG. 3 codes an input video signal in two layers, the following principle of the present invention is applicable between layers even if the device codes the input signal in three layers or more.
- an enhanced layer (EL) encoder 1 for scalably encoding an input video signal through a specification scheme (e.g., MCTF or AVC) based on each macro block unit and generating suitable management information
- a texture coding unit 2 for converting the encoded information of each macro block into a compressed bit string
- a motion coding unit 3 for coding motion vectors of a video block obtained from the EL encoder 1 into a compressed bit string through a specific scheme
- a base layer encoder 4 for encoding an input video signal through a specification scheme such as an AVC scheme and generating the sequence of small-sized videos, for example, the sequence of pictures having 25% of an original video size or the sequence of pictures having the same size as the enhanced layer and a low frame rate
- a muxer 5 for encapsulating the output data of the texture coding unit 2 , the encoded video sequence of the BL encoder 4 , and an output vector data of the motion coding unit 120 in a predetermined format, multiplexing the data
- the EL encoder 1 performs a motion estimation operation and a prediction operation with respect to a macro block in a predetermined image frame.
- the EL encoder 1 performs an inter-layer prediction coding using video data and coding information provided from the BL encoder 4, inserts coding information according to the inter-layer prediction coding as macro block information into a suitable header, and transmits the coding information if coding efficiency is improved.
- a current macro block to be coded is determined as an intra-mode macro block, it is determined that a block corresponding to the current macro block is in an intra-mode or in an inter-mode based on information provided from the BL encoder 4.
- the current macro block is specified as an intra BL mode block and coded into residual data using image data of the corresponding block in the base layer.
- the current macro block may be specified as an intra BL mode block (in a case of unconstraint) according to an inter-layer prediction constraint/unconstraint state predetermined for encoding, and coded into the residual data using image data of the corresponding block of the base layer as described above.
- the current macro block may be specified as an intra mode block according to the inter-layer prediction constraint/unconstraint state and coded into residual data based on pixel values of an adjacent macro block.
- specific information including "constrained_inter_layer_pred_flag" maybe set to ⁇ l' . If the constraint is not set, the constrained_inter_layer_jpred_flag may be set to x 0'.
- the set specific information is inserted into a header (a sequence header, a picture or picture group header, or a slice header) to be transmitted.
- the EL encoder 1 codes an image of the current macro block into residual data and specifies the mode of the image of the current macro block as an intra BL mode based on a reconstructed image obtained by performing a reconstruction operation (MC: Motion Compensation or inverse-MCTF) for an inter mode block of the base layer corresponding to the current macro block.
- MC Motion Compensation or inverse-MCTF
- the reconstructed image may be received by requesting the image from the BL encoder 4, and, if the BL encoder 4 temporarily stores image data before the current macro block is coded into the residual data, the stored image data may be used.
- the EL encoder 1 may insert the constraint flag into one of several headers. If the EL encoder 1 inserts the constraint flag into a picture header (PPS; Picture Parameter Set and PPSE; PPS extension) or a slice header, the EL encoder 1 may specify inter-layer prediction constraint according to slices. In addition, the EL encoder 1 may insert the constraint flag into a header for a sequence or a header for a group of pictures (GOP) . In this case, all slices belonging to the sequence or the GOP equally undergo constraint or unconstraint specified by the constraint flag. Description about encoding procedures for a macro block in several block modes will be omitted because the encoding procedures do not directly relate to the present invention.
- PPS Picture Parameter Set and PPSE
- PPS extension Picture Parameter Set and PPSE
- a slice header the EL encoder 1 may specify inter-layer prediction constraint according to slices.
- the EL encoder 1 may insert the constraint flag into a header for a sequence or
- Input image signals are stored in an additional storage unit through encoding procedures including the above-described procedure. Then, all or a part of the image signals are read-out from the storage unit according to the request of a decoder and are transmitted through a transmission channel. The selection for an amount of the image signals is determined according to the capacity of the transmission channel, and description about the selection for the amount of the image signals will be omitted because the selection is regardless of the present invention.
- FIG. 4 is a block diagram illustrating the structure of the decoder for decoding a data stream encoded and transmitted as described above.
- the decoder shown in FIG. 4 includes a de-muxer 15 for dividing the received data stream into a compressed motion vector stream and a compressed macro block information stream, a texture decoding unit 12 for recovering an original uncompressed information stream from the compressed macro block stream, a motion decoding unit 13 for recovering an original uncompressed stream from a compressed motion vector stream, an enhanced layer
- EL EL
- BL base layer
- the BL decoder 14 provides header information included in an input base layer stream to the EL decoder 11 while decoding the input base layer stream such that the EL decoder 11 can use required encoding information (in the header of the base layer stream) of the base layer including motion vector information and macro block mode information.
- the BL decoder 14 provides image data of the decoded base layer picture or a picture, in which a part of blocks is decoded, to the EL decoder 11 according to the direction of the EL decoder 11.
- the EL decoder 11 determines the constrained__inter_layer_jpred_flag, which is an inter-layer prediction constraint flag, in a header of a GOP or a sequence having a picture to be currently decoded among received picture sequences of the enhanced layer. As described through the above encoding procedure, the inter-layer prediction constraint flag may be checked in the picture header or the slice header.
- the EL decoder 11 receives decoded picture data provided by the BL decoder 14 (or reads the decoded picture data from a memory shared between the EL decoder 11 and the BL decoder 14) and reconstructs original image data from residual data of the intra BL mode block based on reconstructed data of blocks in the decoded picture data corresponding to the intra BL mode blocks.
- the EL decoder 11 directs the BL decoder 14 to reconstruct all macro blocks in a slice of the base layer corresponding to the slice to be decoded and provide the reconstructed macro blocks to the EL decoder 11. If the BL decoder 14 is set in such a manner that the BL decoder 14 always provides decoded data for all pictures, it is unnecessary for the EL decoder 11 to request the direction according to conditions. However, since residual prediction is used between layers in addition to inter-layer prediction based on an intra BL mode, it is preferred that the
- 5 BL decoder 14 reconstructs only intra mode block data instead of all data within a picture so as to provide the reconstructed data to the EL decoder 11 and, if there is additional direction, performs a reconstruction operation (the MC or the inverse_MCTF) for inter mode blocks within the picture so as to provide a slice
- the EL decoder 11 reconstructs original image data from residual data of a current intra BL mode block based on reconstructed data of a block corresponding to the BL mode block in a slice having reconstructed data received from the BL decoder
- information about inter-layer prediction constraint may be classified and set according to types of pictures.
- a type of a picture is a key picture or a picture coded
- the EL encoder 1 shown in FIG. 3 may set or reset flag information about ⁇ constrained_inter_layer_pred_L_flag" , thereby transmitting the flag information to the decoder. If the type of the picture is
- the EL encoder 1 shown in FIG. 3 may set or reset flag information about "constrained_inter_layer_pred_H_flag" , thereby transmitting the flag information to the decoder.
- the key picture denotes a picture coded into residual data by performing a prediction operation based on only a quality-base picture.
- the non-key picture denotes a picture coded into residual data based on SNR enhance picture data in addition to the quality-base picture.
- the definition of the key picture is only one example, and the present invention is limited to the definition.
- the two flags have the same usage as the constrained_inter_layer_jpred_flag. Accordingly, the EL decoder 11 shown in FIG. 4 determines the value of the constrained_inter_layer_pred_L_flag if a picture to be decoded is the key picture or the picture having a low band component. If the picture to be decoded is the non-key picture or the picture having a high band component, the EL decoder 11 determines the value of the constrained_inter_layer_jpred_H_flag.
- the reconstruction operation of a BL mode macro block according to the determined value is identical to that of the previous embodiment of the present invention.
- the constrained_intra_j?red_flag which indicates whether or not data in an adjacent inter mode block are used in the reconstruction of an intra mode block
- the BL decoder 14 shown in FIG. 4 performs a reconstruction operation through an MC scheme (an inverse-MCTF scheme) with respect to the adjacent inter mode block in order to reconstruct residual data in the intra mode block of the picture.
- the EL encoder 1 shown in FIG. 1 encodes a macro block to be encoded of the enhanced layer without distinguishing if a block of the base layer corresponding to the macro block is in an inter mode or an intra mode.
- the EL decoder 11 shown in FIG. 4 can obtain reconstructed image data from the BL decoder 14 through the operation such as the MC even for the inter mode block. Accordingly, when the constrained_intra__pred__flag of the base layer is set to ⁇ 0' by the BL encoder 4 (that is, in a case in which constraint is not set with respect to the adjacent block) , the EL encoder 1 shown in FIG.
- the EL encoder 1 codes a specific block to an intra BL mode block according to a predetermined prediction constraint condition for the enhanced layer and transmits the specific block by setting the constrained_inter_layer_pred_flag to ⁇ 0' or ⁇ l' .
- the EL decoder 11 requests a reconstruction operation for the inter mode block from the BL decoder 14 as described above according to the previous embodiment. Accordingly, in this case, the MC operation (or the inverse-MCTF) for data reconstruction must be performed in both layers.
- the EL decoder 11 shown in FIG. 4 determines whether or not constraint is set for inter-layer prediction through a scheme shown in FIG. 5 because the constrained_inter_layer_pred_flag may not be transmitted from the encoder.
- the EL decoder 11 initializes "interlayer_constrained" which is a variable for inter-layer prediction, as a unconstraint state value (i.e., ⁇ 0') and then determines the value of the constrained_intra_j?red_flag transmitted from the BL decoder 14.
- the EL decoder copies the value of the constrained_inter_layer__pred_flag received through a header of the enhanced layer to the value of the interlayer_constrained only if the value of the constrained_intra_pred_flag has ⁇ l'.
- the EL decoder 11 shown in FIG. 4 can recognize based on the value of the interlayer_constrained if constraint is set for inter-layer prediction.
- a procedure of reconstructing original image data from residual data of an intra BL mode macro block according to the state of the inter-layer prediction is identical to the procedure described according to the previous embodiment .
- (constrained_inter__layer_pred_flag) indicating the selected constraint state may be classified and allocated according to types of pictures. For example, the value relating to inter-layer prediction constraint may be carried through the constrained_inter_layer_pred_L_flag which corresponds to a key picture or a picture coded using a low band component or the constrained_inter_layer_pred_H_flag which corresponds to a non-key picture or a picture coded using a high band component .
- both the flags may not be transmitted according to the value of the constrained_intra_pred_flag of the base layer or may be transmitted with the value of ⁇ 0' or x l' as described above.
- the EL decoder 11 shown in FIG. 4 reconstructs an intra BL mode macro block according to the transmission state. If the constrained_intra_jpred_flag of the base layer has the value of ⁇ 0', and if the constrained_inter_layer_jpred_L_flag, or the constrained_inter_layerj?red_H_flag is not transmitted, the EL decoder 11 shown in FIG. 4 performs an operation according to a syntax shown in FIG. 6 and determines whether or not the constraint is set for inter-layer prediction according to the final value of the interlayer_constrained obtained through the operation.
- Information about inter-layer prediction constraint may be delivered using one integrated indicator such as "constrained_inter_layer_pred_idc" without classification and allocation according to types of pictures as described according to the previous embodiment.
- the constrained_inter_layer_pred_idc is set to x 0 ' when representing the constraint inter-layer prediction regardless of the types of pictures.
- the constrained__inter_layer_pred_idc is set to ⁇ l' when representing an inter-layer prediction unconstraint state for a first picture type (e.g., a key picture or a picture having a low band component) , and an inter-layer prediction constraint state for a second picture type (e.g., a non-key picture or a picture having a high band component) .
- the constrained_inter_layer_pred_idc is set to S 2' when representing the inter-layer prediction unconstraint state regardless of the types of pictures.
- the EL decoder 11 shown in FIG. 4 determines whether or not constraint is set for the inter-layer prediction according to types of pictures based on the indication information depending on the indication value defined above.
- the value indicating the case is excluded.
- a decoder of determining information representing inter-layer prediction constraint and performing a reconstruction operation for a corresponding BL mode macro block according to the determination result may be installed at a mobile communication terminal or a device of reproducing recorded media.
- the inter-layer prediction constraint/unconstraint state is directly delivered through a prediction-coded layer instead of a base layer for the inter-layer prediction, thereby individually setting or releasing prediction constraint of each layer when a video signal is encoded and transmitted based on a plurality of layers. Accordingly, coding can be freely performed, and layer coding suitable for an encoding environment can be achieved.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Disclosed is a method for providing and using information about inter-layer prediction when providing a video signal to a plurality of layers by encoding the video signal. The method for encoding an image signal to bit streams of an enhanced layer and a base layer, includes the steps of coding an image block in a picture of the enhanced layer into residual data based on image data of a block of the base layer corresponding to the vide block, and providing indication information through the bit stream of the enhanced layer, the indication information representing whether the coding is achieved in inter-layer prediction constraint or inter-layer prediction unconstraint.
Description
D E S C R I P T I O N
METHOD FOR PROVIDING AND USING INFORMATION ABOUT INTER-LAYER PREDICTION
FOR VIDEO SIGNAL
1. Technical Field
The present invention relates to a method for providing and using information about inter-layer prediction when providing a video signal to a plurality of layers by encoding the video signal .
2. Background Art
According to a Scalable Video Codec (SVC) scheme, a video signal is encoded with a best video quality in such a manner that a low quality video can be presented even though parts of picture sequences (frame sequences intermittently selected from among the picture sequences) derived from the encoding are decoded. A motion compensated temporal filter (or filtering) (MCTF) is one of encoding schemes suggested for the SVC scheme .
However, although picture sequences encoded through the SVC scheme can present a low quality image even if only parts of received picture sequences are processed, image quality is seriously degraded if a bit rate is lowered. In order to overcome the image quality degradation, an additional assistant picture sequence having a low transmission rate, such as a small-sized video and/or a' picture sequence having the smaller number of frames per second, may be provided in a hierarchy structure having at least one layer
On the assumption that two sequences are processed, an assistance sequence (a lower layer sequence) and a main picture sequence (an upper layer sequence) are called a base layer and
an enhancement layer, respectively. However, since the base layer and the enhanced layer are obtained by encoding the same video source, redundancy information exists in video signals of both layers. Accordingly, in order to improve the coding rate of the enhanced layer, the video signal of the enhanced layer is coded using coding information of the base layer. This is one of inter-layer prediction schemes.
For example, when the type of a current macro block in the enhanced layer is determined as an intra mode macro block, the current macro block is coded into residual data using image data of a corresponding block in an intra mode of the base layer (this corresponding block temporarily simultaneous with and identical to the macro block of the enhanced layer) .
The coded macro block is called an 'intra BL mode block', and the specification of the intra BL mode for the macro block may be limited or not. For example, as shown in FIG. IA, the inter-layer prediction may be constrained by allowing the inter-layer prediction only when the corresponding block of the base layer is coded in the intra mode. In addition, as shown in FIG. IB, the inter-layer prediction may not be constrained by allowing the inter-layer prediction when the corresponding block of the base layer is coded in an inter mode as well as in an intra mode .
A encoding mode (in the side of an encoder) or a decoding mode (in the side of a decoder) is determined from one of modes shown in FIGs . IA and IB based on the value of a λconstrained_intra_pred_flag' of the base layer. When a macro block having residual data coded in an intra mode is reconstructed, this flag is used for indicating that a fixed value (constrained_intra_pred_fIg=I) or a reconstructed pixel value (constrained_intra_pred_fIg=O) ) is employed for the adjacent inter mode block.
However, when a video signal is encoded in three layers as
shown in FIG. 2, and when both the upper layer (Ll) and the middle layer (L2) are coded by employing the lower layer (L3) as a prediction layer and then are provided to the decoder, both the upper layer (Ll) and the middle layer (L2) are constrained in a coding scheme for an intra mode block of the lower layer (L3) . In other words, when the constrained_intra__pred_flag of the lower layer (L3) is λl' , prediction-constraint is assigned to the upper layer (Dl) and the middle layer (L2) so that the upper layer (Ll) and the middle layer (L2) are coded through a constrained scheme as shown in PIG. IA. In addition, when the constrained_intra_pred_flag is x0', prediction-unconstraint is assigned to the upper layer (Ll) and the middle layer (L2) so that the upper layer (Ll) and the middle layer (L2) are coded through an unconstraint scheme as shown in FIG. IB. In other words, when inter-layer prediction is performed based on the lower layer (L3) , the upper layers of the lower layer cannot individually select the inter-layer prediction constraint or the inter-layer prediction unconstraint.
In addition, since inter-layer prediction constraint (unconstraint) is determined for "constrained_intra_pred_flag" having a different attribute, if the "constrained_intra_pred_flag" of a lower layer has a specific value from among a plurality of layers, the upper layer may loss the degree of freedom for the inter-layer prediction constraint. In other words, only one of inter-layer prediction constraint and inter-layer prediction unconstraint is forcibly determined for the upper layer.
3. Disclosure of Invention Accordingly, the present invention has been made to solve the above-mentioned problems occurring in the prior art, and an object of the present invention is to provide a method for transmitting information about inter-layer prediction constraint
for a video signal through a prediction coded layer and decoding the video signal using the transmitted information.
To accomplish the above objects, there is provided a method for encoding an image signal to bit streams of a first layer and a second layer, the method comprising the steps of (1) coding an image block in a picture of the first layer into residual data based on image data of a block of the second layer corresponding to the vide block; and (2) providing indication information through the bit stream of the first layer, the indication information representing whether the coding is achieved in inter-layer prediction constraint or inter-layer prediction unconstraint .
According to another aspect of the present invention, there is provided a method for decoding encoded bit streams of a first layer and a second layer by receiving the encoded bit streams, the method comprising the steps of:(l) determining indication information representing that all or a part of data of the first layer are coded in an inter-layer prediction constraint state or in an inter-layer prediction unconstraint state, the indication information being provided through the bit stream of the first layer,- and (2) determining whether an inter mode block of the second layer is reconstructed first or not in order to reconstruct a corresponding block having a specific mode in a picture of the first layer. According to still another aspect of the present invention, there is provided a method for decoding encoded bit streams of a first layer and a second layer by receiving the encoded bit streams, the method comprising the steps of: (1) determining indication information indicating that use of adjacent inter mode block data is constrained when an intra mode block is reconstructed, the flag being included in the bit stream of the second layer; and (2) determining indication information representing that all or a part of data of the first layer are
coded in an inter-layer prediction constraint state or in an inter-layer prediction unconstraint state, the indication information being provided through the bit stream of the first layer if the determined indication information of step (1) indicates that the use of the adjacent inter mode block data is constrained.
According to an embodiment of the present invention, the indication information is allocated with different values depending on types of pictures . According to an embodiment of the present invention, the types of the pictures are classified into two types including a key picture (or a picture having a low band component) and a non-key picture (or a picture having a high band component) .
According to an embodiment of the present invention, the indication information is classified according to the types of the pictures and has a value representing that the pictures are coded in an inter-layer prediction constraint/unconstraint .
4. Brief Description of Drawings The above and other objects, features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:
FIG. IA is a view illustrating a scheme of predicting an intra mode block based on a lower layer according to inter-layer prediction constraint;
FIG. IB is a view illustrating a scheme of predicting an intra mode block based on a lower layer according to inter-layer prediction unconstraint; FIG. 2 is a view illustrating an example of an inter-layer prediction scheme of upper layers when a video signal is encoded and transmitted through a plurality of layers including at least three layers;
FIG. 3 is a block diagram illustrating the structure of a video signal encoding device employing a scalable coding scheme for a video signal according to the present invention;
FIG. 4 is a block diagram illustrating the structure of a decoder for decoding a data stream transmitted and encoded by the encoding device shown in FIG. 3 ;
FIG. 5 is a view illustrating an example of syntax used for determining by a decoder whether or not inter-layer prediction is constrained according to an embodiment of the present invention; and
FIG. 6 is a view illustrating an example of syntax used for determining by a decoder whether or not inter-layer prediction is constrained according to another embodiment of the present invention.
5. Modes for Carrying out the Invention
Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. In the following description and drawings, the same reference numerals are used to designate the same or similar components, and so repetition of the description on the same or similar components will be omitted.
FIG. 3 is a block diagram illustrating the structure of a video signal encoding device employing a video signal scalable coding scheme according to the present invention. Although the device shown in FIG. 3 codes an input video signal in two layers, the following principle of the present invention is applicable between layers even if the device codes the input signal in three layers or more. The video signal encoding device shown in FIG. 3 according to the present invention includes an enhanced layer (EL) encoder 1 for scalably encoding an input video signal through a specification scheme (e.g., MCTF or AVC) based on each macro block
unit and generating suitable management information, a texture coding unit 2 for converting the encoded information of each macro block into a compressed bit string, a motion coding unit 3 for coding motion vectors of a video block obtained from the EL encoder 1 into a compressed bit string through a specific scheme, a base layer encoder 4 for encoding an input video signal through a specification scheme such as an AVC scheme and generating the sequence of small-sized videos, for example, the sequence of pictures having 25% of an original video size or the sequence of pictures having the same size as the enhanced layer and a low frame rate, a muxer 5 for encapsulating the output data of the texture coding unit 2 , the encoded video sequence of the BL encoder 4 , and an output vector data of the motion coding unit 120 in a predetermined format, multiplexing the data with each other in a predetermined format , and then outputting the multiplexed data.
The EL encoder 1 performs a motion estimation operation and a prediction operation with respect to a macro block in a predetermined image frame. In this case, the EL encoder 1 performs an inter-layer prediction coding using video data and coding information provided from the BL encoder 4, inserts coding information according to the inter-layer prediction coding as macro block information into a suitable header, and transmits the coding information if coding efficiency is improved.
In the coding procedure, if a current macro block to be coded is determined as an intra-mode macro block, it is determined that a block corresponding to the current macro block is in an intra-mode or in an inter-mode based on information provided from the BL encoder 4. In the case of the intra-mode, the current macro block is specified as an intra BL mode block and coded into residual data using image data of the corresponding block in the base layer.
In the case of the inter-mode, the current macro block may be specified as an intra BL mode block (in a case of unconstraint)
according to an inter-layer prediction constraint/unconstraint state predetermined for encoding, and coded into the residual data using image data of the corresponding block of the base layer as described above. In the case of constraint, the current macro block may be specified as an intra mode block according to the inter-layer prediction constraint/unconstraint state and coded into residual data based on pixel values of an adjacent macro block.
In addition, in the case of constraint, specific information including "constrained_inter_layer_pred_flag" maybe set to λl' . If the constraint is not set, the constrained_inter_layer_jpred_flag may be set to x0'. The set specific information is inserted into a header (a sequence header, a picture or picture group header, or a slice header) to be transmitted.
In the case of unconstraint, the EL encoder 1 codes an image of the current macro block into residual data and specifies the mode of the image of the current macro block as an intra BL mode based on a reconstructed image obtained by performing a reconstruction operation (MC: Motion Compensation or inverse-MCTF) for an inter mode block of the base layer corresponding to the current macro block. In the reconstruction operation for the inter mode block, the reconstructed image may be received by requesting the image from the BL encoder 4, and, if the BL encoder 4 temporarily stores image data before the current macro block is coded into the residual data, the stored image data may be used.
The EL encoder 1 may insert the constraint flag into one of several headers. If the EL encoder 1 inserts the constraint flag into a picture header (PPS; Picture Parameter Set and PPSE; PPS extension) or a slice header, the EL encoder 1 may specify inter-layer prediction constraint according to slices. In addition, the EL encoder 1 may insert the constraint flag into
a header for a sequence or a header for a group of pictures (GOP) . In this case, all slices belonging to the sequence or the GOP equally undergo constraint or unconstraint specified by the constraint flag. Description about encoding procedures for a macro block in several block modes will be omitted because the encoding procedures do not directly relate to the present invention. In addition, generally well-known schemes may be employed for the encoding procedures . Input image signals are stored in an additional storage unit through encoding procedures including the above-described procedure. Then, all or a part of the image signals are read-out from the storage unit according to the request of a decoder and are transmitted through a transmission channel. The selection for an amount of the image signals is determined according to the capacity of the transmission channel, and description about the selection for the amount of the image signals will be omitted because the selection is regardless of the present invention.
FIG. 4 is a block diagram illustrating the structure of the decoder for decoding a data stream encoded and transmitted as described above. The decoder shown in FIG. 4 includes a de-muxer 15 for dividing the received data stream into a compressed motion vector stream and a compressed macro block information stream, a texture decoding unit 12 for recovering an original uncompressed information stream from the compressed macro block stream, a motion decoding unit 13 for recovering an original uncompressed stream from a compressed motion vector stream, an enhanced layer
(EL) decoder 11 for converting the uncompressed macro block information stream and the motion vector stream into an original video signal through an MCTF scheme, and a base layer (BL) decoder 14 for decoding base layer stream through a predetermined scheme such as an AVC scheme .
The BL decoder 14 provides header information included in
an input base layer stream to the EL decoder 11 while decoding the input base layer stream such that the EL decoder 11 can use required encoding information (in the header of the base layer stream) of the base layer including motion vector information and macro block mode information. In addition, the BL decoder 14 provides image data of the decoded base layer picture or a picture, in which a part of blocks is decoded, to the EL decoder 11 according to the direction of the EL decoder 11.
The EL decoder 11 determines the constrained__inter_layer_jpred_flag, which is an inter-layer prediction constraint flag, in a header of a GOP or a sequence having a picture to be currently decoded among received picture sequences of the enhanced layer. As described through the above encoding procedure, the inter-layer prediction constraint flag may be checked in the picture header or the slice header.
If the inter-layer prediction constraint flag applied to a slice to be decoded has been set as "inter-layer prediction constraint" (constrained_inter_layer_pred_flag =1) , in the case of inter BL mode blocks in the slice, at least for intra mode blocks, the EL decoder 11 receives decoded picture data provided by the BL decoder 14 (or reads the decoded picture data from a memory shared between the EL decoder 11 and the BL decoder 14) and reconstructs original image data from residual data of the intra BL mode block based on reconstructed data of blocks in the decoded picture data corresponding to the intra BL mode blocks.
If the determined inter-layer prediction constraint flag applied to the slice to be decoded is specified as inter-layer prediction unconstraint (constrained_inter_layer_j?red_flag =0) , the EL decoder 11 directs the BL decoder 14 to reconstruct all macro blocks in a slice of the base layer corresponding to the slice to be decoded and provide the reconstructed macro blocks to the EL decoder 11. If the BL decoder 14 is set in such a manner that the BL decoder 14 always provides decoded data for all
pictures, it is unnecessary for the EL decoder 11 to request the direction according to conditions. However, since residual prediction is used between layers in addition to inter-layer prediction based on an intra BL mode, it is preferred that the
5 BL decoder 14 reconstructs only intra mode block data instead of all data within a picture so as to provide the reconstructed data to the EL decoder 11 and, if there is additional direction, performs a reconstruction operation (the MC or the inverse_MCTF) for inter mode blocks within the picture so as to provide a slice
10 having the reconstructed image data.
The EL decoder 11 reconstructs original image data from residual data of a current intra BL mode block based on reconstructed data of a block corresponding to the BL mode block in a slice having reconstructed data received from the BL decoder
15 14.
According to another embodiment of the present invention, information about inter-layer prediction constraint may be classified and set according to types of pictures.
If a type of a picture is a key picture or a picture coded
20 using a picture having a low band component (an L picture in the case of the MCTF) , the EL encoder 1 shown in FIG. 3 may set or reset flag information about λλconstrained_inter_layer_pred_L_flag" , thereby transmitting the flag information to the decoder. If the type of the picture is
25 a non-key picture or a picture coded using a high band component (an H picture in the case of the MCTF) , the EL encoder 1 shown in FIG. 3 may set or reset flag information about "constrained_inter_layer_pred_H_flag" , thereby transmitting the flag information to the decoder.
30 The key picture denotes a picture coded into residual data by performing a prediction operation based on only a quality-base picture. In contrast, the non-key picture denotes a picture coded into residual data based on SNR enhance picture data in addition
to the quality-base picture. The definition of the key picture is only one example, and the present invention is limited to the definition.
Although the two inter-layer prediction constrained flags (constrained_inter_layer_pred_L_flag and
(constrained_inter_layer_pred_H_flag ) are applied to different types of pictures, the two flags have the same usage as the constrained_inter_layer_jpred_flag. Accordingly, the EL decoder 11 shown in FIG. 4 determines the value of the constrained_inter_layer_pred_L_flag if a picture to be decoded is the key picture or the picture having a low band component. If the picture to be decoded is the non-key picture or the picture having a high band component, the EL decoder 11 determines the value of the constrained_inter_layer_jpred_H_flag. The reconstruction operation of a BL mode macro block according to the determined value is identical to that of the previous embodiment of the present invention.
Hereinafter, another embodiment of the present invention will be described. When the constrained_intra_j?red_flag, which indicates whether or not data in an adjacent inter mode block are used in the reconstruction of an intra mode block, is reset in the base layer, that is, when the constraint is not set, the BL decoder 14 shown in FIG. 4 performs a reconstruction operation through an MC scheme (an inverse-MCTF scheme) with respect to the adjacent inter mode block in order to reconstruct residual data in the intra mode block of the picture. In this case, it is advantageous that the EL encoder 1 shown in FIG. 1 encodes a macro block to be encoded of the enhanced layer without distinguishing if a block of the base layer corresponding to the macro block is in an inter mode or an intra mode. Because, the EL decoder 11 shown in FIG. 4 can obtain reconstructed image data from the BL decoder 14 through the operation such as the MC even for the inter mode block.
Accordingly, when the constrained_intra__pred__flag of the base layer is set to λ0' by the BL encoder 4 (that is, in a case in which constraint is not set with respect to the adjacent block) , the EL encoder 1 shown in FIG. 1 transmits the constrained_inter__layer_pred_flag by resetting the constrained__inter__layer_pred_flag or does not transmit the constrained__inter_layer_pred_flag for a slice or a picture (a sequence or a group including the slice or the picture) including a macro block coded in an intra BL mode. Since constraint may be set or not for inter-layer prediction when the constrained_intra_pred_flag of the base layer is set to 1I' (that is, data of the adjacent inter mode block are not used in the coding (or reconstruction) of the intra mode block due to the constraint set on the adjacent inter mode block) , the EL encoder 1 codes a specific block to an intra BL mode block according to a predetermined prediction constraint condition for the enhanced layer and transmits the specific block by setting the constrained_inter_layer_pred_flag to λ0' or χl' . If constraint is not set for inter-layer prediction in the case of the constrained_intra__layer_pred_flag set to Λl' , the EL decoder 11 requests a reconstruction operation for the inter mode block from the BL decoder 14 as described above according to the previous embodiment. Accordingly, in this case, the MC operation (or the inverse-MCTF) for data reconstruction must be performed in both layers.
In the meantime, as described above, according to the present invention, the EL decoder 11 shown in FIG. 4 determines whether or not constraint is set for inter-layer prediction through a scheme shown in FIG. 5 because the constrained_inter_layer_pred_flag may not be transmitted from the encoder.
The EL decoder 11 initializes "interlayer_constrained" which is a variable for inter-layer prediction, as a unconstraint
state value (i.e., λ0') and then determines the value of the constrained_intra_j?red_flag transmitted from the BL decoder 14. The EL decoder copies the value of the constrained_inter_layer__pred_flag received through a header of the enhanced layer to the value of the interlayer_constrained only if the value of the constrained_intra_pred_flag has λl'.
The EL decoder 11 shown in FIG. 4 can recognize based on the value of the interlayer_constrained if constraint is set for inter-layer prediction. A procedure of reconstructing original image data from residual data of an intra BL mode macro block according to the state of the inter-layer prediction is identical to the procedure described according to the previous embodiment .
In the meantime, it is selected whether or not constraint is set for inter-layer prediction according to the value of the constrained_intra_pred_flag of the base layer, and information
(constrained_inter__layer_pred_flag) indicating the selected constraint state may be classified and allocated according to types of pictures. For example, the value relating to inter-layer prediction constraint may be carried through the constrained_inter_layer_pred_L_flag which corresponds to a key picture or a picture coded using a low band component or the constrained_inter_layer_pred_H_flag which corresponds to a non-key picture or a picture coded using a high band component .
Although flag information classified according to types of pictures as described above is used, both the flags may not be transmitted according to the value of the constrained_intra_pred_flag of the base layer or may be transmitted with the value of λ0' or xl' as described above. In addition, even the EL decoder 11 shown in FIG. 4 reconstructs an intra BL mode macro block according to the transmission state. If the constrained_intra_jpred_flag of the base layer has the value of λ0', and if the constrained_inter_layer_jpred_L_flag, or the constrained_inter_layerj?red_H_flag is not transmitted, the EL
decoder 11 shown in FIG. 4 performs an operation according to a syntax shown in FIG. 6 and determines whether or not the constraint is set for inter-layer prediction according to the final value of the interlayer_constrained obtained through the operation. Hereinafter, still another embodiment of the present invention will be described.
Information about inter-layer prediction constraint may be delivered using one integrated indicator such as "constrained_inter_layer_pred_idc" without classification and allocation according to types of pictures as described according to the previous embodiment.
According to the present embodiment, the constrained_inter_layer_pred_idc is set to x 0 ' when representing the constraint inter-layer prediction regardless of the types of pictures. In addition, the constrained__inter_layer_pred_idc is set to λl' when representing an inter-layer prediction unconstraint state for a first picture type (e.g., a key picture or a picture having a low band component) , and an inter-layer prediction constraint state for a second picture type (e.g., a non-key picture or a picture having a high band component) . The constrained_inter_layer_pred_idc is set to S2' when representing the inter-layer prediction unconstraint state regardless of the types of pictures. The EL decoder 11 shown in FIG. 4 determines whether or not constraint is set for the inter-layer prediction according to types of pictures based on the indication information depending on the indication value defined above.
According to the present embodiment, since there is rarely a procedure of encoding the first picture type in the inter-layer prediction constraint state and the second picture type in the inter-layer prediction unconstraint state (actually, when the second type picture is encoded in the inter-layer prediction unconstraint state, it is unnecessary to encode the first type picture in the inter-layer prediction constraint state) , the
value indicating the case is excluded. However, it is natural that it is possible to represent the case by allocating the value of constrained_inter_layer_pred_idc with an additional value such as '4' if necessity. As described above, a decoder of determining information representing inter-layer prediction constraint and performing a reconstruction operation for a corresponding BL mode macro block according to the determination result (the reconstruction operation includes an operation of selectively reconstructing an inter mode block of a base layer based on the information representing the inter-layer prediction constraint) may be installed at a mobile communication terminal or a device of reproducing recorded media.
As described above, according to the present invention, the inter-layer prediction constraint/unconstraint state is directly delivered through a prediction-coded layer instead of a base layer for the inter-layer prediction, thereby individually setting or releasing prediction constraint of each layer when a video signal is encoded and transmitted based on a plurality of layers. Accordingly, coding can be freely performed, and layer coding suitable for an encoding environment can be achieved.
Although preferred embodiments of the present invention have been described for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.
Claims
1. A method for encoding an image signal to bit streams of a first layer and a second layer, the method comprising the steps of: (1) coding an image block in a picture of the first layer into residual data based on image data of a block of the second layer corresponding to the vide block; and
(2) providing indication information through the bit stream of the first layer, the indication information representing whether the coding is achieved in inter-layer prediction constraint or inter-layer prediction unconstraint .
2. The method as claimed in claim 1, wherein the indication information represents that the coding is achieved in the inter-layer prediction unconstraint if information included in the bit stream of the second layer is set to a value representing that use of adjacent inter mode block data is constrained when an intra mode block is reconstructed, the information indicating whether the use of the adjacent inter mode block data is constrained or not when the intra mode block is reconstructed.
3. The method as claimed in claim 2, wherein the corresponding block is coded in an intra mode or an inter mode.
4. The method as claimed in claim 1, wherein the indication information is set to one of an inter-layer prediction constraint value and an inter-layer prediction unconstraint value, if information included in the bit stream of the second layer is set to a value representing that use of adjacent inter mode block data is constrained when an intra mode block is reconstructed, the information indicating whether the use of the adjacent inter mode block data is constrained or not when the intra mode block is reconstructed .
5. The method as claimed in claim 1, wherein the indication information includes plural pieces of information being classified and allocated according to types of pictures.
6. The method as claimed in claim 1, wherein the indication information has at least three pieces of information being classified according to types of pictures and representing that the pictures are coded in an inter-layer prediction constraint state or in an inter-layer prediction unconstraint state.
7. A method for decoding encoded bit streams of a first layer and a second layer by receiving the encoded bit streams, the method comprising the steps of:
(1) determining indication information representing that all or a part of data of the first layer are coded in an inter-layer prediction constraint state or in an inter-layer prediction unconstraint state, the indication information being provided through the bit stream of the first layer; and
(2) determining whether an inter mode block of the second layer is reconstructed first or not in order to reconstruct a corresponding block having a specific mode in a picture of the first layer.
8. The method as claimed in claim 7, wherein the specific mode is an intra BL mode.
9. The method as claimed in claim 7, wherein, in step (2) , it is determined whether the inter mode block of the second layer is reconstructed first or not according to types of pictures based on the indication information.
10. The method as claimed in claim 7, further comprising a step of determining a flag indicating that use of adjacent inter mode block data is constrained when an intra mode block is reconstructed, the flag being included in the bit stream of the second layer.
11. The method as claimed in claim 10,' wherein step (1) and step (2) are performed when the determined flag indicates that use of adjacent inter mode block data is constrained.
12. The method as claimed in claim 10, further comprising a step of determining whether an inter mode block of the second layer is first reconstructed or not in order to reconstruct a corresponding block having a specific mode in a picture of the first layer without performing step (1) if the determined flag indicates that use of adjacent inter mode block data is not constrained.
13. The method as claimed in claim 7, wherein the indication information is included in one of a slice header, a picture header, a sequence header, and a picture group header.
14. A method for decoding encoded bit streams of a first layer and a second layer by receiving the encoded bit streams, the method comprising the steps of:
(1) determining indication information indicating that use of adjacent inter mode block data is constrained when an intra mode block is reconstructed, the flag being included in the bit stream of the second layer; and
(2) determining indication information representing that all or a part of data of the first layer are coded in an inter-layer prediction constraint state or in an inter-layer prediction unconstraint state, the indication information being provided through the bit stream of the first layer if the determined indication information of step (1) indicates that the use of the adjacent inter mode block data is constrained.
15. The method as claimed in claim 14, wherein the indication information is included in one of a slice header, a picture header, a sequence header, and a picture group header.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US68459005P | 2005-05-26 | 2005-05-26 | |
US70104005P | 2005-07-21 | 2005-07-21 | |
KR1020050086500A KR100878812B1 (en) | 2005-05-26 | 2005-09-15 | Method for providing and using information on interlayer prediction of a video signal |
PCT/KR2006/001980 WO2006126841A1 (en) | 2005-05-26 | 2006-05-25 | Method for providing and using information about inter-layer prediction for video signal |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1897377A1 true EP1897377A1 (en) | 2008-03-12 |
EP1897377A4 EP1897377A4 (en) | 2010-12-22 |
Family
ID=37452221
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06747456A Withdrawn EP1897377A4 (en) | 2005-05-26 | 2006-05-25 | Method for providing and using information about inter-layer prediction for video signal |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP1897377A4 (en) |
WO (1) | WO2006126841A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106060540A (en) * | 2012-09-28 | 2016-10-26 | 索尼公司 | Image processing device and method |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100878812B1 (en) | 2005-05-26 | 2009-01-14 | 엘지전자 주식회사 | Method for providing and using information on interlayer prediction of a video signal |
JP4542064B2 (en) * | 2006-05-11 | 2010-09-08 | 日本電信電話株式会社 | Inter-layer prediction method, apparatus, program, and recording medium thereof |
KR20100014282A (en) * | 2006-12-25 | 2010-02-10 | 톰슨 라이센싱 | Device for encoding video data, device for decoding video data, stream of digital data |
MX2009012385A (en) | 2007-05-16 | 2009-12-01 | Thomson Licensing | Apparatus and method for encoding and decoding signals. |
MX2010004148A (en) | 2007-10-15 | 2010-05-17 | Thomson Licensing | Apparatus and method for communicating burst mode activity. |
MX2010004147A (en) * | 2007-10-15 | 2010-08-09 | Thomson Licensing | High definition television transmission with mobile capability. |
KR20130116782A (en) | 2012-04-16 | 2013-10-24 | 한국전자통신연구원 | Scalable layer description for scalable coded video bitstream |
KR102221615B1 (en) * | 2012-09-03 | 2021-03-02 | 소니 주식회사 | Image processing device and method |
US10097825B2 (en) | 2012-11-21 | 2018-10-09 | Qualcomm Incorporated | Restricting inter-layer prediction based on a maximum number of motion-compensated layers in high efficiency video coding (HEVC) extensions |
-
2006
- 2006-05-25 EP EP06747456A patent/EP1897377A4/en not_active Withdrawn
- 2006-05-25 WO PCT/KR2006/001980 patent/WO2006126841A1/en active Application Filing
Non-Patent Citations (6)
Title |
---|
"Description of core experiments in SVC", ISO/IEC JTC1/SC29/WG11 N6898, XX, XX, 1 January 2005 (2005-01-01), page COMPLETE, XP002340411, * |
"Text of ISO/IEC 14496-10:2005 (AVC 3rd edition)", ITU STUDY GROUP 16 - VIDEO CODING EXPERTS GROUP -ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), XX, XX, no. N7081, 22 April 2005 (2005-04-22), XP030013753, * |
"Video Verification Model version 3.0", ITU STUDY GROUP 16 - VIDEO CODING EXPERTS GROUP -ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), XX, XX, no. N1277, 15 July 1996 (1996-07-15), XP030010211, * |
JVT: "Joint Scalable Video Model JSVM-2", JOINT VIDEO TEAM (JVT) OF ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), XX, XX, 16 April 2005 (2005-04-16), pages 1-31, XP002399745, * |
JVT: "Scalable Video Coding - Working Draft 2", JOINT VIDEO TEAM (JVT) OF ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), XX, XX, 16 April 2005 (2005-04-16), pages 1-134, XP002399746, * |
See also references of WO2006126841A1 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106060540A (en) * | 2012-09-28 | 2016-10-26 | 索尼公司 | Image processing device and method |
US10212446B2 (en) | 2012-09-28 | 2019-02-19 | Sony Corporation | Image processing device for suppressing deterioration in encoding efficiency |
CN106060540B (en) * | 2012-09-28 | 2019-07-02 | 索尼公司 | Image processing apparatus and method |
Also Published As
Publication number | Publication date |
---|---|
WO2006126841A1 (en) | 2006-11-30 |
EP1897377A4 (en) | 2010-12-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8050326B2 (en) | Method for providing and using information about inter-layer prediction for video signal | |
WO2006126841A1 (en) | Method for providing and using information about inter-layer prediction for video signal | |
US20090041130A1 (en) | Method of transmitting picture information when encoding video signal and method of using the same when decoding video signal | |
KR100718133B1 (en) | Motion information encoding/decoding apparatus and method and scalable video encoding apparatus and method employing the same | |
EP1878260B1 (en) | Method for scalably encoding and decoding video signal | |
US8532187B2 (en) | Method and apparatus for scalably encoding/decoding video signal | |
CA2440154C (en) | Picture encoding method and apparatus and picture decoding method and apparatus | |
TWI407796B (en) | An image signal decoding apparatus, an image signal decoding method, an image signal decoding method, an image signal coding method, and a program | |
KR100786132B1 (en) | Method for encoding/decoding a video sequence based on hierarchical B-picture using adaptively-adjusted GOP structure | |
US20090190844A1 (en) | Method for scalably encoding and decoding video signal | |
US20080304566A1 (en) | Method for Decoding Video Signal Encoded Through Inter-Layer Prediction | |
CN101185343A (en) | Method for providing and using information about inter-layer prediction for video signal | |
US20060233246A1 (en) | Method and apparatus for encoding, transmitting, and decoding a video signal | |
US20060159181A1 (en) | Method for encoding and decoding video signal | |
KR100878824B1 (en) | Method for scalably encoding and decoding video signal | |
US20060133499A1 (en) | Method and apparatus for encoding video signal using previous picture already converted into H picture as reference picture of current picture and method and apparatus for decoding such encoded video signal | |
US20060133488A1 (en) | Method for encoding and decoding video signal | |
WO2006062330A1 (en) | Method and apparatus for encoding, transmitting, and decoding a video signal | |
KR20080008205A (en) | Method for encoding and decoding video signal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20071217 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20101124 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 7/26 20060101AFI20101118BHEP |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20110624 |