CN103716633A - Scaled code stream processing method, scaled code stream processing device and scaled code stream encoder - Google Patents
Scaled code stream processing method, scaled code stream processing device and scaled code stream encoder Download PDFInfo
- Publication number
- CN103716633A CN103716633A CN201210375832.2A CN201210375832A CN103716633A CN 103716633 A CN103716633 A CN 103716633A CN 201210375832 A CN201210375832 A CN 201210375832A CN 103716633 A CN103716633 A CN 103716633A
- Authority
- CN
- China
- Prior art keywords
- enhancement layer
- decoded
- image block
- skip mode
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a scaled code stream processing method which comprises the following steps: receiving a base layer code stream and an enhancement layer code stream; decoding the base layer code stream to obtain a decoded base layer image block; decoding the enhancement layer code stream to obtain mode information, included in the enhancement layer code stream, of an enhancement layer to-be-decoded block, wherein the mode information is used for indicating the decoding method of the enhancement layer to-be-decoded block; acquiring a prediction value of an enhancement layer to-be-decoded reconstructed image block from the decoded base layer image block; and decoding the enhancement layer to-be-decoded block according to the predication value and the mode information of the enhancement layer to-be-decoded image block.
Description
Technical field
The present invention relates to technology, relate in particular to a kind of processing method of layered code stream, the encoder of device and layered code stream.
Background technology
Along with the improving constantly and develop of network technology and terminal processing capacity, people are more and more higher to the requirement of Video coding.High efficiency video coding (High Efficiency Video Coding is called for short HEVC) is video encoding standard of new generation, and good video compression efficiency can be provided.
HEVC encoding and decoding technique adopts hybrid encoding frame to carry out Code And Decode.Video image is divided into that the image block of NxM is predicted, converted, quantification and entropy coding, and for reaching the object of compressed information, N and M can be the different sizes such as 64,32 or 16.Wherein predictive coding comprises infra-frame prediction and inter prediction, infra-frame prediction mainly utilizes the spatial coherence of image block, use present encoding piece periphery to rebuild the predicted value that pixel generates current block, difference signal to current image block pixel and predicted value converts, quantification and entropy coding, realizes compression.Inter prediction utilizes the temporal correlation of image block, uses the predicted value that generates current block from the match block in the reconstruction image before or after the image of current block place, and the approximate process of follow-up process and infra-frame prediction completes interframe encode process.Adopt in the code stream after predictive coding and include prediction mode information or difference information.Especially, for inter prediction encoding code stream, comprise a kind of special predictive mode one inter prediction skip mode, the image block coded data for using inter prediction skip mode, does not comprise difference information.
Can layered video encoding and decoding (Scaled Video Coding, be called for short SVC), a kind ofly video flowing can be divided into the technology of a plurality of resolution, quality and frame rate layers, expansion using SVC technology as HEVC, video data is divided into the multi-layer video stream of the optional enhancement layer composition of a plurality of resolution-adjustables, frame rate or quality.SVC coding techniques has been introduced inter-layer prediction concept, for resolution demixing coding techniques, video data is divided into a plurality of layer of video data of different resolution, for each layer video data, except adopting the video-frequency compression method identical with HEVC, can also realize by the method for inter-layer prediction video compression performance more efficiently.When video image is divided into the image of a plurality of different resolutions, such as being divided into L layer, the 0th layer of resolution minimum, L layer resolution is maximum.With respect to L layer, the basal layer that L-1 layer is L layer.During coding current layer, can utilize the basal layer reconstruction image of current layer to carry out soon predictive coding to current layer pixel.How utilizing interlayer information to improve layered video coding efficiency is the key issue that hierarchical coding Technology Need solves.
Summary of the invention
The invention provides a kind of processing method of layered code stream, the encoder of device and layered code stream is in order to improve the compression efficiency of hierarchical coding.
First aspect, provides a kind of processing method of layered code stream, and the method comprises: receive basal layer code stream and enhancement layer bitstream; The described basal layer code stream of decoding obtains decoded base layer image piece; Resolve described enhancement layer bitstream, obtain being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, described pattern information is used to indicate the decoding process of to be decoded of described enhancement layer; From described decoded base layer image piece, obtain the predicted value of described enhancement layer reconstruction image block to be decoded; According to the pattern information of described predicted value and the described enhancement layer image block to be decoded described enhancement layer module to be decoded of decoding.
In conjunction with first aspect, in a kind of possible execution mode, the method also comprises: wherein, the decoding process that the indicated described enhancement layer of described pattern information is to be decoded comprises inter-layer prediction skip mode, corresponding, the described pattern information according to described predicted value and the described enhancement layer image block to be decoded described enhancement layer module to be decoded of decoding comprises: according to described predicted value and the described inter-layer prediction skip mode described enhancement layer module to be decoded of decoding.
In conjunction with first aspect and the possible execution mode of the first, in the possible execution mode of the second, describedly according to described predicted value and the described inter-layer prediction skip mode described enhancement layer module to be decoded of decoding, comprise: using described predicted value image block after the decoding of described enhancement layer image block to be decoded.
In conjunction with first aspect, execution mode and the possible execution mode of the second that the first is possible, in the third possible execution mode, described described predicted value image block after the decoding of described enhancement layer image block to be decoded is comprised: choose the described decoded base layer image piece corresponding with the image block to be decoded of described enhancement layer, after up-sampling, obtain the predicted value of described enhancement layer reconstruction image block to be decoded; Described predicted value obtains image block after the decoding of described enhancement layer image block to be decoded as the pixel value of the reconstruction image block to be decoded of described enhancement layer.
In conjunction with first aspect, the execution mode that the first is possible, the execution mode that the second is possible or the third possible execution mode, in the 4th kind of possible execution mode, the described enhancement layer bitstream of described parsing, obtain being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, comprise: resolve the inter-layer prediction skip mode sign that is included in the enhancement layer image block to be decoded in described enhancement layer bitstream, pattern information using described inter-layer prediction skip mode sign as described enhancement layer image block to be decoded, for determining according to described inter-layer prediction skip mode sign whether described enhancement layer image block to be decoded adopts the decoding of inter-layer prediction skip mode, corresponding, when the inter-layer prediction skip mode sign described enhancement layer of indication image block to be decoded is while adopting the decoding of inter-layer prediction skip mode, carry out described according to described predicted value and the described inter-layer prediction skip mode described enhancement layer module to be decoded of decoding.
In conjunction with first aspect and the 4th kind of possible execution mode, the described enhancement layer bitstream of described parsing, obtain being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, also comprise: the skip mode sign of resolving the image block to be decoded of described enhancement layer, if the decoding process of the image block to be decoded of the described enhancement layer of described skip mode sign sign is skip mode, carry out the inter-layer prediction skip mode sign that described parsing is included in the enhancement layer image block to be decoded in described enhancement layer bitstream.
Second aspect, provides a kind of processing method of layered code stream, and the method comprises: basis of coding tomographic image piece, formation base layer bit stream; According to default coded system encoding enhancement layer image block, form enhancement layer bitstream, and the pattern information corresponding with described default coded system write in described enhancement layer bitstream for making decoding end according to the described pattern information described enhancement layer bitstream of decoding.
In conjunction with second aspect, in a kind of possible execution mode, the method also comprises: described default coded system is inter-layer prediction skip mode, corresponding, the coded system encoding enhancement layer image block that described basis is default, form enhancement layer bitstream, and will in pattern information corresponding to described and described default coded system, write in described enhancement layer bitstream for making decoding end according to the described pattern information described enhancement layer bitstream of decoding, comprise: according to inter-layer prediction skip mode encoding enhancement layer image block, form enhancement layer bitstream, and will in inter-layer prediction skip mode sign corresponding to described and described inter-layer prediction skip mode, as pattern information, write in described enhancement layer bitstream for making decoding end according to the described enhancement layer bitstream of described inter-layer prediction skip mode sign decoding.
In conjunction with second aspect or the possible execution mode of the first, in method described in the possible execution mode of the second, also comprise: skip mode sign is write in described enhancement layer bitstream, and described skip mode sign is in order to indicate whether described default coded system is skip mode.
The third aspect provides a kind of processing unit of layered code stream, and this device comprises: receiver module, for receiving basal layer code stream and enhancement layer bitstream; Decoder module, for decoding, described basal layer code stream obtains decoded base layer image piece; Parsing module, resolves described enhancement layer bitstream, obtains being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, and described pattern information is used to indicate the decoding process of to be decoded of described enhancement layer; Parameter acquisition module, for obtaining the predicted value of described enhancement layer reconstruction image block to be decoded from described decoded base layer image piece; Described decoder module, also for the described enhancement layer module to be decoded of decoding according to the pattern information of described predicted value and described enhancement layer image block to be decoded.
In conjunction with the third aspect, in a kind of possible execution mode, wherein, the decoding process that the indicated described enhancement layer of described pattern information is to be decoded comprises inter-layer prediction skip mode, corresponding, described described decoder module, also for the described enhancement layer module to be decoded of decoding according to the pattern information of described predicted value and described enhancement layer image block to be decoded, specifically comprise: described decoder module, also for the described enhancement layer module to be decoded of decoding according to described predicted value and described inter-layer prediction skip mode.
In conjunction with the third aspect and the possible execution mode of the first, in the possible execution mode of the second, described decoder module is specifically for using described predicted value image block after the decoding of described enhancement layer image block to be decoded.
In conjunction with the third aspect, execution mode and the possible execution mode of the second that the first is possible, described decoder module, specifically for choosing the described decoded base layer image piece corresponding with the image block to be decoded of described enhancement layer, obtains the predicted value of described enhancement layer reconstruction image block to be decoded after up-sampling; The pixel value of the reconstruction image block to be decoded using described predicted value as described enhancement layer obtains image block after the decoding of described enhancement layer image block to be decoded.
In conjunction with the third aspect, the execution mode that the first is possible, the execution mode that the second is possible and the third possible execution mode, in the 4th kind of possible execution mode, described parsing module specifically for: resolve the inter-layer prediction skip mode sign be included in the enhancement layer image block to be decoded in described enhancement layer bitstream, pattern information using described inter-layer prediction skip mode sign as described enhancement layer image block to be decoded, for determining according to described inter-layer prediction skip mode sign whether described enhancement layer image block to be decoded adopts the decoding of inter-layer prediction skip mode, corresponding, when the inter-layer prediction skip mode sign described enhancement layer of indication image block to be decoded is while adopting the decoding of inter-layer prediction skip mode, described decoder module, for the described enhancement layer module to be decoded of decoding according to described predicted value and described inter-layer prediction skip mode.
In conjunction with the third aspect and the 4th kind of possible execution mode, in the 5th kind of possible execution mode, described parsing module is also for resolving the skip mode sign of the image block to be decoded of described enhancement layer, if the decoding process of the image block to be decoded of the described enhancement layer of described skip mode sign sign is skip mode, for carrying out described parsing, be included in the inter-layer prediction skip mode sign of the enhancement layer image block to be decoded of described enhancement layer bitstream.
Fourth aspect, provides a kind of encoder of layered code stream, and this device comprises: the first coding module, for basis of coding tomographic image piece, formation base layer bit stream; The second coding module, be used for according to default coded system encoding enhancement layer image block, form enhancement layer bitstream, and the pattern information corresponding with described default coded system write in described enhancement layer bitstream for making decoding end according to the described pattern information described enhancement layer bitstream of decoding.
In conjunction with fourth aspect, in a kind of possible execution mode, described default coded system is inter-layer prediction skip mode; Corresponding, described the second coding module is used for, according to inter-layer prediction skip mode encoding enhancement layer image block, form enhancement layer bitstream, and will in inter-layer prediction skip mode sign corresponding to described and described inter-layer prediction skip mode, as pattern information, write in described enhancement layer bitstream for making decoding end according to the described enhancement layer bitstream of described inter-layer prediction skip mode sign decoding.
In fourth aspect or the possible execution mode of the first, at possible described the second coding module of the second, also for skip mode sign is write to described enhancement layer bitstream, described skip mode sign is in order to indicate whether described default coded system is skip mode.
The 5th aspect, provides a kind of processing unit of layered code stream, and this device comprises memory and processor, and described processor is stored in described storage executable instruction wherein for reading, to carry out following steps: receive basal layer code stream and enhancement layer bitstream; The described basal layer code stream of decoding obtains decoded base layer image piece; Resolve described enhancement layer bitstream, obtain being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, described pattern information is used to indicate the decoding process of to be decoded of described enhancement layer; From described decoded base layer image piece, obtain the predicted value of described enhancement layer reconstruction image block to be decoded; According to the pattern information of described predicted value and the described enhancement layer image block to be decoded described enhancement layer module to be decoded of decoding.
In conjunction with the 5th aspect, in a kind of possible execution mode, this processing unit also comprises: wherein, the decoding process that the indicated described enhancement layer of described pattern information is to be decoded comprises inter-layer prediction skip mode, corresponding, the described pattern information according to described predicted value and the described enhancement layer image block to be decoded described enhancement layer module to be decoded of decoding comprises: according to described predicted value and the described inter-layer prediction skip mode described enhancement layer module to be decoded of decoding.
In conjunction with the 5th aspect and the possible execution mode of the first, in the possible execution mode of the second, describedly according to described predicted value and the described inter-layer prediction skip mode described enhancement layer module to be decoded of decoding, comprise: using described predicted value image block after the decoding of described enhancement layer image block to be decoded.
In conjunction with the 5th aspect, execution mode and the possible execution mode of the second that the first is possible, in the third possible execution mode, described described predicted value image block after the decoding of described enhancement layer image block to be decoded is comprised: choose the described decoded base layer image piece corresponding with the image block to be decoded of described enhancement layer, after up-sampling, obtain the predicted value of described enhancement layer reconstruction image block to be decoded; Described predicted value obtains image block after the decoding of described enhancement layer image block to be decoded as the pixel value of the reconstruction image block to be decoded of described enhancement layer.
In conjunction with the 5th aspect, the execution mode that the first is possible, the execution mode that the second is possible or the third possible execution mode, in the 4th kind of possible execution mode, the described enhancement layer bitstream of described parsing, obtain being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, comprise: resolve the inter-layer prediction skip mode sign that is included in the enhancement layer image block to be decoded in described enhancement layer bitstream, pattern information using described inter-layer prediction skip mode sign as described enhancement layer image block to be decoded, for determining according to described inter-layer prediction skip mode sign whether described enhancement layer image block to be decoded adopts the decoding of inter-layer prediction skip mode, corresponding, when the inter-layer prediction skip mode sign described enhancement layer of indication image block to be decoded is while adopting the decoding of inter-layer prediction skip mode, carry out described according to described predicted value and the described inter-layer prediction skip mode described enhancement layer module to be decoded of decoding.
In conjunction with the 5th aspect and the 4th kind of possible execution mode, the described enhancement layer bitstream of described parsing, obtain being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, also comprise: the skip mode sign of resolving the image block to be decoded of described enhancement layer, if the decoding process of the image block to be decoded of the described enhancement layer of described skip mode sign sign is skip mode, carry out the inter-layer prediction skip mode sign that described parsing is included in the enhancement layer image block to be decoded in described enhancement layer bitstream.
The 6th aspect, a kind of processing unit of layered code stream is provided, and this device comprises memory and processor, and described processor is stored in described storage executable instruction wherein for reading, to carry out following steps:: basis of coding tomographic image piece, formation base layer bit stream; According to default coded system encoding enhancement layer image block, form enhancement layer bitstream, and the pattern information corresponding with described default coded system write in described enhancement layer bitstream for making decoding end according to the described pattern information described enhancement layer bitstream of decoding.
In conjunction with the 6th aspect, in a kind of possible execution mode, the method also comprises: described default coded system is inter-layer prediction skip mode, corresponding, the coded system encoding enhancement layer image block that described basis is default, form enhancement layer bitstream, and will in pattern information corresponding to described and described default coded system, write in described enhancement layer bitstream for making decoding end according to the described pattern information described enhancement layer bitstream of decoding, comprise: according to inter-layer prediction skip mode encoding enhancement layer image block, form enhancement layer bitstream, and will in inter-layer prediction skip mode sign corresponding to described and described inter-layer prediction skip mode, as pattern information, write in described enhancement layer bitstream for making decoding end according to the described enhancement layer bitstream of described inter-layer prediction skip mode sign decoding.
In conjunction with the 6th aspect or the possible execution mode of the first, in method described in the possible execution mode of the second, also comprise: skip mode sign is write in described enhancement layer bitstream, and described skip mode sign is in order to indicate whether described default coded system is skip mode.
As shown from the above technical solution, the processing method of a kind of layered code stream provided by the invention, the encoder of device and layered code stream can effectively promote compression efficiency.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
The hierarchy encoding method 100 that Fig. 1 provides for one embodiment of the present invention;
Fig. 2 is the performance test analogous diagram that the 100 couples of HD video sequence Kimono of hierarchy encoding method in employing Fig. 1 carry out hierarchical coding;
The hierarchical decoding method 200 that Fig. 3 provides for another embodiment of the present invention;
Fig. 4 is the data structure of the code stream of the enhancement layer that generates of the handled coding side of the hierarchical decoding method 200 in Fig. 3.
The layered encoder 300 that Fig. 5 provides for one embodiment of the present invention;
The hierarchical decoding device 400 that Fig. 6 provides for another embodiment of the present invention.
Embodiment
For making object, technical scheme and the advantage of the embodiment of the present invention clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
In embodiments of the present invention, take that to generate two-layer resolution code stream be example, technical solution of the present invention is described.Wherein resolution is provided is the picture quality of 960x540 to basal layer code stream, and it is the picture quality of 1920x1080 that enhancement layer bitstream provides resolution.Can generate the layered code stream that meets multiple resolution quality according to application demand in actual applications, the proportionate relationship of basal layer and enhancement layer resolution can be also arbitrarily.
The first hierarchy encoding method flow chart that Fig. 1 provides for the embodiment of the present invention.The hierarchy encoding method that the present embodiment provides specifically can be applied to the cataloged procedure to video, this cataloged procedure can based on but be not limited to HEVC-SVC technology.The hierarchy encoding method that the present embodiment provides can be carried out by hierarchy encoding apparatus, this hierarchy encoding apparatus can be integrated in the video processor of equipment such as television set, Set Top Box, personal computer, notebook computer, panel computer or mobile phone, also can arrange separately, this hierarchy encoding apparatus can be realized by the mode of software and/or hardware.
The hierarchy encoding method 100 that the present embodiment provides specifically comprises:
Concrete, in coding method of the present invention, first completing base layer image piece coding, formation base tomographic image block code stream, comprises the code stream information that 960x540 resolution quality can be provided, and obtains decoded base layer image simultaneously.Base layer image block coding method adopts existing HEVC coding method to encode;
Particularly, encoding enhancement layer image block, generates enhancement layer image code stream, comprises the code stream information that 1920x1080 resolution quality can be provided.To enhancement layer image piece coding, can use except adopting existing HEVC coding mode, can also adopt inter-layer prediction skip mode to encode to enhancement layer.When using inter-layer prediction skip mode to enhancement layer image block coding to be encoded, such as coding is positioned at the enhancement layer image piece that the size of (64,64) position of enhancement layer image to be encoded is 64x64, direct coding inter-layer prediction skip mode sign, write code stream, generate enhancement layer bitstream.It should be noted that, above-mentioned coding is positioned at (64 of enhancement layer image to be encoded, 64) position and size are only the examples adopting in the book the specific embodiment of the present invention of explaining as enhancement layer image piece, can adopt coding to be positioned at the optional position of enhancement layer image to be encoded and big or small as enhancement layer image piece in actual use.Whether coding side uses inter-layer prediction skip mode, need to carry out the comparison of code efficiency cost to inter-layer prediction skip mode and other patterns.Concrete, need to adopt (64 of inter-layer prediction mode coding, 64) the coding cost of the enhancement layer image piece that the size of position is 64x64, use the image block of decoded basal layer correspondence position, be positioned at base layer image (32, 32) size is base layer image piece after the decoding of 32x32, utilize up-sampling algorithm to carry out up-sampling processing to this base layer image piece, obtain size for the prediction piece of 64x64, using this prediction piece as (64 of enhancement layer, 64) position size is enhancement layer image piece after the decoding of 64x64, calculate (64 of the rear enhancement layer image piece of this decoding and enhancement layer, 64) position size is the distortion factor D_skip of enhancement layer image piece original image after the decoding of 64x64, compare the distortion factor Dn after D_Skip and other coding method decoded pictures, n=1,2,3..., chooses the coding mode of distortion factor minimum as the coding mode of current enhancement layer coding piece.
Refer to Fig. 2, for adopting 100 couples of HD video sequence Kimono of hierarchical decoding method of the present invention to carry out the performance test analogous diagram of hierarchical coding, test condition is full I frame encoding condition, and code stream is divided into two-layer, enhancement layer resolution is 1920x1080, and basal layer is 1280x720.In figure, circular punctuate curve is the present invention program's performance, rhombus punctuate curve is original scheme performance, compared to the prior art, the present invention program can effectively save the code check 16% of hierarchical coding code stream, therefore adopt hierarchical decoding method 100 of the present invention can effectively save coding resource, improve the efficiency of coding.
Refer to Fig. 3, the embodiment of the present invention also provides a kind of hierarchical decoding method 200, specifically comprises:
Step 210, reception basal layer code stream and enhancement layer bitstream;
In this step, described basal layer code stream provides the video quality of resolution 960x540, and described enhancement layer provides the video quality of resolution 1920x1080;
Step 220, the described basal layer code stream of decoding obtain decoded base layer image piece;
Particularly, in the present invention, use basal layer code stream described in HEVC technique decodes to obtain decoded base layer image piece; Be appreciated that other similar coding/decoding methods that described decoding also can adopt industry to be familiar with, as decoding process H.264.
Step 230, resolve described enhancement layer bitstream, obtain being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, described pattern information is used to indicate the decoding process of to be decoded of described enhancement layer;
Particularly, resolve the bit stream data of enhancement layer image block to be decoded, parsing obtains the inter-layer prediction skip mode sign of current block, described inter-layer prediction skip mode sign indicates the decoding process of to be decoded of the indicated described enhancement layer of described pattern information to comprise inter-layer prediction skip mode, if this is designated 1, show that current block is used inter-layer prediction skip mode to decode, otherwise according to the interframe of HEVC defined or intra prediction mode decoding;
Step 240, from described decoded base layer image piece, obtain the predicted value of described enhancement layer reconstruction image block to be decoded;
Particularly, if the predictive mode of enhancement layer image block to be decoded is inter-layer prediction skip mode, in code stream, do not comprise difference information, now corresponding basal layer is rebuild to image block and carried out as enhancement layer image block to be decoded, rebuilding pixel value after up-sampling.Concrete, for being positioned at (64 of enhancement layer image to be encoded, 64) the enhancement layer image piece to be decoded that the size of position is 64x64, obtaining basic layer position is (32,32) size is base layer image piece after the decoding of 32x32, uses image block that up-sampling algorithm is 64x64 size using this base layer image piece up-sampling as the predicted value of enhancement layer image to be encoded.
Particularly, when the pattern information of described enhancement layer image block to be decoded be inter-layer prediction skip mode described predicted value be the decoded image blocks of the enhancement layer image piece to be decoded that the size of enhancement layer (64,64) position is 64x64.
Further, according to the embodiment of the present invention, refer to Fig. 4 and disclose for step 130, the bit stream data of resolving enhancement layer image block to be decoded can also be:
Resolve enhancement layer image block code stream to be decoded coding_unit_svc (x0, y0, log2CbSize), wherein x0 and y0 represent the positional information of current image block to be decoded in current image to be decoded, and log2CbSize represents the size information of current image block to be decoded;
If the type of coding slice_type of enhancement layer is inter prediction encoding type i, or the type of coding of enhancement layer is that intraframe predictive coding and its layer of sign layerID are greater than 0, resolves and obtains skip mode sign skip_flag[x0] [y0];
If the type of coding slice_type of enhancement layer is intraframe coding type i, and layerID is greater than 0, enhancement layer image block use to be decoded inter-layer prediction skip mode decoding;
If the type of coding slice_type of enhancement layer is interframe encode type, and layerID is greater than 0, further resolve and obtain inter-layer prediction skip mode sign base_recon_skip_flag[x0] [y0], if base_recon_skip_flag[x0] [y0] 1 show that enhancement layer image block to be decoded is used the decoding of inter-layer prediction skip mode, if base_recon_skip_flag[x0] [y0] 1 show that enhancement layer image block to be decoded is used inter-layer prediction mode decoding.
The pattern information obtaining according to parsing completes decode procedure.
In embodiments of the present invention, decoder starts decoding enhancement layer after can be designed as the late whole base layer image of decoding again, also can decode after a late base layer image part, start decoding enhancement layer, real system can require to provide different designs according to hardware structure and complexity.
The schematic block diagram of the first layering coder 300 that Fig. 5 provides for the embodiment of the present invention.The hierarchy encoding apparatus that the present embodiment provides specifically can be applied to the coding to video, this coding can based on but be not limited to HEVC-SVC technology.The hierarchy encoding apparatus that the present embodiment provides can be integrated in the video processor of equipment such as television set, Set Top Box, personal computer, notebook computer, panel computer or mobile phone, also can arrange separately, this hierarchy encoding apparatus can be realized by the mode of software and/or hardware.
Refer to Fig. 5, the layered encoder 300 that the present embodiment provides specifically comprises:
The first coding module 310, for basis of coding tomographic image piece, formation base layer bit stream;
Concrete, in coding method of the present invention, first completing base layer image piece coding, formation base tomographic image block code stream, comprises the code stream information that 960x540 resolution quality can be provided, and obtains decoded base layer image simultaneously.Base layer image block coding method adopts existing HEVC coding method to encode;
The second coding module 320, be used for according to default coded system encoding enhancement layer image block, form enhancement layer bitstream, and the pattern information corresponding with described default coded system write in described enhancement layer bitstream for making decoding end according to the described pattern information described enhancement layer bitstream of decoding.
Particularly, encoding enhancement layer image block, generates enhancement layer image code stream, comprises the code stream information that 1920x1080 resolution quality can be provided.To enhancement layer image piece coding, can use except adopting existing HEVC coding mode, can also adopt inter-layer prediction skip mode to encode to enhancement layer.When using inter-layer prediction skip mode to enhancement layer image block coding to be encoded, such as coding is positioned at the enhancement layer image piece that the size of (64,64) position of enhancement layer image to be encoded is 64x64, direct coding inter-layer prediction skip mode sign, write code stream, generate enhancement layer bitstream.Whether coding side uses inter-layer prediction skip mode, need to carry out the comparison of code efficiency cost to inter-layer prediction skip mode and other patterns.Concrete, need to adopt (64 of inter-layer prediction mode coding, 64) the coding cost of the enhancement layer image piece that the size of position is 64x64, use the image block of decoded basal layer correspondence position, be positioned at base layer image (32, 32) size is base layer image piece after the decoding of 32x32, utilize up-sampling algorithm to carry out up-sampling processing to this base layer image piece, obtain size for the prediction piece of 64x64, using this prediction piece as (64 of enhancement layer, 64) position size is enhancement layer image piece after the decoding of 64x64, calculate (64 of the rear enhancement layer image piece of this decoding and enhancement layer, 64) position size is the distortion factor D_skip of enhancement layer image piece original image after the decoding of 64x64, compare the distortion factor Dn after D_Skip and other coding method decoded pictures, n=1,2,3..., chooses the coding mode of distortion factor minimum as the coding mode of current enhancement layer coding piece.
The layered encoder 300 that the embodiment of the present invention provides can realize beneficial effect as identical in hierarchy encoding method 100.
Please consult Fig. 6, the embodiment of the present invention also provides a kind of hierarchical decoding device 400 specifically to comprise:
Receiver module 410, for receiving basal layer code stream and enhancement layer bitstream;
The described basal layer code stream that described reception receiver module 410 receives provides the video quality of resolution 960x540, and described enhancement layer provides the video quality of resolution 1920x1080;
Decoder module 420, for decoding, described basal layer code stream obtains decoded base layer image piece;
Particularly, described decoder module 420 can be used basal layer code stream described in HEVC technique decodes to obtain decoded base layer image piece; Be appreciated that other similar decoding processes that described decoder module 320 also can adopt industry to be familiar with, as decoding process H.264.
Parsing module 430, for resolving described enhancement layer bitstream, obtains being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, and described pattern information is used to indicate the decoding process of to be decoded of described enhancement layer;
Particularly, described parsing module 430 is resolved the bit stream data of enhancement layer image block to be decoded, parsing obtains the inter-layer prediction skip mode sign of current block, described inter-layer prediction skip mode sign indicates the decoding process of to be decoded of the indicated described enhancement layer of described pattern information to comprise inter-layer prediction skip mode, if this is designated 1, show that current block is used inter-layer prediction skip mode to decode, otherwise according to the interframe of HEVC defined or intra prediction mode decoding;
Parameter acquisition module 440, for obtaining the predicted value of described enhancement layer reconstruction image block to be decoded from described decoded base layer image piece;
Particularly, if the predictive mode of enhancement layer image block to be decoded is inter-layer prediction skip mode, in code stream, do not comprise difference information, now corresponding basal layer is rebuild to image block and carried out as enhancement layer image block to be decoded, rebuilding pixel value after up-sampling.Particularly, for being positioned at (64 of enhancement layer image to be encoded, 64) the enhancement layer image piece to be decoded that the size of position is 64x64, obtaining basic layer position is (32,32) size is base layer image piece after the decoding of 32x32, uses image block that up-sampling algorithm is 64x64 size using this base layer image piece up-sampling as the predicted value of enhancement layer image to be encoded.
Described decoder module 420, is further used for according to the pattern information of described predicted value and the described enhancement layer image block to be decoded described enhancement layer module to be decoded of decoding;
Particularly, when the pattern information of described enhancement layer image block to be decoded be inter-layer prediction skip mode described predicted value be the decoded image blocks of the enhancement layer image piece to be decoded that the size of enhancement layer (64,64) position is 64x64.
Further, according to the embodiment of the present invention, described parsing module 430 is further used for:
Resolve enhancement layer image block code stream to be decoded coding_unit_svc (x0, y0, log2CbSize), wherein x0 and y0 represent the positional information of current image block to be decoded in current image to be decoded, and log2CbSize represents the size information of current image block to be decoded;
If the type of coding slice_type of enhancement layer is inter prediction encoding type i, or the type of coding of enhancement layer is that intraframe predictive coding and its layer of sign layerID are greater than 0, resolves and obtains skip mode sign skip_flag[x0] [y0];
If the type of coding slice_type of enhancement layer is intraframe coding type i, and layerID is greater than 0, enhancement layer image block use to be decoded inter-layer prediction skip mode decoding;
If the type of coding slice_type of enhancement layer is interframe encode type, and layerID is greater than 0, further resolve and obtain inter-layer prediction skip mode sign base_recon_skip_flag[x0] [y0], if base_recon_skip_flag[x0] [y0] 1 show that enhancement layer image block to be decoded is used the decoding of inter-layer prediction skip mode, if base_recon_skip_flag[x0] [y0] 1 show that enhancement layer image block to be decoded is used inter-layer prediction mode decoding.
The pattern information obtaining according to parsing completes decode procedure.
In embodiments of the present invention, decoder starts decoding enhancement layer after can be designed as the late whole base layer image of decoding again, also can decode after a late base layer image part, start decoding enhancement layer, real system can require to provide different designs according to hardware structure and complexity.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can complete by the relevant hardware of program command, aforesaid program can be stored in a computer read/write memory medium, this program, when carrying out, is carried out the step that comprises said method embodiment; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CDs.
Finally it should be noted that: above embodiment only, in order to technical scheme of the present invention to be described, is not intended to limit; Although the present invention is had been described in detail with reference to previous embodiment, those of ordinary skill in the art is to be understood that: its technical scheme that still can record aforementioned each embodiment is modified, or part technical characterictic is wherein equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution depart from the scope of various embodiments of the present invention technical scheme.
Claims (18)
1. a processing method for layered code stream, is characterized in that, comprising:
Receive basal layer code stream and enhancement layer bitstream;
The described basal layer code stream of decoding obtains decoded base layer image piece;
Resolve described enhancement layer bitstream, obtain being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, described pattern information is used to indicate the decoding process of to be decoded of described enhancement layer;
From described decoded base layer image piece, obtain the predicted value of described enhancement layer reconstruction image block to be decoded;
According to the pattern information of described predicted value and the described enhancement layer image block to be decoded described enhancement layer module to be decoded of decoding.
2. layered code stream processing method according to claim 1, it is characterized in that, wherein, the decoding process that the indicated described enhancement layer of described pattern information is to be decoded comprises inter-layer prediction skip mode, corresponding, the described pattern information according to described predicted value and the described enhancement layer image block to be decoded described enhancement layer module to be decoded of decoding comprises:
According to described predicted value and the described inter-layer prediction skip mode described enhancement layer module to be decoded of decoding.
3. layered code stream processing method according to claim 2, is characterized in that, describedly according to described predicted value and the described inter-layer prediction skip mode described enhancement layer module to be decoded of decoding, comprises:
Using described predicted value image block after the decoding of described enhancement layer image block to be decoded.
4. layered code stream processing method according to claim 3, is characterized in that, described described predicted value image block after the decoding of described enhancement layer image block to be decoded is comprised:
Choose the described decoded base layer image piece corresponding with the image block to be decoded of described enhancement layer, after up-sampling, obtain the predicted value of described enhancement layer reconstruction image block to be decoded;
Described predicted value obtains image block after the decoding of described enhancement layer image block to be decoded as the pixel value of the reconstruction image block to be decoded of described enhancement layer.
5. according to the layered code stream processing method described in claim 2 to 4 any one, it is characterized in that, the described enhancement layer bitstream of described parsing, obtains being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, comprising:
Parsing is included in the inter-layer prediction skip mode sign of the enhancement layer image block to be decoded in described enhancement layer bitstream, pattern information using described inter-layer prediction skip mode sign as described enhancement layer image block to be decoded, for determining according to described inter-layer prediction skip mode sign whether described enhancement layer image block to be decoded adopts the decoding of inter-layer prediction skip mode; Corresponding,
When the described enhancement layer of inter-layer prediction skip mode sign indication image block to be decoded is while adopting the decoding of inter-layer prediction skip mode, carry out described according to described predicted value and the described inter-layer prediction skip mode described enhancement layer module to be decoded of decoding.
6. layered code stream processing method according to claim 5, is characterized in that, the described enhancement layer bitstream of described parsing obtains being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, also comprises:
Resolve the skip mode sign of the image block to be decoded of described enhancement layer, if the decoding process of the image block to be decoded of the described enhancement layer of described skip mode sign sign is skip mode, carry out the inter-layer prediction skip mode sign that described parsing is included in the enhancement layer image block to be decoded in described enhancement layer bitstream.
7. a processing method for layered code stream, is characterized in that, comprising:
Basis of coding tomographic image piece, formation base layer bit stream;
According to default coded system encoding enhancement layer image block, form enhancement layer bitstream, and the pattern information corresponding with described default coded system write in described enhancement layer bitstream for making decoding end according to the described pattern information described enhancement layer bitstream of decoding.
8. processing method as claimed in claim 7, is characterized in that, described default coded system is inter-layer prediction skip mode;
Corresponding, the coded system encoding enhancement layer image block that described basis is default, form enhancement layer bitstream, and will in pattern information corresponding to described and described default coded system, write in described enhancement layer bitstream for making decoding end according to the described pattern information described enhancement layer bitstream of decoding, comprising:
According to inter-layer prediction skip mode encoding enhancement layer image block, form enhancement layer bitstream, and will in inter-layer prediction skip mode sign corresponding to described and described inter-layer prediction skip mode, as pattern information, write in described enhancement layer bitstream for making decoding end according to the described enhancement layer bitstream of described inter-layer prediction skip mode sign decoding.
9. processing method as claimed in claim 7 or 8, is characterized in that, described method also comprises:
Skip mode sign is write in described enhancement layer bitstream, and described skip mode sign is in order to indicate whether described default coded system is skip mode.
10. a processing unit for layered code stream, is characterized in that, comprising:
Receiver module, for receiving basal layer code stream and enhancement layer bitstream;
Decoder module, for decoding, described basal layer code stream obtains decoded base layer image piece;
Parsing module, resolves described enhancement layer bitstream, obtains being included in the pattern information of to be decoded of enhancement layer in described enhancement layer bitstream, and described pattern information is used to indicate the decoding process of to be decoded of described enhancement layer;
Parameter acquisition module, for obtaining the predicted value of described enhancement layer reconstruction image block to be decoded from described decoded base layer image piece;
Described decoder module, also for the described enhancement layer module to be decoded of decoding according to the pattern information of described predicted value and described enhancement layer image block to be decoded.
11. layered code stream processing unit according to claim 10, it is characterized in that, wherein, the decoding process that the indicated described enhancement layer of described pattern information is to be decoded comprises inter-layer prediction skip mode, corresponding, described described decoder module, also specifically comprises for the described enhancement layer module to be decoded of decoding according to the pattern information of described predicted value and described enhancement layer image block to be decoded:
Described decoder module, also for the described enhancement layer module to be decoded of decoding according to described predicted value and described inter-layer prediction skip mode.
12. layered code stream processing unit according to claim 11, is characterized in that, described decoder module specifically for:
Using described predicted value image block after the decoding of described enhancement layer image block to be decoded.
13. layered code stream processing unit according to claim 12, is characterized in that, described decoder module specifically for:
Choose the described decoded base layer image piece corresponding with the image block to be decoded of described enhancement layer, after up-sampling, obtain the predicted value of described enhancement layer reconstruction image block to be decoded;
The pixel value of the reconstruction image block to be decoded using described predicted value as described enhancement layer obtains image block after the decoding of described enhancement layer image block to be decoded.
14. according to claim 11 to the layered code stream processing unit described in 13 any one, it is characterized in that, described parsing module specifically for:
Parsing is included in the inter-layer prediction skip mode sign of the enhancement layer image block to be decoded in described enhancement layer bitstream, pattern information using described inter-layer prediction skip mode sign as described enhancement layer image block to be decoded, for determining according to described inter-layer prediction skip mode sign whether described enhancement layer image block to be decoded adopts the decoding of inter-layer prediction skip mode; Corresponding,
When the inter-layer prediction skip mode sign described enhancement layer of indication image block to be decoded is while adopting the decoding of inter-layer prediction skip mode,
Described decoder module, for the described enhancement layer module to be decoded of decoding according to described predicted value and described inter-layer prediction skip mode.
15. layered code stream processing unit according to claim 14, is characterized in that, described parsing module also for:
Resolve the skip mode sign of the image block to be decoded of described enhancement layer, if the decoding process of the image block to be decoded of the described enhancement layer of described skip mode sign sign is skip mode, for carrying out described parsing, be included in the inter-layer prediction skip mode sign of the enhancement layer image block to be decoded of described enhancement layer bitstream.
The encoder of 16. 1 kinds of layered code stream, is characterized in that, comprising:
The first coding module, for basis of coding tomographic image piece, formation base layer bit stream;
The second coding module, be used for according to default coded system encoding enhancement layer image block, form enhancement layer bitstream, and the pattern information corresponding with described default coded system write in described enhancement layer bitstream for making decoding end according to the described pattern information described enhancement layer bitstream of decoding.
17. encoders as claimed in claim 16, is characterized in that, described default coded system is inter-layer prediction skip mode;
Corresponding, described the second coding module is used for, according to inter-layer prediction skip mode encoding enhancement layer image block, form enhancement layer bitstream, and will in inter-layer prediction skip mode sign corresponding to described and described inter-layer prediction skip mode, as pattern information, write in described enhancement layer bitstream for making decoding end according to the described enhancement layer bitstream of described inter-layer prediction skip mode sign decoding.
18. encoders as described in claim 16 or 17, is characterized in that, described the second coding module also for, skip mode sign is write in described enhancement layer bitstream, described skip mode sign is in order to indicate whether described default coded system is skip mode.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210375832.2A CN103716633A (en) | 2012-09-30 | 2012-09-30 | Scaled code stream processing method, scaled code stream processing device and scaled code stream encoder |
| PCT/CN2013/084380 WO2014048353A1 (en) | 2012-09-30 | 2013-09-27 | Processing method and device for scaled code stream and coder for scaled code stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210375832.2A CN103716633A (en) | 2012-09-30 | 2012-09-30 | Scaled code stream processing method, scaled code stream processing device and scaled code stream encoder |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103716633A true CN103716633A (en) | 2014-04-09 |
Family
ID=50387007
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210375832.2A Pending CN103716633A (en) | 2012-09-30 | 2012-09-30 | Scaled code stream processing method, scaled code stream processing device and scaled code stream encoder |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103716633A (en) |
| WO (1) | WO2014048353A1 (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101383962A (en) * | 2007-09-07 | 2009-03-11 | 武汉大学 | Low code rate space domain enhancement layer encoding and decoding method based on interested region |
| CN101461244A (en) * | 2006-04-04 | 2009-06-17 | 三星电子株式会社 | Method and apparatus for encoding/decoding using extended macroblock skip mode |
| US20100128786A1 (en) * | 2007-04-23 | 2010-05-27 | Yong Ying Gao | Method and apparatus for encoding video data, method and apparatus for decoding encoded video data and encoded video signal |
| CN101895748A (en) * | 2010-06-21 | 2010-11-24 | 华为终端有限公司 | Coding and decoding methods and coding and decoding devices |
-
2012
- 2012-09-30 CN CN201210375832.2A patent/CN103716633A/en active Pending
-
2013
- 2013-09-27 WO PCT/CN2013/084380 patent/WO2014048353A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101461244A (en) * | 2006-04-04 | 2009-06-17 | 三星电子株式会社 | Method and apparatus for encoding/decoding using extended macroblock skip mode |
| US20100128786A1 (en) * | 2007-04-23 | 2010-05-27 | Yong Ying Gao | Method and apparatus for encoding video data, method and apparatus for decoding encoded video data and encoded video signal |
| CN101383962A (en) * | 2007-09-07 | 2009-03-11 | 武汉大学 | Low code rate space domain enhancement layer encoding and decoding method based on interested region |
| CN101895748A (en) * | 2010-06-21 | 2010-11-24 | 华为终端有限公司 | Coding and decoding methods and coding and decoding devices |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2014048353A1 (en) | 2014-04-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102062767B1 (en) | Method and apparatus for inter-prediction and motion-compensation | |
| KR102040315B1 (en) | Method and apparatus for entropy coding for slice segment, method and apparatus for entropy decoding for slice segment | |
| KR102290420B1 (en) | Method and apparatus for video encoding, method and apparatus for video decoding | |
| KR102329126B1 (en) | Method and device for configuring merge candidate list for decoding and encoding of interlayer video | |
| CN104581161B (en) | With the use of method and the equipment of large-scale conversion cell encoding and decoded picture | |
| KR102254118B1 (en) | Method and apparatus for video encoding using intra block copy prediction, method and apparatus for video decoding using intra block copy prediction | |
| KR102135957B1 (en) | Method and apparatus for multi-layer video encoding for random access, method and apparatus for multi-layer video decoding for random access | |
| KR20140005102A (en) | Method and apparatus for motion vector determination in video encoding or decoding | |
| KR20130050903A (en) | Method and apparatus for motion vector determination in video encoding or decoding | |
| CN102511163A (en) | Method and apparatus for decoding image based on skip mode | |
| KR20140034053A (en) | Method and appratus for inter-layer encoding of prediction information in scalable video encoding based on coding units of tree structure, method and appratus for inter-layer decoding of prediction information in scalable video decoding based on coding units of tree structure | |
| KR102312335B1 (en) | Method and apparatus for video encoding for illumination compensation, method and apparatus for video decoding for residual prediction | |
| CN103096053A (en) | Mode-transforming encoding and decoding method and device | |
| CN107690806B (en) | Video encoding method and video encoding apparatus, and video decoding method and video decoding apparatus | |
| KR20130018628A (en) | Method and apparatus for encodingmulti-view video prediction , method and apparatus for decodingmulti-view video prediction | |
| CN102611885B (en) | Encoding and decoding method and device | |
| KR20200024196A (en) | Method and apparatus for determining quantization parameter based on size of tranformation block | |
| TW201505424A (en) | Method and device for decoding a scalable stream representative of an image sequence and corresponding coding method and device | |
| WO2015091360A1 (en) | Method for coding a sequence of pictures and method for decoding a bitstream and corresponding devices | |
| KR102264679B1 (en) | Method and apparatus for applying view synthesized prediction according to illumination compensation | |
| KR20140122673A (en) | Method and apparatus for video encoding for illumination compensation, method and apparatus for video decoding for illu mination compensation | |
| CN103237213B (en) | Method for video coding and video encoding/decoding method and relevant apparatus | |
| KR20140122197A (en) | Method and apparatus for video stream encoding according to prediction for multi-view video, method and apparatus for video stream decoding according to prediction for multi-view video | |
| CN102474616B (en) | Methods and devices for creating, decoding and transcoding an encoded video data stream | |
| KR101663230B1 (en) | Method and apparatus for video encoding for residual prediction, method and apparatus for video decoding for residual prediction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140409 |