CN102801980A - Scalable video coding decoding device and method - Google Patents
Scalable video coding decoding device and method Download PDFInfo
- Publication number
- CN102801980A CN102801980A CN2012102834051A CN201210283405A CN102801980A CN 102801980 A CN102801980 A CN 102801980A CN 2012102834051 A CN2012102834051 A CN 2012102834051A CN 201210283405 A CN201210283405 A CN 201210283405A CN 102801980 A CN102801980 A CN 102801980A
- Authority
- CN
- China
- Prior art keywords
- data
- coefficient
- operator unit
- group
- layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 239000010410 layer Substances 0.000 claims description 116
- 239000011229 interlayer Substances 0.000 claims description 75
- 238000013139 quantization Methods 0.000 claims description 64
- 230000009466 transformation Effects 0.000 claims description 41
- 238000012545 processing Methods 0.000 claims description 23
- 230000008569 process Effects 0.000 claims description 10
- 230000008707 rearrangement Effects 0.000 claims description 5
- 230000008676 import Effects 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 abstract description 2
- 230000008901 benefit Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
Images
Abstract
The invention provides a scalable video coding decoding device and method. The device comprises an arithmetic unit in which all operations related to scalable video decoding are performed, a memory unit used for storing input data, output data and intermediate data and a bus for data transmission between the arithmetic unit and the memory unit. According to the device and the method which are provided by the invention, part of standard arithmetic units are modified and copied, a plurality of quality scalable layers are decoded in one attempt, the decoding speed is increased at limited cost, and the bandwidth of the bus is saved.
Description
Technical field
The present invention relates to a kind of decoding device and method of scalable video, particularly can improve the apparatus and method of quality scalable layer decoding speed in the scalable video.
Background technology
Scalable video (Scalable Video Codec) is on the basis of conventional video coding standard (H.264/MPEG4/MPEG2); The various tool and the notion of conventional video encoder have highly been utilized; Increased the time scalability; Spatial scalability and quality scalability have promoted bigger coding flexibility ratio, make video transmission more can adapt to the network bandwidth and decoding terminals, demonstration and the memory device of isomery.
For the scalability of realizing encoding, scalable video is divided into multilayer to each frame image data on Spatial Dimension and quality dimensions encodes, and realizes the time scalability at the time dimension higher slice simultaneously.
In quality scalability coding, the basic layer of the quality on the same space dimension is identical with the resolution of quality enhancement layer, the quantization parameter that different is when residual signals is encoded.Usually when the basic layer of coding quality, can adopt bigger quantization step, and when the coding quality enhancement layer, can adopt less quantization step.In scalable video standard H.264, give the method that coefficient divides into groups, make when adopting identical quantization step, divide into groups to produce a plurality of quality scalable layer through coefficient.The Y-PSNR (PSNR) of the basic layer of quality can be lower, and code check is low but quality is coarse.And each quality enhancement layer all is a kind of refinement to the basic layer of quality, and the data of each quality enhancement layer and basic layer are superimposed according to the algorithm of video encoding standard, can obtain higher-quality coded image.
Compare with the conventional video coding, the hierarchy of scalable video certainly will increase the complexity of decode system design, has not only increased the arithmetic element implementation complexity, has increased the throughput of bus bandwidth simultaneously.
Summary of the invention
In view of the problem that exists in the prior art; The object of the present invention is to provide a kind of decoding device that is used for scalable video; This device is included in arithmetic element, the memory cell that is used to store input data, dateout and intermediate data of wherein handling all computings relevant with the telescopic video decoding, the bus that is used for transfer of data between arithmetic element and the memory cell; Wherein arithmetic element comprises following subelement: parallel entropy decoding operation subelement; It comprises the entropy decoding operation logic of L group standard; Parallel entropy decoding operation subelement reads in N layer quality scalable layer data flow simultaneously and carries out the entropy decoding, and wherein N exports N group macro block information data and N group coefficient data simultaneously smaller or equal to L; Parallel counter-scanning operator unit; The counter-scanning arithmetic logic that comprises L group standard; Input comprises through N group coefficient data and macro block information data after the parallel entropy decoding operation subelement decoding; The scan format information in the macro block information data is organized according to N simultaneously in parallel counter-scanning operator unit, coefficient is put in order resequence and output; Coefficient reconstruct and inverse quantization operator unit; Its input comprises through the N group coefficient data after the counter-scanning operator unit weighs new sort with through the N group macro block information data after the parallel entropy decoding operation subelement decoding; Coefficient reconstruct and inverse quantization operator unit carry out reconstruct and inverse quantization according to macro block (mb) type, coefficient reconstructing method and quantitative information in the N group macro block information data to coefficient data.
Further, arithmetic element further comprises: inverse transformation operator unit, its input are through the coefficient data after coefficient reconstruct and the inverse quantization, and the output of inverse transformation operator unit is through the residual error data after the inverse transformation; Prediction restructing operation subelement; Its input comprises the macro block information data after the parallel entropy decoding operation subelement decoding of reference picture, interlayer reference data and process; Prediction restructing operation subelement utilizes reference picture, interlayer reference data or adjacent macroblocks decoded information data generation forecast result according to the predictive mode in the macro block information data; Wherein the interlayer reference data comprises the residual error reference data that is used for inter-layer residue prediction, the pixel reference data that is used for the interlayer infra-frame prediction; Image reconstruction operator unit, its input comprise that through the residual error data after the inverse transformation and through predicting the outcome after the prediction reconstruct image reconstruction operator unit is according to these two parts input data, and the reconstructed reference image also produces the interlayer reference data.
Further; Said memory cell further comprises: import data stream buffer memory to be decoded, reference picture buffer storage, interlayer reference data buffer storage, wherein the reconstructed reference image and the interlayer reference data of the output of image reconstruction operator unit output to reference picture buffer storage and interlayer reference data buffer storage through bus respectively.
Further; If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than L; M layer quality scalable layer data can be divided into K to be criticized and sends into parallel entropy decoding operation subelement and decode, and K is the result of (M+L-1)/L after rounding, and decodes every batch for K-1 time before wherein and sends into the N=L layer data; Send into N=M-(K-1) * L layer data for the K time; Each decoding is except output N group macro block information data and coefficient data, and the macro block information data of decoding also can deposit interlayer reference data buffer storage in, when decoding next group quality scalable layer data, can read in these data as a reference.
Further; If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than the number L of parallel processing logic in the parallel entropy decoding operation subelement; During K-1 before processing (K is the result after (M+L-1)/L rounds) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to interlayer reference data buffer storage; And when decoding next group quality scalable layer data, can read in these data as a reference, but these data can not be sent to inverse transformation operator cell processing; When handling K (result after K rounds for (M+L-1)/L) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit read in the coefficient reconfiguration information as a reference from interlayer reference data buffer storage; Utilize K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data to carry out reconstruct and inverse quantization then, obtain the result of the inverse quantization of one group of final M layer quality scalable layer.
The present invention also provides a kind of coding/decoding method that is used for scalable video; This method may further comprise the steps: the parallel entropy decoding operation subelement in the arithmetic element reads in N layer quality scalable layer data flow simultaneously and carries out the entropy decoding, exports N group macro block information data and N group coefficient data simultaneously; Parallel entropy decoding operation subelement comprises the entropy decoding operation logic of L group standard, and wherein N is smaller or equal to L; Input comprises through the N group coefficient data after the parallel entropy decoding operation subelement decoding and the macro block information data parallel counter-scanning operator unit in the arithmetic element; Parallel counter-scanning operator unit is simultaneously according to the scan format information in the N group macro block information data; To coefficient put in order rearrangement and output, parallel counter-scanning operator unit comprises the counter-scanning arithmetic logic of L group standard; Input comprises through the N group coefficient data after the counter-scanning operator unit weighs new sort with through coefficient reconstruct and the inverse quantization operator unit of the N group macro block information data after the parallel entropy decoding operation subelement decoding in the arithmetic element; Coefficient reconstruct and inverse quantization operator unit carry out reconstruct and inverse quantization according to macro block (mb) type, coefficient reconstructing method and quantitative information in the N group macro block information data to coefficient data.
Further, this method further comprises: to inverse transformation operator unit, the output of inverse transformation operator unit is through the residual error data after the inverse transformation through the coefficient data after coefficient reconstruct and the inverse quantization in input; Input comprises that the parallel entropy decoding operation subelement decoding of reference picture, interlayer reference data and process macro block information data afterwards are to predicting the restructing operation subelement; Prediction restructing operation subelement utilizes reference picture, interlayer reference data or adjacent macroblocks decoded information data generation forecast result according to the predictive mode in the macro block information data; Wherein the interlayer reference data comprises the residual error reference data that is used for inter-layer residue prediction, the pixel reference data that is used for the interlayer infra-frame prediction; Input comprises that through the residual error data after the inverse transformation and through the image reconstruction operator unit that predicts the outcome after the prediction reconstruct image reconstruction operator unit is according to these two parts input data, and the reconstructed reference image also produces the interlayer reference data.
Further; If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than L; M layer quality scalable layer data can be divided into K to be criticized and sends into parallel entropy decoding operation subelement and decode, and K is the result of (M+L-1)/L after rounding, and decodes every batch for K-1 time before wherein and sends into the N=L layer data; Send into N=M-(K-1) * L layer data for the K time; Each decoding is except output N group macro block information data and coefficient data, and the macro block information data of decoding also can deposit interlayer reference data buffer storage in, when decoding next group quality scalable layer data, can read in these data as a reference.
Further; If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than the number L of parallel processing logic in the parallel entropy decoding operation subelement; During K-1 before processing (K is the result after (M+L-1)/L rounds) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to interlayer reference data buffer storage; And when decoding next group quality scalable layer data, can read in these data as a reference, but these data can not be sent to inverse transformation operator cell processing; When handling K (result after K rounds for (M+L-1)/L) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit read in the coefficient reconfiguration information as a reference from interlayer reference data buffer storage; Utilize K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data to carry out reconstruct and inverse quantization then, obtain the result of the inverse quantization of one group of final M layer quality scalable layer.
Of the present invention having the following advantages: apparatus of the present invention and method are through revising and duplicating the part of standards arithmetic element, and a plurality of quality scalable layer of disposable decoding have improved decoding speed with limited cost, and have saved bus bandwidth.
Description of drawings
Accompanying drawing 1 is the decoding device structural representation of scalable video of the present invention.
Accompanying drawing 2 is parallel entropy decoding operation sub-unit structure sketch map.
Accompanying drawing 3 is when data flow has the quality scalable layer of M (M=10) layer equal resolution, and number of lines is the parallel entropy decoding operation subelement decoded instance of L (L=4).
Accompanying drawing 4 is parallel counter-scanning operator cellular construction sketch map.
Accompanying drawing 5 is the coding/decoding method flow chart of scalable video of the present invention.
Embodiment
For making above-mentioned purpose of the present invention, feature and advantage more obviously understandable, the present invention is done further detailed explanation below in conjunction with accompanying drawing and embodiment:
The objective of the invention is to propose a kind of apparatus and method that are used for improving scalable video quality scalable layer decoding speed.This device is through revising and duplicating the part of standards arithmetic element, and a plurality of quality scalable layer of disposable decoding have improved decoding speed with limited cost, and have saved bus bandwidth.Fig. 1 has provided the decoding device structural representation of scalable video of the present invention.As shown in Figure 1, apparatus of the present invention comprise arithmetic element, bus and memory cell.
For achieving the above object, apparatus of the present invention comprise following content:
1. arithmetic element
Arithmetic element comprises all arithmetic logics of telescopic video decoding device, and all are all accomplished in arithmetic element with the relevant computing of telescopic video decoding.Arithmetic element comprises following subelement:
1.1 parallel entropy decoding operation subelement
Parallel entropy decoding operation subelement comprises the entropy decoding operation logic of L group standard, the quality scalable layer parallel processing number decision that the size of L is supported by decoding device.Parallel entropy decoding operation subelement reads in N (N is smaller or equal to L) layer quality scalable layer data flow simultaneously and carries out the entropy decoding from data stream buffer memory to be decoded; Export N group macro block information data and N group coefficient data simultaneously, decode procedure is with reference to the algorithm and the flow process of video standard definition.The macro block information data refer to all macro block informations except that coefficient, comprise macro block (mb) type, scan mode, grouping information, information of forecasting, coefficient reconstruct mode, mapping mode, quantitative information etc.Can be in the macro block information data decode process with reference to the macro block information of adjacent layer; Decoded result is used to control (other operator unit except that parallel entropy decoding operation subelement, other each operator unit; Comprise parallel counter-scanning subelement, coefficient reconstruct and inverse quantization subelement and prediction reconstruct subelement) data handling procedure.Coefficient data refers to the coefficient of each piece in the macro block, can deliver to parallel counter-scanning operator unit after the decoding and resequence.Fig. 2 has provided parallel entropy decoding operation sub-unit structure sketch map.
Be not more than L if having the number M of the quality scalable layer of equal resolution in the data flow to be decoded, M layer quality scalable layer data can be sent into parallel entropy decoding operation subelement simultaneously and handle, output M group macro block information data and M group coefficient data.
If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than L, M layer quality scalable layer data can be divided into K to be criticized and sends into parallel entropy decoding operation subelement and decode, and K is the result of (M+L-1)/L after rounding.The N=L layer data is sent in wherein preceding K-1 every batch of decoding, sends into N=M-(K-1) * L layer data the K time.In this case; Each decoding is except output N group macro block information data and coefficient data; The macro block information data of decoding also can deposit interlayer reference data buffer storage in, when decoding next group quality scalable layer data, can read in these data (algorithm according to the video standard definition utilizes the coefficient data of these reference datas and current decoding to realize coefficient reconstruct) as a reference.Fig. 3 has provided when data flow has the quality scalable layer of M (M=10) layer equal resolution, and number of lines is the parallel entropy decoding operation subelement decoded instance of L (L=4).With Fig. 3 is example; Decode procedure comprises 3 steps: step 1: first handles 4 groups of data; Processing procedure comprises parallel entropy decoding, parallel counter-scanning and coefficient reconstruct and inverse quantization, and 4 groups of data are merged into 1 group of data after through coefficient reconstruct and inverse quantization processing.Owing to have 10 groups of data, first data are temporarily stored into interlayer reference data buffer storage after through coefficient reconstruct and inverse quantization.Step 2: handle second batch data then; Method is with step 1; Just when carrying out coefficient reconstruct and inverse quantization, need read the coefficient data that is temporarily stored in the interlayer reference data buffer storage, deposit the coefficient data after the reconstruct in interlayer reference data buffer storage once more then.Step 3: handle the 3rd batch data at last, method is with step 2, and just the coefficient data after carrying out coefficient reconstruct and inverse quantization need not deposit interlayer reference data buffer storage in.After 3 step process, 10 groups of coefficients finally reconstitute 1 group of coefficient, and then are input to inverse transformation operator unit and carry out inverse transformation and handle.
1.2 parallel counter-scanning operator unit
Parallel counter-scanning operator unit comprises the counter-scanning arithmetic logic of L (identical with the number of parallel processing logic in the parallel entropy decoding operation subelement) group standard, and input comprises through N (N is smaller or equal to L) group coefficient data and macro block information data after the parallel entropy decoding operation subelement decoding.Parallel counter-scanning operator unit is simultaneously according to the scan format information in the N group macro block information data; According to the algorithm that defines in the video standard to the coefficient rearrangement that puts in order; Scanning algorithm such as defining in the scalable video standard H.264 comprises zig-zag scanning algorithm and field scanning algorithm, and specific algorithm is with reference to standard H.264.N group coefficient data after the rearrangement is exported, and is sent to coefficient reconstruct then and inverse quantization operator unit carries out coefficient reconstruct and inverse quantization.Fig. 4 has provided the structural representation of parallel counter-scanning operator unit.
1.3 coefficient reconstruct and inverse quantization operator unit
The input of coefficient reconstruct and inverse quantization operator unit comprises through the N group coefficient data after the counter-scanning operator unit weighs new sort with through the N group macro block information data after the parallel entropy decoding operation subelement decoding.Coefficient reconstruct and inverse quantization operator unit carry out reconstruct and inverse quantization according to the algorithm that defines in the video standard to coefficient data according to macro block (mb) type, coefficient reconstructing method and quantitative information in the N group macro block information data.
If have the number L that the number M of the quality scalable layer of equal resolution is not more than parallel processing logic in the parallel entropy decoding operation subelement in the data flow to be decoded; Coefficient reconstruct and inverse quantization operator unit are output as the data after 1 group of inverse quantization, are sent to inverse transformation operator unit and carry out inverse transformation.
If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than the number L of parallel processing logic in the parallel entropy decoding operation subelement; During K-1 before processing (K is the result after (M+L-1)/L rounds) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to interlayer reference data buffer storage; And when decoding next group quality scalable layer data, can read in these data as a reference, but these data can not be sent to inverse transformation operator cell processing; When handling K (result after K rounds for (M+L-1)/L) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit read in the coefficient reconfiguration information as a reference from interlayer reference data buffer storage; Utilize K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data to carry out reconstruct and inverse quantization then; Obtain the result of the inverse quantization of one group of final M layer quality scalable layer, be sent to inverse transformation operator unit again and carry out inverse transformation.
1.4 inverse transformation operator unit
The input of inverse transformation operator unit is through one group of coefficient data after coefficient reconstruct and the inverse quantization.Inverse transformation operator unit carries out the inverse transformation computing according to the algorithm that provides in the video encoding standard, comprises integral inverse transform and Hadamard inverse transformation such as the inverse transformation algorithm that defines in the scalable video standard H.264, and specific algorithm is with reference to standard H.264.The output of inverse transformation operator unit is that residual error data can be delivered to image reconstruction operator unit and carry out image reconstruction through the residual error data after the inverse transformation.
1.5 prediction restructing operation subelement
The input of prediction restructing operation subelement comprises the macro block information data after the parallel entropy decoding operation subelement decoding of reference picture, interlayer reference data (comprising residual error reference data that is used for inter-layer residue prediction and the pixel reference data that is used for the interlayer infra-frame prediction) and process.Prediction restructing operation subelement is at first predicted according to input data (being reference image data and residual error reference data, pixel reference data); Prediction mode comprises infra-frame prediction, inter prediction and inter-layer prediction (comprising interlayer infra-frame prediction and inter-layer residue prediction); The algorithm of prediction is according to the algorithm that defines in the video encoding standard, and prediction result is called prediction data.For example H.264 can utilize the adjacent macroblocks information data to carry out infra-frame prediction (comprising 9 kinds of 4x4 intra-frame prediction methods and 5 kinds of 16x16 intra-frame prediction methods) in the scalable video; Utilize reference image data to carry out inter prediction and (comprise 7 kinds of macro blocks and piece division methods; On prediction direction, comprise single directional prediction, bi-directional predicted and Direct Model prediction; The luminance signal precision of prediction can arrive 1/4th pixels); Utilize the interlayer reference data to carry out interlayer infra-frame prediction and inter-layer residue prediction simultaneously.Predict the outcome and to be sent to image reconstruction operator unit and to carry out image reconstruction.
1.6 image reconstruction operator unit
The input of image reconstruction operator unit comprises through the residual error data after the inverse transformation and through predicting the outcome after the prediction reconstruct.Image reconstruction operator unit carries out image reconstruction according to these two parts input data according to the algorithm that defines in the video encoding standard.Image reconstruction operator unit is the reconstructed reference image not only, also can produce interlayer reference data (comprising residual error reference data that is used for inter-layer residue prediction and the pixel reference data that is used for the interlayer infra-frame prediction).The result of image reconstruction can output to reference picture buffer storage and interlayer reference data buffer storage through bus respectively.The result of image reconstruction is exactly final decoded results, and above-mentioned each operator unit is accomplished the partial decoding of h function respectively, finally constitutes a complete decoding device.
2. memory cell
Memory cell can be any one memory device; Memory cell comprises input data stream buffer memory to be decoded, reference picture buffer storage, interlayer reference data buffer storage, and these buffer storage are that needed input data, dateout and intermediate data provide memory space in the telescopic video decode procedure.
2.1 import data stream buffer memory to be decoded
This buffer storage is used for storage input data flow to be decoded.
2.2 reference picture buffer storage
This buffer storage is used for the stored reference image, and reference picture offers prediction restructing operation subelement and uses.
2.3 interlayer reference data buffer storage
This buffer storage is used for reference data between accumulation layer, and the interlayer reference data comprises the intermediate data of all inter-layer prediction needs.
3. bus
Bus can be any one system bus, is responsible for the transfer of data between arithmetic element and the memory cell.
Fig. 5 has provided the decoding process figure of method of the present invention.This method may further comprise the steps: the parallel entropy decoding operation subelement in the arithmetic element reads in N layer quality scalable layer data flow simultaneously and carries out the entropy decoding, exports N group macro block information data and N group coefficient data simultaneously; Parallel entropy decoding operation subelement comprises the entropy decoding operation logic of L group standard, and wherein N is smaller or equal to L; Input comprises through the N group coefficient data after the parallel entropy decoding operation subelement decoding and the macro block information data parallel counter-scanning operator unit in the arithmetic element; Parallel counter-scanning operator unit is simultaneously according to the scan format information in the N group macro block information data; To coefficient put in order rearrangement and output, parallel counter-scanning operator unit comprises the counter-scanning arithmetic logic of L group standard; Input comprises through the N group coefficient data after the counter-scanning operator unit weighs new sort with through coefficient reconstruct and the inverse quantization operator unit of the N group macro block information data after the parallel entropy decoding operation subelement decoding in the arithmetic element; Coefficient reconstruct and inverse quantization operator unit carry out reconstruct and inverse quantization according to macro block (mb) type, coefficient reconstructing method and quantitative information in the N group macro block information data to coefficient data.
This method further comprises: to inverse transformation operator unit, the output of inverse transformation operator unit is through the residual error data after the inverse transformation through the coefficient data after coefficient reconstruct and the inverse quantization in input; Input comprises that the parallel entropy decoding operation subelement decoding of reference picture, interlayer reference data and process macro block information data afterwards are to predicting the restructing operation subelement; Prediction restructing operation subelement utilizes reference picture, interlayer reference data or adjacent macroblocks decoded information data generation forecast result according to the predictive mode in the macro block information data; Wherein the interlayer reference data comprises the residual error reference data that is used for inter-layer residue prediction, the pixel reference data that is used for the interlayer infra-frame prediction; Input comprises that through the residual error data after the inverse transformation and through the image reconstruction operator unit that predicts the outcome after the prediction reconstruct image reconstruction operator unit is according to these two parts input data, and the reconstructed reference image also produces the interlayer reference data.
If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than L; M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operation subelement and decode; K is the result after (M+L-1)/L rounds; The N=L layer data is sent in wherein preceding K-1 every batch of decoding, sends into N=M-(K-1) * L layer data the K time, and each decoding is organized macro block information data and the coefficient data except output N; The macro block information data of decoding also can deposit interlayer reference data buffer storage in, when decoding next group quality scalable layer data, can read in these data as a reference.
If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than the number L of parallel processing logic in the parallel entropy decoding operation subelement; During K-1 before processing (K is the result after (M+L-1)/L rounds) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to interlayer reference data buffer storage; And when decoding next group quality scalable layer data, can read in these data as a reference, but these data can not be sent to inverse transformation operator cell processing; When handling K (result after K rounds for (M+L-1)/L) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit read in the coefficient reconfiguration information as a reference from interlayer reference data buffer storage; Utilize K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data to carry out reconstruct and inverse quantization then, obtain the result of the inverse quantization of one group of final M layer quality scalable layer.
In sum, the inventive method is passed through to revise and increase entropy decoding, scanning and coefficient reconstruct and inverse quantization hardware handles unit with device, has improved the decoding speed of quality scalable layer in the scalable video, has saved bus bandwidth.
More than be the detailed description that the preferred embodiments of the present invention are carried out, but those of ordinary skill in the art should be appreciated that within the scope of the invention with spirit and instruct down that various improvement, interpolation and replacement all are possible.These are all in the protection range that claim of the present invention limited.
Claims (9)
1. decoding device that is used for scalable video; This device is included in arithmetic element, the memory cell that is used to store input data, dateout and intermediate data of wherein handling all computings relevant with the telescopic video decoding, the bus that is used for transfer of data between arithmetic element and the memory cell, it is characterized in that arithmetic element comprises following subelement:
Parallel entropy decoding operation subelement; It comprises the entropy decoding operation logic of L group standard; Parallel entropy decoding operation subelement reads in N layer quality scalable layer data flow simultaneously and carries out the entropy decoding, and wherein N exports N group macro block information data and N group coefficient data simultaneously smaller or equal to L;
Parallel counter-scanning operator unit; The counter-scanning arithmetic logic that comprises L group standard; Input comprises through N group coefficient data and macro block information data after the parallel entropy decoding operation subelement decoding; The scan format information in the macro block information data is organized according to N simultaneously in parallel counter-scanning operator unit, coefficient is put in order resequence and output;
Coefficient reconstruct and inverse quantization operator unit; Its input comprises through the N group coefficient data after the counter-scanning operator unit weighs new sort with through the N group macro block information data after the parallel entropy decoding operation subelement decoding; Coefficient reconstruct and inverse quantization operator unit carry out reconstruct and inverse quantization according to macro block (mb) type, coefficient reconstructing method and quantitative information in the N group macro block information data to coefficient data.
2. device according to claim 1 is characterized in that arithmetic element further comprises:
Inverse transformation operator unit, its input are through the coefficient data after coefficient reconstruct and the inverse quantization, and the output of inverse transformation operator unit is through the residual error data after the inverse transformation;
Prediction restructing operation subelement; Its input comprises the macro block information data after the parallel entropy decoding operation subelement decoding of reference picture, interlayer reference data and process; Prediction restructing operation subelement utilizes reference picture, interlayer reference data or adjacent macroblocks decoded information data generation forecast result according to the predictive mode in the macro block information data; Wherein the interlayer reference data comprises the residual error reference data that is used for inter-layer residue prediction, the pixel reference data that is used for the interlayer infra-frame prediction;
Image reconstruction operator unit, its input comprise that through the residual error data after the inverse transformation and through predicting the outcome after the prediction reconstruct image reconstruction operator unit is according to these two parts input data, and the reconstructed reference image also produces the interlayer reference data.
3. device according to claim 1 and 2; It is characterized in that: said memory cell further comprises: import data stream buffer memory to be decoded, reference picture buffer storage, interlayer reference data buffer storage, wherein the reconstructed reference image and the interlayer reference data of the output of image reconstruction operator unit output to reference picture buffer storage and interlayer reference data buffer storage through bus respectively.
4. device according to claim 3 is characterized in that:
If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than L; M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operation subelement and decode; K is the result after (M+L-1)/L rounds; The N=L layer data is sent in wherein preceding K-1 every batch of decoding, sends into N=M-(K-1) * L layer data the K time, and each decoding is organized macro block information data and the coefficient data except output N; The macro block information data of decoding also can deposit interlayer reference data buffer storage in, when decoding next group quality scalable layer data, can read in these data as a reference.
5. device according to claim 4 is characterized in that:
If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than the number L of parallel processing logic in the parallel entropy decoding operation subelement; During K-1 before processing (K is the result after (M+L-1)/L rounds) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to interlayer reference data buffer storage; And when decoding next group quality scalable layer data, can read in these data as a reference, but these data can not be sent to inverse transformation operator cell processing; When handling K (result after K rounds for (M+L-1)/L) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit read in the coefficient reconfiguration information as a reference from interlayer reference data buffer storage; Utilize K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data to carry out reconstruct and inverse quantization then, obtain the result of the inverse quantization of one group of final M layer quality scalable layer.
6. coding/decoding method that is used for scalable video is characterized in that may further comprise the steps:
Parallel entropy decoding operation subelement in the arithmetic element reads in N layer quality scalable layer data flow simultaneously and carries out the entropy decoding, exports N group macro block information data and N group coefficient data simultaneously; Parallel entropy decoding operation subelement comprises the entropy decoding operation logic of L group standard, and wherein N is smaller or equal to L;
Input comprises through the N group coefficient data after the parallel entropy decoding operation subelement decoding and the macro block information data parallel counter-scanning operator unit in the arithmetic element; Parallel counter-scanning operator unit is simultaneously according to the scan format information in the N group macro block information data; To coefficient put in order rearrangement and output, parallel counter-scanning operator unit comprises the counter-scanning arithmetic logic of L group standard;
Input comprises through the N group coefficient data after the counter-scanning operator unit weighs new sort with through coefficient reconstruct and the inverse quantization operator unit of the N group macro block information data after the parallel entropy decoding operation subelement decoding in the arithmetic element; Coefficient reconstruct and inverse quantization operator unit carry out reconstruct and inverse quantization according to macro block (mb) type, coefficient reconstructing method and quantitative information in the N group macro block information data to coefficient data.
7. method according to claim 6 is characterized in that this method further comprises:
To inverse transformation operator unit, the output of inverse transformation operator unit is through the residual error data after the inverse transformation through the coefficient data after coefficient reconstruct and the inverse quantization in input;
Input comprises that the parallel entropy decoding operation subelement decoding of reference picture, interlayer reference data and process macro block information data afterwards are to predicting the restructing operation subelement; Prediction restructing operation subelement utilizes reference picture, interlayer reference data or adjacent macroblocks decoded information data generation forecast result according to the predictive mode in the macro block information data; Wherein the interlayer reference data comprises the residual error reference data that is used for inter-layer residue prediction, the pixel reference data that is used for the interlayer infra-frame prediction;
Input comprises that through the residual error data after the inverse transformation and through the image reconstruction operator unit that predicts the outcome after the prediction reconstruct image reconstruction operator unit is according to these two parts input data, and the reconstructed reference image also produces the interlayer reference data.
8. according to claim 6 or 7 described methods; It is characterized in that: if the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than L; M layer quality scalable layer data can be divided into K to be criticized and sends into parallel entropy decoding operation subelement and decode, and K is the result of (M+L-1)/L after rounding, and decodes every batch for K-1 time before wherein and sends into the N=L layer data; Send into N=M-(K-1) * L layer data for the K time; Each decoding is except output N group macro block information data and coefficient data, and the macro block information data of decoding also can deposit interlayer reference data buffer storage in, when decoding next group quality scalable layer data, can read in these data as a reference.
9. method according to claim 8 is characterized in that:
If the number M of quality scalable layer that has equal resolution in the data flow to be decoded is greater than the number L of parallel processing logic in the parallel entropy decoding operation subelement; During K-1 before processing (K is the result after (M+L-1)/L rounds) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to interlayer reference data buffer storage; And when decoding next group quality scalable layer data, can read in these data as a reference, but these data can not be sent to inverse transformation operator cell processing; When handling K (result after K rounds for (M+L-1)/L) quality of lot scalable layer; Coefficient reconstruct and inverse quantization operator unit read in the coefficient reconfiguration information as a reference from interlayer reference data buffer storage; Utilize K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data to carry out reconstruct and inverse quantization then, obtain the result of the inverse quantization of one group of final M layer quality scalable layer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210283405.1A CN102801980B (en) | 2012-08-09 | 2012-08-09 | A kind of decoding device for scalable video and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210283405.1A CN102801980B (en) | 2012-08-09 | 2012-08-09 | A kind of decoding device for scalable video and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102801980A true CN102801980A (en) | 2012-11-28 |
| CN102801980B CN102801980B (en) | 2016-01-20 |
Family
ID=47200935
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210283405.1A Active CN102801980B (en) | 2012-08-09 | 2012-08-09 | A kind of decoding device for scalable video and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102801980B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024389A (en) * | 2012-12-24 | 2013-04-03 | 芯原微电子(北京)有限公司 | HEVC (high efficiency video coding) decoding device and method |
| CN104768008A (en) * | 2015-03-26 | 2015-07-08 | 哈尔滨工业大学 | Fast encoding method for scalable video code |
| CN105453568A (en) * | 2013-07-30 | 2016-03-30 | 株式会社Kt | Scalable video signal encoding/decoding method and apparatus |
| CN105791866A (en) * | 2014-12-24 | 2016-07-20 | 北京数码视讯科技股份有限公司 | Video coding intermediate data obtaining method, device and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101878649A (en) * | 2007-12-04 | 2010-11-03 | 索尼公司 | An extension to the avc standard to support the encoding and storage of high resolution digital still pictures in parallel with video |
| US20110122944A1 (en) * | 2009-11-24 | 2011-05-26 | Stmicroelectronics Pvt. Ltd. | Parallel decoding for scalable video coding |
| US20110274178A1 (en) * | 2010-05-06 | 2011-11-10 | Canon Kabushiki Kaisha | Method and device for parallel decoding of video data units |
-
2012
- 2012-08-09 CN CN201210283405.1A patent/CN102801980B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101878649A (en) * | 2007-12-04 | 2010-11-03 | 索尼公司 | An extension to the avc standard to support the encoding and storage of high resolution digital still pictures in parallel with video |
| US20110122944A1 (en) * | 2009-11-24 | 2011-05-26 | Stmicroelectronics Pvt. Ltd. | Parallel decoding for scalable video coding |
| US20110274178A1 (en) * | 2010-05-06 | 2011-11-10 | Canon Kabushiki Kaisha | Method and device for parallel decoding of video data units |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024389A (en) * | 2012-12-24 | 2013-04-03 | 芯原微电子(北京)有限公司 | HEVC (high efficiency video coding) decoding device and method |
| CN103024389B (en) * | 2012-12-24 | 2015-08-12 | 芯原微电子(北京)有限公司 | A kind of decoding device for HEVC and method |
| CN105453568A (en) * | 2013-07-30 | 2016-03-30 | 株式会社Kt | Scalable video signal encoding/decoding method and apparatus |
| US10148949B2 (en) | 2013-07-30 | 2018-12-04 | Kt Corporation | Scalable video signal encoding/decoding method and apparatus |
| US10154259B2 (en) | 2013-07-30 | 2018-12-11 | Kt Corporation | Image encoding and decoding method supporting plurality of layers and apparatus using same |
| CN105791866A (en) * | 2014-12-24 | 2016-07-20 | 北京数码视讯科技股份有限公司 | Video coding intermediate data obtaining method, device and system |
| CN105791866B (en) * | 2014-12-24 | 2018-10-30 | 北京数码视讯科技股份有限公司 | Video coding intermediate data acquisition methods, equipment and system |
| CN104768008A (en) * | 2015-03-26 | 2015-07-08 | 哈尔滨工业大学 | Fast encoding method for scalable video code |
| CN104768008B (en) * | 2015-03-26 | 2018-01-30 | 哈尔滨工业大学 | A kind of fast encoding method for scalable video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102801980B (en) | 2016-01-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103621099B (en) | Entropy decoding method and use its decoding apparatus | |
| US9787996B2 (en) | Encoding/decoding method and apparatus using a tree structure | |
| CN103959790B (en) | Scanning of prediction residuals in high efficiency video coding | |
| JP2020205627A (en) | Inter-prediction method and device thereof | |
| JP6545770B2 (en) | Inter prediction method, decoding apparatus and video decoding method | |
| CN108141588A (en) | inter-frame prediction method and device in image encoding system | |
| CN103650496A (en) | Pixel-based intra prediction for coding in HEVC | |
| WO2017191461A1 (en) | Video encoding using hierarchical algorithms | |
| CN104918045A (en) | Method and encoding/decoding of video using common merging candidate set of asymmetric partitions | |
| CN101779463B (en) | Method for processing images and the corresponding electronic device | |
| CN104041035A (en) | Lossless Coding and Associated Signaling Methods for Compound Video | |
| CN106851292A (en) | For the method for the decoding image of infra-frame prediction | |
| CN105847830A (en) | Method for encoding and decoding images, and device using same | |
| CN105284114A (en) | Method and apparatus for processing video signal | |
| CN101895756A (en) | Method and system for coding, decoding and reconstructing video image blocks | |
| CN104604232A (en) | Method and apparatus for encoding multi-view images, and method and apparatus for decoding multi-view images | |
| CN102484701A (en) | Methods and apparatus for spatially varying residue coding | |
| CN103975599A (en) | Method, device, and program for coding and decoding of images | |
| CN105659600A (en) | Method and device for decoding a scalable stream representative of an image sequence and corresponding coding method and device | |
| US9686558B2 (en) | Scalable encoding and decoding | |
| CN102801980B (en) | A kind of decoding device for scalable video and method | |
| US9014495B2 (en) | Parallel intra prediction method for video data | |
| CN102833542B (en) | A kind of raising scalable video quality enhancement layer coding rate apparatus and method | |
| CN102238385A (en) | Encoder and/or vertical and/or horizontal cache device of decoder and method | |
| CN104506860A (en) | Video coding reference image selecting method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: VERISILICON (SHANGHAI) INC. VERISILICON MICROELECT Free format text: FORMER OWNER: VERISILICON (SHANGHAI) INC. Effective date: 20130724 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20130724 Address after: 100193 Information Center building A106, Zhongguancun Software Park, Beijing, Haidian District Applicant after: VeriSilicon Microelectronics (Beijing) Co., Ltd. Applicant after: VeriSilicon Microelectronics (Shanghai) Co., Ltd. Applicant after: VERISILICON MICROELECTRONICS (CHENGDU) CO., LTD. Address before: 100193 Information Center building A106, Zhongguancun Software Park, Beijing, Haidian District Applicant before: VeriSilicon Microelectronics (Beijing) Co., Ltd. Applicant before: VeriSilicon Microelectronics (Shanghai) Co., Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Scalable video coding decoding device and method Effective date of registration: 20170621 Granted publication date: 20160120 Pledgee: National integrated circuit industry investment fund, Limited by Share Ltd Pledgor: VeriSilicon Microelectronics (Beijing) Co., Ltd.|(Shanghai) virisilicon Microelectronics Co., Ltd.|virisilicon Microelectronics (Chengdu) Registration number: 2017990000508 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20190415 Granted publication date: 20160120 Pledgee: National integrated circuit industry investment fund, Limited by Share Ltd Pledgor: VeriSilicon Microelectronics (Beijing) Co., Ltd.|VeriSilicon Microelectronics (Shanghai) Co., Ltd.|VERISILICON MICROELECTRONICS (CHENGDU) CO., LTD. Registration number: 2017990000508 |
|
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 100193 Information Center Building A106, Zhongguancun Software Park, Haidian District, Beijing Co-patentee after: Xinyuan Microelectronics (Shanghai) Co., Ltd. Patentee after: VeriSilicon Microelectronics (Beijing) Co., Ltd. Co-patentee after: VERISILICON MICROELECTRONICS (CHENGDU) CO., LTD. Address before: 100193 Information Center Building A106, Zhongguancun Software Park, Haidian District, Beijing Co-patentee before: VeriSilicon Microelectronics (Shanghai) Co., Ltd. Patentee before: VeriSilicon Microelectronics (Beijing) Co., Ltd. Co-patentee before: VERISILICON MICROELECTRONICS (CHENGDU) CO., LTD. |