CN102801980B - A kind of decoding device for scalable video and method - Google Patents
A kind of decoding device for scalable video and method Download PDFInfo
- Publication number
- CN102801980B CN102801980B CN201210283405.1A CN201210283405A CN102801980B CN 102801980 B CN102801980 B CN 102801980B CN 201210283405 A CN201210283405 A CN 201210283405A CN 102801980 B CN102801980 B CN 102801980B
- Authority
- CN
- China
- Prior art keywords
- data
- layer
- operator unit
- coefficient
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000015654 memory Effects 0.000 claims abstract description 48
- 230000008569 process Effects 0.000 claims abstract description 17
- 238000012546 transfer Methods 0.000 claims abstract description 4
- 239000010410 layer Substances 0.000 claims description 132
- 239000011229 interlayer Substances 0.000 claims description 69
- 238000013139 quantization Methods 0.000 claims description 64
- 230000009466 transformation Effects 0.000 claims description 41
- 238000012545 processing Methods 0.000 claims description 18
- 230000008707 rearrangement Effects 0.000 claims description 8
- 230000001413 cellular effect Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
Abstract
The invention provides a kind of decoding device for scalable video and method, this device be included in wherein process all relevant computings of decoding to telescopic video arithmetic element, input data for storing, the memory cell that exports data and intermediate data, bus for transfer of data between arithmetic element and memory cell.Apparatus of the present invention and method are by revising and copy part of standards arithmetic element, and the multiple quality scalable layer of disposable decoding, improves decoding speed with limited cost, and save bus bandwidth.
Description
Technical field
The present invention relates to a kind of decoding device and method of scalable video, particularly can improve the apparatus and method of quality scalable layer decoding speed in scalable video.
Background technology
Scalable video (ScalableVideoCodec) is on the basis of conventional video coding standard (H.264/MPEG4/MPEG2), highly make use of various instrument and the concept of conventional video encoder, add time scalability, spatial scalability and quality scalability, improve larger coding flexibility ratio, make transmission of video more can adapt to the network bandwidth and decoding terminals, display and the memory device of isomery.
In order to realize the scalability of encoding, scalable video is divided into multilayer each frame image data and encodes on Spatial Dimension and quality dimensions, realizes time scalability at time dimension higher slice simultaneously.
In quality scalability coding, the quality base layer in the same space dimension is identical with the resolution of quality enhancement layer, unlike quantization parameter when encoding to residual signals.Usually, when coding quality Primary layer, larger quantization step can be adopted, and when coding quality enhancement layer, less quantization step can be adopted.In H.264 scalable video standard, giving the method for coefficient grouping, making when adopting identical quantization step, multiple quality scalable layer can be produced by coefficient grouping.The Y-PSNR (PSNR) of quality base layer can be lower, and code check is low but quality is coarse.And each quality enhancement layer is a kind of refinement to quality base layer, the data of each quality enhancement layer and Primary layer are superimposed according to the algorithm of video encoding standard, can obtain higher-quality coded image.
Compared with encoding with conventional video, the hierarchy of scalable video certainly will add the complexity of decode system design, not only increases arithmetic element implementation complexity, increases the throughput of bus bandwidth simultaneously.
Summary of the invention
In view of problems of the prior art, the object of the present invention is to provide a kind of decoding device for scalable video, this device is included in the arithmetic element wherein processing all relevant computings of decoding to telescopic video, for storing input data, export the memory cell of data and intermediate data, for the bus of transfer of data between arithmetic element and memory cell, wherein arithmetic element comprises following subelement: parallel entropy decoding operator unit, it comprises the entropy decoding arithmetic logic of L group standard, parallel entropy decoding operator unit reads in N layer quality scalable layer data flow simultaneously and carries out entropy decoding, wherein N is less than or equal to L, export N group macroblock information data and N group coefficient data simultaneously, parallel counter-scanning operator unit, comprise the counter-scanning arithmetic logic of L group standard, input the N group coefficient data and macroblock information data that comprise after parallel entropy decoding operator unit decodes, parallel counter-scanning operator unit, simultaneously according to the scan format information in N group macroblock information data, puts in order to coefficient and resequences and export, coefficient reconstruct and inverse quantization operator unit, its input comprises the N group coefficient data after the rearrangement of counter-scanning operator unit and the N group macroblock information data after parallel entropy decoding operator unit decodes, coefficient reconstruct and inverse quantization operator unit, according to macro block (mb) type, coefficient reconstructing method and quantitative information in N group macroblock information data, are reconstructed and inverse quantization coefficient data.
Further, arithmetic element comprises further: inverse transformation operator unit, and its input is through the coefficient data after coefficient reconstruct and inverse quantization, the output of inverse transformation operator unit be through inverse transformation after residual error data; Prediction restructing operation subelement, its input comprises reference picture, inter-layer reference data and the macroblock information data after parallel entropy decoding operator unit decodes, prediction restructing operation subelement, according to the predictive mode in macroblock information data, utilizes reference picture, inter-layer reference data or adjacent macroblocks decoded information data generation forecast result; Wherein inter-layer reference data comprise the residual error reference data for inter-layer residue prediction, the pixel reference data for inter-layer intra prediction; Image reconstruction operation subelement, it inputs the residual error data that comprises after inverse transformation and predicting the outcome after prediction reconstruct, image reconstruction operation subelement according to these two parts input data, reconstructed reference image reference data between generating layer.
Further, described memory cell comprises further: input data stream buffer memory to be decoded, reference picture buffer storage, inter-layer reference Data Buffer Memory, and reconstructed reference image and the inter-layer reference data of wherein image reconstruction operation subelement output output to reference picture buffer storage and inter-layer reference Data Buffer Memory respectively by bus.
Further, if the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than L, M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operator unit and decode, K is the result after (M+L-1)/L rounds, wherein front K-1 decoding is often criticized and is sent into N=L layer data, send into N=M-(K-1) × L layer data the K time, each decoding is except exporting N group macroblock information data and coefficient data, the macroblock information data of decoding also can stored in inter-layer reference Data Buffer Memory, these data can be read in as a reference when decoding next group quality scalable layer data.
Further, if the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than the number L of parallel processing logic in parallel entropy decoding operator unit, before treatment during K-1 (K is the result after (M+L-1)/L rounds) quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to inter-layer reference Data Buffer Memory, and can read in these data as a reference when decoding next group quality scalable layer data, but these data can not be sent to inverse transformation operator cell processing; When process K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit read in coefficient reconfiguration information as a reference from inter-layer reference Data Buffer Memory, then utilize K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data to be reconstructed and inverse quantization, obtain the result of the inverse quantization of one group of final M layer quality scalable layer.
Present invention also offers a kind of coding/decoding method for scalable video, the method comprises the following steps: the parallel entropy decoding operator unit in arithmetic element reads in N layer quality scalable layer data flow simultaneously and carries out entropy decoding, exports N group macroblock information data and N group coefficient data simultaneously; Parallel entropy decoding operator unit comprises the entropy decoding arithmetic logic of L group standard, and wherein N is less than or equal to L; Input comprises N group coefficient data after parallel entropy decoding operator unit decodes and macroblock information data to the parallel counter-scanning operator unit in arithmetic element, parallel counter-scanning operator unit is simultaneously according to the scan format information in N group macroblock information data, put in order to coefficient and resequence and export, parallel counter-scanning operator unit comprises the counter-scanning arithmetic logic of L group standard; Input comprises the N group coefficient data after the rearrangement of counter-scanning operator unit and the N group macroblock information data after parallel entropy decoding operator unit decodes reconstructs and inverse quantization operator unit to the coefficient in arithmetic element, coefficient reconstruct and inverse quantization operator unit, according to macro block (mb) type, coefficient reconstructing method and quantitative information in N group macroblock information data, are reconstructed and inverse quantization coefficient data.
Further, the method comprises further: input coefficient data after coefficient reconstruct and inverse quantization to inverse transformation operator unit, the residual error data of inverse transformation operator unit output after inverse transformation; Input comprises reference picture, inter-layer reference data and the macroblock information data after parallel entropy decoding operator unit decodes to prediction restructing operation subelement, prediction restructing operation subelement, according to the predictive mode in macroblock information data, utilizes reference picture, inter-layer reference data or adjacent macroblocks decoded information data generation forecast result; Wherein inter-layer reference data comprise the residual error reference data for inter-layer residue prediction, the pixel reference data for inter-layer intra prediction; Input the residual error data that comprises after inverse transformation and the image reconstruction operation subelement that predicts the outcome after prediction reconstruct, image reconstruction operation subelement according to these two parts input data, reconstructed reference image reference data between generating layer.
Further, if the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than L, M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operator unit and decode, K is the result after (M+L-1)/L rounds, wherein front K-1 decoding is often criticized and is sent into N=L layer data, send into N=M-(K-1) × L layer data the K time, each decoding is except exporting N group macroblock information data and coefficient data, the macroblock information data of decoding also can stored in inter-layer reference Data Buffer Memory, these data can be read in as a reference when decoding next group quality scalable layer data.
Further, if the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than the number L of parallel processing logic in parallel entropy decoding operator unit, before treatment during K-1 (K is the result after (M+L-1)/L rounds) quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to inter-layer reference Data Buffer Memory, and can read in these data as a reference when decoding next group quality scalable layer data, but these data can not be sent to inverse transformation operator cell processing; When process K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit read in coefficient reconfiguration information as a reference from inter-layer reference Data Buffer Memory, then utilize K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data to be reconstructed and inverse quantization, obtain the result of the inverse quantization of one group of final M layer quality scalable layer.
Of the present inventionly to have the following advantages: apparatus of the present invention and method are by revising and copy part of standards arithmetic element, and the multiple quality scalable layer of disposable decoding, improves decoding speed with limited cost, and save bus bandwidth.
Accompanying drawing explanation
Accompanying drawing 1 is the decoding device structural representation of scalable video of the present invention.
Accompanying drawing 2 is parallel entropy decoding operator cellular construction schematic diagram.
Accompanying drawing 3 is when data flow has the quality scalable layer of M (M=10) layer equal resolution, and number of lines is the parallel entropy decoding operator unit decodes example of L (L=4).
Accompanying drawing 4 is parallel counter-scanning operator cellular construction schematic diagram.
Accompanying drawing 5 is the coding/decoding method flow chart of scalable video of the present invention.
Embodiment
For making above-mentioned purpose of the present invention, feature and advantage become apparent more, and below in conjunction with the drawings and specific embodiments, the present invention is further detailed explanation:
The object of the invention is to propose a kind of apparatus and method for improving quality scalable layer decoding speed in scalable video.This device is by revising and copy part of standards arithmetic element, and the multiple quality scalable layer of disposable decoding, improves decoding speed with limited cost, and save bus bandwidth.Fig. 1 gives the decoding device structural representation of scalable video of the present invention.As shown in Figure 1, apparatus of the present invention comprise arithmetic element, bus and memory cell.
For achieving the above object, apparatus of the present invention comprise following content:
1. arithmetic element
Arithmetic element comprises all arithmetic logics of telescopic video decoding device, and all relevant computings of decoding to telescopic video all complete in arithmetic element.Arithmetic element comprises following subelement:
1.1 parallel entropy decoding operator unit
Parallel entropy decoding operator unit comprises the entropy decoding arithmetic logic of L group standard, and the quality scalable layer parallel processing number that the size of L is supported by decoding device determines.Parallel entropy decoding operator unit reads in N (N is less than or equal to L) layer quality scalable layer data flow simultaneously and carries out entropy decoding from data stream buffer memory to be decoded, export N group macroblock information data and N group coefficient data, the algorithm of decode procedure reference video standard definition and flow process simultaneously.Macroblock information data refers to all macro block informations except coefficient, comprises macro block (mb) type, scan mode, grouping information, information of forecasting, coefficient reconstruct mode, mapping mode, quantitative information etc.Can with reference to the macro block information of adjacent layer in macroblock information data decode procedure, decoded result is used to control other each operator unit (except other operator unit except parallel entropy decoding operator unit, comprise parallel counter-scanning subelement, coefficient reconstruct and inverse quantization subelement and prediction reconstruct subelement) data handling procedure.Coefficient data refers to the coefficient of each block in macro block, can deliver to parallel counter-scanning operator unit and resequence after decoding.Fig. 2 gives parallel entropy decoding operator cellular construction schematic diagram.
If the number M in data flow to be decoded with the quality scalable layer of equal resolution is not more than L, M layer quality scalable layer data can be sent into parallel entropy decoding operator unit simultaneously and process, and exports M group macroblock information data and M group coefficient data.
If the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than L, M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operator unit and decode, and K is the result after (M+L-1)/L rounds.Wherein front K-1 decoding is often criticized and is sent into N=L layer data, sends into N=M-(K-1) × L layer data the K time.In this case, each decoding is except exporting N group macroblock information data and coefficient data, the macroblock information data of decoding also stored in inter-layer reference Data Buffer Memory, can read in these data and (utilize the coefficient data of these reference datas and current decoding to realize coefficient reconstruct according to the algorithm of video standard definition) as a reference when decoding next group quality scalable layer data.Fig. 3 gives when data flow has the quality scalable layer of M (M=10) layer equal resolution, and number of lines is the parallel entropy decoding operator unit decodes example of L (L=4).Take Fig. 3 as example, decode procedure comprises 3 steps: step 1: first processes 4 groups of data, processing procedure comprises the decoding of parallel entropy, and parallel counter-scanning and coefficient reconstruct and inverse quantization, and 4 groups of data are merging into 1 group of data after coefficient reconstruct and inverse quantization process.Owing to having 10 groups of data, first data are being temporarily stored into inter-layer reference Data Buffer Memory after coefficient reconstruct and inverse quantization.Step 2: then process second batch data, method is with step 1, just need when carrying out coefficient reconstruct and inverse quantization to read the coefficient data be temporarily stored in inter-layer reference Data Buffer Memory, then the coefficient data after reconstruct again stored in inter-layer reference Data Buffer Memory.Step 3: finally process the 3rd batch data, method, with step 2, does not just need stored in inter-layer reference Data Buffer Memory carrying out the coefficient data after coefficient reconstruct and inverse quantization.After 3 step process, 10 groups of coefficients finally reconstruct 1 group of coefficient, and then are input to inverse transformation operator unit and carry out inverse transformation process.
1.2 parallel counter-scanning operator unit
Parallel counter-scanning operator unit comprises the counter-scanning arithmetic logic that L (identical with the parallel entropy number of parallel processing logic in operator unit of decode) organize standard, inputs the N (N is less than or equal to L) comprised after parallel entropy decodes operator unit decodes and organizes coefficient data and macroblock information data.Parallel counter-scanning operator unit is simultaneously according to the scan format information in N group macroblock information data, according to the algorithm defined in video standard, coefficient is put in order rearrangement, the scanning algorithm such as H.264 defined in scalable video standard comprises zig-zag scanning algorithm and field scanning algorithm, and specific algorithm is with reference to H.264 standard.N group coefficient data after rearrangement is output, be then sent to coefficient reconstruct and inverse quantization operator unit carry out coefficient reconstruct and inverse quantization.Fig. 4 gives the structural representation of parallel counter-scanning operator unit.
1.3 coefficient reconstruct and inverse quantization operator unit
The input of coefficient reconstruct and inverse quantization operator unit comprises the N group coefficient data after the rearrangement of counter-scanning operator unit and the N group macroblock information data after parallel entropy decoding operator unit decodes.Coefficient reconstruct and inverse quantization operator unit, according to macro block (mb) type, coefficient reconstructing method and quantitative information in N group macroblock information data, are reconstructed and inverse quantization coefficient data according to the algorithm defined in video standard.
If the number M in data flow to be decoded with the quality scalable layer of equal resolution is not more than the number L of parallel processing logic in parallel entropy decoding operator unit, the output of coefficient reconstruct and inverse quantization operator unit is the data after 1 group of inverse quantization, is sent to inverse transformation operator unit and carries out inverse transformation.
If the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than the number L of parallel processing logic in parallel entropy decoding operator unit, before treatment during K-1 (K is the result after (M+L-1)/L rounds) quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to inter-layer reference Data Buffer Memory, and can read in these data as a reference when decoding next group quality scalable layer data, but these data can not be sent to inverse transformation operator cell processing; When process K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit read in coefficient reconfiguration information as a reference from inter-layer reference Data Buffer Memory, then K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data is utilized to be reconstructed and inverse quantization, obtain the result of the inverse quantization of one group of final M layer quality scalable layer, then be sent to inverse transformation operator unit and carry out inverse transformation.
1.4 inverse transformation operator unit
The input of inverse transformation operator unit is through one group of coefficient data after coefficient reconstruct and inverse quantization.Inverse transformation operator unit carries out inverse transformation computing according to the algorithm provided in video encoding standard, and the inverse transformation algorithm such as H.264 defined in scalable video standard comprises integral inverse transform and Hadamard inverse transformation, and specific algorithm is with reference to H.264 standard.The output of inverse transformation operator unit be through inverse transformation after residual error data, residual error data can be delivered to image reconstruction operation subelement and carry out Image Reconstruction.
1.5 prediction restructing operation subelements
The input of prediction restructing operation subelement comprises reference picture, inter-layer reference data (comprising the residual error reference data for inter-layer residue prediction and the pixel reference data for inter-layer intra prediction) and the macroblock information data after parallel entropy decoding operator unit decodes.First prediction restructing operation subelement is predicted according to input data (i.e. reference image data and residual error reference data, pixel reference data), prediction mode comprises infra-frame prediction, inter prediction and inter-layer prediction (comprising inter-layer intra prediction and inter-layer residue prediction), the algorithm of prediction is according to the algorithm defined in video encoding standard, and the result of prediction is called prediction data.Such as adjacent macroblocks information data can be utilized to carry out infra-frame prediction (comprising 9 kinds of 4x4 intra-frame prediction methods and 5 kinds of 16x16 intra-frame prediction methods) in H.264 scalable video; Utilize reference image data to carry out inter prediction and (comprise 7 kinds of macro blocks and block division methods; Prediction direction comprises single directional prediction, bi-directional predicted and Direct Model prediction; Luminance signal precision of prediction can to 1/4th pixels); Utilize inter-layer reference data to carry out inter-layer intra prediction and inter-layer residue prediction simultaneously.Predict the outcome and can be sent to image reconstruction operation subelement and carry out Image Reconstruction.
1.6 image reconstruction operation subelements
Predicting the outcome after the input of image reconstruction operation subelement comprises the residual error data after inverse transformation and passes through prediction reconstruct.Image reconstruction operation subelement, according to these two parts input data, carries out Image Reconstruction according to the algorithm defined in video encoding standard.Image reconstruction operation subelement is reconstructed reference image not only, also can reference data (comprising the residual error reference data for inter-layer residue prediction and the pixel reference data for inter-layer intra prediction) between generating layer.The result of Image Reconstruction can output to reference picture buffer storage and inter-layer reference Data Buffer Memory respectively by bus.The result of Image Reconstruction is exactly the result of final decoding, and above-mentioned each operator unit completes partial decoding of h function respectively, the decoding device that final formation one is complete.
2. memory cell
Memory cell can be any one memory device, memory cell comprises input data stream buffer memory to be decoded, reference picture buffer storage, inter-layer reference Data Buffer Memory, and these buffer storage are that input data, output data and intermediate data required in telescopic video decode procedure provides memory space.
2.1 input data stream buffer memory to be decoded
This buffer storage is for storing input data flow to be decoded.
2.2 reference picture buffer storage
This buffer storage is used for stored reference image, and reference picture is supplied to prediction restructing operation subelement and uses.
2.3 inter-layer reference Data Buffer Memories
This buffer storage is used for reference data between accumulation layer, and inter-layer reference data comprise the intermediate data of all inter-layer prediction needs.
3. bus
Bus can be any one system bus, is responsible for the transfer of data between arithmetic element and memory cell.
Fig. 5 gives the decoding process figure of method of the present invention.The method comprises the following steps: the parallel entropy decoding operator unit in arithmetic element reads in N layer quality scalable layer data flow simultaneously and carries out entropy decoding, exports N group macroblock information data and N group coefficient data simultaneously; Parallel entropy decoding operator unit comprises the entropy decoding arithmetic logic of L group standard, and wherein N is less than or equal to L; Input comprises N group coefficient data after parallel entropy decoding operator unit decodes and macroblock information data to the parallel counter-scanning operator unit in arithmetic element, parallel counter-scanning operator unit is simultaneously according to the scan format information in N group macroblock information data, put in order to coefficient and resequence and export, parallel counter-scanning operator unit comprises the counter-scanning arithmetic logic of L group standard; Input comprises the N group coefficient data after the rearrangement of counter-scanning operator unit and the N group macroblock information data after parallel entropy decoding operator unit decodes reconstructs and inverse quantization operator unit to the coefficient in arithmetic element, coefficient reconstruct and inverse quantization operator unit, according to macro block (mb) type, coefficient reconstructing method and quantitative information in N group macroblock information data, are reconstructed and inverse quantization coefficient data.
The method comprises further: input coefficient data after coefficient reconstruct and inverse quantization to inverse transformation operator unit, the residual error data of inverse transformation operator unit output after inverse transformation; Input comprises reference picture, inter-layer reference data and the macroblock information data after parallel entropy decoding operator unit decodes to prediction restructing operation subelement, prediction restructing operation subelement, according to the predictive mode in macroblock information data, utilizes reference picture, inter-layer reference data or adjacent macroblocks decoded information data generation forecast result; Wherein inter-layer reference data comprise the residual error reference data for inter-layer residue prediction, the pixel reference data for inter-layer intra prediction; Input the residual error data that comprises after inverse transformation and the image reconstruction operation subelement that predicts the outcome after prediction reconstruct, image reconstruction operation subelement according to these two parts input data, reconstructed reference image reference data between generating layer.
If the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than L, M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operator unit and decode, K is the result after (M+L-1)/L rounds, wherein front K-1 decoding is often criticized and is sent into N=L layer data, send into N=M-(K-1) × L layer data the K time, each decoding is except exporting N group macroblock information data and coefficient data, the macroblock information data of decoding also can stored in inter-layer reference Data Buffer Memory, these data can be read in as a reference when decoding next group quality scalable layer data.
If the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than the number L of parallel processing logic in parallel entropy decoding operator unit, before treatment during K-1 (K is the result after (M+L-1)/L rounds) quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to inter-layer reference Data Buffer Memory, and can read in these data as a reference when decoding next group quality scalable layer data, but these data can not be sent to inverse transformation operator cell processing; When process K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit read in coefficient reconfiguration information as a reference from inter-layer reference Data Buffer Memory, then utilize K (K is the result after (M+L-1)/L rounds) quality of lot scalable layer coefficient data to be reconstructed and inverse quantization, obtain the result of the inverse quantization of one group of final M layer quality scalable layer.
In sum, the inventive method and device, by revising and increasing entropy decoding, scanning and coefficient reconstruct and inverse quantization hardware processing element, improve the decoding speed of quality scalable layer in scalable video, save bus bandwidth.
Be more than the detailed description of carrying out the preferred embodiments of the present invention, but those of ordinary skill in the art it should be appreciated that within the scope of the present invention, and guided by the spirit, various improvement, interpolation and replacement are all possible.These are all in the protection range that claim of the present invention limits.
Claims (9)
1. the decoding device for scalable video, this device be included in wherein process all relevant computings of decoding to telescopic video arithmetic element, input data for storing, the memory cell that exports data and intermediate data, bus for transfer of data between arithmetic element and memory cell, it is characterized in that arithmetic element comprises following subelement:
Parallel entropy decoding operator unit, it comprises the entropy decoding arithmetic logic of L group standard, parallel entropy decoding operator unit reads in N layer quality scalable layer data flow simultaneously and carries out entropy decoding, and wherein N is less than or equal to L, exports N group macroblock information data and N group coefficient data simultaneously; If the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than L, M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operator unit and decode, K is the result after (M+L-1)/L rounds, wherein front K-1 decoding is often criticized and is sent into N=L layer data, sends into N=M-(K-1) × L layer data the K time;
Parallel counter-scanning operator unit, comprise the counter-scanning arithmetic logic of L group standard, input the N group coefficient data and macroblock information data that comprise after parallel entropy decoding operator unit decodes, parallel counter-scanning operator unit, simultaneously according to the scan format information in N group macroblock information data, puts in order to coefficient and resequences and export;
Coefficient reconstruct and inverse quantization operator unit, its input comprises the N group coefficient data after the rearrangement of counter-scanning operator unit and the N group macroblock information data after parallel entropy decoding operator unit decodes, coefficient reconstruct and inverse quantization operator unit, according to macro block (mb) type, coefficient reconstructing method and quantitative information in N group macroblock information data, are reconstructed and inverse quantization coefficient data.
2. device according to claim 1, is characterized in that arithmetic element comprises further:
Inverse transformation operator unit, its input is through the coefficient data after coefficient reconstruct and inverse quantization, the output of inverse transformation operator unit be through inverse transformation after residual error data;
Prediction restructing operation subelement, its input comprises reference picture, inter-layer reference data and the macroblock information data after parallel entropy decoding operator unit decodes, prediction restructing operation subelement, according to the predictive mode in macroblock information data, utilizes reference picture, inter-layer reference data or adjacent macroblocks decoded information data generation forecast result; Wherein inter-layer reference data comprise the residual error reference data for inter-layer residue prediction, the pixel reference data for inter-layer intra prediction;
Image reconstruction operation subelement, it inputs the residual error data that comprises after inverse transformation and predicting the outcome after prediction reconstruct, image reconstruction operation subelement according to these two parts input data, reconstructed reference image reference data between generating layer.
3. device according to claim 1 and 2, it is characterized in that: described memory cell comprises further: input data stream buffer memory to be decoded, reference picture buffer storage, inter-layer reference Data Buffer Memory, reconstructed reference image and the inter-layer reference data of wherein image reconstruction operation subelement output output to reference picture buffer storage and inter-layer reference Data Buffer Memory respectively by bus.
4. device according to claim 3, is characterized in that:
If the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than L, M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operator unit and decode, K is the result after (M+L-1)/L rounds, wherein front K-1 decoding is often criticized and is sent into N=L layer data, send into N=M-(K-1) × L layer data the K time, each decoding is except exporting N group macroblock information data and coefficient data, the macroblock information data of decoding also can stored in inter-layer reference Data Buffer Memory, these data can be read in as a reference when decoding next group quality scalable layer data.
5. device according to claim 4, is characterized in that:
If the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than the number L of parallel processing logic in parallel entropy decoding operator unit, before treatment during K-1 quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to inter-layer reference Data Buffer Memory, and can read in these data as a reference when decoding next group quality scalable layer data, but these data can not be sent to inverse transformation operator cell processing; When process K quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit read in coefficient reconfiguration information as a reference from inter-layer reference Data Buffer Memory, then utilize K quality of lot scalable layer coefficient data to be reconstructed and inverse quantization, obtain the result of the inverse quantization of one group of final M layer quality scalable layer; Wherein, K is the result after (M+L-1)/L rounds.
6., for a coding/decoding method for scalable video, it is characterized in that comprising the following steps:
Parallel entropy decoding operator unit in arithmetic element reads in N layer quality scalable layer data flow simultaneously and carries out entropy decoding, exports N group macroblock information data and N group coefficient data simultaneously; Parallel entropy decoding operator unit comprises the entropy decoding arithmetic logic of L group standard, and wherein N is less than or equal to L; If the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than L, M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operator unit and decode, K is the result after (M+L-1)/L rounds, wherein front K-1 decoding is often criticized and is sent into N=L layer data, sends into N=M-(K-1) × L layer data the K time;
Input comprises N group coefficient data after parallel entropy decoding operator unit decodes and macroblock information data to the parallel counter-scanning operator unit in arithmetic element, parallel counter-scanning operator unit is simultaneously according to the scan format information in N group macroblock information data, put in order to coefficient and resequence and export, parallel counter-scanning operator unit comprises the counter-scanning arithmetic logic of L group standard;
Input comprises the N group coefficient data after the rearrangement of counter-scanning operator unit and the N group macroblock information data after parallel entropy decoding operator unit decodes reconstructs and inverse quantization operator unit to the coefficient in arithmetic element, coefficient reconstruct and inverse quantization operator unit, according to macro block (mb) type, coefficient reconstructing method and quantitative information in N group macroblock information data, are reconstructed and inverse quantization coefficient data.
7. method according to claim 6, is characterized in that the method comprises further:
The coefficient data of input after coefficient reconstruct and inverse quantization is to inverse transformation operator unit, and inverse transformation operator unit exports the residual error data after inverse transformation;
Input comprises reference picture, inter-layer reference data and the macroblock information data after parallel entropy decoding operator unit decodes to prediction restructing operation subelement, prediction restructing operation subelement, according to the predictive mode in macroblock information data, utilizes reference picture, inter-layer reference data or adjacent macroblocks decoded information data generation forecast result; Wherein inter-layer reference data comprise the residual error reference data for inter-layer residue prediction, the pixel reference data for inter-layer intra prediction;
Input the residual error data that comprises after inverse transformation and the image reconstruction operation subelement that predicts the outcome after prediction reconstruct, image reconstruction operation subelement according to these two parts input data, reconstructed reference image reference data between generating layer.
8. the method according to claim 6 or 7, it is characterized in that: if the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than L, M layer quality scalable layer data can be divided into K and criticize and send into parallel entropy decoding operator unit and decode, K is the result after (M+L-1)/L rounds, wherein front K-1 decoding is often criticized and is sent into N=L layer data, send into N=M-(K-1) × L layer data the K time, each decoding is except exporting N group macroblock information data and coefficient data, the macroblock information data of decoding also can stored in inter-layer reference Data Buffer Memory, these data can be read in as a reference when decoding next group quality scalable layer data.
9. method according to claim 8, is characterized in that:
If the number M in data flow to be decoded with the quality scalable layer of equal resolution is greater than the number L of parallel processing logic in parallel entropy decoding operator unit, before treatment during K-1 quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit output factor reconfiguration information are to inter-layer reference Data Buffer Memory, and can read in these data as a reference when decoding next group quality scalable layer data, but these data can not be sent to inverse transformation operator cell processing; When process K quality of lot scalable layer, coefficient reconstruct and inverse quantization operator unit read in coefficient reconfiguration information as a reference from inter-layer reference Data Buffer Memory, then utilize K quality of lot scalable layer coefficient data to be reconstructed and inverse quantization, obtain the result of the inverse quantization of one group of final M layer quality scalable layer; Wherein, K is the result after (M+L-1)/L rounds.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210283405.1A CN102801980B (en) | 2012-08-09 | 2012-08-09 | A kind of decoding device for scalable video and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210283405.1A CN102801980B (en) | 2012-08-09 | 2012-08-09 | A kind of decoding device for scalable video and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102801980A CN102801980A (en) | 2012-11-28 |
| CN102801980B true CN102801980B (en) | 2016-01-20 |
Family
ID=47200935
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210283405.1A Active CN102801980B (en) | 2012-08-09 | 2012-08-09 | A kind of decoding device for scalable video and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102801980B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024389B (en) * | 2012-12-24 | 2015-08-12 | 芯原微电子(北京)有限公司 | A kind of decoding device for HEVC and method |
| US9762909B2 (en) | 2013-07-30 | 2017-09-12 | Kt Corporation | Image encoding and decoding method supporting plurality of layers and apparatus using same |
| CN105791866B (en) * | 2014-12-24 | 2018-10-30 | 北京数码视讯科技股份有限公司 | Video coding intermediate data acquisition methods, equipment and system |
| CN104768008B (en) * | 2015-03-26 | 2018-01-30 | 哈尔滨工业大学 | A kind of fast encoding method for scalable video |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101878649A (en) * | 2007-12-04 | 2010-11-03 | 索尼公司 | An extension to the avc standard to support the encoding and storage of high resolution digital still pictures in parallel with video |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8705624B2 (en) * | 2009-11-24 | 2014-04-22 | STMicroelectronics International N. V. | Parallel decoding for scalable video coding |
| US20110274178A1 (en) * | 2010-05-06 | 2011-11-10 | Canon Kabushiki Kaisha | Method and device for parallel decoding of video data units |
-
2012
- 2012-08-09 CN CN201210283405.1A patent/CN102801980B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101878649A (en) * | 2007-12-04 | 2010-11-03 | 索尼公司 | An extension to the avc standard to support the encoding and storage of high resolution digital still pictures in parallel with video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102801980A (en) | 2012-11-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101040533B (en) | Method and apparatus for complexity scalable video encoding and decoding | |
| CN103931180B (en) | Image decoding apparatus | |
| CN103621099B (en) | Entropy decoding method and use its decoding apparatus | |
| CN103959790B (en) | Scanning of prediction residuals in high efficiency video coding | |
| CN101340585B (en) | Data processing apparatus, data processing method, encoding apparatus, encoding method, and decoding apparatus and decoding method | |
| CN114650419B (en) | Encoder, decoder and corresponding methods for intra prediction | |
| CN103931195B (en) | Method and apparatus for decoding intra prediction mode | |
| CN104041035B (en) | Lossless coding and coherent signal method for expressing for composite video | |
| KR20190016985A (en) | Method and apparatus for decoding image | |
| JP6545770B2 (en) | Inter prediction method, decoding apparatus and video decoding method | |
| CN108141588A (en) | inter-frame prediction method and device in image encoding system | |
| CN108605141A (en) | Efficient parameter storage for the transformation of compact multipass | |
| CN104335585A (en) | Image decoding method and apparatus using same | |
| CN103004191A (en) | Video encoder, video decoder, video encoding method, video decoding method, and program | |
| CN103313051A (en) | System and method for adaptive frame re-compression in video processing system | |
| CN101895756A (en) | Method and system for coding, decoding and reconstructing video image blocks | |
| CN102484701A (en) | Methods and apparatus for spatially varying residue coding | |
| JP2006211304A (en) | Device, method, and program for video image coding and decoding | |
| CN104604232A (en) | Method and apparatus for encoding multi-view images, and method and apparatus for decoding multi-view images | |
| CN105379272A (en) | Signaling of Bit Rate Information and Picture Rate Information in VPS | |
| CN103975599A (en) | Method, device, and program for coding and decoding of images | |
| JP2021536710A (en) | Video Decoding Method and Video Decoder | |
| CN102801980B (en) | A kind of decoding device for scalable video and method | |
| CN112385227A (en) | Method and apparatus for intra prediction | |
| CN112702603A (en) | Video encoding method, video encoding device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: VERISILICON (SHANGHAI) INC. VERISILICON MICROELECT Free format text: FORMER OWNER: VERISILICON (SHANGHAI) INC. Effective date: 20130724 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20130724 Address after: 100193 Information Center building A106, Zhongguancun Software Park, Beijing, Haidian District Applicant after: VeriSilicon Microelectronics (Beijing) Co., Ltd. Applicant after: VeriSilicon Microelectronics (Shanghai) Co., Ltd. Applicant after: VERISILICON MICROELECTRONICS (CHENGDU) CO., LTD. Address before: 100193 Information Center building A106, Zhongguancun Software Park, Beijing, Haidian District Applicant before: VeriSilicon Microelectronics (Beijing) Co., Ltd. Applicant before: VeriSilicon Microelectronics (Shanghai) Co., Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Scalable video coding decoding device and method Effective date of registration: 20170621 Granted publication date: 20160120 Pledgee: National integrated circuit industry investment fund, Limited by Share Ltd Pledgor: VeriSilicon Microelectronics (Beijing) Co., Ltd.|(Shanghai) virisilicon Microelectronics Co., Ltd.|virisilicon Microelectronics (Chengdu) Registration number: 2017990000508 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20190415 Granted publication date: 20160120 Pledgee: National integrated circuit industry investment fund, Limited by Share Ltd Pledgor: VeriSilicon Microelectronics (Beijing) Co., Ltd.|VeriSilicon Microelectronics (Shanghai) Co., Ltd.|VERISILICON MICROELECTRONICS (CHENGDU) CO., LTD. Registration number: 2017990000508 |
|
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 100193 Information Center Building A106, Zhongguancun Software Park, Haidian District, Beijing Co-patentee after: Xinyuan Microelectronics (Shanghai) Co., Ltd. Patentee after: VeriSilicon Microelectronics (Beijing) Co., Ltd. Co-patentee after: VERISILICON MICROELECTRONICS (CHENGDU) CO., LTD. Address before: 100193 Information Center Building A106, Zhongguancun Software Park, Haidian District, Beijing Co-patentee before: VeriSilicon Microelectronics (Shanghai) Co., Ltd. Patentee before: VeriSilicon Microelectronics (Beijing) Co., Ltd. Co-patentee before: VERISILICON MICROELECTRONICS (CHENGDU) CO., LTD. |