CN1492688A - Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure - Google Patents
Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure Download PDFInfo
- Publication number
- CN1492688A CN1492688A CNA031544746A CN03154474A CN1492688A CN 1492688 A CN1492688 A CN 1492688A CN A031544746 A CNA031544746 A CN A031544746A CN 03154474 A CN03154474 A CN 03154474A CN 1492688 A CN1492688 A CN 1492688A
- Authority
- CN
- China
- Prior art keywords
- pixel
- coding
- macro block
- prediction piece
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 72
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 230000009466 transformation Effects 0.000 claims description 5
- 238000013139 quantization Methods 0.000 claims description 4
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 238000005070 sampling Methods 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 208000037170 Delayed Emergence from Anesthesia Diseases 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
This invention relates to a frame coding method in a frame of two section predict codes used in NS including: taking each macroblock in original NS and derived VS as the predict blocks, all reestablished and interpolated picture elements of two, three or four directions around the said predict block as the reference picture element set to predict every picture element in NS with various linear or nonlinear filters by the reference picture elements corresponding to the set to get values of predict blocks under each kind of predict mode chacterizing that based on each section of NS code, every macra block in NS is predicted in the frame under any circumstances.
Description
Technical field the invention belongs to the coding and decoding video field in the signal processing, particularly the coded prediction technology of intracoded frame.
H.261 the video encoding standard that background technology is traditional such as ITU formulate, H.263, H.263+, the MPEG-1 that organizes to set up of the MPEG of standard and ISO H.264, MPEG-2, MPEG-4 etc. are based upon hybrid coding, promptly on the Hybrid Coding framework.So-called hybrid encoding frame is a kind of incorporation time space video image code method, and this method comprises: carry out in the frame earlier, the prediction of interframe, to eliminate the correlation of time-domain; Then original picture and the residual error that predicts the outcome are carried out two-dimensional transform (adopting discrete cosine transform or other linear transformation), eliminate spatial coherence; Carry out entropy coding then, remove statistical redundancy.
Two kinds of different coding methods of intracoded frame coding and inter-frame encoding frame coding have been comprised in the hybrid encoding frame.Traditional intracoded frame cataloged procedure is as follows: original image data is carried out two-dimensional transform (adopting discrete cosine transform or integer transform); In transform domain, conversion coefficient is quantized then; Carry out entropy coding at last, i.e. Huffman coding or arithmetic coding etc.The cataloged procedure of inter-frame encoding frame is as follows: adopt estimation to obtain motion vector, adopt inter prediction then based on motion compensation, then the residual block that inter prediction is obtained carries out two-dimensional transform, coefficient in transform domain is quantized again, and carries out entropy coding at last.
In order to improve compression efficiency, prediction is the most frequently used technology.In nearest H.264 video encoding standard, the coding of intracoded frame also uses intra-frame prediction method fully.Adopt the intraframe coding frame coding method of infra-frame prediction to be: the difference of the prediction piece that original picture piece and intra-frame prediction method are obtained is carried out two-dimensional transform (employing discrete cosine transform or integer transform); In transform domain, conversion coefficient is quantized then; Carry out entropy coding at last, i.e. Huffman coding or arithmetic coding etc.
The existing intraframe coding frame coding method of infra-frame prediction that adopts comprises cataloged procedure and decode procedure, and the concrete steps of cataloged procedure wherein are:
1) from original image, extracts a prediction piece;
2) with various predictive modes each pixel in the prediction piece is carried out infra-frame prediction respectively, obtain the predicted value of the prediction piece under each predictive mode;
3) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is carried out two-dimensional transform (adopting discrete cosine transform or integer transform); In transform domain, conversion coefficient is quantized then;
5) at last coefficient after quantizing and best predictive mode are carried out entropy coding, i.e. Hunffman coding or arithmetic coding etc., and the data after will encoding write code stream.
The concrete steps of decode procedure are:
1) at first the data in the encoding code stream are carried out the decoding of entropy coding, decoded data are carried out inverse quantization and inverse transformation after, obtain the residual error data of this prediction piece, and judge optimum prediction mode selected in the cataloged procedure;
2) adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
3) with 2) predicted value of the prediction piece that obtains of step adds 1) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
Prediction piece in the said method (Intra Predictive Block) has the prediction piece of two kinds of sizes: the rectangular block of macro block (16 * 16 pixel) and 4 * 4 pixels, as fundamental forecasting encoding and decoding unit, the intra prediction value of each pixel is to obtain by the encoded reference pixel with the piece of rebuilding around the prediction piece in the prediction piece with this prediction piece.Reference pixel described in the above-mentioned intra-frame prediction method must be a pixel encoded prior to this prediction piece and that rebuild.
In existing standard, the order of infra-frame prediction be level by left-to-right, therefore vertically from top to bottom, when each prediction piece is carried out infra-frame prediction, have only the encoded of the left side and top and the pixel rebuild may be brought as with reference to pixel.Every kind of predictive mode in the above-mentioned intra-frame prediction method corresponds respectively to different linear predictors.The parameter of linear fallout predictor is by the availability decision of the reference pixel of prediction piece top and left part.Every kind of linear predictor with the reference pixel as input, output be the predicted value of corresponding predicted pixel.Said predictive mode in H.264, adopted level, vertical, tiltedly on and tiltedly the linear predictor of inferior a plurality of different directions current prediction piece predicted, wherein the rectangular block with 4 * 4 pixels serves as when predicting piece, adopted the linear predictor of 9 kinds of different directions, i.e. 9 kinds of predictive modes.When being the prediction piece, 4 kinds of predictive modes have been adopted with the macro block.
As mentioned above, in existing intraframe coding frame coding method prediction steps, the order of infra-frame prediction is that level is by left-to-right, vertically from top to bottom, Fig. 1 has marked pixel (lowercase is represented) in the prediction piece of one 4 * 4 pixel size in H.264 and with reference to the position relation of pixel (capitalization is represented).
As can be seen, owing to each prediction piece in the frame has been adopted merely by a left side and right in H.264, therefore coded sequence from top to bottom only may appear at the left side and the upside of prediction piece with reference to pixel.When each prediction piece is carried out infra-frame prediction, the pixel possibility conduct of having only the encoded of the left side and top and rebuilding is with reference to pixel, because the raising that lacks meeting impact prediction efficient with reference to pixel, can not satisfy the needs of various different motion images, hinder the further raising of video signal compression efficiencies.
The present inventor has proposed a kind of predictive coding method stage by stage based on macro block group (Macroblock Group) structure.So-called predictive coding method stage by stage based on macro block group (Macroblock Group) structure is to utilize the characteristics of macro block group data structure, adopts two stages that the macro block group is carried out predictive coding.This predictive coding method is adopted by avs (advanced audio/video encoding standard).
In above-mentioned predictive coding method, the macro block group of definition is: for the original picture of lining by line scan, the square of 32 continuous pixels * 32 pixels constitutes an original macro group; For interleaved original picture, to go up adjacent strange and idol field earlier the time, or idol and strange field pattern resemble by the place position and be combined into frame image, and the square of 32 continuous pixels * 32 pixels just constitutes an original macro group in the frame image that is combined into then, as shown in Figure 2.
In the avs video encoding and decoding standard, the original macro group is made of 4 16 * 16 macro block, and shown in Fig. 3 (a), two macro blocks in upper strata are NS1, the NS2 macro block, and two macro blocks of lower floor are NS3 and NS4 macro block.Specifically be defined as:
NS1(x，y)＝MBG(x，y)，
NS2(x，y)＝MBG(x+16，y)，
NS3(x，y)＝MBG(x，y+16)，
NS4(x，y)＝MBG(x+16，y+16)，x，y＝1，…，16，
The original macro group is carried out vertical 1/2 sampling, just vertically derived from the macro block group, shown in Fig. 3 (b), two macro blocks in upper strata are VS1, the VS2 macro block, and two macro blocks of lower floor are VS3 and VS4 macro block.
Specifically be defined as:
VS1(x，y)＝MBG(x，2y)，
VS2(x，y)＝MBG(x+16，2y)，
VS3(x，y)＝MBG(x，2y+1)，
VS4(x，y)＝MBG(x+16，2y+1)，x，y＝1，…，16，
In the avs video encoding standard, some macro block was encoded in the phase I in the dissimilar macro block groups, and some is encoded in second stage.The principle of distinguishing macroblock coding stage attribute is: each macro block must be encoded and could be obtained satisfied reconstruction macro block among the original macro group NS, so each macro block all must be encoded in the phase I in this macro block group.In deriving from macro block group VS, if this macro block can be obtained satisfied reconstruction macro block by other coded macroblocks by interpolation, then this macro block is stayed the second stage coding, otherwise encodes in the phase I.Concrete condition is as follows:
VS3 can obtain its satisfied reconstruction macro block by the VS1 interpolation, and VS4 can obtain its satisfied reconstruction macro block by the VS2 interpolation.Therefore in this type of mb group, VS1 and VS2 encoded in the phase I, and VS3 and VS4 encode in second stage.
In existing avs video encoding and decoding standard, though adopted predictive coding method stage by stage based on macro block group (Macroblock Group) structure, but when each macro block being made infra-frame prediction in each stage, still just adopt the encoded and pixel rebuild in the left side and top as the reference pixel, this Forecasting Methodology does not make full use of the basic characteristics based on the predictive coding method stage by stage of macro block group (MacroblockGroup) structure, thereby the efficient of infra-frame prediction is not high.
Summary of the invention the objective of the invention is the weak point for encoding and decoding technique in the frame that overcomes existing infra-frame prediction, a kind of intraframe coding frame coding method that is encoded to the infra-frame prediction on basis with the macro block component stage has been proposed, got pixel around the present invention can make full use of carries out infra-frame prediction to each macro block in the macro block group as a reference.Can improve efficient, thereby improve the compression efficiency of whole video signal, can be applicable to hybrid coding based on the infra-frame prediction of macro block component stage coding.
A kind of intraframe coding frame coding method that is used for the two-stage forecasting coding of macro block group structure that the present invention proposes comprises cataloged procedure and decode procedure, and the concrete steps of cataloged procedure wherein are:
1) with original macro group NS with derive from each macro block among the macro block group VS as the prediction piece;
2) in the two-stage forecasting cataloged procedure, with the pixel of all reconstructions of two, three or four direction around this prediction piece and interpolation as reference pixel collection, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with correspondence with reference to the reference pixel in the pixel collection, obtain the predicted value of the prediction piece under each predictive mode;
3) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is carried out two-dimensional transform (adopting discrete cosine transform or integer transform); In transform domain, conversion coefficient is quantized then;
5) at last coefficient after quantizing and best predictive mode are carried out entropy coding, i.e. Hunffman coding or arithmetic coding etc., and the data after will encoding write code stream;
The concrete steps of decode procedure are:
1) at first the data in the encoding code stream are carried out the decoding of entropy coding, decoded data are carried out inverse quantization and inverse transformation after, obtain the residual error data of this prediction piece, and judge optimum prediction mode selected in the cataloged procedure;
2) adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
3) with 2) predicted value of the prediction piece that obtains of step adds 1) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
The present invention is used for the macroblock coding in two stages, according to the particular type of the macro block of working as the previous crops predictive coding and the macro block (mb) type around this macro block, and the reference pixel collection that can get around setting.
Characteristics of the present invention:
The present invention is according to the characteristics based on the Data Structures of the two-stage forecasting coding method of macro block group (Macroblock Group) structure, and the got pixel around making full use of carries out infra-frame prediction to each macro block in the macro block group as a reference.Can improve efficient, thereby improve the compression efficiency of whole video signal, can be applicable to hybrid coding based on the infra-frame prediction of macro block component stage coding.
Description of drawings
Fig. 1 H.264 in pixel (lowercase is represented) and with reference to the position relation of pixel (capitalization is represented) in the prediction piece of one 4 * 4 pixel size
The original macro group of Fig. 2 32 pixels * 32 pixels
The derivation macro block group VS of Fig. 3 original macro group NS and vertical sampling
The macro block of Fig. 4 original macro group NS is as prediction during piece, reference pixel situation on every side
When Fig. 5 derives from the VS1 of macro block group VS or VS2 macro block as the prediction piece, reference pixel situation on every side
When Fig. 6 derives from the VS3 of macro block group VS or VS4 macro block as the prediction piece, reference pixel situation on every side
The intraframe coding frame coding method of the two-stage forecasting coding that is used for macro block group structure that embodiment the present invention proposes reaches embodiment in conjunction with the accompanying drawings and is described in detail as follows:
Method of the present invention comprises cataloged procedure and decode procedure, and the concrete steps of cataloged procedure wherein are:
1) with original macro group NS with derive from each macro block among the macro block group VS as the prediction piece;
2) in the two-stage forecasting cataloged procedure, with the pixel of all reconstructions of two, three or four direction around this prediction piece and interpolation as reference pixel collection, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with correspondence with reference to the reference pixel in the pixel collection, obtain the predicted value of the prediction piece under each predictive mode;
3) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is carried out two-dimensional transform (adopting discrete cosine transform or integer transform); In transform domain, conversion coefficient is quantized then;
5) at last coefficient after quantizing and best predictive mode are carried out entropy coding, i.e. Hunffman coding or arithmetic coding etc., and the data after will encoding write code stream;
The concrete steps of decode procedure are:
1) at first the data in the encoding code stream are carried out the decoding of entropy coding, decoded data are carried out inverse quantization and inverse transformation after, obtain the residual error data of this prediction piece, and judge optimum prediction mode selected in the cataloged procedure;
2) adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
3) with 2) predicted value of the prediction piece that obtains of step adds 1) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
The present invention is used for the macroblock coding in two stages, according to the particular type of the macro block of working as the previous crops predictive coding and the macro block (mb) type around this macro block, and the reference pixel collection that can get around setting, the present invention sets with reference to the pixel collection, and various situations illustrate as follows:
When encoding in the phase I:
1) if the macro block that current prediction piece is original macro group NS, the macro block of the left side and top all is the macro block of original macro group VS, as shown in Figure 4: " x " represents field, the end (bottom field) pixel; " o " representative top (top field) pixel; if field, the end is formerly when (bottom field first); " x " pixel is through the phase I coding and rebuilding, " o " pixel obtains by interpolation in the coding phase I.If push up field formerly (top field first), then " o " pixel is through the phase I coding and rebuilding, and " x " pixel obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
2) if the macro block that current prediction piece is original macro group NS, the left side is the macro block of original macro group VS, the top is the macro block of interlacing scan gained original macro group NS, as shown in Figure 4, image is that field, the end is formerly the time, Fig. 4 left side then " x " and next-door neighbour's pixel of top all be through the phase I coding and rebuilding, Fig. 4 left side " o " pixel obtains by interpolation in the coding phase I.If the field, top formerly, then next-door neighbour's pixel of " o " on Fig. 4 left side and top all is to pass through the phase I coding and rebuilding, and " x " pixel on Fig. 4 left side obtained by interpolation in the coding phase I.If the macro block of original macro group NS is the gained of lining by line scan, then image is that field, the end is formerly the time, field, the end pixel on the macro block left side of current original macro group NS and top next-door neighbour's pixel all is a process phase I coding and rebuilding, and field, the top pixel on the macro block left side of current original macro group NS obtained by interpolation in the coding phase I.If the field, top formerly, field, the top pixel on the macro block left side of then current original macro group NS and next-door neighbour's pixel of top all are process phase I coding and rebuilding, and field, the end pixel on the macro block left side of current original macro group NS obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
3) if the macro block that current prediction piece is original macro group NS, the top is the macro block of original macro group VS, the left side is the macro block of interlacing scan gained original macro group NS, as shown in Figure 4, image is that field, the end is formerly the time, Fig. 4 top " x " next-door neighbour's pixel on pixel and the left side all is through the phase I coding and rebuilding, Fig. 4 top " o " pixel obtains by interpolation in the coding phase I.If the field, top formerly, then next-door neighbour's pixel on " o " pixel of Fig. 4 top and the left side all is to pass through the phase I coding and rebuilding, and " x " pixel of Fig. 4 top obtained by interpolation in the coding phase I.If the macro block of original macro group NS is the interlacing scan gained, if image be field, the end formerly, field, the end pixel of the macro block top of then current original macro group NS and next-door neighbour's pixel on the left side all are process phase I coding and rebuilding, and field, the top pixel of the macro block top of current original macro group NS obtained by interpolation in the coding phase I.If the field, top formerly, field, the top pixel of the macro block top of then current original macro group NS and next-door neighbour's pixel on the left side all are process phase I coding and rebuilding, and field, the end pixel of the macro block top of current original macro group NS obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
4) if the macro block that current prediction piece is original macro group NS, the left side is the macro block of original macro group NS, the top is the macro block of original macro group NS, the macro block left side of then current original macro group NS and next-door neighbour's pixel of top all are the pixel after the coding and rebuilding, and the pixel of above-mentioned mentioned all reconstructions constitutes with reference to the pixel collection.
5) if the macro block that current prediction piece is original macro group VS, the left side and top all are the macro blocks of original macro group VS, because the macro block at the original macro group VS of phase I coding has only VS1 and VS2 macro block, so " x " the expression VS1 macro block of phase I coding and rebuilding or the pixel of VS2 macro block in Fig. 5, " o " the expression pixel is the VS3 macro block that obtains by interpolation in the coding phase I or the pixel of VS4 macro block.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
6) if the macro block that current prediction piece is original macro group VS, the macro block of left side original macro group VS, the top is the macro block of original macro group NS, the field is formerly the time at the bottom of the image, next-door neighbour's pixel of field pixel and top all is a process phase I coding and rebuilding at the bottom of the macro block left side of then current original macro group VS, and field, the top pixel on the macro block left side of current original macro group VS obtained by interpolation in the coding phase I.If field, image top formerly, top, the macro block left side pixel of then current original macro group VS and next-door neighbour's pixel of top all are process phase I coding and rebuilding, and field, the end pixel on the macro block left side of current original macro group VS obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
7) if piece is the macro block of original macro group VS before prediction, the macro block of left side original macro group NS, the top is the macro block of original macro group VS, as shown in Figure 4, if the field formerly at the bottom of the image, next-door neighbour's pixel on the field pixel and the left side all is a process phase I coding and rebuilding at the bottom of the macro block top of then current original macro group VS, and field, the top pixel of the macro block top of current original macro group VS obtained by interpolation in the coding phase I.If field, image top formerly, top, the macro block top pixel of then current original macro group VS and next-door neighbour's pixel on the left side all are process phase I coding and rebuilding, and field, the end pixel of the macro block top of current original macro group VS obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
8) if the macro block that current prediction piece is original macro group VS, the left side is the macro block of original macro group NS, the top is the macro block of original macro group NS, as shown in Figure 5, the macro block left side of current original macro group VS and next-door neighbour's pixel of top all are the pixel after the coding and rebuilding, and the pixel of above-mentioned mentioned all reconstructions constitutes with reference to the pixel collection.
The second stage coding of coding have only VS3 macro block and VS4 macro block, as shown in Figure 6, the situation with reference to pixel around it has following several:
When the VS3 macro block was carried out coded prediction, the four direction up and down of VS3 macro block all can occur with reference to pixel, and the top is the VS1 piece of coding and rebuilding, and the right is the VS2 piece of coding and rebuilding and the VS4 piece that obtained by VS2 piece interpolation.
1) if when the VS3 macro block left side and bottom all are the macro block of original macro group VS, then among Fig. 6, " o " is the pixel of coding and rebuilding among Fig. 6, " x " be by in the phase I cataloged procedure by the resulting pixel of interpolation, the reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
2) if the VS3 macro block left side and following when all be the macro block of original macro group NS, then four direction next-door neighbour's pixel all be the pixel of coding and rebuilding, the pixel formation after these reconstructions is with reference to the pixel collection.
3) if the left side is the macro block of original macro group NS, when bottom is the macro block of original macro group VS, when image is that field, the end is formerly the time, current VS3 macro block the right and following field, top pixel are obtained by the phase I interpolation, and next-door neighbour's pixel of the left side and top and the right and following field, end pixel are the pixel of coding and rebuilding.When image for top field formerly the time, current VS3 macro block the right and following field, end pixel are obtained by the phase I interpolation, and next-door neighbour's pixel of the left side and top and the right and following field, top pixel are the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
4) if the left side is the macro block of original macro group VS, bottom is the macro block of original macro group NS, when image is that field, the end is formerly the time, field, the top pixel on the current VS3 macro block the right and the left side is obtained by the phase I interpolation, and field, the end pixel on next-door neighbour's pixel of bottom and top and the right and the left side is the pixel of coding and rebuilding.When image for top field formerly the time, field, the end pixel on the current VS3 macro block the right and the left side is obtained by the phase I interpolation, and field, the top pixel on next-door neighbour's pixel of bottom and top and the right and the left side is the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
When VS4 is encoded, about the VS4 macro block up and down all four direction may occur with reference to pixel, and VS4 macro block top and the left side all are the pixel of coding and rebuilding.
1) if VS4 macro block the right and bottom all be the macro block of original macro group NS, then next-door neighbour's pixel of four direction all is the pixel of coding and rebuilding, and the pixel formation after these reconstructions is with reference to the pixel collection.
2) if when the right and bottom all are the macro block of original macro group VS, when image is that field, the end is formerly the time, current VS4 macro block the right and following field, top pixel are obtained by the phase I interpolation, and field, the end pixel on next-door neighbour's pixel of the left side and top and the right and the left side is the pixel of coding and rebuilding.When image for top field formerly the time, current VS4 macro block the right and following field, end pixel are obtained by the phase I interpolation, and next-door neighbour's pixel of the left side and top and the right and following field, top pixel are the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
3) if the right is the macro block of original macro group NS, when bottom is the macro block of original macro group VS, when image is that field, the end is formerly the time, field, the top pixel of current VS4 macro block bottom is obtained by the phase I interpolation, and next-door neighbour's pixel on the left side, top and the right and following field, end pixel are the pixel of coding and rebuilding.When image for top field formerly the time, field, the end pixel of current VS4 macro block bottom is obtained by the phase I interpolation, and next-door neighbour's pixel on the left side, top and the right and following field, top pixel are the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
4) if the right is the macro block of original macro group VS, when bottom is the macro block of original macro group NS, when image is that field, the end is formerly the time, field, the top pixel on current VS4 macro block the right is obtained by the phase I interpolation, and field, the end pixel on next-door neighbour's pixel on following, the top and the left side and the right is the pixel of coding and rebuilding.When image for top field formerly the time, field, the end pixel on current VS4 macro block the right is obtained by the phase I interpolation, and field, the top pixel on next-door neighbour's pixel on following, the top and the left side and the right is the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
In coding and decode procedure, all to use the reference pixel collection of afore mentioned rules, concentrating the pixel of interpolation with reference to pixel is that the macroblock interpolation by the coding and rebuilding of this macro block group obtains in the phase I of encoding, during decoding, concentrating the pixel of interpolation with reference to pixel is that the macroblock interpolation of having decoded out by this macro block group obtains in the phase I of decoding.
The difference of above-mentioned intraframe coding frame coding method and setting is used for based on the embodiment of the predictive coding method stage by stage of macro block group (MacroblockGroup) structure as follows with reference to pixel transporting something containerized:
Present embodiment comprises cataloged procedure and decode procedure, and wherein cataloged procedure may further comprise the steps:
1) from original image, extracts an original macro group NS, and the original macro group is carried out vertical 1/2 sampling, obtain deriving from macro block group VS;
2) elder generation encodes to the macro block group form of the original macro group NS of macro block group, and under this group form, the macro block of 4 original macro group NS all must be encoded in the phase I.According to the above-mentioned reference pixel collection of setting in all cases, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with reference to the reference pixel in the pixel collection with corresponding;
3) choosing the residual error of predicting interior raw image data of piece and predicted value minimum is that (said every kind of predictive mode corresponds respectively to different fallout predictors to best predictive mode; Every kind of fallout predictor with the reference pixel as input, output be the predicted value of corresponding predicted pixel.)；
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is encoded and the calculation code cost.
5) the VS piece group form of macro block group is encoded.Under this group form, VS1 and VS2 piece were encoded in the phase I.VS3 and VS4 piece are encoded in second stage.VS1 and VS2 piece being carried out the phase I during coding, in all cases with reference to the setting of pixel collection, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with reference to the reference pixel in the pixel collection with correspondence according to above-mentioned.
6) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best, residual error to original image data and the predicted value of image under the predictive mode of the best in the prediction piece is encoded and the calculation code cost, estimate the coding cost of VS3 and VS4 piece simultaneously, compare with the coding cost under the macro block group form of original macro group NS, that chooses coding cost minimum is optimical block group form.
7) to optimical block group form encode the back together with the coding after residual error data, optimum prediction mode write code stream.Utilize the data reconstruction of VS1 and VS2 piece that VS3 and VS4 piece are carried out interpolation at last, obtain the interpolation pixel of VS3 and VS4 piece.
8) entire frame is finished phase I coding after, begin the macro block that also not have to encode is carried out the coding of second stage.Macro block at this stage coding all is VS3 macro block and VS4 macro block, in all cases with reference to the setting of pixel collection, adopts various linearities or nonlinear filter that each pixel of NS inside is predicted with corresponding with reference to the reference pixel in the pixel collection according to above-mentioned.
9) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
10) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is encoded, and write code stream.
This decode procedure may further comprise the steps:
1) at first the data in the encoding code stream is decoded and judge, obtain optimical block group mode selected in the cataloged procedure;
2) if the optimical block group mode is the macro block group of original macro group NS, according to the reference pixel collection around the optimical block group mode of macro block group is determined on every side, adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
3) with the 2nd) predicted value of the prediction piece that obtains of step adds the 1st) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
4) if the optimical block group mode is a VS piece group, need to divide two stage decodings, at first be that VS1 and VS2 piece are decoded, the same with cataloged procedure, according to the reference pixel collection around the optimical block group mode of macro block group is determined on every side, adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece.
5) with the 4th) predicted value of the prediction piece that obtains of step adds the 1st) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.Utilize the data reconstruction of VS1 and VS2 piece that VS3 and VS4 piece are carried out interpolation, obtain the interpolation pixel of VS3 and VS4 piece.
6) finish the decode procedure of phase I after, carry out decoding work again to the second stage of VS3 piece and VS4 piece, be according to the reference pixel collection around the optimical block group mode of macro block group is determined on every side equally, adopt selected optimum prediction mode, according to the reference pixel of prediction piece, predicted value is predicted and obtained to the prediction piece.
7) with the 6th) predicted value of the prediction piece that obtains of step adds the 1st) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
Claims (1)
1, a kind of intraframe coding frame coding method that is used for the two-stage forecasting coding of macro block group structure comprises cataloged procedure and decode procedure, and the concrete steps of cataloged procedure wherein are:
1) with original macro group NS with derive from each macro block among the macro block group VS as the prediction piece;
2) in the two-stage forecasting cataloged procedure, with the pixel of all reconstructions of two, three or four direction around this prediction piece and interpolation as reference pixel collection, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with correspondence with reference to the reference pixel in the pixel collection, obtain the predicted value of the prediction piece under each predictive mode;
3) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is carried out two-dimensional transform (adopting discrete cosine transform or integer transform); In transform domain, conversion coefficient is quantized then;
5) at last coefficient after quantizing and best predictive mode are carried out entropy coding, i.e. Hunffman coding or arithmetic coding etc., and the data after will encoding write code stream;
The concrete steps of decode procedure are:
1) at first the data in the encoding code stream are carried out the decoding of entropy coding, decoded data are carried out inverse quantization and inverse transformation after, obtain the residual error data of this prediction piece, and judge optimum prediction mode selected in the cataloged procedure;
2) adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
3) with 2) predicted value of the prediction piece that obtains of step adds 1) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 03154474 CN1224270C (en) | 2003-09-30 | 2003-09-30 | Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 03154474 CN1224270C (en) | 2003-09-30 | 2003-09-30 | Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1492688A true CN1492688A (en) | 2004-04-28 |
| CN1224270C CN1224270C (en) | 2005-10-19 |
Family
ID=34240802
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 03154474 Expired - Fee Related CN1224270C (en) | 2003-09-30 | 2003-09-30 | Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1224270C (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100455021C (en) * | 2004-09-30 | 2009-01-21 | 华为技术有限公司 | Method for selecting intra-prediction mode |
| CN102084658A (en) * | 2008-07-01 | 2011-06-01 | 法国电信公司 | Method and device for encoding images using improved prediction, and corresponding decoding method and device, signal and computer software |
| CN102265618A (en) * | 2008-12-25 | 2011-11-30 | 夏普株式会社 | Image decoding device and image coding device |
| CN101453646B (en) * | 2007-12-04 | 2012-02-22 | 华为技术有限公司 | Image interpolation method, apparatus and interpolation coefficient obtaining method |
| US8208739B2 (en) | 2005-10-25 | 2012-06-26 | Siemens Aktiengesellshcsft | Methods and devices for the determination and reconstruction of a predicted image area |
| CN101529916B (en) * | 2006-10-31 | 2012-07-18 | 汤姆森许可贸易公司 | Video encoding with intra encoding selection |
| CN103384333A (en) * | 2008-10-01 | 2013-11-06 | 韩国电子通信研究院 | Image encoder and decoder using unidirectional prediction |
| CN104954805A (en) * | 2011-06-28 | 2015-09-30 | 三星电子株式会社 | Method and apparatus for image encoding and decoding using intra prediction |
| CN105338345A (en) * | 2011-10-24 | 2016-02-17 | 英孚布瑞智有限私人贸易公司 | Method and apparatus for image decoding |
| US9332282B2 (en) | 2008-10-01 | 2016-05-03 | Electronics And Telecommunications Research Institute | Image encoder and decoder using undirectional prediction |
| CN107734342A (en) * | 2012-01-19 | 2018-02-23 | 佳能株式会社 | The method for coding and decoding the validity mapping of the residual error coefficient of change of scale |
| CN104125462B (en) * | 2008-07-02 | 2018-11-23 | 三星电子株式会社 | Image encoding method and device and its coding/decoding method and device |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102295680B1 (en) * | 2010-12-08 | 2021-08-31 | 엘지전자 주식회사 | Intra prediction method and encoding apparatus and decoding apparatus using same |
-
2003
- 2003-09-30 CN CN 03154474 patent/CN1224270C/en not_active Expired - Fee Related
Cited By (44)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100455021C (en) * | 2004-09-30 | 2009-01-21 | 华为技术有限公司 | Method for selecting intra-prediction mode |
| US8208739B2 (en) | 2005-10-25 | 2012-06-26 | Siemens Aktiengesellshcsft | Methods and devices for the determination and reconstruction of a predicted image area |
| CN101297557B (en) * | 2005-10-25 | 2012-07-04 | 西门子公司 | Methods and devices for the determination and reconstruction of a predicted image area |
| CN101529916B (en) * | 2006-10-31 | 2012-07-18 | 汤姆森许可贸易公司 | Video encoding with intra encoding selection |
| CN101453646B (en) * | 2007-12-04 | 2012-02-22 | 华为技术有限公司 | Image interpolation method, apparatus and interpolation coefficient obtaining method |
| US8428396B2 (en) | 2007-12-04 | 2013-04-23 | Huawei Technologies Co., Ltd. | Image interpolation method and apparatus, and method for obtaining interpolation coefficients |
| CN102084658A (en) * | 2008-07-01 | 2011-06-01 | 法国电信公司 | Method and device for encoding images using improved prediction, and corresponding decoding method and device, signal and computer software |
| CN102084658B (en) * | 2008-07-01 | 2013-06-05 | 法国电信公司 | Method and device for encoding images using improved prediction, and corresponding decoding method and device, signal and computer software |
| CN104125462B (en) * | 2008-07-02 | 2018-11-23 | 三星电子株式会社 | Image encoding method and device and its coding/decoding method and device |
| US11277622B2 (en) | 2008-10-01 | 2022-03-15 | Electronics And Telecommunications Research Institute | Image encoder and decoder using unidirectional prediction |
| US9369737B2 (en) | 2008-10-01 | 2016-06-14 | Electronics And Telecommunications Research Institute | Image encoder and decoder using undirectional prediction |
| CN103384333A (en) * | 2008-10-01 | 2013-11-06 | 韩国电子通信研究院 | Image encoder and decoder using unidirectional prediction |
| US11882292B2 (en) | 2008-10-01 | 2024-01-23 | Electronics And Telecommunications Research Institute | Image encoder and decoder using unidirectional prediction |
| US10917647B2 (en) | 2008-10-01 | 2021-02-09 | Electronics And Telecommunications Research Institute | Image encoder and decoder using unidirectional prediction |
| US9332282B2 (en) | 2008-10-01 | 2016-05-03 | Electronics And Telecommunications Research Institute | Image encoder and decoder using undirectional prediction |
| US9332281B2 (en) | 2008-10-01 | 2016-05-03 | Electronics And Telecommunications Research Institute | Image encoder and decoder using undirectional prediction |
| US11683502B2 (en) | 2008-10-01 | 2023-06-20 | Electronics And Telecommunications Research Institute | Image encoder and decoder using unidirectional prediction |
| US9407937B2 (en) | 2008-10-01 | 2016-08-02 | Electronics And Telecommunications Research Institute | Image encoder and decoder using undirectional prediction |
| US10742996B2 (en) | 2008-10-01 | 2020-08-11 | Electronics And Telecommunications Research Institute | Image encoder and decoder using unidirectional prediction |
| US20190281305A1 (en) | 2008-10-01 | 2019-09-12 | Electronics And Telecommunications Research Institute | Image encoder and decoder using unidirectional prediction |
| CN103384333B (en) * | 2008-10-01 | 2018-01-16 | 韩国电子通信研究院 | Use the video decoder of predictive mode |
| CN104219523B (en) * | 2008-10-01 | 2018-02-16 | 韩国电子通信研究院 | Use the video encoding/decoding method of predictive mode |
| US10321137B2 (en) | 2008-10-01 | 2019-06-11 | Electronics And Telecommunications Research Institute | Image encoder and decoder using unidirectional prediction |
| US9942554B2 (en) | 2008-10-01 | 2018-04-10 | Electronics And Telecommunications Research Institute | Image encoder and decoder using unidirectional prediction |
| US10178393B2 (en) | 2008-10-01 | 2019-01-08 | Electronics And Telecommunications Research Institute | Image encoder and decoder using unidirectional prediction |
| US8792738B2 (en) | 2008-12-25 | 2014-07-29 | Sharp Kabushiki Kaisha | Image decoding apparatus and image coding apparatus |
| CN102265618A (en) * | 2008-12-25 | 2011-11-30 | 夏普株式会社 | Image decoding device and image coding device |
| CN102265618B (en) * | 2008-12-25 | 2014-01-15 | 夏普株式会社 | Image decoding device and image coding device |
| US9788006B2 (en) | 2011-06-28 | 2017-10-10 | Samsung Electronics Co., Ltd. | Method and apparatus for image encoding and decoding using intra prediction |
| US10085037B2 (en) | 2011-06-28 | 2018-09-25 | Samsung Electronics Co., Ltd. | Method and apparatus for image encoding and decoding using intra prediction |
| US10045043B2 (en) | 2011-06-28 | 2018-08-07 | Samsung Electronics Co., Ltd. | Method and apparatus for image encoding and decoding using intra prediction |
| CN104954805B (en) * | 2011-06-28 | 2019-01-04 | 三星电子株式会社 | Method and apparatus for using intra prediction to carry out image coding and decoding |
| US10075730B2 (en) | 2011-06-28 | 2018-09-11 | Samsung Electronics Co., Ltd. | Method and apparatus for image encoding and decoding using intra prediction |
| US10045042B2 (en) | 2011-06-28 | 2018-08-07 | Samsung Electronics Co., Ltd. | Method and apparatus for image encoding and decoding using intra prediction |
| US9813727B2 (en) | 2011-06-28 | 2017-11-07 | Samsung Electronics Co., Ltd. | Method and apparatus for image encoding and decoding using intra prediction |
| US10506250B2 (en) | 2011-06-28 | 2019-12-10 | Samsung Electronics Co., Ltd. | Method and apparatus for image encoding and decoding using intra prediction |
| CN104954805A (en) * | 2011-06-28 | 2015-09-30 | 三星电子株式会社 | Method and apparatus for image encoding and decoding using intra prediction |
| CN105338345B (en) * | 2011-10-24 | 2019-01-04 | 英孚布瑞智有限私人贸易公司 | Method and apparatus for image decoding |
| CN105338345A (en) * | 2011-10-24 | 2016-02-17 | 英孚布瑞智有限私人贸易公司 | Method and apparatus for image decoding |
| CN107734342B (en) * | 2012-01-19 | 2020-01-21 | 佳能株式会社 | Method for coding and decoding a significance map of residual coefficients of a transform unit |
| US10531100B2 (en) | 2012-01-19 | 2020-01-07 | Canon Kabushiki Kaisha | Method, apparatus and system for encoding and decoding the significance map for residual coefficients of a transform unit |
| US10531101B2 (en) | 2012-01-19 | 2020-01-07 | Canon Kabushiki Kaisha | Method, apparatus and system for encoding and decoding the significance map for residual coefficients of a transform unit |
| US10516887B2 (en) | 2012-01-19 | 2019-12-24 | Canon Kabushiki Kaisha | Method, apparatus and system for encoding and decoding the significance map for residual coefficients of a transform unit |
| CN107734342A (en) * | 2012-01-19 | 2018-02-23 | 佳能株式会社 | The method for coding and decoding the validity mapping of the residual error coefficient of change of scale |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1224270C (en) | 2005-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1874521A (en) | Apparatus and method for image encoding and decoding | |
| CN100336401C (en) | Moving image encoder, moving image decoder, moving image encoding method, moving image decoding method | |
| CN1200568C (en) | Optimum scanning method for change coefficient in coding/decoding image and video | |
| CN104602003B (en) | Prediction block produces equipment | |
| CN1224268C (en) | Moving picture coding apparatus and moving picture decoding apparatus | |
| KR100882949B1 (en) | Apparatus and method of encoding and decoding using adaptive scanning of DCT coefficients according to the pixel similarity | |
| JP6807987B2 (en) | Image coding device, moving image decoding device, moving image coding data and recording medium | |
| CN1929611A (en) | Methods and apparatus for video intraprediction encoding and decoding | |
| CN1224270C (en) | Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure | |
| CN1719735A (en) | Method or device for coding a sequence of source pictures | |
| CN104602009A (en) | Intra prediction decoding apparatus | |
| CN1777283A (en) | Microblock based video signal coding/decoding method | |
| JP2011035902A (en) | Method for decoding stream of coded data representative of sequence of images, and method for coding sequence of images | |
| CN1589023A (en) | Coding and decoding method and device for multiple coded list lengthening based on context | |
| CN1149853C (en) | Coding and decoding device with movement compensation | |
| CN1476253A (en) | Inframe coding frame coding method using inframe prediction based on prediction blockgroup | |
| CN1268136C (en) | Frame field adaptive coding method based on image slice structure | |
| CN103444171A (en) | Methods and devices for encoding and decoding at least one image implementing a selection of pixels to be predicted, and corresponding computer program | |
| CN1857002A (en) | Rate-distortion video data partitioning using convex hull search | |
| CN1705376A (en) | Method and apparatus for spatial predictive encoding and/or decoding of video data | |
| JP5219062B2 (en) | Image data generation method | |
| US8363722B2 (en) | Method and apparatus for hierarchical bi-directional intra-prediction in a video encoder | |
| KR101512643B1 (en) | 2 Video encoding apparatus and Apparatus and Method of 2 dimensional ordering transform for image signal and Recording Medium therefor | |
| CN1235413C (en) | Method for coding and recoding ripple video frequency based on motion estimation | |
| CN1812583A (en) | Block group coding structure and adaptive phased predictive coding method based on the same structure |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20051019 Termination date: 20100930 |