CN102215390A - Processing method and device for image coding and decoding - Google Patents

Processing method and device for image coding and decoding Download PDF

Info

Publication number
CN102215390A
CN102215390A CN2010101475870A CN201010147587A CN102215390A CN 102215390 A CN102215390 A CN 102215390A CN 2010101475870 A CN2010101475870 A CN 2010101475870A CN 201010147587 A CN201010147587 A CN 201010147587A CN 102215390 A CN102215390 A CN 102215390A
Authority
CN
China
Prior art keywords
prediction
prediction residual
carried out
sub
decoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2010101475870A
Other languages
Chinese (zh)
Other versions
CN102215390B (en
Inventor
林永兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201010147587.0A priority Critical patent/CN102215390B/en
Publication of CN102215390A publication Critical patent/CN102215390A/en
Application granted granted Critical
Publication of CN102215390B publication Critical patent/CN102215390B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The embodiment of the invention provides a processing method and device for image coding and decoding. The processing method for image coding comprises the following steps that: a macroblock to be coded is subjected to a down sampling division to obtain a plurality of blocks; the plurality of blocks are subjected to spatial-domain prediction intra-frame coding to obtain prediction residuals which respectively correspond to the plurality of blocks, wherein the spatial-domain prediction intra-frame coding at least comprises an interblock prediction intra-frame coding by adopting a prediction mode; and at least one prediction residual is subjected to directional change based on the prediction mode. In the embodiment of the invention, the prediction accuracy and the coding compression performance can be effectively improved.

Description

Image coding and decoding processing method and device
Technical field
The embodiment of the invention relates to the communications field, relates in particular to a kind of image coding and decoding processing method and device.
Background technology
Video coding compression is the correlation between a kind of spatial domain, time domain and code word of utilizing video image, removes redundant a kind of video compression processing method as far as possible.Inner frame coding method is a kind of block-based hybrid video coding method.
In the prior art, inner frame coding method can comprise: spatial domain prediction, conversion, quantification and entropy coding.Wherein, spatial domain prediction can utilize the correlation between the adjacent block, carries out the spatial domain prediction coding.For instance, H.264 the spatial domain prediction in the standard can utilize the adjacent block of having encoded, and the piece of current required prediction is carried out predictive coding.Because H.264 in the standard, luminance component has 9 kinds of predictive modes, and chromatic component has 5 kinds of predictive modes.In these predictive modes, except DC mode, in fact all the other predictive modes have characterized the texture information of image different directions.When carrying out the spatial domain prediction coding, can carry out predictive coding to current block according to the predictive mode of choosing, obtain prediction residual, then prediction residual is carried out conversion, quantification and entropy coding, finally generate compressed bit stream.Can remove the spatial domain redundancy of video image by these steps, thereby reach the purpose of compressed encoding.Correspondingly, decoding end also can be decoded according to information such as predictive mode, prediction residual, thereby obtains decoded image.
In realizing process of the present invention, the inventor finds that the data volume of high clear video image is bigger, and it is more to take network bandwidth resources during transmission, and the existing network bandwidth resources are difficult to satisfy the transmission of high clear video image.Therefore, how further to improve the video coding compression performance and become problem demanding prompt solution.
Summary of the invention
The embodiment of the invention provides a kind of image coding and decoding processing method and device.
The embodiment of the invention provides a kind of image encoding processing method, comprising:
Macro block to required coding carries out the down-sampling division, obtains a plurality of;
Carry out the spatial domain prediction intraframe coding to described a plurality of, obtain and described a plurality of corresponding respectively prediction residual, wherein said spatial domain prediction intraframe coding comprises that at least the employing predictive mode carries out the inter prediction intraframe coding;
At least one prediction residual in the described prediction residual is carried out directional transform based on described predictive mode.
The embodiment of the invention provides a kind of picture decoding processing method, comprising:
To with a plurality of corresponding respectively prediction residual coefficients in the corresponding prediction residual coefficient of at least one piece carry out directivity inverse transformation based on predictive mode, obtain prediction residual;
Described prediction residual is carried out the spatial domain prediction intraframe decoder handle, obtain described a plurality of, wherein said spatial domain prediction intraframe decoder is handled and is comprised that at least the described predictive mode of employing carries out the inter prediction intraframe decoder;
Carry out up-sampling to described a plurality of and synthesize, obtain decoded macro block.
The embodiment of the invention provides a kind of image code processing device, comprising:
Coding is divided module, is used for the macro block of required coding is carried out the down-sampling division, obtains a plurality of;
The coded prediction module is used for carrying out the spatial domain prediction intraframe coding to described a plurality of, obtains and described a plurality of corresponding respectively prediction residual, and wherein said spatial domain prediction intraframe coding comprises at least adopts predictive mode to carry out the inter prediction intraframe coding;
The transcoding, coding transform module is used at least one prediction residual of described prediction residual is carried out directional transform based on described predictive mode.
The embodiment of the invention provides a kind of picture decoding processing unit, comprising:
The decoding conversion module is used for obtaining prediction residual to carrying out directivity inverse transformation based on predictive mode with the corresponding prediction residual coefficient of a plurality of corresponding respectively at least one pieces of prediction residual coefficient;
The decoding prediction module is used for that described prediction residual is carried out the spatial domain prediction intraframe decoder and handles, and obtains described a plurality of, and wherein said spatial domain prediction intraframe decoder is handled and comprised that at least the described predictive mode of employing carries out the inter prediction intraframe decoder;
The decoding synthesis module is used for carrying out up-sampling to described a plurality of and synthesizes, and obtains decoded macro block.
The embodiment of the invention is carried out down-sampling by the macro block to required coding and is divided, and can make full use of the correlation between pixel, thereby improve precision of prediction, improves the encoding compression performance; By at least one prediction residual in the prediction residual of obtaining after the spatial domain prediction intraframe coding processing being carried out directional transform based on pattern, can further remove the direction texture information correlation in the prediction residual, improve the encoding compression performance.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, to do one to the accompanying drawing of required use in embodiment or the description of the Prior Art below introduces simply, apparently, accompanying drawing in describing below is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow chart of image encoding processing method embodiment one of the present invention;
Fig. 2 is the flow chart of image encoding processing method embodiment two of the present invention;
The structural representation that Fig. 3 divides for down-sampling among the image encoding processing method embodiment two of the present invention;
Fig. 4 carries out the structural representation of infra-frame prediction for image encoding processing method embodiment two of the present invention;
Fig. 5 is the flow chart of image encoding processing method embodiment three of the present invention;
Fig. 6 is the flow chart of image encoding processing method embodiment four of the present invention;
Fig. 7 carries out the structural representation of infra-frame prediction for image encoding processing method embodiment four of the present invention;
Fig. 8 is the flow chart of image encoding processing method embodiment five of the present invention;
The flow chart of Fig. 9 image encoding processing method of the present invention embodiment six;
Figure 10 carries out the structural representation of infra-frame prediction for image encoding processing method embodiment six of the present invention;
Figure 11 is the flow chart of image encoding processing method embodiment seven of the present invention;
Figure 12 is the flow chart of decoding processing method embodiment one of the present invention;
Figure 13 is the flow chart of decoding processing method embodiment two of the present invention;
Figure 14 is the flow chart of decoding processing method embodiment three of the present invention;
Figure 15 is the flow chart of decoding processing method embodiment four of the present invention;
Figure 16 is the flow chart of decoding processing method embodiment five of the present invention;
Figure 17 is the flow chart of decoding processing method embodiment six of the present invention;
Figure 18 is the flow chart of decoding processing method embodiment seven of the present invention;
Figure 19 is the structural representation of image code processing device embodiment one of the present invention;
Figure 20 is the structural representation of image code processing device embodiment two of the present invention;
Figure 21 is the structural representation of image code processing device embodiment three of the present invention;
Figure 22 is the structural representation of image code processing device embodiment four of the present invention;
Figure 23 is the structural representation of image code processing device embodiment five of the present invention;
Figure 24 is the structural representation of picture decoding processing unit embodiment one of the present invention;
Figure 25 is the structural representation of picture decoding processing unit embodiment two of the present invention;
Figure 26 is the structural representation of picture decoding processing unit embodiment three of the present invention;
Figure 27 is the structural representation of picture decoding processing unit embodiment four of the present invention;
Figure 28 is the structural representation of picture decoding processing unit embodiment five of the present invention;
Figure 29 is the structural representation of picture decoding processing unit embodiment six of the present invention.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the invention clearer, below in conjunction with the accompanying drawing in the embodiment of the invention, technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that is obtained under the creative work prerequisite.
Fig. 1 is the flow chart of image encoding processing method embodiment one of the present invention, and as shown in Figure 1, the method for present embodiment can comprise:
Step 101, the macro block of required coding is carried out down-sampling divide, obtain a plurality of.
Specifically, image code processing device to the macro block of required coding (Macroblock, hereinafter to be referred as: when MB) carrying out encoding process, can carry out down-sampling to the macro block of required coding and divide, thus obtain a plurality of (hereinafter to be referred as: Block).For instance, the MB of required coding is 16 * 16, and image code processing device can carry out 1/2 down-sampling to this MB, also promptly the row and column of 16 * 16 MB is carried out 1/2 respectively and extracts, thereby can obtain 48 * 8 Block.In the present embodiment, employing down-sampling division methods is divided the MB of required coding, can make full use of the correlation between pixel, thereby improve precision of prediction, improves the encoding compression performance.
Need to prove, the size of MB described in the present embodiment both can be above-mentioned 16 * 16, also can be 32 * 32,64 * 64,128 * 128 or other arbitrary dimension, this down-sampling is divided and both can be handled luminance block, also can handle chrominance block, and this down-sampling divides other down-sampling mode that also can adopt except that 1/2 down-sampling, and present embodiment does not limit.
Step 102, carry out the spatial domain prediction intraframe coding to described a plurality of, obtain and described a plurality of corresponding respectively prediction residual, wherein said spatial domain prediction intraframe coding comprises that at least the employing predictive mode carries out the inter prediction intraframe coding.
Behind a plurality of Block of image code processing device in obtaining the Macroblock of required coding, can carry out the spatial domain prediction intraframe coding, thereby can obtain the prediction residual corresponding respectively with these a plurality of Block to these a plurality of Block.For instance, image code processing device can all adopt the inter prediction intraframe coding to handle 48 * 8 Block, perhaps can carry out the inter prediction intraframe coding to 18 * 8 Block among 48 * 8 the Block and handle, can carry out between pixel encoding process in the predictive frame with reference to the Block that adopts the inter prediction intraframe coding to handle other Block of 38 * 8.Wherein, the inter prediction intraframe coding handles that to be with adjacent encoding block serve as with reference to predicting, between pixel in the predictive frame encoding process to be with adjacent encoded pixels serve as with reference to predicting.Therefore, in the present embodiment, image code processing device can be distinguished 48 * 8 Block corresponding spatial domain prediction intraframe coding result and corresponding the subtracting each other of original pixels of 48 * 8 Block, thereby can obtain the prediction residual corresponding respectively with 48 * 8 Block respectively.
Need to prove, spatial domain prediction intraframe coding in the present embodiment can be adopted spatial domain prediction inner frame coding method realization arbitrarily in the prior art, for example adopt traditional inter prediction intraframe coding to handle, perhaps adopt between pixel in the predictive frame other spatial domain prediction inner frame coding methods such as encoding process, adopt predictive mode to carry out the inter prediction intraframe coding as long as this spatial domain prediction intraframe coding comprises at least, present embodiment does not limit.
Step 103, at least one prediction residual in the described prediction residual is carried out directional transform based on described predictive mode.
Because the intra prediction mode (Intra prediction mode) of spatial domain prediction intraframe coding can reflect the grain direction information of Block itself to a certain extent, and these grain direction information still exist in the prediction residual of a plurality of Block.Therefore, present embodiment can be at least one prediction residual employing in the prediction residual corresponding with a plurality of Block difference based on directional transform (the Mode-Dependent Directional Transform of predictive mode, hereinafter to be referred as: MDDT), the predictive mode travel direction conversion of for example adopting in the step 102 to be adopted, thereby can further remove the direction texture information correlation in the prediction residual, improve the encoding compression performance.
Specifically, MDDT can be for conversion of various Intra prediction mode customizations, with the different direction texture information in the better adaptive prediction residual error.For instance, at key technology area (KeyTechnology Area, hereinafter to be referred as: KTA) in the reference software, MDDT for except direct current (hereinafter to be referred as: DC) Intra of other pattern prediction mode customizes a directional transform respectively, as for other 8 kinds of Intraprediction mode except that the DC pattern among 8 * 8 and the 4 * 4MB in H.264, respectively corresponding 8 kinds of directional transform, then still adopt and the irrelevant conversion of direction texture information for the DC pattern, for example discrete cosine transform (discrete cosine transform, hereinafter to be referred as: DCT), discrete sine transform, wavelet transformation etc., these conversion are irrelevant with the predictive mode that characterizes the direction texture information, and are for example irrelevant with above-mentioned 8 kinds of Intra prediction mode.In the present embodiment, adopt MDDT, can further remove the direction texture information correlation in the prediction residual, improve the encoding compression performance.
Present embodiment carries out down-sampling by the MB to required coding and divides, and can make full use of the correlation between pixel, thereby improve precision of prediction, improves the encoding compression performance; Carry out MDDT by at least one prediction residual in the prediction residual of obtaining after the spatial domain prediction intraframe coding is handled, can further remove the direction texture information correlation in the prediction residual, improve the encoding compression performance.
Adopt several specific embodiments that the technical scheme of image encoding processing method of the present invention is elaborated below.
Fig. 2 is the flow chart of image encoding processing method embodiment two of the present invention, and as shown in Figure 2, the method for present embodiment can comprise:
Step 201, the macro block of required coding is carried out down-sampling divide, obtain a plurality of.
In the present embodiment, step 201 is similar with the realization principle of step 101 shown in Figure 1.In the present embodiment, the MB that can suppose required coding is 16 * 16.The structural representation that Fig. 3 divides for down-sampling among the image encoding processing method embodiment two of the present invention, as shown in Figure 3, image code processing device can carry out 1/2 down-sampling to 16 * 16 MB and divide, promptly on vertical and horizontal direction every 1 pixel of 1 pixel decimation, and the pixel after will extracting forms new piece, can form 48 * 8 Block altogether.In the present embodiment, this Block of 48 * 8 can be designated as Block0, Block1, Block2 and Block3 respectively.
Step 202, adopt predictive mode to carry out the inter prediction intraframe coding to handle to first in described a plurality of, obtain and described first first corresponding prediction residual, and use described first inter prediction intraframe coding result all the other pieces in described a plurality of carried out between pixel encoding process in the predictive frame, obtain with described a plurality of in the second corresponding respectively prediction residual of all the other pieces.
In the present embodiment, image code processing device can adopt Intra prediction mode that 8 * 8 Block3 is carried out the inter prediction intraframe coding and handle, obtain the inter prediction intraframe coding result of this Block3, and, obtain first prediction residual corresponding with Block3 with the processing that subtracts of the original pixels of the Block3 of this inter prediction intraframe coding result and 8 * 8.Then, image code processing device can be with the inter prediction intraframe coding result of this Block3 as a reference, to all the other Block of 38 * 8, be that Block0, Block1, Blcok2 carry out between pixel encoding process in the predictive frame, distinguish the second corresponding prediction residual thereby obtain with Block0, Block1, Blcok2.Specifically, present embodiment can carry out interpolation to the pixel of Block3, estimates so that obtain more accurate prediction.For instance, present embodiment can adopt a kind of based on 4-tap level and the interpolation method of the interpolation filter of vertical direction the pixel of Block3 is carried out interpolation, therefore, pixel among Block0, Block1, the Blcok2 can predict that prediction is more accurate than the precision of inter prediction between this kind pixel with reference to adjacent pixel of having encoded Block3.So far, image code processing device can obtain with Block0, Block1, Blcok2 distinguishes the interior encoding process result of predictive frame between corresponding pixel, image code processing device can be respectively with original pixels corresponding subtract each other of encoding process result in the predictive frame between the pixel of Block0, Block1, Blcok2 with Block0, Block1, Blcok2 then, thereby obtain and Block0, Block1, second prediction residual that Blcok2 is corresponding respectively.
Fig. 4 carries out the structural representation of infra-frame prediction for image encoding processing method embodiment two of the present invention, as shown in Figure 4, wherein I3 represents that Block3 is carried out the inter prediction intraframe coding to be handled, and obtains first prediction residual, therefore, this first prediction residual has Intra prediction mode; And P0, P1, P2 represent that respectively inter prediction intraframe coding result with Block3 serves as with reference to Block0, Block1, Blcok2 being carried out between pixel encoding process in the predictive frame, obtain second prediction residual respectively, therefore, second prediction residual does not have Intra prediction mode.
Need to prove that in the present embodiment, employed predictive mode can be previously selected optimum Match pattern, those skilled in the art can adopt prior art to select the optimum Match pattern, repeat no more herein.
Step 203, described first prediction residual is carried out directional transform based on described predictive mode, to the conversion that described second prediction residual is carried out and directivity is irrelevant.
Obtain owing to I3 adopts traditional inter prediction intraframe coding to handle, it has the Intra prediction mode that characterizes the direction texture information, and the interior encoding process of predictive frame is obtained between P0, P1 and P2 employing pixel, and there is not Intra prediction mode in it.And MDDT must have Intra prediction mode, therefore, present embodiment can adopt the MDDT conversion to I3, promptly adopt the transformation matrix corresponding that I3 is carried out the MDDT conversion with employed Intraprediction mode in the step 202, and P0, P1 and P2 are adopted the conversion that has nothing to do with the direction texture information, for example dct transform.
Need to prove, in the present embodiment, for the DC pattern among the Intra prediction mode, because it does not characterize the direction texture information, thus do not use the MDDT conversion, and can use dct transform.
Present embodiment carries out down-sampling by the MB to required coding and divides, and can make full use of the correlation between pixel, thereby improve precision of prediction, improves the encoding compression performance; By the residual MDDT of carrying out of first prediction that obtains after the inter prediction intraframe coding is handled, can remove the direction texture information correlation in first prediction residual, improve the encoding compression performance of Block3, and the inter prediction intraframe coding result that adopts Block3 is carried out between pixel encoding process in the predictive frame to Block0, Block1, Blcok2 as a reference, can further improve the encoding compression performance.
Fig. 5 is the flow chart of image encoding processing method embodiment three of the present invention, and as shown in Figure 5, the method for present embodiment can comprise:
Step 301, the macro block of required coding is carried out down-sampling divide, obtain a plurality of.
Step 302, adopt predictive mode to carry out the inter prediction intraframe coding to handle to first in described a plurality of, obtain and described first first corresponding prediction residual, and use described first inter prediction intraframe coding result all the other pieces in described a plurality of carried out between pixel encoding process in the predictive frame, obtain with described a plurality of in the second corresponding respectively prediction residual of all the other pieces.
In the present embodiment, the realization principle of step 301 and step 302 is identical with the realization principle of above-mentioned step 201 shown in Figure 2 and step 202, repeats no more herein.
Step 303, described first prediction residual and second prediction residual are carried out directional transform based on described predictive mode.
The difference of present embodiment and image encoding processing method embodiment two of the present invention shown in Figure 2 is that present embodiment can adopt the predictive mode that uses in the step 302 all to adopt MDDT to handle to first prediction residual and second prediction residual.Need to prove that in the present embodiment, it is identical with the predictive mode of first prediction residual that second prediction residual is carried out the predictive mode that MDDT adopts when handling.
For instance, as shown in Figure 4, because I3 obtains first prediction residual for adopting traditional inter prediction intraframe coding to handle, has the Intra prediction mode that characterizes the direction texture information, therefore, it can directly use MDDT, and P0, P1 and P2 are for adopting second prediction residual that encoding process is obtained respectively in the predictive frame between pixel, there is not Intra prediction mode in it, therefore can't directly use MDDT.But, under the framework that the spatial domain prediction intraframe coding of dividing based on down-sampling is handled, each down-sampling piece, promptly Block0, Block1, Block2 and Block3 are the epitome of whole M B, and its grain direction information is consistent with the grain direction information of whole M B.That is to say that the grain direction information of each down-sampling piece is same or similar.Therefore, P0, P1 and P2 are in fact same or similar with the grain direction information of I3, therefore, similar grain direction information are arranged with also retaining in the second corresponding respectively prediction residual of P0, P1 and P2.Therefore, P0, P1 and P2 can adopt the Intra prediction mode of I3 to carry out the MDDT conversion.That is to say, when P0, P1 and P2 are carried out MDDT, use the corresponding transformation matrix of Intra prediction mode with I3.Like this, just, realized all the down-sampling pieces among the MB are all used the MDDT conversion.
Need to prove, in the present embodiment, for the DC pattern among the Intra prediction mode, because it does not characterize the direction texture information, thus do not use the MDDT conversion, and can use dct transform.
Present embodiment carries out down-sampling by the MB to required coding and divides, and can make full use of the correlation between pixel, thereby improve precision of prediction, improves the encoding compression performance; Residual and second prediction residual of obtaining after the encoding process in the predictive frame between pixel all carried out the MDDT conversion by first prediction of obtaining after the inter prediction intraframe coding is handled, can remove the direction texture information correlation in first prediction residual and second prediction residual, improve the encoding compression performance of whole down-sampling pieces.
Fig. 6 is the flow chart of image encoding processing method embodiment four of the present invention, and as shown in Figure 6, the method for present embodiment can comprise:
Step 401, macro block is carried out first down-sampling divide, obtain first and a plurality of second, and carry out second down-sampling to described first and divide, obtain the first sub-piece and a plurality of second sub-piece.
Present embodiment adopts the multilayer dividing mode to the MB of required coding.Specifically, present embodiment can be divided on the basis at first down-sampling shown in Figure 4, I3 is carried out second down-sampling once more divide.For instance, image code processing device can carry out first down-sampling to 16 * 16MB of required coding and divide, promptly 1/2 down-sampling is divided, obtain first Block3 of 8 * 8 and 3 s' 8 * 8 second Block0, Block1 and Block2, image code processing device can carry out the division of second down-sampling to first Block3 then, for example 1/2 down-sampling is divided, and obtains 4 * 4 the first sub-piece sub-Block3 and 34 * 4 the second sub-piece sub-Block0, sub-Block1 and sub-Block2.
Need to prove, in the present embodiment, first down-sampling is divided and the division of 1/2 down-sampling is all chosen in the division of second down-sampling, but it will be understood by those skilled in the art that, the division of first down-sampling is divided with second down-sampling also can be different, those skilled in the art can choose the down-sampling division methods according to the size of MB, do not limit herein.
Step 402, employing predictive mode carry out the inter prediction intraframe coding to the described first sub-piece to be handled, obtain first prediction residual corresponding with the described first sub-piece, and the inter prediction intraframe coding result of using the described first sub-piece carries out between pixel encoding process in the predictive frame to described a plurality of second and the described a plurality of second sub-pieces, obtains and described a plurality of second and the second corresponding respectively prediction residual of the described a plurality of second sub-piece.
In the present embodiment, image code processing device can adopt Intra prediction mode that 4 * 4 sub-Block3 is carried out the inter prediction intraframe coding and handle, obtain the inter prediction intraframe coding result of this sub-Block3, and, obtain first prediction residual corresponding with sub-Block3 with the processing that subtracts of the original pixels of the sub-Block3 of this inter prediction intraframe coding result and 4 * 4.Then, image code processing device can be with the inter prediction intraframe coding result of this sub-Block3 as a reference, all the other the second sub-piece sub-Block0, sub-Block1 of 34 * 4 and sub-Block2 and 3 s' 8 * 8 second Block0, Block1, Blcok2 carried out between pixel encoding process in the predictive frame, distinguish the second corresponding prediction residual thereby obtain with sub-Block0, sub-Block1, sub-Block2, Block0, Block1 and Blcok2.
Fig. 7 carries out the structural representation of infra-frame prediction for image encoding processing method embodiment four of the present invention, as shown in Figure 7, wherein, I represents that sub-Block3 is carried out the inter prediction intraframe coding to be handled and to obtain first prediction residual, p0, p1, p2, P0, P1, P2 and represent that respectively the inter prediction intraframe coding result with sub-Block3 is reference, sub-Block0, sub-Block1, sub-Block2, Block0, Block1 and Block2 are carried out between pixel encoding process in the predictive frame respectively, obtain second prediction residual respectively.
Step 403, described first prediction residual is carried out directional transform based on described predictive mode, to the conversion that described second prediction residual is carried out and directivity is irrelevant.
Because I adopts traditional inter prediction intraframe coding to handle and obtains, it has the Intra prediction mode that characterizes the direction texture information, the interior encoding process of predictive frame is obtained between p0, p1, p2, P0, P1 and P2 employing pixel, and there is not Intra prediction mode in it.And MDDT must have Intraprediction mode, therefore, present embodiment can adopt the MDDT conversion to I, promptly adopt the transformation matrix corresponding that I is carried out the MDDT conversion with employed Intra prediction mode in the step 402, and p0, p1, p2, P0, P1 and P2 are adopted the conversion that has nothing to do with the direction texture information, for example dct transform.
Need to prove, in the present embodiment, for the DC pattern among the Intra prediction mode, because it does not characterize the direction texture information, thus do not use the MDDT conversion, and can use dct transform.
Present embodiment carries out the multilayer down-sampling by the MB to required coding and divides, and can make full use of the correlation between pixel, thereby improve precision of prediction, improves the encoding compression performance; By the residual MDDT of carrying out of first prediction that obtains after the inter prediction intraframe coding is handled, can remove the direction texture information correlation in first prediction residual, improve the encoding compression performance of sub-Block3, and the inter prediction intraframe coding result that adopts sub-Block3 is carried out between pixel encoding process in the predictive frame to sub-Block0, sub-Block1, sub-Block2, Block0, Block1 and Block2 as a reference, can further improve the encoding compression performance.
Fig. 8 is the flow chart of image encoding processing method embodiment five of the present invention, and as shown in Figure 8, the method for present embodiment can comprise:
Step 501, macro block is carried out first down-sampling divide, obtain first and a plurality of second, and carry out second down-sampling to described first and divide, obtain the first sub-piece and a plurality of second sub-piece.
Step 502, employing predictive mode carry out the inter prediction intraframe coding to the described first sub-piece to be handled, obtain first prediction residual corresponding with the described first sub-piece, and the inter prediction intraframe coding result of using the described first sub-piece carries out between pixel encoding process in the predictive frame to described a plurality of second and the described a plurality of second sub-pieces, obtains and described a plurality of second and the second corresponding respectively prediction residual of the described a plurality of second sub-piece.
The step 501 of present embodiment and step 502, its realization principle that realizes principle and step 401 shown in Figure 6 and step 402 is similar, repeats no more herein.
Step 503, described first prediction residual and described second prediction residual are carried out directional transform based on described predictive mode.
The difference of present embodiment and image encoding processing method embodiment four of the present invention shown in Figure 4 is that present embodiment can adopt the predictive mode that uses in the step 502 all to adopt MDDT to carry out conversion to first prediction residual and second prediction residual.
For instance, as shown in Figure 7, because I obtains first prediction residual for adopting traditional inter prediction intraframe coding to handle, has the Intra prediction mode that characterizes the direction texture information, therefore, it can directly use MDDT, and p0, p1, p2, P0, P1 and P2 are for adopting second prediction residual that encoding process is obtained respectively in the predictive frame between pixel, there is not Intra prediction mode in it, therefore can't directly use MDDT.But, under the framework that the spatial domain prediction intraframe coding of dividing based on down-sampling is handled, each down-sampling piece, be the epitome that sub-Block0, sub-Block 1, sub-Block2, sub-Block3, Block0, Block1 and Block2 are whole M B, its grain direction information is consistent with the grain direction information of whole M B.That is to say that the grain direction information of each down-sampling piece is same or similar.Therefore, p0, p1, p2, P0, P1 and P2 are in fact same or similar with the grain direction information of I, therefore, similar grain direction information are arranged with also retaining in the second corresponding respectively prediction residual of p0, p1, p2, P0, P1 and P2.Therefore, p0, p1, p2, P0, P1 and P2 can adopt the Intra prediction mode of I to carry out the MDDT conversion.That is to say, when p0, p1, p2, P0, P1 and P2 are carried out MDDT, use the corresponding transformation matrix of Intra prediction mode with I.Like this, just, realized all the down-sampling pieces among the MB are all used the MDDT conversion.
Need to prove, in the present embodiment, for the DC pattern among the Intra prediction mode, because it does not characterize the direction texture information, thus do not use the MDDT conversion, and can use dct transform.
Present embodiment carries out the multilayer down-sampling by the MB to required coding and divides, and can make full use of the correlation between pixel, thereby improve precision of prediction, improves the encoding compression performance; All carry out MDDT by first prediction residual obtained after the inter prediction intraframe coding is handled and to second prediction residual of obtaining after the encoding process in the predictive frame between pixel, can remove the direction texture information correlation in first prediction residual and second prediction residual, further improve the encoding compression performance of whole M B.
The flow chart of Fig. 9 image encoding processing method of the present invention embodiment six, as shown in Figure 9, the method for present embodiment can comprise:
Step 601, described macro block is carried out down-sampling divide, obtain first and a plurality of second, and carry out the spatial domain to described first and divide and handle, obtain a plurality of first sub-piece.
The difference of present embodiment and step 501 shown in Figure 8 is that present embodiment is the first sub-piece sub-Block3 that first Block3 of 8 * 8 is divided into 44 * 4 on the spatial domain, be 4 sub-pieces of I corresponding to the form of expression of predictive mode.Figure 10 carries out the structural representation of infra-frame prediction for image encoding processing method embodiment six of the present invention, as shown in figure 10, in the present embodiment, 44 * 4 sub-Block3 is the sub-piece of I that needs to adopt the inter prediction coding, all the other 3 second Block0, Block1 and Block2 are the P piece that needs to adopt predictive coding between pixel, respectively corresponding P0, P1 and P2.
Step 602, employing predictive mode carry out the inter prediction intraframe coding respectively to the described a plurality of first sub-piece to be handled, obtain first prediction residual corresponding respectively with the described a plurality of first sub-piece, and the inter prediction intraframe coding result of using described a plurality of first sub-pieces carries out between pixel encoding process in the predictive frame to described a plurality of second, obtains and described a plurality of second second corresponding respectively prediction residual.
In the present embodiment, image code processing device can adopt Intra prediction mode respectively 44 * 4 sub-Block3 to be carried out the inter prediction intraframe coding and handle, obtain the inter prediction intraframe coding result of these 4 sub-Block3 respectively, thereby obtain first prediction residual corresponding respectively with 4 sub-Block3, and, this image code processing device can be looked 4 inter prediction intraframe coding results as a reference as a whole, to all the other Block of 38 * 8, be Block0, Block1, Blcok2 carries out the interior encoding process of predictive frame between pixel, thereby obtains and Block0, Block1, second prediction residual that Blcok2 is corresponding respectively.
Step 603, described first prediction residual is carried out directional transform based on described predictive mode, to the conversion that described second prediction residual is carried out and directivity is irrelevant.
In the present embodiment, because 44 * 4 sub-Block3, promptly to combine be the equal of the epitome of whole M B to 4 sub-pieces of I, and single 4 * 4 sub-Block3, the sub-piece of promptly single I is not the epitome of whole M B.Therefore, in this case, P0, P1 and P2 can't utilize the Intra prediction mode of the sub-piece of I to carry out the MDDT conversion.Therefore, present embodiment adopts the MDDT conversion to the sub-piece of I, promptly adopt the transformation matrix corresponding that the sub-piece of I is carried out the MDDT conversion, and P0, P1 and P2 are adopted and the irrelevant conversion of direction texture information, for example dct transform with employed Intra prediction mode in the step 402.
Need to prove, in the present embodiment, for the DC pattern among the Intra prediction mode, because it does not characterize the direction texture information, thus do not use the MDDT conversion, and can use dct transform.
Present embodiment carries out the multilayer down-sampling by the MB to required coding and divides, and can make full use of the correlation between pixel, thereby improve precision of prediction, improves the encoding compression performance; By the residual MDDT of carrying out of first prediction that obtains after the inter prediction intraframe coding is handled, can remove the direction texture information correlation in first prediction residual, improve the encoding compression performance of Block3, and the inter prediction intraframe coding result that adopts Block3 is carried out between pixel encoding process in the predictive frame to Block0, Block1 and Block2 as a reference, can further improve the encoding compression performance.
Figure 11 is the flow chart of image encoding processing method embodiment seven of the present invention, and as shown in figure 11, the method for present embodiment can comprise:
Step 701, described macro block is carried out down-sampling divide, obtain first and a plurality of second, and carry out the spatial domain to described first and divide and handle, obtain a plurality of first sub-piece.
Step 702, employing predictive mode carry out the inter prediction intraframe coding respectively to the described a plurality of first sub-piece to be handled, obtain first prediction residual corresponding respectively with the described a plurality of first sub-piece, and the inter prediction intraframe coding result of using described a plurality of first sub-pieces carries out between pixel encoding process in the predictive frame to described a plurality of second, obtains and described a plurality of second second corresponding respectively prediction residual.
The step 701 of present embodiment and step 702, its realization principle that realizes principle and step 601 shown in Figure 9 and step 602 is similar, repeats no more herein.
Step 703, described first prediction residual and described second prediction residual are carried out directional transform based on described predictive mode.
The difference of present embodiment and image encoding processing method embodiment six of the present invention shown in Figure 9 is that present embodiment can adopt the predictive mode that uses in the step 702 all to adopt MDDT to carry out conversion to first prediction residual and second prediction residual.
Specifically, in the present embodiment, 4 sub-pieces of I can be considered to have identical Intraprediction mode, so, the direction texture information of the sub-piece of each I has still characterized the direction texture information of whole M B, and these direction texture informations can further be utilized by P0, P1 and P2, thereby makes P0, P1 and P2 all can use MDDT, thereby further remove the direction texture information correlation of retaining in second prediction residual of P0, P1 and P2 piece, thereby promote the encoding compression performance.
Need to prove, in the present embodiment, for the DC pattern among the Intra prediction mode, because it does not characterize the direction texture information, thus do not use the MDDT conversion, and can use dct transform.
Present embodiment carries out the multilayer down-sampling by the MB to required coding and divides, and can make full use of the correlation between pixel, thereby improve precision of prediction, improves the encoding compression performance; All carry out MDDT by first prediction residual obtained after the inter prediction intraframe coding is handled and to second prediction residual of obtaining after the encoding process in the predictive frame between pixel, can remove the direction texture information correlation in first prediction residual and second prediction residual, further improve the encoding compression performance of whole M B.
Figure 12 is the flow chart of decoding processing method embodiment one of the present invention, and as shown in figure 12, the method for present embodiment can comprise:
Step 104, to a plurality of corresponding respectively prediction residual coefficients in the corresponding prediction residual coefficient of at least one piece carry out directivity inverse transformation based on predictive mode, obtain prediction residual.
Step 105, described prediction residual is carried out the spatial domain prediction intraframe decoder handle, obtain described a plurality of, wherein said spatial domain prediction intraframe decoder is handled and is comprised at least and adopt described predictive mode to carry out the inter prediction intraframe decoder.
Step 106, to carry out up-sampling to described a plurality of synthetic, obtains decoded macro block.
The method of present embodiment is and image encoding processing method embodiment one corresponding decoding process shown in Figure 1, it just adopts the process opposite with the encoding process process to carry out decoding processing on implementation, it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 1, repeats no more herein.
Figure 13 is the flow chart of decoding processing method embodiment two of the present invention, and as shown in figure 13, the method for present embodiment can comprise:
Step 204, to described a plurality of in first first corresponding prediction residual coefficient carry out directivity inverse transformation based on predictive mode, obtain first prediction residual, the second prediction residual coefficient corresponding with all the other pieces in described a plurality of carried out and the irrelevant inverse transformation of directivity, obtain second prediction residual.
Step 205, the described predictive mode of employing carry out the inter prediction intraframe decoder to described first prediction residual to be handled, obtain described first inter prediction intraframe decoder result, and use described first inter prediction intraframe decoder result described second prediction residual is carried out between pixel decoding processing in the predictive frame, obtain between the pixel of all the other pieces in described a plurality of decoding process result in the predictive frame.
Step 206, that decoding process result in the predictive frame between described inter prediction intraframe decoder result and described pixel is carried out up-sampling is synthetic, obtains decoded macro block.
The method of present embodiment is the decoding process corresponding with image encoding processing method embodiment shown in Figure 2 two, it just adopts the process opposite with the encoding process process to carry out decoding processing on implementation, it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 2, repeats no more herein.
Figure 14 is the flow chart of decoding processing method embodiment three of the present invention, and as shown in figure 14, the method for present embodiment can comprise:
Step 304, to described a plurality of in first first corresponding prediction residual coefficient and with described a plurality of in the corresponding second prediction residual coefficient of all the other pieces carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively.
Step 305, the described predictive mode of employing carry out the inter prediction intraframe decoder to described first prediction residual to be handled, obtain described first inter prediction intraframe decoder result, and use described first inter prediction intraframe decoder result described second prediction residual is carried out between pixel decoding processing in the predictive frame, obtain between the pixel of all the other pieces in described a plurality of decoding process result in the predictive frame.
Step 306, that decoding process result in the predictive frame between described inter prediction intraframe decoder result and described pixel is carried out up-sampling is synthetic, obtains decoded macro block.
The method of present embodiment is the decoding process corresponding with image encoding processing method embodiment shown in Figure 5 three, it just adopts the process opposite with the encoding process process to carry out decoding processing on implementation, it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 5, repeats no more herein.
Figure 15 is the flow chart of decoding processing method embodiment four of the present invention, and as shown in figure 15, the method for present embodiment can comprise:
Step 404, the first prediction residual coefficient corresponding with the first sub-piece in described a plurality of carried out directivity inverse transformation based on predictive mode, obtain first prediction residual, and to described a plurality of in the corresponding respectively inverse transformations that the second prediction residual coefficient carries out and directivity has nothing to do of a plurality of second and a plurality of second sub-pieces, obtain second prediction residual.
Step 405, the described predictive mode of employing carry out the inter prediction intraframe decoder to described first prediction residual to be handled, obtain the inter prediction intraframe decoder result of the described first sub-piece, and the inter prediction intraframe decoder result of using the described first sub-piece carries out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between the pixel of a plurality of second and a plurality of second sub-pieces in described a plurality of decoding process result in the predictive frame.
Step 406, decoding process result in the predictive frame between the pixel of the inter prediction intraframe decoder result of the described first sub-piece and described a plurality of second sub-pieces carried out second up-sampling is synthetic to obtain described first, and it is synthetic that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out first up-sampling, obtains decoded macro block.
The method of present embodiment is and image encoding processing method embodiment four corresponding decoding process shown in Figure 6, it just adopts the process opposite with the encoding process process to carry out decoding processing on implementation, it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 6, repeats no more herein.
Figure 16 is the flow chart of decoding processing method embodiment five of the present invention, and as shown in figure 16, the method for present embodiment can comprise:
Step 504, to the first prediction residual coefficient corresponding with the first sub-piece in described a plurality of and with described a plurality of in the corresponding second prediction residual coefficient of a plurality of second and a plurality of second sub-pieces carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively.
Step 505, the described predictive mode of employing carry out the inter prediction intraframe decoder to described first prediction residual to be handled, obtain the inter prediction intraframe decoder result of the described first sub-piece, and the inter prediction intraframe decoder result of using the described first sub-piece carries out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between the pixel of a plurality of second and a plurality of second sub-pieces in described a plurality of decoding process result in the predictive frame.
Step 506, decoding process result in the predictive frame between the pixel of the inter prediction intraframe decoder result of the described first sub-piece and described a plurality of second sub-pieces carried out second up-sampling is synthetic to obtain described first, and it is synthetic that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out first up-sampling, obtains decoded macro block.
The method of present embodiment is and image encoding processing method embodiment five corresponding decoding process shown in Figure 8, it just adopts the process opposite with the encoding process process to carry out decoding processing on implementation, it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 8, repeats no more herein.
Figure 17 is the flow chart of decoding processing method embodiment six of the present invention, and as shown in figure 17, the method for present embodiment can comprise:
Step 604, the first prediction residual coefficient corresponding with a plurality of first sub-piece in described a plurality of carried out directivity inverse transformation based on predictive mode respectively, obtain first prediction residual, and to described a plurality of in a plurality of second second corresponding prediction residual coefficient carry out and directivity is irrelevant inverse transformation, obtain second prediction residual.
Step 605, the described predictive mode of employing carry out the inter prediction intraframe decoder to described first prediction residual to be handled, obtain the inter prediction intraframe decoder result of described a plurality of first sub-pieces, and the inter prediction intraframe decoder result of using described a plurality of first sub-pieces carries out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between pixels a plurality of second in described a plurality of decoding process result in the predictive frame.
Step 606, the inter prediction intraframe decoder result of described a plurality of first sub-pieces carried out the spatial domain is synthetic handles, obtain described first, and it is synthetic that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out up-sampling, obtains decoded macro block.
The method of present embodiment is and image encoding processing method embodiment six corresponding decoding process shown in Figure 9, it just adopts the process opposite with the encoding process process to carry out decoding processing on implementation, it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 9, repeats no more herein.
Figure 18 is the flow chart of decoding processing method embodiment seven of the present invention, and as shown in figure 18, the method for present embodiment can comprise:
Step 704, to the first prediction residual coefficient corresponding with a plurality of first sub-piece in described a plurality of and with described a plurality of in a plurality of second second corresponding prediction residual coefficient carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively.
Step 705, the described predictive mode of employing carry out the inter prediction intraframe decoder to described first prediction residual to be handled, obtain the inter prediction intraframe decoder result of described a plurality of first sub-pieces, and the inter prediction intraframe decoder result of using the described plural first sub-piece carries out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between pixels a plurality of second in described a plurality of decoding process result in the predictive frame.
Step 706, the inter prediction intraframe decoder result of described a plurality of first sub-pieces carried out the spatial domain is synthetic handles, obtain described first, and it is synthetic that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out up-sampling, obtains decoded macro block.
The method of present embodiment is and image encoding processing method embodiment seven corresponding decoding process shown in Figure 11, it just adopts the process opposite with the encoding process process to carry out decoding processing on implementation, it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 11, repeats no more herein.
Figure 19 is the structural representation of image code processing device embodiment one of the present invention, as shown in figure 19, the device of present embodiment can comprise: coding is divided module 11, coded prediction module 12 and transcoding, coding transform module 13, wherein, coding is divided module 11 and is used for the macro block of required coding is carried out the down-sampling division, obtains a plurality of; Coded prediction module 12 is used for carrying out the spatial domain prediction intraframe coding to described a plurality of, obtains and described a plurality of corresponding respectively prediction residual, and wherein said spatial domain prediction intraframe coding comprises at least adopts predictive mode to carry out the inter prediction intraframe coding; Transcoding, coding transform module 13 is used at least one prediction residual of described prediction residual is carried out directional transform based on described predictive mode.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 1, and it realizes that principle is similar with the technique effect that is reached, and repeats no more herein.
Figure 20 is the structural representation of image code processing device embodiment two of the present invention, as shown in figure 20, present embodiment is on the basis of image code processing device embodiment one shown in Figure 19, further, coded prediction module 12 comprises: the first coded prediction unit 121 and the second coded prediction unit 122, wherein, the first coded prediction unit 121 is used for adopting predictive mode to carry out the inter prediction intraframe coding to described a plurality of first handling, obtain and described first first corresponding prediction residual; The second coded prediction unit 122 is used for using described first inter prediction intraframe coding result all the other described a plurality of pieces is carried out between pixel encoding process in the predictive frame, obtain with described a plurality of in the second corresponding respectively prediction residual of all the other pieces; Transcoding, coding transform module 13 comprises: the first transcoding, coding transform unit 131 and the second transcoding, coding transform unit 132, and wherein, the first transcoding, coding transform unit 131 is used for described first prediction residual is carried out directional transform based on described predictive mode; The second transcoding, coding transform unit 132 is used for described second prediction residual is carried out and the irrelevant conversion of directivity.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 2 two, and it realizes that principle is similar with the technique effect that is reached, and repeats no more herein.
Figure 21 is the structural representation of image code processing device embodiment three of the present invention, as shown in figure 21, present embodiment is on the basis of image code processing device embodiment one shown in Figure 19, further, coded prediction module 12 comprises: the 3rd coded prediction unit 123 and the 4th coded prediction unit 124, wherein, the 3rd coded prediction unit 123 is used for adopting predictive mode to carry out the inter prediction intraframe coding to described a plurality of first handling, obtain and described first first corresponding prediction residual; The 4th coded prediction unit 124 is used for using described first inter prediction intraframe coding result all the other described a plurality of pieces is carried out between pixel encoding process in the predictive frame, obtain with described a plurality of in the second corresponding respectively prediction residual of all the other pieces; Transcoding, coding transform module 13 specifically is used for described first prediction residual and second prediction residual are carried out directional transform based on described predictive mode.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 5 three, and it realizes that principle is similar with the technique effect that is reached, and repeats no more herein.
Figure 22 is the structural representation of image code processing device embodiment four of the present invention, as shown in figure 22, present embodiment is on the basis of image code processing device embodiment one shown in Figure 19, further, coding is divided module 11 and is comprised: the first coded sample unit 111 and the second coded sample unit 112, wherein, the first coded sample unit 111 is used for that described macro block is carried out first down-sampling to be divided, and obtains first and a plurality of second; The second coded sample unit 112 is used for carrying out second down-sampling to described first to be divided, and obtains the first sub-piece and a plurality of second sub-piece; Coded prediction module 12 comprises: the 5th coded prediction unit 125 and the 6th coded prediction unit 126, wherein the 5th coded prediction unit 125 is used to adopt predictive mode that the described first sub-piece is carried out inter prediction intraframe coding processing, obtains first prediction residual corresponding with the described first sub-piece; The 6th coded prediction unit 126 is used for and the inter prediction intraframe coding result of using the described first sub-piece is carried out between pixel encoding process in the predictive frame to described a plurality of second and the described a plurality of second sub-pieces, obtains and described a plurality of second and the second corresponding respectively prediction residual of the described a plurality of second sub-piece; Transcoding, coding transform module 13 comprises: the 3rd transcoding, coding transform unit 133 and the 4th transcoding, coding transform unit 134, and wherein, the 3rd transcoding, coding transform unit 133 is used for described first prediction residual is carried out directional transform based on described predictive mode; Perhaps described first prediction residual and described second prediction residual are carried out directional transform based on described predictive mode; The 4th transcoding, coding transform unit 134 is used for described second prediction residual is carried out and the irrelevant conversion of directivity.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 6 four or method embodiment five shown in Figure 8, and it realizes that principle and the technique effect that is reached are similar, repeats no more herein.
Figure 23 is the structural representation of image code processing device embodiment five of the present invention, as shown in figure 23, present embodiment is on the basis of image code processing device embodiment one shown in Figure 19, further, coding is divided module 11 and is comprised: the 3rd coded sample unit 113 and the 4th coded sample unit 114, wherein, the 3rd coded sample unit 113 is used for that described macro block is carried out down-sampling to be divided, and obtains first and a plurality of second; The 4th coded sample unit 114 is used for carrying out the spatial domain to described first and divides processing, obtains a plurality of first sub-piece; Coded prediction module 12 comprises: the 7th coded prediction unit 127 and the 8th coded prediction unit 128, wherein, the 7th coded prediction unit 127 is used to adopt predictive mode that the described a plurality of first sub-piece is carried out inter prediction intraframe coding processing respectively, obtains and the first corresponding prediction residual of the described a plurality of first sub-piece difference; The inter prediction intraframe coding result that the 8th coded prediction unit 128 is used to use described a plurality of first sub-pieces is carried out between pixel encoding process in the predictive frame to described a plurality of second, obtains and described a plurality of second second corresponding respectively prediction residual; Transcoding, coding transform module 13 specifically is used for described first prediction residual is carried out directional transform based on described predictive mode, to the conversion that described second prediction residual is carried out and directivity is irrelevant; Perhaps described first prediction residual and described second prediction residual are carried out directional transform based on described predictive mode.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 9 six or method embodiment seven shown in Figure 11, and it realizes that principle and the technique effect that is reached are similar, repeats no more herein.
Figure 24 is the structural representation of picture decoding processing unit embodiment one of the present invention, as shown in figure 24, the picture decoding processing unit of present embodiment, can comprise: decoding conversion module 21, decoding prediction module 22 and decoding synthesis module 23, wherein, decoding conversion module 21 is used for obtaining prediction residual to carrying out directivity inverse transformation based on predictive mode with the corresponding prediction residual coefficient of a plurality of corresponding respectively at least one pieces of prediction residual coefficient; Decoding prediction module 22 is used for that described prediction residual is carried out the spatial domain prediction intraframe decoder to be handled, and obtains described a plurality of, and wherein said spatial domain prediction intraframe decoder is handled and comprised that at least the described predictive mode of employing carries out the inter prediction intraframe decoder; Decoding synthesis module 23 is used for carrying out up-sampling to described a plurality of and synthesizes, and obtains decoded macro block.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 12, and it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 12, repeats no more herein.
Figure 25 is the structural representation of picture decoding processing unit embodiment two of the present invention, as shown in figure 25, the picture decoding processing unit of present embodiment is on the basis of picture decoding processing unit embodiment one shown in Figure 24, further, decoding conversion module 21 comprises: the first decoding converter unit 211 and the second decoding converter unit 212, wherein, the first decoding converter unit 211 is used for obtaining first prediction residual to carrying out directivity inverse transformation based on predictive mode with the described a plurality of first first corresponding prediction residual coefficient; The second decoding converter unit 212 is used for the second prediction residual coefficient corresponding with described a plurality of all the other pieces carried out and the irrelevant inverse transformation of directivity, obtains second prediction residual; Decoding prediction module 22 comprises: the first decoding predicting unit 221 and the second decoding predicting unit 222, wherein, the first decoding predicting unit 221 is used to adopt described predictive mode that described first prediction residual is carried out the processing of inter prediction intraframe decoder, obtains described first inter prediction intraframe decoder result; The second decoding predicting unit 222 is used to use described first inter prediction intraframe decoder result described second prediction residual is carried out between pixel decoding processing in the predictive frame, obtains between the pixel of all the other pieces in described a plurality of decoding process result in the predictive frame; Decoding synthesis module 23 is used for that specifically decoding process result in the predictive frame between described inter prediction intraframe decoder result and described pixel is carried out up-sampling and synthesizes, and obtains decoded macro block.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 13 two, and it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 13, repeats no more herein.
Figure 26 is the structural representation of picture decoding processing unit embodiment three of the present invention, as shown in figure 26, the picture decoding processing unit of present embodiment is on the basis of picture decoding processing unit embodiment one shown in Figure 24, further, decoding conversion module 21 specifically be used for to the described a plurality of first first corresponding prediction residual coefficient and with described a plurality of in the corresponding second prediction residual coefficient of all the other pieces carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively; Decoding prediction module 22 comprises: the 3rd decoding predicting unit 223 and the 4th decoding predicting unit 224, wherein, the 3rd decoding predicting unit 223 is used to adopt described predictive mode that described first prediction residual is carried out the processing of inter prediction intraframe decoder, obtains described first inter prediction intraframe decoder result; The 4th decoding predicting unit 224 is used to use described first inter prediction intraframe decoder result described second prediction residual is carried out between pixel decoding processing in the predictive frame, obtains between the pixel of all the other pieces in described a plurality of decoding process result in the predictive frame; Decoding synthesis module 23 is used for that specifically decoding process result in the predictive frame between described inter prediction intraframe decoder result and described pixel is carried out up-sampling and synthesizes, and obtains decoded macro block.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 14 three, and it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 14, repeats no more herein.
Figure 27 is the structural representation of picture decoding processing unit embodiment four of the present invention, as shown in figure 27, the picture decoding processing unit of present embodiment is on the basis of picture decoding processing unit embodiment one shown in Figure 24, further, decoding conversion module 21 comprises: the 3rd decoding converter unit 213 and the 4th decoding converter unit 214, wherein, the 3rd decoding converter unit 213 is used for the first prediction residual coefficient corresponding with described a plurality of first sub-pieces carried out directivity inverse transformation based on predictive mode, obtains first prediction residual; The 4th decoding converter unit 214 is used for second prediction residual coefficient carry out and directivity have nothing to do the inverse transformation corresponding respectively with described a plurality of a plurality of second and a plurality of second sub-piece obtained second prediction residual; Decoding prediction module 22 comprises: the 5th decoding predicting unit 225 and the 6th decoding predicting unit 226, wherein, the 5th decoding predicting unit 225 is used to adopt described predictive mode that described first prediction residual is carried out the processing of inter prediction intraframe decoder, obtains the inter prediction intraframe decoder result of the described first sub-piece; The inter prediction intraframe decoder result that the 6th decoding predicting unit 226 is used to use the described first sub-piece is carried out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between the pixel of a plurality of second and a plurality of second sub-pieces in described a plurality of decoding process result in the predictive frame; Decoding synthesis module 23 comprises: the first decoding sampling unit 231 and the second decoding sampling unit 232, wherein, the first decoding sampling unit 231 is used for decoding process result in the predictive frame between the pixel of the inter prediction intraframe decoder result of the described first sub-piece and described a plurality of second sub-pieces carried out that second up-sampling is synthetic to obtain described first; It is synthetic that the second decoding sampling unit 232 is used for that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out first up-sampling, obtains decoded macro block.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 15 four, and it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 15, repeats no more herein.
Figure 28 is the structural representation of picture decoding processing unit embodiment five of the present invention, as shown in figure 28, the picture decoding processing unit of present embodiment is on the basis of picture decoding processing unit embodiment one shown in Figure 24, further, decoding conversion module 21 specifically be used for to the first prediction residual coefficient corresponding with described a plurality of first sub-pieces and with described a plurality of in the corresponding second prediction residual coefficient of a plurality of second and a plurality of second sub-pieces carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively; Decoding prediction module 22 comprises: the 7th decoding predicting unit 227 and the 8th decoding predicting unit 228, wherein, the 7th decoding predicting unit 227 is used to adopt described predictive mode that described first prediction residual is carried out the processing of inter prediction intraframe decoder, obtains the inter prediction intraframe decoder result of the described first sub-piece; The inter prediction intraframe decoder result that the 8th decoding predicting unit 228 is used to use the described first sub-piece is carried out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between the pixel of a plurality of second and a plurality of second sub-pieces in described a plurality of decoding process result in the predictive frame; Decoding synthesis module 23 comprises: the 3rd decoding sampling unit 233 and the 4th decoding sampling unit 234, wherein, the 3rd decoding sampling unit 233 is used for decoding process result in the predictive frame between the pixel of the inter prediction intraframe decoder result of the described first sub-piece and described a plurality of second sub-pieces carried out that second up-sampling is synthetic to obtain described first; It is synthetic that the 4th decoding sampling unit 234 is used for that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out first up-sampling, obtains decoded macro block.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 16 five, and it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 16, repeats no more herein.
Figure 29 is the structural representation of picture decoding processing unit embodiment six of the present invention, as shown in figure 29, the picture decoding processing unit of present embodiment is on the basis of picture decoding processing unit embodiment one shown in Figure 24, further, decoding conversion module 21 comprises: the 5th decoding converter unit 215 and the 6th decoding converter unit 216, wherein, the 5th decoding converter unit 215 is used for the first prediction residual coefficient corresponding with described a plurality of a plurality of first sub-pieces carried out directivity inverse transformation based on predictive mode respectively, obtains first prediction residual; The 6th decoding converter unit 216 is used for obtaining second prediction residual to carrying out and the irrelevant inverse transformation of directivity with the described a plurality of a plurality of second second corresponding prediction residual coefficient; Decoding prediction module 22 comprises: the 9th decoding predicting unit 229 and the tenth decoding predicting unit 230, wherein, the 9th decoding predicting unit 229 is used to adopt described predictive mode that described first prediction residual is carried out the processing of inter prediction intraframe decoder, obtains the inter prediction intraframe decoder result of described a plurality of first sub-pieces; The inter prediction intraframe decoder result that the tenth decoding predicting unit 230 is used to use described a plurality of first sub-pieces is carried out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between pixels a plurality of second in described a plurality of decoding process result in the predictive frame; Decoding synthesis module 23 comprises: the 6th decoding sampling unit 236 and the 7th decoding sampling unit 237, wherein, the 6th decoding sampling unit 236 is used for the inter prediction intraframe decoder result of described a plurality of first sub-pieces is carried out the synthetic processing in spatial domain, obtains described first; It is synthetic that the 7th decoding sampling unit 237 is used for that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out up-sampling, obtains decoded macro block.
The device of present embodiment can be used to carry out the technical scheme of method embodiment shown in Figure 17 six, and it realizes that principle is similar with the effect that is reached with realization principle embodiment illustrated in fig. 17, repeats no more herein.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be finished by the relevant hardware of program command, aforesaid program can be stored in the computer read/write memory medium, this program is carried out the step that comprises said method embodiment when carrying out; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
It should be noted that at last: above embodiment only in order to technical scheme of the present invention to be described, is not intended to limit; Although with reference to previous embodiment the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the spirit and scope of various embodiments of the present invention technical scheme.

Claims (23)

1. an image encoding processing method is characterized in that, comprising:
Macro block to required coding carries out the down-sampling division, obtains a plurality of;
Carry out the spatial domain prediction intraframe coding to described a plurality of, obtain and described a plurality of corresponding respectively prediction residual, wherein said spatial domain prediction intraframe coding comprises that at least the employing predictive mode carries out the inter prediction intraframe coding;
At least one prediction residual in the described prediction residual is carried out directional transform based on described predictive mode.
2. image encoding processing method according to claim 1, it is characterized in that, describedly carry out the spatial domain prediction intraframe coding to described a plurality of, obtain and described a plurality of corresponding respectively prediction residual, wherein said spatial domain prediction intraframe coding comprises at least adopts predictive mode to carry out the inter prediction intraframe coding, comprising:
Adopting predictive mode to carry out the inter prediction intraframe coding to first in described a plurality of handles, obtain and described first first corresponding prediction residual, and use described first inter prediction intraframe coding result all the other pieces in described a plurality of carried out between pixel encoding process in the predictive frame, obtain with described a plurality of in the second corresponding respectively prediction residual of all the other pieces;
Described at least one prediction residual in the described prediction residual is carried out directional transform based on described predictive mode, comprising:
Described first prediction residual is carried out directional transform based on described predictive mode, to the conversion that described second prediction residual is carried out and directivity is irrelevant.
3. image encoding processing method according to claim 1, it is characterized in that, describedly carry out the spatial domain prediction intraframe coding to described a plurality of, obtain and described a plurality of corresponding respectively prediction residual, wherein said spatial domain prediction intraframe coding comprises at least adopts predictive mode to carry out the inter prediction intraframe coding, comprising:
Adopting predictive mode to carry out the inter prediction intraframe coding to first in described a plurality of handles, obtain and described first first corresponding prediction residual, and use described first inter prediction intraframe coding result all the other pieces in described a plurality of carried out between pixel encoding process in the predictive frame, obtain with described a plurality of in the second corresponding respectively prediction residual of all the other pieces;
Described at least one prediction residual in the described prediction residual is carried out directional transform based on described predictive mode, comprising:
Described first prediction residual and second prediction residual are carried out directional transform based on described predictive mode.
4. image encoding processing method according to claim 1 is characterized in that, described macro block to required coding carries out down-sampling to be divided, and obtains a plurality of, comprising:
Described macro block is carried out first down-sampling divide, obtain first and a plurality of second, and carry out second down-sampling to described first and divide, obtain the first sub-piece and a plurality of second sub-piece;
Describedly carry out the spatial domain prediction intraframe coding to described a plurality of, obtain and described a plurality of corresponding respectively prediction residual, wherein said spatial domain prediction intraframe coding comprises that at least the employing predictive mode carries out the inter prediction intraframe coding, comprising:
Adopting predictive mode that the described first sub-piece is carried out the inter prediction intraframe coding handles, obtain first prediction residual corresponding with the described first sub-piece, and the inter prediction intraframe coding result of using the described first sub-piece carries out between pixel encoding process in the predictive frame to described a plurality of second and the described a plurality of second sub-pieces, obtains and described a plurality of second and the second corresponding respectively prediction residual of the described a plurality of second sub-piece;
Described at least one prediction residual in the described prediction residual is carried out directional transform based on described predictive mode, comprising:
Described first prediction residual is carried out directional transform based on described predictive mode, to the conversion that described second prediction residual is carried out and directivity is irrelevant; Perhaps described first prediction residual and described second prediction residual are carried out directional transform based on described predictive mode.
5. image encoding processing method according to claim 1 is characterized in that, described macro block to required coding carries out down-sampling to be divided, and obtains a plurality of, comprising:
Described macro block is carried out down-sampling divide, obtain first and a plurality of second, and carry out the spatial domain to described first and divide processing, obtain a plurality of first sub-piece;
Describedly carry out the spatial domain prediction intraframe coding to described a plurality of, obtain and described a plurality of corresponding respectively prediction residual, wherein said spatial domain prediction intraframe coding comprises that at least the employing predictive mode carries out the inter prediction intraframe coding, comprising:
Adopting predictive mode that the described a plurality of first sub-piece is carried out the inter prediction intraframe coding respectively handles, obtain first prediction residual corresponding respectively with the described a plurality of first sub-piece, and the inter prediction intraframe coding result of using described a plurality of first sub-pieces carries out between pixel encoding process in the predictive frame to described a plurality of second, obtains and described a plurality of second second corresponding respectively prediction residual;
Described at least one prediction residual in the described prediction residual is carried out directional transform based on described predictive mode, comprising:
Described first prediction residual is carried out directional transform based on described predictive mode, to the conversion that described second prediction residual is carried out and directivity is irrelevant; Perhaps described first prediction residual and described second prediction residual are carried out directional transform based on described predictive mode.
6. a picture decoding processing method is characterized in that, comprising:
To with a plurality of corresponding respectively prediction residual coefficients in the corresponding prediction residual coefficient of at least one piece carry out directivity inverse transformation based on predictive mode, obtain prediction residual;
Described prediction residual is carried out the spatial domain prediction intraframe decoder handle, obtain described a plurality of, wherein said spatial domain prediction intraframe decoder is handled and is comprised that at least the described predictive mode of employing carries out the inter prediction intraframe decoder;
Carry out up-sampling to described a plurality of and synthesize, obtain decoded macro block.
7. picture decoding processing method according to claim 6, it is characterized in that, described to a plurality of corresponding respectively prediction residual coefficients in the corresponding prediction residual coefficient of at least one piece carry out directivity inverse transformation based on predictive mode, obtain prediction residual, comprising:
To with described a plurality of in first first corresponding prediction residual coefficient carry out directivity inverse transformation based on predictive mode, obtain first prediction residual, the second prediction residual coefficient corresponding with all the other pieces in described a plurality of carried out and the irrelevant inverse transformation of directivity, obtain second prediction residual;
Describedly described prediction residual is carried out the spatial domain prediction intraframe decoder handle, obtain described a plurality of, wherein said spatial domain prediction intraframe decoder is handled and is comprised at least and adopt described predictive mode to carry out the inter prediction intraframe decoder, comprising:
Adopting described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder handles, obtain described first inter prediction intraframe decoder result, and use described first inter prediction intraframe decoder result described second prediction residual is carried out between pixel decoding processing in the predictive frame, obtain between the pixel of all the other pieces in described a plurality of decoding process result in the predictive frame;
Described to carry out up-sampling to described a plurality of synthetic, obtains decoded macro block, comprising:
Decoding process result in the predictive frame between described inter prediction intraframe decoder result and described pixel is carried out up-sampling synthesize, obtain decoded macro block.
8. picture decoding processing method according to claim 6, it is characterized in that, described to a plurality of corresponding respectively prediction residual coefficients in the corresponding prediction residual coefficient of at least one piece carry out directivity inverse transformation based on predictive mode, obtain prediction residual, comprising:
To with described a plurality of in first first corresponding prediction residual coefficient and with described a plurality of in the corresponding second prediction residual coefficient of all the other pieces carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively;
Describedly described prediction residual is carried out the spatial domain prediction intraframe decoder handle, obtain described a plurality of, wherein said spatial domain prediction intraframe decoder is handled and is comprised at least and adopt described predictive mode to carry out the inter prediction intraframe decoder, comprising:
Adopting described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder handles, obtain described first inter prediction intraframe decoder result, and use described first inter prediction intraframe decoder result described second prediction residual is carried out between pixel decoding processing in the predictive frame, obtain between the pixel of all the other pieces in described a plurality of decoding process result in the predictive frame;
Described to carry out up-sampling to described a plurality of synthetic, obtains decoded macro block, comprising:
Decoding process result in the predictive frame between described inter prediction intraframe decoder result and described pixel is carried out up-sampling synthesize, obtain decoded macro block.
9. picture decoding processing method according to claim 6, it is characterized in that, described to a plurality of corresponding respectively prediction residual coefficients in the corresponding prediction residual coefficient of at least one piece carry out directivity inverse transformation based on predictive mode, obtain prediction residual, comprising:
The first prediction residual coefficient corresponding with the first sub-piece in described a plurality of carried out directivity inverse transformation based on predictive mode, obtain first prediction residual, and to described a plurality of in the corresponding respectively inverse transformations that the second prediction residual coefficient carries out and directivity has nothing to do of a plurality of second and a plurality of second sub-pieces, obtain second prediction residual;
Describedly described prediction residual is carried out the spatial domain prediction intraframe decoder handle, obtain described a plurality of, wherein said spatial domain prediction intraframe decoder is handled and is comprised at least and adopt described predictive mode to carry out the inter prediction intraframe decoder, comprising:
Adopting described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder handles, obtain the inter prediction intraframe decoder result of the described first sub-piece, and the inter prediction intraframe decoder result of using the described first sub-piece carries out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between the pixel of a plurality of second and a plurality of second sub-pieces in described a plurality of decoding process result in the predictive frame;
Described to carry out up-sampling to described a plurality of synthetic, obtains decoded macro block, comprising:
Decoding process result in the predictive frame between the pixel of the inter prediction intraframe decoder result of the described first sub-piece and described a plurality of second sub-pieces carried out second up-sampling is synthetic to obtain described first, and it is synthetic that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out first up-sampling, obtains decoded macro block.
10. picture decoding processing method according to claim 6 is characterized in that, described to a plurality of corresponding respectively prediction residual coefficients in the corresponding prediction residual coefficient of at least one piece carry out directivity inverse transformation based on predictive mode, comprising:
To the first prediction residual coefficient corresponding with the first sub-piece in described a plurality of and with described a plurality of in the corresponding second prediction residual coefficient of a plurality of second and a plurality of second sub-pieces carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively;
Describedly described prediction residual is carried out the spatial domain prediction intraframe decoder handle, obtain described a plurality of, wherein said spatial domain prediction intraframe decoder is handled and is comprised at least and adopt described predictive mode to carry out the inter prediction intraframe decoder, comprising:
Adopting described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder handles, obtain the inter prediction intraframe decoder result of the described first sub-piece, and the inter prediction intraframe decoder result of using the described first sub-piece carries out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between the pixel of a plurality of second and a plurality of second sub-pieces in described a plurality of decoding process result in the predictive frame;
Described to carry out up-sampling to described a plurality of synthetic, obtains decoded macro block, comprising:
Decoding process result in the predictive frame between the pixel of the inter prediction intraframe decoder result of the described first sub-piece and described a plurality of second sub-pieces carried out second up-sampling is synthetic to obtain described first, and it is synthetic that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out first up-sampling, obtains decoded macro block.
11. picture decoding processing method according to claim 6 is characterized in that, described to a plurality of corresponding respectively prediction residual coefficients in the corresponding prediction residual coefficient of at least one piece carry out directivity inverse transformation based on predictive mode, comprising:
The first prediction residual coefficient corresponding with a plurality of first sub-piece in described a plurality of carried out directivity inverse transformation based on predictive mode respectively, obtain first prediction residual, and to described a plurality of in a plurality of second second corresponding prediction residual coefficient carry out and directivity is irrelevant inverse transformation, obtain second prediction residual;
Describedly described prediction residual is carried out the spatial domain prediction intraframe decoder handle, obtain described a plurality of, wherein said spatial domain prediction intraframe decoder is handled and is comprised at least and adopt described predictive mode to carry out the inter prediction intraframe decoder, comprising:
Adopting described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder handles, obtain the inter prediction intraframe decoder result of described a plurality of first sub-pieces, and the inter prediction intraframe decoder result of using described a plurality of first sub-pieces carries out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between pixels a plurality of second in described a plurality of decoding process result in the predictive frame;
Described to carry out up-sampling to described a plurality of synthetic, obtains decoded macro block, comprising:
The inter prediction intraframe decoder result of described a plurality of first sub-pieces is carried out the synthetic processing in spatial domain, obtain described first, and it is synthetic that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out up-sampling, obtains decoded macro block.
12. picture decoding processing method according to claim 6 is characterized in that, described to a plurality of corresponding respectively prediction residual coefficients in the corresponding prediction residual coefficient of at least one piece carry out directivity inverse transformation based on predictive mode, comprising:
To the first prediction residual coefficient corresponding with a plurality of first sub-piece in described a plurality of and with described a plurality of in a plurality of second second corresponding prediction residual coefficient carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively;
Describedly described prediction residual is carried out the spatial domain prediction intraframe decoder handle, obtain described a plurality of, wherein said spatial domain prediction intraframe decoder is handled and is comprised at least and adopt described predictive mode to carry out the inter prediction intraframe decoder, comprising:
Adopting described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder handles, obtain the inter prediction intraframe decoder result of described a plurality of first sub-pieces, and the inter prediction intraframe decoder result of using the described plural first sub-piece carries out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between pixels a plurality of second in described a plurality of decoding process result in the predictive frame;
Described to carry out up-sampling to described a plurality of synthetic, obtains decoded macro block, comprising:
The inter prediction intraframe decoder result of described a plurality of first sub-pieces is carried out the synthetic processing in spatial domain, obtain described first, and it is synthetic that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out up-sampling, obtains decoded macro block.
13. an image code processing device is characterized in that, comprising:
Coding is divided module, is used for the macro block of required coding is carried out the down-sampling division, obtains a plurality of;
The coded prediction module is used for carrying out the spatial domain prediction intraframe coding to described a plurality of, obtains and described a plurality of corresponding respectively prediction residual, and wherein said spatial domain prediction intraframe coding comprises at least adopts predictive mode to carry out the inter prediction intraframe coding;
The transcoding, coding transform module is used at least one prediction residual of described prediction residual is carried out directional transform based on described predictive mode.
14. image code processing device according to claim 13 is characterized in that, described coded prediction module comprises:
The first coded prediction unit is used for adopting predictive mode to carry out the inter prediction intraframe coding to described a plurality of first and handles, and obtains and described first first corresponding prediction residual;
The second coded prediction unit, be used for using described first inter prediction intraframe coding result all the other described a plurality of pieces carried out between pixel encoding process in the predictive frame, obtain with described a plurality of in the second corresponding respectively prediction residual of all the other pieces;
Described transcoding, coding transform module comprises:
The first transcoding, coding transform unit is used for described first prediction residual is carried out directional transform based on described predictive mode;
The second transcoding, coding transform unit is used for described second prediction residual is carried out and the irrelevant conversion of directivity.
15. image code processing device according to claim 13 is characterized in that, described coded prediction module comprises:
The 3rd coded prediction unit is used for adopting predictive mode to carry out the inter prediction intraframe coding to described a plurality of first and handles, and obtains and described first first corresponding prediction residual;
The 4th coded prediction unit, be used for using described first inter prediction intraframe coding result all the other described a plurality of pieces carried out between pixel encoding process in the predictive frame, obtain with described a plurality of in the second corresponding respectively prediction residual of all the other pieces;
Described transcoding, coding transform module specifically is used for described first prediction residual and second prediction residual are carried out directional transform based on described predictive mode.
16. image code processing device according to claim 13 is characterized in that, described coding is divided module, comprising:
The first coded sample unit is used for that described macro block is carried out first down-sampling and divides, and obtains first and a plurality of second;
The second coded sample unit is used for carrying out second down-sampling to described first and divides, and obtains the first sub-piece and a plurality of second sub-piece;
Described coded prediction module comprises:
The 5th coded prediction unit is used to adopt predictive mode that the described first sub-piece is carried out the inter prediction intraframe coding and handles, and obtains first prediction residual corresponding with the described first sub-piece;
The 6th coded prediction unit, the inter prediction intraframe coding result that is used to use the described first sub-piece is carried out between pixel encoding process in the predictive frame to described a plurality of second and the described a plurality of second sub-pieces, obtains and described a plurality of second and the second corresponding respectively prediction residual of the described a plurality of second sub-piece;
Described transcoding, coding transform module comprises:
The 3rd transcoding, coding transform unit is used for described first prediction residual is carried out directional transform based on described predictive mode; Perhaps described first prediction residual and described second prediction residual are carried out directional transform based on described predictive mode;
The 4th transcoding, coding transform unit is used for described second prediction residual is carried out and the irrelevant conversion of directivity.
17. image code processing device according to claim 13 is characterized in that, described coding is divided module, comprising:
The 3rd coded sample unit is used for that described macro block is carried out down-sampling and divides, and obtains first and a plurality of second;
The 4th coded sample unit is used for carrying out the spatial domain to described first and divides processing, obtains a plurality of first sub-piece;
Described coded prediction module comprises:
The 7th coded prediction unit is used to adopt predictive mode that the described a plurality of first sub-piece is carried out the inter prediction intraframe coding respectively and handles, and obtains first prediction residual corresponding respectively with the described a plurality of first sub-piece;
The 8th coded prediction unit, the inter prediction intraframe coding result that is used to use described a plurality of first sub-pieces is carried out between pixel encoding process in the predictive frame to described a plurality of second, obtains and described a plurality of second second corresponding respectively prediction residual;
Described transcoding, coding transform module specifically is used for described first prediction residual is carried out directional transform based on described predictive mode, to the conversion that described second prediction residual is carried out and directivity is irrelevant; Perhaps described first prediction residual and described second prediction residual are carried out directional transform based on described predictive mode.
18. a picture decoding processing unit is characterized in that, comprising:
The decoding conversion module is used for obtaining prediction residual to carrying out directivity inverse transformation based on predictive mode with the corresponding prediction residual coefficient of a plurality of corresponding respectively at least one pieces of prediction residual coefficient;
The decoding prediction module is used for that described prediction residual is carried out the spatial domain prediction intraframe decoder and handles, and obtains described a plurality of, and wherein said spatial domain prediction intraframe decoder is handled and comprised that at least the described predictive mode of employing carries out the inter prediction intraframe decoder;
The decoding synthesis module is used for carrying out up-sampling to described a plurality of and synthesizes, and obtains decoded macro block.
19. picture decoding processing unit according to claim 18 is characterized in that, described decoding conversion module comprises:
The first decoding converter unit is used for obtaining first prediction residual to carrying out directivity inverse transformation based on predictive mode with the described a plurality of first first corresponding prediction residual coefficient;
The second decoding converter unit is used for the second prediction residual coefficient corresponding with described a plurality of all the other pieces carried out and the irrelevant inverse transformation of directivity, obtains second prediction residual;
Described decoding prediction module comprises:
The first decoding predicting unit is used to adopt described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder and handles, and obtains described first inter prediction intraframe decoder result;
The second decoding predicting unit, be used to use described first inter prediction intraframe decoder result described second prediction residual is carried out between pixel decoding processing in the predictive frame, obtain between the pixel of all the other pieces in described a plurality of decoding process result in the predictive frame;
Described decoding synthesis module is used for that specifically decoding process result in the predictive frame between described inter prediction intraframe decoder result and described pixel is carried out up-sampling and synthesizes, and obtains decoded macro block.
20. picture decoding processing unit according to claim 18, it is characterized in that, described decoding conversion module specifically be used for to the described a plurality of first first corresponding prediction residual coefficient and with described a plurality of in the corresponding second prediction residual coefficient of all the other pieces carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively;
Described decoding prediction module comprises:
The 3rd decoding predicting unit is used to adopt described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder and handles, and obtains described first inter prediction intraframe decoder result;
The 4th decoding predicting unit, be used to use described first inter prediction intraframe decoder result described second prediction residual is carried out between pixel decoding processing in the predictive frame, obtain between the pixel of all the other pieces in described a plurality of decoding process result in the predictive frame;
Described decoding synthesis module is used for that specifically decoding process result in the predictive frame between described inter prediction intraframe decoder result and described pixel is carried out up-sampling and synthesizes, and obtains decoded macro block.
21. picture decoding processing unit according to claim 18 is characterized in that, described decoding conversion module comprises:
The 3rd decoding converter unit is used for the first prediction residual coefficient corresponding with described a plurality of first sub-pieces carried out directivity inverse transformation based on predictive mode, obtains first prediction residual;
The 4th decoding converter unit is used for second prediction residual coefficient carry out and directivity have nothing to do the inverse transformation corresponding respectively with described a plurality of a plurality of second and a plurality of second sub-piece obtained second prediction residual;
Described decoding prediction module comprises:
The 5th decoding predicting unit is used to adopt described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder and handles, and obtains the inter prediction intraframe decoder result of the described first sub-piece;
The 6th decoding predicting unit, the inter prediction intraframe decoder result that is used to use the described first sub-piece is carried out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between the pixel of a plurality of second and a plurality of second sub-pieces in described a plurality of decoding process result in the predictive frame;
Described decoding synthesis module comprises:
The first decoding sampling unit is used for decoding process result in the predictive frame between the pixel of the inter prediction intraframe decoder result of the described first sub-piece and described a plurality of second sub-pieces carried out that second up-sampling is synthetic to obtain described first;
The second decoding sampling unit, it is synthetic to be used for that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out first up-sampling, obtains decoded macro block.
22. picture decoding processing unit according to claim 18, it is characterized in that, described decoding conversion module specifically be used for to the first prediction residual coefficient corresponding with described a plurality of first sub-pieces and with described a plurality of in the corresponding second prediction residual coefficient of a plurality of second and a plurality of second sub-pieces carry out directivity inverse transformation based on same prediction mode, obtain first prediction residual and second prediction residual respectively;
Described decoding prediction module comprises:
The 7th decoding predicting unit is used to adopt described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder and handles, and obtains the inter prediction intraframe decoder result of the described first sub-piece;
The 8th decoding predicting unit, the inter prediction intraframe decoder result that is used to use the described first sub-piece is carried out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between the pixel of a plurality of second and a plurality of second sub-pieces in described a plurality of decoding process result in the predictive frame;
Described decoding synthesis module comprises:
The 3rd decoding sampling unit is used for decoding process result in the predictive frame between the pixel of the inter prediction intraframe decoder result of the described first sub-piece and described a plurality of second sub-pieces carried out that second up-sampling is synthetic to obtain described first;
The 4th decoding sampling unit, it is synthetic to be used for that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out first up-sampling, obtains decoded macro block.
23. picture decoding processing unit according to claim 18 is characterized in that, described decoding conversion module comprises:
The 5th decoding converter unit is used for the first prediction residual coefficient corresponding with described a plurality of a plurality of first sub-pieces carried out directivity inverse transformation based on predictive mode respectively, obtains first prediction residual;
The 6th decoding converter unit is used for obtaining second prediction residual to carrying out and the irrelevant inverse transformation of directivity with the described a plurality of a plurality of second second corresponding prediction residual coefficient;
Described decoding prediction module comprises:
The 9th decoding predicting unit is used to adopt described predictive mode that described first prediction residual is carried out the inter prediction intraframe decoder and handles, and obtains the inter prediction intraframe decoder result of described a plurality of first sub-pieces;
The tenth decoding predicting unit, the inter prediction intraframe decoder result that is used to use described a plurality of first sub-pieces is carried out between pixel decoding processing in the predictive frame to described second prediction residual, obtains between pixels a plurality of second in described a plurality of decoding process result in the predictive frame;
Described decoding synthesis module comprises:
The 6th decoding sampling unit is used for the inter prediction intraframe decoder result of described a plurality of first sub-pieces is carried out the synthetic processing in spatial domain, obtains described first;
The 7th decoding sampling unit, it is synthetic to be used for that decoding process result in the predictive frame between described first and described a plurality of second pixel is carried out up-sampling, obtains decoded macro block.
CN201010147587.0A 2010-04-09 2010-04-09 Processing method and device for image coding and decoding Active CN102215390B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010147587.0A CN102215390B (en) 2010-04-09 2010-04-09 Processing method and device for image coding and decoding

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010147587.0A CN102215390B (en) 2010-04-09 2010-04-09 Processing method and device for image coding and decoding

Publications (2)

Publication Number Publication Date
CN102215390A true CN102215390A (en) 2011-10-12
CN102215390B CN102215390B (en) 2014-07-09

Family

ID=44746487

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010147587.0A Active CN102215390B (en) 2010-04-09 2010-04-09 Processing method and device for image coding and decoding

Country Status (1)

Country Link
CN (1) CN102215390B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103227917A (en) * 2012-01-31 2013-07-31 华为技术有限公司 Decoding method and device
CN104935928A (en) * 2015-06-01 2015-09-23 电子科技大学 High-efficiency image compression method based on spatial domain downsampling mode
CN109803147A (en) * 2019-01-04 2019-05-24 中国联合网络通信集团有限公司 Transform process method and device based on video texture feature
WO2020182154A1 (en) * 2019-03-11 2020-09-17 杭州海康威视数字技术股份有限公司 Encoding method and apparatus, and decoding method and apparatus
WO2023197180A1 (en) * 2022-04-12 2023-10-19 Oppo广东移动通信有限公司 Decoding methods, encoding methods, decoders and encoders

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222641A (en) * 2007-01-11 2008-07-16 华为技术有限公司 Infra-frame prediction encoding and decoding method and device
CN101252686A (en) * 2008-03-20 2008-08-27 上海交通大学 Undamaged encoding and decoding method and system based on interweave forecast
CN101415121A (en) * 2007-10-15 2009-04-22 华为技术有限公司 Self-adapting method and apparatus for forecasting frame
CN101682770A (en) * 2007-06-15 2010-03-24 高通股份有限公司 Adaptive coding of video block prediction mode

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222641A (en) * 2007-01-11 2008-07-16 华为技术有限公司 Infra-frame prediction encoding and decoding method and device
CN101682770A (en) * 2007-06-15 2010-03-24 高通股份有限公司 Adaptive coding of video block prediction mode
CN101415121A (en) * 2007-10-15 2009-04-22 华为技术有限公司 Self-adapting method and apparatus for forecasting frame
CN101252686A (en) * 2008-03-20 2008-08-27 上海交通大学 Undamaged encoding and decoding method and system based on interweave forecast

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103227917A (en) * 2012-01-31 2013-07-31 华为技术有限公司 Decoding method and device
WO2013113217A1 (en) * 2012-01-31 2013-08-08 华为技术有限公司 Decoding method and device
CN104935928A (en) * 2015-06-01 2015-09-23 电子科技大学 High-efficiency image compression method based on spatial domain downsampling mode
CN104935928B (en) * 2015-06-01 2017-10-17 电子科技大学 A kind of efficient image compression method based on spatial domain down-sampling pattern
CN109803147A (en) * 2019-01-04 2019-05-24 中国联合网络通信集团有限公司 Transform process method and device based on video texture feature
CN109803147B (en) * 2019-01-04 2021-02-23 中国联合网络通信集团有限公司 Transformation processing method and device based on video texture features
WO2020182154A1 (en) * 2019-03-11 2020-09-17 杭州海康威视数字技术股份有限公司 Encoding method and apparatus, and decoding method and apparatus
WO2023197180A1 (en) * 2022-04-12 2023-10-19 Oppo广东移动通信有限公司 Decoding methods, encoding methods, decoders and encoders

Also Published As

Publication number Publication date
CN102215390B (en) 2014-07-09

Similar Documents

Publication Publication Date Title
US11659210B2 (en) Video encoding method for encoding division block, video decoding method for decoding division block, and recording medium for implementing the same
US11750809B2 (en) Encoding and decoding methods and apparatuses with multiple image block division manners
AU2015261728B2 (en) Method and apparatus for intra prediction within display screen
CN102045560B (en) Video encoding and decoding method and video encoding and decoding equipment
EP2153655B1 (en) Method and apparatus for encoding and decoding image using modification of residual block
TWI552579B (en) Video encoding method and apparatus, and non-transitory computer-readable recording medium
US20160073107A1 (en) Method and apparatus for video encoding/decoding using intra prediction
CN115514973A (en) Apparatus for decoding/encoding video signal and transmitting data
KR20120043661A (en) Method for encoding/decoding with adaptive intra prediction
CN103430545A (en) Content adaptive motion compensation filtering for high efficiency video coding
JP2006173808A (en) In-plane prediction device and method
US20210014484A1 (en) Picture encoding and decoding, picture encoder, and picture decoder
CN102215390B (en) Processing method and device for image coding and decoding
CN111448798A (en) Method and apparatus for block shape based video encoding and decoding
WO2006080779A1 (en) Method of effectively predicting multi-layer based video frame, and video coding method and apparatus using the same
CN102215391B (en) Video data encoding and decoding method and device as well as transform processing method and device
CN112135147B (en) Encoding method, decoding method and device
CN102984522A (en) Brightness transformation domain intra-frame prediction coding and decoding method and system
CN110677645B (en) Image prediction method and device
WO2011002091A1 (en) Moving image decoding method and moving image decoding apparatus
KR101005394B1 (en) Method for producting intra prediction block in H.264/AVC encoder
AU2016219672A1 (en) Method and apparatus for intra prediction within display screen

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant