CN1710959A - Video coding-decoding processing method - Google Patents
Video coding-decoding processing method Download PDFInfo
- Publication number
- CN1710959A CN1710959A CN 200410059687 CN200410059687A CN1710959A CN 1710959 A CN1710959 A CN 1710959A CN 200410059687 CN200410059687 CN 200410059687 CN 200410059687 A CN200410059687 A CN 200410059687A CN 1710959 A CN1710959 A CN 1710959A
- Authority
- CN
- China
- Prior art keywords
- sub
- macro block
- piece
- coding
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
- H04N19/895—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Abstract
The method includes steps: carrying out subprocess of transforming subblocks for each block inside each macro group respectively; sorting process is carried out for all subblocks after transform process inside each macro group; sending party sends encoded transformation coefficients of header information of each macro group, header information of macro block and each class of sub block group; receiving party carries out decoding proves for corrected received code stream respectively in order to recover image information of corresponding sub block; base on image information of relevant sub blocks, the receiving party carries out image information process in insertion approach algorithm for each sub block of containing error code. The invention is capable of carrying out process of anti error code more precisely for stream of error code caused by quality of transmission channel. Features are: lowering visual distortion of video image and raising effect of video communication.
Description
Technical field
The present invention relates to field of multimedia communication, relate in particular to a kind of coding and decoding video processing method.
Background technology
In multimedia communications system, video image quality has played very crucial effect to the multimedia communication performance.But often but because the problem of transmission channel quality, the encoding code stream that causes video image is in transmission course, packet loss phenomenon and error code phenomenon can appear, especially the error rate of wireless transmission channel and packet loss all are higher, and the bandwidth change amplitude is bigger, will make the video image recipient can not right-only receive the encoding code stream of video image like this, and if obtain video communication effect preferably, just need carry out anti-error code and handle, so that video image from visually can normally watching decoding to recover out to the wrong code stream (comprise the error code code stream and be dropped code stream etc.) that receives.
At present, the MPEG of Motion Picture Experts Group (Motion picture experts group) standard MPEG-4, low-bit rate video communication code H.263 standard and advanced video compression standard H.264 in all corresponding the proposition video transmission code stream is carried out the mode that anti-error code is handled, as:
Heavy (Resynchronization) processing mode synchronously;
Possibility of reversal long codes (RVLC, Reversible Variable Length Code) processing mode;
Data are cut apart (Data Partition) processing mode;
Self adaptation bar tape sort (ASO, Adaptive SLICE Ordering) processing mode;
Flexible macro-block ordering (FMO, Flexible Macroblock Ordering) processing mode; And
Redundant band (Redundant SLICEs) processing mode etc.;
The anti-error code processing mode of above-mentioned video transmission code stream can both be carried out corresponding compensation to the error code stream that causes owing to transmission channel to a certain extent, recover the video image processing so that the video image recipient can decode preferably, obtain video communication effect preferably.
But because in the video image encoding and decoding process, used the anti-error code processing mode of video transmission code stream, may suitably reduce encoding-decoding efficiency, but under the transmission channel quality condition of severe, it is very important that the anti-error code of transmission code stream is handled reaching video communication effect preferably, so often be ready suitably to reduce encoding-decoding efficiency can exchange anti-preferably error code and anti-packet loss performance for,, obtain video communication effect preferably to reach wrong preferably compensation purpose.
Wherein advanced video compression standard H.264 in, its video image compression standard is based on performance and approaches discrete digital cosine transform (DCT, Digital cosine transform) integer transform method, and compression at unit to as if video image in each 16 * 16 pixel size of being divided out macro block (MB, Macroblock).With reference to Fig. 1, this figure is that reconciliation compression process schematic diagram is handled in the compression of H.264 being adopted in the prior art, and it is as follows to the processing procedure that video image carries out compression and decompression:
The image compression process of video image transmit leg
-macro block of each 16 * 16 pixel size of marking off in video image is carried out estimation and motion compensation process;
-again 4 * 4 sub-pieces in each macro block are carried out dct transform;
-conversion coefficient behind the dct transform is quantized;
-again the result after quantizing is carried out entropy coding after, be assembled into packet and be sent to transmission channel;
Video image recipient's image decompression compression process
-the received code code stream is carried out the entropy decoding;
-decoded result is carried out re-quantization handle;
-again the result behind the re-quantization is carried out reverse discrete digital cosine transform (IDCT, Inverse digitalcosine transform);
-result behind the idct transform is carried out recovering decoded video image after the motion compensation.
Wherein the process that a video image is divided into a plurality of macro block MB comprises: earlier the whole video image is carried out transformed macroblock and divide processing, to obtain the macro block of a plurality of 16 * 16 pixels, the processing of again macro block being classified, and the macro block group that every class macro block is formed is defined as a video segment (SLICE).Wherein each video image is carried out coding structure that macroblock partitions handles each the macro block MB obtain as shown in Figure 2, for H.264, the luminance block Y (coding 0 is to the piece zone that is encoded to 15) that comprises 16 4 * 4 pixel sizes in each macro block MB, the chrominance block Cr (coding 20 is to the piece zone that is encoded to 23) of chrominance block Cb of 44 * 4 pixel sizes (coding 16 is to the piece zone that is encoded to 19) and 44 * 4 pixel sizes.
In order to obtain video communication effect preferably, H.264 standard has adopted flexible macro-block ordering (FMO, Flexible Macroblock Ordering) video coding processing mode that POLYCOM company proposes.With reference to Fig. 3, this figure is the handling principle schematic diagram of FMO video coding processing mode in the prior art; In the figure, suppose that the macro block MB that is designated " 0 " belongs to video segment SLICE0, the macro block MB that is designated " 1 " belongs to video segment SLICE1 (certainly except that dividing the situation of different SLICE with these two kinds of macro block sequencing schemes shown in this figure, can also comprise the various situations of dividing different SLICE according to macro block order arbitrarily).As shown in the drawing, at first the macro block MB that is designated " 0 " is carried out compressed encoding at the video image transmit leg and handle, be packaged into the bit stream data bag then and send; Again the macro block MB that is designated " 1 " is carried out compressed encoding and handle, be packaged into the bit stream data bag again and send.The video image recipient, at first the bit stream data bag that is designated " 0 " is carried out decoding processing, again the bit stream data bag that is designated " 1 " is carried out decoding processing; And if owing to the transmission channel quality problem causes that the bit stream data bag (being video segment SLICE0) that is designated " 0 " is lost on transmission channel, then the macro block pictorial information of adjacent being designated " 1 " that can recover according to decoding is inserted in the macro block that is designated " 0 " accordingly and is approached pictorial information, thereby reaches the purpose that mistake is covered.
Because FMO video coding treatment technology is that basic handling unit carries out the encoding and decoding processing with macro block MB, cover effect preferably although the error code code stream that causes owing to transmission channel quality had, but in video image recovery process, its image that approaches that inserts in the macro block that has produced error code according to the recovery image information of other adjacent macroblocks MB still has bigger distortion on visual angle, thereby makes video communication can not reach the anticipation effect.
Summary of the invention
The technical problem to be solved in the present invention is to propose a kind of coding and decoding video processing method, handles more accurately the error code code stream that causes owing to transmission channel quality is carried out anti-error code, reduces video image distortion visually, improves the effect of video communication.
For addressing the above problem, the present invention proposes a kind of coding and decoding video processing method, comprise step:
A, respectively each macro block that comprises in each macro block group is carried out the varitron piece and divide to handle;
B, respectively to the processing of classifying of all the sub-pieces after each macro block group conversion process;
C, transmit leg carry out respectively sending after the encoding process to the conversion coefficient of each macro block group header, macro block header and the sub-piece group of every class;
D, recipient carry out decoding processing to the code stream of correct reception respectively, to recover image information of corresponding sub block; Produced the sub-piece of error code for each, the recipient then inserts according to the image information of corresponding adjacent sub-blocks and approaches Image Information Processing.
Also comprise step after the wherein said step B:
Result according to all the sub-pieces after each macro block group conversion process being classified handling belongs to independently macro block group respectively with all kinds of sub-piece groups, so that former corresponding each macro block group is split into a plurality of independently macro block groups.
Also comprise step after the wherein said step B:
The result who handles according to all the sub-pieces after each macro block group conversion process are classified belongs to the sub-macro block group of respective macroblock group respectively with all kinds of sub-piece groups, so that former corresponding each macro block group comprises a plurality of sub-macro block groups.
Wherein in step C and D, described transmit leg and recipient also go square to handle to the adjacent sub-blocks that belongs to same type.
Wherein in step C and D, described transmit leg and recipient also carry out infra-frame prediction to the image information in the sub-piece that belongs to same type.
Respectively all the sub-pieces after each macro block group conversion process are classified to handle among the wherein said step B and are specially:
All sub-pieces after each macro block group conversion process are divided into two types sub-piece group according to sub-block conversion coefficient.
Wherein said each sub-block size is 4 * 4 pixels.Then pattern of rows and columns of two types sub-piece group comprises in each macro block:
Belong to two dissimilar sub-pieces respectively and be the diagonal angle distributions;
Belong to dissimilar sub-pieces respectively and be the interlacing distributions; Or
Be every the row distributions.
Wherein said each sub-block size is 8 * 8 pixels.Then pattern of rows and columns of two types sub-piece group comprises in each macro block:
Belong to two dissimilar sub-pieces respectively and be the diagonal angle distributions;
Belong to dissimilar sub-pieces respectively and be capable distributions; Or
Be the row distributions.
The beneficial effect that the present invention can reach is as follows:
Because coding and decoding video processing method of the present invention no longer belongs to same macro block group SLICE with all the subblock coding information among the macro block MB, but with the sub-block sort among the MB, make all kinds of subblock coding information belong to different macro block group SLICE respectively, the sub-macro block group SLICE that perhaps belongs to same macro block group SLICE, like this in video image decoding recovery process, just can be for the sub-piece that has produced error code with reference to the image information of other adjacent sub-pieces, insert and approach image information accordingly, thereby realized inserting to approach information accuracy higher, to error concealment effect purpose preferably, thereby on visual effect, reduced the image fault that wrong code stream brought that causes owing to transmission channel quality, improved the effect of video communication.
Description of drawings
Fig. 1 is that reconciliation compression process schematic diagram is handled in the compression of H.264 being adopted in the prior art;
Fig. 2 is the coding structure schematic diagram of each macro block MB in the prior art;
Fig. 3 is the handling principle schematic diagram of FMO video coding processing mode in the prior art;
Fig. 4 is the implementation procedure flow chart of coding and decoding video processing method of the present invention;
Fig. 5 is in the coding and decoding video processing method of the present invention, each MB is divided into the first order ideograph of the sub-piece of two classes of 4 * 4 pixel sizes;
Fig. 6 is in the coding and decoding video processing method of the present invention, each MB is divided into the second order ideograph of the sub-piece of two classes of 4 * 4 pixel sizes;
Fig. 7 is in the coding and decoding video processing method of the present invention, each MB is divided into the 3rd pattern of rows and columns figure of the sub-piece of two classes of 4 * 4 pixel sizes;
Fig. 8 is in the coding and decoding video processing method of the present invention, each MB is divided into the first order ideograph of the sub-piece of two classes of 8 * 8 pixel sizes;
Fig. 9 is in the coding and decoding video processing method of the present invention, each MB is divided into the second order ideograph of the sub-piece of two classes of 8 * 8 pixel sizes;
Figure 10 is in the coding and decoding video processing method of the present invention, each MB is divided into the 3rd pattern of rows and columns figure of the sub-piece of two classes of 8 * 8 pixel sizes;
When Figure 11 is SLICE of a macro block behavior, the principle schematic of its coded prediction;
When Figure 12 is SLICE of two macro block behaviors, the principle schematic of its coded prediction.
Embodiment
The basic design philosophy of coding and decoding video processing method of the present invention is: with the sub-block sort among the macro block MB, make all kinds of subblock coding information belong to different macro block group SLICE respectively, the sub-macro block group SLICE that perhaps belongs to same macro block group SLICE, thereby recover in the reduction process at image, to because the sub-piece group of the caused error code of transmission channel quality problem, can be according to the image information of other adjacent sub-blocks around each sub-piece of makeing mistakes, corresponding each sub-piece of makeing mistakes is inserted the processing that approaches image information, thereby make insertion to approach the image information accuracy higher, the error concealment better effects if is to reduce the distortion factor of video image on visual angle.Flexible macro-block ordering (FMO corresponding to the proposition of POLYCOM company, Flexible Macroblock Ordering) video coding processing mode, here the coding and decoding video processing mode that the present invention is proposed abbreviates flexible block sequencing (FBO as, Flexible Block Ordering) coding and decoding processing method, i.e. FBO coding and decoding processing method.
Please refer to Fig. 4, this figure is the implementation procedure flow chart of coding and decoding video processing method of the present invention; FBO encoding and decoding processing procedure of the present invention comprises the steps:
Step S10, each macro block that comprises in each the macro block group (being each image segments SLICE) after respectively video image being handled through transformed macroblock carries out the varitron piece and divides processing, so that each the macro block MB in each macro block group is divided into a plurality of sub-pieces; Size as original each MB is 16 * 16 pixels, can need as the case may be that then each MB is carried out the varitron piece and handle, to obtain the sub-piece of 4 * 4 pixels or 8 * 8 pixel sizes;
Step S20, respectively to all sub-pieces that obtain after each macro block group conversion process among step S10 processing of classifying, so that all the sub-pieces after the conversion process arrive together according to type categorization in each macro block group, forming dissimilar sub-piece groups, all sub-pieces that obtain after as the conversion coefficient of the sub-piece that can obtain according to each conversion each macro block group varitron piece being handled processing of classifying;
Wherein according to the result that all the sub-pieces after former each macro block group conversion process are classified and handled, all kinds of sub-piece groups can be belonged to independently macro block group (promptly forming independently video segment SLICE) respectively, so that former corresponding each macro block group is split into a plurality of independently macro block groups, after each macro block process varitron piece is handled among original certain macro block group SLICE0, again the sub-piece of corresponding all that obtain is divided into 3 groups, then each is organized sub-piece and just is defined as a macro block group, be about to former macro block group SLICE0 and split into 3 independently macro block groups, be SLICE1, SLICE2 and SLICE3.
Correspondingly, the also result that can handle according to all the sub-pieces after former each macro block group conversion process are classified belongs to the sub-macro block group of respective macroblock group respectively with all kinds of sub-piece groups, so that former corresponding each macro block group is by a plurality of sub-macro block groups.After each macro block process varitron piece is handled among original certain macro block group SLICE0, again the sub-piece of corresponding all that obtain is divided into 3 groups, then each is organized sub-piece and just is defined as a sub-macro block group under the former macro block group SLICE0, be that former macro block group SLICE0 just is made up of 3 sub-macro block groups, be SLICE0_1, SLICE0_2 and SLICE0_3.
Step S30, the video image transmit leg carries out respectively sending after the encoding process to the conversion coefficient of each macro block group header, macro block header and the sub-piece of every class that video image marks off; As above routine, coding and decoding video processing method of the present invention is in the encoding video pictures process, when macro block group SLICE0 coding is sent, need to the header of macro block group SLICE0, and SLICE0 in the conversion coefficient of the sub-piece of every class that comprises among the macro block header that comprises and the SLICE0 carry out encoding process respectively.
Step S40, video image recipient carry out decoding processing to the code stream of correct reception respectively, to recover to restore image information of corresponding sub block; Because in some cases, abominable as transmission channel quality, usually can cause the encoding code stream of video image can not right-on arrival recipient, and can lose some bit stream data bags or cause some bit stream data to contract out existing error code information, so the recipient, error image information or the bigger image information of distortion level will appear in these corresponding sub block that the error data packets place occurs;
Step S50, after decoding recovers video image, at the sub-piece that has produced error code, then produced the image information of sub-piece other adjacent sub-blocks on every side of error code according to this, in this has produced the sub-piece of error code, insert and approach Image Information Processing, handle the sub-piece that has produced error code is carried out error concealment.
Being divided into two types with all sub-pieces that will obtain after each macro block group (SLICE) conversion process in the video image below is that example describes in the processing of FBO encoding and decoding of the present invention pattern of rows and columns of two types sub-piece group in each macro block.
Wherein each sub-block size that each MB is carried out obtaining after the varitron piece is handled can be 4 * 4 pixels:
As shown in Figure 5, this figure is in the coding and decoding video processing method of the present invention, each MB is divided into the first order ideograph of the sub-piece of two classes of 4 * 4 pixel sizes; Wherein form the sub-piece group of a class, and do not have the sub-piece of five-pointed star sign to form another kind of sub-piece group, promptly belong to two dissimilar sub-pieces respectively and be the diagonal angle distributions by the sub-piece of five-pointed star sign; Like this, there is the sub-piece group of five-pointed star sign can belong to a SLICE separately, do not have the sub-piece group of five-pointed star sign then to belong to another SLICE separately; Perhaps by the sub-piece group of five-pointed star sign with there is not the sub-piece group of five-pointed star sign to form sub-SLICE former macro block group SLICE under respectively, an original like this SLICE just is equivalent to division for two SLICE.
Please refer to Fig. 6, this figure is in the coding and decoding video processing method of the present invention, each MB is divided into the second order ideograph of the sub-piece of two classes of 4 * 4 pixel sizes; Wherein form the sub-piece group of a class, and do not have the sub-piece of five-pointed star sign to form another kind of sub-piece group, promptly belong to dissimilar sub-pieces respectively and be the interlacing distributions by the sub-piece of five-pointed star sign;
Please refer to Fig. 7, this figure is in the coding and decoding video processing method of the present invention, each MB is divided into the 3rd pattern of rows and columns figure of the sub-piece of two classes of 4 * 4 pixel sizes; Wherein form the sub-piece group of a class, and do not have the sub-piece of five-pointed star sign to form another kind of sub-piece group, promptly belong to dissimilar sub-pieces respectively and be every the row distributions by the sub-piece of five-pointed star sign.
Each sub-block size that each MB is carried out obtaining after the varitron piece is handled also can be 8 * 8 pixels in addition:
Please refer to Fig. 8, this figure is in the coding and decoding video processing method of the present invention, each MB is divided into the first order ideograph of the sub-piece of two classes of 8 * 8 pixel sizes; Wherein form the sub-piece group of a class, and do not have the sub-piece of five-pointed star sign to form another kind of sub-piece group, promptly belong to two dissimilar sub-pieces respectively and be the diagonal angle distributions by the sub-piece of five-pointed star sign.
Please refer to Fig. 9, this figure is in the coding and decoding video processing method of the present invention, each MB is divided into the second order ideograph of the sub-piece of two classes of 8 * 8 pixel sizes; Wherein form the sub-piece group of a class, and do not have the sub-piece of five-pointed star sign to form another kind of sub-piece group, promptly belong to dissimilar sub-pieces respectively and be capable distributions by the sub-piece of five-pointed star sign.
Please refer to Figure 10, this figure is in the coding and decoding video processing method of the present invention, each MB is divided into the 3rd pattern of rows and columns figure of the sub-piece of two classes of 8 * 8 pixel sizes; Wherein form the sub-piece group of a class, and do not have the sub-piece of five-pointed star sign to form another kind of sub-piece group, promptly belong to dissimilar sub-pieces respectively and be the row distributions by the sub-piece of five-pointed star sign.
Certainly; no matter be the sub-piece that each MB is divided into the sub-piece of 4 * 4 pixel sizes or is divided into 8 * 8 pixel sizes; its dissimilar sub-piece pattern of rows and columns all be not limited to above-mentioned for the embodiment situation; as the case may be; pattern of rows and columns that other can also be arranged, then other dissimilar sub-piece pattern of rows and columns are also all in invention which is intended to be protected.
And above-mentioned dissimilar sub-piece pattern of rows and columns of lifting is based on, and the situation of luminance block Y, chrominance block Cr, chrominance block Cb structure describes among the macro block MB among the video image format 4:2:0, and be two kinds of situations of 4:2:2 and 4:4:4 at the video image form, the same 4:2:0 of its principle no longer too much gives unnecessary details here.
Because coding and decoding video processing mode of the present invention is based on FBO's, promptly belong to different macro block group SLICE modes and carry out the coding and decoding video operation with the sub-piece among the macro block MB, thus can cause the respective change of some standard procedures in the encoding-decoding process, as:
1) video image transmit leg and video image recipient will go square to handle (De-blocking) to the adjacent sub-blocks that belongs to same type, handle as Fig. 6, Fig. 7, Fig. 8, Fig. 9 and the sub-piece of adjacent 4 * 4 pixels that the five-pointed star sign is arranged shown in Figure 10 are carried out De-blocking, and the sub-piece of adjacent 4 * 4 pixels that does not have the five-pointed star sign is carried out De-blocking handle; And just need not to carry out the De-blocking processing for the sub-piece of 4 * 4 pixels of pattern of rows and columns shown in Figure 5, because in this pattern of rows and columns, there is not the sub-piece of same type to exist adjacent situation to occur.
2) video image transmit leg and video image recipient should carry out infra-frame prediction to the image information in the sub-piece that belongs to same type.
3) video image transmit leg and video image recipient's encoding and decoding estimation and motion compensation are unaffected substantially, just need the motion vector with reference to the sub-piece of same type when carrying out motion-vector prediction.
4) video image transmit leg and video image recipient are carrying out sub-block conversion coefficient coding context when considering, can only use the information of the sub-piece part of same type.
5) nuisance parameter information problem, as an original SLICE being divided into two independently in the example of SLICE above-mentioned, because for each SLICE part independently, half image information of the original SLICE part of only having encoded, therefore comparatively speaking, after adopting the FBO video coding-decoding method, the macroblock number that SLICE comprised can nearly double than the macroblock number under the routine, but some public parts that the macro block header has been repetition obviously, and belong to dissimilar sub-build information can be respectively in corresponding independent SLICE part coding respectively, as block motion vector information etc.
6) code efficiency problem, can consider from two aspects:
On the one hand, because FBO encoding and decoding processing mode of the present invention belongs to different macro block group SLICE with the dissimilar sub-piece of each macro block MB, obviously reduced the correlation of adjacent block in the original same SLICE part to a certain extent, its code efficiency is certain to decrease to some degree.
On the other hand, with reference to Figure 11, when this figure is SLICE of a macro block behavior, the principle schematic of its coded prediction; In this case, when a macro-block line is carried out one by one encoding process, generally can only predict with reference to left side macro block information; With reference to Figure 12, when this figure is SLICE of two macro block behaviors, the principle schematic of its coded prediction; Situation for a SLICE of two macro block behaviors, then the macro block of following macro-block line can with reference to the information of this macro block upper left corner macro block, directly over information, the information of upper right corner macro block and the information of left side macro block of macro block carry out coded prediction, as seen because the raising of coded prediction performance, (above-mentioned reason is because in order to improve the efficient of H.264 intraframe coding can to improve code efficiency to a certain extent, make full use of the spatial coherence of adjacent macroblocks in given frame, neighboring macro-blocks contains similar attribute usually.Therefore, to a given macroblock coding time, at first can be according to macroblock prediction on every side, be typically macro block according to the upper left corner, the processing because this macro block has been encoded is encoded to the difference of predicted value and actual value, so then, for this frame coding, can reduce code check with respect to directly greatly).
Certainly, the influence of comprehensive above-mentioned two aspects, FBO code encoding/decoding mode in general its code efficiency also can decrease to some degree.
In concrete practical application, according to concrete applicable cases, can selectively use FMO and FBO encoding and decoding processing mode, pattern of rows and columns to dissimilar sub-pieces also can selectively use simultaneously, as a plurality of sub-pieces being divided into two types situation, can carry out following setting at aforesaid:
1, sets up a FBO sign " FBO_label "
Work as FBO_label=0, choose the FMO encoding and decoding processing mode of prior art, be mainly used in the lower transmission channel of the error rate;
Work as FBO_label=1, choose FBO encoding and decoding processing mode of the present invention, be mainly used in the relatively poor transmission channel of the error rate;
2, for certain SLICE in the video image, set up principal mark for it and know Sub_SLICE, value 0 and 1 corresponds respectively to its two sub-SLICE that split by branch respectively, also can be with two after its division independent SLICE part respectively all value be Sub_SLICE;
3, set up a FBO pattern identification " FBO_mode ", FBO_mode value 0～5 corresponds respectively to Fig. 5 to six kinds of FBO pattern of rows and columns shown in Figure 10;
4, the selection of six kinds of FBO pattern of rows and columns can require to take all factors into consideration to choose according to system coding performance requirement and error-resilient performance; Certainly, consider the computation complexity in the concrete processing procedure, also certain that can only get in six kinds of FBO pattern of rows and columns is several; For example, can only get Fig. 5 and FBO pattern of rows and columns shown in Figure 8.
As seen, in FBO coding and decoding video processing mode of the present invention, when image information is recovered reduction, for the distorted image that occurs owing to error code, can insert and approach information processing having produced wrong piece as reference information with the block message of 4 * 4 pixels or 8 * 8 pixel sizes, carry out the information approximation process compared with the macro block with 16 * 16 pixel sizes in the prior art, the information accuracy that approaches of its insertion can be higher, and the image restoring effect can be more better.
Above-mentioned be primarily aimed at will carry out same macro block group all sub-pieces of obtaining after handling of varitron piece be divided into two types example and be illustrated; it is similar with the situation that is divided into two types wherein to be divided into polytype performance for all sub-pieces that same macro block group carried out obtain after the varitron piece is handled; here no longer too much give unnecessary details, but it is divided into polytype performance to all sub-pieces and is also included within the invention which is intended to be protected.
FBO encoding and decoding processing mode of the present invention is the modification of carrying out on the basis of referral procedure JM76 H.264, at some cycle testss, FBO coding and decoding processing method proposed by the invention is tested, the result shows, can access error concealment effect preferably, reduce the image deflects that causes owing to the transmission channel quality problem, improved the effect of video communication preferably.
The above only is a preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the technology of the present invention principle; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.
Claims (10)
1, a kind of coding and decoding video processing method is characterized in that, comprises step:
A, respectively each macro block that comprises in each macro block group is carried out the varitron piece and divide to handle;
B, respectively to the processing of classifying of all the sub-pieces after each macro block group conversion process;
C, transmit leg carry out respectively sending after the encoding process to the conversion coefficient of each macro block group header, macro block header and the sub-piece group of every class;
D, recipient carry out decoding processing to the code stream of correct reception respectively, to recover image information of corresponding sub block; Produced the sub-piece of error code for each, the recipient then inserts according to the image information of corresponding adjacent sub-blocks and approaches Image Information Processing.
2, coding and decoding video processing method according to claim 1 is characterized in that, also comprises step after the described step B:
Result according to all the sub-pieces after each macro block group conversion process being classified handling belongs to independently macro block group respectively with all kinds of sub-piece groups, so that former corresponding each macro block group is split into a plurality of independently macro block groups.
3, coding and decoding video processing method according to claim 1 is characterized in that, also comprises step after the described step B:
The result who handles according to all the sub-pieces after each macro block group conversion process are classified belongs to the sub-macro block group of respective macroblock group respectively with all kinds of sub-piece groups, so that former corresponding each macro block group comprises a plurality of sub-macro block groups.
4, coding and decoding video processing method according to claim 1 is characterized in that, in step C and D, described transmit leg and recipient also go square to handle to the adjacent sub-blocks that belongs to same type.
5, coding and decoding video processing method according to claim 1 is characterized in that, in step C and D, described transmit leg and recipient also carry out infra-frame prediction to the image information in the sub-piece that belongs to same type.
6, coding and decoding video processing method according to claim 1 is characterized in that, respectively all the sub-pieces after each macro block group conversion process being classified to handle among the described step B is specially:
All sub-pieces after each macro block group conversion process are divided into two types sub-piece group according to sub-block conversion coefficient.
7, coding and decoding video processing method according to claim 6 is characterized in that, described each sub-block size is 4 * 4 pixels.
8, coding and decoding video processing method according to claim 7 is characterized in that, pattern of rows and columns of two types sub-piece group comprises in each macro block:
Belong to two dissimilar sub-pieces respectively and be the diagonal angle distributions;
Belong to dissimilar sub-pieces respectively and be the interlacing distributions; Or
Be every the row distributions.
9, coding and decoding video processing method according to claim 6 is characterized in that, described each sub-block size is 8 * 8 pixels.
10, coding and decoding video processing method according to claim 9 is characterized in that, pattern of rows and columns of two types sub-piece group comprises in each macro block:
Belong to two dissimilar sub-pieces respectively and be the diagonal angle distributions;
Belong to dissimilar sub-pieces respectively and be capable distributions; Or
Be the row distributions.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100596872A CN100344163C (en) | 2004-06-16 | 2004-06-16 | Video coding-decoding processing method |
| PCT/CN2005/000795 WO2005125212A1 (en) | 2004-06-16 | 2005-06-07 | Method for video encoding and decoding process |
| HK06106678A HK1086696A1 (en) | 2004-06-16 | 2006-06-12 | Video coding and decoding method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100596872A CN100344163C (en) | 2004-06-16 | 2004-06-16 | Video coding-decoding processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1710959A true CN1710959A (en) | 2005-12-21 |
| CN100344163C CN100344163C (en) | 2007-10-17 |
Family
ID=35510133
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100596872A Active CN100344163C (en) | 2004-06-16 | 2004-06-16 | Video coding-decoding processing method |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN100344163C (en) |
| HK (1) | HK1086696A1 (en) |
| WO (1) | WO2005125212A1 (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101222639B (en) * | 2007-01-09 | 2010-04-21 | 华为技术有限公司 | Inter-view prediction method, encoder and decoder of multi-viewpoint video technology |
| CN102742268A (en) * | 2009-12-08 | 2012-10-17 | 汤姆森特许公司 | Methods and apparatus for adaptive residual updating of template matching prediction for video encoding and decoding |
| CN103200416A (en) * | 2013-04-23 | 2013-07-10 | 华录出版传媒有限公司 | Processing method for encoding and decoding 3D (three dimensional) video |
| CN107105259A (en) * | 2011-03-10 | 2017-08-29 | 夏普株式会社 | Picture decoding apparatus and method, picture coding device and method and recording medium |
| CN110996127A (en) * | 2019-11-25 | 2020-04-10 | 西安万像电子科技有限公司 | Image coding and decoding method, device and system |
| CN113115046A (en) * | 2018-06-21 | 2021-07-13 | 北京字节跳动网络技术有限公司 | Component dependent sub-block partitioning |
| US11509915B2 (en) | 2018-06-05 | 2022-11-22 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between IBC and ATMVP |
| US11616945B2 (en) | 2018-09-24 | 2023-03-28 | Beijing Bytedance Network Technology Co., Ltd. | Simplified history based motion vector prediction |
| US11792421B2 (en) | 2018-11-10 | 2023-10-17 | Beijing Bytedance Network Technology Co., Ltd | Rounding in pairwise average candidate calculations |
| US11968377B2 (en) | 2018-06-21 | 2024-04-23 | Beijing Bytedance Network Technology Co., Ltd | Unified constrains for the merge affine mode and the non-merge affine mode |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW237589B (en) * | 1991-02-27 | 1995-01-01 | Gen Electric | |
| FI92272C (en) * | 1992-05-20 | 1994-10-10 | Valtion Teknillinen | Compressive coding method for image transfer systems |
| KR100307618B1 (en) * | 1994-05-31 | 2001-11-30 | 윤종용 | Device and method for encoding image |
| US6711211B1 (en) * | 2000-05-08 | 2004-03-23 | Nokia Mobile Phones Ltd. | Method for encoding and decoding video information, a motion compensated video encoder and a corresponding decoder |
| CN101715136B (en) * | 2001-11-21 | 2017-03-29 | 摩托罗拉移动有限责任公司 | The method and apparatus encoded by image sequence with multiple images |
| CN1226882C (en) * | 2003-08-06 | 2005-11-09 | 清华大学 | Two stage predictive coding method based on sampling macroblock structure in video frequency signal |
-
2004
- 2004-06-16 CN CNB2004100596872A patent/CN100344163C/en active Active
-
2005
- 2005-06-07 WO PCT/CN2005/000795 patent/WO2005125212A1/en active Application Filing
-
2006
- 2006-06-12 HK HK06106678A patent/HK1086696A1/en unknown
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101222639B (en) * | 2007-01-09 | 2010-04-21 | 华为技术有限公司 | Inter-view prediction method, encoder and decoder of multi-viewpoint video technology |
| CN105791823B (en) * | 2009-12-08 | 2019-11-29 | 交互数字麦迪逊专利控股公司 | The method and apparatus of Video coding and decoded adaptive stencil matching prediction |
| CN102742268A (en) * | 2009-12-08 | 2012-10-17 | 汤姆森特许公司 | Methods and apparatus for adaptive residual updating of template matching prediction for video encoding and decoding |
| CN102742268B (en) * | 2009-12-08 | 2016-05-04 | 汤姆森特许公司 | The method and apparatus of the self adaptation masterplate coupling prediction of Video coding and decoding |
| CN105791823A (en) * | 2009-12-08 | 2016-07-20 | 汤姆森特许公司 | Methods and apparatus for adaptive template matching prediction for video encoding and decoding |
| US10743027B2 (en) | 2009-12-08 | 2020-08-11 | Interdigital Madison Patent Holdings | Methods and apparatus for adaptive template matching prediction for video encoding and decoding |
| CN107105259B (en) * | 2011-03-10 | 2021-12-28 | 夏普株式会社 | Image decoding device and method, and recording medium |
| CN107105259A (en) * | 2011-03-10 | 2017-08-29 | 夏普株式会社 | Picture decoding apparatus and method, picture coding device and method and recording medium |
| CN103200416A (en) * | 2013-04-23 | 2013-07-10 | 华录出版传媒有限公司 | Processing method for encoding and decoding 3D (three dimensional) video |
| US11523123B2 (en) | 2018-06-05 | 2022-12-06 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between IBC and ATMVP |
| US11509915B2 (en) | 2018-06-05 | 2022-11-22 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between IBC and ATMVP |
| US11831884B2 (en) | 2018-06-05 | 2023-11-28 | Beijing Bytedance Network Technology Co., Ltd | Interaction between IBC and BIO |
| US11973962B2 (en) | 2018-06-05 | 2024-04-30 | Beijing Bytedance Network Technology Co., Ltd | Interaction between IBC and affine |
| CN113115046A (en) * | 2018-06-21 | 2021-07-13 | 北京字节跳动网络技术有限公司 | Component dependent sub-block partitioning |
| US11477463B2 (en) | 2018-06-21 | 2022-10-18 | Beijing Bytedance Network Technology Co., Ltd. | Component-dependent sub-block dividing |
| US11659192B2 (en) | 2018-06-21 | 2023-05-23 | Beijing Bytedance Network Technology Co., Ltd | Sub-block MV inheritance between color components |
| US11895306B2 (en) | 2018-06-21 | 2024-02-06 | Beijing Bytedance Network Technology Co., Ltd | Component-dependent sub-block dividing |
| US11968377B2 (en) | 2018-06-21 | 2024-04-23 | Beijing Bytedance Network Technology Co., Ltd | Unified constrains for the merge affine mode and the non-merge affine mode |
| US11616945B2 (en) | 2018-09-24 | 2023-03-28 | Beijing Bytedance Network Technology Co., Ltd. | Simplified history based motion vector prediction |
| US11792421B2 (en) | 2018-11-10 | 2023-10-17 | Beijing Bytedance Network Technology Co., Ltd | Rounding in pairwise average candidate calculations |
| CN110996127A (en) * | 2019-11-25 | 2020-04-10 | 西安万像电子科技有限公司 | Image coding and decoding method, device and system |
| CN110996127B (en) * | 2019-11-25 | 2022-12-09 | 西安万像电子科技有限公司 | Image encoding and decoding method, device and system |
Also Published As
| Publication number | Publication date |
|---|---|
| HK1086696A1 (en) | 2006-09-22 |
| WO2005125212A1 (en) | 2005-12-29 |
| CN100344163C (en) | 2007-10-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108028919B (en) | Video or image coding and decoding method and device | |
| CN101098473B (en) | Picture coding method and apparatus | |
| KR101622450B1 (en) | Video encoding and decoding using transforms | |
| CN1620761A (en) | Adaptive variable length coding | |
| CN1178515C (en) | Image encoding method and device thereof | |
| CN1192634C (en) | Error concealment in a video signal | |
| US20100195715A1 (en) | Method and apparatus for adaptive frame prediction | |
| CN1643912A (en) | Method for coding motion in a video sequence | |
| CN1620816A (en) | Coding transform system in image/video encoders and/or decoders | |
| CN1893666A (en) | Video encoding and decoding methods and apparatuses | |
| JP2008537373A (en) | Error recovery method and apparatus using intra-slice resynchronization point | |
| CN1679330A (en) | System and method for video error concealment | |
| CN1751521A (en) | Image decoding device, image decoding method, and image decoding program | |
| CN101031086A (en) | Video-information encoding method and video-information decoding method | |
| CN1361991A (en) | Video coding | |
| CN101036392A (en) | Parameter set and picture header in video coding | |
| CN107710759A (en) | Method and device for the conversion coefficient encoding and decoding of non-square block | |
| CN1183491C (en) | Method and system for compressing image data with wavelet transform and quadtree coding for telecommunication | |
| CN1893663A (en) | Transmission protection method of multi-media communication | |
| CN1656690A (en) | Coding transform coefficients in image / video encoder and/or decoders | |
| CN1781314A (en) | Picture coding method | |
| KR101038531B1 (en) | Apparatus and method for encoding image capable of parallel processing in decoding and apparatus and method for decoding image capable of parallel processing | |
| CN1835590A (en) | Method and system for distributing video encoder processing | |
| WO2005125212A1 (en) | Method for video encoding and decoding process | |
| US6859500B2 (en) | Run-length coding of non-coded macroblocks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1086696 Country of ref document: HK |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: GR Ref document number: 1086696 Country of ref document: HK |
|
| ASS | Succession or assignment of patent right |
Owner name: TENCENT TECHNOLOGY (SHENZHEN) CO., LTD. Free format text: FORMER OWNER: HUAWEI TECHNOLOGY CO LTD Effective date: 20111027 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 518129 SHENZHEN, GUANGDONG PROVINCE TO: 518057 SHENZHEN, GUANGDONG PROVINCE |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20111027 Address after: 518057 Tencent Building, Nanshan District hi tech park, Shenzhen, Guangdong Patentee after: Tencent Technology (Shenzhen) Co., Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: Huawei Technologies Co., Ltd. |