CN101207823A - Method for video encoding of video frequency corresponding synthesis anti-code error - Google Patents
Method for video encoding of video frequency corresponding synthesis anti-code error Download PDFInfo
- Publication number
- CN101207823A CN101207823A CN 200710168410 CN200710168410A CN101207823A CN 101207823 A CN101207823 A CN 101207823A CN 200710168410 CN200710168410 CN 200710168410 CN 200710168410 A CN200710168410 A CN 200710168410A CN 101207823 A CN101207823 A CN 101207823A
- Authority
- CN
- China
- Prior art keywords
- error
- reference frame
- coding
- pixel
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to a comprehensive error resilience video coding method used for video communication. The comprehensive error resilience video coding method comprises the following steps at a coder part: 1. if receiving error feedback information of a decoder before coding each frame image, a coder carries out precise error area tracking and synchronous error concealment for all reference frames that are influenced by error codes in a reference frame queue, thereby leading the reference frame queues of the coder and the decoder to recover the synchronization; 2. before coding each macroblock, a new coding mode and a multiple reference frame selection algorithm are used for determining the type of the macroblock and the coding parameter; 3. after the image coding is finished, the coding modes of all macroblocks, the motion vector, the coding residual and error mask are saved; the invention also comprises the following steps at the decoder part: 1. video streams are decoded according to the procedures of a video decoder, and the serial numbers of all error macroblocks as well as the methods of the error concealment are recorded; 2. after one frame image finishes decoding, error feedback information containing the frame numbers and the serial numbers of all error macroblocks and and the methods of the error concealment is sent to the coder if the error codes exist.
Description
Technical field
The invention belongs to field of multimedia communication, specifically when taking place, error of transmission can be applicable to the video encoder of supporting the macro-block level multi-reference frame with utilizing the feedback information comprehensive anti-code error video frequency coding method that is used for video communication of the recovery image of rate rapidly and efficiently with a kind of.
Background technology
Along with the communication technology and rapid development of network technique, video communication system is obtaining application more and more widely.For example video conference, video telephone etc.Yet any communication network can not guarantee that all transmission course is reliable fully, the wireless network of particularly being used widely gradually in recent years is owing to be subject to the influence of signal fadeout, interference and multipath transmission etc., have higher bit error rate, thus error prone channels particularly the video communication on the wireless channel video coding algorithm has been proposed higher requirement.Here it is, and video code flow should have certain anti-channel error code ability, after mistake takes place, has stronger error recovery capabilities.This also is to put a difficult problem in face of the researcher and study focus.
The various video coding algorithms that adopt in video communication system have at present all adopted traditional hybrid video coding method based on time prediction.By time prediction, video coding algorithm has made full use of the correlation between the moving image consecutive frame as much as possible, and having reduced needs to participate in the image encoded complexity, thereby has obtained the compression ratio that many higher than the still image coding algorithm.But, time prediction also makes video code flow to error code sensitivity especially, decoder that error code causes and the reference frame in the encoder do not match and can accumulate and diffusion, before next I frame arrives, mistake can be propagated backward along time domain, successive image is made a mistake, and zone errors enlarge gradually.
H.263 drawn multiple effective anti-error code coding method with up-to-date video coding algorithm in H.264 what be used widely, for example: synchronously heavy, possibility of reversal long codes, data partition, flexible macro-block order, redundant band etc.These methods can reduce the destruction of error code to image to a certain extent, make the picture quality of decoding better.Yet these methods can't the adaptive channel quality, and anti-error code capacity still very limited, can't stop error propagation.When channel bit error rate was very low, they had reduced code efficiency, and when channel bit error rate improved, their anti-error code effect was difficult to satisfactory again.
Except anti-error code coding method, anti-error code decoding and interactive anti-error code coding also are anti-error code methods commonly used in the video communication.Anti-error code decoding refers generally to the error concealment of decoder, and it can recover wrong image to a certain extent, improves visual effect, but can not stop error propagation.Interactive anti-error code coding appears in the system with feedback channel, generally is meant the operation of adjusting encoder by the error message of decoder feedback, and the mistake of image can be recovered as early as possible.This method is less to the influence of code efficiency, can stop error propagation, but has delay issue.
Above-mentioned three class methods have all obtained extensive studies to the greatest extent, but these methods all have shortcoming and defect separately, how effectively they to be combined, on the basis of existing video coding algorithm, obtain the practical higher error-resilient performance of efficient and remain a good problem to study.
Summary of the invention
The objective of the invention is to propose a kind of effectively the decoding of anti-error code and interactive anti-error code coding comprehensive in existing video coding algorithm, the comprehensive anti-code error video frequency coding method that is used for video communication of the termination error propagation of rate rapidly and efficiently under the prerequisite that does not reduce code efficiency substantially.
To achieve these goals, the present invention comprises following steps:
In encoder side:
First step, before the every two field picture of coding, if receive the error feedback message of decoder, encoder will carry out that accurate zone errors are followed the tracks of and timing error is covered to all reference frames that are subjected to error code influence in the reference frame formation.The reference frame formation of encoder is recovered synchronously;
Second step, the coding each macro block before, determine macro block (mb) type and coding parameter with new coding mode and multi-reference frame selection algorithm;
Third step, after image encoding finishes, preserve all macroblock encoding patterns, motion vector, coded residual and wrong mask;
In decoder side:
The 4th step, video code flow is decoded according to the flow process of Video Decoder, and write down the sequence number and the error concealment method of all erroneous macroblock;
The 5th step, after two field picture decoding finishes, if error code is arranged, then send error feedback message, comprise frame number, the sequence number of all erroneous macroblock and error concealment method are to encoder.
The accurate zone errors of above-mentioned first step are followed the tracks of and timing error covers that being actually combines carries out.
The accurate zone errors tracking of above-mentioned first step and timing error are covered and are comprised the steps:
The first step: determine the reference frame that corresponding decoder is made mistakes;
Second step:, carry out error concealment with the error concealment method of decoder feedback to all erroneous macroblock of the reference frame of makeing mistakes;
The 3rd step: will put ' 1 ' through the wrong mask of all pixels that change behind the error concealment in second step, these pixels of mark are by " pollution ";
The 4th step: handle as follows successively for subsequent reference frame:
According to coded sequence, upgrade the wrong mask of each pixel for all macro blocks of each frame according to its coding mode and motion vector:
If a pixel has only a reference point, directly copy the wrong mask of reference point;
If a pixel has a plurality of reference points, to the wrong mask fetch logic of a plurality of reference points " or " the result as the wrong mask of this pixel.
The 5th step: judge with the 4th new wrong mask that goes on foot each pixel that obtains whether this pixel needs to rebuild, if wrong mask is ' 1 ', in the reference frame of rebuilding,, obtain the reconstructed value of this pixel with the coded residual of this pixel of preserving in advance and the reference pixel addition that regains.
The coding mode of above-mentioned second step and multi-reference frame selection algorithm comprise the steps:
Before each macro block of coding, at first calculate the cost function of I macroblock coding, for H.264, then be the cost function of selecting optimum INTRA predictive mode earlier and obtaining optimum I macroblock coding;
The estimation of taking exercises: at first on nearest reference frame, carry out, if the wrong mask of all pixels of reference zone is ' 0 ' entirely, then estimation finishes, otherwise in the reference frame formation, get reference frame forward successively and carry out estimation, until the wrong mask of all pixels of reference zone entirely for ' 0 ' or reference frame exhaust, preserve the motion vector and the cost function of estimation each time;
The cost function of I macroblock coding and the cost function of all estimation are got minimum value together, determine the macroblock encoding pattern, if the P macroblock coding, this step has also been determined reference frame and motion vector.
The wrong mask of all macro blocks of preservation of above-mentioned third step is entirely ' 0 '.
Basic design philosophy of the present invention is: when error code occurring, decoder can't normal decoder all macro block sequence numbers and error concealment method notice encoder, encoder carries out same error concealment according to feedback information in the respective macroblock of corresponding reference frame, and mark is owing to the wrong mask of the pixel that error concealment changes is ' 1 ', promptly by " pollution ".Because motion compensation, may be made " pollution " in successive image, propagate and spread by the subsequent frame reference by the pixel of " pollutions ".To in the successive image because of the pixel of motion compensation " pollution ", with the coded residual of this pixel of preserving in advance with finished the reference pixel addition that timing error is covered, obtain the new reconstructed value of this pixel, finish the timing error of subsequent frame and cover.After finishing timing error and covering, the reference frame formation of encoder recovers synchronously, and error propagation has stopped fully.In order further to improve code efficiency, when each macroblock coding, carry out new coding mode and multi-reference frame and select, avoid " pollution " regional reference bigger with new method to error as far as possible.By these methods, the present invention as far as possible limit in the error recovery capabilities that has the video encoder under the condition of feedback channel, be that wrong recovery time and image Y-PSNR all are better than present existent method.
Description of drawings
Fig. 1 is a theory diagram of the present invention.
Fig. 2 a is that H.263 the present invention to be accurate error tracking (black partly is " pollution " zone) reference frame of makeing mistakes of example.
Fig. 2 (b) is that H.263 the present invention to be the accurate error tracking subsequent reference frame of example.
Fig. 3 selects schematic diagram for multi-reference frame of the present invention.
Fig. 4 is the flow chart of encoder of the present invention.
Fig. 5 is the flow chart of decoder of the present invention.
Among the figure: R
0To R
N-1Be the reference frame formation, M
0To M
N-1Preserve the wrong mask of each reference frame, MV
0To MV
N-1Preserve each reference frame all macroblock encoding pattern and motion vectors, E
0To E
N-1Preserve the coded residual of each frame.
Embodiment
The present invention is described in further detail below in conjunction with drawings and Examples.
The comprehensive anti-error code coding method that is used for video communication that the present invention proposes comprises mainly that accurate zone errors are followed the tracks of, timing error is covered, coding mode and multi-reference frame are selected three parts.This three part is continuous closely, is an indivisible integral body.Wherein accurately whether zone errors are followed the tracks of each pixel of having indicated each frame in the encoder reference frame formation accurately in Pixel-level and are lost synchronously with the same pixel of the corresponding reference frame of decoder.Reconstruction is covered in timing error, and all lose synchronous pixel, and the reference frame formation of encoder is recovered synchronously.It is that each macro block is selected best coding mode and parameter fast and accurately taking place when timing error is covered that coding mode and multi-reference frame select to help encoder.
In Fig. 1, frame of broken lines is outward the video encoder of the support macro-block level multi-reference frame of a standard, is this method replenishing video encoder in the frame of broken lines.In family H.26x, H.263++ and H.264 comprised support to the macro-block level multi-reference frame.R among the figure
0To R
N-1Be the reference frame formation, M
0To M
N-1Preserve the wrong mask of each reference frame, MV
0To MV
N-1Preserve each reference frame all macroblock encoding pattern and motion vectors, E
0To E
N-1Preserve the coded residual of each frame.Wherein wrong mask is the virtual image of sizes such as and reference frame, and each pixel is a Boolean, and whether the point of representing corresponding reference frame same position is by channel error " pollution ".Subscript 0 to N-1 is represented the time interval of reference frame to current encoded frame.
1, accurately zone errors are followed the tracks of: video encoder is preserved a nearest N reference frame and their wrong mask, coding mode and motion vector and coded residual.When not receiving error feedback message at first, encoder is all clear ' 0 ' with the wrong mask of each reference frame, shows that picture is not by " pollution ".Decoder sends the sequence number of error feedback message informing encoder erroneous frame, the position of all error macro blocks and the error concealment method that each error macro block is adopted by feedback channel.Before the every two field picture of coding, if receive error feedback message from decoder, encoder is with carrying out following three steps, otherwise skips steps 1 and step 2:
Step 1: for the reference frame of makeing mistakes, encoder carries out timing error earlier to all erroneous macroblock and covers step 1, the wrong mask of the pixel that changes behind the error concealment is all put ' 1 ', and these pixels of mark are by " pollution ".
Step 2:, when error feedback message arrives encoder, some two field pictures have been arranged in the reference frame formation of decoder by error propagation " pollution " because there is round-trip delay in channel.So encoder not only needs to mark " pollution " part of wrong reference frame, also need part to all follow-up reference frame marks " pollution ".Carry out error tracking for subsequent reference frame successively according to their coded sequence.Method be all macro blocks for each frame according to coded sequence, upgrade the wrong mask of each pixel according to its coding mode and motion vector.
If a pixel has only a reference point, for example the whole pixel motion vector of P macro block or I macro block H.264 directly copy the wrong mask of reference point when vertical and horizontal forecast; If a pixel has a plurality of reference points (reference point is the linear combination of a plurality of pixels in the reference frame in other words), for example the half-pix motion vector of P macro block or I macro block H.264 be when diagonal is predicted, to the wrong mask fetch logic of a plurality of reference points " or " the result as the wrong mask of this pixel.
H.263, Fig. 2 is being example, suppose that motion vector all is an integer, error code causes decoder the 4th last 6 macro blocks of piece group of can't decoding, and timing error is covered all pixels of back variation has all been taken place, so the wrong mask of these 6 macro block correspondences of this frame of encoder mark be entirely ' 1 ', as Fig. 2 (a).In 1,2,3 macro blocks of next frame, macro block 2 is INTRA patterns, because I macro block H.263 is not with reference to other pixel, so macro block data and wrong mask all remain unchanged; Macro block 1,3 is owing to be the P macro block, and reference zone comprised the data of wrong mask non-' 0 ', so encoder duplicates the wrong mask of reference zone respectively to macro block 1,3.This process is carried out repeatedly, has all finished error tracking and reconstruction up to all subsequent reference frame.
Step 3: when the new two field picture of the every coding of encoder, because the reference frame formation of encoder recovered synchronously, so wrong mask is ' 0 '.
By this several steps, encoder can be set up all quilt exact positions of the pixel of " pollution " of each frame in the reference frame formation accurately after receiving error feedback message.
Accurately the characteristics of zone errors tracking are:
A, for the reference frame of makeing mistakes, encoder is done timing error and is covered with the error concealment method identical with decoder, and the wrong mask of the pixel that changes is labeled as ' 1 ', has obtained all pixels that influenced by error code of this frame accurately;
B, can judge all pixels that influenced by error code in the subsequent reference frame accurately according to motion vector, covering for the timing error of subsequent reference frame provides foundation.
The reference frame mistake mask of c, accurately zone errors foundation is that the selection of encoder better choice coding mode and reference frame (the 3rd joint) provides foundation.
2, timing error is covered: timing error is covered and is meant by the reference frame of error code " pollution ", and encoder is rebuild all by the macro blocks of " pollution " with the error concealment method identical with decoder, and makes the reference frame formation maintenance of encoder identical.Be divided into two steps:
Step 1: after receiving the error feedback message of decoder, for corresponding reference frame and the decoder that makes encoder is consistent, at first the error concealment method that all error macro blocks of feedback message report are notified in feedback message in the reference frame of makeing mistakes carries out the error concealment same with decoder.Carrying out accurate zone errors then follows the tracks of.
Step 2: accurate zone errors follow the tracks of finish after, in the formation of decoder reference frame all influenced by the pixel of " pollution " by error code all definite.For the reference frame formation that makes encoder keeps need carrying out timing error successively to subsequent reference frame and covering synchronously.
This method is for subsequent reference frame, and whether needs are rebuilt to judge this pixel according to the wrong mask of each pixel.If the wrong mask of this pixel is ' 1 ',, obtain the reconstructed value of this pixel with the coded residual of this pixel of preserving in advance and the reference pixel addition that regains.
The characteristics that timing error is covered are:
Timing error cover finish after the reference frame formation of encoder recover synchronously, error propagation is stopped fully.
3, coding mode and multi-reference frame are selected: according to the temporal correlation of video image, the reference frame of general P macro block is in time more near present frame, and predicated error is more little.Consider that wrong mask is that ' 1 ' pixel is because error is bigger, in order to improve precision of prediction, the estimation of each macro block is at first carried out on nearest reference frame, if the wrong mask of all pixels of reference zone all is ' 0 ', then estimation finishes, carry out estimation otherwise in the reference frame formation, get reference frame forward successively, until the wrong mask at the reference zone of a certain frame all be ' 0 ' or reference frame exhaust (Fig. 3).
The step to the pattern of each macro block and reference frame selection of encoder is as follows:
Step 1: calculating the cost function of I macroblock coding, for H.264, then is the cost function of selecting optimum INTRA predictive mode earlier and obtaining optimum I macroblock coding;
Step 2: get nearest reconstruction frames as the reference frame, carry out estimation, and the calculation cost function;
Step 3: if reference zone is not exhausted by " pollution " (the wrong mask of all pixels all is ' 0 ') or reference frame, then estimation finishes, carry out estimation otherwise get a reconstruction frames more forward as the reference frame, and the calculation cost function, repeating step 3;
The cost function of I macroblock coding and the cost function of all estimation are got minimum value together, determine the macroblock encoding pattern, if the P macroblock coding, this step has also been determined reference frame and motion vector.
The characteristics of coding mode and multi-reference frame system of selection are:
A, in order to reduce the amount of calculation of estimation, this method reduces the reference frame number that takes exercises and estimate as far as possible;
B, in order to reduce predicated error, avoid as far as possible the P macro block to " pollution " zone reference;
If c to the minimum of cost function really of the reference in " pollution " zone, still allows the P macro block with reference to " pollution " zone.
As mentioned above, the accurate zone errors of the combination that the present invention proposes are followed the tracks of, timing error is covered and the comprehensive anti-code error video frequency coding method of multi-reference frame selection accurately obtains all zones that influenced by error propagation in the reference frame formation by the zone errors tracking at every turn when receiving error feedback message, and cover all affected pixels of reconstruction by timing error, make the reference frame formation of encoder recover to stop error propagation fully synchronously.By coding mode and multi-reference frame system of selection, the present invention can accomplish after encoder receives error feedback message in several frame times picture quality returned to the level under the no error code situation.H.263++ the present invention can be applied to, H.264 wait all to support the video coding algorithm of macro-block level reference frame selection, is a kind of general anti-code error video frequency coding method.
The present invention is actually the method for the collaborative anti-error code of a kind of encoder, the accurate zone errors of the error feedback of decoder side and encoder side are followed the tracks of, timing error is covered, coding mode and multi-reference frame are selected organically to be combined into as a whole, can stop error propagation under the prerequisite that does not reduce code efficiency substantially fast.
Implementation procedure of the present invention is the flow chart in decoder and encoder (Fig. 4 and Fig. 5) respectively.Comprehensive anti-error code processing procedure of the present invention mainly comprises the steps:
In encoder:
First step (S11): after encoder is determined reference frame that corresponding decoder makes mistakes, all erroneous macroblock sequence numbers to decoder second step feedback, do timing error and cover step 1, soon these macro blocks carry out the error concealment same with decoder with the error concealment method of decoder feedback.Do accurate zone errors tracking step 1 again, the wrong mask of the pixel that changes behind the error concealment is all put ' 1 ', these pixels of mark are by " pollution ".
Second step (S12):, when feedback message arrives encoder, some two field pictures have been arranged in the reference frame formation of decoder by error propagation " pollution " because there is round-trip delay in channel.So the reference frame that encoder not only needs mark to make mistakes also needs the part to the reference frame mark " pollution " of all subsequent reconstruction.Carry out accurate zone errors tracking step 2 for subsequent reference frame successively according to their coded sequence.This method is to upgrade the wrong mask of each pixel according to its coding mode and motion vector for all macro blocks of each frame.If a pixel has only a reference point, for example the whole pixel motion vector of P macro block or I macro block H.264 directly copy the wrong mask of reference point when vertical and horizontal forecast; If a pixel has a plurality of reference points, for example the half-pix motion vector of P macro block or I macro block H.264 when diagonal is predicted, to the wrong mask fetch logic of a plurality of reference points " or " the result as the wrong mask of this pixel.After finishing accurate zone errors tracking, carry out timing error and cover step 2, whether needs are rebuilt successively subsequent reference frame to be judged this pixel according to the wrong mask of each pixel.If the wrong mask of this pixel is ' 1 ', use the coded residual of this pixel of preserving in advance and finished the reference pixel addition that timing error is covered, obtain the reconstructed value of this pixel, finish timing error and cover.Make encoder corresponding reference frame recover consistent.
Third step (S13): each macro block at first calculates the cost function of I macroblock coding, for H.264, then is the cost function of selecting optimum INTRA predictive mode earlier and obtaining optimum I macroblock coding, carries out estimation then.Estimation is at first carried out on nearest reference frame, if the wrong mask of all pixels of reference zone is ' 0 ' entirely, then estimation finishes, otherwise in the reference frame formation, get reference frame forward successively and carry out estimation, until the wrong mask of all pixels of reference zone entirely for ' 0 ' or reference frame exhaust, then the cost function of different reference frame estimation and the cost function of I macroblock coding are got minimum value together, determine the macroblock encoding pattern, if the P macroblock coding, this step has also been determined reference frame and motion vector.
The 4th step (S14): when third step has been selected I mode macro coding, current macro is carried out the I macroblock coding with the designated encryption algorithm.
The 5th step (S15): when third step has been selected P mode macro coding, the parameter that current macro is selected according to third step with the designated encryption algorithm is carried out the P macroblock coding.
The 6th step (S16): the reconstructed image after the end-of-encode enters the reference frame formation, and its all macroblock encoding patterns, motion vector, coded residual and wrong mask need be preserved and deposit similar formation (Fig. 1) in.
Recover synchronously owing to cover the reference frame formation of back encoder in timing error, error propagation is stopped fully.So the image error mask that step S16 preserves is complete ' 0 '.
In decoder:
The first step (S21): to because error code and the common way of macro block that can't normal decoder is to abandon wrong data, with the approximate content of recovering macro block of error concealment method, for example a kind of method commonly used is exactly the macro block that directly copies the previous frame same position.Decoder can be selected different error concealment methods according to the characteristics of erroneous macroblock, so decoder not only will write down the grand sequence number of determining of error code, also will write down the error concealment method that this macro block uses.
Second step (S22): after picture decoding finished, with visual sequence number, the error concealment method that use all erroneous macroblock sequence numbers and they sent to encoder by feedback channel.According to these information, encoder can be rebuild corresponding reference frame and identical with the output of decoder.
The content that is not described in detail in this specification belongs to this area professional and technical personnel's known prior art.
Claims (5)
1. comprehensive anti-code error video frequency coding method that is used for video communication comprises following steps:
In encoder side:
First step, before the every two field picture of coding, if receive the error feedback message of decoder, encoder will carry out that accurate zone errors are followed the tracks of and timing error is covered to all reference frames that are subjected to error code influence in the reference frame formation.The reference frame formation of encoder is recovered synchronously;
Second step, the coding each macro block before, determine macro block (mb) type and coding parameter with new coding mode and multi-reference frame selection algorithm;
Third step, after image encoding finishes, preserve all macroblock encoding patterns, motion vector, coded residual and wrong mask;
In decoder side:
The 4th step, video code flow is decoded according to the flow process of Video Decoder, and write down the sequence number and the error concealment method of all erroneous macroblock;
The 5th step, after two field picture decoding finishes, if error code is arranged, then send error feedback message, comprise frame number, the sequence number of all erroneous macroblock and error concealment method are to encoder.
2. the comprehensive anti-code error video frequency coding method that is used for video communication as claimed in claim 1 is characterized in that: the accurate zone errors of first step are followed the tracks of and timing error covers that being actually combines carries out.
3. the comprehensive anti-code error video frequency coding method that is used for video communication as claimed in claim 1 or 2 is characterized in that: the accurate zone errors tracking of first step and timing error are covered and are comprised the steps:
The first step: determine the reference frame that corresponding decoder is made mistakes;
Second step:, carry out error concealment with the error concealment method of decoder feedback to all erroneous macroblock of the reference frame of makeing mistakes;
The 3rd step: will put ' 1 ' through the wrong mask of all pixels that change behind the error concealment in second step, these pixels of mark are by " pollution ";
The 4th step: handle as follows successively for subsequent reference frame:
According to coded sequence, upgrade the wrong mask of each pixel for all macro blocks of each frame according to its coding mode and motion vector:
If a pixel has only a reference point, directly copy the wrong mask of reference point;
If a pixel has a plurality of reference points, to the wrong mask fetch logic of a plurality of reference points " or " the result as the wrong mask of this pixel.
The 5th step: judge with the 4th new wrong mask that goes on foot each pixel that obtains whether this pixel needs to rebuild, if wrong mask is ' 1 ', in the reference frame of rebuilding,, obtain the reconstructed value of this pixel with the coded residual of this pixel of preserving in advance and the reference pixel addition that regains.
4. the comprehensive anti-code error video frequency coding method that is used for video communication as claimed in claim 1 is characterized in that: the coding mode of second step and multi-reference frame selection algorithm comprise the steps:
Before each macro block of coding, at first calculate the cost function of I macroblock coding, for H.264, then be the cost function of selecting optimum INTRA predictive mode earlier and obtaining optimum I macroblock coding;
The estimation of taking exercises: at first on nearest reference frame, carry out, if the wrong mask of all pixels of reference zone is ' 0 ' entirely, then estimation finishes, otherwise in the reference frame formation, get reference frame forward successively and carry out estimation, until the wrong mask of all pixels of reference zone entirely for ' 0 ' or reference frame exhaust, preserve the motion vector and the cost function of estimation each time;
The cost function of I macroblock coding and the cost function of all estimation are got minimum value together, determine the macroblock encoding pattern, if the P macroblock coding, this step has also been determined reference frame and motion vector.
5. the comprehensive anti-code error video frequency coding method that is used for video communication as claimed in claim 1 is characterized in that: the wrong mask of all macro blocks of preservation of third step is entirely ' 0 '.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710168410 CN101207823A (en) | 2007-11-22 | 2007-11-22 | Method for video encoding of video frequency corresponding synthesis anti-code error |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710168410 CN101207823A (en) | 2007-11-22 | 2007-11-22 | Method for video encoding of video frequency corresponding synthesis anti-code error |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101207823A true CN101207823A (en) | 2008-06-25 |
Family
ID=39567623
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200710168410 Pending CN101207823A (en) | 2007-11-22 | 2007-11-22 | Method for video encoding of video frequency corresponding synthesis anti-code error |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101207823A (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101692712B (en) * | 2009-10-19 | 2011-02-02 | 浙江大学 | Error concealment method based on state of signal channel and visual perception side information |
| CN101990097A (en) * | 2009-07-29 | 2011-03-23 | 索尼公司 | Image processing apparatus and image processing method |
| CN102006467A (en) * | 2009-09-01 | 2011-04-06 | 索尼公司 | Video transmitting apparatus, video receiving apparatus, video transmitting method, and video receiving method |
| CN101389037B (en) * | 2008-09-28 | 2012-05-30 | 湖北科创高新网络视频股份有限公司 | Time-space domain split multiple state video coding method and device |
| CN104918052A (en) * | 2014-03-14 | 2015-09-16 | 想象技术有限公司 | Error tracking and mitigation for motion compensation-based video compression |
| CN105245908A (en) * | 2015-10-27 | 2016-01-13 | 大连海事大学 | Video error resilient coding method based on error correction priority value feedback |
| CN106101702A (en) * | 2015-12-29 | 2016-11-09 | 苏州踪视通信息技术有限公司 | Video coding with reverse channel message management and decoding |
| CN107113441A (en) * | 2016-12-30 | 2017-08-29 | 深圳市大疆创新科技有限公司 | Image processing method, device, unmanned vehicle and receiving terminal |
| US10506257B2 (en) | 2015-09-28 | 2019-12-10 | Cybrook Inc. | Method and system of video processing with back channel message management |
| US10516892B2 (en) | 2015-09-28 | 2019-12-24 | Cybrook Inc. | Initial bandwidth estimation for real-time video transmission |
| US10756997B2 (en) | 2015-09-28 | 2020-08-25 | Cybrook Inc. | Bandwidth adjustment for real-time video transmission |
| CN111600774A (en) * | 2020-05-13 | 2020-08-28 | 北京奇艺世纪科技有限公司 | Consumption delay determination method, system, device, equipment and readable storage medium |
| US10911750B2 (en) | 2016-12-30 | 2021-02-02 | SZ DJI Technology Co., Ltd. | System and methods for feedback-based data transmission |
| US10924745B2 (en) | 2016-12-30 | 2021-02-16 | SZ DJI Technology Co., Ltd. | Image processing method and device |
| CN114051164A (en) * | 2021-11-16 | 2022-02-15 | 重庆紫光华山智安科技有限公司 | Decoding abnormal code stream generation method and device, electronic equipment and readable storage medium |
-
2007
- 2007-11-22 CN CN 200710168410 patent/CN101207823A/en active Pending
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101389037B (en) * | 2008-09-28 | 2012-05-30 | 湖北科创高新网络视频股份有限公司 | Time-space domain split multiple state video coding method and device |
| CN101990097A (en) * | 2009-07-29 | 2011-03-23 | 索尼公司 | Image processing apparatus and image processing method |
| CN101990097B (en) * | 2009-07-29 | 2013-03-27 | 索尼公司 | Image processing apparatus and image processing method |
| CN102006467A (en) * | 2009-09-01 | 2011-04-06 | 索尼公司 | Video transmitting apparatus, video receiving apparatus, video transmitting method, and video receiving method |
| CN102006467B (en) * | 2009-09-01 | 2013-07-17 | 索尼公司 | Video transmitting apparatus, video receiving apparatus, video transmitting method, and video receiving method |
| CN101692712B (en) * | 2009-10-19 | 2011-02-02 | 浙江大学 | Error concealment method based on state of signal channel and visual perception side information |
| CN104918052A (en) * | 2014-03-14 | 2015-09-16 | 想象技术有限公司 | Error tracking and mitigation for motion compensation-based video compression |
| US10756997B2 (en) | 2015-09-28 | 2020-08-25 | Cybrook Inc. | Bandwidth adjustment for real-time video transmission |
| US10516892B2 (en) | 2015-09-28 | 2019-12-24 | Cybrook Inc. | Initial bandwidth estimation for real-time video transmission |
| US10506257B2 (en) | 2015-09-28 | 2019-12-10 | Cybrook Inc. | Method and system of video processing with back channel message management |
| CN105245908A (en) * | 2015-10-27 | 2016-01-13 | 大连海事大学 | Video error resilient coding method based on error correction priority value feedback |
| CN105245908B (en) * | 2015-10-27 | 2018-06-29 | 大连海事大学 | A kind of video fault-tolerant coding method based on error correction preferred value feedback |
| CN106101702A (en) * | 2015-12-29 | 2016-11-09 | 苏州踪视通信息技术有限公司 | Video coding with reverse channel message management and decoding |
| CN106101702B (en) * | 2015-12-29 | 2019-08-09 | 苏州踪视通信息技术有限公司 | Video coding and decoding with reverse channel message management |
| CN107113441B (en) * | 2016-12-30 | 2019-07-26 | 深圳市大疆创新科技有限公司 | Image processing method, device, unmanned vehicle and receiving end |
| CN107113441A (en) * | 2016-12-30 | 2017-08-29 | 深圳市大疆创新科技有限公司 | Image processing method, device, unmanned vehicle and receiving terminal |
| US10911750B2 (en) | 2016-12-30 | 2021-02-02 | SZ DJI Technology Co., Ltd. | System and methods for feedback-based data transmission |
| US10924745B2 (en) | 2016-12-30 | 2021-02-16 | SZ DJI Technology Co., Ltd. | Image processing method and device |
| US11070732B2 (en) | 2016-12-30 | 2021-07-20 | SZ DJI Technology Co., Ltd. | Method for image processing, device, unmanned aerial vehicle, and receiver |
| CN111600774A (en) * | 2020-05-13 | 2020-08-28 | 北京奇艺世纪科技有限公司 | Consumption delay determination method, system, device, equipment and readable storage medium |
| CN114051164A (en) * | 2021-11-16 | 2022-02-15 | 重庆紫光华山智安科技有限公司 | Decoding abnormal code stream generation method and device, electronic equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101207823A (en) | Method for video encoding of video frequency corresponding synthesis anti-code error | |
| CN100558168C (en) | The method and apparatus that generates coded picture data and coded picture data is decoded | |
| CN102137263B (en) | Distributed video coding and decoding methods based on classification of key frames of correlation noise model (CNM) | |
| CN102656890B (en) | For the method and apparatus of Video coding | |
| CN101248669B (en) | Apparatus and method for encoding and decoding multi-view video | |
| JPS63121372A (en) | Hybrid coding system for moving image signal | |
| CN102934434A (en) | Method and apparatus of temporal motion vector prediction | |
| CN101304538B (en) | Method for detecting and shielding error of AVS video decode | |
| CN101379816A (en) | Temporal error concealment for bi-directionally predicted frames | |
| CN101163250B (en) | Boundary gradient based video stream fault tolerance method | |
| CN103262543A (en) | Concealment of data loss for video decoding | |
| KR19990074806A (en) | Texture Padding Apparatus and its Padding Method for Motion Estimation in Parallel Coding | |
| CN108632616A (en) | A method of interframe weight estimation is done based on reference mass | |
| CN101355708A (en) | Self-adapting method for shielding error code | |
| CN101242540B (en) | Error control method for video decoder chip | |
| CN101188772A (en) | A method for hiding time domain error in video decoding | |
| CN1269359C (en) | Video error blanketing method based on motion vector extrapolation and motion vector search | |
| CN104219530A (en) | HEVC multiple-description coding scheme based on prediction mode copying | |
| CN101783956A (en) | Back-prediction forecast method based on spatio-temporal neighbor information | |
| CN101175217A (en) | Code error shielding technology aiming at mobile network video transmission | |
| CN102111622B (en) | Method and device for concealing time domain errors of video images | |
| Lee et al. | A temporal error concealment method for MPEG coded video using a multi-frame boundary matching algorithm | |
| KR100587274B1 (en) | method for concealing error in MPEG-2 decompression system | |
| CN100370836C (en) | Motion forecast method based on rate-distortion optimization | |
| CN100409689C (en) | Error covering method for improving video frequency quality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20080625 |