CN105245908B - A kind of video fault-tolerant coding method based on error correction preferred value feedback - Google Patents
A kind of video fault-tolerant coding method based on error correction preferred value feedback Download PDFInfo
- Publication number
- CN105245908B CN105245908B CN201510712171.1A CN201510712171A CN105245908B CN 105245908 B CN105245908 B CN 105245908B CN 201510712171 A CN201510712171 A CN 201510712171A CN 105245908 B CN105245908 B CN 105245908B
- Authority
- CN
- China
- Prior art keywords
- macro block
- value
- macro
- frame
- error correction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a kind of video fault-tolerant coding methods based on error correction preferred value feedback, include the following steps：S100. the frame image in the sequence of frames of video after coding is decoded, determines to lose with the presence or absence of macro block in frame；The position that macro block is lost in sequence of frames of video is counted, generation macro block loses number aggregate-value, and then generation error corrects preferred value, and error correction preferred value loses number aggregate-value for macro block at this time；S200. obtain and add up the frame difference value of each macro block position in sequence of frames of video；Summation of the frame difference value for current macro and the absolute value of the difference of the pixel value of same position macro block in reference frame；S300. the weighted difference aggregate-value of each macro block position is calculated according to the frame difference value of error correction preferred value and each macro block position, when weighted difference aggregate-value is more than given threshold, when next frame image encodes, carries out error correction；S400. by after refreshing macrob locks, bit stream to decoder is completed to repair.
Description
Technical field
The present invention relates to a kind of video fault-tolerant coding method more particularly to a kind of regarding based on error correction preferred value feedback
Frequency fault-tolerant coding method is united.It is related to Patent classificating number H04 electrical communication technology H04N Image Communications, such as TV H04N7/00 TVs system
The H04N7/24 that unites is reduced using the system H04N7/26 of pulse code modulation transmitting television signals using bandwidth.
Background technology
With developing in depth and breadth for the computer and network communication technology, simple text has been unable to meet the demand of people, rich
The video of rich information content gradually comes into people's daily life, becomes indispensable part.Limited network transmission bandwidth
The video original data compression huge to data volume is required, therefore video coding and decoding technology has become with standard with storage size
For part highly important in multimedia application.Existing video encoding and decoding standard relies on the integrality of code stream.If it is passed in network
Occur mistake during defeated and may result in decoding viewing quality decline, influence user experience.Therefore, enhance code in Video coding
Stream resists the ability of mistake, improves the fault-tolerance of code stream, very necessary.In order to make full use of video system configuration, particularly compile
The corresponding matching of code device and decoder, it is a very effective mechanism that decoded information, which is fed back in encoder,.Pass through these
The feedback of useful information, encoder can be completed more accurately to calculate or handle.For example, the packet loss in feedback information can be effective
Encoder is helped to consider the information of real network situation.Though the existing method for carrying out fault-tolerant encoding using decoding feedback mechanism obtains
Certain effect, but still there are problems that.Certain methods based on feedback do not account for the effect of Fault recovery, this is
A kind of common algorithm of decoder, it is possible to reduce influence of the mistake code stream to final image quality.Certain methods are in feedback information
Reliable timely transmission on it is more demanding.In addition, the computation complexity of certain methods is high, practical application difficulty is big.
Invention content
The it is proposed of the present invention in view of the above problems, and a kind of video error tolerance based on error correction preferred value feedback developed
Coding method includes the following steps：
S100. the frame image in the sequence of frames of video after coding is decoded, determines to lose with the presence or absence of macro block in frame
It loses；The position that macro block is lost in sequence of frames of video is counted, generation macro block loses number aggregate-value Num (x, y, n), and then generates wrong
Accidentally correct preferred value PEC(x, y, n), wherein x, y are coordinate of the macro block in frame image, and n is the serial number of frame image where macro block,
Error correction preferred value loses number aggregate-value for macro block at this time；
S200. obtain and add up the frame difference value D of each macro block position in sequence of frames of videoacc；The frame difference value is
The summation of current macro and the absolute value of the difference of the pixel value of same position macro block in reference frame；
S300. each macro block position is calculated according to the frame difference value of the error correction preferred value and each macro block position
When weighted difference aggregate-value is more than given threshold, when next frame image encodes, it is macro to refresh this for the weighted difference aggregate-value put
Block position carries out error correction；
S400. by after refreshing macrob locks, bit stream to decoder completes the reparation of next frame image, repeats above-mentioned step
Suddenly, until sequence of frames of video coding and decoding all terminates.
Macro block loss number aggregate-value Num is generated in the step S100 to specifically comprise the following steps：
S101. it is to numerical value of the coordinate in n-th frame in video for the accumulative loss number of the macro block position of (x, y)：
Because for all macro blocks all using intraframe coding, the initial value of all Num is 0 in first frame.In above-mentioned expression formula altogether
There are three conditions for meter：
A. represent that Num values should be in the macro block of previous frame recording if decoder judges current macro to lose macro block
Add 1 on the basis of loss number aggregate-value.
B. represent that the value of Num variables resets to 0 if current macro is the frame mode coded macroblocks being properly received；
Because the cumulative error of the macro block position has been eliminated at this time.
C. the Num values of other macro block positions for not meeting above-mentioned two condition remain unchanged, this part is usually
The coded in inter mode macro block being properly received.
As preferred embodiment, the step S100 further includes step：
S110. the accumulative decoded residual value of each macro block position in frame image is calculated：
In above formula, coeff represents the decoded each pixel of n-th frame for the pixel value difference compensated in interframe or frame, i
Represent pixel in the macro transverse and longitudinal coordinate in the block respectively with j；
The value range of the coeff values is positive and negative values, therefore characterizes amplitude using the calculating of absolute value；
Three conditions have been co-expressed in formula.
A. if decoder judges current macro block to lose macro block, ResaccValue remains unchanged；
B. if current macro is the frame mode coded macroblocks being properly received, ResaccValue be 0；
If c is not belonging to the Res of the macro block position of the situation of a and baccIt is worth exhausted for current macro all pixels decoded residual
To the sum of value along with former frame is the same as the Res of positionaccValue；
At this point, the error correction preferred value is：
PEC(x, y, n)=Num (x, y, n)α×RESacc(x,y,n)β
In formula, α and β are empirical parameter value.
Further, the step S100 further includes step：
Periphery macro block position Reliability Index CI (u, v) when S120. by calculating each macro block position progress Fault recovery
With the recovery motion vector complexity C of each macro block positionMV(x, y, n) obtains the Fault recovery that macro block position is lost in frame image
Complexity CECA(x,y,n)；
At this point, the error correction preferred value is
PEC(x, y, n)=Num (x, y, n)α×RESacc(x,y,n)β×CECA(x,y,n)。
Further, the periphery macro block position Reliability Index calculating process is as follows：
Wherein, u and v represents the transverse and longitudinal coordinate of current macro, and CI (x, y) is the reliability of the periphery macro block of current macro
Index；Current macro at most has 8 periphery macro blocks, then the Reliability Index of periphery macro block is：
Unavailable macro block in above formula refers in image border or not yet decoded macro block information, these information without
Method, using the Fault recovery for being used for carrying out current macro, is denoted as 0 by current macro.
Further, the recovery motion vector complexity CMV(x, y, n) includes：Restore motion vector intensity and extensive
Multiple motion vector difference degree；
A child partition of macro block is defined in the recovery motion vector that the coordinate of interior macroblocks is (s, t), the then child partition
Intensity is：
Wherein, MV0 and MV1 is respectively to predict that is obtained restores value of the motion vector in transverse and longitudinal coordinate direction；For losing
Macro block, error resilience algorithms start, which may not be 0；For other macro blocks, because not starting error resilience algorithms, institute
With value for 0；The recovery motion vector intensity of current macro is：
μ in formula represents the weighting parameters of one child partition of macro block, which depends on the face that the child partition accounts for entire macro block
The ratio between product；
Restore motion vector difference degree MSDFor each child partition I in a macro blockECStandard deviation；
The recovery motion vector complexity of one macro block is；
CMV(x, y, n)=IECMB(x,y,n)×MSD(x,y,n)
Each the Fault recovery complexity of macro block position is：
The complexity is added up, with the cumulative effects of error before reaction：
Three conditions, C are contained in above formulaECAFor the cumulative of current macroblock position Fault recovery complexity.
A. if decoder judges that current macro to lose macro block, starts error resilience algorithms at this time；CECAValue need exist
Added up on the basis of former frame；
B. if current macro is the frame mode coded macroblocks being properly received, by CECAValue resets to 0, removes accumulative；
C. if not meeting the condition of a and b, the C of other macro block positionsECAValue remains unchanged, this part is usually correct
The coded in inter mode macro block of reception.
Description of the drawings
For the clearer technical solution for illustrating the embodiment of the present invention or the prior art, to embodiment or will show below
Have technology describe needed in attached drawing do one and simply introduce, it should be apparent that, the accompanying drawings in the following description is only
Some embodiments of the present invention for those of ordinary skill in the art, without creative efforts, may be used also
To obtain other attached drawings according to these attached drawings.
Fig. 1 is the flow chart of the present invention；
Fig. 2 is the PSNR result schematic diagrams of Hall alignments test
Specific embodiment
Purpose, technical scheme and advantage to make the embodiment of the present invention are clearer, with reference to the embodiment of the present invention
In attached drawing, the technical solution in the embodiment of the present invention is clearly completely described：
As shown in Figure 1：A kind of video fault-tolerant coding method based on error correction preferred value feedback, it is main to include following step
Suddenly：
(1) Video Decoders receive the code stream of a frame image and are decoded：
The first frame image of entire video sequence is decoded by encoder coded transmission to decoder, and the frame is using usually side
Formula encodes.The fault-tolerant encoding mode of subsequent each frame is true by the calculating of the decoding feedback information based on former frame and coding itself
Determine, all multi informations that normal encoding generates in the process with decoding will be used in the calculating of the present invention, avoid more remove and solve
Location information is lost during code, decoded residual value, restores the incremental computations of the parameters such as motion vector, therefore this hair can be improved
Bright computational efficiency.
(2) is counted and is added up the loss number of each macro block position.
Since the present invention is applied in the scene of unreliable video code flow transmission, it will appear certain in decoding process
The phenomenon that a or certain macro blocks are lost.
Form regulation of the decoder based on code stream in video standard judges which macro block is lost, then to this portion
Point, that is, the macro block information lost is counted, and carries out accumulative meter to including normal transmission macro block and losing the position of macro block
It calculates, aggregate-value is Num in the present embodiment.
If aggregate-value Num is larger, mean that the macro block position needs preferentially to carry out mistake in subsequent coding to repair
Just.
It is to numerical value of the coordinate in n-th frame in video for the accumulative loss number of the macro block position of (x, y)：
Because there is no the reference frame of first frame in sequence of frames of video, therefore all macro blocks of first frame are all compiled using in frame
Code, the initial value of all Num is 0.Condition there are three amounting in above-mentioned expression formula：
A. represent that Num values should be in the macro block of previous frame recording if decoder judges current macro to lose macro block
Add 1 on the basis of loss number aggregate-value.
B. represent that the value of Num variables resets to 0 if current macro is the frame mode coded macroblocks being properly received；
Because the cumulative error of the macro block position has been eliminated at this time.
C. the Num values of other macro block positions for not meeting above-mentioned two condition remain unchanged, this part is usually
The coded in inter mode macro block being properly received.
(3) add up the decoded residual value of each macro block position.
Decoded residual value in this patent refers to that decoder carries out required information during compensation in interframe or frame, which needs
It to be obtained from correct decoded bit stream.
The purpose for adding up the decoded residual value of each macro block position is the complexity in order to calculate its Fault recovery.When accumulative
Decoded residual value when being more than certain numberical range, show that the Fault recovery that the macro block position carried out when losing is transported
The error of dynamic compensation is larger, i.e. Fault recovery complexity is also larger, i.e., the complexity cost of Fault recovery is also very big, so at this time
The macro block position should preferentially carry out error correction in subsequent coding.
The accumulative decoded residual value of current macroblock position is：
In above formula, coeff represents the decoded each pixel of n-th frame for the pixel value difference compensated in interframe or frame, i
Represent pixel in the macro transverse and longitudinal coordinate in the block respectively with j.
The value range of the coeff values is positive and negative values, therefore characterizes amplitude using the calculating of absolute value.
Three conditions have been co-expressed in formula.
A. if decoder judges current macro block to lose macro block, ResaccValue remains unchanged；
B. if current macro is the frame mode coded macroblocks being properly received, ResaccValue be 0；
If c is not belonging to the Res of the macro block position of the situation of a and caccIt is worth exhausted for current macro all pixels decoded residual
To the sum of value along with former frame is the same as the Res of positionaccValue, this part are usually the coded macroblocks of inter-frame mode being properly received.
(4) calculate each macro block carry out Fault recovery (when) periphery macro block Reliability Index.
In most decoding error restoring algorithms, the reliability of periphery macro block is most important, is current erroneous macroblock
Carry out the Main Basiss of Fault recovery.The present embodiment is based on current macroblock position (including normal transmission macro block and losing macro block)
Periphery macro block be properly received number and periphery macro block adds up to lose two aspects of number and carries out periphery macro block Reliability Indexes
It calculates：
Wherein, u and v represents the transverse and longitudinal coordinate of current macro, and CI (x, y) is the reliability of the periphery macro block of current macro
Index.Current macro at most has 8 periphery macro blocks, and the accumulated value of these periphery macro block reliabilitys is calculated to be worked as in the present invention
It the periphery of preceding macro block can aperture index.The reliability of single periphery macro block is：
The unavailable macro block in expression formula refers in image border or not yet decoded macro block information above, these
Information can not be by current macro using being used for carrying out the Fault recovery of current macro, therefore be denoted as 0.
The reliability of other normal macro blocks is based primarily upon the Num values and is calculated.Num values are bigger, and the macro block is reliable
Degree is lower, conversely, reliability is higher.Common, if the CI values of all macro blocks in periphery are 0, the CI values of current macro are
0.5,0.5 is individually sets, reason：The value cannot be 0 (to do denominator below), and is unable to reliability (reliability should be higher than 1
Lower value), therefore use this empirical value..
(5) calculates the complexity for the recovery motion vector for losing macro block.
Restoring motion vector in invention refers to the error resilience algorithms prediction generation of decoder for the fortune of motion compensation
Dynamic vector.
In an embodiment of the present invention, recovery motion vector complexity is estimated to calculate based on two parameters：1 is restores fortune
Dynamic vector intensity, 2 is restore motion vector difference degree.
If restored, motion vector value is bigger, illustrates that the possibility of Fault recovery generation large error is higher；And if
The value is smaller by even 0 (to be replicated reference frame and corresponds to the pixel value of macro block, pixel value here refers to decoder for ought
The loss macro block of previous frame removes the pixel value of copy former frame corresponding position macro block, to restore the pixel of the loss macro block of present frame
Value), then the possibility of error recovery procedure (ERP) generation large error is relatively low.If one child partition of macro block is in the coordinate of interior macroblocks
(s, t), then the recovery motion vector intensity of the child partition be：
Wherein, MV0 and MV1 is respectively to predict that is obtained restores value of the motion vector in transverse and longitudinal coordinate direction.For losing
Macro block, error resilience algorithms start, which may not be 0；For other macro blocks, because not starting error resilience algorithms, institute
With value for 0.The recovery motion vector intensity of current macro is：
μ in formula represents the weighting parameters of one child partition of macro block, which depends on the face that the child partition accounts for entire macro block
The ratio between product.Such as：Weighting parameters value corresponding to the child partition of 8 × 4 pixels is 0.125, because it accounts for macro block area
12.5%.
And the recovery motion vector difference degree can be reflected in the difficulty that interior macroblocks carry out Fault recovery, Hen Duogao
The error resilience algorithms of quality can all use child partition to carry out restoration and compensation.
In an embodiment of the present invention, restore motion vector difference degree MSDFor each child partition I in a macro blockECThe mark of value
It is accurate poor.
Thus the recovery motion vector complexity of one macro block obtains：
CMV(x, y, n)=IECMB(x,y,n)×MSD(x,y,n)
(6) calculate and add up the Fault recovery complexity of each macro block position.
According to the above-mentioned periphery macro block Reliability Index being calculated and restore motion vector complexity, obtain each macro block
The Fault recovery complexity of position is：
The complexity is added up, with the cumulative effects of error before reaction：
Three conditions, C are contained in above formulaECAFor the cumulative of current macroblock position Fault recovery complexity.
A. if decoder judges that current macro to lose macro block, starts error resilience algorithms at this time；CECAValue need exist
Added up on the basis of former frame；
B. if current macro is the frame mode coded macroblocks being properly received, by CECAValue resets to 0, removes accumulative；
C. if not meeting the condition of a and b, the C of other macro block positionsECAValue remains unchanged, this part is usually correct
The coded in inter mode macro block of reception.
(7) calculates each macro block position according to the loss time numerical value, decoded residual value and Fault recovery complexity
Error correction preferred value, and feed back to encoder.
Error correction preferred value is：
PEC(x, y, n)=Num (x, y, n)α×RESacc(x,y,n)β×CECA(x,y,n)
Wherein α and β is empirical parameter value, for adjusting the numerical relation of each variable in expression formula.Error correction is preferential
It is worth high macro block position needs in next code process priority error amendment, common, preferred value height means to have accumulated which
More decoding error, practical decoding quality are relatively low.In the present embodiment, α values 0.3, β value ranges are between 0.1-0.4.
Further, it analyzes after tested, the P of most macro block positionsECBe worth be 0 or one close to 0 numerical value, it is only few
The P of number macro block positionECIt is worth larger.Thus, the information that encoder is fed back in the present invention only includes those PECIt is worth larger (not small
In 5, the Parameter adjustable section) macro block position coordinate and PECValue, to reduce the data volume of feedback channel.It is not received by decoding
The P of device feedbackECThe macro block position of value, encoder should regard its PECIt is 1 to be worth, i.e., does not influence itself calculating process of encoder, is reduced
The calculation amount of encoder.
(8) video encoder adds up according to the feedback information, i.e., described error correction preferred value and frame difference
Macro block updating quantity and position is calculated in value.
The preferential value information of error correction of encoder Rcv decoder feedback, is carried out at the same time the calculating of encoder itself, with
Determine quantity and the position of macro block updating.
In the present embodiment, encoder calculates the frame difference aggregate-value of each macro block position.Frame difference refers to current macro
With the summation (being denoted as D) of the difference (absolute value) of position macro block pixels value in block and reference frame.So, the interframe of each macro block position
Difference aggregate-value is：
Wherein, n0Refer to the macro block position, the last time carries out the frame number of that frame after macro block updating.DaccIt is worth larger
When imply the macro block position once in decoding lose can generate larger cumulative error, fault-tolerant processing should be carried out.
The weighted difference aggregate-value of one macro block position is：
DWA(x, y, n)=p (n) × PEC(x,y,n)×Dacc(x,y,n)
Wherein p is packet loss, can also be obtained from decoding feedback information.
When weighted difference aggregate-value is higher than a certain threshold value T, then the macro block position should carry out macro block updating in the next frame,
To carry out error correction.
As described in previous step, it is not received by the P of decoder feedbackECThe macro block position of value, encoder regard its PECIt is worth and is
1, i.e., itself calculating process of encoder is not influenced.It means that the feedback mechanism of the present invention has stronger flexibility, i.e.,
Encoder calculating and macro block updating can be also normally carried out when feedback involves a delay or loses.
Meanwhile the error correction preferred value of decoder feedback can be not only used for macro block updating method in the present invention, also may be used
For other error resilience tools, because which kind of tool to be required for understanding the practical decoding quality of decoder regardless of.
(9) it according to above-mentioned result of calculation, carries out the coding of next frame and by bit stream to decoder, then constantly follows
Ring, until coding and decoding all terminates.
Experiment effect：Hall sequences are encoded using the method for the present invention (PRO), transmit (containing feedback) and decoding.With
Do not use feedback mechanism of the present invention method (only calculated in encoder, the PEC values of all macro block positions be set to 1) into
Row comparison (control methods is denoted as ENC),
Control methods is does not use feedback mechanism proposed by the present invention, remaining completely the same method is (when encoder calculates
The P of all macro block positionsECValue is set to 1, i.e. the feedback information of decoder cuts little ice).It can be seen that feedback mechanism
Validity.Test design parameter：Experiment basis code JM (H.264/AVC Reference Software JM15.1:
http://iphome.hhi.de/suehring/tml/download/old_jm/), packet loss 4%, 7% and 10%, code
Rate 400kbps, I frame (i.e. all with the frame of intraframe coding) are spaced 100 frames, 25 frames of frame per second/second.
The results are shown in Figure 2 by the PSNR of decoding video (packet loss 4%, 7% and 10%, code check 400kbps).From figure
It can be seen that the present invention can improve quality 0.1dB-0.73dB compared to ENC methods, preferable fault-tolerant effect is achieved.
The foregoing is only a preferred embodiment of the present invention, but protection scope of the present invention be not limited thereto,
Any one skilled in the art in the technical scope disclosed by the present invention, according to the technique and scheme of the present invention and its
Inventive concept is subject to equivalent substitution or change, should be covered by the protection scope of the present invention.
Claims (6)
1. a kind of video fault-tolerant coding method based on error correction preferred value feedback, it is characterised in that include the following steps：
S100. the frame image in the sequence of frames of video after coding is decoded, determines that the frame is lost with the presence or absence of macro block；System
The position that macro block is lost in sequence of frames of video is counted, generation macro block loses number aggregate-value Num (x, y, n), and then generation error is repaiied
Positive preferred value PEC(x, y, n), wherein x, y are coordinate of the macro block in a frame image, and n is the serial number of frame image where macro block, this
When error correction preferred value lose number aggregate-value for macro block；
S200. obtain and add up the frame difference value D of each macro block position in sequence of frames of videoacc；The frame difference value is current
The absolute value of the difference summation of macro block and the pixel value of same position macro block in reference frame；
S300. each macro block position is calculated according to the frame difference aggregate-value of the error correction preferred value and each macro block position
When weighted difference aggregate-value is more than given threshold, when next frame image encodes, it is macro to refresh this for the weighted difference aggregate-value put
Block position carries out error correction；
S400. the bit stream after refreshing macrob locks to decoder is decoded, completes the reparation of next frame image, repeat above-mentioned step
Suddenly, until sequence of frames of video coding and decoding all terminates.
2. a kind of video fault-tolerant coding method based on error correction preferred value feedback according to claim 1, feature
Generation macro block loss number aggregate-value Num in the step S100 is also resided in specifically comprise the following steps：
S101. it is to numerical value of the coordinate in n-th frame in video for the accumulative loss number of the macro block position of (x, y)：
For all macro blocks all using intraframe coding, the initial value of all Num is 0 in first frame, amount in above-mentioned expression formula there are three
Condition：
A. it represents if decoder judges that current macro should lose to lose macro block, Num values in the macro block of previous frame recording
Add 1 on the basis of number aggregate-value；
B. represent that the value of Num variables resets to 0 if current macro is the frame mode coded macroblocks being properly received；Because
The cumulative error of the macro block position has been eliminated at this time；
C. the Num values of other macro block positions for not meeting above-mentioned two condition remain unchanged, and do not meet above-mentioned two condition
Other macro block positions the coded in inter mode macro block that has usually been properly received of Num values.
3. a kind of video fault-tolerant coding method based on error correction preferred value feedback according to claim 1, feature
It also resides in the step S100 and further includes step：
S110. the accumulative decoded residual value of each macro block position in a frame image is calculated：
In above formula, coeff represents the decoded each pixel of n-th frame for the pixel value difference compensated in interframe or frame, i and j
Represent pixel in the macro transverse and longitudinal coordinate in the block respectively；
The value range of the coeff values is positive and negative values, therefore characterizes amplitude using the calculating of absolute value；
Three conditions have been co-expressed in formula：
A. if decoder judges current macro block to lose macro block, ResaccValue remains unchanged；
B. if current macro is the frame mode coded macroblocks being properly received, ResaccValue be 0；
If c is not belonging to the Res of the macro block position of the situation of a and baccIt is worth for current macro all pixels decoded residual absolute value
The sum of along with former frame with position ResaccValue；
At this point, the error correction preferred value is：
PEC(x, y, n)=Num (x, y, n)α×RESacc(x,y,n)β
In formula, α and β are empirical parameter value.
4. a kind of video fault-tolerant coding method based on error correction preferred value feedback according to claim 3, feature
It also resides in the step S100 and further includes step：
Periphery macro block position Reliability Index CI (u, v) and every when S120. carrying out Fault recovery by calculating each macro block position
The recovery motion vector complexity C of a macro block positionMV(x, y, n) obtains the Fault recovery complexity that macro block position is lost in frame image
Spend CECA(x,y,n)；
At this point, the error correction preferred value is
PEC(x, y, n)=Num (x, y, n)α×RESacc(x,y,n)β×CECA(x,y,n)。
5. a kind of video fault-tolerant coding method based on error correction preferred value feedback according to claim 4, feature
It is as follows to also reside in the periphery macro block position Reliability Index calculating process：
Wherein, u and v represents the transverse and longitudinal coordinate of current macro, and CI (x, y) is that the reliability of the periphery macro block of current macro refers to
Number；Current macro at most has 8 periphery macro blocks, then the Reliability Index of periphery macro block is：
Unavailable macro block in above formula refers in image border or not yet decoded macro block information, these information can not be by
Current macro is used for carrying out the Fault recovery of current macro, is denoted as 0.
6. a kind of video fault-tolerant coding method based on error correction preferred value feedback according to claim 4, feature
Also reside in the recovery motion vector complexity CMV(x, y, n) includes：Restore motion vector intensity and restore motion vector difference
Different degree；
A child partition of macro block is defined in the recovery motion vector intensity that the coordinate of interior macroblocks is (s, t), the then child partition
For：
Wherein, MV0 and MV1 is respectively to predict that is obtained restores value of the motion vector in transverse and longitudinal coordinate direction；For losing macro block,
Error resilience algorithms start, which is 0 or is not 0；For other macro blocks, because not starting error resilience algorithms, value
It is 0；The recovery motion vector intensity of current macro is：
μ in formula represents the weighting parameters of one child partition of macro block, and the values of weighting parameters accounts for entire macro block depending on the child partition
Area ratio；
Restore motion vector difference degree MSDFor each child partition I in a macro blockECStandard deviation；
The recovery motion vector complexity of one macro block is；
CMV(x, y, n)=IECMB(x,y,n)×MSD(x,y,n)
Each the Fault recovery complexity of macro block position is：
The complexity is added up, with the cumulative effects of error before reaction：
Three conditions, C are contained in above formulaECAFor the cumulative of current macroblock position Fault recovery complexity；
A. if decoder judges that current macro to lose macro block, starts error resilience algorithms at this time；CECAValue need previous
Added up on the basis of frame；
B. if current macro is the frame mode coded macroblocks being properly received, by CECAValue resets to 0, removes accumulative；
C. if not meeting the condition of a and b, the C of other macro block positionsECAValue remains unchanged, and does not meet above-mentioned two condition
The Num values of other macro block positions are usually the coded in inter mode macro block being properly received.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510712171.1A CN105245908B (en) | 2015-10-27 | 2015-10-27 | A kind of video fault-tolerant coding method based on error correction preferred value feedback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510712171.1A CN105245908B (en) | 2015-10-27 | 2015-10-27 | A kind of video fault-tolerant coding method based on error correction preferred value feedback |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105245908A CN105245908A (en) | 2016-01-13 |
| CN105245908B true CN105245908B (en) | 2018-06-29 |
Family
ID=55043351
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510712171.1A Expired - Fee Related CN105245908B (en) | 2015-10-27 | 2015-10-27 | A kind of video fault-tolerant coding method based on error correction preferred value feedback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105245908B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6141486A (en) * | 1993-01-13 | 2000-10-31 | Hitachi America, Ltd. | Methods and apparatus for recording digital data including sync block and track number information for use during trick play operation |
| CN101009838A (en) * | 2006-01-25 | 2007-08-01 | 松下电器产业株式会社 | Bit rate conversion coding method, conversion encoder, and integrated circuit capable of restraining drift error |
| CN101207823A (en) * | 2007-11-22 | 2008-06-25 | 武汉大学 | Method for video encoding of video frequency corresponding synthesis anti-code error |
| CN102026001A (en) * | 2011-01-06 | 2011-04-20 | 西安电子科技大学 | Method for evaluating importance of video frame based on motion information |
| CN102547282A (en) * | 2011-12-29 | 2012-07-04 | 中国科学技术大学 | Extensible video coding error hiding method, decoder and system |
| CN103152581A (en) * | 2013-03-15 | 2013-06-12 | 浙江大学 | Error concealment method of space-domain MDC (Multiple Description Coding) |
| CN104410864A (en) * | 2014-11-07 | 2015-03-11 | 太原科技大学 | Residual energy-based error hiding method in HEVC (High Efficiency Video Coding) |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004532540A (en) * | 2001-03-05 | 2004-10-21 | インタービデオインコーポレイテッド | System and method for error resilient coding |
-
2015
- 2015-10-27 CN CN201510712171.1A patent/CN105245908B/en not_active Expired - Fee Related
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6141486A (en) * | 1993-01-13 | 2000-10-31 | Hitachi America, Ltd. | Methods and apparatus for recording digital data including sync block and track number information for use during trick play operation |
| CN101009838A (en) * | 2006-01-25 | 2007-08-01 | 松下电器产业株式会社 | Bit rate conversion coding method, conversion encoder, and integrated circuit capable of restraining drift error |
| CN101207823A (en) * | 2007-11-22 | 2008-06-25 | 武汉大学 | Method for video encoding of video frequency corresponding synthesis anti-code error |
| CN102026001A (en) * | 2011-01-06 | 2011-04-20 | 西安电子科技大学 | Method for evaluating importance of video frame based on motion information |
| CN102547282A (en) * | 2011-12-29 | 2012-07-04 | 中国科学技术大学 | Extensible video coding error hiding method, decoder and system |
| CN103152581A (en) * | 2013-03-15 | 2013-06-12 | 浙江大学 | Error concealment method of space-domain MDC (Multiple Description Coding) |
| CN104410864A (en) * | 2014-11-07 | 2015-03-11 | 太原科技大学 | Residual energy-based error hiding method in HEVC (High Efficiency Video Coding) |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105245908A (en) | 2016-01-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8856624B1 (en) | Method and apparatus for dynamically generating error correction | |
| US10334289B2 (en) | Efficient approach to dynamic frame size and frame rate adaptation | |
| KR101287458B1 (en) | Multi-view image encoding method, multi-view image decoding method, multi-view image encoding device, multi-view image decoding device, multi-view image encoding program, and multi-view image decoding program | |
| US8872895B2 (en) | Real-time video coding using graphics rendering contexts | |
| US8798144B2 (en) | System and method for determining encoding parameters | |
| US9912714B2 (en) | Sending 3D image with first video image and macroblocks in the second video image | |
| CN103152576B (en) | A kind of it is applicable to the anti-dropout Video coding of multicast and decoding apparatus | |
| CN113573101B (en) | Video coding method, device, equipment and storage medium | |
| CN108012149B (en) | Code rate control method in video coding | |
| US8411743B2 (en) | Encoding/decoding system using feedback | |
| JP2004312709A (en) | Apparatus and method for correcting block error in image frame | |
| US20100023837A1 (en) | Transmitting apparatus, transmitting method, and program | |
| JP5030179B2 (en) | Video coding | |
| CN101895753B (en) | Network congestion degree based video transmission method, system and device | |
| CN102740081B (en) | Method for controlling transmission errors of multiview video based on distributed coding technology | |
| US10469824B2 (en) | Hybrid digital-analog coding of stereo video | |
| CN105245908B (en) | A kind of video fault-tolerant coding method based on error correction preferred value feedback | |
| US20130028325A1 (en) | Method and device for error concealment in motion estimation of video data | |
| US20130016775A1 (en) | Video Encoding Using Visual Quality Feedback | |
| JP2006339775A (en) | Scalable moving picture transmission system | |
| CN106937168B (en) | Video coding method, electronic equipment and system using long-term reference frame | |
| Zhou et al. | A new feedback-based intra refresh method for robust video coding | |
| US20140289369A1 (en) | Cloud-based system for flash content streaming | |
| US20110182343A1 (en) | Encoder | |
| US11140407B2 (en) | Frame boundary artifacts removal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180629 Termination date: 20191027 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |