CN105681809A - Motion compensation method for double-forward prediction unit - Google Patents

Motion compensation method for double-forward prediction unit Download PDF

Info

Publication number
CN105681809A
CN105681809A CN201610091950.9A CN201610091950A CN105681809A CN 105681809 A CN105681809 A CN 105681809A CN 201610091950 A CN201610091950 A CN 201610091950A CN 105681809 A CN105681809 A CN 105681809A
Authority
CN
China
Prior art keywords
pixel
double
predicted picture
motion compensation
prediction unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610091950.9A
Other languages
Chinese (zh)
Other versions
CN105681809B (en
Inventor
马思伟
赵磊
张健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Peking University
Original Assignee
Peking University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University filed Critical Peking University
Priority to CN201610091950.9A priority Critical patent/CN105681809B/en
Publication of CN105681809A publication Critical patent/CN105681809A/en
Application granted granted Critical
Publication of CN105681809B publication Critical patent/CN105681809B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/573Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H04N19/615Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding using motion compensated temporal filtering [MCTF]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The embodiment of the invention provides a motion compensation method for a double-forward prediction unit. The method mainly comprises following steps of obtaining two initial double-forward prediction image blocks for predicting a current image block; selecting pixels on the two initial double-forward prediction image blocks; utilizing a gradient calculation formula to calculate x direction and y direction derivatives of the pixels on the forward prediction image blocks; through adoption of a training window, calculating the offset values of the pixels on the forward prediction image blocks; and adjusting the positions of the pixels on the forward prediction image blocks according to the x direction and y direction derivatives and the offset values of the pixels on the forward prediction image blocks. According to the motion compensation method for the double-forward prediction unit provided by the embodiment of the invention, the prediction effects of the prediction image block can be further improved on the basis of not increasing a code rate; the accuracies of prediction image blocks are improved; therefore, the prediction quality of the current image block is improved; and the coding efficiency of the double-forward prediction unit is improved.

Description

Motion compensation process for double; two forward prediction unit
Technical field
The present invention relates to technical field of video coding, particularly relate to a kind of motion compensation process for double; two forward prediction unit.
Background technology
Along with the extensive use of multimedia technology, and the day by day expansion of multi-medium data, the importance of video coding technique day by day highlights. Modern coding techniques adopts hybrid encoding frame, the process such as including prediction, conversion, quantization and entropy code. Predictive coding includes infra-frame prediction and inter prediction, the former utilizes the encoded image block built of laying equal stress in same two field picture that the image block currently encoded is predicted, and the latter is that the image currently encoded is predicted by the image utilizing encoded other frame laid equal stress on and build. Wherein, inter prediction encoding make use of the temporal correlation of video sequence, eliminates spatial redundancy, is very important link in current video coding framework.
The method introducing double; two forward motion compensation in latest generation video encoding standard (HEVC), under Lowdelay configures, at prediction PU (PredictionUnit, current prediction unit) time, encoder can be searched for and obtain two predicted picture blocks, and using the weighted value of the two predicted picture block as the predictive value of current PU. In the prior art, but without a kind of fine setting that predicted picture block carried out Pixel-level method to promote forecast quality further.
Summary of the invention
The embodiment provides a kind of motion compensation process for double; two forward prediction unit, to improve the accuracy of predicted picture block.
To achieve these goals, this invention takes following technical scheme.
A kind of motion compensation process for double; two forward prediction unit, including:
Obtain two forward-predicted picture blocks for predicting current image block, choose the pixel on said two forward-predicted picture block;
Gradient calculation formula is utilized to calculate x direction and the y directional derivative of pixel on described forward-predicted picture block, by training window to calculate the deviant of the pixel on described forward-predicted picture block;
According to the x direction of the pixel on described forward-predicted picture block, y directional derivative and deviant, the position of the pixel on described forward-predicted picture block is adjusted.
Further, described two the forward-predicted picture blocks obtained for predicting current image block, choose the pixel on said two forward-predicted picture block, including:
Choose the pixel p on said two forward-predicted picture block1[i, j] and p0[i, j], if pixel p0Optimum prediction pixel after the adjustment of [i, j] is p'0[i, j], pixel p'0[i, j] is relative to pixel p0The skew of [i, j] is (vx, vy), if pixel p0Optimum prediction pixel after the adjustment of [i, j] is p'1[i, j], pixel p'1[i, j] is relative to pixel p1The skew of [i, j] is (-vx,-vy);
According to Taylor's single order expansion formula, p'1[i, j] and p'0The estimated value computing formula of [i, j] is as follows:
p'0[i,j]≈p0[i,j]+vx·Ix0+vy·Iy0
p'1[i,j]≈p1[i,j]-vx·Ix1-vy·Iy1
Ix0,Iy0Represent pixel p0The x direction of [i, j] and y directional derivative, Ix1,Iy1Represent pixel p1The x direction of [i, j] and y directional derivative.
Further, the described x direction utilizing gradient calculation formula to calculate pixel on described forward-predicted picture block and y directional derivative, including:
I is calculated by following gradient calculation formulax1,Ix0,Iy1,Iy0:
Ix0=(p0[i+Δ,j]-p0[i-Δ,j])/2
Ix1=(p1[i+Δ,j]-p1[i-Δ,j])/2
Iy0=(p0[i,j+Δ]-p0[i,j-Δ])/2
Iy1=(p1[i,j+Δ]-p1[i,j-Δ])/2
In formula, Δ represents image element interpolation precision set in advance, p0[i+Δ,j]、p0[i-Δ,j]、p1[i+Δ,j]、p1[i-Δ,j]、p0[i,j+Δ]、p0[i,j-Δ]、p1[i,j+Δ]、p1[i, j-Δ] is obtained by DCT interpolation filter interpolation respectively.
Further, the described deviant by training window to calculate the pixel on described forward-predicted picture block, including:
Respectively with pixel p1[i, j] and p0[i, j] certain contiguous range around opens a training window, utilizes method of least square to solve deviant vx,vy
Wherein window training calculate computational methods particularly as follows:
Δ [ i , j ] = p ′ 0 [ i , j ] - p ′ 1 [ i , j ] = ( p 0 [ i , j ] + v x [ i , j ] · I x ( 0 ) [ i , j ] + v y [ i , j ] · I y ( 0 ) [ i , j ] ) - ( p 1 [ i , j ] - v x [ i , j ] · I x ( 1 ) [ i , j ] - v y [ i , j ] · I y ( 1 ) [ i , j ] ) Σ [ i ′ , j ] ∈ Ω Δ 2 [ i , j ] = min .
By windowing, training is askedMinima obtains optimum offset m in, wherein,
v x [ i , j ] = det 1 det , v y [ i , j ] = det 2 det ,
det1=s3s5-s2s6,det2=s1s6-s3s4, det=s1s5-s2s4;
s 1 = Σ Ω ( I x 0 [ i , j ] + I x 1 [ i , j ] ) 2 ,
s 2 = s 4 = Σ Ω ( I x 0 [ i , j ] + I x 1 [ i , j ] ) ( I y 0 [ i , j ] + I y 1 [ i , j ] ) ,
s 3 = - Σ Ω ( P 0 [ i , j ] - P 1 [ i , j ] ) ( I x 0 [ i , j ] + I x 1 [ i , j ] ) ,
s 5 = Σ Ω ( I y 0 [ i , j ] + I y 1 [ i , j ] ) 2 ,
s 6 = - Σ Ω ( P 0 [ i , j ] - P 1 [ i , j ] ) ( I y 0 [ i , j ] + I y 1 [ i , j ] ) .
Further, described according to the x direction of the pixel on described forward-predicted picture block, y directional derivative and deviant, the position of the pixel on described forward-predicted picture block is adjusted, including:
In units of 2x2 pixel, offseting average using the position of adjacent four pixels as overall side-play amount, the position deviant of adjacent 4 pixels is carried out mean filter, mean filter computing formula is as follows:
vx_average=(vx1+vx2+vx3+vx4)/4
vy_average=(vy1+vy2+vy3+vy4)/4
(v in above-mentioned formulaX1,vy1)、(vX2,vy2)、(vx3, vy3)、(vx4, vy4) the position deviant of respectively adjacent four pixels.
According to Taylor's single order expansion formula, after position deviant adjusts, two initial pixel point p1[i, j] and p0[i, j] is adjusted to:
p'0[i,j]≈p0[i,j]+vx_average·Ix0+vy_average·Iy0
p'1[i,j]≈p1[i,j]-vx_average·Ix1-vy_average·Iy1
Further, described method also includes:
The final predictive value of the corresponding pixel points in described current image block is adjusted to:
Ppre[i, j]=(p'1[i,j]+p'0[i,j])/2
RD cost after completing according to adopting the described coding for the current image block after the motion compensation process of double; two forward prediction unit, determines whether to adopt the described motion compensation process for double; two forward prediction unit.
The technical scheme provided by embodiments of the invention described above can be seen that, the motion compensation process for double; two forward prediction unit that the embodiment of the present invention proposes is by Taylor expansion and high-precision gradient calculation process, the predictive value fine setting that furthermore achieved that Pixel-level on the basis of block is predicted at original image, the prediction effect improving predicted picture block on the basis of code check further can not increased, improve the accuracy of predicted picture block, thus improving the forecast quality of current image block, improve the code efficiency of double; two forward prediction unit.
Aspect and advantage that the present invention adds will part provide in the following description, and these will become apparent from the description below, or is recognized by the practice of the present invention.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below the accompanying drawing used required during embodiment is described is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the premise not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
A kind of motion compensation process for double; two forward direction PU that Fig. 1 provides for the embodiment of the present invention realize principle schematic;
The process chart of a kind of motion compensation process for double; two forward direction PU that Fig. 2 provides for the embodiment of the present invention;
Fig. 3 is filtered schematic diagram for the position deviant of a kind of adjacent 4 pixels that the embodiment of the present invention provides.
Detailed description of the invention
Being described below in detail embodiments of the present invention, the example of described embodiment is shown in the drawings, and wherein same or similar label represents same or similar element or has the element of same or like function from start to finish. The embodiment described below with reference to accompanying drawing is illustrative of, and is only used for explaining the present invention, and is not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless expressly stated, and singulative used herein " ", " one ", " described " and " being somebody's turn to do " may also comprise plural form. Should be further understood that, the wording " including " used in the description of the present invention refers to there is described feature, integer, step, operation, element and/or assembly, but it is not excluded that existence or adds other features one or more, integer, step, operation, element, assembly and/or their group. It should be understood that when we claim element to be " connected " or during " coupled " to another element, it can be directly connected or coupled to other elements, or can also there is intermediary element. Additionally, " connection " used herein or " coupling " can include wireless connections or couple. Wording "and/or" used herein includes one or more any cell listing item being associated and all combinations.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (include technical term and scientific terminology) and have with the those of ordinary skill in art of the present invention be commonly understood by identical meaning. Should also be understood that in such as general dictionary, those terms of definition should be understood that have the meaning consistent with the meaning in the context of prior art, and unless defined as here, will not explain by idealization or excessively formal implication.
For ease of the understanding to the embodiment of the present invention, it is further explained explanation below in conjunction with accompanying drawing for several specific embodiments, and each embodiment is not intended that the restriction to the embodiment of the present invention.
The embodiment of the present invention to solve the technical problem that the fine setting being double; two forward-predicted picture blocks carry out Pixel-level is to promote forecast quality further. By Taylor expansion and high-precision gradient calculation process, the embodiment of the present invention predicts the predictive value fine setting that furthermore achieved that Pixel-level on the basis of block at original image, do not increase the prediction effect improving prediction block on the basis of code check further, improve the code efficiency of double; two forward prediction unit.
A kind of motion compensation process for double; two forward direction PU that the embodiment of the present invention provides realize principle schematic as it is shown in figure 1, concrete handling process is as in figure 2 it is shown, include following process step:
Step S210, according to Taylor's single order expansion formula, calculate optimum prediction pixel p'1[i, j] and p'0The estimated value of [i, j].
For double; two forward direction PU, utilizing the search of block-based motion estimation algorithm to obtain for two the initial forward-predicted picture blocks predicting current image block, these two initial forward-predicted picture blocks are all located at before current image block on a timeline.
For the pixel p of correspondence position on two initial forward-predicted picture blocks1[i, j] and p0[i, j], it is assumed that the present invention needs the pixel p solved0Optimum prediction pixel after the adjustment of [i, j] is p'0[i, j], pixel p'0[i, j] is positioned at pixel p0Near [i, j], relative to initial position p0The skew of [i, j] is (vx, vy). Need the pixel p solved1Optimum prediction pixel after the adjustment of [i, j] is p'1[i, j], pixel p'1[i, j] is positioned at pixel p1Near [i, j], relative to home position p1The skew of [i, j] is (-vx,-vy)。
According to Taylor's single order expansion formula, p'1[i, j] and p'0The estimated value of [i, j] is shown below:
p'0[i,j]≈p0[i,j]+vx·Ix0+vy·Iy0
p'1[i,j]≈p1[i,j]-vx·Ix1-vy·Iy1
Ix0,Iy0Represent pixel p0The x direction of [i, j] and y directional derivative, Ix1,Iy1Represent pixel p1The x direction of [i, j] and y directional derivative.
Step S220, calculate derivative value I by gradient calculation formulax1,Ix0,Iy1,Iy0
P' is obtained in order to calculate1[i, j] and p'0[i, j], it is necessary to respectively obtain Ix1,Ix0,Iy1,Iy0, and vx,vy. Obtaining high-precision Grad to calculate, the embodiment of the present invention uses high-precision image element interpolation scheme, calculates I by following gradient calculation formulax1,Ix0,Iy1,Iy0:
Ix0=(p0[i+Δ,j]-p0[i-Δ,j])/2
Ix1=(p1[i+Δ,j]-p1[i-Δ,j])/2
Iy0=(p0[i,j+Δ]-p0[i,j-Δ])/2
Iy1=(p1[i,j+Δ]-p1[i,j-Δ])/2
In formula, Δ represents image element interpolation precision set in advance. Wherein, p0[i+Δ,j]、p0[i-Δ,j]、p1[i+Δ,j]、p1[i-Δ,j]、p0[i,j+Δ]、p0[i,j-Δ]、p1[i,j+Δ]、p1[i, j-Δ] can be obtained by DCT (DiscreteCosineTransform, discrete cosine transform) interpolation filter interpolation respectively.
Utilizing image interpolation method to calculate and obtain 1/12 location of pixels pixel value, this programme uses 8 ladder degree interpolation filters, according to original predictive pixel present position, calculates the position Grad obtaining original predictive pixel, and interpolation filter coefficients is as follows:
Whole location of pixels :-8,19 ,-40,0,43 ,-20,12 ,-6}
1/4 location of pixels :-8,12 ,-16 ,-32,56 ,-16,12 ,-8}
1/2 location of pixels: 0,4,8 ,-52,52 ,-8 ,-4,0}
3/4 location of pixels: 8 ,-12,16 ,-56,32,16 ,-12,8}
Step S230, by train window calculate deviant vx,vy
For the predictive value p' after adjusting1[i, j] and p'0[i, j], it is believed that difference value is the smaller the better, on this basis, respectively with pixel p1[i, j] and p0[i, j] certain contiguous range (such as 5x5 scope) around opens a training window, utilizes method of least square to solve deviant vx,vy
Wherein window training calculate computational methods particularly as follows:
Δ [ i , j ] = p ′ 0 [ i , j ] - p ′ 1 [ i , j ] = ( p 0 [ i , j ] + v x [ i , j ] · I x ( 0 ) [ i , j ] + v y [ i , j ] · I y ( 0 ) [ i , j ] ) - ( p 1 [ i , j ] - v x [ i , j ] · I x ( 1 ) [ i , j ] - v y [ i , j ] · I y ( 1 ) [ i , j ] ) Σ [ i ′ , j ] ∈ Ω Δ 2 [ i , j ] = min .
By windowing, training is askedMinima can calculate and obtain optimum deviant, and using the side-play amount of pixel total optimization in window as the optimum side-play amount of current pixel, it is possible to obtain the effect of robust more. Wherein,
v x [ i , j ] = det 1 det , v y [ i , j ] = det 2 det ,
det1=s3s5-s2s6,det2=s1s6-s3s4, det=s1s5-s2s4;
s 1 = Σ Ω ( I x 0 [ i , j ] + I x 1 [ i , j ] ) 2 ,
s 2 = s 4 = Σ Ω ( I x 0 [ i , j ] + I x 1 [ i , j ] ) ( I y 0 [ i , j ] + I y 1 [ i , j ] ) ,
s 3 = - Σ Ω ( P 0 [ i , j ] - P 1 [ i , j ] ) ( I x 0 [ i , j ] + I x 1 [ i , j ] ) ,
s 5 = Σ Ω ( I y 0 [ i , j ] + I y 1 [ i , j ] ) 2 ,
s 6 = - Σ Ω ( P 0 [ i , j ] - P 1 [ i , j ] ) ( I y 0 [ i , j ] + I y 1 [ i , j ] ) .
In actual applications, p'1[i, j] is relative to p1The skew of [i, j] position can also be expressed as (scale*vx, scale*vy), wherein scale represents p1[i, j] place reference frame and present frame distance and p0[i, j] place reference frame and present frame ratio of distances constant.
Step S240, adjacent four pixels position skew Filtering Processing
For avoiding the situation through this patent method rear section pixel prediction deleterious, we are the deviant v to adjacent 4 pixelsx,vyBy after Filtering Processing as overall displacement trim values.
In units of 2x2 pixel, the average side-play amount as entirety is offset using the position of adjacent four pixels, the position deviant of adjacent 4 pixels is carried out mean filter, and Fig. 3 is filtered schematic diagram for the position deviant of a kind of adjacent 4 pixels that the embodiment of the present invention provides. Mean filter computational methods particularly as follows:
vx_average=(vx1+vx2+vx3+vx4)/4
vy_average=(vy1+vy2+vy3+vy4)/4
(v in above-mentioned formulax1, vy1)、(vx2, vy2)、(vx3, vy3)、(vx4, vy4) the position deviant of respectively adjacent four pixels.
According to Taylor's single order expansion formula, after position deviant adjusts, two initial prediction pixel p1[i, j] and p0[i, j] is adjusted to:
p'0[i,j]≈p0[i,j]+vx_average·Ix0+vy_average·Iy0
p'1[i,j]≈p1[i,j]-vx_average·Ix1-vy_average·Iy1
The final predictive value of the corresponding pixel points in current image block is adjusted to:
Ppre[i, j]=(p'1[i,j]+p'0[i,j])/2
Step S250, increase coding maker position at different levels. The predictive value of each pixel is that principle determines whether present encoding unit uses the scheme in the embodiment of the present invention with RD (rate-distortioncost, rate distortion) cost after adjusting.
The flag of flag and the PU level arranging CTU (code tree unit) level shows whether current CTU or PU uses the motion compensation process that the present invention proposes.
Method particularly as follows:
Coding side uses two schemes to carry out motion compensation for each CTU respectively, a kind of scheme is the motion compensation process that the present invention proposes, the another kind of encoding scheme using encoder original, two schemes selects optimum motion compensated schemes with RD cost for index after having encoded, if the compensation scheme RD cost that the present invention proposes is relatively low, then CTU level flag bit is set to 1, is otherwise set to 0. This flag bit is with bit stream to decoder, and decoder selects corresponding mode to be decoded end motion compensation after decoding this flag bit. Wherein,
RD-cost=R+ λ * D
Bit needed for the current CTU of R presentation code, D represents the pixel value deviation between reconstruct CTU and original CT U, and λ is constant, encoder determine.
Additionally, when CTU level flag bit is 1, for this CTU using the PU that AMVP pattern is predicted show whether this PU uses the motion compensated schemes that the present invention proposes by increasing a flag bit.
The present invention is integrated on HEVC reference software HM12.0, and for HEVC universal test sequence, when testing time 2s, the lower performance realized of Lowdelay configuration is as shown in table 1.
Experimental data shows, this programme Y-component on HM12.0 platform can obtain the performance gain of average 1.3%, sequence performance boost for having texture-rich and slight movement becomes apparent from, and such as BQsquare, under this sequence, this algorithm can obtain the performance gain of 3.9%.
Although it should be noted that the present invention is integrated in HEVC reference software HM12.0, but it can be equally applicable to other encoding and decoding platform, as H.264/AVC, AVS2 etc.
1 algorithm of table performance data under different cycle testss
In sum, the motion compensation process for double; two forward prediction unit that the embodiment of the present invention proposes is by Taylor expansion and high-precision gradient calculation process, the predictive value fine setting that furthermore achieved that Pixel-level on the basis of block is predicted at original image, the prediction effect improving predicted picture block on the basis of code check further can not increased, improve the accuracy of predicted picture block, thus improving the forecast quality of current image block, improve the code efficiency of double; two forward prediction unit.
One of ordinary skill in the art will appreciate that: accompanying drawing is the schematic diagram of an embodiment, module or flow process in accompanying drawing are not necessarily implemented necessary to the present invention.
As seen through the above description of the embodiments, those skilled in the art is it can be understood that can add the mode of required general hardware platform by software to the present invention and realize. Based on such understanding, the part that prior art is contributed by technical scheme substantially in other words can embody with the form of software product, this computer software product can be stored in storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that a computer equipment (can be personal computer, server, or the network equipment etc.) perform the method described in some part of each embodiment of the present invention or embodiment.
Each embodiment in this specification all adopts the mode gone forward one by one to describe, between each embodiment identical similar part mutually referring to, what each embodiment stressed is the difference with other embodiments. Especially for device or system embodiment, owing to it is substantially similar to embodiment of the method, so describing fairly simple, relevant part illustrates referring to the part of embodiment of the method. Apparatus and system embodiment described above is merely schematic, the wherein said unit illustrated as separating component can be or may not be physically separate, the parts shown as unit can be or may not be physical location, namely may be located at a place, or can also be distributed on multiple NE. Some or all of module therein can be selected according to the actual needs to realize the purpose of the present embodiment scheme. Those of ordinary skill in the art, when not paying creative work, are namely appreciated that and implement.
The above; being only the present invention preferably detailed description of the invention, but protection scope of the present invention is not limited thereto, any those familiar with the art is in the technical scope that the invention discloses; the change that can readily occur in or replacement, all should be encompassed within protection scope of the present invention. Therefore, protection scope of the present invention should be as the criterion with scope of the claims.

Claims (6)

1. the motion compensation process for double; two forward prediction unit, it is characterised in that including:
Obtain two forward-predicted picture blocks for predicting current image block, choose the pixel on said two forward-predicted picture block;
Gradient calculation formula is utilized to calculate x direction and the y directional derivative of pixel on described forward-predicted picture block, by training window to calculate the deviant of the pixel on described forward-predicted picture block;
According to the x direction of the pixel on described forward-predicted picture block, y directional derivative and deviant, the position of the pixel on described forward-predicted picture block is adjusted.
2. the motion compensation process for double; two forward prediction unit according to claim 1, it is characterised in that described two the forward-predicted picture blocks obtained for predicting current image block, chooses the pixel on said two forward-predicted picture block, including:
Choose the pixel p on said two forward-predicted picture block1[i, j] and p0[i, j], if pixel p0Optimum prediction pixel after the adjustment of [i, j] is p'0[i, j], pixel p'0[i, j] is relative to pixel p0The skew of [i, j] is (vx, vy), if pixel p0Optimum prediction pixel after the adjustment of [i, j] is p'1[i, j], pixel p'1[i, j] is relative to pixel p1The skew of [i, j] is (-vx,-vy);
According to Taylor's single order expansion formula, p'1[i, j] and p'0The estimated value computing formula of [i, j] is as follows:
p'0[i,j]≈p0[i,j]+vx·Ix0+vy·Iy0
p'1[i,j]≈p1[i,j]-vx·Ix1-vy·Iy1
Ix0,Iy0Represent pixel p0The x direction of [i, j] and y directional derivative, Ix1,Iy1Represent pixel p1The x direction of [i, j] and y directional derivative.
3. the motion compensation process for double; two forward prediction unit according to claim 2, it is characterised in that the described x direction utilizing gradient calculation formula to calculate pixel on described forward-predicted picture block and y directional derivative, including:
I is calculated by following gradient calculation formulax1,Ix0,Iy1,Iy0:
Ix0=(p0[i+Δ,j]-p0[i-Δ,j])/2
Ix1=(p1[i+Δ,j]-p1[i-Δ,j])/2
Iy0=(p0[i,j+Δ]-p0[i,j-Δ])/2
Iy1=(p1[i,j+Δ]-p1[i,j-Δ])/2
In formula, Δ represents image element interpolation precision set in advance, p0[i+Δ,j]、p0[i-Δ,j]、p1[i+Δ,j]、p1[i-Δ,j]、p0[i,j+Δ]、p0[i,j-Δ]、p1[i,j+Δ]、p1[i, j-Δ] is obtained by DCT interpolation filter interpolation respectively.
4. the motion compensation process for double; two forward prediction unit according to claim 3, it is characterised in that the described deviant by training window to calculate the pixel on described forward-predicted picture block, including:
Respectively with pixel p1[i, j] and p0[i, j] certain contiguous range around opens a training window, utilizes method of least square to solve deviant vx,vy
Wherein window training calculate computational methods particularly as follows:
By windowing, training is askedMinima obtains optimum offset m in, wherein,
det1=s3s5-s2s6,det2=s1s6-s3s4, det=s1s5-s2s4;
5. the motion compensation process for double; two forward prediction unit according to claim 4, it is characterized in that, described according to the x direction of the pixel on described forward-predicted picture block, y directional derivative and deviant, the position of the pixel on described forward-predicted picture block is adjusted, including:
In units of 2x2 pixel, offseting average using the position of adjacent four pixels as overall side-play amount, the position deviant of adjacent 4 pixels is carried out mean filter, mean filter computing formula is as follows:
vx_average=(vx1+vx2+vx3+vx4)/4
vy_average=(vy1+vy2+vy3+vy4)/4
(v in above-mentioned formulax1, vy1)、(vx2, vy2)、(vx3, vy3)、(vx4, vy4) the position deviant of respectively adjacent four pixels.
According to Taylor's single order expansion formula, after position deviant adjusts, two initial pixel point p1[i, j] and p0[i, j] is adjusted to:
p'0[i,j]≈p0[i,j]+vx_average·Ix0+vy_average·Iy0
p'1[i,j]≈p1[i,j]-vx_average·Ix1-vy_average·Iy1
6. the motion compensation process for double; two forward prediction unit according to claim 5, it is characterised in that described method also includes:
The final predictive value of the corresponding pixel points in described current image block is adjusted to:
Ppre[i, j]=(p'1[i,j]+p'0[i,j])/2
RD cost after completing according to adopting the described coding for the current image block after the motion compensation process of double; two forward prediction unit, determines whether to adopt the described motion compensation process for double; two forward prediction unit.
CN201610091950.9A 2016-02-18 2016-02-18 For the motion compensation process of double forward prediction units Active CN105681809B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610091950.9A CN105681809B (en) 2016-02-18 2016-02-18 For the motion compensation process of double forward prediction units

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610091950.9A CN105681809B (en) 2016-02-18 2016-02-18 For the motion compensation process of double forward prediction units

Publications (2)

Publication Number Publication Date
CN105681809A true CN105681809A (en) 2016-06-15
CN105681809B CN105681809B (en) 2019-05-21

Family

ID=56304681

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610091950.9A Active CN105681809B (en) 2016-02-18 2016-02-18 For the motion compensation process of double forward prediction units

Country Status (1)

Country Link
CN (1) CN105681809B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108337513A (en) * 2017-01-20 2018-07-27 浙江大学 A kind of intra prediction pixel generation method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007092192A2 (en) * 2006-02-02 2007-08-16 Thomson Licensing Method and apparatus for motion estimation using combined reference bi-prediction
CN101766030A (en) * 2007-07-31 2010-06-30 三星电子株式会社 Use video coding and the coding/decoding method and the equipment of weight estimation
CN102742272A (en) * 2010-01-18 2012-10-17 索尼公司 Image processing device, method, and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007092192A2 (en) * 2006-02-02 2007-08-16 Thomson Licensing Method and apparatus for motion estimation using combined reference bi-prediction
CN101766030A (en) * 2007-07-31 2010-06-30 三星电子株式会社 Use video coding and the coding/decoding method and the equipment of weight estimation
CN102742272A (en) * 2010-01-18 2012-10-17 索尼公司 Image processing device, method, and program

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
RICKARD SJOBERG,YING CHEN: "Overview of HEVC High-Level Syntax and Reference Picture Management", 《IEEE AND TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108337513A (en) * 2017-01-20 2018-07-27 浙江大学 A kind of intra prediction pixel generation method and device

Also Published As

Publication number Publication date
CN105681809B (en) 2019-05-21

Similar Documents

Publication Publication Date Title
US7643690B2 (en) Image decoding and encoding apparatus, method and computer readable storage medium
US8982951B2 (en) Adaptive motion estimation coding
US20110261886A1 (en) Image prediction encoding device, image prediction encoding method, image prediction encoding program, image prediction decoding device, image prediction decoding method, and image prediction decoding program
CN112954340B (en) Encoding and decoding method, device and equipment
CN102804771B (en) Process For Matching Pursuit Based Coding Of Video Data For A Sequence Of Images
EP1379000B1 (en) Signal encoding method and apparatus and decoding method and apparatus
EP1734769B1 (en) An encoder and encoding method for motion estimation
CN1366777A (en) Video encoding and decoding method
CN100469142C (en) Video encoding and decoding methods and corresponding devices
AU2010265451A1 (en) Method, apparatus and device for obtaining video image motion information and template construction method
CN102340664B (en) Techniques for motion estimation
CN102801976A (en) Inter-frame module selecting method based on three-dimensional wavelet video code
CN101389028A (en) Video intra-frame encoding method based on space domain decomposition
CN102685505B (en) Intra-frame prediction method and prediction device
KR20050055553A (en) Motion estimation method for encoding motion image, and recording medium storing a program to implement thereof
CN102685506B (en) Intra-frame predication method and predication device
CN103190150B (en) The characteristic utilizing reference pixel omits intraframe predictive coding/decoding device and the method for the transmission of prediction mode information
CN102801982B (en) Estimation method applied on video compression and based on quick movement of block integration
GB2348559A (en) Motion vector estimation using multi-resolution techniques
CN105681809A (en) Motion compensation method for double-forward prediction unit
CN102316323A (en) Rapid binocular stereo-video fractal compressing and uncompressing method
CN105933718B (en) A kind of dividing method and device of coding unit
KR20120045369A (en) Video encoding/decoding apparatus and method for encoding and decoding of block filter information based on quad-tree
CN102257817B (en) Video coding based on global movement compensation
US20060104358A1 (en) Method and apparatus for motion estimation using adaptive search pattern for video sequence compression

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant