CN100341334C - Multi-reference frame rapid movement estimation method based on effective coverage - Google Patents

Multi-reference frame rapid movement estimation method based on effective coverage Download PDF

Info

Publication number
CN100341334C
CN100341334C CNB200510002067XA CN200510002067A CN100341334C CN 100341334 C CN100341334 C CN 100341334C CN B200510002067X A CNB200510002067X A CN B200510002067XA CN 200510002067 A CN200510002067 A CN 200510002067A CN 100341334 C CN100341334 C CN 100341334C
Authority
CN
China
Prior art keywords
estimation
effective coverage
motion
reference frame
motion vector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB200510002067XA
Other languages
Chinese (zh)
Other versions
CN1633184A (en
Inventor
熊璋
蒲菊华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beihang University
Original Assignee
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University filed Critical Beihang University
Priority to CNB200510002067XA priority Critical patent/CN100341334C/en
Publication of CN1633184A publication Critical patent/CN1633184A/en
Application granted granted Critical
Publication of CN100341334C publication Critical patent/CN100341334C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The present invention discloses a multi-reference frame rapid movement estimation method based on an effective region, which is suitable for rapid movement estimation of the integral pixel precision for video encoding. The rapid movement estimation method of the present invention proposes and verifies a movement continuity hypothesis by researching the characteristics of the multi-reference frame movement estimation, and proposes an effective region in different reference frames on the basis for proposing and verifying the movement continuity hypothesis. Search points of the effective region are far smaller than search points of the complete search movement estimation, and thereby, the time complexity of the movement estimation is greatly reduced. The method mainly proposes a rapid search strategy for the movement estimation of the integral pixel precision, the unique region prediction strategy causes the predicted search region to be a continuous region, so the method can be combined with other rapid score pixel precision movement estimation methods so as to further reduce the operation complexity of the movement estimation.

Description

Multi-reference frame rapid movement estimation method based on the effective coverage
Technical field
The present invention relates to the video coding in a kind of signal processing, especially at the multi-reference frame estimation that is adopted in the video encoding standard H.264, the rapid motion estimating method that is proposed is guaranteeing to have reduced the search point of estimation significantly under compression ratio and the video recovery quality prerequisite with full searching moving estimation basically identical.
Background technology
Along with rapid development of multimedia, people not only require receive to handle text message, and to the requirement of very impressive multimedia messages more and more widely, so Video Applications is more and more universal.Yet,, need all that generally it is carried out encoding compression and could satisfy application need because the data volume of video is very huge.
Video compression is to eliminate the intrinsic various redundant informations of video data by multiple means, typical strategy is generally all to need to utilize prediction or conversion to eliminate between frame of video and the interior redundant information of frame, wherein, estimation is a kind of method of typical elimination interframe redundancy, a lot of video encoding standards are all used this strategy, as ITU-T organize to set up H.261/263/263+/264 and the MPEG-1/2/4 that organizes to set up of MPEG.
The full search procedure of estimation is: generally at first frame of video is carried out macroblock partitions, and for each macro block, one (2w+1) of definition in reference frame 2Search window, the coordinate of the central pixel point of this window is identical with the upper left angle point of current macro; The macro block and the current macro that will be upper left angle point then with the point in the window compare, and obtain its cost function (such as the absolute difference and the SAD:Sum of AbsoluteDifference that calculate all pixels in two macro blocks); According to all these cost functions, seek the macro block of a cost function minimum at last, the distance of this macro block and current macro is just thought the motion vector of current macro.If allow the fraction pixel estimation, also need around the whole pixel of being searched for, carry out interpolation and comparison, obtain final best matching blocks and motion vector.
This shows that the search point that full searching moving is estimated is very huge, has reached (2w+1) 2Individual, thus need to calculate (2w+1) 2Inferior cost function.And be example with the SAD cost function, calculate SAD and need make N * N time subtraction and N * N sub-addition (wherein N represents the piece size, and general macro block is N=16), so the computation complexity that the full search of a macro block is estimated is very high.Therefore, generally need rapid motion estimating method, promptly only the macro block that partial pixel point determined in the search window is carried out matching ratio, obtain the motion vector of a near optimal, to reduce computation complexity.Yet compare with full search, reduced search point just because of the fast motion estimation algorithm, may make that estimation is insufficient, thereby make compression rates reduce or recover quality and descend, these descend for some Video Applications is flagrant, such as: the low bit rate rate is used to use especially in real time compression ratio is had relatively high expectations; The application of high-fidelity has higher requirement to recovering quality.
H.264 standard is a kind of video encoding and decoding standard of novelty, and it is all obtaining very ten-strike aspect compression ratio and the video recovery quality, but its computation complexity is too big, has limited the H.264 practical application of standard on this certain degree, and especially real-time video is used.Single from the estimation aspect, H.264 standard allows multi-reference frame, multiple macroblock partitions mode and 1/4 pixel precision motion vector, and this has all improved the H.264 complexity of standard movement estimation greatly.Therefore, need study the H.264 rapid motion estimating method of standard, and preferably these rapid motion estimating methods do not influence compression ratio substantially and recover quality, otherwise the standard that just lost H.264 is in compression ratio with recover qualitative advantage.
Have at present at the rapid motion estimating method of standard H.264, obtaining certain success aspect the reduction motion estimation complexity, but but bringing some decreased performance aspect compression ratio and the recovery quality, therefore, how to provide effective fast motion estimation strategy with better compromise compression ratio, recovery quality and computation complexity, just become very crucial.
Summary of the invention
The objective of the invention is to disclose a kind of multi-reference frame rapid movement estimation method based on the effective coverage, be that the encoder complexity of standard is a starting point to reduce H.264, explored the characteristic of estimation and motion vector under its multi-reference frame situation, propose and verified the motion continuity hypothesis, and a kind of fast motion estimation strategy based on the effective coverage proposed in view of the above, this strategy is searched for the motion vector that obtains in this frame entirely in a reference frame, with follow-up other frames be with reference to the time, can be with the zonule of motion-vector prediction that is obtained, and only in the zonule of being predicted, search for estimation entirely.
A kind of multi-reference frame rapid movement estimation method of the present invention based on the effective coverage, draw and verified the motion continuity hypothesis of video sequence with the effective coverage of multi-reference frame estimation, and adopt the motion continuity of described video sequence that the piece B in the present frame is carried out fast motion estimation, its motion-estimation step is as follows:
(A) at first reference frame F -1In carry out full searching moving and estimate, obtain the motion vector of 1/4 pixel precision and the cost function of estimation, be designated as MV (B ,-1) and SAD (B ,-1) respectively;
(B) according to the motion vector MV (B ,-1) in (A), obtain reference frame F j, the effective coverage VR of j ≠-1;
(C) with frame F j, motion vector and corresponding cost function that full searching moving estimates to obtain 1/4 pixel precision are carried out as a reference in j ≠-1 in the effective coverage VR that (B) obtains, be designated as respectively MV (B, j) and SAD (B, j);
(D), obtain optimal reference frame and the corresponding motion estimation result of present frame piece B according to the result of calculation of above-mentioned (A)～(C).
Described multi-reference frame rapid movement estimation method based on the effective coverage, its motion vector v=(x, y) effective coverage in search window is the pixel collection that satisfies following condition:
Figure C20051000206700041
In the formula, z represents effective coverage VR (the v) abscissa value in kinetic coordinate system, w represent effective coverage VR (the v) ordinate value in kinetic coordinate system, x represents the abscissa value of motion vector v in the kinetic coordinate system, y represents the ordinate value of motion vector v in the kinetic coordinate system.
Described multi-reference frame rapid movement estimation method based on the effective coverage, its motion continuity hypothesis P (MV (B, j) ∈ VR (MV j(B ,-1))) ≈ 1
In the formula, the probability of P (X) presentation of events X, (B, j) expression piece B is at frame F for MV jIn motion vector, MV j(B ,-1) expression frame F jIn and MV (B ,-1) picture element of same coordinate value is arranged.
Advantage of the present invention: (1) algorithm carries out speed-optimization at the multi-reference frame estimation, not only is suitable for H.264 standard, and other any encoding and decoding strategies that relate to multi-reference frame can use; (2) with a lot of fast motion estimation mode differences of tradition, this tactful estimation is still searched in a continuum, but this zone is far smaller than full search window, thereby greatly reduces complexity; (3) be based on the continuum just because of this strategy, therefore, the matching rate of the motion vector of its search and full searching motion vector is just higher, thereby it recovers the influence that quality and compression efficiency are reduced by search point hardly; (4) three step search wait fast algorithm different with tradition, and the fast motion estimation algorithm based on the continuum that the present invention proposes not only can be realized the quick search to whole pixel precision estimation, can realize the fast motion estimation to fraction pixel precision simultaneously.
Description of drawings
Fig. 1 is the kinetic coordinate system schematic diagram in the search window.
Fig. 2 (a), Fig. 2 (b) and Fig. 2 (c) are the multi-form structural representations in motion vector effective coverage in the kinetic coordinate system of search window.
Fig. 3 is a typical inter prediction encoding FB(flow block).
Among the figure: 1. search window 2. current blocks 3. effective coverages
Embodiment
The encoder complexity of standard is a starting point to reduce H.264 just in the present invention, explored the characteristic of estimation and motion vector under its multi-reference frame situation, propose and verified the motion continuity hypothesis, and a kind of fast motion estimation strategy based on the effective coverage proposed in view of the above, this strategy is searched for the motion vector that obtains in this frame entirely in a reference frame, with follow-up other frames be with reference to the time, can be with the zonule of motion-vector prediction that is obtained, and only in the zonule of being predicted, search for estimation entirely.The particular content of this invention comprises:
The present invention is a kind of multi-reference frame rapid movement estimation method based on the effective coverage, draw and verified the motion continuity hypothesis of video sequence with the effective coverage of multi-reference frame estimation, and adopt the motion continuity of described video sequence that the piece B in the present frame is carried out fast motion estimation, its motion-estimation step is as follows:
(A) at first reference frame F -1In carry out full searching moving and estimate, obtain the motion vector of 1/4 pixel precision and the cost function of estimation, be designated as MV (B ,-1) and SAD (B ,-1) respectively;
(B) according to the motion vector MV (B ,-1) in (A), obtain reference frame F j, the effective coverage VR of j ≠-1;
(C) with frame F j, motion vector and corresponding cost function that full searching moving estimates to obtain 1/4 pixel precision are carried out as a reference in j ≠-1 in the effective coverage VR that (B) obtains, be designated as respectively MV (B, j) and SAD (B, j);
(D), obtain optimal reference frame and the corresponding motion estimation result of present frame piece B according to the result of calculation of above-mentioned (A)～(C).
In the present invention, motion vector v=(X, y) effective coverage in search window is the pixel collection that satisfies following condition:
Figure C20051000206700061
In the formula, z represents effective coverage VR (the v) abscissa value in kinetic coordinate system, w represent effective coverage VR (the v) ordinate value in kinetic coordinate system, x represents the abscissa value of motion vector v in the kinetic coordinate system, y represents the ordinate value of motion vector v in the kinetic coordinate system.
In the present invention, motion continuity hypothesis P (MV (B, j) ∈ VR (MV j(B ,-1))) ≈ 1,
In the formula, the probability of P (X) presentation of events X, (B, j) expression piece B is at frame F for MV jIn motion vector, MV j(B ,-1) expression frame F jIn and MV (B ,-1) picture element of same coordinate value is arranged.
The present invention is described in further detail below in conjunction with drawings and Examples.
(1) motion continuity hypothesis and effective coverage model:
Definition 1: to video sequence { F k| K=-N M, F 0Represent the current frame of video (being present frame) that is about to coding, F i(i＞0) is the subsequent frame that will encode, F i(i＜0) is encoded frame, does not specify, the explanation of back of the present invention all only allows with reference to F i(i＜0) frame present frame F that encodes 0
Definition 2: for present frame F 0In a piece B, make MV (B, i)=(x i, y i) represent that it is at F iMotion vector in the frame.Under the situation of multiframe reference, for F arbitrarily j, j ≠ i,, make MV j(B, i) expression frame F iIn and MV (B i) has the picture element of same coordinate value.
Usually, adjacent two frames are more similar than two non-adjacent frames in the video motion sequence, i.e. F I-1Than other any F j, j＜i-1 and F iMore similar, the present invention claims that this kinetic characteristic is the motion continuity of video sequence, and the multi-reference frame of a lot of document descriptions estimates that motion vector statistical property and this motion continuity under the situation is identical.In addition, in the actual implementation procedure of a lot of video standards,, generally all use F for display delay simple and the minimizing video -1Carry out estimation, the success of these video standards is from the motion continuity of the clear video sequence of true Shanghai Stock Exchange.
According to the motion continuity characteristic, the present invention proposes: usually, (B, i), i＜-1 should mostly concentrate on a MV to any MV i(B ,-1) on every side, promptly (B i) is present in MV to MV iIn the zonule that (B ,-1) is determined, we claim that this zonule is the effective coverage, and its different structure form is shown in Fig. 2 (a), Fig. 2 (b) and Fig. 2 (c).
(2) defined hit rate and verified the effective coverage model
Hit rate: for video sequence { F k} K=-N MIf use B I, kIf i piece in k the frame of expression in the sequence is F then i＜(j＜k-1) is piece B I, kReference frame and MV (B I, k, j) be positioned at effective coverage VR (MV (B I, k, k-1)) in, MV (B then claimed I, k, be what hit j); Otherwise MV (B I, k, j) be called as miss.If defined function f:S 3→ 0,1} and g:S 3→ 0,1}, wherein: S={i|-N≤i≤M}, and if only if F jBe B I, kA reference frame time, f equals 1, otherwise equals 0; Currently only equal 1 and MV (B as f I, k, j) hitting, g equals 1, otherwise g equals 0.For this reason, video sequence { F k} K=-N MHit rate (hit_rate) be defined as formula (1), it has represented that each piece motion vector in different reference frames in the sequence drops on the probability in its specific effective coverage.
hit _ rate = Σ k Σ i Σ j ≠ i - 1 f ( i , k , j ) Σ k Σ i Σ j ≠ i - 1 [ f ( i , k , j ) + g ( i , k , j ) ] - - - ( 1 )
Obviously, for present frame F 0In any piece B, can be similar to P (MV (B, j) ∈ VR (MV with the hit rate hit_rate of video sequence j(B ,-1))), wherein, j ≠-1 and F jBe F 0A reference frame.
Hit rate that the present invention has passed through verification experimental verification, result such as table 1, hit rate is on average up to more than 97%.
(3) based on the rapid motion estimating method of effective coverage:
The present invention is based on effective coverage defined above model, proposed a kind of rapid motion estimating method, i.e. MVRF method, its step is as follows:
(A) at first reference frame F -1In carry out full searching moving and estimate, obtain the motion vector of 1/4 pixel precision and the cost function of estimation, be designated as MV (B ,-1) and SAD (B ,-1) respectively;
(B) according to the motion vector MV (B ,-1) in (A), obtain reference frame F j, the effective coverage VR of j ≠-1;
(C) with frame F j, motion vector and corresponding cost function that full searching moving estimates to obtain 1/4 pixel precision are carried out as a reference in j ≠-1 in the effective coverage VR that (B) obtains, be designated as respectively MV (B, j) and SAD (B, j);
(D), obtain optimal reference frame and the corresponding motion estimation result of present frame piece B according to the result of calculation of above-mentioned (A)～(C).
(4) consideration of fraction pixel estimation:
Different with other fast methods such as three step search, logarithm search, though searching for entirely, MVRF method of the present invention do not estimate to search the integer-pel precision motion vector, but its region of search remains a continuous zonule, this special continuous region of search has determined that the MVRF method can well be utilized the existing fraction pixel precision Fast Estimation Algorithm of estimating based on the whole pixel precision of full search.Therefore, if when the MVRF method need be carried out the fraction pixel precision motion search, can adopt following Fast estimation thought:
1) if the corresponding whole pixel precision motion vector MV that is searched with the MVRF method in the inside of effective coverage, then the motion estimation result of the whole pixel around this MV necessarily exists, therefore, when carrying out the search of fraction precision pixel, can be the same with common full search, adopt any outstanding fast method;
2) if the corresponding whole pixel precision motion vector MV that is searched with the MVRF method on the border of effective coverage, method in the time of can not using full the search this moment, if with other approximate evaluation strategies, certainly will further influence compression ratio and video recovery quality, therefore, for better compromise, can keep traditional method to fraction pixel precision search in this case.
(5) analyzed the effect of this invention in theory
Definition 3: rate does not match, for certain given method for estimating (such as MVRF), a given video blocks, if its motion vector that finds with this algorithm be used in whole search window in to search for the motion vector that finds entirely identical, claim that then this motion vector MV is the MV of a coupling, otherwise be a unmatched MV.The rate of not matching is illustrated in the motion vector of all pieces in all frames in the video sequence, the ratio of the motion vector that do not match.
For a piece, the motion vector MV that MVRF method proposed by the invention is searched MVRFExpression, and the motion vector MV that searches with the estimation of full searching moving FSExpression, then motion vector MV FSBe distributed with three kinds of situations: 1) MV FSAt F -1In the frame; 2) MV FSAt F -iIn the frame and in its effective coverage; 3) MV FSAt F iIn but not in its effective coverage, i＜-1 here.If MV MVRFAt F -1In the reference frame, perhaps MV MVRFAt F iIn the frame and in its effective coverage, MV then MVRFAnd MV FSConsistent; Otherwise, MV MVRFAnd MV FSDifference and MV MVRFBe a unmatched motion vector MV.That is to say that the rate that do not match of MVRF method only is MV FSAt F iIn (i＜-1) reference frame and the probability outside the VR of its effective coverage.If with P (! F -1) represent MV FSNot at F -1Probability in the reference frame, then P (mis)=P (! F -1) * (1-hit_rate).Available research achievements shows in the world: when 5 reference frames, search window size w=7, the motion vector distribution of video blocks is at F -1Probability in the reference frame has reached 48.83%, therefore, P (! F -1)=1-48.83%=51.17%, thus the rate that do not match of MVRF method then is: P (mis)=(1-48.83%) * 2.87%=1.47%.This shows that the rate that do not match of MVRF method is very low, therefore, its compression ratio and video recovery quality and carry out in whole search window that full searching moving estimates quite, and its amount of calculation reduces greatly.
Video Applications more and more widely, such as video conference, video request program VoD, remote teaching and medical treatment etc.And no matter be the video storage or the application of mode transmission, all need to carry out video compression coding.Video compression is generally divided intraframe coding and interframe encode, and wherein interframe encode generally needs estimation to eliminate the interframe redundancy.Behind the video process motion estimation and compensation of input, adopt strategies such as DCT or integer transform to eliminate redundancy in the frames, and quantize and entropy coding, form compressed bit stream, this compressed bit stream can be stored also and can be transferred on the network.The FB(flow block) of typical inter prediction encoding process as shown in Figure 3.
In standard H.264, because macro block exists multiple dividing mode, estimation to allow multi-reference frame and support 1/4 pixel precision motion vector, therefore, for a video macro block, its motion estimation process is as follows: For (all macroblock partitions modes)
For (all pieces under certain macroblock partitions mode)
{
For (reference frames of all permissions)
{
Putting in order the full searching moving of pixel in search window estimates;
Near the whole pixel of being searched for, carry out the half-pix estimation;
Carrying out 1/4 pixel motion near the half-pix point of being searched for estimates;
Obtain the motion vector MV of this piece under this reference frame;
Obtain " certain the sub-piece under certain macroblock partitions mode with certain frame be with reference to the time motion estimation result and cost function ";
}
}
Obtain under certain macroblock partitions mode, the overall movement estimated result and the cost function of this macro block; According to the estimation cost function of macro block under all dividing mode, obtain its optimal movement and estimate cost function; For macro block finds best dividing mode, the optimal reference frame of each sub-piece and relevant compression result;
Above-mentioned is the full searching moving estimation procedure (false code) of a macro block in the standard H.264.
When using MVRF method of the present invention, H.264 the motion estimation search process of a macro block is in the standard: For (all macroblock partitions modes)
For (all pieces under certain macroblock partitions mode)
{
At first reference frame F -1In put in order the full searching moving of pixel precision and estimate;
Near the whole pixel of being searched for, carry out the half-pixel accuracy estimation;
Near the half-pix point of being searched for, carry out 1/4 pixel motion and estimate, obtain its motion vector MV (B ,-1);
Calculating is at reference frame F -1Carry out the cost function of estimation;
Obtain the effective coverage according to MV (B ,-1);
For (every other reference frame)
{
Putting in order the full searching moving of pixel in the effective coverage estimates;
Near the whole pixel of being searched for, carry out the half-pix estimation;
Carrying out 1/4 pixel motion near the half-pix point of being searched for estimates;
Obtain the motion vector MV of this piece under this reference frame;
Obtain " certain the sub-piece under certain macroblock partitions mode with certain frame be with reference to the time motion estimation result and cost function ";
}
}
Obtain under certain macroblock partitions mode, the overall movement of this macro block estimates cost function; According to the estimation cost function under all dividing mode of macro block, obtain its optimal movement and estimate cost function; For macro block finds best dividing mode, the optimal reference frame of each sub-piece and relevant compression result;
Above-mentioned is to adopt the multi-reference frame rapid movement based on the effective coverage of the present invention to estimate after (MVRF) method H.264 a macro block motion estimation process (false code) in the standard.
In the present invention, be to serve as that checking is realized on the basis with the reference test platform JM7.3 of standard H.264, not only verified the hit rate of motion continuity hypothesized model and effective coverage, and checking and compared the present invention in detail and the performance of strategy on video recovery quality, compression ratio and motion estimation search are counted estimated in full search.Example has selected representational 7 international standard sequences as cycle tests: Coast sequence, Forman sequence, Mother sequence, Mobile sequence, Tennis sequence, Hall sequence and Flower.In this embodiment, except the Flower sequence is that the CIF form is thought, other all are the QCIF forms, and other parameters are provided with as follows:
A) frame rate is 30fps;
B) every kind of sequence comprises 200 frames, I frame of per 100 frames coding, and other all are the P frame;
C) allow 5 reference frame (N F=5);
D) allow 4 kinds of macroblock partitions modes, promptly 16 * 16,16 * 8,8 * 16 and 8 * 8;
E) quantizer is 32;
F) entropy coding pattern: CAVLC;
G) Hadamard conversion and error recovery mechanisms have been ignored;
H) search window size w is 7.
(1) hit rate of motion continuity model is relatively:
The hit rate result such as the table 1 of motion continuity model, obviously, although the defined effective coverage of the present invention is far smaller than the search window of full search, but its motion vector hit rate is on average but up to more than 97%, promptly estimate the motion vector that obtained with full searching moving, the overwhelming majority all can drop in the defined effective coverage of the present invention.
Table 1 motion vector is present in the hit rate of VR
Video sequence Miss rate Hit rate
Coast 3.80％ 96.20％
Forman 6.20％ 93.80％
Mother 0.77％ 99.23％
Mobile 1.46％ 98.54％
Tennis 5.25％ 94.75％
Hall 0.24％ 99.76％
Flower(CIF) 2.37％ 97.63％
On average 2.87％ 97.13％
Estimate that with full searching moving strategy (FS) compares, with the example of method of the present invention (MVRF) realization count at motion estimation search, compression ratio and the qualitative comparing result of recovery be as follows:
(2) the motion estimation search comparison of counting:
The motion vector distribution characteristic of table 2 MVRF algorithm
T FS＝N F[(2w+1) 2+16]＝1141
= 15 × 15 + 4 ( 81 × 0.40 + 64 × 0.27 + 120 × 0.33 ) + 5 × 16
= 662.12
T FS - T MVRF T FS = 1141 - 662.12 1141 = 41.97 %
In the formula, T FS, T MVRFRepresent that respectively the search point that full searching moving is estimated and the motion estimation search of MVRF method of the present invention count.As seen result of calculation estimated to compare with full searching moving thus, and motion estimation search of the present invention is counted and descended greatly.
(3) video recovery quality objective quality is relatively:
Video recovery quality objective to such as table 3, as seen, although search point descends greatly, video recovery quality that the present invention obtains and full search suitable substantially:
The PSNR-Y contrast (dB) of table 3 MVRF algorithm and full-search algorithm
(4) compression ratio is relatively:
Compression ratio is to such as table 4, as seen, although search point descends greatly, the basically identical of video code flow compression ratio that the present invention obtains and full search:
The bit rate contrast (Kbps) of table 4 MVRF algorithm and full-search algorithm
Figure C20051000206700116
Contrast by his-and-hers watches 1, table 2, table 3 and table 4, verified the multi-reference frame rapid movement estimation method that the present invention is based on the effective coverage, based on video encoding standard H.264,5 reference frames arranged, allowing under 4 kinds of macro blocks (16 * 16,16 * 8,8 * 16,8 * 8) partition mode, with in the whole search window of all reference frames, carry out full searching moving and estimate to compare, the motion estimation search of this method is counted and has on average been descended 41%, the video recovery quality has on average increased by 0.007 decibel, and bit rate has on average only descended 0.18%.

Claims (4)

1, a kind of multi-reference frame rapid movement estimation method based on the effective coverage, it is characterized in that: the motion continuity hypothesis that draws and verified video sequence with the effective coverage of multi-reference frame estimation, and adopt the motion continuity of described video sequence that the piece B in the present frame is carried out fast motion estimation, its motion-estimation step is as follows:
(A) at first reference frame F -1In carry out full searching moving and estimate, obtain the motion vector of 1/4 pixel precision and the cost function of estimation, be designated as MV (B ,-1) and SAD (B ,-1) respectively;
(B) according to the motion vector MV (B ,-1) in (A), obtain reference frame F j, the effective coverage VR of j ≠-1;
(C) with frame F j, motion vector and corresponding cost function that full searching moving estimates to obtain 1/4 pixel precision are carried out as a reference in j ≠-1 in the effective coverage VR that (B) obtains, be designated as respectively MV (B, j) and SAD (B, j);
(D), obtain optimal reference frame and the corresponding motion estimation result of present frame piece B according to the result of calculation of above-mentioned (A)～(C).
2, the multi-reference frame rapid movement estimation method based on the effective coverage according to claim 1 is characterized in that: motion vector v=(x, y) effective coverage in search window is the pixel collection that satisfies following condition:
Figure C2005100020670002C1
In the formula, z represents effective coverage VR (the v) abscissa value in kinetic coordinate system, w represent effective coverage VR (the v) ordinate value in kinetic coordinate system, x represents the abscissa value of motion vector v in the kinetic coordinate system, y represents the ordinate value of motion vector v in the kinetic coordinate system.
3, the multi-reference frame rapid movement estimation method based on the effective coverage according to claim 1 is characterized in that: motion continuity hypothesis P (MV (B, j) ∈ VR (MV j(B ,-1))) in ≈ 1 formula, the probability of P (X) presentation of events X, (B, j) expression piece B is at frame F for MV jIn motion vector, MV j(B ,-1) expression frame F jIn and MV (B ,-1) picture element of same coordinate value is arranged.
4, the multi-reference frame rapid movement estimation method based on the effective coverage according to claim 1, it is characterized in that: based on video encoding standard H.264,5 reference frames are being arranged, allowing under 4 kinds of macro blocks 16 * 16,16 * 8,8 * 16 and 8 * 8 partition modes, with in the whole search window of all reference frames, carry out full searching moving and estimate to compare, the motion estimation search of this method is counted and has on average been descended 41%, the video recovery quality has on average increased by 0.007 decibel, and bit rate has on average only descended 0.18%.
CNB200510002067XA 2005-01-14 2005-01-14 Multi-reference frame rapid movement estimation method based on effective coverage Expired - Fee Related CN100341334C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB200510002067XA CN100341334C (en) 2005-01-14 2005-01-14 Multi-reference frame rapid movement estimation method based on effective coverage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB200510002067XA CN100341334C (en) 2005-01-14 2005-01-14 Multi-reference frame rapid movement estimation method based on effective coverage

Publications (2)

Publication Number Publication Date
CN1633184A CN1633184A (en) 2005-06-29
CN100341334C true CN100341334C (en) 2007-10-03

Family

ID=34852922

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB200510002067XA Expired - Fee Related CN100341334C (en) 2005-01-14 2005-01-14 Multi-reference frame rapid movement estimation method based on effective coverage

Country Status (1)

Country Link
CN (1) CN100341334C (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102075756A (en) * 2011-01-27 2011-05-25 北京视博云科技有限公司 Video multiframe prediction encoding and decoding method and device

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101227616B (en) * 2007-01-15 2010-06-16 上海豪宙网络通讯设备有限公司 H.263/AVC integer pixel vectors search method
CN101330614B (en) * 2007-06-21 2011-04-06 中兴通讯股份有限公司 Method for implementing motion estimation of fraction pixel precision using digital signal processor
CN101272498B (en) * 2008-05-14 2010-06-16 杭州华三通信技术有限公司 Video encoding method and device
CN101877786B (en) * 2009-04-30 2012-08-15 北京大学 Video frame foreground tracking method and video coder
CN101945268B (en) * 2009-07-03 2013-06-12 晨星软件研发(深圳)有限公司 Motion estimating method and motion estimating device
CN103139562B (en) * 2011-11-30 2016-05-04 富士通株式会社 Method for estimating and device
KR102560629B1 (en) * 2013-03-15 2023-07-26 매직 립, 인코포레이티드 Display system and method
CN104038768B (en) * 2014-04-30 2017-07-18 中国科学技术大学 The many reference field rapid motion estimating methods and system of a kind of coding mode
CN111292357B (en) * 2020-03-02 2023-04-14 西安交通大学 Video inter-frame rapid motion estimation method based on correlation filtering

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5699129A (en) * 1995-10-17 1997-12-16 Zapex Technologies, Inc. Method and apparatus for motion vector determination range expansion
CN1463161A (en) * 2002-06-01 2003-12-24 三星电子株式会社 Device and method of correcting image movement

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5699129A (en) * 1995-10-17 1997-12-16 Zapex Technologies, Inc. Method and apparatus for motion vector determination range expansion
CN1463161A (en) * 2002-06-01 2003-12-24 三星电子株式会社 Device and method of correcting image movement

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Fast multi-frame motion estimation algorithm withadaptivesearch strategies in H.264 Xiang Li,Eric Q. Li,and Yen.Kuang Chen,IEEE International Conference on Acoustics,Speech,and Signal Processing（ICASSP '04） 2004 *
一种适用于H264的基于自适应搜索范围的快速运动估计算法 李翔，吴国威，中国图象图形学报，第9卷第4期 2004 *
基于对象快速自适应的混合搜索运动估计方法 朱红彬，薛方，数字电视与数字视频，第2卷第4期 2002 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102075756A (en) * 2011-01-27 2011-05-25 北京视博云科技有限公司 Video multiframe prediction encoding and decoding method and device
CN102075756B (en) * 2011-01-27 2012-10-24 北京视博云科技有限公司 Video multiframe prediction encoding and decoding method and device

Also Published As

Publication number Publication date
CN1633184A (en) 2005-06-29

Similar Documents

Publication Publication Date Title
CN100341334C (en) Multi-reference frame rapid movement estimation method based on effective coverage
CN100336401C (en) Moving image encoder, moving image decoder, moving image encoding method, moving image decoding method
CN1225127C (en) A coding/decoding end bothway prediction method for video coding
CN100338956C (en) Method and apapratus for generating compact transcoding hints metadata
CN1874521A (en) Apparatus and method for image encoding and decoding
CN1929611A (en) Methods and apparatus for video intraprediction encoding and decoding
CN101044763A (en) Encoder-assisted adaptive video frame interpolation
CN1675848A (en) Method and apparatus for performing high quality fast predictive motion search
CN1933601A (en) Method of and apparatus for lossless video encoding and decoding
CN1719735A (en) Method or device for coding a sequence of source pictures
CN1497981A (en) Method and device for code and decode motion vector
CN1236624C (en) Quick full pixel movement evaluation method of multiple kinds of modules
CN104394409B (en) HEVC predictive mode fast selecting methods based on spatial correlation
CN1777283A (en) Microblock based video signal coding/decoding method
CN1144469C (en) Motion-vector coding method
CN1753500A (en) Method of selecting in frame prediction mode based on H.264/AVC standard frame image
CN1753501A (en) Method of selecting H.264/AVC frame to frame motion estimation mode
CN1191718C (en) Motion image encoder and method, program, memory medium thereof
CN101056408A (en) Method and apparatus for determining a threshold for skip mode in video coding
CN1147154C (en) Method and apparatus for coding interlaced shape information
CN101742301B (en) Block mode coding method and device
CN1863319A (en) Fractional pixel interpolation method and encoding and decoding apparatus
CN101040534A (en) Moving image conversion method, moving image conversion apparatus, moving image conversion system, and server apparatus, and program
CN1224270C (en) Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure
CN1440200A (en) Non-uniform multilayer hexaploid lattice full pixel kinematic search method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C19 Lapse of patent right due to non-payment of the annual fee
CF01 Termination of patent right due to non-payment of annual fee