CN104219533B - A kind of bi-directional motion estimation method and up-conversion method of video frame rate and system - Google Patents
A kind of bi-directional motion estimation method and up-conversion method of video frame rate and system Download PDFInfo
- Publication number
- CN104219533B CN104219533B CN201410495756.8A CN201410495756A CN104219533B CN 104219533 B CN104219533 B CN 104219533B CN 201410495756 A CN201410495756 A CN 201410495756A CN 104219533 B CN104219533 B CN 104219533B
- Authority
- CN
- China
- Prior art keywords
- sad
- motion vector
- value
- frame image
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention provides a kind of bi-directional motion estimation method and system, after obtaining previous frame image and current frame image, carry out respectively based on the preceding bi-directional motion estimation to Block- matching and based on backward Block- matching, then final motion vector is obtained according to the minimum sad value and corresponding motion vector that get respectively, the obtained final motion vector accurate description motion conditions of moving object, solves the phenomenon that moving object caused by motion vector inaccuracy is obscured with background.Present invention also offers a kind of up-conversion method of video frame rate and system, final motion vector is obtained according to bi-directional motion estimation method and system, then motion vector filtering, motion compensation and blocking effect processing are carried out, the interleave image finally obtained eliminates the phenomenon and blocking effect phenomenon that moving object is obscured with background, improve the picture quality of interleave image, reduce video pictures it is not smooth and discontinuous the problems such as, improve video visual effect.
Description
Technical field
The present invention relates to field of video image processing, more particularly on a kind of bi-directional motion estimation method and video frame rate
Conversion method and system.
Background technology
Due to the fast development of digital image processing techniques and multimedia information technology in the last few years, HD video meeting quilt
It is widely used among various meeting-place, particularly using 1080p high definitions as representative.1080p high definition technologies bring high quality
Image quality, the but simultaneously as requirement of high image quality so that during video information transmission, the problem of network bandwidth limits compares
Prominent, under limited network bandwidth, the frame per second of video is forced to reduce, so that during whole video render, picture occurs
Not smooth, the action of particularly moving object is discontinuous.In order to solve this problem, it would be desirable to introduce on video frame rate and change
Method, low frame per second is converted to high frame per second, as far as possible reduce video pictures it is not smooth and discontinuous the problems such as, raising video visual
Effect.
Switch technology obtains interpolated frame by analyzing the correlation of consecutive frame on video frame rate, so as to which relatively low frame per second is turned
It is changed to higher frame per second.Conventional up-conversion method of video frame rate can substantially be summarized as two major classes, and the first kind is not account for
The motion state of adjacent interframe moving object, such as interframe repetition methods and interframe averaging method.Interframe repetition methods refer to directly
Connecing that present frame replicate and be used as interpolated frame, interframe averaging method refers to by being averaging to obtain interpolated frame to front and rear frame, though
Right above two method is improved in frame per second, but easily produces the phenomenon or moving object edge of image motion mutation
Fuzzy phenomenon.Second class is to consider the motion state of adjacent interframe moving object, wherein with motion estimation and compensation
Method be representative, due to analyzing the motion state of moving object, on the premise of frame per second is improved, the picture quality of interpolated frame
Larger improvement is obtained.But for the second class method, the fortune of moving object can be obtained by motion estimation techniques
Dynamic vector, motion vector reflect motion conditions of the moving object in interframe, if cannot be accurate using method for estimating
Motion vector if, then the picture quality effect of interpolated frame may be also poorer than first kind method.Therefore, estimation skill
Art turns into the key component of up-conversion method of video frame rate.
Conventional method for estimating has the unidirectional search method based on Block- matching, the bi-directional motion estimation based on Block- matching
Method.Unidirectional search method based on Block- matching refers to carry out the Block- matching search from former frame to present frame in adjacent two frame
(to Block- matching before referred to as) or the Block- matching search (referred to as backward Block- matching) from present frame to former frame.But this method makes
Obtain some pixel in interpolated frame to correspond to multiple motion vectors or correspond to therewith without motion vector, thus may produce
Raw " overlapping " phenomenon and " cavity " phenomenon.Bi-directional motion estimation based on Block- matching is that Byung-Tae Choi et al. are proposed,
Refer to the one initial motion vector of current image block for assigning interpolated frame, then certain change centered on the motion vector
In the range of Block- matching search is symmetrically carried out in former frame and present frame, find the displacement that makes both most like as working as
The motion vector of preceding image block.This method preferably solves " overlapping " phenomenon and " cavity " phenomenon, wherein what is be endowed is initial
Motion vector be to search for obtain by using single forward or a backward Block- matching because this method only considered based on unidirectional
Block- matching search bi-directional motion estimation, obtained motion vector reflects the motion shape of moving object with being unable to entirely accurate
State, but the motion vector inaccuracy of Block- matching can cause occur the phenomenon that moving object is obscured with background in interpolated frame.
The content of the invention
Therefore, the technical problems to be solved by the invention are in the prior art for being changed on video frame rate based on list
To the obtained motion vector of bi-directional motion estimation method searched for of Block- matching reflect the fortune of moving object with being unable to entirely accurate
Dynamic state, so as to propose a kind of bi-directional motion estimation method and up-conversion method of video frame rate and system.
In order to solve the above technical problems, the following technical scheme of offer of the present invention：
A kind of bi-directional motion estimation method, comprises the following steps：
Obtain previous frame image and current frame image；
Carried out, based on the preceding bi-directional motion estimation to Block- matching, obtaining first according to previous frame image and current frame image
Sad value and corresponding first motion vector, first sad value are the institute based on the preceding bi-directional motion estimation acquisition to Block- matching
There is sad value minimum in sad value；
Bi-directional motion estimation based on backward Block- matching is carried out according to previous frame image and current frame image, obtains second
Sad value and corresponding second motion vector, second sad value are the institute that is obtained based on the bi-directional motion estimation of backward Block- matching
There is sad value minimum in sad value；
Obtained according to first sad value, first motion vector, second sad value and second motion vector
Take final motion vector.
Above-mentioned bi-directional motion estimation method, it is described according to first sad value, first motion vector, described second
The step of sad value and second motion vector obtain final motion vector, including final motion arrow is calculated by equation below
Amount：
F=a1*f1+a2*f2
Wherein, f represents final motion vector, a1Represent the weights of the first motion vector, a2Represent the power of the second motion vector
Value, f1Represent the first motion vector, f2Represent the second motion vector, 0<a1<1,0<a2<1。
Above-mentioned bi-directional motion estimation method, it is described according to first sad value, first motion vector, described second
The step of sad value and second motion vector obtain final motion vector also includes calculating a1And a2Process, it is as follows：
Work as SAD1+SAD2When=0, a1=a2=0.5；
Work as SAD1+SAD2When ≠ 0, a1=1-SAD1/(SAD1+SAD2),a2=1-SAD2/(SAD1+SAD2)；
Wherein SAD1For the first sad value, SAD2For the second sad value.
Above-mentioned bi-directional motion estimation method, it is described according to first sad value, first motion vector, described second
The step of sad value and second motion vector obtain final motion vector also includes calculating a1And a2Process, it is as follows：
Work as SAD1=SAD2When=0, a1=a2=0.5；
Work as SAD1≠ 0 and SAD2When ≠ 0, a1=1-SAD1 2/(SAD1 2+SAD2 2),a2=1-SAD2 2/(SAD1 2+SAD2 2)；
Wherein SAD1For the first sad value, SAD2For the second sad value.
Above-mentioned bi-directional motion estimation method, it is described to be carried out according to previous frame image and current frame image based on preceding to Block- matching
Bi-directional motion estimation, obtain the first sad value and include the step of corresponding first motion vector：
Block- matching search is carried out with previous frame image to current frame image, obtains motion vector t1；
By the motion vector t1Initial value as bi-directional motion estimation；
In the motion vector t1Certain threshold range in carry out the Block- matching of previous frame image and current frame image and search
Rope, obtain all sad values；
Minimum sad value will be chosen in all sad values as the first sad value, motion vector corresponding to the first sad value is
First motion vector.
Above-mentioned bi-directional motion estimation method, it is described to be carried out being based on backward Block- matching according to previous frame image and current frame image
Bi-directional motion estimation, obtain the second sad value and include the step of corresponding second motion vector：
Block- matching search is carried out with current frame image to previous frame image, obtains motion vector t2；
By the motion vector t2Initial value as bi-directional motion estimation；
In the motion vector t2Certain threshold range in carry out the Block- matching of previous frame image and current frame image and search
Rope, obtain all sad values；
Minimum sad value will be chosen in all sad values as the second sad value, motion vector corresponding to the second sad value is
Second motion vector.
Above-mentioned bi-directional motion estimation method, the sad value are in image block and current frame image in previous frame image
The sum of the absolute difference of the pixel value of the corresponding pixel points of image block.
A kind of up-conversion method of video frame rate, comprises the following steps：
T1：Final motion vector is obtained using bi-directional motion estimation method described above；
T2：Final motion vector filtering is carried out to interleave image；
T3：Motion compensation is carried out to filtered interleave image；
T4：Blocking effect processing is carried out to the interleave image after motion compensation；
T5：Obtain final interleave image.
A kind of bi-directional motion estimation system, including：
Image collection module, for obtaining previous frame image and current frame image；
First data acquisition module, for being carried out according to previous frame image and current frame image based on preceding to the double of Block- matching
To estimation, the first sad value and corresponding first motion vector are obtained, first sad value is to Block- matching based on preceding
Minimum sad value in all sad values that bi-directional motion estimation obtains；
Second data acquisition module, it is double based on backward Block- matching for being carried out according to previous frame image and current frame image
To estimation, the second sad value and corresponding second motion vector are obtained, second sad value is based on backward Block- matching
Minimum sad value in all sad values that bi-directional motion estimation obtains；
Final motion vector acquisition module, for according to first sad value, first motion vector, described second
Sad value and second motion vector obtain final motion vector.
Above-mentioned bi-directional motion estimation system, final motion vector acquisition module include calculating final fortune by equation below
Dynamic vector：
F=a1*f1+a2*f2
Wherein, f represents final motion vector, a1Represent the weights of the first motion vector, a2Represent the power of the second motion vector
Value, f1Represent the first motion vector, f2Represent the second motion vector, 0<a1<1,0<a2<1。
Above-mentioned bi-directional motion estimation system, also include in final motion vector acquisition module calculating a1And a2Process, such as
Under：
Work as SAD1+SAD2When=0, a1=a2=0.5；
Work as SAD1+SAD2When ≠ 0, a1=1-SAD1/(SAD1+SAD2),a2=1-SAD2/(SAD1+SAD2)；
Wherein SAD1For the first sad value, SAD2For the second sad value.
Above-mentioned bi-directional motion estimation system, also include in final motion vector acquisition module calculating a1And a2Process, such as
Under：
Work as SAD1=SAD2When=0, a1=a2=0.5；
Work as SAD1≠ 0 and SAD2When ≠ 0, a1=1-SAD1 2/(SAD1 2+SAD2 2),a2=1-SAD2 2/(SAD1 2+SAD2 2)；
Wherein SAD1For the first sad value, SAD2For the second sad value.
Above-mentioned bi-directional motion estimation system, the first data acquisition module specifically include：
First forward block matched sub-block, for carrying out Block- matching search with previous frame image to current frame image, obtain
Motion vector t1；
First initial value sets submodule, for by the motion vector t1Initial value as bi-directional motion estimation；
First bi-directional motion estimation submodule, in the motion vector t1Certain threshold range in carry out former frame
The Block- matching of image and current frame image is searched for, and obtains all sad values；
First data acquisition submodule, in all sad values for will being obtained in the first bi-directional motion estimation submodule
Minimum sad value is chosen as the first sad value, motion vector corresponding to the first sad value is the first motion vector.
Above-mentioned bi-directional motion estimation system, the second data acquisition module specifically include：
Second backward Block- matching submodule, for carrying out Block- matching search with current frame image to previous frame image, obtain
Motion vector t2；
Second initial value sets submodule, for by the motion vector t2Initial value as bi-directional motion estimation；
Second bi-directional motion estimation submodule, in the motion vector t2Certain threshold range in carry out former frame
The Block- matching of image and current frame image is searched for, and obtains all sad values；
Second data acquisition submodule, in all sad values for will being obtained in the second bi-directional motion estimation submodule
Minimum sad value is chosen as the second sad value, motion vector corresponding to the second sad value is the second motion vector.
Above-mentioned bi-directional motion estimation system, in the first data submodule and the second data submodule, the sad value is previous
The pixel value of the corresponding pixel points of the image block in image block and current frame image in two field picture absolute difference and.
A kind of system changed on video frame rate, including：
Bi-directional motion estimation system described above, for obtaining final motion vector；
Filtration module, for carrying out final motion vector filtering to interleave image；
Compensating module, for carrying out motion compensation to filtered interleave image；
Blocking effect processing module, for carrying out blocking effect processing to the interleave image after motion compensation；
Interleave image collection module, for obtaining final interleave image.
The above-mentioned technical proposal of the present invention has advantages below compared with prior art：
(1) bi-directional motion estimation method and system of the present invention, after obtaining previous frame image and current frame image, point
Do not carry out based on the preceding bi-directional motion estimation to Block- matching and the bi-directional motion estimation based on backward Block- matching, then according to respectively
The minimum sad value got and corresponding motion vector obtain final motion vector, and the final motion vector of acquisition is accurate
The motion conditions of moving object are described, solve the phenomenon that moving object caused by motion vector inaccuracy is obscured with background.
(2) up-conversion method of video frame rate and system of the present invention, are obtained according to bi-directional motion estimation method and system
Final motion vector is taken, final motion vector filtering is carried out to interpolation two field picture, carries out motion compensation and blocking effect after filtering again
Processing, the interleave image finally obtained eliminate the phenomenon and blocking effect phenomenon that moving object is obscured with background, improve interleave
The picture quality of image.Reduce video pictures it is not smooth and discontinuous the problems such as, improve video visual effect.
Brief description of the drawings
In order that present disclosure is more likely to be clearly understood, specific embodiment and combination below according to the present invention
Accompanying drawing, the present invention is further detailed explanation, wherein
Fig. 1 is a kind of flow chart of bi-directional motion estimation method of one embodiment of the invention；
Fig. 2 is a kind of bi-directional motion estimation schematic diagram of one embodiment of the invention；
Fig. 3 is a kind of flow chart of up-conversion method of video frame rate of one embodiment of the invention；
Fig. 4 is a kind of blocking effect processing schematic diagram of one embodiment of the invention；
Fig. 5 is a kind of bi-directional motion estimation system block diagram of one embodiment of the invention；
Fig. 6 is converting system block diagram on a kind of video frame rate of one embodiment of the invention.
Reference is expressed as in figure：1- previous frame images, 2- interleaves image, 3- current frame images, R1- First partials area
Domain, the regional areas of R2- second, the regional areas of R3- the 3rd, B1~B9- image blocks.
Embodiment
Embodiment 1
The present embodiment provides a kind of bi-directional motion estimation method, as shown in figure 1, comprising the following steps：
S1：Read previous frame image pre_img and current frame image cur_img.
S2：Carried out according to previous frame image and current frame image based on the preceding bi-directional motion estimation to Block- matching, obtain the
One sad value and corresponding first motion vector, first sad value are to be obtained based on the preceding bi-directional motion estimation to Block- matching
Minimum sad value in all sad values.
Step S2 specifically comprises the following steps：
S21：The image block of a 4x4 size in previous frame image pre_img is taken out, in current frame image cur_img
+/- 8 pixel hunting zone in carry out similar Block- matching, the hunting zone be using current image block top left co-ordinate in
8 pixels each up and down of the heart, block matching criterion use SAD criterions, and sad value is the picture of the corresponding pixel points of two image blocks
The sum of the absolute difference of element value, formula are as follows：
Wherein (i, j) represents the coordinate of pixel in image block, fp(i, j) represents pixel (i, j) in previous frame image
The pixel value at place, fc(i, j) represents the pixel value at pixel (i, j) place in current frame image.
Offset corresponding to minimum sad value is the motion vector (f_ of current image block in all sad values of acquisition
Mvx, f_mvy), if there is two minimum sad values, then select to move arrow corresponding to the sad value nearest from current image block
Amount is used as motion vector (f_mvx, f_mvy).
S22：Motion vector (f_mvx/2, f_mvy/2) is set as the first of interleave image interp_img correspondence image blocks
Beginning motion vector.
S23：Bi-directional motion estimation is carried out, bi-directional motion estimation schematic diagram is as shown in Fig. 21 being previous frame image, 2 being slotting
Two field picture, 3 are current frame image, and the excursion of the value of setting initial motion vectors (f_mvx/2, f_mvy/2) is +/- 2, then
25 groups of candidate motion vectors can be produced.It is named as (tmp_mvx, tmp_mvy) for one group of candidate motion vector therein, it is false
It is (w, h) to determine coordinate position of the current image block in interleave image, is somebody's turn to do according to motion vector (tmp_mvx, tmp_mvy)
Image block is (w-tmp_mvx, h-tmp_mvy) in the coordinate of previous frame image, is (w+tmp_ in the coordinate of current frame image
Mvx, h+tmp_mvy), then calculate the sad values of former frame and present frame the two image blocks.Sweared for 25 groups of Candidate Motions
Amount, the calculating more than, then can produce 25 sad values.
If sitting target value has decimal, then the value of pixel corresponding to the coordinate value needs progress interpolation to calculate
Arrive, for the interpolation computational methods that the present embodiment uses for bilinear interpolation method, process is as follows：
It is assumed that the coordinate for the pixel being interpolated is (x, y), the integer part for making x is x_int, fractional part x_
frac；The integer part for making y is y_int, fractional part y_frac.
Obtain the value of 4 pixels of pixel (x, y) neighborhood：
P1=img_data (x_int, y_int)
P2=img_data (x_int+1, y_int)
P3=img_data (x_int, y_int+1)
P4=img_data (x_int+1, y_int+1)
Calculate weights corresponding to 4 pixels：
W1=(1-x_frac) * (1-y_frac)
W2=x_frac* (1-y_frac)
W3=(1-x_frac) * y_frac
W4=x_frac*y_frac
Interpolated value is：
Interp_val=w1*p1+w2*p2+w3*p3+w4*p4
S24：The sad value of minimum will be chosen in 25 sad values as the first sad value, the corresponding motion of the first sad value
Vector is the first motion vector, the motion vector (fwd_mvx, fwd_mvy) of current image block as in interleave image, if gone out
Two or more existing minimum sad values, then motion vector corresponding to the sad value nearest from current image block is selected to be used as the
One motion vector.
S3：Bi-directional motion estimation based on backward Block- matching is carried out according to previous frame image and current frame image, obtains the
Two sad values and corresponding second motion vector, second sad value obtain for the bi-directional motion estimation based on backward Block- matching
Minimum sad value in all sad values.
Step S3 specifically comprises the following steps：
S31：The image block of a 4x4 size in current frame image cur_img is taken out, in previous frame image pre_img
+/- 8 pixel hunting zone in carry out similar Block- matching, the hunting zone be using current image block top left co-ordinate in
8 pixels each up and down of the heart, block matching criterion use SAD criterions, and sad value is the picture of the corresponding pixel points of two image blocks
The sum of the absolute difference of element value, formula is as shown in step S21.The offset corresponding to minimum sad value in all sad values of acquisition
The as motion vector (b_mvx, b_mvy) of current image block, if there is two minimum sad values, then select from current figure
Motion vector is as motion vector (b_mvx, b_mvy) as corresponding to block nearest sad value.
S32：Motion vector (- b_mvx/2 ,-b_mvy/2) is set as interleave image interp_img correspondence image blocks
Initial motion vectors.
S33：The excursion for setting the value of initial motion vectors (- b_mvx/2 ,-b_mvy/2) is +/- 2, then can produce
Raw 25 groups of candidate motion vectors.It is named as (tmp_mvx, tmp_mvy) for one group of candidate motion vector therein, it is assumed that current
Coordinate position of the image block in interleave image is (w, h), and the image block is obtained according to motion vector (tmp_mvx, tmp_mvy)
It is (w-tmp_mvx, h-tmp_mvy) in the coordinate of previous frame image, is (w+tmp_mvx, h+ in the coordinate of current frame image
Tmp_mvy), the sad value of the two image blocks of former frame and present frame is then calculated.For 25 groups of candidate motion vectors, pass through
Calculating above, then can produce 25 sad values.If sitting target value has decimal, then pixel corresponding to the coordinate value
Value needs progress interpolation to be calculated, and interpolation computational methods are as shown in step S23.
S34：The sad value of minimum will be chosen in 25 sad values as the second sad value, the corresponding motion of the second sad value
Vector is the second motion vector, the motion vector (bwd_mvx, bwd_mvy) of current image block as in interleave image.If go out
Two or more existing minimum sad values, then motion vector corresponding to the sad value nearest from current image block is selected to be used as the
Two motion vectors
S4：According to first sad value, first motion vector, second sad value and second motion vector
Obtain final motion vector.
In step S4, including final motion vector calculated by equation below：
F=a1*f1+a2*f2
Wherein, f represents final motion vector (mvx, mvy), a1Represent the weights of the first motion vector, a2Represent the second fortune
The weights of dynamic vector, f1Represent the first motion vector (fwd_mvx, fwd_mvy), f2Represent the second motion vector (bwd_mvx,
Bwd_mvy), 0<a1<1,0<a2<1, mvx and mvy in final motion vector (mvx, mvy) retain fractional part.
Step S2 and step S3 do not have sequencing, in the present embodiment, can first carry out step S2 with parallel processing, then
Perform step S3.
In step S4, in addition to calculate a1And a2Process, it is as follows：
Work as SAD1+SAD2When=0, a1=a2=0.5；
Work as SAD1+SAD2When ≠ 0, a1=1-SAD1/(SAD1+SAD2), a2=1-SAD2/(SAD1+SAD2)；
Wherein SAD1For the first sad value, SAD2For the second sad value.
A kind of bi-directional motion estimation method described in the present embodiment, after obtaining previous frame image and current frame image, respectively
Carry out based on the preceding bi-directional motion estimation to Block- matching and the bi-directional motion estimation based on backward Block- matching, then according to obtaining respectively
The minimum sad value got and corresponding motion vector obtain final motion vector, and the final motion vector of acquisition is accurately retouched
The motion conditions of moving object have been stated, have solved the phenomenon that moving object caused by motion vector inaccuracy is obscured with background.
Embodiment 2
The present embodiment provides a kind of bi-directional motion estimation method, and embodiment 2 is the deformation on the basis of embodiment 1, its with
The difference of embodiment 1 is calculating a in the step S41And a2Process.
In the present embodiment step S4, including calculate a1And a2Process, it is as follows：
Work as SAD1=SAD2When=0, a1=a2=0.5；
Work as SAD1≠ 0 and SAD2When ≠ 0, a1=1-SAD1 2/(SAD1 2+SAD2 2),a2=1-SAD2 2/(SAD1 2+SAD2 2)；
Wherein SAD1For the first sad value, SAD2For the second sad value.
A kind of bi-directional motion estimation method described in the present embodiment, after obtaining previous frame image and current frame image, respectively
Carry out based on the preceding bi-directional motion estimation to Block- matching and the bi-directional motion estimation based on backward Block- matching, then according to obtaining respectively
The minimum sad value got and corresponding motion vector obtain final motion vector, and the final motion vector of acquisition is accurately retouched
The motion conditions of moving object have been stated, have solved the phenomenon that moving object caused by motion vector inaccuracy is obscured with background.
Embodiment 3
The present embodiment provides a kind of method changed on video frame rate, as shown in figure 3, comprising the following steps：
T1：Final motion vector is obtained using the bi-directional motion estimation method described in embodiment 1 or embodiment 2
(mvx, mvy).It is assumed that the coordinate of current image block is (w, h) in interleave image interp_img, obtain with current image block
Centered on 3x3 windows in 9 image blocks altogether 9 groups of final motion vectors (mvx1~mvx9, mvy1~mvy9).This
9 groups of final motion vectors motion vector as current image block successively.
T2：Final motion vector filtering is carried out to interleave image.Current image block is worth to preceding according to motion vector
One two field picture pre_img and current frame image cur_img coordinate (w-mvx1~mvx9, h-mvx1~mvx9), (w+mvx1~
Mvx9, h+mvx1~mvx9), and the sad value of the two image blocks is calculated, if decimal be present in the coordinate of former frame or present frame
Part, then the value of corresponding pixel need carry out interpolation calculating, for this 9 groups of motion vectors, obtain 9 sad values, it is minimum
Motion vector corresponding to sad value is as the filtered motion vector of current image block (smooth_mvx, smooth_mvy).
T3：Motion compensation is carried out to filtered interleave image.Obtain interleave image interp_img current pixel point
The motion vector (smooth_mvx, smooth_mvy) of image block belonging to (x, y), is calculated the pixel in previous frame image
Pixel point coordinates (x-smooth_mvx, y-smooth_mvy) and (x+ corresponding to pre_img and current frame image cur_img
Smooth_mvx, y+smooth_mvy), and the pixel value pre_pxl and cur_pxl_ of pixel are read, if two groups of seats above
There is fractional part in the value in mark, then the value of corresponding pixel needs to carry out interpolation calculating, then interleave image interp_img
Interpolation calculation formula be：
T4：Blocking effect processing is carried out to the interleave image after motion compensation.As shown in figure 4, make a width of blk_ of image block
Width, a height of blk_height, horizontal direction skew are ofst_w, and vertical direction skew is ofst_h.For blk_
The image block of widthxblk_height sizes, left and right respectively expand ofst_w, respectively expand ofst_h up and down, then form (blk_
Width+2*ofst_w) the image block image block of x (blk_height+2*ofst_h) size just generates three after expansion
Class regional area：First partial region R1, the second regional area R2, wherein the 3rd regional area R3, blocking effect processing are mainly
It is then constant to First partial region R1 and the second regional area R2 processing, the 3rd regional area R3.B1~B9 represents not expand
Image block before filling, corresponding block motion vector are (smooth_mvx1~smooth_mvx9, smooth_mvy1~smooth_
mvy9).Wherein, First partial region R1 result is by taking the First partial region R1 in the upper left corner as an example, then the knot of blocking effect
Fruit is equal to the average value of B1, B2, B4 and B5 motion compensated result.Second regional area R2 result is with the second of the left side
Exemplified by regional area R2, then the average value of the B4 such as result of blocking effect and B5 motion compensated result.
T5：Obtain final interleave image.Final interleave image is obtained after step T1-T4.
A kind of up-conversion method of video frame rate described in the present embodiment, final motion is obtained according to bi-directional motion estimation method
Vector, final motion vector filtering is carried out to interpolation two field picture, carry out motion compensation and blocking effect processing after filtering again, finally obtain
The interleave image taken eliminates the phenomenon and blocking effect phenomenon that moving object is obscured with background, improves the image matter of interleave image
Amount.Reduce video pictures it is not smooth and discontinuous the problems such as, improve video visual effect.
Embodiment 4
The present embodiment provides a kind of bi-directional motion estimation system, as shown in figure 5, including：
Image collection module, for obtaining previous frame image and current frame image；
First data acquisition module, for being carried out according to previous frame image and current frame image based on preceding to the double of Block- matching
To estimation, the first sad value and corresponding first motion vector are obtained, first sad value is to Block- matching based on preceding
Minimum sad value in all sad values that bi-directional motion estimation obtains；
Second data acquisition module, it is double based on backward Block- matching for being carried out according to previous frame image and current frame image
To estimation, the second sad value and corresponding second motion vector are obtained, second sad value is based on backward Block- matching
Minimum sad value in all sad values that bi-directional motion estimation obtains；
Final motion vector acquisition module, for according to first sad value, first motion vector, described second
Sad value and second motion vector obtain final motion vector.
The final motion vector acquisition module includes calculating final motion vector by equation below：
F=a1*f1+a2*f2
Wherein, f represents final motion vector, a1Represent the weights of the first motion vector, a2Represent the power of the second motion vector
Value, f1Represent the first motion vector, f2Represent the second motion vector, 0<a1<1,0<a2<1。
Also include calculating a in the final motion vector acquisition module1And a2Process, it is as follows：
Work as SAD1+SAD2When=0, a1=a2=0.5.
Work as SAD1+SAD2When ≠ 0, a1=1-SAD1/(SAD1+SAD2),a2=1-SAD2/(SAD1+SAD2)。
Wherein SAD1For the first sad value, SAD2For the second sad value.
First data acquisition module specifically includes：
First forward block matched sub-block, for carrying out Block- matching search with previous frame image to current frame image, obtain
Motion vector t1；
First initial value sets submodule, for by the motion vector t1Divided by 2 as the initial of bi-directional motion estimation
Value；
First bi-directional motion estimation submodule, in the motion vector t1Certain threshold range in carry out former frame
The Block- matching of image and current frame image is searched for, and obtains all sad values；
First data acquisition submodule, in all sad values for will being obtained in the first bi-directional motion estimation submodule
Minimum sad value is chosen as the first sad value, motion vector corresponding to the first sad value is the first motion vector.
Second data acquisition module specifically includes：
Second backward Block- matching submodule, for carrying out Block- matching search with current frame image to previous frame image, obtain
Motion vector t2；
Second initial value sets submodule, for by the motion vector t2Divided by 2 as the initial of bi-directional motion estimation
Value；
Second bi-directional motion estimation submodule, in the motion vector t2Certain threshold range in carry out former frame
The Block- matching of image and current frame image is searched for, and obtains all sad values；
Second data acquisition submodule, in all sad values for will being obtained in the second bi-directional motion estimation submodule
Minimum sad value is chosen as the second sad value, motion vector corresponding to the second sad value is the second motion vector.
In the first data submodule and the second data submodule, the sad value is the image block in previous frame image
With the absolute difference of the pixel value of the corresponding pixel points of the image block in current frame image and.
Bi-directional motion estimation system described in the present embodiment, after obtaining previous frame image and current frame image, carry out respectively
Based on the preceding bi-directional motion estimation to Block- matching and the bi-directional motion estimation based on backward Block- matching, then according to getting respectively
Minimum sad value and corresponding motion vector obtain final motion vector, the final motion vector accurate description of acquisition
The motion conditions of moving object, solves the phenomenon that moving object caused by motion vector inaccuracy is obscured with background.
Embodiment 5
The present embodiment provides a kind of bi-directional motion estimation system, and embodiment 5 is the deformation on the basis of embodiment 4, its with
The difference of embodiment 4 is calculating a in the final motion vector acquisition module1And a2Process.
Final motion vector acquisition module described in the present embodiment includes calculating a1And a2Process, it is as follows：
Work as SAD1=SAD2When=0, a1=a2=0.5；
Work as SAD1≠ 0 and SAD2When ≠ 0, a1=1-SAD1 2/(SAD1 2+SAD2 2),a2=1-SAD2 2/(SAD1 2+SAD2 2)；
Wherein SAD1For the first sad value, SAD2For the second sad value.
Bi-directional motion estimation system described in the present embodiment, after obtaining previous frame image and current frame image, carry out respectively
Based on the preceding bi-directional motion estimation to Block- matching and the bi-directional motion estimation based on backward Block- matching, then according to getting respectively
Minimum sad value and corresponding motion vector obtain final motion vector, the final motion vector accurate description of acquisition
The motion conditions of moving object, solves the phenomenon that moving object caused by motion vector inaccuracy is obscured with background.
Embodiment 6
The present embodiment provides the system changed on a kind of video frame rate, as shown in fig. 6, including：
Bi-directional motion estimation system described in embodiment 4 or 5, for obtaining final motion vector.
Filtration module, for carrying out final motion vector filtering to interleave image；
Compensating module, for carrying out motion compensation to filtered interleave image；
Blocking effect processing module, for carrying out blocking effect processing to the interleave image after motion compensation；
Interleave image collection module, for obtaining final interleave image.
Converting system on video frame rate described in the present embodiment, final fortune is obtained according to bi-directional motion estimation method and system
Dynamic vector, final motion vector filtering is carried out to interpolation two field picture, carry out motion compensation and blocking effect processing after filtering again, finally
The interleave image of acquisition eliminates the phenomenon and blocking effect phenomenon that moving object is obscured with background, improves the image of interleave image
Quality.Reduce video pictures it is not smooth and discontinuous the problems such as, improve video visual effect.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or computer program
Product.Therefore, the present invention can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.Moreover, the present invention can use the computer for wherein including computer usable program code in one or more
The computer program production that usable storage medium is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram
Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that the instruction of the computing device set by computer or the processing of other programmable datas is produced for realizing
The device for the function of being specified in one flow of flow chart or multiple flows and/or one square frame of block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
Although preferred embodiments of the present invention have been described, but those skilled in the art once know basic creation
Property concept, then can make other change and modification to these embodiments.So appended claims be intended to be construed to include it is excellent
Select embodiment and fall into having altered and changing for the scope of the invention.
Claims (12)
- A kind of 1. bi-directional motion estimation method, it is characterised in that comprise the following steps：Obtain previous frame image and current frame image；Carried out, based on the preceding bi-directional motion estimation to Block- matching, obtaining the first sad value according to previous frame image and current frame image And corresponding first motion vector, first sad value are all SAD obtained based on the preceding bi-directional motion estimation to Block- matching Minimum sad value in value；If there is two or more minimum sad values, then select nearest from current image block Motion vector corresponding to sad value is as first motion vector；Bi-directional motion estimation based on backward Block- matching is carried out according to previous frame image and current frame image, obtains the second sad value And corresponding second motion vector, all SAD that second sad value obtains for the bi-directional motion estimation based on backward Block- matching Minimum sad value in value；If there is two or more minimum sad values, then the SAD nearest from current image block is selected Motion vector corresponding to value is as second motion vector；Obtained most according to first sad value, first motion vector, second sad value and second motion vector Whole motion vector；It is described to be carried out, based on the preceding bi-directional motion estimation to Block- matching, obtaining first according to previous frame image and current frame image The step of sad value and corresponding first motion vector, includes：Block- matching search is carried out with previous frame image to current frame image, obtains motion vector t1；By the motion vector t1Initial value as bi-directional motion estimation；In the motion vector t1Certain threshold range in carry out the Block- matching of previous frame image and current frame image and search for, obtain Take all sad values；Minimum sad value will be chosen in all sad values as the first sad value, motion vector corresponding to the first sad value is first Motion vector；OrIt is described that the bi-directional motion estimation based on backward Block- matching is carried out according to previous frame image and current frame image, obtain second The step of sad value and corresponding second motion vector, includes：Block- matching search is carried out with current frame image to previous frame image, obtains motion vector t2；By the motion vector t2Initial value as bi-directional motion estimation；In the motion vector t2Certain threshold range in carry out the Block- matching of previous frame image and current frame image and search for, obtain Take all sad values；Minimum sad value will be chosen in all sad values as the second sad value, motion vector corresponding to the second sad value is second Motion vector.
- 2. bi-directional motion estimation method according to claim 1, it is characterised in that described according to first sad value, institute The step of the first motion vector, second sad value and second motion vector obtain final motion vector is stated, including is passed through Equation below calculates final motion vector：F=a1*f1+a2*f2Wherein, f represents final motion vector, a1Represent the weights of the first motion vector, a2The weights of the second motion vector are represented, f1Represent the first motion vector, f2Represent the second motion vector, 0<a1<1,0<a2<1。
- 3. bi-directional motion estimation method according to claim 2, it is characterised in that described according to first sad value, institute Stating the step of the first motion vector, second sad value and second motion vector obtain final motion vector also includes meter Calculate a1And a2Process, it is as follows：Work as SAD1+SAD2When=0, a1=a2=0.5；Work as SAD1+SAD2When ≠ 0, a1=1-SAD1/(SAD1+SAD2),a2=1-SAD2/(SAD1+SAD2)；Wherein SAD1For the first sad value, SAD2For the second sad value.
- 4. bi-directional motion estimation method according to claim 2, it is characterised in that described according to first sad value, institute Stating the step of the first motion vector, second sad value and second motion vector obtain final motion vector also includes meter Calculate a1And a2Process, it is as follows：Work as SAD1=SAD2When=0, a1=a2=0.5；Work as SAD1≠ 0 and SAD2When ≠ 0, a1=1-SAD1 2/(SAD1 2+SAD2 2),a2=1-SAD2 2/(SAD1 2+SAD2 2)；Wherein SAD1For the first sad value, SAD2For the second sad value.
- 5. according to any described bi-directional motion estimation methods of claim 1-4, it is characterised in that the sad value is former frame The pixel value of the corresponding pixel points of the image block in image block and current frame image in image absolute difference and.
- 6. a kind of up-conversion method of video frame rate, it is characterised in that comprise the following steps：T1：Final motion vector is obtained using any described bi-directional motion estimation methods of claim 1-5；T2：Final motion vector filtering is carried out to interleave image；T3：Motion compensation is carried out to filtered interleave image；T4：Blocking effect processing is carried out to the interleave image after motion compensation；T5：Obtain final interleave image.
- A kind of 7. bi-directional motion estimation system, it is characterised in that including：Image collection module, for obtaining previous frame image and current frame image；First data acquisition module, for being carried out according to previous frame image and current frame image based on the preceding two-way fortune to Block- matching Dynamic estimation, obtains the first sad value and corresponding first motion vector, and first sad value is to the two-way of Block- matching based on preceding Minimum sad value in all sad values that estimation obtains；If there is two or more minimum sad values, then select Motion vector corresponding to the sad value nearest from current image block is selected as first motion vector；Second data acquisition module, for carrying out the two-way fortune based on backward Block- matching according to previous frame image and current frame image Dynamic estimation, obtains the second sad value and corresponding second motion vector, and second sad value is based on the two-way of backward Block- matching Minimum sad value in all sad values that estimation obtains；If there is two or more minimum sad values, then select Motion vector is as second motion vector corresponding to the sad value nearest from current image block；Final motion vector acquisition module, for according to first sad value, first motion vector, second sad value Final motion vector is obtained with second motion vector；First data acquisition module specifically includes：First forward block matched sub-block, for carrying out Block- matching search with previous frame image to current frame image, obtain motion Vector t1；First initial value sets submodule, for by the motion vector t1Initial value as bi-directional motion estimation；First bi-directional motion estimation submodule, in the motion vector t1Certain threshold range in carry out previous frame image Searched for the Block- matching of current frame image, obtain all sad values；First data acquisition submodule, for will be chosen in all sad values obtained in the first bi-directional motion estimation submodule For minimum sad value as the first sad value, motion vector corresponding to the first sad value is the first motion vector；OrSecond data acquisition module specifically includes：Second backward Block- matching submodule, for carrying out Block- matching search with current frame image to previous frame image, obtain motion Vector t2；Second initial value sets submodule, for by the motion vector t2Initial value as bi-directional motion estimation；Second bi-directional motion estimation submodule, in the motion vector t2Certain threshold range in carry out previous frame image Searched for the Block- matching of current frame image, obtain all sad values；Second data acquisition submodule, for will be chosen in all sad values obtained in the second bi-directional motion estimation submodule For minimum sad value as the second sad value, motion vector corresponding to the second sad value is the second motion vector.
- 8. bi-directional motion estimation system according to claim 7, it is characterised in that wrapped in final motion vector acquisition module Include and final motion vector is calculated by equation below：F=a1*f1+a2*f2Wherein, f represents final motion vector, a1Represent the weights of the first motion vector, a2The weights of the second motion vector are represented, f1Represent the first motion vector, f2Represent the second motion vector, 0<a1<1,0<a2<1。
- 9. bi-directional motion estimation system according to claim 8, it is characterised in that in final motion vector acquisition module also Including calculating a1And a2Process, it is as follows：Work as SAD1+SAD2When=0, a1=a2=0.5；Work as SAD1+SAD2When ≠ 0, a1=1-SAD1/(SAD1+SAD2),a2=1-SAD2/(SAD1+SAD2)；Wherein SAD1For the first sad value, SAD2For the second sad value.
- 10. bi-directional motion estimation system according to claim 8, it is characterised in that in final motion vector acquisition module Also include calculating a1And a2Process, it is as follows：Work as SAD1=SAD2When=0, a1=a2=0.5；Work as SAD1≠ 0 and SAD2When ≠ 0, a1=1-SAD1 2/(SAD1 2+SAD2 2),a2=1-SAD2 2/(SAD1 2+SAD2 2)；Wherein SAD1For the first sad value, SAD2For the second sad value.
- 11. according to any described bi-directional motion estimation systems of claim 7-10, it is characterised in that the first data submodule and In second data submodule, the sad value is that the image block in previous frame image is corresponding with the image block in current frame image The sum of the absolute difference of the pixel value of pixel.
- A kind of 12. system changed on video frame rate, it is characterised in that including：Any described bi-directional motion estimation systems of claim 7-11, for obtaining final motion vector；Filtration module, for carrying out final motion vector filtering to interleave image；Compensating module, for carrying out motion compensation to filtered interleave image；Blocking effect processing module, for carrying out blocking effect processing to the interleave image after motion compensation；Interleave image collection module, for obtaining final interleave image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410495756.8A CN104219533B (en) | 2014-09-24 | 2014-09-24 | A kind of bi-directional motion estimation method and up-conversion method of video frame rate and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410495756.8A CN104219533B (en) | 2014-09-24 | 2014-09-24 | A kind of bi-directional motion estimation method and up-conversion method of video frame rate and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104219533A CN104219533A (en) | 2014-12-17 |
| CN104219533B true CN104219533B (en) | 2018-01-12 |
Family
ID=52100610
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410495756.8A Active CN104219533B (en) | 2014-09-24 | 2014-09-24 | A kind of bi-directional motion estimation method and up-conversion method of video frame rate and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104219533B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016187776A1 (en) * | 2015-05-25 | 2016-12-01 | 北京大学深圳研究生院 | Video frame interpolation method and system based on optical flow method |
| US9906715B2 (en) * | 2015-07-08 | 2018-02-27 | Htc Corporation | Electronic device and method for increasing a frame rate of a plurality of pictures photographed by an electronic device |
| CN105100807B (en) * | 2015-08-28 | 2018-11-13 | 山东大学 | A kind of frame per second method for improving based on motion vector post-processing |
| CN105828184A (en) * | 2015-08-31 | 2016-08-03 | 维沃移动通信有限公司 | Video processing method and mobile terminal |
| CN106101716B (en) * | 2016-07-11 | 2019-05-07 | 北京大学 | A kind of video frame rate upconversion method |
| CN106454378B (en) * | 2016-09-07 | 2019-01-29 | 中山大学 | Converting video coding method and system in a kind of frame per second based on amoeboid movement model |
| CN106998437B (en) * | 2017-03-31 | 2020-07-31 | 武汉斗鱼网络科技有限公司 | Method and device for reconstructing video image |
| CN107172426B (en) * | 2017-06-23 | 2019-10-11 | 西安电子科技大学 | Conversion method in the parallel frame per second of OpenCL based on double MIC |
| CN107707916A (en) * | 2017-09-30 | 2018-02-16 | 河海大学 | A kind of frame per second transfer algorithm based on scene change detecte |
| CN109756778B (en) * | 2018-12-06 | 2021-09-14 | 中国人民解放军陆军工程大学 | Frame rate conversion method based on self-adaptive motion compensation |
| CN110198412B (en) * | 2019-05-31 | 2020-09-18 | 维沃移动通信有限公司 | Video recording method and electronic equipment |
| CN111462021B (en) * | 2020-04-27 | 2023-08-29 | Oppo广东移动通信有限公司 | Image processing method, apparatus, electronic device, and computer-readable storage medium |
| CN111614911B (en) * | 2020-05-08 | 2022-12-09 | Oppo广东移动通信有限公司 | Image generation method and device, electronic device and storage medium |
| CN112565652B (en) * | 2020-11-25 | 2023-03-24 | 紫光展锐(重庆)科技有限公司 | Image data storage method, storage device and computer readable storage medium |
| CN112532907A (en) * | 2020-11-30 | 2021-03-19 | 湖南国科微电子股份有限公司 | Video frame frequency improving method, device, equipment and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1328405A (en) * | 2000-06-13 | 2001-12-26 | 三星电子株式会社 | Format converter using bidirectional motion vector and its method |
| CN101193253A (en) * | 2006-11-30 | 2008-06-04 | 株式会社东芝 | Interpolated frame generating method and interpolated frame generating apparatus |
| CN102088589A (en) * | 2009-12-08 | 2011-06-08 | 英特尔公司 | Frame rate conversion using bi-directional, local and global motion estimation |
| CN102111613A (en) * | 2009-12-28 | 2011-06-29 | 中国移动通信集团公司 | Image processing method and device |
| WO2011094871A1 (en) * | 2010-02-05 | 2011-08-11 | Sensio Technologies Inc. | Method and apparatus of frame interpolation |
| CN103826133A (en) * | 2004-05-04 | 2014-05-28 | 高通股份有限公司 | Method and apparatus for motion compensated frame rate up conversion |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1774794A1 (en) * | 2004-07-20 | 2007-04-18 | Qualcomm Incorporated | Method and apparatus for frame rate up conversion with multiple reference frames and variable block sizes |
| CN102857728B (en) * | 2012-10-12 | 2015-05-20 | 重庆大学 | Video data frame rate up conversion method based on system analysis and design (SAD) and video on demand (VOD) matching rules |
-
2014
- 2014-09-24 CN CN201410495756.8A patent/CN104219533B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1328405A (en) * | 2000-06-13 | 2001-12-26 | 三星电子株式会社 | Format converter using bidirectional motion vector and its method |
| CN103826133A (en) * | 2004-05-04 | 2014-05-28 | 高通股份有限公司 | Method and apparatus for motion compensated frame rate up conversion |
| CN101193253A (en) * | 2006-11-30 | 2008-06-04 | 株式会社东芝 | Interpolated frame generating method and interpolated frame generating apparatus |
| CN102088589A (en) * | 2009-12-08 | 2011-06-08 | 英特尔公司 | Frame rate conversion using bi-directional, local and global motion estimation |
| CN102111613A (en) * | 2009-12-28 | 2011-06-29 | 中国移动通信集团公司 | Image processing method and device |
| WO2011094871A1 (en) * | 2010-02-05 | 2011-08-11 | Sensio Technologies Inc. | Method and apparatus of frame interpolation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104219533A (en) | 2014-12-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104219533B (en) | A kind of bi-directional motion estimation method and up-conversion method of video frame rate and system | |
| CN105517671B (en) | Video frame interpolation method and system based on optical flow method | |
| US9148622B2 (en) | Halo reduction in frame-rate-conversion using hybrid bi-directional motion vectors for occlusion/disocclusion detection | |
| JP5153940B2 (en) | System and method for image depth extraction using motion compensation | |
| US8724022B2 (en) | Frame rate conversion using motion estimation and compensation | |
| TWI455588B (en) | Bi-directional, local and global motion estimation based frame rate conversion | |
| CN105100807B (en) | A kind of frame per second method for improving based on motion vector post-processing | |
| CN103428516B (en) | Method, circuit and system for stablizing digital picture | |
| CN106210449B (en) | Multi-information fusion frame rate up-conversion motion estimation method and system | |
| Yu et al. | Multi-level video frame interpolation: Exploiting the interaction among different levels | |
| US10349058B2 (en) | Method for predicting depth map coding distortion of two-dimensional free viewpoint video | |
| CN103220488A (en) | Up-conversion device and method of video frame rate | |
| CN103460242A (en) | Information processing device, information processing method, and data structure of location information | |
| KR20060133764A (en) | Intermediate vector interpolation method and 3d display apparatus | |
| CN103369208A (en) | Self-adaptive de-interlacing method and device | |
| US20100026888A1 (en) | Image processing method and system with repetitive pattern detection | |
| JP2000253422A (en) | Method for generating three-dimensionall image from two-dimensional image | |
| CN104270624A (en) | Region-partitioning 3D video mapping method | |
| JP2004356747A (en) | Method and apparatus for matching image | |
| CN112532907A (en) | Video frame frequency improving method, device, equipment and medium | |
| US9106926B1 (en) | Using double confirmation of motion vectors to determine occluded regions in images | |
| CN107124617B (en) | Method and system for generating random vector in motion estimation motion compensation | |
| JP2009295029A (en) | Moving quantity detection device and moving quantity detection method | |
| JP2014072809A (en) | Image generation apparatus, image generation method, and program for the image generation apparatus | |
| JP5448983B2 (en) | Resolution conversion apparatus and method, scanning line interpolation apparatus and method, and video display apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220908 Address after: No.131 Jinshan Road, Jiangsu Province Patentee after: SUZHOU KEDA TECHNOLOGY Co.,Ltd. Patentee after: Shanghai Kefada Transportation Facilities Engineering Co.,Ltd. Patentee after: Shanghai Weihong Technology Co.,Ltd. Address before: No.131 Jinshan Road, Jiangsu Province Patentee before: SUZHOU KEDA TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |