CN103051857B - Motion compensation-based 1/4 pixel precision video image deinterlacing method - Google Patents

Motion compensation-based 1/4 pixel precision video image deinterlacing method Download PDF

Info

Publication number
CN103051857B
CN103051857B CN201310030625.8A CN201310030625A CN103051857B CN 103051857 B CN103051857 B CN 103051857B CN 201310030625 A CN201310030625 A CN 201310030625A CN 103051857 B CN103051857 B CN 103051857B
Authority
CN
China
Prior art keywords
point
search
test points
pixel
interpolation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310030625.8A
Other languages
Chinese (zh)
Other versions
CN103051857A (en
Inventor
吴家骥
焦李成
孙晨艳
白静
马文萍
马晶晶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xidian University
Original Assignee
Xidian University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xidian University filed Critical Xidian University
Priority to CN201310030625.8A priority Critical patent/CN103051857B/en
Publication of CN103051857A publication Critical patent/CN103051857A/en
Application granted granted Critical
Publication of CN103051857B publication Critical patent/CN103051857B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses a motion compensation-based 1/4 pixel precision video image deinterlacing method, to mainly solve the problem that the motion estimation precision in the conventional motion compensation deinterlacing method is limited. The method comprises the following steps of: reading an interlacing video sequence; selecting a corresponding interpolation field and a reference field; applying a sixth order limited impact response filter to carry out semi-pixel interpolation in the reference field; applying a complete pixel point and a semi-pixel point to a 1/4 pixel point of the reference field so as to carry out linear interpolation; applying an effective three-step searching method E3SS to carry out motion estimation on the complete pixel and the sub-pixel of the reference field; searching for a motion vector with the minimum absolute error and SAD; carrying out bidirectional motion estimation on the reference field so as to obtain two motion vectors; taking one with the minimum absolute error and SAD as the motion vector of a present block; and utilizing a corresponding reference block to carry out motion compensation according to the motion vector of the present block so as to obtain a deinterlacing image. According to the method, on the premise that the calculation complexity is not increased, the image quality is improved, and therefore the method can be used for deinterlacing of video images.

Description

Based on 1/4 pixel precision video image interlace-removing method of motion compensation
Technical field
The invention belongs to technical field of image processing, relate to the conversion of video image interlaced scan format to progressive-scan format, can be used for the de interlacing process of horizontally interlaced image to progressive scanning picture, is one of de-interlaced study hotspot of video image in recent years.
Background technology
At present along with the development of various novel display device, new television broadcast format, there is format standards different in a large number at video field.In order to realize the interchange between different-format vision signal, video format changes indispensable.In current television broadcasting system, most video signal source adopts interlacing scan, and this mode can reduce bandwidth demand, but can cause creep, film flicker, edge blurry and crenellated phenomena.Deinterlacing technique is a key technology of format conversion, is also the basis of extended formatting switch technology.So-called " de interlacing ", namely from interlaced scan format to the conversion of progressive-scan format.
In order to overcome the phenomenons such as fuzzy, the sawtooth that brings when interlaced picture is converted to progressive image, there has been proposed many different interlace-removing methods, according to the time sequencing of deinterlacing technique development, be followed successively by: linear interlace-removing method, comprises spatial domain linear filtering, time domain linear filtering, time-space domain linear filtering; Non-linear interlace-removing method, comprises the interlace-removing method based on edge self-adaption, the interlace-removing method based on medium filtering, interlace-removing method based on Motion Adaptive; Based on the interlace-removing method of motion compensation, it is current state-of-the-art interlace-removing method.
Motion compensation deinterlacing method has two important processes: motion estimation and compensation.For sequence of video images, between consecutive frame and frame, there is stronger correlation, estimation be exactly to multiframe between the estimation of movable information.Motion compensation does interpolation arithmetic according to the result of estimation.Motion estimation and compensation is widely used in Digital Video Processing.Such as H.261, H.263, H.264 and in MPEG-1, MPEG-2, MPEG-4 compression standard, motion estimation and compensation has all been used.In de interlacing Video processing, before and after estimation application, the movable information of field, obtains motion vector MV, then carries out interpolation along movement locus and carry out reconstructed frame.In general, if the motion vector obtained is enough accurate, motion compensation process will obtain best de interlacing effect.This interlace-removing method can keep the vertical definition of image well.
Estimation is the basis of motion compensation process, is also the most important step of motion compensation deinterlacing method.Had multi-motion method of estimation at present, conventional has BMA, Bayes's estimation etc.BMA is the most frequently used a kind of method for estimating, its basic thought is image block image being divided into N × N number of fixed size, non-overlapping copies, and suppose that in sub-block, all pixels all have identical kinematic parameter, namely the motion of each sub-block is translation of rigid body, processes respectively every block.N × N number of sub-block of current field searches the sub-block of mating most with it according to certain matching criterior in the sub-block neighborhood window that reference field is corresponding, and the displacement on two dimensional surface of current sub-block and match block is the motion vector that estimation obtains.The advantage of block-based motion estimation is to calculate simply, amount of calculation is little and hardware implementing simple, and precision and complexity aspect have compromise preferably.
Motion compensation is that the movement locus described by motion vector obtained according to estimation carries out image interpolation, so just be equivalent to a motion sequence to become a static sequence virtually, therefore also just can utilize the method processing moving of rest image interpolation.Conventional motion compensation has the methods such as forward motion compensation, reverse compensation, bi directional motion compensation and the motion compensation of many hypothesis.
At present, the interlace-removing method based on Motion estimation and compensation is formed primarily of Integer Pel estimation, motion compensation.Wherein estimation adopts Integer Pel Block-matching rapid motion estimating method, what motion compensation adopted is bi directional motion compensation mode, the weak point of this method is: the motion vector displacement in Integer Pel motion estimation search range is all Integer Pel rank, if in video sequence there is the motion of fraction pixel level in object, existing Integer Pel motion estimation search precision is not enough, accurately cannot obtain the motion vector of real motion, relatively optimum match block can only be found in Integer Pel level hunting zone, thus cause obvious blocking effect, not good to interlaced video images de interlacing treatment effect.
Summary of the invention
The object of the invention is to for above-mentioned the deficiencies in the prior art, the 1/4 pixel precision Block-matching image interlace-removing method based on motion estimation and compensation is proposed, to improve the search accuracy of block-based motion estimation, improve interlaced video images de interlacing treatment effect.
For achieving the above object, technical solution of the present invention comprises the steps:
(1) read in the actual interlaced video sequence that a size is 100 of the raw form of 352 × 288, choose an interpolation field and two reference field, the reference field wherein chosen is the forward field of interpolation field and backward field;
(2) between the Integer Pel point of forward and backward reference field, half-pix point is produced:
Apply adjacent Integer Pel point to carry out interpolation and obtain half-pix point, wherein interpolation method is that application six rank finite impulse response filters are weighted adjacent Integer Pel point, and filter weights is:
(1/32,-5/32,5/8,5/8,-5/32,1/32);
(3) after obtaining all half-pixel position pixels, carry out linear interpolation by contiguous Integer Pel point and half-pix point, obtain the pixel of 1/4 location of pixels;
(4) effective three step search algorithm E3SS is used to carry out block-based motion estimation to reference field Integer Pel, 1/2 pixel, 1/4 location of pixels, find absolute error and the minimum best matching blocks of SAD, when displacement vector is (i, j), absolute error and SAD are defined as follows:
SAD ( i , j ) = Σ m = 1 M Σ n = 1 N | f k ( m , n ) - f k - 1 ( m + i , n + j ) | ,
In formula, f kand f k-1be the gray value of current field and forward field corresponding pixel points respectively, M × N is macroblock size;
(5) bi-directional motion estimation is carried out to forward and backward reference field, obtain two motion vector (dx 1, dy 1), (dx 2, dy 2), get the motion vector (dx, dy) of a minimum motion vector of wherein absolute error and SAD as current macro;
(6) according to the motion vector (dx, dy) of current macro, corresponding reference macroblock in application forward and backward reference field, linear interpolation obtains interpolation macro block F (x, y; K):
F ( x , y ; k ) = F ( x - dx , y - dy ; k - 1 ) + F ( x + dx , y + dy ; k + 1 ) 2 ,
Wherein, the coordinate that (x, y) is macro block, F (x-dx, y-dy; K-1) be the reference macroblock that forward direction reference field application motion vector (dx, dy) obtains, F (x+dx, y+dy; K+1) be reference macroblock that backward reference field application motion vector (dx, dy) obtains;
(7) interpolation macro block F (x, y is merged; K) and current macro, the progressive image macro block after de interlacing is obtained.
The present invention carries out linear interpolation owing to adopting contiguous Integer Pel point and half-pix point, obtains the pixel of 1/4 location of pixels, therefore can effectively improve motion estimation search precision; Simultaneously because the present invention adopts six rank finite response filters to carry out interpolation to Integer Pel point, obtain the half-pix point that interpolation is more excellent, can the impact that suddenlys change on interpolation of pixel that effectively removal of images noise causes; In addition because the present invention uses effective three step search algorithm E3SS to carry out block-based motion estimation search to integer, fractional pixel position, thus computation complexity is reduced, and it is effective to motion intense image difference, can ensure, under the prerequisite that interpolation calculation complexity is suitable, effectively to improve the image visual effect after interpolation.
Accompanying drawing explanation
Fig. 1 is flow chart of the present invention;
Fig. 2 is the test video image that the present invention uses;
Fig. 3 is the search pattern of a kind of effective three step search algorithm E3SS that the present invention applies;
Fig. 4 is that the present invention and existing Integer Pel motion compensation de interlacing method are schemed the Experimental comparison that football sequence carries out de interlacing process;
Fig. 5 is that the present invention and existing Integer Pel motion compensation de interlacing method are schemed the Experimental comparison that soccer sequence carries out de interlacing process.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
With reference to Fig. 1, implementation step of the present invention is as follows:
Step 1, choose interpolation field and reference field:
Read in the actual interlaced video sequence that a size is 100 of the raw form of 352 × 288, interpolation field is chosen from initial field to end field successively according to time sequencing, choose a field as behind interpolation field, two reference field are respectively the forward field of the interpolation field chosen and backward field.
Step 2, produces half-pix point between the Integer Pel point of forward and backward reference field.
Different according to interpolation half-pix point and adjacent Integer Pel point distance, apply different pixel interpolation and obtain half-pix point, implementation step is as follows:
(2a) for the half-pix point closing on horizontal direction integer position, by applying six rank finite impulse response filters, the contiguous Integer Pel point in left and right is weighted, interpolation obtains interpolation half-pix point, wherein filter weights is: (1/32,-5/32,5/8,5/8,-5/32,1/32);
(2b) for the half-pix point closing on vertical direction integer position, by applying six rank finite impulse response filters, Integer Pel point contiguous is up and down weighted, interpolation obtains interpolation half-pix point, wherein filter weights is: (1/32,-5/32,5/8,5/8,-5/32,1/32);
(2c) for the pixel of the half-pixel position of remainder, by applying six rank finite impulse response filters, six levels or the known contiguous half-pix point of vertical direction are weighted, interpolation obtains interpolation half-pix point, wherein filter weights is: (1/32,-5/32,5/8,5/8,-5/32,1/32).
Step 3, obtain all half-pixel position pixels in reference field after, according to interpolation 1/4 pixel and adjacent Integer Pel point, half-pix point distance different, apply different Integer Pel points and half-pix point interpolation obtains 1/4 pixel, implementation step is as follows:
(3a) for 1/4th pixels of closing on horizontal direction Integer Pel and half-pixel position, be that the Integer Pel point that is close to by left and right and half-pix point carry out linear interpolation and obtain;
(3b) for 1/4th pixels of closing on vertical direction Integer Pel and half-pixel position, be carry out linear interpolation by the Integer Pel point be close to up and down and half-pix point to obtain;
(3c) for the pixel of 1/4th location of pixels of remainder, be carry out linear interpolation with two half-pix points of adjacent diagonal line position to obtain.
Step 4, use effective three step search algorithm E3SS to carry out block-based motion estimation to the Integer Pel of reference field, 1/2 pixel, 1/4 location of pixels.
With reference to Fig. 3, being implemented as follows of this step:
(4a) to Integer Pel position, search for 13 test points in this E3SS template, if minimal error point is search window Spot detection point, the reference macroblock that then this minimal error point is corresponding is best match reference macro block, search terminates, and obtains the motion vector (i that a best match reference macro block is corresponding int, j int); If minimal error point is in outer 8 test points of 13 test points, three step search algorithm 3SS is adopted to proceed block-based motion estimation search; If minimal error point is in 4 test points of the interior rhombus of 13 test points, using the central point of minimal error point now as 4 test points of rhombus in next step search, continue interior rhombus 4 test points that search is corresponding, until minimal error point is central point or the search arrival search window boundary position of interior rhombus 4 test points; After terminating search, obtain the motion vector (i that best match reference macro block is corresponding int, j int);
(4b) to 1/2 location of pixels, search for 13 test points in this E3SS template, if minimal error point is search window Spot detection point, the reference macroblock that then this minimal error point is corresponding is best match reference macro block, search terminates, and obtains the motion vector (i that a best match reference macro block is corresponding 1/2, j 1/2); If minimal error point is in outer 8 test points of 13 test points, three step search algorithm 3SS is adopted to proceed block-based motion estimation search; If minimal error point is in 4 test points of the interior rhombus of 13 test points, using the central point of minimal error point now as 4 test points of rhombus in next step search, continue interior rhombus 4 test points that search is corresponding, until minimal error point is central point or the search arrival search window boundary position of interior rhombus 4 test points; After terminating search, obtain the motion vector (i that best match reference macro block is corresponding 1/2, j 1/2);
(4c) to 1/4 location of pixels, search for 13 test points in this E3SS template, if minimal error point is search window Spot detection point, the reference macroblock that then this minimal error point is corresponding is best match reference macro block, search terminates, and obtains the motion vector (i that a best match reference macro block is corresponding 1/4, j 1/4); If minimal error point is in outer 8 test points of 13 test points, three step search algorithm 3SS is adopted to proceed block-based motion estimation search; If minimal error point is in 4 test points of the interior rhombus of 13 test points, using the central point of minimal error point now as 4 test points of rhombus in next step search, continue interior rhombus 4 test points that search is corresponding, until minimal error point is central point or the search arrival search window boundary position of interior rhombus 4 test points; After terminating search, obtain the motion vector (i that best match reference macro block is corresponding 1/4, j 1/4);
(4d) from the motion vector (i that Integer Pel, 1/2 pixel, the search of 1/4 location of pixels obtain int, j int), (i 1/2, j 1/2), (i 1/4, j 1/4) in, choose absolute error and the minimum motion vector of SAD, as the optimum movement vector (i, j) that the effective three step search algorithm E3SS of application obtains.
Step 5, carries out search respectively compare the Integer Pel of forward and backward reference macroblock, 1/2 pixel, 1/4 location of pixels, obtain the motion vector (dx of forward direction reference macroblock 1, dy 1) and the motion vector (dx of backward reference macroblock 2, dy 2), get the motion vector (dx, dy) of a minimum motion vector of wherein absolute error and SAD as current macro.
Step 6, according to the motion vector (dx, dy) of current macro, corresponding reference macroblock in application forward and backward reference field, linear interpolation obtains interpolation macro block F (x, y; K):
F ( x , y ; k ) = F ( x - dx , y - dy ; k - 1 ) + F ( x + dx , y + dy ; k + 1 ) 2 ,
Wherein, k is the sequence number of interpolation field in image sequence, the coordinate that (x, y) is macro block, F (x, y; K) be coordinate with (x, y) in a kth interpolation field interpolation macro block, F (x-dx, y-dy; K-1) be the reference macroblock that forward direction reference field application motion vector (dx, dy) obtains, F (x+dx, y+dy; K+1) be reference macroblock that backward reference field application motion vector (dx, dy) obtains.
Step 7, by interpolation macro block F (x, y; K) insert current macro line by line, form the image macro that a line number is current macro line number two times, this image macro is the progressive image macro block after de interlacing.
Effect of the present invention can be further illustrated by following emulation experiment and contrast objective evaluation index:
1) emulation experiment condition:
Experimental situation of the present invention is Microsoft Visual Studio 2010, the actual interlaced video sequence of experiment initial data to be two sizes be 100 of the raw form of 352 × 288, for cycle tests football and the soccer sequence of classics, Fig. 2 (a) is the snapshot of football sequence, and Fig. 2 (b) is the snapshot of soccer sequence.
The objective evaluation index that the present invention uses is Y-PSNR PSNR, is defined as follows:
Assuming that: the size of two width images is X × Y, makes f (x, y) represent original image, represent the image after interpolation, objective evaluation index peak signal to noise ratio PSNR is defined as:
PSNR = 101 g { 255 2 1 XY Σ x = 1 X Σ y = 1 Y [ f ( x , y ) - f ^ ( x , y ) ] 2 } .
2) emulation experiment content:
Emulation experiment 1, to the football sequence shown in Fig. 2 (a), use Integer Pel motion compensation deinterlacing method to carry out experiment simulation and obtain a Y-PSNR PSNR curve, use 1/4 pixel precision motion compensation deinterlacing method of the present invention to carry out experiment simulation and obtain a Y-PSNR PSNR curve, contrasted by two Y-PSNR PSNR curves, result as shown in Figure 4;
Emulation experiment 2, to the soccer sequence shown in Fig. 2 (b), use Integer Pel motion compensation deinterlacing method to carry out experiment simulation and obtain a Y-PSNR PSNR curve, use 1/4 pixel precision motion compensation deinterlacing method of the present invention to carry out experiment simulation and obtain a Y-PSNR PSNR curve, contrasted by two Y-PSNR PSNR curves, result as shown in Figure 5.
3) interpretation:
As can be seen from Fig. 4 comparative result, for the classical cycle tests football that there is strenuous exercise, compare Integer Pel fast motion estimation de interlacing effect, the effect of 1/4 pixel precision motion compensation deinterlacing method to the process of image de interlacing using the present invention to propose has obvious lifting;
As can be seen from Fig. 5 comparative result, for exist scene, personage's integrated motion classical cycle tests soccer, compare Integer Pel fast motion estimation de interlacing effect, the effect of 1/4 pixel precision motion compensation deinterlacing method to the process of image de interlacing using the present invention to propose has obvious lifting;
To sum up, the 1/4 pixel precision Block-matching image interlace-removing method based on motion compensation that the present invention proposes, the basis of existing Integer Pel precise movements estimation interlace-removing method adds 1/2 pixel precision and 1/4 pixel precision image interpolation, motion estimation search range is expanded, the precision of motion-vector search improves, interlace-removing method is estimated relative to Integer Pel precise movements, image PSNR evaluation criterion of the present invention has and significantly promotes, under the prerequisite ensureing computation complexity, effectively can improve the visual effect of the video image after de interlacing.

Claims (4)

1., based on a 1/4 pixel precision video image interlace-removing method of motion compensation, comprise the steps:
(1) read in the actual interlaced video sequence that a size is 100 of the raw form of 352 × 288, choose an interpolation field and two reference field, the reference field wherein chosen is the forward direction reference field of interpolation field and backward reference field;
(2) between the Integer Pel point of forward and backward reference field, half-pix point is produced:
Apply adjacent Integer Pel point to carry out interpolation and obtain half-pix point, wherein interpolation method is that application six rank finite impulse response filters are weighted adjacent Integer Pel point, and filter weights is:
(1/32,-5/32,5/8,5/8,-5/32,1/32);
(3) after obtaining all half-pixel position pixels, carry out linear interpolation by contiguous Integer Pel point and half-pix point, obtain the pixel of 1/4 location of pixels;
(4) effective three step search algorithm E3SS is used to carry out block-based motion estimation to reference field Integer Pel, 1/2 pixel, 1/4 location of pixels, find absolute error and the minimum best matching blocks of SAD, when displacement vector is (i, j), absolute error and SAD are defined as follows:
In formula, f kand f k-1the size of the gray value of interpolation field and forward direction reference field corresponding pixel points, M × N presentation video macro block respectively;
(5) bi-directional motion estimation is carried out to forward and backward reference field, obtain two motion vector (dx 1, dy 1), (dx 2, dy 2), get the motion vector (dx, dy) of a minimum motion vector of wherein absolute error and SAD as current macro;
(6) according to the motion vector (dx, dy) of current macro ,corresponding reference macroblock in application forward and backward reference field, linear interpolation obtains interpolation macro block F (x, y; K):
Wherein, k is the sequence number of interpolation field in image sequence, the coordinate that (x, y) is macro block, F (x, y; K) be coordinate with (x, y) in a kth interpolation field interpolation macro block, F (x-dx, y-dy; K-1) be the reference macroblock that forward direction reference field application motion vector (dx, dy) obtains, F (x+dx, y+dy; K+1) be reference macroblock that backward reference field application motion vector (dx, dy) obtains;
(7) interpolation macro block F (x, y is merged; K) and current macro, the progressive image macro block after de interlacing is obtained.
2. image interlace-removing method according to claim 1, wherein apply adjacent Integer Pel point described in step (2) to carry out interpolation and obtain half-pix point, be different according to half-pix point and adjacent Integer Pel point distance, apply different pixels and carry out interpolation, that is:
For the half-pix point closing on horizontal direction integer position, be by applying six rank finite impulse response filters, six the integer position pixel points contiguous to left and right are weighted and obtain, and the weights of filter are:
(1/32,-5/32,5/8,5/8,-5/32,1/32);
For the half-pix point closing on vertical direction integer position, being by applying six rank finite impulse response filters, six contiguous up and down integer position pixel points being weighted and obtaining;
For the pixel of the half-pixel position of remainder, being by applying six rank finite impulse response filters, six levels or the known contiguous half-pix point of vertical direction being weighted and obtaining.
3. image interlace-removing method according to claim 1, wherein described in step (3) after obtaining all half-pixel position pixels, linear interpolation is carried out by contiguous Integer Pel point and half-pix point, obtain the pixel of 1/4 location of pixels, be according to 1/4 pixel and adjacent Integer Pel point, half-pix point distance different, apply different Integer Pel points and half-pix point carries out interpolation, that is:
For 1/4th pixels of closing on horizontal direction Integer Pel and half-pixel position, be that the Integer Pel point that is close to by left and right and half-pix point carry out linear interpolation and obtain;
For 1/4th pixels of closing on vertical direction Integer Pel and half-pixel position, be carry out linear interpolation by the Integer Pel point be close to up and down and half-pix point to obtain;
For the pixel of 1/4th location of pixels of remainder, be carry out linear interpolation with two half-pix points of adjacent diagonal line position to obtain.
4. image interlace-removing method according to claim 1, the effective three step search algorithm E3SS of utilization wherein described in step (4) is to reference field Integer Pel, 1/2 pixel, 1/4 location of pixels carries out block-based motion estimation, undertaken by effective three step search algorithm E3SS template, this E3SS template is provided with 13 test points, these test points comprise 8 test points according to outer rectangular, interior diamond comprises 4 test points, 1 window center test point regularly arranged, the corresponding reference field macro block of each test point, absolute error between current macro and reference macroblock and the minimum test point of SAD are minimal error point, apply this effective three step search algorithm E3SS and carry out block-based motion estimation, carry out in accordance with the following steps:
(4a) to Integer Pel position, search for 13 test points in this E3SS template, if minimal error point is search window Spot detection point, the reference macroblock that then this minimal error point is corresponding is best match reference macro block, search terminates, and obtains the motion vector (i that a best match reference macro block is corresponding int, j int); If minimal error point is in outer 8 test points of 13 test points, three step search algorithm 3SS is adopted to proceed block-based motion estimation search; If minimal error point is in 4 test points of the interior rhombus of 13 test points, using the central point of minimal error point now as 4 test points of rhombus in next step search, continue interior rhombus 4 test points that search is corresponding, until minimal error point is central point or the search arrival search window boundary position of interior rhombus 4 test points; After terminating search, obtain the motion vector (i that best match reference macro block is corresponding int, j int);
(4b) to 1/2 location of pixels, search for 13 test points in this E3SS template, if minimal error point is search window Spot detection point, the reference macroblock that then this minimal error point is corresponding is best match reference macro block, search terminates, and obtains the motion vector (i that a best match reference macro block is corresponding 1/2, j 1/2); If minimal error point is in outer 8 test points of 13 test points, three step search algorithm 3SS is adopted to proceed block-based motion estimation search; If minimal error point is in 4 test points of the interior rhombus of 13 test points, using the central point of minimal error point now as 4 test points of rhombus in next step search, continue interior rhombus 4 test points that search is corresponding, until minimal error point is central point or the search arrival search window boundary position of interior rhombus 4 test points; After terminating search, obtain the motion vector (i that best match reference macro block is corresponding 1/2, j 1/2);
(4c) to 1/4 location of pixels, search for 13 test points in this E3SS template, if minimal error point is search window Spot detection point, the reference macroblock that then this minimal error point is corresponding is best match reference macro block, search terminates, and obtains the motion vector (i that a best match reference macro block is corresponding 1/4, j 1/4); If minimal error point is in outer 8 test points of 13 test points, three step search algorithm 3SS is adopted to proceed block-based motion estimation search; If minimal error point is in 4 test points of the interior rhombus of 13 test points, using the central point of minimal error point now as 4 test points of rhombus in next step search, continue interior rhombus 4 test points that search is corresponding, until minimal error point is central point or the search arrival search window boundary position of interior rhombus 4 test points; After terminating search, obtain the motion vector (i that best match reference macro block is corresponding 1/4, j 1/4);
(4d) to the motion vector (i that Integer Pel, 1/2 pixel, the search of 1/4 location of pixels obtain int, j int), (i 1/2, j 1/2), (i 1/4, j 1/4), choose the motion vector that wherein absolute error and SAD are minimum, as the optimum movement vector (i, j) that the effective three step search algorithm E3SS of application obtains.
CN201310030625.8A 2013-01-25 2013-01-25 Motion compensation-based 1/4 pixel precision video image deinterlacing method Expired - Fee Related CN103051857B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310030625.8A CN103051857B (en) 2013-01-25 2013-01-25 Motion compensation-based 1/4 pixel precision video image deinterlacing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310030625.8A CN103051857B (en) 2013-01-25 2013-01-25 Motion compensation-based 1/4 pixel precision video image deinterlacing method

Publications (2)

Publication Number Publication Date
CN103051857A CN103051857A (en) 2013-04-17
CN103051857B true CN103051857B (en) 2015-07-15

Family

ID=48064345

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310030625.8A Expired - Fee Related CN103051857B (en) 2013-01-25 2013-01-25 Motion compensation-based 1/4 pixel precision video image deinterlacing method

Country Status (1)

Country Link
CN (1) CN103051857B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516726B (en) * 2015-11-27 2019-04-09 传线网络科技(上海)有限公司 The motion compensation matching process and system of Video coding
CN106303340B (en) * 2016-09-20 2019-02-15 天津大学 A kind of bi-directional motion estimation interlace-removing method
CN106998437B (en) * 2017-03-31 2020-07-31 武汉斗鱼网络科技有限公司 Method and device for reconstructing video image
CN109831672B (en) * 2019-01-09 2020-10-27 北京大学 Motion estimation method of space-time pulse array, electronic equipment and storage medium
CN109951713B (en) * 2019-03-11 2023-02-28 深圳信息职业技术学院 Motion estimation compensation circuit and method for video de-interlacing
CN110263699B (en) * 2019-06-17 2021-10-22 睿魔智能科技(深圳)有限公司 Video image processing method, device, equipment and storage medium
CN113246859B (en) * 2021-05-28 2023-04-07 深圳天联星科技有限公司 Electronic rearview mirror with driving auxiliary system warning function
CN116016831B (en) * 2022-12-13 2023-12-05 湖南快乐阳光互动娱乐传媒有限公司 Low-time-delay image de-interlacing method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1234447A1 (en) * 1999-11-05 2002-08-28 Demografx System and method for motion compensation and frame rate conversion
CN1846437A (en) * 2003-09-07 2006-10-11 微软公司 Innovations in coding and decoding macroblock and motion information for interlaced and progressive scan video
CN101340539A (en) * 2007-07-06 2009-01-07 北京大学软件与微电子学院 Deinterlacing video processing method and system by moving vector and image edge detection
CN101510985A (en) * 2009-02-27 2009-08-19 西安交通大学 Self-adapting de-interleave method for movement compensation accessory movement

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8160160B2 (en) * 2005-09-09 2012-04-17 Broadcast International, Inc. Bit-rate reduction for multimedia data streams

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1234447A1 (en) * 1999-11-05 2002-08-28 Demografx System and method for motion compensation and frame rate conversion
CN1846437A (en) * 2003-09-07 2006-10-11 微软公司 Innovations in coding and decoding macroblock and motion information for interlaced and progressive scan video
CN101340539A (en) * 2007-07-06 2009-01-07 北京大学软件与微电子学院 Deinterlacing video processing method and system by moving vector and image edge detection
CN101510985A (en) * 2009-02-27 2009-08-19 西安交通大学 Self-adapting de-interleave method for movement compensation accessory movement

Also Published As

Publication number Publication date
CN103051857A (en) 2013-04-17

Similar Documents

Publication Publication Date Title
CN103051857B (en) Motion compensation-based 1/4 pixel precision video image deinterlacing method
KR100482898B1 (en) Method, device, and video display device including the device for estimating motion vectors
Wang et al. Frame rate up-conversion using trilateral filtering
Kang et al. Motion compensated frame rate up-conversion using extended bilateral motion estimation
CN104363451B (en) Image prediction method and relevant apparatus
KR100530223B1 (en) Frame interpolation method and apparatus at frame rate conversion
CN1270526C (en) Device and method for using adaptive moving compensation conversion frame and/or semi-frame speed
KR0171154B1 (en) Method and apparatus for encoding video signals using feature point based motion prediction
CN1237796C (en) Interpolating picture element data selection for motion compensation and its method
CN104219533B (en) A kind of bi-directional motion estimation method and up-conversion method of video frame rate and system
CN103702128B (en) A kind of interpolation frame generating method being applied on video frame rate conversion
CN101621693B (en) Frame frequency lifting method for combining target partition and irregular block compensation
Yu et al. Multi-level video frame interpolation: Exploiting the interaction among different levels
CN102025960B (en) Motion compensation de-interlacing method based on adaptive interpolation
JPH06506578A (en) Method for estimating motion content in video signals
CN110312132A (en) A kind of decoding method, device and its equipment
CN103369208A (en) Self-adaptive de-interlacing method and device
WO2008152951A1 (en) Method of and apparatus for frame rate conversion
Tai et al. A multi-pass true motion estimation scheme with motion vector propagation for frame rate up-conversion applications
Heinrich et al. Optimization of hierarchical 3DRS motion estimators for picture rate conversion
CN102447870A (en) Detection method for static objects and motion compensation device
Cho et al. Temporal frame interpolation based on multiframe feature trajectory
KR101544158B1 (en) Method for searching bidirectional motion using multiple frame and image apparatus with the same technique
CN102364933A (en) Motion-classification-based adaptive de-interlacing method
Han et al. Frame rate up-conversion for high-definition video applications

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150715

Termination date: 20200125