CN101521761B - Method and device for image deinterlacing using horizontal displacement estimation and compensation - Google Patents

Abstract

A de-interlacing method and a de-interlacing device. The de-interlacing method is used for de-interlacing a video data, the video data includes a first field, a second field, a third field, a fourth field and a fifth field, the video data generates an output frame when the third field is output, the method includes the following steps: estimating the horizontal displacement according to at least one group of the first field, the third field, the fifth field and the second field and the fourth field to detect a horizontal displacement vector; and if the horizontal displacement vector is detected, selecting a first pixel from the second field and a second pixel from the fourth field according to the horizontal displacement vector, and interpolating a specific pixel value corresponding to a target pixel in the output frame according to the first pixel and the second pixel.

Description

Method and device for image deinterlacing using horizontal displacement estimation and compensation

technical field

The present invention provides an image de-interlacing method and device, especially an image de-interlacing method and device using horizontal motion estimation and horizontal motion compensation. the

Background technique

The traditional interlaced scanning technology is to interleave the two fields that make up the frame. The two fields consist of an odd field and an even field. The progressive scan technology, also known as non-interlaced scan (non-interlaced), first merges two fields into one frame, and then scans all the scans in the frame in sequence at a doubled horizontal scan frequency. lines to improve the picture quality. the

In order to display interlaced image data in a sequential scanning manner, it is necessary to use a de-interlacing method to interpolate a new scanning line between two original continuous scanning lines in a field. In the prior art, a motion-adaptive (motion-adaptive) processing method is commonly used to perform the de-interlacing operation. the

However, when de-interlacing is performed using displacement adaptability, most of the high-frequency and moving details cannot be interpolated, and if the video data is processed by video encode/decode before de-interlacing , the flooding phenomenon will make the high-frequency part more distorted, making it difficult to interpolate the original image, and then make the picture quality of the de-interlaced image poor. the

Contents of the invention

Therefore, the main purpose of the present invention is to provide a method and device for image deinterlacing that can detect a horizontal displacement vector between fields of the same type and perform horizontal displacement compensation on a target pixel of an output frame according to the horizontal displacement vector , to improve image quality and reduce related hardware costs. the

According to an embodiment of the present invention, it discloses a de-interlacing method for de-interlacing a video data. The video data includes a first, second, third, fourth and fifth field, and an output frame is generated when the video data is output in the third field. The method includes the following steps: performing horizontal displacement estimation to detect a horizontal displacement vector according to at least one of the first and third fields, the third and fifth fields, and the second and fourth fields; and if the horizontal displacement vector is detected, selecting a first pixel from the second field and a second pixel from the fourth field according to the horizontal displacement vector, and selecting a second pixel from the fourth field according to the first pixel and the second pixel to interpolate a specific pixel value corresponding to a target pixel in the output frame. the

According to an embodiment of the present invention, it further discloses a de-interlacing device for de-interlacing a video data. The video data includes a first, second, third, fourth and fifth field, and an output frame is generated when the video data is output in the third field. The device includes a horizontal displacement estimation unit and a horizontal displacement compensation unit. The horizontal displacement estimation unit performs horizontal displacement estimation according to at least one of the first and third fields, the third and fifth fields, and the second and fourth fields to detect a horizontal displacement vector. The horizontal displacement compensation unit is coupled to the horizontal displacement estimation unit, wherein if the horizontal displacement estimation unit detects the horizontal displacement vector, selects a first pixel from the second field according to the horizontal displacement vector and A second pixel is selected in the fourth field, and a specific pixel value corresponding to a target pixel in the output frame is interpolated according to the first pixel and the second pixel. the

Description of drawings

FIG. 1 is a schematic diagram of a video data including five adjacent fields and a corresponding output frame. the

FIG. 2 is a schematic diagram of a deinterleaving device according to an embodiment of the present invention. the

FIG. 3 is a schematic diagram of the horizontal displacement compensation performed by the horizontal displacement compensation unit of the present invention. the

FIG. 4 is a flow chart of the deinterleaving operation performed by the deinterleaving device shown in FIG. 2 . the

FIG. 5 is a schematic diagram of a deinterleaving device according to another embodiment of the present invention. the

FIG. 6 is a flow chart of the de-interleaving operation performed by the de-interleaving device shown in FIG. 5 . the

【Description of main component symbols】

200, 500 de-interlacer 210, 510   Horizontal displacement estimation unit 220, 520 Horizontal Displacement Compensation Unit 222, 522 select unit 224, 524 computing unit 530   Displacement Adaptive Circuit 540 decision unit

Detailed ways

See Figure 1. FIG. 1 is a schematic diagram of a video data 100 including five adjacent fields and a corresponding output frame 160 . The deinterlaced output frame 160 corresponds to time T, and the five adjacent fields 110, 120, 130, 140, and 150 in the video data 100 correspond to times T-2, T-1, T, T+1, respectively and T+2. In FIG. 1, scan lines 112, 132, 152 and 162 are the N-1th scan lines in fields 110, 130, 150 and 160 respectively; scan lines 123, 143 and 163 are respectively The Nth scan line; and the scan lines 114, 134, 154 and 164 are the N+1 scan lines in the field 110, 130, 150 and 160 respectively, wherein the N-1 scan line and the N+ 1 scan line belongs to the same field and the Nth scan line belongs to another field. In addition, the de-interlacing method in the embodiment of the present invention generates the output frame 160 on a pixel-by-pixel basis. the

Please refer to FIG. 2 , which is a schematic diagram of a de-interleaving device 200 according to an embodiment of the present invention. The de-interlacing device 200 includes a horizontal displacement estimation unit 210 and a horizontal displacement compensation unit 220 , and the horizontal displacement compensation unit 220 includes a selection unit 222 and a calculation unit 224 . After the video data is input to the horizontal displacement estimation unit 210 in the de-interlacing device 200 , the horizontal displacement estimation unit 210 performs horizontal displacement estimation on the video data. In this embodiment, it is assumed that the de-interlacing device 200 performs de-interlacing processing on a target pixel 10 of the field 130 to generate the target pixel 10 corresponding to the output frame 160 . Therefore, the horizontal displacement estimating unit 210 of the present invention will perform horizontal displacement determination for the adjacent area of the target pixel 10 . In practice, the horizontal displacement estimation unit 210 can set an estimation range (window) centered on the target pixel 10, and perform inter-frame motion detection (motion detection) on the field 130 within the estimation range. To find a horizontal displacement vector (motion vector). As shown in FIG. 1 , in this embodiment, assuming that an estimated range 101 is set to a size of 2*5 pixels, then the horizontal displacement estimation unit 210 can compare the field 130 with the field 150 or It is the displacement change with the field 110, or/and compares the displacement change between the adjacent field 120 and the field 140 according to the estimated range 101, for example, the pixel values of pixels 15 and 16 in the field 130 shown in FIG. 1 are moved to the field 150 The pixel value of pixels 13 and 14 in , or pixel 12 in field 120 is shifted to the pixel value of pixel 11 in field 140 . Therefore, in this embodiment, the horizontal displacement estimation unit 210 determines that a horizontal displacement occurs in the vicinity of the target pixel 10 and the horizontal displacement vector is +2. the

Please refer to FIG. 3 . FIG. 3 is a schematic diagram of horizontal displacement compensation performed by the horizontal displacement compensation unit 220 of the present invention. After the horizontal displacement estimation unit 210 inputs the determined horizontal displacement vector to the selection unit 222 of the horizontal displacement compensation unit 220 . The selection unit 222 selects the reference pixel to be used for interpolating the target pixel 10 according to the horizontal displacement vector, as shown in FIG. 3 , in this embodiment, since the horizontal displacement vector is +2, the selection unit 222 selects the The pixel 12 of the field 120 before the target pixel 10 in the field 130 and the pixel 11 of the next field 140 corresponding to the target pixel 10 in the field 130 are used as reference pixels for interpolating the target pixel 10. Please note that in this embodiment, the horizontal displacement vector is an even value, so the horizontal displacement compensation unit 220 can select one pixel before and after each as a reference pixel, but if the horizontal displacement vector is an odd value (for example, +3), then The horizontal displacement compensation unit 220 of the present invention can also select two pixels before and after the corresponding horizontal displacement vector as reference pixels. For example, when the horizontal displacement vector is +3, the selection unit 222 can select the pixel corresponding to the target pixel 10 The pixels 12 and 20 of the previous field 120 and the pixels 11 and 19 of the subsequent field 140 corresponding to the target pixel 10 in the field 130 are used as reference pixels for interpolating the target pixel 10 . Next, the calculating unit 224 in the horizontal displacement compensating unit 220 uses the pixel value of the average reference pixel to interpolate the output frame according to the reference pixel corresponding to the target pixel 10 (such as the pixel 12 in the field 120 and the pixel 11 in the field 140). The pixel value of the target pixel 10 is 160 to complete the de-interlacing operation. the

Please refer to FIG. 4 . FIG. 4 is a flow chart of the de-interleaving operation performed by the de-interleaving device 200 shown in FIG. 2 . Please note that the relevant steps in the flow chart are not necessarily executed consecutively in this order, and other steps may also be inserted therein. The steps of the de-interleaving operation performed by the de-interleaving device 200 can be summarized as follows:

Step 400 : The horizontal displacement estimating unit 210 performs an action of estimating the horizontal displacement of the target pixel 10 according to an estimated range 101 . the

Step 402: If the horizontal displacement estimation unit 210 determines that there is a horizontal displacement action in the vicinity of the target pixel 10, execute step 404; otherwise, end the process. the

Step 404: The horizontal displacement estimation unit 210 determines a horizontal displacement vector according to the horizontal displacement. the

Step 406: The selection unit 222 determines a plurality of reference pixels 11, 12 relative to the target pixel 10 according to the horizontal displacement vector. the

Step 408 : The calculation unit 224 averages the pixel values of the reference pixels 11 and 12 as the pixel value of the target pixel 10 . the

Please refer to FIG. 5 , which is a schematic diagram of a de-interleaving device 500 according to another embodiment of the present invention. In the embodiment of the present invention, the de-interlacing device 500 includes a horizontal displacement estimation unit 510 , a horizontal displacement compensation unit 520 , a displacement adaptive circuit 530 and a determination unit 540 . The horizontal displacement compensation unit 520 includes a selection unit 522 and a calculation unit 524 . Please note that the de-interleaving device 500 shown in FIG. 5 has the same functions and operations as components with the same name in the de-interleaving device 200 shown in FIG. 2 , so details will not be repeated here. As mentioned above, when the conventional motion adaptive de-interlacing circuit 530 uses the motion adaptive de-interlacing method to perform the de-interlacing operation, most of the high-frequency and moving details cannot be interpolated, resulting in image distortion. Therefore, the horizontal displacement estimation unit 510 and the horizontal displacement compensation unit 520 of the present invention can be used to supplement the deficiencies of the displacement adaptability circuit 530. In this embodiment, when the horizontal displacement estimation unit 510 estimates the horizontal displacement of a target pixel, if the target pixel 10 has a horizontal displacement, the determination unit 540 will calculate the pixel value according to the horizontal displacement compensation unit 520 as the pixel value of the target pixel 10, instead of selecting the pixel value calculated by the displacement adaptability circuit 530; on the other hand, if the target pixel 10 is judged by the horizontal displacement estimation unit 510 to have no horizontal displacement, then The decision unit 540 selects the pixel value calculated by the displacement adaptability circuit 530 as the pixel value of the target pixel 10 instead of selecting the pixel value calculated by the horizontal displacement compensation unit 520 . Therefore, the de-interlacing device 500 of the present invention can determine the de-interlacing method for compensating the target pixel 10 according to whether the horizontal displacement of the target pixel occurs or not, thus enhancing the accuracy and sensitivity of the de-interlacing process, thereby greatly improving the Picture quality. the

Please refer to FIG. 6 . FIG. 6 is a flow chart of the de-interleaving operation performed by the de-interleaving device 500 shown in FIG. 5 . Please note that the relevant steps in the flow chart are not necessarily executed consecutively in this order, and other steps may also be inserted therein. The steps of the de-interleaving operation performed by the de-interleaving device 500 can be summarized as follows:

Step 600 : The horizontal displacement estimation unit 510 performs horizontal displacement estimation on the target pixel 10 . the

Step 602 : The horizontal displacement compensation unit 520 generates a specific pixel value according to a horizontal displacement vector determined by the horizontal displacement estimation unit 510 . the

Step 604: The displacement adaptability circuit 530 deinterleaves according to a displacement adaptability to generate a candidate pixel value. the

Step 606: If the horizontal displacement vector is detected, the decision unit 540 uses the specific pixel value to set the target pixel; and if the horizontal displacement vector is not detected, the decision unit 540 uses the candidate pixel value to set the target pixel Sets the target pixel. the

Compared with the prior art, when the de-interlacing device of the present invention uses horizontal displacement estimation and horizontal displacement compensation to perform image de-interlacing operation, it uses an estimated range to detect the horizontal movement of the target range, so it can greatly reduce The hardware cost required for large-scale searches. On the other hand, the de-interlacing device of the present invention can also use the horizontal displacement estimation and horizontal displacement to make up for the deficiencies of the displacement-adaptive de-interlacing method, which not only enhances the accuracy and sensitivity of the de-interlacing process, but also greatly improves the overall Picture quality. the

The above descriptions are only preferred embodiments of the present invention, and all equivalent changes and modifications made according to the scope of the patent application of the present invention shall fall within the scope of the present invention. the

Claims (8)

1. de-interlacing methods is used for deinterleave one video data, and this video data comprises one first, second, third, fourth and the 5th, and this video data produces an output frame when the 3rd output, and this method comprises the following steps:

According to this first and the 3rd, the 3rd and the 5th and this one of them group of second and the 4th, carry out horizontal displacement and estimate to detect a horizontal displacement vector; And

If detect this horizontal displacement vector, then in this second, select one first pixel and in the 4th, select one second pixel, and come interpolation to go out a particular pixel values an object pixel in should output frame according to this first pixel and this second pixel according to this horizontal displacement vector.

2. the method for claim 1, the step of wherein detecting this horizontal displacement vector comprises:

Set a processes pixel scope according to this object pixel; And

Carrying out horizontal displacement according to this processes pixel scope estimates to detect this horizontal displacement vector.

3. the method for claim 1 wherein comprises in order to the step that produces this object pixel:

If this horizontal displacement vector that detects equals 2N, then:

The pixel of choosing in this second at a distance of N pixel of this object pixel according to this horizontal displacement vector is used as this first pixel;

The pixel of choosing in the 4th at a distance of N pixel of this object pixel according to this horizontal displacement vector is used as this second pixel; And

The pixel value of average this first pixel and the pixel value of this second pixel are used as this particular pixel values; And

If this horizontal displacement vector that detects equals 2N+1, then:

According to this horizontal displacement vector choose in this second pixel at a distance of N pixel of this object pixel be used as this first pixel and apart the pixel of N+1 pixel of this object pixel be used as one the 3rd pixel, wherein this first pixel is adjacent with the 3rd pixel;

According to this horizontal displacement vector choose in the 4th pixel at a distance of N pixel of this object pixel be used as this second pixel and apart the pixel of N+1 pixel of this object pixel be used as one the 4th pixel, wherein this second pixel is adjacent with the 4th pixel; And

The pixel value of this first pixel, this second pixel, the 3rd pixel and the 4th pixel is average, be used as this particular pixel values.

4. the method for claim 1, it comprises in addition:

This video data is carried out a displacement adaptability deinterleave to produce the candidate pixel value to this object pixel in should output frame, wherein when not detecting this horizontal displacement vector, use this candidate pixel value to set this object pixel.

5. deinterlacing device is used for deinterleave one video data, and this video data comprises one first, second, third, fourth and the 5th, and this video data produces an output frame when the 3rd output, and this device comprises:

The unit is estimated in one horizontal displacement, and at least wherein one group according to second and the 4th of this first and the 3rd, the 3rd and the 5th and this carries out horizontal displacement and estimates to detect a horizontal displacement vector; And

One horizontal displacement compensating unit, be coupled to this horizontal displacement and estimate the unit, if this horizontal displacement is estimated the unit and is detected this horizontal displacement vector, then in this second, select one first pixel and in the 4th, select one second pixel, and come interpolation to go out a particular pixel values an object pixel in should output frame according to this first pixel and this second pixel according to this horizontal displacement vector.

6. device as claimed in claim 5, wherein this horizontal displacement is estimated the unit and is set a processes pixel scope according to this object pixel; And carrying out horizontal displacement according to this processes pixel scope estimates to detect this horizontal displacement vector.

7. device as claimed in claim 5, wherein this horizontal displacement compensating unit comprises:

One selected cell, be used for according to this horizontal displacement vector choose in this second pixel at a distance of N pixel of this object pixel be used as this first pixel and apart the pixel of N+1 pixel of this object pixel be used as one the 3rd pixel, wherein this first pixel is adjacent with the 3rd pixel, and according to this horizontal displacement vector choose in this output frame pixel at a distance of N pixel of this object pixel be used as this second pixel and apart the pixel of N+1 pixel of this object pixel be used as one the 4th pixel, wherein this second pixel is adjacent with the 4th pixel; And

One computing unit, be coupled to this selected cell, when this horizontal displacement vector equals 2N, the pixel value of average this first pixel and second pixel is used as this particular pixel values, when this horizontal displacement vector equals 2N+1, on average the pixel value of this first pixel, this second pixel, the 3rd pixel and the 4th pixel is used as this particular pixel values.

8. device as claimed in claim 5, it comprises in addition:

One displacement adaptability circuit is used for this video data is carried out a displacement adaptability deinterleave to produce the candidate pixel value to this object pixel in should output frame; And

One decision unit, be coupled to this displacement adaptability circuit, unit and this horizontal displacement compensating unit are estimated in this horizontal displacement, if detect this horizontal displacement vector, then this decision unit uses this particular pixel values to set this object pixel, and if do not detect this horizontal displacement vector, then this decision unit uses this candidate pixel value to set this object pixel.

Images