AU2004200237B2 - Image processing apparatus with frame-rate conversion and method thereof - Google Patents

Image processing apparatus with frame-rate conversion and method thereof Download PDF

Info

Publication number
AU2004200237B2
AU2004200237B2 AU2004200237A AU2004200237A AU2004200237B2 AU 2004200237 B2 AU2004200237 B2 AU 2004200237B2 AU 2004200237 A AU2004200237 A AU 2004200237A AU 2004200237 A AU2004200237 A AU 2004200237A AU 2004200237 B2 AU2004200237 B2 AU 2004200237B2
Authority
AU
Australia
Prior art keywords
block
motion
pixels
motion vectors
predetermined
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2004200237A
Other versions
AU2004200237A1 (en
Inventor
Jeong-Woo Kang
Jong-Sul Min
Young-Wook Sohn
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of AU2004200237A1 publication Critical patent/AU2004200237A1/en
Application granted granted Critical
Publication of AU2004200237B2 publication Critical patent/AU2004200237B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0127Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0135Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
    • H04N7/014Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes involving the use of motion vectors

Description

L_
AUSTRALIA
Patents Act COMPLETE SPECIFICATION
(ORIGINAL)
Class Int. Class Application Number: Lodged: Complete Specification Lodged: Accepted: Published: Priority Related Art: Name of Applicant: Samsung Electronics Co., Ltd Actual Inventor(s): Jeong-woo Kang, Jong-sul Min, Young-wook Sohn Address for Service and Correspondence: PHILLIPS ORMONDE FITZPATRICK Patent and Trade Mark Attorneys 367 Collins Street Melbourne 3000 AUSTRALIA Invention Title: IMAGE PROCESSING APPARATUS WITH FRAME-RATE CONVERSION AND METHOD
THEREOF
Our Ref: 711891 POF Code: 460249/462172 The following statement is a full description of this invention, including the best method of performing it known to applicant(s): -1- Soeq IMAGE PROCESSING APPARATUS WITH FRAME-RATE CONVERSION AND METHOD THEREOF This application claims the priority of Korean Patent Application No.
2003-6537, filed on February 3, 2003, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a frame-rate converter using a technique of motion estimation, and more particularly, to an image processing apparatus with the frame-rate conversion and method thereof to provide appropriate filtering and compensating for'a motion vector.
2. Description of the Related Art Typically, an image processing method in a high picture quality display, such as a digital television or a plasma display panel (PDP), uses a progressive scan method. In the progressive scan method, a whole image of a video frame is rendered at a timein the unit of a frame, just as a film is projected on a screen.
FIG. 1 is a block diagram of a part of an image processing apparatus in a conventional digital display device. The portion includes a de-interlacing unit 100, an 1-frame delaying unit 110, a first pixel block 120, a second pixel block 130, a sum-of-absolute difference map (SAD map) 140, a motion vector extraction unit 150, a frame-rate conversion (FRC) unit 160, and an interlacing unit 170.
The de-interlacing unit 100 converts input images from fields into frames.
The 1 -frame delaying unit 110 delays the frames to enable a previous frame (P frame),to be compared with a current frame (C frame).
The first pixel block 120 extracts a C x C pixel block from the C frame, where C 2".
The second pixel block 130 extracts a Cx C pixel block from the P frame.
The SAD map 140 compares the pixel blocks of the C frame and the P frame with each other to obtain difference between the pixel blocks and stores the result.
The motion vector extraction unit 150 estimates a motion vector of the current pixel block using the value in the SAD map 140.
The FRC 160 performs a frame-rate conversion for the extracted motion vector.
The interlacing unit 170 re-converts the frame-rate converted image back into a field.
In the image processing apparatus of FIG. 1, in order to perform the frame-rate conversion accurately, C frame and P frame are at the same resolution.
However, an input interlaced image comprising a current and a previous field contains a pixel difference between the two fields, the pixel difference existing in the vertical direction. The pixel difference between the two fields may lead to problems in comparing the two fields and extracting a vector motion. Therefore, the de-interlacing unit 100 performs a vertical image interpolation and protects a pixel difference between two images. The de-interlaced image is stored in a memory (not shown), and a predetermined block extracted from the current de-interlaced image (C frame) is compared with a block in the same position of the previous de-interlaced image (P frame) which has been delayed by the 1-frame delaying unit 110. The blocks from the previous frame and the current frame are compared by the SAD map 140 in order to estimate where and by how much the previous frame has moved, thereby the motion vector extraction unit 150 can determine a motion vector of the image. The predetermined block is a C x C square block. The C x C square block is used for motion vector estimation because the number of pixels in the vertical direction is doubled through de-interlacing. When using an interlace display.format, there are twice as many pixels in the horizontal direction as pixels in the vertical direction and a Cx C/2 block used for the motion vector estimation. The estimated motion vector is input to the FRC unit which makes a new frame and outputs it to the interlacing unit 170 which adapts the frame to an output display format in which the number of vertical pixels of the new frame is diminished in half.
In the image processing apparatus described above, since an input image is de-interlaced at the early stage, a higher memory capacity is required and the amount of operation is increased in proportion to the memory capacity. Also when the image is interlaced at the final stage, additional memory is further required. Due to the need for the large memory capacity and the amount of operation, the hardware for the image processing is not only enlarged but also leads to heating problems and errors in signal processing. In addition, an image which has undergone de-interlacing and interlacing is not the same as the original image and the quality of the image deteriorates.
The discussion of the background to the invention herein is included to explain the context of the invention. This is not to be taken as an admission that any of the material referred to was published, known or part of the common general knowledge in Australia as at the priority date of any of the claims.
Doanrt2
I
SUMMARY OF THE INVENTION The present invention may provide an image processing apparatus with frame-rate conversion and method thereof, in which a stage of de-interlacing of an input image is eliminated to improve an efficiency of operation of image processing.
q According to an aspect of the present invention, there is provided an 0apparatus which processes images with frame-rate conversion (FRC), the N apparatus including: a block extraction unit which extracts a predetermined block from an Sinput field; a motion vector extraction unit which determines a motion vector of the predetermined block by comparing blocks of two sequentially input fields with each other; a motion filter which determines whether there has been any motion by using the motion vectors of pixels in a predetermined range of the block by setting a predetermined mask block, calculating absolute values of motion vectors output from the motion filter, and determining whether the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is equal to or more than a predetermined number; a motion compensation unit which passes values of the motion vectors intact if it is determined that there has been a motion in the predetermined range of the block, and changes the values of the motion vectors to 0, otherwise; and a frame-rate conversion unit which performs a frame-rate conversion on the motion vectors received from the motion compensation unit.
It is preferable that the block extracted by the block extraction unit has dimensions C x C/2, where C (n It is preferable that the block extraction unit further comprises, a delay unit which delays the input interlaced image by one field; a first block extraction unit which extracts a block from the delayed input interlaced image; and a second block extraction unit which extracts a block from the current input interlaced image.
W:'rarle\GABNODEL\711891 replaced pages 8 Jul
I
It is preferable that the apparatus further comprises a sum-of-absolute- 0 difference (SAD) map which compares pixels in the first block extraction unit
(N
Sand in the second block extraction unit with each other to obtain differences therebetween.
It is preferable that the motion vector extraction unit estimates motion vectors of the input fields from the SAD map.
q It is preferable that the motion compensation unit converts the absolute 0values of the motion vectors in the mask block to 0 if the number of the motion N vectors which have an absolute value which is equal to or less than a 0 10 predetermined number of pixels is equal to or more than the predetermined Snumber.
It is preferable that the motion compensation unit passes the motion vectors in themask block intact if the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is less than a predetermined number.
It is preferable that the predetermined number of pixels is 1, and the predetermined number is the number of pixels covered by the mask block.
According to another aspect of the invention, there is provided a method of a method of image processing with frame-rate conversion, the method including: extracting a predetermined block from an input interlaced image; estimating motion vectors of the pixels in the predetermined block by comparing blocks of two sequentially input interlaced images; determining whether there has been a motion by setting a predetermined mask block, calculating absolute values of the motion vectors, and determining whether the number of motion vectors of pixels covered by the predetermined mask block which have an absolute value which is equal to or less than a predetermined number of pixels is equal to or more than a predetermined number; passing the values of the motion vectors of pixels in the predetermined range of the block intact if it is determined that there has been any motion, and forcing the values of the motion vectors of pixels in the predetermined range of the block to 0 if it is determined that there has been no motion; and performing a frame-rate conversion (FRC) on the resulting motion vectors.
W:Vnmarie\GABNODEL\711891 replaced pages Jul It is preferable that the predetermined block is extracted to have Sdimensions C x C/2, where C (n It is preferable that the step of extracting the predetermined block comprises, delaying the input interlaced image by a field and extracting a first block from the delayed input interlaced image; and extracting a second block from the current input interlaced image.
Cc It is preferable that the method further comprises comparing corresponding pixels in the first block and the second block to obtain differences N therebetween.
It is preferable that the method further comprises estimating motion Svectors of the input interlaced images from the differences and storing the results.
It is preferable that the step of determining if there has been a motion comprises forcing the absolute values of the motion vectors covered with the mask block to 0 if the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is equal to or more than a predetermined number.
It is preferable that the step of determining if there has been a motion comprises passing the motion vectors in the mask block intact if the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is less than a predetermined number.
It is preferable that the predetermined number of pixels is 1, and the predetermined number is the number of pixels covered by the mask block.
It is preferable that the predetermined mask block has dimensions of 3 x 3 pixels, and the predetermined number of pixels is 9.
According to yet another aspect of the invention, there is provided an apparatus which processes images with frame-rate conversion (FRC), the apparatus including: a motion filter which determines whether a motion vector estimated from an input interlaced image is caused by a line deviation between odd and even fields by setting a predetermined mask block, calculating absolute values of motion vectors output from the motion filter, and determining whether the number of the motion vectors which have an absolute value which is equal to or W:marie\GABNODEL\1 1891 replaced pages 6 Jul less than a predetermined number of pixels is equal to or more than a Spredetermined number; and a motion compensation unit which passes the motion vector intact if it has not been caused by the line deviation, and changes the motion vector to 0, otherwise.
According to still another aspect of the invention, there is provided a Cc method of image processing with frame-rate conversion (FRC), the method 0including: N determining whether a motion vector estimated from an input interlaced 0 10 image is caused by a line deviation between odd and even fields by setting a IN predetermined mask block, calculating absolute values of motion vectors output from the motion filter, and determining whether the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is equal to or more than a predetermined number; and compensating for the motion vector by passing the motion vector intact if it has not been caused by the line deviation, and changing the motion vector into a null vector, otherwise.
BRIEF DESCRIPTION OF THE DRAWINGS The above and other aspects and advantages of the present invention will become more apparent by describing in detail preferred embodiments thereof with reference to the attached drawings in which: W:marieGABNODEL7l1891- replaced pages 6Jul FIG. 1 is a block diagram of a conventional image processing apparatus; FIG. 2 is a block diagram of image processing apparatus according to a preferred embodiment of the present invention; FIG. 3 is a flowchart of a motion filtering method according to a preferred embodiment of the present invention; FIG. 4 is an example of an original input image; FIG. 5 shows a partial result of image processing for the original input image of FIG. 4, the image processing having de-interlacing and interlacing stages; FIG. 6 shows a partial result of image processing for the original input image of FIG. 4, the image processing not having a de-interlacing stage; and FIG. 7 shows a partial result of image processing for the original input image of FIG. 4 according to the present invention.
DETAILED DESCRIPTION OF THE INVENTION FIG. 2 is a block diagram of an image processing apparatus according to a first embodiment of the present invention. The apparatus includes an 1-field delay unit 200, a first image block extraction unit 210, a second image block extraction unit 220, a sum-of-absolute difference map (SAD map) 230, a motion vector extraction unit 240, a storage unit 250, a motion filter 260, a motion vector compensation unit 270 and a frame-rate conversion (FRC) unit 280.
The 1-field delay unit 200 delays an image input in the unit of a field to allow a comparison of a current input image with a previous input image.
The first image block extraction unit 210 extracts a block from the current input image. The block has a size of CxC/2 pixels, wherein and- n As described above, a field which has been de-interlaced has half the number of pixels in the vertical direction as the frame which results from de-interlacing.
The second image block extraction unit 220 extracts a block from the previous input image. The shape and position of the block is identical to the block extracted from the current input image.
The SAD map 230 compares the blocks from the first image block extraction unit 210 and the second image block extraction unit 220 to obtain pixel differences, between the blocks, and stores the pixel difference values.
The motion vector extraction unit 240 determines a motion vector of each of the pixels of the the block of the current input image using values of the SAD map 230.
The storage unit 250 stores the motion vector value extracted by the motion vector extraction unit 240.
The motion filter 260 picks out incorrectly determined motion vector values in the storage unit 250 based on the absolute value of the motion vector. In other words, the motion filter 260 checks if a motion vector estimated from an input image, which is an interlaced image, is based on a pixel difference of line deviation between an odd field and an even field, and if so, determines the motion vector to be an incorrect motion vector.
The motion vector compensation unit 270 changes the values of the incorrcet motion vectors received from the motion filter 260 to and leaves the correct motion vectors intact.
The FRC unit 280 performs frame-rate conversion on the motion vector received from the motion vector compensation unit 270.
An operation of the apparatus of FIG. 2 will now be described.
The 1-field delay unit 200 delays an input (interlaced) image by a field so that, rectangular pixel blocks in the form of CxC/2, where, for example C= 32, extracted from the previous input image delayed by a field can be compared with the blocks from the current input image.
The SAD map 230 compares the block extracted from the previous input image delayed by a field with the corresponding pixel of the block extracted from the current input image, and obtains a pixel difference between them.
Using the pixel difference, the motion-vector extraction unit 240 determines a motion vector MV(vx, vy) for each of the pixels in an input image and stores the motion vectors in the storage unit 250.
The motion filter 260 corrects a misinterpretation of the motion vector received from the storage unit 250 by taking the distance between consecutively input images which are even and odd field images (the input order can be reversed) caused by "motion" of the input images.
The motion filter 260 sets a mask (block) of the form of Ax B, where, for example, A B 3. The motion filter 260 then calculates the absolute values of the motion vectors of pixels covered by the mask, and determines whether the number for which the absolute values of the motion vectors are equal to or less than a predetermined pixel difference is equal to or more than a predetermined I 1 number. The predetermined pixel difference may be 1, that is, a distance between Seven and odd field images, and in this case, the predetermined number is preferably the same as the number of pixels covered by the mask block since A B 3, the predetermined number is 9).
C 5 When the number of the absolute values of the motion vectors of pixels covered by the mask block which are equal to or less than is equal to or greater '-than 9, the motion vector compensation unit 270 converts the absolute values of t the motion vectors to a null vector, and interprets that there was no "motion" of the corresponding block. If the number of absolute values of the motion vectors of (Ni 10 pixels covered by the mask block which are equal to or less than is less than 9, Sthe motion vector compensation unit 270 determines that there was a "motion" for (Ni the corresponding block and outputs the motion vectors intact.
The dimension of the mask block can be arbitrarily defined by a user.
The absolute value of the motion vector is obtained because only information about the extent of movement of the block is required, regardless of the direction of the movement. It is determined if the absolute value of a coordinate of the motion vector is less than a value of a predetermined threshold coordinate (thl, th2), and if so, a count value is increased. It is preferable that the predetermined threshold coordinate (thl, th2) is The comparison of the absolute value of the motion vector of C x C/2 block with the predetermined threshold coordinate is performed over each of the pixels in the mask block.
The motion filtering ensures that a still image is not given a false motion. An input (still) interlaced image has vy=l as its vertical coordinate value even when there is no motion, because the even and the odd field images have a 1 pixel discrepancy between them. A field to be interpolated between the even and odd field images selects a value of or for its vy, so that a straight line deviated by 1 pixel can be observed in the output still image.
The motion vector compensation unit 270 makes vy consistently for a still image to prevent a deviation of the image when the image is output.
FIG. 3 is a flowchart of the motion filtering method according to a preferred embodiment of the present invention.
It is assumed that an estimated motion vector of pixels in a predetermined block of C x C/2 from two field images input sequentially is represented by a coordinate of MV(vx,vy).
Motion vectors are stored in a storage unit and are subjected to motion filtering one by one.
W:\marie\GABNODEL\711891 replaced pages 6 Jul I I To begin the motion filtering, a mask block A x B is set to check if the Sestimated and stored motion vector is a real motion vector in step 300.
An absolute value of the motion vector MV(vxi,vyj) of a pixel positioned at (i, j) in the mask block A x B is calculated in step 310. It can be expressed as in C 5 equation 1.
i abs(vxi), Yj abs(vyj) (1) The calculation of the absolute value of the motion vector decreases the probability of determining a motionless image to be an image in motion by only obtaining the extent of movement of the image regardless of the direction of the Simage.
It is determined whether the absolute value of the coordinate (vxi, vy) exceeds a threshold (absolute) value of a predetermined coordinate (thl, th2) in step 320. Each coordinate value of (thl, th2) may be a number greater than one (the number of a single pixel), for example, 2).
If the absolute value of the motion vector coordinate is less than the threshold value (thl, th2), a count value is increased by 1 in step 330.
It is checked if the steps 320 and 330 are performed over all the pixels covered by the mask block in step 340. If the mask block is a 3 x 3 block, the steps 320 and 330 should be performed over 9 pixels.
In step 350, it is determined if the count value reaches a threshold value th3, the count value being increase by 1 whenever the absolute value of the motion vector is equal to or less than the threshold value of (thl, th2). That is, to check if absolute values of the motion vectors of all the pixels in the mask block are less than or equal to 1. In step 350, if the count value has not exceeded the threshold value th3, it is determined that the absolute values of the motion vectors of some of the pixels in the mask block are greater than 2, in which case, it is determined that there has been a motion in the mask block. Thus, the motion vectors MV(vx, vy) in the predetermined block C x C12 are passed through the motion filter with their original values in step 360.
In step 350, if the count value is equal to or greater than the threshold value th3, it is determined that the absolute values of all or most of pixels in the mask W:Vmarte\GABNODEL\7l1891 replaced pages -86 Jul block are equal to or less than in which case, it is determined that there has been no motion in the mask block. Thus, in step 370, values of the motion vectors for the pixels covered by the mask block are forced to be 0 to prevent the deviation of a straight line in an image output, due to the value of the motion vector which appears to have even though there was no motion.
So far, a method of motion filtering has been described. After the process of motion filtering, the final motion vectors filtered in steps 360 and 370 are FRC converted and output in step 380.
The present invention as described above leads to the following effects in terms of hardware implementation: 1. Memory consumption and corresponding amounts of operation can be cut in half, because the block used for determining the motion vector is cut in half Cx C CxC/2 2. Image processing becomes simpler, which leads to a reduction in signal processing and a speed increase, because the de-interlacing and the interlacing processes are omitted.
Despite the effects in hardware implementation, the de-interlacing cannot be omitted in the conventional image processing apparatus as an error in finding the correct position of an image due to a discrepancy in the positions of pixels in odd and even field images may occur. However in the preferred embodiment of the present invention, a motion filter algorithm is provided to solve this problem. The motion filter algorithm forces the motion vector values of the motion vectors which seem to have a motion when there is actually no motion to to protect the deviation of a straight line in an image output.
FIG. 4 is an example of an original input image.
FIG. 5 shows a partial result of image processing for the original input image of FIG. 4, the image processing having de-interlacing and interlacing stages.
FIG. 6 shows a. partial result of image processing for the original input image of FIG. 4, the image processing, not having a de-interlacing stage. Omitting the de-interlacing causes an error in processing motion vector. In FIG. 6, deviations of straight lines can be observed in a marked circle.
FIG. 7 shows partial result of image processing for the original input image of FIG. 4 according to the present invention, in the present invention, de-interlacing is omitted, and instead, a motion filter is provided to compensate for errors in the motion vectors. In FIG. 7, line deviations are not observed.
According to the present invention, using a motion filter can reduce the hardware required for image processing with frame-rate conversion to lower costs and increase operational efficiency.
While this invention has been particularly shown and described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (13)

  1. 2. The apparatus of claim 1, wherein the block extracted by the block extraction unit has dimensions C x C/2, where C
  2. 3. The apparatus of claim 1 or 2, wherein the block extraction unit further comprises: a delay unit which delays an input interlaced image by one field; a first block extraction unit which extracts a block from the delayed input interlaced image; and a second block extraction unit which extracts a block from the current input interlaced image. W:rrianeIGABNODEL1711891 replaced pages- 6 I 13 S4. The apparatus of claim 3, further comprising a sum-of-absolute- Sdifference (SAD) map which compares pixels in the first block extraction unit and in the second block extraction unit with each other to obtain differences ntherebetween. \O C The apparatus of claim 4, wherein the motion vector extraction unit Cc estimates motion vectors of the input fields from the SAD map. c 6. The apparatus of any one of the preceding claims, wherein the motion 0 10 compensation unit converts the absolute values of the motion vectors in the cI mask block to 0 if the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is equal to or more than the predetermined number.
  3. 7. The apparatus of any one of the preceding claims wherein the motion compensation unit passes the motion vectors in the mask block intact if the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is less than a predetermined number.
  4. 8. The apparatus of claim 7, wherein the predetermined number of pixels is 1, and the predetermined number is the number of pixels covered by the mask block.
  5. 9. A method of image processing with frame-rate conversion, the method including: extracting a predetermined block from an input interlaced image; estimating motion vectors of the pixels in the predetermined block by comparing blocks of two sequentially input interlaced images; determining whether there has been a motion by setting a predetermined mask block, calculating absolute values of the motion vectors, and determining whether the number of motion vectors of pixels covered by the predetermined mask block which have an absolute value which is equal to or less than a W:Amarle\GABNODEL\71 1891 replaced pages 8 Jul Spredetermined number of pixels is equal to or more than a predetermined 0 number; IN passing the values of the motion vectors of pixels in the predetermined nrange of the block intact if it is determined that there has been any motion, and forcing the values of the motion vectors of pixels in the predetermined range of the block to 0 if it is determined that there has been no motion; and Sperforming a frame-rate conversion (FRC) on the resulting motion vectors.
  6. 10. The method of claim 9, wherein the predetermined block is extracted to Shave dimensions C x C/2, where C=2 n
  7. 11. The method of claim 9 or 10, wherein the step of extracting the predetermined block comprises: delaying the input interlaced image by a field and extracting a first block from the delayed input interlaced image; and extracting a second block from the current input interlaced image.
  8. 12. The method of claim 11, further comprising comparing corresponding pixels in the first block and the second block to obtain differences therebetween.
  9. 13. The method of claim 12, further comprising estimating motion vectors of the input interlaced images from the differences and storing the results.
  10. 14. The method of any one of claims 9 to 13, wherein determining if there has been a motion comprises forcing the absolute values of the motion vectors covered with the mask block to 0 if the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is equal to or more than a predetermined number. The method of any one of claims 9 to 13, wherein the determining if there has been a motion comprises passing the motion vectors in the mask block intact if the number of the motion vectors which have an absolute value which is W:Vmarie\GABNODEL\711891 replaced pages 6 Jul equal to or less than a predetermined number of pixels is less than a Spredetermined number.
  11. 16. The method of claim 14 or 15, wherein the predetermined number of pixels is 1, and the predetermined number is the number of pixels covered by the mask block. (Ni
  12. 17. The method of claim 16, wherein the predetermined mask block has 1 dimensions of 3x3 pixels, and the predetermined number of pixels is 9. c 18. An apparatus which processes images with frame-rate conversion (FRC), the apparatus including: a motion filter which determines whether a motion vector estimated from an input interlaced image is caused by a line deviation between odd and even fields by setting a predetermined mask block, calculating absolute values of motion vectors output from the motion filter, and determining whether the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is equal to or more than a predetermined number; and a motion compensation unit which passes the motion vector intact if it has not been caused by the line deviation, and changes the motion vector to 0, otherwise.
  13. 19. A method of image processing with frame-rate conversion (FRC), the method including: determining whether a motion vector estimated from an input interlaced image is caused by a line deviation between odd and even fields by setting a predetermined mask block, calculating absolute values of motion vectors output from the motion filter, and determining whether the number of the motion vectors which have an absolute value which is equal to or less than a predetermined number of pixels is equal to or more than a predetermined number; and W:marie\GABNODEL\71 1891 replaced pages 8 Jul 16 compensating for the motion vector by passing the motion vector intact if 0 it has not been caused by the line deviation, and changing the motion vector into a null vector, otherwise. S 5 20. An apparatus which processes images with frame-rate conversion substantially as herein described with reference to Figures 2 to 7 of the t n accompanying drawings. c( 21. A method of image processing with frame-rate conversion substantially as herein described with reference to Figures 2 to 7 of the accompanying c(N drawings. DATED: 25 July, 2005 PHILLIPS ORMONDE FITZPATRICK Attorneys for: SAMSUNG ELECTRONICS CO. LTD. Oci4Adfl W:\marie\GABNODEL\711891 replaced pages 6 Jul
AU2004200237A 2003-02-03 2004-01-22 Image processing apparatus with frame-rate conversion and method thereof Ceased AU2004200237B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR2003-6537 2003-02-03
KR10-2003-0006537A KR100467625B1 (en) 2003-02-03 2003-02-03 Image processing apparatus and method using frame-rate conversion

Publications (2)

Publication Number Publication Date
AU2004200237A1 AU2004200237A1 (en) 2004-08-19
AU2004200237B2 true AU2004200237B2 (en) 2005-09-08

Family

ID=34309353

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2004200237A Ceased AU2004200237B2 (en) 2003-02-03 2004-01-22 Image processing apparatus with frame-rate conversion and method thereof

Country Status (3)

Country Link
KR (1) KR100467625B1 (en)
CN (1) CN100594723C (en)
AU (1) AU2004200237B2 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100515069C (en) * 2004-09-16 2009-07-15 株式会社Ntt都科摩 Video evaluation device and method, frame rate determination device, and video process device
KR100766085B1 (en) * 2006-02-28 2007-10-11 삼성전자주식회사 Image displaying apparatus having frame rate conversion and method thereof
US8204104B2 (en) * 2006-03-09 2012-06-19 Sony Corporation Frame rate conversion system, method of converting frame rate, transmitter, and receiver
JP4139430B1 (en) 2007-04-27 2008-08-27 シャープ株式会社 Image processing apparatus and method, image display apparatus and method
JP2011223493A (en) * 2010-04-14 2011-11-04 Canon Inc Image processing apparatus and image processing method
CN102131058B (en) * 2011-04-12 2013-04-17 上海理滋芯片设计有限公司 Speed conversion processing module and method of high definition digital video frame
JP2013026727A (en) * 2011-07-19 2013-02-04 Sony Corp Display device and display method
KR102584521B1 (en) * 2019-02-15 2023-10-05 한화비전 주식회사 Imaging processing device for motion detection and method thereof

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2277004A (en) * 1993-04-08 1994-10-12 Sony Uk Ltd Motion compensated video signal processing; motion/no motion flag
JPH08111852A (en) * 1994-10-12 1996-04-30 Sharp Corp Motion adaptive scanning line interpolation device
EP0883298A2 (en) * 1997-06-04 1998-12-09 Hitachi, Ltd. Conversion apparatus for image signals and TV receiver

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1167261C (en) * 2000-07-21 2004-09-15 三星电子株式会社 Method for converting video frequency data frame rate and its apparatus

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2277004A (en) * 1993-04-08 1994-10-12 Sony Uk Ltd Motion compensated video signal processing; motion/no motion flag
JPH08111852A (en) * 1994-10-12 1996-04-30 Sharp Corp Motion adaptive scanning line interpolation device
EP0883298A2 (en) * 1997-06-04 1998-12-09 Hitachi, Ltd. Conversion apparatus for image signals and TV receiver

Also Published As

Publication number Publication date
CN100594723C (en) 2010-03-17
AU2004200237A1 (en) 2004-08-19
CN1520180A (en) 2004-08-11
KR20040070487A (en) 2004-08-11
KR100467625B1 (en) 2005-01-24

Similar Documents

Publication Publication Date Title
JP4997281B2 (en) Method for determining estimated motion vector in image, computer program, and display device
EP1804488A2 (en) Motion estimator and motion method
US8817878B2 (en) Method and system for motion estimation around a fixed reference vector using a pivot-pixel approach
US8189105B2 (en) Systems and methods of motion and edge adaptive processing including motion compensation features
US20080211968A1 (en) Image Processor and Image Display Apparatus Comprising the Same
US7336316B2 (en) De-interlacing of video data
JP5039192B2 (en) Spatio-temporal adaptive video deinterlacing
US8571114B2 (en) Sparse geometry for super resolution video processing
US7796191B1 (en) Edge-preserving vertical interpolation
US7227897B2 (en) Motion vector detector and motion vector detecting method
US20100177239A1 (en) Method of and apparatus for frame rate conversion
US5357287A (en) Method of and apparatus for motion estimation of video data
US8406305B2 (en) Method and system for creating an interpolated image using up-conversion vector with uncovering-covering detection
US8355442B2 (en) Method and system for automatically turning off motion compensation when motion vectors are inaccurate
US6930728B2 (en) Scan conversion apparatus
US20070133686A1 (en) Apparatus and method for frame interpolation based on motion estimation
US8345148B2 (en) Method and system for inverse telecine and scene change detection of progressive video
AU2004200237B2 (en) Image processing apparatus with frame-rate conversion and method thereof
EP1460847B1 (en) Image signal processing apparatus and processing method
JPH1098695A (en) Image information converter and its device and product sum arithmetic unit
JP5448983B2 (en) Resolution conversion apparatus and method, scanning line interpolation apparatus and method, and video display apparatus and method
US8233085B1 (en) Method and system for interpolating a pixel value of a pixel located at an on-screen display
KR20020068065A (en) Motion compensated upconversion for video scan rate conversion
JP4250807B2 (en) Field frequency conversion device and conversion method
JP2005086631A (en) Video signal processor and video signal processing method

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)
MK14 Patent ceased section 143(a) (annual fees not paid) or expired