US8059920B2 - Method and apparatus for pixel interpolation - Google Patents

Method and apparatus for pixel interpolation Download PDF

Info

Publication number
US8059920B2
US8059920B2 US11/277,519 US27751906A US8059920B2 US 8059920 B2 US8059920 B2 US 8059920B2 US 27751906 A US27751906 A US 27751906A US 8059920 B2 US8059920 B2 US 8059920B2
Authority
US
United States
Prior art keywords
pixel
edge detection
target position
target
detection range
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US11/277,519
Other languages
English (en)
Other versions
US20060222267A1 (en
Inventor
Po-Wei Chao
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Realtek Semiconductor Corp
Original Assignee
Realtek Semiconductor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Realtek Semiconductor Corp filed Critical Realtek Semiconductor Corp
Assigned to REALTEK SEMICONDUCTOR CORP. reassignment REALTEK SEMICONDUCTOR CORP. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHAO, PO-WEI
Publication of US20060222267A1 publication Critical patent/US20060222267A1/en
Application granted granted Critical
Publication of US8059920B2 publication Critical patent/US8059920B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image
    • G06T3/40—Scaling the whole image or part thereof
    • G06T3/403—Edge-driven scaling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image
    • G06T3/40—Scaling the whole image or part thereof
    • G06T3/4007—Interpolation-based scaling, e.g. bilinear interpolation

Definitions

  • the present invention relates to image processing techniques, and more particularly, to methods and apparatuses for pixel interpolation.
  • Pixel interpolation operation is a widely used image processing technique.
  • the pixel interpolation operation is usually employed for generating required pixel values in deinterlacing or image-scaling operations.
  • the performance of pixel interpolation operation greatly affects the interpolated image quality.
  • a pixel interpolation method for interpolating pixel values of a plurality of target positions of a target picture includes: dynamically setting a plurality of edge detection ranges corresponding to the plurality of target positions, respectively; and for each of the plurality of target positions, performing an edge detection according to a corresponding edge detection range to select an edge direction for the target position, and interpolating a pixel value for the target position according to pixel data corresponding to the selected edge direction.
  • a pixel interpolating device for interpolating pixel values of a plurality of target positions of a target picture.
  • the pixel interpolating device comprises a control unit for dynamically setting a plurality of edge detection ranges corresponding to the plurality of target positions, respectively; and a pixel interpolating unit coupled to the control unit for performing an edge detection according to a corresponding edge detection range to select an edge direction for each of the plurality of target positions, and for interpolating a pixel value for the target position according to pixel data corresponding to the selected edge direction.
  • a pixel interpolation method for interpolating a pixel value of a target position of a target picture comprises: determining pixel values of a plurality of reference pixels corresponding to the target position; setting an edge detection range corresponding to the target position according to the determining result of the pixel values of the plurality of reference pixels; performing an edge detection according to the edge detection range to select an edge direction for the target position; and interpolating a pixel value for the target position according to pixel data corresponding to the selected edge direction.
  • a pixel interpolating device for interpolating a pixel value of a target position of a target picture.
  • the pixel interpolating device comprises: a detection module for determining pixel values of a plurality of reference pixels corresponding to the target position; a control unit coupled to the detection module for setting an edge detection range corresponding to the target positions according to the determining result of the pixel values of the plurality of reference pixels; and a pixel interpolating unit coupled to the control unit for performing an edge detection according to the edge detection range to select an edge direction for the target position and for interpolating a pixel value for the target position according to pixel data corresponding to the selected edge direction.
  • FIG. 1 is a block diagram of a pixel interpolating device according to an exemplary embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a target picture.
  • FIG. 3 is a flowchart illustrating a pixel interpolation method according to one embodiment of the present invention.
  • the pixel interpolation method and related pixel interpolating apparatus to be disclosed hereinafter can be applied in various deinterlacing or image-scaling operations.
  • the proposed pixel interpolation method can be applied to process still image and video data such as a picture, an image frame with an image field and so on.
  • FIG. 1 shows a block diagram of a pixel interpolating device 100 according to an exemplary embodiment of the present invention.
  • the pixel interpolating device 100 is utilized for interpolating pixel values of a plurality of target positions of a target picture.
  • the pixel interpolating device 100 comprises a control unit 110 , a pixel interpolating unit 120 , and a detection module 130 .
  • FIG. 2 is a schematic diagram of a target picture 200 in which the pixel interpolation operation to be applied.
  • FIG. 1 shows a block diagram of a pixel interpolating device 100 according to an exemplary embodiment of the present invention.
  • the pixel interpolating device 100 is utilized for interpolating pixel values of a plurality of target positions of a target picture.
  • the pixel interpolating device 100 comprises a control unit 110 , a pixel interpolating unit 120 , and a detection module 130 .
  • FIG. 2 is a schematic diagram of a target picture 200 in which the pixel interpolation operation
  • pixel rows 22 , 24 , 26 , and 28 denote four existing pixel rows of the target picture 200
  • pixel positions 202 and 204 denote two pixel positions need to be interpolated.
  • the two pixel positions 202 and 204 are referred to as target positions 202 and 204 , respectively.
  • the target picture 200 is herein assumed as an image frame with an image field and the pixel rows 22 , 24 , 26 , and 28 are four existing scan line of the target picture 200 .
  • the pixel row 22 comprises a plurality of pixels including pixels 2 A ⁇ 2 G while the pixel row 24 comprises a plurality of pixels including pixels 4 A ⁇ 4 G.
  • the control unit 110 of the pixel interpolating device 100 is arranged for dynamically setting a plurality of edge detection ranges corresponding to a plurality of target positions of the target picture 200 , respectively.
  • the control unit 110 sets a corresponding edge detection range 210 for the target position 202 of the target picture 200 and sets a corresponding edge detection range 220 for the target position 204 . Since the control unit 110 dynamically sets an edge detection range for each of the plurality of target positions, the edge detection ranges of the target positions may vary from each other.
  • the pixel interpolating unit 120 performs an edge detection according to a corresponding edge detection range to select an edge direction for the target position. Then the pixel interpolating unit 120 interpolates a pixel value for the target position according to pixel data corresponding to the selected edge direction.
  • FIG. 3 shows a flowchart 300 illustrating a pixel interpolation method according to one embodiment of the present invention.
  • the target position 202 is employed as an example for describing the operations of the pixel interpolating device 100 with reference to the flowchart 300 .
  • the detection module 130 of the pixel interpolating device 100 is utilized for determining pixel values of a plurality of reference pixels corresponding to the target position 202 .
  • the detection module 130 determines a pixel value distribution with respect to the plurality of reference pixels to determine the image feature of the target position 202 .
  • the detection module 130 may select some pixels from a first pixel row (i.e., a scan line in this embodiment) prior to the target position 202 , from a second pixel row posterior to the target position 202 , or from both the first and second pixel rows to be the reference pixels of the target position 202 .
  • the detection module 130 may select pixels 2 A ⁇ 2 G on the preceding scan line 22 of the target position 202 , pixels 4 A ⁇ 4 G on the succeeding scan line 24 of the target position 202 , or both the pixel 2 A ⁇ 2 G and 4 A ⁇ 4 G to be the reference pixels of the target position 202 .
  • the pixels 2 A ⁇ 2 G on the scan line 22 are herein assumed to be selected as the reference pixels of the target position 202 by the detection module 130 in this embodiment.
  • the detection module 130 comprises a computing unit 132 for generating a plurality of differences by respectively determining pixel difference of each pair of a plurality of pairs of adjacent reference pixels; and a decision unit 134 for determining the pixel value distribution according to the plurality of differences.
  • the computing unit 132 can compute a pixel difference between the reference pixels 2 A and 2 B, a pixel difference between the reference pixels 2 B and 2 C, a pixel difference between 2 C and 2 D, a pixel difference between 2 D and 2 E, a pixel difference between 2 E and 2 F, and a pixel difference between 2 F and 2 G to generate six differences.
  • the decision unit 134 determines the pixel value distribution according to the six differences.
  • the six differences have a greater variation if the surrounding image of the target position 202 is more chaotic or disordered. On the contrary, if the surrounding image of the target position 202 is smoother, the six differences have a smaller variation. For example, if the six differences are 100, ⁇ 80, 97, ⁇ 52, 71, and ⁇ 80, it is obvious that the pixel value distribution of the reference pixels 2 A ⁇ 2 G is very ragged. This situation often happens on a chaos image region.
  • the decision unit 134 may determine the pixel value distribution of the plurality of reference pixels according to the variation, the number of sign change, the SAD (sum of absolute difference) of the plurality of differences or the like. Then, the decision unit 134 applies a corresponding signal or value to the control unit 110 .
  • the control unit 110 sets a corresponding edge detection range for the target position 202 according to the signal or value, representing the determining result of the pixel values of the plurality of reference pixels obtained by the detection module 130 , from the decision unit 134 .
  • the control unit 110 sets a small edge detection range for the target position 202 when the surrounding image of the target position 202 is chaotic, for example, within a radius of three pixels from the target position 202 .
  • the control unit 110 sets a relative large edge detection range for the target position 202 , such as within a radius of ten pixels from the target position 202 .
  • step 330 the pixel interpolating unit 120 performs an edge detection according to the edge detection range of the target position 202 set by the control unit 110 to select an edge direction for the target position 202 .
  • step 340 the pixel interpolating unit 120 interpolates a pixel value for the target position 202 according to pixel data corresponding to the selected edge direction.
  • the control unit 110 of the pixel interpolating device 100 is utilized for dynamically setting a plurality of edge detection ranges corresponding to the plurality of target positions, respectively, according to the determining results obtained by the detection module 130 . Accordingly, the edge detection range of each target position varies with the image features and characteristics thereof. In other words, the disclosed pixel interpolation method sets a corresponding edge detection range for a target position based on its image features. As a result, the probability of the edge detection operations producing erroneous results can be significantly reduced thereby improving the interpolated image quality.
  • the image feature of a target position is determined based on the determining result of the pixel values of the plurality of reference pixels corresponding to the target position. This is merely an example rather than a restriction of the practical applications. In practice, any other image detection method can also be employed to detect the image feature of each target position.
  • the disclosed pixel interpolation method can not only be applied to interpolate pixels in horizontal pixel rows or horizontal scan lines, but can also be applied to interpolate pixels in vertical pixel rows or vertical scan lines.
US11/277,519 2005-04-01 2006-03-27 Method and apparatus for pixel interpolation Active 2029-09-20 US8059920B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
TW94110451A 2005-04-01
TW094110451A TWI288890B (en) 2005-04-01 2005-04-01 Method and apparatus for pixel interpolation
TW094110451 2005-04-01

Publications (2)

Publication Number Publication Date
US20060222267A1 US20060222267A1 (en) 2006-10-05
US8059920B2 true US8059920B2 (en) 2011-11-15

Family

ID=37070567

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/277,519 Active 2029-09-20 US8059920B2 (en) 2005-04-01 2006-03-27 Method and apparatus for pixel interpolation

Country Status (2)

Country Link
US (1) US8059920B2 (zh)
TW (1) TWI288890B (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9324131B1 (en) * 2013-04-06 2016-04-26 Crucial Ip, Inc. Method and apparatus for motion adaptive deinterlacing with reduced artifacts

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200811758A (en) * 2006-08-24 2008-03-01 Realtek Semiconductor Corp Method for edge detection, method for motion detection, method for pixel interpolation utilizing up-sampling, and apparatuses thereof
TWI348657B (en) 2007-03-07 2011-09-11 Himax Tech Ltd Determination method of edge direction
TWI372554B (en) * 2007-07-26 2012-09-11 Realtek Semiconductor Corp Motion detecting method
KR101587196B1 (ko) * 2008-06-19 2016-01-20 마벨 월드 트레이드 리미티드 스플릿 에지 강화 구조
JP2013183353A (ja) * 2012-03-02 2013-09-12 Toshiba Corp 画像処理装置

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5134480A (en) 1990-08-31 1992-07-28 The Trustees Of Columbia University In The City Of New York Time-recursive deinterlace processing for television-type signals
US6133957A (en) 1997-10-14 2000-10-17 Faroudja Laboratories, Inc. Adaptive diagonal interpolation for image resolution enhancement
TW457782B (en) 1999-03-15 2001-10-01 Matsushita Electric Ind Co Ltd Block interleave device, block deinterleave device, block interleave method and block deinterleave method
US6417887B1 (en) 1998-11-13 2002-07-09 Nec Corporation Image display processing apparatus and method for converting an image signal from an interlaced system to a progressive system
US6421090B1 (en) 1999-08-27 2002-07-16 Trident Microsystems, Inc. Motion and edge adaptive deinterlacing
US6545719B1 (en) 2000-03-31 2003-04-08 Matsushita Electric Industrial Co., Ltd. Apparatus and method for concealing interpolation artifacts in a video interlaced to progressive scan converter
TW533741B (en) 2001-10-05 2003-05-21 Genesis Microchip Inc Motion adaptive de-interlacing method and apparatus
US20030179935A1 (en) * 2002-03-19 2003-09-25 Fuji Xerox Co., Ltd. Image processing apparatus, image processing method, image processing program, and computer-readable record medium storing image processing program
US20030179953A1 (en) * 2002-03-20 2003-09-25 Fuji Xerox Co., Ltd. Image processing apparatus, image processing method, and image processing program
TW594659B (en) 2002-10-02 2004-06-21 Explore Microelectronics Inc Display device with de-interlaced mode
US20050073607A1 (en) * 2003-10-02 2005-04-07 Samsung Electronics Co., Ltd. Image adaptive deinterlacing method and device based on edge
US20060039590A1 (en) * 2004-08-20 2006-02-23 Silicon Optix Inc. Edge adaptive image expansion and enhancement system and method
US20080123998A1 (en) * 2004-05-19 2008-05-29 Sony Corporation Image Processing Apparatus, Image Processing Method, Program of Image Processing Method, and Recording Medium in Which Program of Image Processing Method Has Been Recorded

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5134480A (en) 1990-08-31 1992-07-28 The Trustees Of Columbia University In The City Of New York Time-recursive deinterlace processing for television-type signals
US6133957A (en) 1997-10-14 2000-10-17 Faroudja Laboratories, Inc. Adaptive diagonal interpolation for image resolution enhancement
US6417887B1 (en) 1998-11-13 2002-07-09 Nec Corporation Image display processing apparatus and method for converting an image signal from an interlaced system to a progressive system
US6986081B1 (en) 1999-03-15 2006-01-10 Matsushita Electric Industrial Co., Ltd. Block interleaving apparatus, block deinterleaving apparatus, block interleaving method and block deinterleaving method
TW457782B (en) 1999-03-15 2001-10-01 Matsushita Electric Ind Co Ltd Block interleave device, block deinterleave device, block interleave method and block deinterleave method
US6421090B1 (en) 1999-08-27 2002-07-16 Trident Microsystems, Inc. Motion and edge adaptive deinterlacing
US6545719B1 (en) 2000-03-31 2003-04-08 Matsushita Electric Industrial Co., Ltd. Apparatus and method for concealing interpolation artifacts in a video interlaced to progressive scan converter
TW533741B (en) 2001-10-05 2003-05-21 Genesis Microchip Inc Motion adaptive de-interlacing method and apparatus
US6784942B2 (en) 2001-10-05 2004-08-31 Genesis Microchip, Inc. Motion adaptive de-interlacing method and apparatus
US20030179935A1 (en) * 2002-03-19 2003-09-25 Fuji Xerox Co., Ltd. Image processing apparatus, image processing method, image processing program, and computer-readable record medium storing image processing program
US20030179953A1 (en) * 2002-03-20 2003-09-25 Fuji Xerox Co., Ltd. Image processing apparatus, image processing method, and image processing program
TW594659B (en) 2002-10-02 2004-06-21 Explore Microelectronics Inc Display device with de-interlaced mode
US20050073607A1 (en) * 2003-10-02 2005-04-07 Samsung Electronics Co., Ltd. Image adaptive deinterlacing method and device based on edge
US20080123998A1 (en) * 2004-05-19 2008-05-29 Sony Corporation Image Processing Apparatus, Image Processing Method, Program of Image Processing Method, and Recording Medium in Which Program of Image Processing Method Has Been Recorded
US20060039590A1 (en) * 2004-08-20 2006-02-23 Silicon Optix Inc. Edge adaptive image expansion and enhancement system and method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9324131B1 (en) * 2013-04-06 2016-04-26 Crucial Ip, Inc. Method and apparatus for motion adaptive deinterlacing with reduced artifacts

Also Published As

Publication number Publication date
TWI288890B (en) 2007-10-21
TW200636607A (en) 2006-10-16
US20060222267A1 (en) 2006-10-05

Similar Documents

Publication Publication Date Title
US5959681A (en) Motion picture detecting method
US8644387B2 (en) Motion estimation method
KR100366935B1 (ko) 화상보간장치
US8059920B2 (en) Method and apparatus for pixel interpolation
US7796191B1 (en) Edge-preserving vertical interpolation
US20060244861A1 (en) Method for detecting bisection pattern in deinterlacing
US6614485B2 (en) Deinterlacing apparatus
US8411974B2 (en) Image processing apparatus, method, and program for detecting still-zone area
KR100423504B1 (ko) 영상신호의 라인보간 장치 및 방법
WO2009140916A1 (zh) 视频数据的去隔行方法、去隔行装置及视频处理系统
US7978265B2 (en) Method and apparatus of deinterlacing
JP5350501B2 (ja) 映像処理装置及び映像処理方法
US7447383B2 (en) Directional interpolation method using frequency information and related device
US8254682B2 (en) Pattern detecting method and related image processing apparatus
US7733420B2 (en) Judder detection apparatus, de-interlacing apparatus using the same, and de-interlacing method
US20060197868A1 (en) Apparatus for interpolating scanning line and method thereof
US10587840B1 (en) Image processing method capable of deinterlacing the interlacing fields
JP4250598B2 (ja) 動き補償型ｉｐ変換処理装置及び動き補償型ｉｐ変換処理方法
JP6012230B2 (ja) エッジ方向判定装置、エッジ方向判定装置の制御方法、及び、画像処理装置
JP2001094951A (ja) 走査線補間方法
JPH09200575A (ja) 画像データ補間装置
US10015513B2 (en) Image processing apparatus and image processing method thereof
US8405767B2 (en) Image processing device
US11195251B1 (en) Image processing apparatus and method capable of rapidly determining bounding box for motion objects without iteration
JP3707959B2 (ja) 画像補間装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: REALTEK SEMICONDUCTOR CORP., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHAO, PO-WEI;REEL/FRAME:017385/0240

Effective date: 20050712

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12