WO1999056247A1 - Image interpolation - Google Patents
Image interpolation Download PDFInfo
- Publication number
- WO1999056247A1 WO1999056247A1 PCT/IB1999/000460 IB9900460W WO9956247A1 WO 1999056247 A1 WO1999056247 A1 WO 1999056247A1 IB 9900460 W IB9900460 W IB 9900460W WO 9956247 A1 WO9956247 A1 WO 9956247A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- interpolated
- pixels
- image
- grid
- rows
- Prior art date
Links
- 238000000034 method Methods 0.000 claims abstract description 15
- 238000001914 filtration Methods 0.000 claims description 6
- 230000000903 blocking effect Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4023—Scaling of whole images or parts thereof, e.g. expanding or contracting based on decimating pixels or lines of pixels; based on inserting pixels or lines of pixels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
Definitions
- the invention relates to image interpolation.
- Rational filters whose input/output relation is expressed as the ratio of two polynomials in the input variables, have already been used with satisfactory results in noise smoothing, contrast enhancement and image interpolation by power-of-two factors [3,4,5].
- the invention provides an image interpolation method and device, as well as a video display apparatus or a printing apparatus comprising such an image interpolation device, as defined in the independent claims.
- Advantageous embodiments are defined in the dependent claims.
- the aim of the method presented here is achieved by using a technique based on a nonlinear rational filtering (RF).
- RF nonlinear rational filtering
- distances between a pixel to be interpolated and surrounding pixels are preferably taken into account in the rational filtering.
- Fig. 1 illustrates the distance between an interpolated pixel and original pixels
- Figs. 2A-2C illustrate row interpolations by a factor 4;
- Fig. 3 illustrates original rows and columns interpolations by a factor 4;
- Fig. 4 illustrates pixel evaluations within the space delimited by rows and columns;
- Fig. 5 shows a conceptual block diagram;
- Fig. 6 shows a two-dimensional operator formula implementation.
- linear interpolation The theoretical limitation of linear interpolation is the low-pass filtering implemented by the operators to avoid imaging artifacts in the output image. This operation limits the presence of high frequency components in the output images, corresponding to details and sharp edges in the spatial domain.
- linear interpolation by an integer L factor is performed by inserting L-l equidistant zero-valued samples between two consecutive original samples, then a low-pass filtering is performed [2].
- the proposed algorithm will be able to reconstruct high frequency components avoiding the blocking artifacts of diagonal edges due to the separability of linear interpolators.
- the algorithm works in two steps.
- the first step is a one-dimensional interpolation of original rows and columns; the second one is the interpolation of the space among interpolated rows and columns.
- the first step is the interpolation of the original rows and columns by the required factor. This step is implemented by using a one-dimensional rational interpolator, whose formula is defined by the equation (1). Pixels S p are calculated between the original ones p 2 and p 3 by using the scheme of Fig. 1. The distance between p 2 and p 3 is equal to 1, while the distance ⁇ between S p ( ⁇ ) and p is smaller than or equal to 1 and greater than or equal to 0.
- A is a parameter related to the non linearity of the algorithm, while the distance ⁇ is described in Fig. 1.
- the pixels pi, p , p 3 and p are the original input data aligned on the same row or
- the pair w p2 and w p3 represents an edge sensor that is able to reconstruct luminance transitions sharply.
- Fig. 2 we can see how a one-dimensional edge in an original vector (Fig. 2A) is interpolated by a factor of 4 by using a linear interpolator (Fig. 2B) and a one-dimensional rational interpolator (Fig. 2C).
- Fig. 2A a one-dimensional edge in an original vector
- Fig. 2B a linear interpolator
- Fig. 2C a one-dimensional rational interpolator
- the second step of the algorithm is the interpolation of pixels between rows and 20 columns evaluated at the first step (the shadowed square of Fig. 3, in which the bigger circles indicate original pixels and the smaller circles indicate the points interpolated in the first step).
- the interpolation of a generic point z, located inside the internal square and having the original points (indicated by black dots) as vertexes (see Fig. 4), is performed using the points a, b, c, d, e,f, g and h interpolated in the first step and indicated by circles. These points are 25 defined once the position of the pixel to be evaluated is fixed; these pixels belong to the 0, 45, 90 and 135 degrees directions and to the interpolated rows and columns.
- the role of the distances d a , d b , d c , ... d h is to weigh the contribution of first-step interpolated points taking into account their distances from the pixel to be computed.
- the weights w ab , W bd , w eg and W ft are able to determine if there is a dominant direction selected, for example, among
- interpolated lines cross themselves in original pixels; in this way we obtain an intermediate image whose nominal dimension is equal to the output image, but, with only N*M +N*M*(SF-1) + M*N*(SF-1) significant pixels; these pixels will be referenced to as grid pixels.
- N*(SF-1)*M*(SF-1) located among original interpolated rows and columns is not yet defined.
- the intermediate image 12 is applied to a two-dimensional operator 52 to obtain an output image 13 having N*SF rows and M*SF columns.
- the two-dimensional operator whose behavior is affected by the choice of the "k” parameter (according to our studies a proper value can be selected around 0.1), works on every square defined by the grid pixels. Starting from one of these squares, this operator computes the value of each pixel inside, using the "grid pixels" belonging to the edges of that square and the pixel coordinates referring to the position in the square (see Fig. 3). These relative pixel co- ordinates are expressed by two integer indexes whose values are in the range (1, SF-1). The processing of the 2-D operator can be described with a block diagram as in Fig. 6.
- Fig. 6 shows a two-dimensional operator formula implementation.
- Grid pixels GP and relative pixel coordinates RPC are applied to a grid pixel selector 61.
- the relative pixel coordinates RPC are also applied to a distance generator 62.
- An output of the grid pixel selector 61 and the parameter k are applied to a weight generator 63.
- Outputs of the distance generator 62 and the weight generator 63 are applied to a multiplier generator 64.
- Outputs of the grid pixel selector 61 and the multiplier generator 64 are applied to a multiplier accumulator 65.
- Outputs of the weights generator 63 and the multiplier accumulator 65 are applied to a divisor 66 that generates output pixels OP that are displayed on a display D or sent to a printing device P.
- a primary aspect of the invention can be summarized as follows.
- a non-linear technique for image interpolation is presented.
- Linear techniques produce smoothed images and blocking artifacts at the output.
- the aim of our method is to interpolate images by large and arbitrary factors preserving the sharpness of their contours.
- We achieve this goal by using a technique based on the nonlinear rational filter (RF).
- RF nonlinear rational filter
- the presented algorithm is derived from the one described in Ref. [5]; the algorithm described there is able to perform image interpolations when the scaling factor is represented by a power of two. That kind of interpolator is important because it applies the method of "rational filters" (RF) to produce interpolated images that preserve the sharpness of the details avoiding at the same time blocking artifacts.
- RF rational filters
- the computational load of the algorithm seems not heavier than the one of comparable algorithms that are not based on RF.
- the two dimensional interpolation scaling factor advantageously needs no longer be a power of two but can be any number (> 1).
- a mono- dimensional interpolator based on RF is able to work with arbitrary scaling factor (any real number >1).
- a two-dimensional operator is applied. Also this operator is based on RF and can work with any interpolation-scaling factor; the proposed structure is intrinsically sensitive to the edge orientation in such a way to produce contours with a high degree of sharpness even if these contours are not horizontal or vertical.
- the invention can be used in the zooming of natural images like those obtained from photographic or video cameras.
- a primary aspect of the invention thus provides an image interpolation method comprising the steps of inserting interpolated pixels along the horizontal and vertical directions so as to obtain a grid in which interpolated lines cross themselves in original pixels; and interpolating pixels between the rows and columns formed by the grid so as to fill the squares delimited by the grid.
- An image interpolation device operating in accordance with this method is also provided, as well as a video display apparatus (printing apparatus) comprising such an image interpolation device for supplying an interpolated image, and a display (printing device) for displaying (printing) the interpolated image.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Editing Of Facsimile Originals (AREA)
- Television Systems (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP55385299A JP2002506600A (en) | 1998-04-29 | 1999-03-18 | Image interpolation method |
EP99947051A EP0993656A1 (en) | 1998-04-29 | 1999-03-18 | Image interpolation |
AU32688/99A AU3268899A (en) | 1998-04-29 | 1999-03-18 | Image interpolation |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP98201396 | 1998-04-29 | ||
EP98201396.3 | 1998-04-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO1999056247A1 true WO1999056247A1 (en) | 1999-11-04 |
Family
ID=8233662
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB1999/000460 WO1999056247A1 (en) | 1998-04-29 | 1999-03-18 | Image interpolation |
Country Status (6)
Country | Link |
---|---|
EP (1) | EP0993656A1 (en) |
JP (1) | JP2002506600A (en) |
KR (1) | KR20010014320A (en) |
CN (1) | CN1266519A (en) |
AU (1) | AU3268899A (en) |
WO (1) | WO1999056247A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU736359B2 (en) * | 1998-12-18 | 2001-07-26 | Canon Kabushiki Kaisha | Image interpolation with a continuous 2-dimensional kernel |
EP2037686A3 (en) * | 2004-07-23 | 2010-09-22 | I-CES (Innovative Compression Engineering Solutions) | Method of compressing a digital audio, image or video file by desynchronisation |
GB2422264B (en) * | 2005-01-14 | 2010-12-29 | Snell & Wilcox Ltd | Image processing |
US8036273B2 (en) | 2001-09-17 | 2011-10-11 | Nokia Corporation | Method for sub-pixel value interpolation |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0536717A2 (en) * | 1991-10-10 | 1993-04-14 | Salora Oy | A method to double the sample density of an orthogonally sampled picture |
WO1994022100A1 (en) * | 1993-03-25 | 1994-09-29 | Delean Bruno Camille Roger Jea | Method for processing an image in a computerized system |
JPH09265527A (en) * | 1996-03-28 | 1997-10-07 | Fuji Photo Film Co Ltd | Method for interpolatory operation of image data and device for executing the same |
-
1999
- 1999-03-18 JP JP55385299A patent/JP2002506600A/en active Pending
- 1999-03-18 AU AU32688/99A patent/AU3268899A/en not_active Abandoned
- 1999-03-18 KR KR1019997012462A patent/KR20010014320A/en not_active Application Discontinuation
- 1999-03-18 CN CN99800639A patent/CN1266519A/en active Pending
- 1999-03-18 WO PCT/IB1999/000460 patent/WO1999056247A1/en not_active Application Discontinuation
- 1999-03-18 EP EP99947051A patent/EP0993656A1/en not_active Withdrawn
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0536717A2 (en) * | 1991-10-10 | 1993-04-14 | Salora Oy | A method to double the sample density of an orthogonally sampled picture |
WO1994022100A1 (en) * | 1993-03-25 | 1994-09-29 | Delean Bruno Camille Roger Jea | Method for processing an image in a computerized system |
JPH09265527A (en) * | 1996-03-28 | 1997-10-07 | Fuji Photo Film Co Ltd | Method for interpolatory operation of image data and device for executing the same |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU736359B2 (en) * | 1998-12-18 | 2001-07-26 | Canon Kabushiki Kaisha | Image interpolation with a continuous 2-dimensional kernel |
US8036273B2 (en) | 2001-09-17 | 2011-10-11 | Nokia Corporation | Method for sub-pixel value interpolation |
EP2037686A3 (en) * | 2004-07-23 | 2010-09-22 | I-CES (Innovative Compression Engineering Solutions) | Method of compressing a digital audio, image or video file by desynchronisation |
GB2422264B (en) * | 2005-01-14 | 2010-12-29 | Snell & Wilcox Ltd | Image processing |
US8421916B2 (en) | 2005-01-14 | 2013-04-16 | Snell Limited | Image processing |
Also Published As
Publication number | Publication date |
---|---|
EP0993656A1 (en) | 2000-04-19 |
JP2002506600A (en) | 2002-02-26 |
KR20010014320A (en) | 2001-02-26 |
AU3268899A (en) | 1999-11-16 |
CN1266519A (en) | 2000-09-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1347410B1 (en) | Edge-based enlargement and interpolation of images | |
EP2239705B1 (en) | Resizing images of an image sequence | |
Wei et al. | Contrast-guided image interpolation | |
US7043091B2 (en) | Method and apparatus for increasing spatial resolution of an image | |
US6496609B1 (en) | Hybrid-linear-bicubic interpolation method and apparatus | |
Muresan | Fast edge directed polynomial interpolation | |
JP2007193508A (en) | Image processor and image processing program | |
Han et al. | Parametric cubic convolution scaler for enlargement and reduction of image | |
US20200219229A1 (en) | Edge-Aware Upscaling for Improved Screen Content Quality | |
WO2001097171A2 (en) | Magnifying digital image using edge mapping | |
Khriji et al. | High-resolution digital resampling using vector rational filters | |
US20040086201A1 (en) | Fast edge directed polynomial interpolation | |
WO1999056247A1 (en) | Image interpolation | |
JP2006350562A (en) | Image processor and image processing program | |
CN113989114A (en) | Image reduction processing method and device | |
Cheikh et al. | Color image interpolation using vector rational filters | |
KR100190039B1 (en) | Apparatus and method of extending high resolution image | |
Kekre et al. | Grid based image scaling technique | |
Alessandretti et al. | Image interpolation by an integer factor using a non linear technique | |
Bosner et al. | Tension splines with application on image resampling | |
Safonov et al. | Image Upscaling | |
EP0543917B1 (en) | Method of interpolating the value of a pixel moved a subpixel distance | |
Huang et al. | Directional moving averaging interpolation for texture mapping | |
Kobayashi et al. | Improved half-pixel generation for image enlargement | |
JP2000182040A (en) | Method and device for providing expression of image data, method and device for expressing image data, method and device for converting kernel for image processing, converting method and converter |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 99800639.4 Country of ref document: CN |
|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1999947051 Country of ref document: EP |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 1019997012462 Country of ref document: KR Ref document number: 09446965 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 1999947051 Country of ref document: EP |
|
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
WWP | Wipo information: published in national office |
Ref document number: 1019997012462 Country of ref document: KR |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 1019997012462 Country of ref document: KR |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 1999947051 Country of ref document: EP |