USRE47291E1 - Filtering control method for improving image quality of bi-linear interpolated image - Google Patents

Filtering control method for improving image quality of bi-linear interpolated image Download PDF

Info

Publication number
USRE47291E1
USRE47291E1 US14/963,818 US201514963818A USRE47291E US RE47291 E1 USRE47291 E1 US RE47291E1 US 201514963818 A US201514963818 A US 201514963818A US RE47291 E USRE47291 E US RE47291E
Authority
US
United States
Prior art keywords
image
psf
filter coefficient
resolution image
pixel data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime, expires
Application number
US14/963,818
Inventor
Min-Cheol Hong
Yoon-Seong Soh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Priority to US14/963,818 priority Critical patent/USRE47291E1/en
Application granted granted Critical
Publication of USRE47291E1 publication Critical patent/USRE47291E1/en
Adjusted expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4007Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
    • G06T5/003
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/20Image enhancement or restoration using local operators
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/73Deblurring; Sharpening
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Definitions

  • the present invention relates to an interpolation method adapted to enlargement of a low resolution image when the image digitized through a CCD (Charged-Coupled Device) has the low resolution, in particular to a filtering control method for improving the image quality of a bi-linear interpolated image which is capable of restoring a requested interpolated high resolution image from a low resolution image by finding a coefficient of a two-dimensional filter on the basis of a regularization image restoration method.
  • CCD Charge-Coupled Device
  • a still picture or a moving picture has or transmits a low resolution image because it can not physically satisfy a sensor having the low resolution or a nyquist value.
  • a compressed moving picture has or transmits the low resolution image due to its bit value problem.
  • the resolution of the transmitted moving picture lowers due to a degradation phenomenon ect.
  • the method for getting the high resolution image from the low resolution image is largely divided into an image expansion type method and an image enhancement type method.
  • the image expansion type method converts the size of the low resolution image into a requested size.
  • the bi-linear interpolation method, a zero order expansion method, and a cubic spline method are comprised in the image expansion type method.
  • the image expansion type method has an image visibility lowering problem because when the image is interpolation-restored by the above-mentioned method such as the bi-linear interpolation method, zero order hold expansion method, cubic spline method, the outlines of the image is over-blurred.
  • the image enhancement type method comprises many methods, but the image enhancement type method causes a computational complexity, accordingly the method is not suited to a real-time processing due to the its computational complexity.
  • mapping method for mapping a non-uniform sample of the low resolution image into a uniform sample of the high resolution image by using moving information and segmentation information of the image.
  • the mapping method has the computational complexity problem, accordingly the mapping method is not suited to the real-time image data processing of the image processing system.
  • the object of the present invention is to provide a filtering control method for improving the image quality of a bi-linear interpolated image which is capable of improving the image quality of the interpolated image by using an interpolation method considering a real-time processing, a computational complexity and an efficiency when the digital video system seeks the interpolated image from the low resolution image.
  • the other object of the present invention is to provide the filtering control method for improving the image quality of the bi-linear interpolated image which is capable of finding a two-dimensional filter coefficient for getting the interpolated image from the low resolution image on the basis of a regularization image restoration method.
  • the other object of the present invention is to provide the filtering control method for improving the image quality of the bi-linear interpolated image which can approximate and find a PSF (Point Spread Function) for the bi-linear interpolated image from a modeling of the degraded image in the frequency region.
  • PSF Point Spread Function
  • the other object of the present invention is to provide the filtering control method for improving the image quality of the bi-linear interpolated image which is capable of performing a real-time adaptive processing by finding a filter coefficient from the bi-linear interpolated image and approximated PSF.
  • H is the PSP (Point Spread Function)
  • f is a requested high resolution image
  • Z is the low resolution image
  • g is the high resolution image gotten from the bi-linear interpolation method
  • the filtering control method for improving the image quality of the bi-linear interpolated image can be implemented by finding the PSF(H) from the added function M(f) by using an equation
  • H ⁇ ( k , l ) G ⁇ ( k , l ) F ⁇ ( k , l ) .
  • FIG. 1 illustrates an image sample for getting a twice enlarged high resolution image according to the embodiment of the present invention.
  • FIG. 2 illustrates an interpolation filter coefficient for getting the twice enlarged image according to the embodiment of the present invention.
  • FIG. 3 illustrates an image sample for getting a three times enlarged high resolution image according to the other embodiment of the present invention.
  • FIG. 4 illustrates the interpolation filter coefficient for getting the three times enlarged image according to the other embodiment of the present invention.
  • FIG. 5 illustrates an image sample for getting a six times enlarged high resolution image according to the another embodiment of the present invention.
  • FIG. 6 illustrates the interpolation filter coefficient for getting the six times enlarged image according to the another embodiment of the present invention.
  • FIG. 1 illustrates an image sample for getting a twice enlarged high resolution image according to the embodiment of the present invention.
  • a ⁇ i illustrate low resolution pixels
  • a ⁇ D illustrate high resolution pixels
  • pixels depicted as ‘x’ illustrate pixels interpolated as twice by a twice interpolation filter coefficient.
  • FIG. 2 illustrates the interpolation filter coefficient for getting a twice enlarged image according to the embodiment of the present invention.
  • the interpolation filter coefficient for interpolating the twice enlarged image of FIG. 1 is depicted in FIG. 2.
  • the high resolution image is gotten from the low resolution pixels a ⁇ i (3 ⁇ 3 pixels) inside of a circle of FIG. 1 by using the interpolation filter coefficient.
  • FIG. 3 illustrates an image sample for getting a three times enlarged high resolution image according to the other embodiment of the present invention.
  • a ⁇ p illustrate the low resolution pixels
  • a ⁇ I illustrate the high resolution pixels using the filter according to the present invention.
  • FIG. 4 illustrates the interpolation filter coefficient for getting the three times enlarged image according to the other embodiment of the present invention.
  • FIG. 5 illustrates the image sample for getting a six times enlarged high resolution image according to the another embodiment of the present invention.
  • it illustrates the image sample for getting the six times enlarged high resolution image from the twice and three times interpolation filter coefficients by using the bi-linear interpolation method.
  • pixels illustrated as a ‘X’ can be gotten by using the twice interpolation filter of FIG. 2, and pixels illustrated as a triangle can be gotten by using the three times interpolation filter coefficient of FIG. 4.
  • pixels illustrated as a quadrilateral can be gotten from the pixels generated by the twice and three times interpolation filter coefficients by using the bi-linear interpolation method.
  • FIG. 6 illustrates the interpolation filter coefficient for getting the six times enlarged image according to the another embodiment of the present invention.
  • the interpolation filter coefficient for getting the six times enlarged image of FIG. 5 is depicted in FIG. 6.
  • the value found by using the interpolation filter coefficient of the present invention has an integer value.
  • a spatially invariant PSF Point Spread Function
  • the spatially invariant PSF Point Spread Function
  • the B, H, n are the bi-linear interpolation filters.
  • H is the spatially invariant PSF defining the relation between the original high resolution image and high resolution image gotten by the interpolation method, and the n is a noise component generated by the assumed H.
  • the PSF(H) can be described as below equation 2 in the frequency region.
  • H ⁇ ( k , l ) G ⁇ ( k , l ) F ⁇ ( k , l ) . [ Equation ⁇ ⁇ 2 ]
  • the H(k,l) is the component in the k,l frequency region of the PSF(H)
  • the G (k,l) is the component in the k,l frequency region of the bi-linear interpolated image.
  • the F (k,l) is the component in the k,l frequency region of the high resolution image.
  • the PSF(H) can be gotten from the bi-linear interpolated high resolution image through a statistical processing after performing an under-sample processing of various images as various value.
  • the high resolution image is gotten by using the PSF(H) found from the direct inverse.
  • the high resolution image gotten from the PSF(H) by using the direct inverse is overshoot in the region where the k,l have ‘0’ value (in general, high frequency region) in the frequency region, accordingly the regularization image restoration for improving the system stabilization is used to solve the problem.
  • the regularization image restoration method is used for restoring the image or finding a certain PSF
  • an added function M(f) for finding the PSF(H) by using the regularization image restoration method can be described as below equation 3.
  • M(f) ⁇ g ⁇ Hf ⁇ 2 + ⁇ Cf ⁇ 2 [Equation 3]
  • the first term of the right side of Equation 3 illustrates the credibility of the bi-linear interpolated image
  • the second term of the right side illustrates increase of the stability of the system by providing the mitigation to the restored image
  • the ⁇ . ⁇ means a norm
  • the ⁇ is a regularization parameter for determining the credibility and mitigation of the original image.
  • the C is the two-dimensional high frequency filter for determining the mitigation of the original image, in the present invention a two-dimensional Gaussian filter is used as the C.
  • Equation 4 When a gradient operator is adapted to Equation 3 in order to get the high resolution image, it can be described as below equation 4.
  • the T means a transpose of a matrix.
  • the regularization parameter ⁇ is fixed as ‘1’, and the high resolution image f can be found as below equation 5.
  • PSF(P) H/(H T H+C T C)
  • PSF(P) in Equation 5 is a block-circulant matrix, accordingly it can be easily calculated in the frequency region.
  • the ‘*’ means a complex-conjugate.
  • the PSF(P) can be found by using an IFT (Inverse Fourier Transform) from Equation 6.
  • IFT Inverse Fourier Transform
  • Equation 7 The requested high resolution image f can be found as below Equation 7 by using the found PSF(P) and Equation 1.
  • the PSF(P) is the spatially invariant function
  • the bi-linear interpolation filter B can be easily found by the conventional technology, accordingly the added filter coefficient Q of the PSF(P) and bi-linear interpolation filter B can be found.
  • the number of a kernel of the PSF(P) is set in accordance with the up-sampling value.
  • the number of the kernel is limited as 3, when the up-sampling value is 3, the number of the kernel is limited as 4.
  • the up-sampling value is 2, it can be used in an application segment for enlarging the size of the image as twice at a post processor of the compressed digital image and in finding of a sub-pixel moving vector in a H.263 moving picture compressed method.
  • the up-sampling value is 3, it can be used in using of a 1 ⁇ 3 unit moving vector in a H.261, moving picture compressed method.
  • H.263 and H.261 are moving picture compressed standards presented in the ITU-T (International Telecommunications Union-Telecommunication).
  • the present invention can be used for improving the image quality at the post processor of the compressed digital image by using the interpolation method for getting the interpolated high resolution image from the low resolution image when the resolution of the digital image lowers due to the low resolution image sensor.
  • the interpolation method of the present invention can improve the image quality by finding the moving vector of the moving picture compressed type.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Editing Of Facsimile Originals (AREA)

Abstract

The present invention relates to an interpolation method for enlarging a digital image or predicting a moving vector of a compressed image system as a sub-pixel unit when the image digitized through a CCD (Charge Coupled Device) camera ect. has a low resolution in a video phone or video conference or general digital video system, particularly the present invention can be adapted to a post processor of a compressed digital image in order to improve the image quality, and can be used for finding a moving vector of a moving picture compressed type, accordingly the present invention is capable of improving the image quality.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
More than one reissue application has been filed for the reissue of U.S. Pat. No. RE42,405. The reissue applications are patent application Ser. No. 14/963,818 (present application); Ser. Nos. 14/959,697; 14/961,306; 14/961,345; 14/961,275; 14/962,578; 14/959,662; 14/963,765; and 14/962,608, all of which are continuation reissues of U.S. Pat. No. RE42,405.
This application is a continuation reissue of U.S. reissue application Ser. No. 14/472,205, filed on Aug. 28, 2014, now U.S. Pat. No. RE45,859, issued on Jan. 19, 2016, which is a reissue of U.S. Pat. No. RE42,045, issued on Jan. 18, 2011, which is a reissue of U.S. Pat. No. 6,803,954 issued Oct. 12, 2004. More than one reissue application has been filed for the reissue of U.S. Pat. No. 6,803,954. U.S. patent application Ser. No. 11/546,484 is a reissue of U.S. Pat. No. 6,803,954; U.S. patent application Ser. No. 12/024,408, now abandoned, is a divisional reissue of U.S. Pat. No. 6,803,954; and U.S. patent application Ser. No. 12/424,927 is a continuation reissue of U.S. patent application Ser. No. 11/546,484, the entire contents of each are hereby incorporated by reference.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to an interpolation method adapted to enlargement of a low resolution image when the image digitized through a CCD (Charged-Coupled Device) has the low resolution, in particular to a filtering control method for improving the image quality of a bi-linear interpolated image which is capable of restoring a requested interpolated high resolution image from a low resolution image by finding a coefficient of a two-dimensional filter on the basis of a regularization image restoration method.
2. Description of the Prior Art
In the conventional technology, a still picture or a moving picture has or transmits a low resolution image because it can not physically satisfy a sensor having the low resolution or a nyquist value.
In addition, a compressed moving picture has or transmits the low resolution image due to its bit value problem.
For example, when the compressed moving picture having the low bit value is transmitted to a receiver and the receiver enlarges the transmitted moving picture, the resolution of the transmitted moving picture lowers due to a degradation phenomenon ect.
Accordingly, a method for getting a high resolution image from a low resolution image is required.
In the meantime, the method for getting the high resolution image from the low resolution image is largely divided into an image expansion type method and an image enhancement type method.
First, the image expansion type method converts the size of the low resolution image into a requested size. The bi-linear interpolation method, a zero order expansion method, and a cubic spline method are comprised in the image expansion type method.
However, as described above, the image expansion type method has an image visibility lowering problem because when the image is interpolation-restored by the above-mentioned method such as the bi-linear interpolation method, zero order hold expansion method, cubic spline method, the outlines of the image is over-blurred.
Meanwhile, the image enhancement type method comprises many methods, but the image enhancement type method causes a computational complexity, accordingly the method is not suited to a real-time processing due to the its computational complexity.
In addition, when the image enhancement type method is used for getting the high resolution image from the low resolution image, setting of each parameter is not adaptable.
For example, there is a POCS (Projection Onto Convex Set) method for increasing the resolution of an image. In the POCS method, in use of time region information, it is assumed as correlation between the images is uniformly same, but actually the correlation between the images is not uniform.
In addition, there is a mapping method for mapping a non-uniform sample of the low resolution image into a uniform sample of the high resolution image by using moving information and segmentation information of the image. However, the mapping method has the computational complexity problem, accordingly the mapping method is not suited to the real-time image data processing of the image processing system.
SUMMARY OF THE INVENTION
The object of the present invention is to provide a filtering control method for improving the image quality of a bi-linear interpolated image which is capable of improving the image quality of the interpolated image by using an interpolation method considering a real-time processing, a computational complexity and an efficiency when the digital video system seeks the interpolated image from the low resolution image.
The other object of the present invention is to provide the filtering control method for improving the image quality of the bi-linear interpolated image which is capable of finding a two-dimensional filter coefficient for getting the interpolated image from the low resolution image on the basis of a regularization image restoration method.
The other object of the present invention is to provide the filtering control method for improving the image quality of the bi-linear interpolated image which can approximate and find a PSF (Point Spread Function) for the bi-linear interpolated image from a modeling of the degraded image in the frequency region.
The other object of the present invention is to provide the filtering control method for improving the image quality of the bi-linear interpolated image which is capable of performing a real-time adaptive processing by finding a filter coefficient from the bi-linear interpolated image and approximated PSF.
In the present invention, in order to find a filter coefficient for finding the interpolated image from the low resolution image on the basis of the regularization image restoration method, when H is the PSP (Point Spread Function), f is a requested high resolution image, Z is the low resolution image, g is the high resolution image gotten from the bi-linear interpolation method, an added function M (f)=∥g−Hf∥2+α∥Cf∥2 for finding the PSF(H) from an equation g=Bz=Hf+n (B, H are bi-linear interpolated filters, n is a noise component generated by the assumed H) is defined.
The filtering control method for improving the image quality of the bi-linear interpolated image can be implemented by finding the PSF(H) from the added function M(f) by using an equation
H ( k , l ) = G ( k , l ) F ( k , l ) .
The filtering control method for improving the image quality of the bi-linear interpolated image can be implemented by finding a PSF(P) of a f=Pg function by using an equation
P ( k , l ) = H * ( k , l ) H * ( k , l ) H ( k , l ) + C * ( k , l ) C ( k , l )
after finding the PSF(H).
The filtering control method for improving the image quality of the bi-linear interpolated image can restore the requested high resolution image(f) by finding an added filter coefficient Q of the PSF(P) and interpolation filter B from the equation f=Pg=PBz=Qz.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates an image sample for getting a twice enlarged high resolution image according to the embodiment of the present invention.
FIG. 2 illustrates an interpolation filter coefficient for getting the twice enlarged image according to the embodiment of the present invention.
FIG. 3 illustrates an image sample for getting a three times enlarged high resolution image according to the other embodiment of the present invention.
FIG. 4 illustrates the interpolation filter coefficient for getting the three times enlarged image according to the other embodiment of the present invention.
FIG. 5 illustrates an image sample for getting a six times enlarged high resolution image according to the another embodiment of the present invention.
FIG. 6 illustrates the interpolation filter coefficient for getting the six times enlarged image according to the another embodiment of the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
FIG. 1 illustrates an image sample for getting a twice enlarged high resolution image according to the embodiment of the present invention.
As depicted in FIG. 1, a˜i illustrate low resolution pixels, A˜D illustrate high resolution pixels. In addition, pixels depicted as ‘x’ illustrate pixels interpolated as twice by a twice interpolation filter coefficient.
FIG. 2 illustrates the interpolation filter coefficient for getting a twice enlarged image according to the embodiment of the present invention. In other words, the interpolation filter coefficient for interpolating the twice enlarged image of FIG. 1 is depicted in FIG. 2.
As depicted in FIG. 2, the high resolution image is gotten from the low resolution pixels a˜i (3×3 pixels) inside of a circle of FIG. 1 by using the interpolation filter coefficient.
FIG. 3 illustrates an image sample for getting a three times enlarged high resolution image according to the other embodiment of the present invention.
As depicted in FIG. 3, a˜p illustrate the low resolution pixels, A˜I illustrate the high resolution pixels using the filter according to the present invention.
FIG. 4 illustrates the interpolation filter coefficient for getting the three times enlarged image according to the other embodiment of the present invention.
As depicted in FIG. 4, three times enlarged pixels which are newly generated illustrated as triangles in FIG. 3 are gotten from the low resolution pixels a˜p (4×4 pixels) by using the interpolation filter coefficient of FIG. 4.
FIG. 5 illustrates the image sample for getting a six times enlarged high resolution image according to the another embodiment of the present invention. In other words, it illustrates the image sample for getting the six times enlarged high resolution image from the twice and three times interpolation filter coefficients by using the bi-linear interpolation method.
As depicted in FIG. 5, pixels illustrated as a ‘X’ can be gotten by using the twice interpolation filter of FIG. 2, and pixels illustrated as a triangle can be gotten by using the three times interpolation filter coefficient of FIG. 4.
In addition, pixels illustrated as a quadrilateral can be gotten from the pixels generated by the twice and three times interpolation filter coefficients by using the bi-linear interpolation method.
FIG. 6 illustrates the interpolation filter coefficient for getting the six times enlarged image according to the another embodiment of the present invention. In other words, the interpolation filter coefficient for getting the six times enlarged image of FIG. 5 is depicted in FIG. 6.
Meanwhile, as depicted in FIG. 2, FIG. 4 and FIG. 6, the value found by using the interpolation filter coefficient of the present invention has an integer value.
In addition, a 9 bit shift is performed to the value calculated by the interpolation filter coefficient, accordingly there is no need to perform a floating point operation processing.
The twice, three times, six times interpolated images are depicted in FIG. 1˜FIG. 6, however the present invention is not limited by that, it can be adapted freely to a certain interpolation value.
Hereinafter, the filtering control method for improving the image quality of the bi-linear interpolated image will be described in more detail.
First, a spatially invariant PSF (Point Spread Function) for finding the interpolation filter coefficient according to the each interpolation value can be easily analyzed and approximated in the frequency region, accordingly the spatially invariant PSF (Point Spread Function) is considered from the bi-linear interpolated image.
After that, when it is assumed as the low resolution image is z, high resolution image gotten by the bi-linear interpolation method is g, high resolution image to be restored is f, the relation between the each image can be described as below.
g=Bz=Hf+n  [Equation 1]
Herein, the B, H, n are the bi-linear interpolation filters. H is the spatially invariant PSF defining the relation between the original high resolution image and high resolution image gotten by the interpolation method, and the n is a noise component generated by the assumed H.
Herein, when the noise component is neglected and a direct inverse is used in order to find the PSF(H), the PSF(H) can be described as below equation 2 in the frequency region.
H ( k , l ) = G ( k , l ) F ( k , l ) . [ Equation 2 ]
Herein, the H(k,l) is the component in the k,l frequency region of the PSF(H), the G (k,l) is the component in the k,l frequency region of the bi-linear interpolated image. In addition, the F (k,l) is the component in the k,l frequency region of the high resolution image.
Meanwhile, the high resolution image f to be restored is unknown, the PSF(H) can be gotten from the bi-linear interpolated high resolution image through a statistical processing after performing an under-sample processing of various images as various value.
Herein, the high resolution image is gotten by using the PSF(H) found from the direct inverse. In other words, there is a system stabilization problem because the high resolution image gotten from the PSF(H) by using the direct inverse is overshoot in the region where the k,l have ‘0’ value (in general, high frequency region) in the frequency region, accordingly the regularization image restoration for improving the system stabilization is used to solve the problem.
The regularization image restoration method is used for restoring the image or finding a certain PSF, an added function M(f) for finding the PSF(H) by using the regularization image restoration method can be described as below equation 3.
M(f)=∥g−Hf∥2+α∥Cf∥2  [Equation 3]
Herein, the first term of the right side of Equation 3 illustrates the credibility of the bi-linear interpolated image, the second term of the right side illustrates increase of the stability of the system by providing the mitigation to the restored image.
In addition, the ∥.∥ means a norm, the α is a regularization parameter for determining the credibility and mitigation of the original image. In addition, the C is the two-dimensional high frequency filter for determining the mitigation of the original image, in the present invention a two-dimensional Gaussian filter is used as the C.
When a gradient operator is adapted to Equation 3 in order to get the high resolution image, it can be described as below equation 4.
HjM(f)=−2HT(g−Hf)+2αCTCf=0  [Equation 4]
Herein, the T means a transpose of a matrix.
Meanwhile, conventionally a repetition method is used in order to get the high resolution image and regularization parameter, but it is not suited to the moving picture processing because the method causes lots of computational complexity.
Accordingly, in the present invention, the regularization parameter α is fixed as ‘1’, and the high resolution image f can be found as below equation 5.
f - H T g ( H T H + C T C ) = Pg [ Equation 5 ]
When the PSF(P) is found by Equation 5, PSF(P)=H/(HTH+CTC) requires the lots of computational complexity for calculating an inverse matrix, however the PSF(P) in Equation 5 is a block-circulant matrix, accordingly it can be easily calculated in the frequency region.
Accordingly, the PSF(P) can be found finally as below Equation 6.
P ( k , l ) = H * ( k , l ) H * ( k , l ) H ( k , l ) + C * ( k , l ) C ( k , l ) [ Equation 6 ]
Herein, the ‘*’ means a complex-conjugate.
The PSF(P) can be found by using an IFT (Inverse Fourier Transform) from Equation 6.
The requested high resolution image f can be found as below Equation 7 by using the found PSF(P) and Equation 1.
f=Pg=PBz=Qz  [Equation 7]
The PSF(P) is the spatially invariant function, the bi-linear interpolation filter B can be easily found by the conventional technology, accordingly the added filter coefficient Q of the PSF(P) and bi-linear interpolation filter B can be found.
Herein, in order to reduce the computational complexity, the number of a kernel of the PSF(P) is set in accordance with the up-sampling value.
When the up-sampling value is 2 in the present invention, the number of the kernel is limited as 3, when the up-sampling value is 3, the number of the kernel is limited as 4.
When the up-sampling value is 2, it can be used in an application segment for enlarging the size of the image as twice at a post processor of the compressed digital image and in finding of a sub-pixel moving vector in a H.263 moving picture compressed method.
In addition, when the up-sampling value is 3, it can be used in using of a ⅓ unit moving vector in a H.261, moving picture compressed method.
Herein, the H.263 and H.261 are moving picture compressed standards presented in the ITU-T (International Telecommunications Union-Telecommunication).
As described above, the present invention can be used for improving the image quality at the post processor of the compressed digital image by using the interpolation method for getting the interpolated high resolution image from the low resolution image when the resolution of the digital image lowers due to the low resolution image sensor.
In addition, the interpolation method of the present invention can improve the image quality by finding the moving vector of the moving picture compressed type.

Claims (26)

What is claimed is:
1. A filtering control method for improving the image quality of a bi-linear interpolated image when recovering a high resolution image from a low resolution image, the method comprising performing operations using at least one processor, the operations comprising:
restoring a requested high resolution image f by finding an added filter coefficient Q of a PSF(P) and a bi-linear interpolation filter B from an equation f=Pg=PBz=Qz, wherein f is the high resolution image as requested, P is the PSF (Point Spread Function), g is the high resolution image found by the bi-linear interpolation method, and z is the low resolution image;
wherein the high resolution image f can be restored by performing an added function M(f) definition process for finding the PSF(H) from an equation g=Bz=Hf+n, wherein B, H are bi-linear interpolation filters, and n is a noise component generated by the assumed H; and
wherein the added function M(f) is defined as M(f)=∥g−Hf∥2+α∥Cf∥2, wherein α is a regularization parameter, and C is a two-dimensional high frequency filter for finding mitigation of the original image.
2. The filtering control method for improving the image quality of the bi-linear interpolated image according to claim 1, wherein the regularization parameter α is fixed as ‘1’ in order to reduce a computational complexity.
3. The filtering control method for improving image quality of the b-linear interpolated image according to claim 1, wherein a two-dimensional gaussian filter is used as the two-dimensional high frequency filer C in order to determine the mitigation of the original image.
4. A filtering control method for improving the image quality of a bi-linear interpolated image when recovering a high resolution image from a low resolution image, the method comprising performing operations using at least one processor, the operations comprising:
restoring a requested high resolution image f by finding an added filter coefficient Q of a PSF(P) and a bi-linear interpolation filter B from an equation f=Pg=PBz=Qz, wherein f is the high resolution image as requested, P is the PSF (Point Spread Function), g is the high resolution image found by the bi-linear interpolation method, and z is the low resolution image;
wherein the high resolution image f can be restored by performing an added function M(f) definition process for finding the PSF(H) from an equation g=Bz=Hf+n, wherein B, H are bi-linear interpolation filters, and n is a noise component generated by the assumed H;
wherein the high resolution image f is restored by finding a PSF(P) of a f=Pg function after finding the PSF(H) from the added function M(f); and
wherein the PSF(H) is found by using an equation
H ( k , l ) = G ( k , l ) F ( k , l ) ,
 G(k,l) is the component in the k,l frequency region of the bi-linear interpolated image, and F(k,l) is the component in the k,l frequency region of the high resolution image.
5. A filtering control method for improving the image quality of a bi-linear interpolated image when recovering a high resolution image from a low resolution image, the method comprising performing operations using at least one processor, the operations comprising:
restoring a requested high resolution image f by finding an added filter coefficient Q of a PSF(P) and a bi-linear interpolation filter B from an equation f=Pg=PBz=Qz, wherein f is the high resolution image as requested, P is the PSF (Point Spread Function), g is the high resolution image found by the bi-linear interpolation method, and z is the low resolution image;
wherein the PSF(P) can be found by getting an IFT (Inverse Fourier Transform) by an equation
P ( k , l ) = H * ( k , l ) H * ( k , l ) H ( k , l ) + C * ( k , l ) C ( k , l ) .
H(k,l) is a component in the k,l frequency region of the PSF(H), and C is a two-dimensional high frequency filter.
6. The filtering control method for improving the image quality of the bi-linear interpolated image according to claim 5, wherein the number of a kernal of the PSF(P) is set in accordance with an up-sampling value of the image.
7. A filtering control method for improving the image quality of a bi-linear interpolated image when recovering a high resolution image from a low resolution image, the method comprising performing operations using at least one processor the operations comprising:
defining an added function M(f) for finding a PSF(H) from an equation g=Bz=Hf+n (wherein B, H are bi-linear filters, n is a noise component generated by an assumed H when the H is a PSF (Point Spread Function), f is a requested high resolution image, z is a low resolution image, and g is a high resolution image gotten by the bi-linear interpolation method);
finding a PSF(P) of a f=Pg function after finding the PSF (H) from the defined added function M(f); and
restoring the requested high resolution image f by finding an added filter coefficient Q of the PSF(P) and interpolation filter B from the equation f=Pg=PBZ=Qz;
wherein the added function M(f) is defined as M(f)=∥g−Hf∥2+α∥Cf∥2, wherein α is a regularization parameter, and C is a two-dimensional high frequency filter for finding the mitigation of the original image.
8. The filtering control method for improving the image quality a of the bi-linear interpolated image according to claim 7, wherein the regularization parameter α is fixed as ‘1’ in order to reduce a computational complexity.
9. The filtering control method for improving image quality of the bi-linear interpolated image according to claim 7, wherein a two-dimensional gaussian filter is used as the two-dimensional high frequency filter C in order to determine the mitigation of the original image.
10. A filtering control method for improving the image quality of a bi-linear interpolated image when recovering a high resolution image from a low resolution image, the method comprising performing operations using at least one processor the operations comprising:
defining an added function M(f) for finding a PSF(H) from an equation g=Bz=Hf+n (wherein B, H are bi-linear filters, n is a noise component generated by an assumed H when the H is a PSF (Point Spread Function), f is a requested high resolution image, z is a low resolution image, and g is a high resolution image gotten by the bi-linear interpolation method);
finding a PSF(P) of a f=Pg function after finding the PSF (H) from the defined added function M(f); and
restoring the requested high resolution image f by finding an added filter coefficient Q of the PSF(P) and interpolation filter B from the equation f=Pg=PBZ=Qz;
wherein the PSF(H) is found by an equation

H(k,l)=(G(k,l)/F(−k,l),
 wherein G(k,l) is the component in the k,l frequency region of the bi-linear interpolated image, and F(k,l) is the component in the k,l frequency region of the high resolution image.
11. A filtering control method for improving the image quality of a bi-linear interpolated image when recovering a high resolution image from a low resolution image, the method comprising performing operations using at least one processor, the operations comprising:
defining an added function M(f) for finding a PSF(H) from an equation g=Bz=Hf+n (wherein B, H are bi-linear filters, n is a noise component generated by an assumed H when the H is a PSF (Point Spread Function), f is a requested high resolution image, z is a low resolution image, and g is a high resolution image gotten by the bi-linear interpolation method);
finding a PSF(P) of a f=Pg function after finding the PSF (H) from the defined added function M(f); and
restoring the requested high resolution image f by finding an added filter coefficient Q of the PSF(P) and interpolation filter B from the equation f=Pg=PBZ=Qz;
wherein the PSF(P) is found by using an IFT (Inverse Fourier Transform) by an equation
P ( k , l ) = H * ( k , l ) H * ( k , l ) H ( k , l ) + C * ( k , l ) C ( k , l ) .
H(k,l) is a component in the k,l frequency region of the PSF(H), and C is a two-dimensional high frequency filter.
12. The filtering control method for improving the image quality of the bi-linear interpolated image according to claim 11, wherein the number of a kernal of the PSF(P) is differently set in accordance with an up-sampling value of the image.
13. A method for generating an interpolated pixel data, the method comprising generating a set of the interpolated pixel data from a set of original pixel data from an original image, wherein interpolated pixel data for a particular pixel is generated by performing operations using at least one processor, the operations comprising:
selecting original pixel data for more than three pixels of the original image;
obtaining at least a first filter coefficient and a second filter coefficient, the first filter coefficient and the second filter coefficient being configured to interpolate the original pixel data;
applying the first filter coefficient to the selected original pixel data to produce first interpolated pixel data, the first filter coefficient including weighting factors having at least three different numerical values, wherein applying the first filter coefficient to the selected original pixel data comprises:
multiplying each of the weighting factors and the selected original pixel data to produce weighted pixel data, and
summing the weighted pixel data to produce the first interpolated pixel data;
multiplying the second filter coefficient and the first interpolated pixel data to produce second interpolated pixel data; and
identifying the interpolated pixel data as the second inter polated pixel data.
14. The method of claim 13, wherein the second filter coefficient is a matrix that includes one or more individual numeric values.
15. The method of claim 13, wherein the first filter coefficient and the second filter coefficient each comprise at least one integer value.
16. The method of claim 13, wherein a value of the first filter coefficient and a value of the second filter coefficient are one.
17. The method of claim 13, wherein a value of the second filter coefficient is one.
18. The method of claim 13, wherein the original image is obtained from a low-resolution imaging system.
19. The method of claim 13, wherein the second filter coefficient is a point spread function (P) and the first filter coefficient is a bi-linear interpolation filter (B).
20. A method for a moving picture compression with a video system by generating an interpolated pixel data, the method comprising:
generating a set of interpolated pixel data from a set of original pixel data from an original image; and
finding a sub-pixel motion vector using the set of interpolated pixel data,
wherein interpolated pixel data for a particular pixel is generated by performing operations using the video system, the operations comprising:
selecting, by the video system, original pixel data including more than three pixels of the original image;
obtaining, by the video system, at least a first filter coefficient and a second filter coefficient, the first filter coefficient and the second filter coefficient being configured to interpolate the original pixel data, the first filter coefficient including weighting factors having at least three different integer values, and the second filter coefficient including at least one integer value;
applying, by the video system, the first filter coefficient to the selected original pixel data to produce first interpolated pixel data, wherein said applying the first filter coefficient to the selected original pixel data comprises:
multiplying each of the weighting factors and the selected original pixel data to produce weighted pixel data, and
summing the weighted pixel data to produce the first interpolated pixel data;
multiplying, by the video system, the second filter coefficient and the first interpolated pixel data to produce second interpolated pixel data; and
identifying, by the video system, the interpolated pixel data for the particular pixel as the second interpolated pixel data.
21. The method of claim 20, wherein the second filter coefficient is a matrix that includes one or more individual numeric values.
22. The method of claim 20, wherein a value of the first filter coefficient and a value of the second filter coefficient are one.
23. The method of claim 20, wherein a value of the second filter coefficient is one.
24. The method of claim 20, wherein the original image is obtained from a low-resolution imaging system.
25. The method of claim 20, wherein the second filter coefficient is a point spread function (P) and the first filter coefficient is a bi-linear interpolation filter (B).
26. The method of claim 20, wherein the at least three different integer values include at least one positive integer value and at least one negative integer value.
US14/963,818 1999-10-21 2015-12-09 Filtering control method for improving image quality of bi-linear interpolated image Expired - Lifetime USRE47291E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/963,818 USRE47291E1 (en) 1999-10-21 2015-12-09 Filtering control method for improving image quality of bi-linear interpolated image

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
KR99-45805 1999-10-21
KR1019990045805A KR100311482B1 (en) 1999-10-21 1999-10-21 Method of filtering control of image bilinear interpolation
US09/692,156 US6803954B1 (en) 1999-10-21 2000-10-20 Filtering control method for improving image quality of bi-linear interpolated image
US11/546,484 USRE42045E1 (en) 1999-10-21 2006-10-12 Filtering control method for improving image quality of bi-linear interpolated image
US14/472,205 USRE45859E1 (en) 1999-10-21 2014-08-28 Filtering control method for improving image quality of bi-linear interpolated image
US14/963,818 USRE47291E1 (en) 1999-10-21 2015-12-09 Filtering control method for improving image quality of bi-linear interpolated image

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/546,484 Reissue USRE42045E1 (en) 1999-10-21 2006-10-12 Filtering control method for improving image quality of bi-linear interpolated image

Publications (1)

Publication Number Publication Date
USRE47291E1 true USRE47291E1 (en) 2019-03-12

Family

ID=19616313

Family Applications (10)

Application Number Title Priority Date Filing Date
US09/692,156 Ceased US6803954B1 (en) 1999-10-21 2000-10-20 Filtering control method for improving image quality of bi-linear interpolated image
US11/546,484 Ceased USRE42045E1 (en) 1999-10-21 2006-10-12 Filtering control method for improving image quality of bi-linear interpolated image
US12/424,927 Expired - Lifetime USRE42747E1 (en) 1999-10-21 2009-04-16 Filtering control method for improving image quality of bi-linear interpolated image
US14/472,205 Expired - Lifetime USRE45859E1 (en) 1999-10-21 2014-08-28 Filtering control method for improving image quality of bi-linear interpolated image
US14/959,697 Expired - Lifetime USRE47337E1 (en) 1999-10-21 2015-12-04 Filtering control method for improving image quality of bi-linear interpolated image
US14/959,662 Expired - Lifetime USRE47341E1 (en) 1999-10-21 2015-12-04 Filtering control method for improving image quality of bi-linear interpolated image
US14/961,306 Expired - Lifetime USRE47238E1 (en) 1999-10-21 2015-12-07 Filtering control method for improving image quality of bi-linear interpolated image
US14/961,275 Expired - Lifetime USRE47310E1 (en) 1999-10-21 2015-12-07 Filtering control method for improving image quality of bi-linear interpolated image
US14/962,608 Expired - Lifetime USRE47274E1 (en) 1999-10-21 2015-12-08 Filtering control method for improving image quality of bi-linear interpolated image
US14/963,818 Expired - Lifetime USRE47291E1 (en) 1999-10-21 2015-12-09 Filtering control method for improving image quality of bi-linear interpolated image

Family Applications Before (9)

Application Number Title Priority Date Filing Date
US09/692,156 Ceased US6803954B1 (en) 1999-10-21 2000-10-20 Filtering control method for improving image quality of bi-linear interpolated image
US11/546,484 Ceased USRE42045E1 (en) 1999-10-21 2006-10-12 Filtering control method for improving image quality of bi-linear interpolated image
US12/424,927 Expired - Lifetime USRE42747E1 (en) 1999-10-21 2009-04-16 Filtering control method for improving image quality of bi-linear interpolated image
US14/472,205 Expired - Lifetime USRE45859E1 (en) 1999-10-21 2014-08-28 Filtering control method for improving image quality of bi-linear interpolated image
US14/959,697 Expired - Lifetime USRE47337E1 (en) 1999-10-21 2015-12-04 Filtering control method for improving image quality of bi-linear interpolated image
US14/959,662 Expired - Lifetime USRE47341E1 (en) 1999-10-21 2015-12-04 Filtering control method for improving image quality of bi-linear interpolated image
US14/961,306 Expired - Lifetime USRE47238E1 (en) 1999-10-21 2015-12-07 Filtering control method for improving image quality of bi-linear interpolated image
US14/961,275 Expired - Lifetime USRE47310E1 (en) 1999-10-21 2015-12-07 Filtering control method for improving image quality of bi-linear interpolated image
US14/962,608 Expired - Lifetime USRE47274E1 (en) 1999-10-21 2015-12-08 Filtering control method for improving image quality of bi-linear interpolated image

Country Status (2)

Country Link
US (10) US6803954B1 (en)
KR (1) KR100311482B1 (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6781570B1 (en) * 2000-11-09 2004-08-24 Logitech Europe S.A. Wireless optical input device
KR100400017B1 (en) * 2001-12-19 2003-09-29 삼성전자주식회사 Apparatus and method for enhancing resolution of image
JP3513506B2 (en) * 2002-02-20 2004-03-31 キヤノン株式会社 WHITE BALANCE CORRECTION DEVICE, IMAGING DEVICE WITH THE SAME, AND WHITE BALANCE CORRECTION METHOD
EP1638447A2 (en) * 2003-06-02 2006-03-29 The General Hospital Corporation Delay-compensated calculation of tissue blood flow
US7680342B2 (en) * 2004-08-16 2010-03-16 Fotonation Vision Limited Indoor/outdoor classification in digital images
US7606417B2 (en) 2004-08-16 2009-10-20 Fotonation Vision Limited Foreground/background segmentation in digital images with differential exposure calculations
US7532772B2 (en) * 2004-07-20 2009-05-12 Duke University Coding for compressive imaging
JP4774736B2 (en) * 2004-12-27 2011-09-14 カシオ計算機株式会社 Image enlargement apparatus and imaging apparatus
US7692696B2 (en) * 2005-12-27 2010-04-06 Fotonation Vision Limited Digital image acquisition system with portrait mode
IES20060559A2 (en) * 2006-02-14 2006-11-01 Fotonation Vision Ltd Automatic detection and correction of non-red flash eye defects
JP4970468B2 (en) * 2006-02-14 2012-07-04 デジタルオプティックス・コーポレイション・ヨーロッパ・リミテッド Image blur processing
IES20060564A2 (en) * 2006-05-03 2006-11-01 Fotonation Vision Ltd Improved foreground / background separation
US20070286514A1 (en) * 2006-06-08 2007-12-13 Michael Scott Brown Minimizing image blur in an image projected onto a display surface by a projector
US8175382B2 (en) * 2007-05-10 2012-05-08 Microsoft Corporation Learning image enhancement
JP5102552B2 (en) * 2007-07-25 2012-12-19 イーストマン コダック カンパニー Image processing system, imaging device, and output device
KR101399012B1 (en) 2007-09-12 2014-05-26 삼성전기주식회사 apparatus and method for restoring image
US8130257B2 (en) * 2008-06-27 2012-03-06 Microsoft Corporation Speaker and person backlighting for improved AEC and AGC
US9741095B2 (en) * 2014-01-29 2017-08-22 Raytheon Company Method for electronic zoom with sub-pixel offset
KR20150118731A (en) 2014-04-15 2015-10-23 삼성전자주식회사 Ultrasound imaging apparatus and control method for the same
KR102195407B1 (en) 2015-03-16 2020-12-29 삼성전자주식회사 Image signal processor and devices having the same
WO2019204672A1 (en) * 2018-04-19 2019-10-24 Huawei Technologies Co., Ltd. Interpolation filter for an intra prediction apparatus and method for video coding

Citations (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4550437A (en) 1981-06-19 1985-10-29 Hitachi, Ltd. Apparatus for parallel processing of local image data
US5208872A (en) 1990-03-30 1993-05-04 The United States Of America As Represented By The United States National Aeronautics And Space Administration Programmable remapper with single flow architecture
US5258938A (en) * 1990-11-30 1993-11-02 Norio Akamatsu Interpolating method using bit-shift and addition/subtraction operations
US5274469A (en) 1991-12-23 1993-12-28 Eastman Kodak Company Sample rate converter circuit for image data
US5396592A (en) * 1991-05-30 1995-03-07 Sony Corporation Image signal interpolating circuit for calculating interpolated values for varying block sizes
US5659364A (en) 1993-12-24 1997-08-19 Matsushita Electric Industrial Co., Ltd. Motion vector detection circuit
US5696848A (en) 1995-03-09 1997-12-09 Eastman Kodak Company System for creating a high resolution image from a sequence of lower resolution motion images
US5821915A (en) 1995-10-11 1998-10-13 Hewlett-Packard Company Method and apparatus for removing artifacts from scanned halftone images
US5838387A (en) * 1996-12-20 1998-11-17 Intel Corporation Digital video scaling engine
US5875268A (en) 1993-09-27 1999-02-23 Canon Kabushiki Kaisha Image processing with low-resolution to high-resolution conversion
US5880767A (en) 1996-09-11 1999-03-09 Hewlett-Packard Company Perceptual image resolution enhancement system
US5917963A (en) 1995-09-21 1999-06-29 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US5949914A (en) 1997-03-17 1999-09-07 Space Imaging Lp Enhancing the resolution of multi-spectral image data with panchromatic image data using super resolution pan-sharpening
US5991464A (en) 1998-04-03 1999-11-23 Odyssey Technologies Method and system for adaptive video image resolution enhancement
US6058248A (en) 1997-04-21 2000-05-02 Hewlett-Packard Company Computerized method for improving data resolution
US6061477A (en) * 1996-04-18 2000-05-09 Sarnoff Corporation Quality image warper
US6072907A (en) 1997-05-28 2000-06-06 Xerox Corporation Method and apparatus for enhancing and thresholding images
US6154574A (en) * 1997-11-19 2000-11-28 Samsung Electronics Co., Ltd. Digital focusing method and apparatus in image processing system
US6236433B1 (en) 1998-09-29 2001-05-22 Intel Corporation Scaling algorithm for efficient color representation/recovery in video
US6252576B1 (en) * 1998-08-06 2001-06-26 In-System Design, Inc. Hardware-efficient system for hybrid-bilinear image scaling
US6263120B1 (en) 1997-11-11 2001-07-17 Sharp Kabushiki Kaisha Image data interpolation processing method
US6285804B1 (en) 1998-12-21 2001-09-04 Sharp Laboratories Of America, Inc. Resolution improvement from multiple images of a scene containing motion at fractional pixel values
US6331902B1 (en) 1999-10-14 2001-12-18 Match Lab, Inc. System and method for digital color image processing
US6496608B1 (en) * 1999-01-15 2002-12-17 Picsurf, Inc. Image data interpolation system and method
US6529638B1 (en) 1999-02-01 2003-03-04 Sharp Laboratories Of America, Inc. Block boundary artifact reduction for block-based image compression
US6567568B1 (en) 1998-01-26 2003-05-20 Minolta Co., Ltd. Pixel interpolating device capable of preventing noise generation
US6665344B1 (en) 1998-06-29 2003-12-16 Zenith Electronics Corporation Downconverting decoder for interlaced pictures
US6714593B1 (en) 1997-10-21 2004-03-30 Robert Bosch Gmbh Motion compensating prediction of moving image sequences
US6912004B1 (en) 1998-09-15 2005-06-28 Phase One A/S Method and system for processing images
US6950469B2 (en) * 2001-09-17 2005-09-27 Nokia Corporation Method for sub-pixel value interpolation
US8428396B2 (en) * 2007-12-04 2013-04-23 Huawei Technologies Co., Ltd. Image interpolation method and apparatus, and method for obtaining interpolation coefficients

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE247308T1 (en) * 1993-01-22 2003-08-15 Olympus Optical Co IMAGE PROCESSOR
GB2311184A (en) * 1996-03-13 1997-09-17 Innovision Plc Motion vector field error estimation
US6577320B1 (en) * 1999-03-22 2003-06-10 Nvidia Corporation Method and apparatus for processing multiple types of pixel component representations including processes of premultiplication, postmultiplication, and colorkeying/chromakeying

Patent Citations (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4550437A (en) 1981-06-19 1985-10-29 Hitachi, Ltd. Apparatus for parallel processing of local image data
US5208872A (en) 1990-03-30 1993-05-04 The United States Of America As Represented By The United States National Aeronautics And Space Administration Programmable remapper with single flow architecture
US5258938A (en) * 1990-11-30 1993-11-02 Norio Akamatsu Interpolating method using bit-shift and addition/subtraction operations
US5396592A (en) * 1991-05-30 1995-03-07 Sony Corporation Image signal interpolating circuit for calculating interpolated values for varying block sizes
US5274469A (en) 1991-12-23 1993-12-28 Eastman Kodak Company Sample rate converter circuit for image data
US5875268A (en) 1993-09-27 1999-02-23 Canon Kabushiki Kaisha Image processing with low-resolution to high-resolution conversion
US5659364A (en) 1993-12-24 1997-08-19 Matsushita Electric Industrial Co., Ltd. Motion vector detection circuit
US5696848A (en) 1995-03-09 1997-12-09 Eastman Kodak Company System for creating a high resolution image from a sequence of lower resolution motion images
US5917963A (en) 1995-09-21 1999-06-29 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US5821915A (en) 1995-10-11 1998-10-13 Hewlett-Packard Company Method and apparatus for removing artifacts from scanned halftone images
US6061477A (en) * 1996-04-18 2000-05-09 Sarnoff Corporation Quality image warper
US5880767A (en) 1996-09-11 1999-03-09 Hewlett-Packard Company Perceptual image resolution enhancement system
US5838387A (en) * 1996-12-20 1998-11-17 Intel Corporation Digital video scaling engine
US5949914A (en) 1997-03-17 1999-09-07 Space Imaging Lp Enhancing the resolution of multi-spectral image data with panchromatic image data using super resolution pan-sharpening
US6075926A (en) 1997-04-21 2000-06-13 Hewlett-Packard Company Computerized method for improving data resolution
US6058248A (en) 1997-04-21 2000-05-02 Hewlett-Packard Company Computerized method for improving data resolution
US6072907A (en) 1997-05-28 2000-06-06 Xerox Corporation Method and apparatus for enhancing and thresholding images
US6714593B1 (en) 1997-10-21 2004-03-30 Robert Bosch Gmbh Motion compensating prediction of moving image sequences
US6263120B1 (en) 1997-11-11 2001-07-17 Sharp Kabushiki Kaisha Image data interpolation processing method
US6154574A (en) * 1997-11-19 2000-11-28 Samsung Electronics Co., Ltd. Digital focusing method and apparatus in image processing system
US6567568B1 (en) 1998-01-26 2003-05-20 Minolta Co., Ltd. Pixel interpolating device capable of preventing noise generation
US5991464A (en) 1998-04-03 1999-11-23 Odyssey Technologies Method and system for adaptive video image resolution enhancement
US6665344B1 (en) 1998-06-29 2003-12-16 Zenith Electronics Corporation Downconverting decoder for interlaced pictures
US6252576B1 (en) * 1998-08-06 2001-06-26 In-System Design, Inc. Hardware-efficient system for hybrid-bilinear image scaling
US6912004B1 (en) 1998-09-15 2005-06-28 Phase One A/S Method and system for processing images
US6236433B1 (en) 1998-09-29 2001-05-22 Intel Corporation Scaling algorithm for efficient color representation/recovery in video
US6285804B1 (en) 1998-12-21 2001-09-04 Sharp Laboratories Of America, Inc. Resolution improvement from multiple images of a scene containing motion at fractional pixel values
US6496608B1 (en) * 1999-01-15 2002-12-17 Picsurf, Inc. Image data interpolation system and method
US6529638B1 (en) 1999-02-01 2003-03-04 Sharp Laboratories Of America, Inc. Block boundary artifact reduction for block-based image compression
US6331902B1 (en) 1999-10-14 2001-12-18 Match Lab, Inc. System and method for digital color image processing
US6950469B2 (en) * 2001-09-17 2005-09-27 Nokia Corporation Method for sub-pixel value interpolation
US8428396B2 (en) * 2007-12-04 2013-04-23 Huawei Technologies Co., Ltd. Image interpolation method and apparatus, and method for obtaining interpolation coefficients

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Office Action for U.S. Appl. No. 12/024,408, mailed Dec. 4, 2008, 10 pages.
Office Action for U.S. Appl. No. 12/024,408, mailed Jun. 29, 2009, 7 pages.

Also Published As

Publication number Publication date
USRE47341E1 (en) 2019-04-09
USRE45859E1 (en) 2016-01-19
US6803954B1 (en) 2004-10-12
USRE42045E1 (en) 2011-01-18
KR20010038010A (en) 2001-05-15
USRE47238E1 (en) 2019-02-12
USRE47310E1 (en) 2019-03-19
USRE47274E1 (en) 2019-03-05
USRE42747E1 (en) 2011-09-27
KR100311482B1 (en) 2001-10-18
USRE47337E1 (en) 2019-04-02

Similar Documents

Publication Publication Date Title
USRE47291E1 (en) Filtering control method for improving image quality of bi-linear interpolated image
US6285804B1 (en) Resolution improvement from multiple images of a scene containing motion at fractional pixel values
EP0731600B1 (en) Creating a high resolution image from a sequence of lower resolution motion images
US8078010B2 (en) Method and device for video image processing, calculating the similarity between video frames, and acquiring a synthesized frame by synthesizing a plurality of contiguous sampled frames
US6650704B1 (en) Method of producing a high quality, high resolution image from a sequence of low quality, low resolution images that are undersampled and subject to jitter
US6005983A (en) Image enhancement by non-linear extrapolation in frequency space
US7164807B2 (en) Method and system for automatically reducing aliasing artifacts
EP2164040B1 (en) System and method for high quality image and video upscaling
JPH06245113A (en) Equipment for improving picture still more by removing noise and other artifact
US20050094899A1 (en) Adaptive image upscaling method and apparatus
CN106846250B (en) Super-resolution reconstruction method based on multi-scale filtering
US7742660B2 (en) Scale-space self-similarity image processing
JP2000354244A (en) Image processing unit, its method and computer-readable storage medium
Lafenetre et al. Implementing handheld burst super-resolution
KR100311481B1 (en) Method and apparatus of regularization image restoration
CN107155096A (en) A kind of super resolution ratio reconstruction method and device based on half error back projection
Zhao et al. Super-fusion: a super-resolution method based on fusion
Patanavijit et al. An iterative super-resolution reconstruction of image sequences using a Bayesian approach with BTV prior and affine block-based registration
CA2011507A1 (en) Parallel image filtering using convolution
JP3143627B2 (en) Edge-preserving noise reduction method
JPH04340886A (en) Moving image encoding device and moving image decoding device
JP4698015B2 (en) Method and system for determining weighted average measured reflectance parameters
Messing et al. Improved multi-image resolution enhancement for colour images captured by single-CCD cameras
WO2023174546A1 (en) Method and image processor unit for processing image data
Váša et al. Improved super-resolution method and its acceleration

Legal Events

Date Code Title Description
CC Certificate of correction