TWI281143B - Method for designing video and image scaler based on 2-d finite impulse response filter - Google Patents
Method for designing video and image scaler based on 2-d finite impulse response filter Download PDFInfo
- Publication number
- TWI281143B TWI281143B TW94118277A TW94118277A TWI281143B TW I281143 B TWI281143 B TW I281143B TW 94118277 A TW94118277 A TW 94118277A TW 94118277 A TW94118277 A TW 94118277A TW I281143 B TWI281143 B TW I281143B
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- impulse response
- finite impulse
- zero
- dimensional
- Prior art date
Links
Landscapes
- Image Processing (AREA)
- Editing Of Facsimile Originals (AREA)
- Picture Signal Circuits (AREA)
Abstract
Description
1281143 五、發明說明α) 【發明所屬之技術領域】 本發明有關於影像縮放器之改良,尤其是指以二維有 限脈衝響應渡波器(2-D Finite lmpuise Resp〇nse filter)設計影像縮放器(sc a 1 e r )之方法〇 【先前技術】 人類正處於一種數位化的世界,數位影像處理廣泛應 :於:多領域中,例如個人電腦、數位相冑、數位電視… f & 』不器如LCD、PDP等亦成為人類日常生活中的 面上有許多不同尺寸的數位顯示面板,#影彳象源 :ί::ί:定的。因此必須使用縮放器(二原 ’ 付θ不同顯示面板的大小。 具# Γ=Γ縮放器方法或内插法如雙線性法或雙立方法大 里使用於相關產品中,不過其中有一些缺陷。又 下面先說明一些傳統方法:1281143 V. INSTRUCTION DESCRIPTION α) Technical Field of the Invention The present invention relates to an improvement of an image scaler, and more particularly to designing an image scaler by a 2-D Finite lmpuise Resp〇nse filter. (sc a 1 er ) Method 先前 [Prior Art] Human beings are in a digital world, and digital image processing should be widely used: in many fields, such as personal computers, digital cameras, digital TVs... f & Devices such as LCDs, PDPs, etc. have also become digital display panels of many different sizes on the surface of human life, #影: Source: ί:: ί: fixed. Therefore, it is necessary to use a scaler (the size of the two original display panels). The # Γ=Γ scaler method or interpolation method such as bilinear method or double vertical method is used in related products, but there are some defects. Here are some traditional methods:
(1)複製法 請參考圖_ •只是複製前面的 圖二,其中C、D 來的三倍,此法 插點,結果示於 ’ #號大小必須放大到原 點(如A或B)並插入作為内 點就是A點的複製。 (2 )雙線性法 此法中C、η机π 口 Λ -、占不疋Α點的複製,而是a點與β點的合(1) Copy method please refer to the figure _ • Just copy the previous figure 2, where C and D are three times, this method is inserted, and the result is shown in '# size must be enlarged to the origin (such as A or B) and Insert as an interior point is a copy of point A. (2) Bilinear method In this method, C and η machines are π-port Λ -, which account for the replication of the point, but the combination of point a and point β.
第6頁 1281143 五、發明說明(2) 成。因為C點較靠近a點,所以c點具有較多A點的成份。另 一方面則D點具有較多b點的成份。採取線性合成法,得 到:Page 6 1281143 V. Description of invention (2) Cheng. Since point C is closer to point a, point c has more components of point A. On the other hand, point D has more components of point b. Take linear synthesis and get:
C = 2/3*A + 1/3*BC = 2/3*A + 1/3*B
D = 1/3*A + 2/3*B 結果示於圖三。 (3 )雙立方法 、此法類似於雙線性法,只是合成方程式是三次方程 參式。 遷像縮放 ’然後 影像, ^在縮放影像時,上述方法是先施用於水平樣本 方也用於其結果的垂直樣本上,於是得到最後的 如圖四所示。 、 上述的縮放或内插法廣泛使用於不同的領 =複製法時’影像縮放器在畫面的邊緣出 的虽使 2用雙線性法時則晝面模糊不清;*用雙立Jr點丄 曰又人眼而言不夠清晰。不論使用哪一種方法,^息 ;二別在水平與垂直方向上運作,如圖四所示。不:都 ”影像基本上是二維的,s此以一維( 不過自然 …影像的結果將產生失真,冑人眼而言看\\直不):放D = 1/3*A + 2/3*B The results are shown in Figure 3. (3) The double vertical method, this method is similar to the bilinear method, except that the synthetic equation is a cubic equation. The image is zoomed ‘and then the image, ^. When scaling the image, the above method is applied to the horizontal sample and also to the vertical sample of the result, so the final image is shown in Figure 4. The above-mentioned scaling or interpolation method is widely used in different collar=copying methods. 'The image scaler is out of the edge of the screen. Although the double-linear method is used, the surface is blurred; *Using the double-jj point It’s not clear enough for the human eye. No matter which method is used, the two are operated in the horizontal and vertical directions, as shown in Figure 4. No: All ”images are basically two-dimensional, s this one-dimensional (but natural...the result of the image will be distorted, it’s not visible to the human eye): put
12811431281143
然0 本發明的目的即在改良及/或排除上述的缺點。 【發明内容】 本發明主要的目的在提供一稀以-波器設計影像縮放器的方法。首先,G、,’ Z脈衝響應遽 Γ! ίί lst rate)加以取樣,而得到二維 ΐ本,其次,將零點填到二維樣本之間而得到一零點填入 式影像,第三步,將零點填入式影像通 :、 響應遽波器(2-D FIRfilter):維有限脈衝 — 於疋侍到一放大影像。 二所需的放大倍數是L,且所需的影像處理方塊大小 疋Mx N,則將零點插入一Μχ N的二維樣本之間,得到一 L) ^XL) X (NXL)白勺零點填入式影像;取用一(MxL) X (NXL)的二維有限脈衝響應濾波器;該(M xL) X (Nx L) 4 一維有限脈衝響應濾波器具有(Μχ L) χ (NxL)個係數; (MxL) x (NxL)的零點填入式影像則以該(MxL) χ (Νχ 的二維有限脈衝響應濾波器的對應係數加以處理,然後相 加而成為(Μ X L) X (Ν X L)影像處理方塊中心像素的結果影 .像’移動影像處理方塊至下一個要處理的位置,重覆上述 程序,直到所有零點填入式影像都處理完畢為止。 【實施方式】 本發明提出以二維有限脈衝響應濾波器設計影像縮放 器之方法。However, the object of the present invention is to improve and/or eliminate the above disadvantages. SUMMARY OF THE INVENTION A primary object of the present invention is to provide a method for designing an image scaler with a rare wave-wave device. First, G,, 'Z impulse response 遽Γ! ίί lst rate) is sampled to obtain a two-dimensional transcript, and secondly, zero is filled between the two-dimensional samples to obtain a zero-fill image, the third step , the zero-fill image pass:, the response filter (2-D FIRfilter): the dimension of the finite pulse - Yu Wei to a magnified image. The required magnification is L, and the required image processing block size 疋Mx N, then insert the zero point between the two-dimensional samples of N , to get a L) ^ XL) X (NXL) zero fill Input image; take a (MxL) X (NXL) two-dimensional finite impulse response filter; the (M xL) X (Nx L) 4 one-dimensional finite impulse response filter has (Μχ L) χ (NxL) (MxL) x (NxL) zero-fill image is processed by the corresponding coefficient of the (MxL) χ (Νχ two-dimensional finite impulse response filter, and then added to become (Μ XL) X ( Ν XL) the result of the image processing of the center pixel of the block. The image is repeated until the next image to be processed is processed until the position of the next image is processed. [Embodiment] The present invention proposes A method of designing an image scaler using a two-dimensional finite impulse response filter.
第8頁 1281143 五、發明說明(4) " ---- 請參考圖五,第一步將零點填入原來的樣本之間;其 -欠則將零點填入式影像通過一二維有限脈衝響應濾波器, 於是得到一放大的影像。若放大影像的大小不是原來影像 =整數倍,或者比原來的影像小,則可將原來影像放大到 最終影像的整數倍,然後取其等分的部分樣品作為最終影 像。 根據數位信號處理的取樣理論,只有當取樣率高於奈 ,斯特取樣率(Nyquist rate)時,數位化的信號才能恢^ 成原來的類比信號。濾除高頻頻帶所得的信號頻譜與原來 的頻譜完全一 # ’取樣頻率愈高’所需的低通遽波器愈 例如圖六示出以高於奈奎斯特取樣率(Nyquist rate) $得的取樣信號,圖七則為其頻譜。為了得到一N倍的影 f,將(N-1)個零點填入原來樣本之間,如圖八所示。圖 是填入零點後的頻譜。若濾除卜pi/N : pi/N]以外的 1可信,’將得到—新頻譜如圖十所示。#以圖六取樣率 I /口侍到取樣仏纟,如圖十一所示’則所得的頻譜與圖Page 8 1281143 V. Invention Description (4) " ---- Please refer to Figure 5, the first step is to fill the zero point between the original samples; the - under the zero point fill image through a two-dimensional limited The impulse response filter then produces an amplified image. If the size of the enlarged image is not the original image = integer multiple, or smaller than the original image, the original image can be enlarged to an integral multiple of the final image, and then part of the sample is taken as the final image. According to the sampling theory of digital signal processing, the digitized signal can be restored to the original analog signal only when the sampling rate is higher than the Nyquist rate. The signal spectrum obtained by filtering out the high frequency band is completely the same as the original spectrum. The lower the sampling frequency is, the more the low pass chopper is required, for example, the higher the Nyquist rate than the Nyquist rate. The sampled signal obtained, Figure 7 is its spectrum. In order to obtain an N-fold shadow f, (N-1) zeros are filled between the original samples, as shown in Fig. 8. The graph is the spectrum after filling in the zero point. If the filter 1 other than pi/N: pi/N] is trusted, the new spectrum will be obtained as shown in Fig. 10. #图六六样本率 I / mouth attendance to sampling 仏纟, as shown in Figure -11, then the spectrum and graph
^相同。這就證明零點填入與提高原來信號的取 相同的效果。 t ’ 衝響應渡波器為基礎,本發 遽波器為基礎,意即不必分 像。二維有限脈衝響應濾波 分解的。因為濾波器必須是 像,所以二維有限脈衝響應 上述方法是以一維有限脈 明則提出以二維有限脈衝響應 別在水平與垂直方向上放大影 益的係數可以是可分解或不可 線性的’以避免產生模糊的影^ Same. This proves that the zero fill is the same as the improvement of the original signal. The t' impulse response is based on the chopper, which means that it is not necessary to be imaged. Two-dimensional finite impulse response filtering is decomposed. Since the filter must be an image, the two-dimensional finite impulse response is based on a one-dimensional finite pulse. The coefficient of the two-dimensional finite impulse response in the horizontal and vertical directions can be decomposed or non-linear. To avoid blurry shadows
第9頁 1281143 五、發明說明(5) 濾波器的係數是以中心點為準而對稱。 、、^維有限脈衝響應濾波器的方法與一維有限脈衝響應 遽波器的方法相同,將零點插在所有原來樣本之間而達到 所需的尺寸,如圖十二所示。 、、然後將零點填入式影像的頻譜以一二維有限脈衝響應 濾、波器直接過濾,所得影像的頻譜與過量取樣的取樣信號 具有相同的頻譜。將放大的影像重訂尺寸,取取其等分的 所需樣品作為最終影像。 實施Jj 、 縮放器相關產品應用於個人電腦液晶監視器、液晶電 視、個人數位助理(PDA) ···等。為了經濟的效益,這些 產品都用微晶片或積體電路實現,下面說明如何設計一縮 放器’可以用VHDL/Verilog RTL hardware code 非常容易 地實現。 睛參考圖十三,第一步是將原來影像儲存到記憶體 選擇所需的水平與垂直方向的放大尺寸,稱為L ;選擇有Page 9 1281143 V. INSTRUCTIONS (5) The coefficients of the filter are symmetrical with respect to the center point. The method of finite impulse response filter is the same as that of the one-dimensional finite impulse response chopper. The zero point is inserted between all the original samples to achieve the required size, as shown in Figure 12. Then, the spectrum of the zero-filled image is filtered by a two-dimensional finite impulse response filter, and the spectrum of the obtained image has the same spectrum as the oversampled sampled signal. Resize the enlarged image and take the aliquot of the desired sample as the final image. Implementation of Jj and scaler related products for personal computer LCD monitors, LCD TVs, personal digital assistants (PDAs), etc. For economical benefit, these products are implemented in microchip or integrated circuits. The following explains how to design a scaler' that can be easily implemented with VHDL/Verilog RTL hardware code. Referring to Figure 13, the first step is to store the original image to the memory. Select the desired horizontal and vertical magnification, called L;
的 限脈衝響應渡波的影像處理方塊大小,稱為Μ X N ;將零點 插入Μ X Ν影像中(圖十三的陰影區域),於是得到一零點填 入式UxL) X (Nx L)影像。然後採用一(MX L) X (NxL) 維有限脈衝響應濾波器,二維有限脈衝響應濾波器的係數 示於圖十三右上角及下面: { F —〇一〇,F —1 —0,F一2 —〇,…· F一Mx L 〇 F —〇 —1,F —1 —1,F一2 —1,….F一Mx xL」,The image processing block size of the pulse-limited response wave is called Μ X N ; the zero point is inserted into the Μ X Ν image (the shaded area in Figure 13), and a zero-filled UxL) X (Nx L) image is obtained. Then a (MX L) X (NxL) dimensional finite impulse response filter is used. The coefficients of the two-dimensional finite impulse response filter are shown in the upper right and lower corners of Figure 13: { F —〇一〇, F —1 —0, F - 2 - 〇, ... · F - Mx L 〇 F - 〇 - 1, F - 1 - 1, F - 2 - 1, ..., F - Mx xL",
第10頁 1281143 五、發明說明(6) L,···· F —M x L — N x L }Page 10 1281143 V. Description of invention (6) L,···· F —M x L — N x L }
F .N x L,F一 1J x L, 濾波 為了取得零點填入式 衝響應渡波器過據影像。零Vm必須用二維有限脈 以對應的係數處理,並相加而成L) X (NxL)影像 (如圖十三中險 為中心像素的結果影像 T 衫區域的中心小方持 ^ 至下一個要處理的位置,重覆 A不);移動影像方塊 輸出,如此重覆下去,直到所有壤得到下一個像素 完畢為止’於是得到-(Mx L)x (NVu式像素都處理 輸出影像存入記憶體,並選擇必J XL)的放大影像;將此 與垂直尺寸的輸出f彡像。 的像素而得到所需水平 本發明的優點說明如下: 法’而 者可以 使最終 數的長 應濾、波 方 計 係 維有限脈衝響 不是C是本發明提出一以係數為基礎的 :口疋參數的方法來實現縮放器及内插器楚机F.N x L, F-1J x L, Filtering In order to obtain a zero-filled impulse response, the waver passes through the image. Zero Vm must be processed with two-dimensional finite veins with corresponding coefficients, and added to form L) X (NxL) images (as shown in Figure 13, the result of the center pixel is the center of the T-shirt area. A position to be processed, repeat A does not; move the image block output, so repeat until all the soils get the next pixel to finish 'then get - (Mx L) x (NVu-type pixels are processed to output image storage Memory, and select the enlarged image of J XL); this is compared with the output of the vertical size f. The pixel achieves the desired level. The advantages of the present invention are as follows: The method can be used to make the final number of long filters, wave squares, finite impulses, or not C. The present invention proposes a coefficient-based: Parameter method to implement the scaler and interpolator
脈衝響應濾波係數而控制影像品質 ‘象更為 >月晰或平順。二維有限脈衝響應濾波 可對不同的設計需求而調整, M W 係數的長度愈長,所得影像就愈佳 濾波器 為現實The impulse responds to the filter coefficients to control the image quality. ‘Easy > Month is clear or smooth. Two-dimensional finite impulse response filtering can be adjusted for different design requirements. The longer the M W coefficient is, the better the resulting image. The filter is realistic.
第11頁 作::個優點是本發明提出以二維有限脈衝響 如像處理的方法,#棄已往的一維影像處理。 1281143 五、發明說明(7) 世界的影像是二維的,以一維方向處理影像會喪失影像品 質。 由於上述的優點,本發明所提出的確實是一創新而卓 越的方法,可供設計縮放器、内插器及其他影像處理之應 用。 雖然本說明書已提出並說明本發明的實施例,但對本 行專家而言,顯而易見的是可以設計出更多的實施例,而 不會脫離本發明的範圍。Page 11:: One advantage is that the present invention proposes a two-dimensional finite impulse sound image processing method, # abandoning the past one-dimensional image processing. 1281143 V. INSTRUCTIONS (7) The world's images are two-dimensional, and processing images in one-dimensional direction loses image quality. Because of the above advantages, the present invention is indeed an innovative and superior method for designing scalers, interposers, and other image processing applications. While the present invention has been described and illustrated by the present invention, it will be apparent to those skilled in the
第12頁 1281143 圖式簡單說明 【圖式簡單說明】 圖一為將信號放大成原來三倍大的示意圖。 圖二為複製法的示意圖。 圖三為雙線性法的示意圖。 圖四為縮放器分別在水平與垂直方向上線性運作的示 意圖。 圖五為本發明方法的示意圖。 圖/、示出以高於奈奎斯特取樣率(Nyquist rate)而得 的取樣信號。 • 圖七示出圖六取樣信號的頻譜。 圖八不出(N-丨)個零點填到原來取樣信號之間而 一N倍的影像。 圖九二出圖八取樣信號填入零點後的頻譜。 之新出濾除[_pl/N: pi/N]以外頻帶的信號後所得 則4:;:出若取樣信號以圖六取樣率_倍而取樣, 則〜果所侍頻譜與圖十的頻譜一樣。 點插: = 工限脈衝響應據波器方法中,將零 > Η ,、末取樣仏5虎之間而得到一所需的放大尺寸。 圖十二示出如何實現本發明。 主要元件符號說明】 無(圖中的符號不是代表元件,只是用以引導說明Page 12 1281143 Brief description of the diagram [Simple description of the diagram] Figure 1 is a schematic diagram of enlarging the signal to three times as large as the original. Figure 2 is a schematic diagram of the replication method. Figure 3 is a schematic diagram of the bilinear method. Figure 4 is a schematic illustration of the scaler operating linearly in the horizontal and vertical directions, respectively. Figure 5 is a schematic illustration of the process of the invention. Figure / shows a sampled signal at a higher Nyquist rate. • Figure 7 shows the spectrum of the sampled signal in Figure 6. Figure 8 shows (N-丨) zero points filled in between the original sampled signals and an image of N times. Figure IX shows the spectrum after the sample signal is filled in zero. After filtering out the signal in the frequency band other than [_pl/N: pi/N], the result is 4:;: If the sampling signal is sampled at the sampling rate of _ times, the spectrum of the signal and the spectrum of Fig. 10 are obtained. same. Dot plug: = Limit pulse response In the wave method, zero > Η , and final sampling 仏 5 between the tigers to obtain a desired magnification. Figure 12 shows how the invention can be implemented. Explanation of main component symbols] None (the symbols in the figure are not representative components, but are used to guide instructions
第13頁Page 13
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW94118277A TWI281143B (en) | 2005-06-03 | 2005-06-03 | Method for designing video and image scaler based on 2-d finite impulse response filter |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW94118277A TWI281143B (en) | 2005-06-03 | 2005-06-03 | Method for designing video and image scaler based on 2-d finite impulse response filter |
Publications (2)
Publication Number | Publication Date |
---|---|
TW200643892A TW200643892A (en) | 2006-12-16 |
TWI281143B true TWI281143B (en) | 2007-05-11 |
Family
ID=38741631
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW94118277A TWI281143B (en) | 2005-06-03 | 2005-06-03 | Method for designing video and image scaler based on 2-d finite impulse response filter |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI281143B (en) |
-
2005
- 2005-06-03 TW TW94118277A patent/TWI281143B/en not_active IP Right Cessation
Also Published As
Publication number | Publication date |
---|---|
TW200643892A (en) | 2006-12-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR100349416B1 (en) | Method and apparatus for resizing images using the discrete cosine transform | |
JP3654420B2 (en) | Image conversion method, image processing apparatus, and image display apparatus | |
JP4162610B2 (en) | Method for generating a resolution-enhanced image using multiple low-resolution images | |
TW200807331A (en) | Method and apparatus of removing opaque area as rescaling an image | |
Wee et al. | A novel fast fractal super resolution technique | |
JP2002500455A (en) | High-speed IDCT / downsampling combined operation method and apparatus | |
JPH08294001A (en) | Image processing method and image processing unit | |
WO2014008329A1 (en) | System and method to enhance and process a digital image | |
WO2016004667A1 (en) | Super-resolution reconstruction method for enhancing smoothness and definition of video image | |
Liang | Image interpolation by blending kernels | |
TWI281143B (en) | Method for designing video and image scaler based on 2-d finite impulse response filter | |
US20090169128A1 (en) | Method for up-scaling an input image and an up-scaling system | |
JP4323808B2 (en) | Two-dimensional pyramid filter architecture | |
JP2009008945A (en) | Image signal processor, image signal processing method and program | |
WO2003056837A1 (en) | Method for resizing images in block dct domain | |
JP2011081477A (en) | Image restoring device, program therefor, and multi-dimensional image restoring device | |
US7084889B2 (en) | Digital picture scaling | |
Sanada et al. | FPGA implementation of single-image super-resolution based on frame-Bufferless box filtering | |
Okuhata et al. | Implementation of super-resolution scaler for Full HD and 4K video | |
JP2004530206A (en) | Two-dimensional pyramid filter architecture | |
Chan et al. | An adaptive interpolation using spatial varying filter | |
JP2017072954A (en) | Image conversion device and image conversion method | |
KR100463552B1 (en) | Cubic convolution interpolation apparatus and method | |
US20060280269A1 (en) | Method for designing video and image scaler based on 2-D finite impulse response filter | |
Goswami | Comparison of image interpolation methods for image zooming |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |