TWI246851B - Interpolation method for compensating pixel color - Google Patents
Interpolation method for compensating pixel color Download PDFInfo
- Publication number
- TWI246851B TWI246851B TW92124825A TW92124825A TWI246851B TW I246851 B TWI246851 B TW I246851B TW 92124825 A TW92124825 A TW 92124825A TW 92124825 A TW92124825 A TW 92124825A TW I246851 B TWI246851 B TW I246851B
- Authority
- TW
- Taiwan
- Prior art keywords
- pixel
- pixels
- green
- color
- red
- Prior art date
Links
Landscapes
- Color Television Image Signal Generators (AREA)
- Color Image Communication Systems (AREA)
Abstract
Description
1246851 五、發明說明(1) (一) 、【發明所屬之技術領域】 本發明係有關一種補足像素色彩之方法, 二種增加判斷訊E走勢變化流程之像*色彩内插j疋= 供準確之色彩插補值。 (二) 、【先前技術】 按,影像感測器陣列係廣泛應用在數位攝影 $影像訊號的裝置,在每-影像感測器上組成畫面的最; 早位被稱為像素(pixel) ’換言之’每一像素即 電體。 尤 由於像素本身只對光的強度有反應,但對光的色彩則 完全沒有分釋能力,所以單純影像感測器陣列本身只能拍 得灰階(gray level)的影像,若要拍到彩色的影像了 =要 在影像感測器陣列的每一光電體前加上紅(R)、綠(G)、藍 (B)三原色(primary color)的濾鏡或濾光片,使每一個光 電體只能接收和量度其中一種原色的光度強弱,其中,R 濾鏡、G濾鏡及B濾鏡係分別僅讓紅光、綠光及藍光通過。 如第了圖所示,影像感測器陣列的影像畫素較普遍的排列 方式係綠、藍(G、b ) —列,另一列則是紅、綠(R列, 進而依序排列組成分佈平均的RGB矩陣排列,而另一種常 用的排列方式則是CYGM(Cyan —Yell〇w — Green —Magenta)。 由於每·一影像晝素僅具有單一色彩元素,因此利用影 像處理器接收來自於影像感測器陣列的影像晝素輝度數之 後’通¥係先利用内插法(interp〇lat i〇n)重建每一影像1246851 V. INSTRUCTIONS (1) (1) [Technical field to which the invention belongs] The present invention relates to a method for complementing the color of pixels, and two methods for increasing the process of changing the trend of the signal E* color interpolation j疋= for accurate The color interpolation value. (B), [Prior Art] Press, image sensor array is widely used in digital photography $ video signal device, the most image on each image sensor; the early position is called pixel (pixel) In other words, 'each pixel is an electric body. Especially since the pixel itself only responds to the intensity of the light, but the color of the light has no dissociation ability at all, so the image sensor array itself can only take the gray level image, if you want to capture the color Image = to add a red (R), green (G), blue (B) primary color filter or filter in front of each optoelectronic body of the image sensor array, so that each photoelectric The body can only receive and measure the luminosity of one of the primary colors, wherein the R filter, the G filter, and the B filter pass only red, green, and blue light, respectively. As shown in the figure, the image pixels of the image sensor array are generally arranged in green and blue (G, b)-columns, and the other column is red and green (R columns, and then arranged in order. The average RGB matrix arrangement, and another common arrangement is CYGM (Cyan - Yell〇w - Green - Magenta). Since each image element has only a single color element, it is received by the image processor. After the image of the sensor array, the number of radiances of the image is used to reconstruct each image by interpolation (interp〇lat i〇n).
1246851 五、發明說明(2) 畫素所遺失的色彩元素,以使每一畫素皆具有三原色。習 ,色彩插補方法係利用每一原色像素旁邊的其他像素,為 每一原色像素計算出其餘兩色的資料。舉例來說,如第一 圖所示,每一紅色像素10的周邊分別有著四個藍色像素12 和四個綠色像素1 4,像素插值系統會利用最近之四個藍色 像素12的光度平均值和四個綠色像素η的光度平均值,為 中心的紅色像素1〇計算出所遺失之綠色和藍色的資料,以 使紅色像素得到一完整的RGB光度資料。同理,藍色和綠 色像素12、14之插補原理亦相同。然而,當拍攝一些旦 細緻彩色線條或精密色彩變化的影像時,若被平均的=點 像素其中點係位於影像邊緣(edge)或訊號走勢變化較大 之處,則㈣平均值將會受此點影響而產生較大之誤1大 1 吏得此處之解析度變差,出現色噪(c〇1〇r n〇ise) 紋現象,而影響整體影像晝質。 〆 為了改善此問題,習土n U^ 號之彩色重建之邊緣相:内;;如;:專:公告第41 3797 平、垂直及45度方向’其係以中心像素的水 性,導致插補值不一定χ 士 仍存在耆祆判方向之可能 因此,本發明係針斟Τ、:、無法?供穩定之解析度。 色彩之内插法,以提供準:題•提出-種補足像素 密色彩變化的影像仍可==度使細緻彩色線條及精 (三)、【發明内容】1246851 V. Description of invention (2) The color elements lost by the pixels, so that each pixel has three primary colors. The color interpolation method uses the other pixels next to each primary color pixel to calculate the remaining two colors for each primary color pixel. For example, as shown in the first figure, each red pixel 10 has four blue pixels 12 and four green pixels 14 respectively, and the pixel interpolation system utilizes the luminosity average of the last four blue pixels 12. The value and the average of the luminosity of the four green pixels η calculate the missing green and blue data for the center red pixel 1〇, so that the red pixel obtains a complete RGB photometric data. Similarly, the interpolation principles of the blue and green pixels 12 and 14 are also the same. However, when shooting some images with detailed color lines or precise color changes, if the average = point pixel is located at the edge of the image or the signal trend changes greatly, then the average value will be affected by this. The influence of the point is a big mistake. 1 big 1 The resolution here is worse, and the color noise (c〇1〇rn〇ise) pattern appears, which affects the overall image quality. 〆 In order to improve this problem, the edge phase of the color reconstruction of the n n^ is: inside;; such as: special: announcement 41 3797 flat, vertical and 45 degree direction 'the water of the central pixel, resulting in imputation The value does not necessarily mean that there is still a possibility of a judgment. Therefore, the present invention is acupuncture, :, not? For the resolution of stability. Color interpolation, to provide the standard: the title • propose - to complement the pixel, the image of the dense color change can still == degree to make fine color lines and fine (3), [invention content]
1246851 〜------ 五、發明說明(3) 本發明之主要目的,係在提供一種補足像素色彩之内 蚕法,藉由在内插計算前,加入邊緣及訊號走勢判斷之流 程,且此判斷流程係同時考慮周邊綠值及藍/紅值的方向 =,以利用正確方向的顏色值來加以平均,進而使整個°内 ,程之訊號數值呈現良好之連接關係’以提供 補色彩值,確實地改善習知誤差大之缺失者。 嘴 本發明之另一目的,係在提供一種補 ,以達成影像解析度高且;:度 心像呈現自然平滑之圖像。 7輸出 係用以ί 一影Ϊ::二列::明,補:像:色彩之内插法 彩元素各予以補足 =丄、、工、‘二像素所遺失的色 之訊號,且判斷每_砰 j v驟.接收該影像像素陣列 走勢變化;接著:據口 =:平與垂直方向的訊號 鄰接之二綠像素加以】最小=方向,將每一紅/藍像素 像素中之綠色元I二1所得之平均值成為每一紅/藍 該等像素,分別ίΐ貧料;接續再對於水平及垂直方向之 素。 進而使每一像素各含有綠、紅、/// P 由命 ^ 容易瞭解本發明_ β細1例配合所附的圖式詳加說明,告更 效。 目的、技術内容、特點及其所達成:功 (四 實施方式 Ι,ΤΙ 1246851 五 、發明說明(4)1246851 ~------ V. Description of the Invention (3) The main purpose of the present invention is to provide a method for complementing the color of the pixel, by adding the edge and signal trending process before interpolation calculation. And the judgment process considers the direction of the surrounding green value and the blue/red value at the same time, and averages the color values in the correct direction, so that the signal value of the whole process shows a good connection relationship in the whole ° to provide complementary colors. Values, indeed improve the lack of conventional errors. Mouth Another object of the present invention is to provide a complement to achieve a high degree of image resolution and a degree of natural image smoothness. 7 output system is used to ί a shadow:: two columns:: Ming, fill: like: color interpolation method color elements are complemented = 丄,, work, 'two pixels lost color signal, and judge each _砰jv. Receive the image pixel array trend change; then: the base =: the horizontal and vertical signals adjacent to the two green pixels to be added] minimum = direction, the green element I in each red / blue pixel 1 The average value obtained becomes the pixel of each red/blue, respectively, and the element is inferior to the horizontal and vertical directions. Furthermore, each pixel contains green, red, and / / / P. It is easy to understand that the present invention _ β fine 1 case with the accompanying drawings detailed description, more effective. Purpose, technical content, characteristics and achievements: (four implementation methods Ι, ΤΙ 1246851 five, invention description (4)
本發明係在進行内插計 藍像素周圍的四個綠像素進 斷,且此判斷步驟係同時一 素訊號變化,以利用訊號變 個綠像素來加以平均,提供 值’再以綠色元素為基礎進 及/或藍色元素的内插計算 值呈現良好之連接關係者。 如第二圖所示,在光線 影像像素陣列2 0,其係由複 24、藍像素26及綠像素28, 紅、綠像素(R、G )列依序排 像素24或藍像素26之周圍具 每一原色像素22僅具有單一 素2 2所遺失之其他二色彩元 含有紅、藍、綠三元素。 由於在紅、藍、綠三原 可提供較準確之光度資料, 像素2 8為基準,判斷其周圍 綠像素2 8加以平均,此平均 所遺失之綠色元素的光度值 算之前,先將所欲插補之紅/ 行訊號邊緣及走勢變化之判 併考綠像素慮周邊的紅、藍像 化較小之水平或垂直方向的二 紅/藍像素之綠色元素插補 行其他像素所遺失之紅色元素 以使整個内插過程之訊號數 通過一彩色濾、光片後所產生之 數像素2 2所組成,包括紅像素 以一綠、藍像素(G、B )列及一 列形成陣列,進而構成每一紅 有四個綠像素28之陣列。由於 色彩元素,因此必須將每一像 素予以補足,使每一像素2 2各 色中,綠原色之輝度值最高而 因此本發明之内插法係先以綠 的訊號走勢變化而將二間隔之 值即作為紅像素24或藍像素26 像處理裝置來實現。此補足像素色方係以- 閱第三圖所示’其係運用内插/ 法的流程圖請 插法且在内插過程加入判斷In the present invention, four green pixels around the blue pixel are interpolated, and the judging step is to change the signal at the same time to average the signal by changing the green pixel to provide a value of 'based on the green element. The interpolated calculated values of the incoming and/or blue elements present a good connection. As shown in the second figure, in the ray image pixel array 20, it is composed of a complex 24, a blue pixel 26, and a green pixel 28, and the red and green pixels (R, G) are sequentially arranged around the pixel 24 or the blue pixel 26. The other two color elements with each primary color pixel 22 having only a single element 2 2 are red, blue, and green. Since the red, blue and green colors can provide more accurate luminosity data, the pixel 28 is used as a reference, and the surrounding green pixels 28 are averaged. The luminosity value of the green element lost by the average is calculated before the first time. Complementary red / signal edge and trend change judgment and green pixel consideration of the surrounding red, blue image of the smaller horizontal or vertical two red / blue pixels of the green element interpolation line red pixels lost by other pixels So that the number of signals of the entire interpolation process is composed of a plurality of pixels 2 2 generated by a color filter and a light slice, and the red pixel is formed into an array by a green and blue pixel (G, B) column and a column, thereby forming each One red has an array of four green pixels 28. Due to the color elements, each pixel must be complemented so that the luminance of the green primary color is the highest among the colors of each pixel. Therefore, the interpolation method of the present invention first changes the value of the green signal and changes the value of the two intervals. That is, it is realized as a red pixel 24 or a blue pixel 26 like a processing device. This complements the pixel color system to - as shown in the third figure, the flowchart of the interpolation/method is inserted and added to the interpolation process.
1246851 五 發明說明(5) 流,,請同時配合第二圖,本發明之方法包. :先’如步驟S10,接收由影1 V驟’ 像素陣列20的訊號,而後由左? *旙傳來之影像 ,每掃描到一藍像素26或紅像素24:素陣列 向的訊號走勢變化,且此判斷 垂直方 據此四個綠像素28中每一綠像素28之周=根 紅/藍像素24/26的值來加以判斷;接著如驟,、 變化最小之方向,將每一紅/駐像辛 IS12依據 28加以平均,此平均值即上像气2 ?6鄰接之二綠像素 6 _本 十勾值即成為母一紅/藍像素24/26中之_ “素,如此重複步驟S10及S12,依序掃描且重建 紅、藍像素24、26中所遺失之綠色元素, 中之綠色元素重建完成。上述 由右至左或由上至下等方向掃描。 ”2t:S1(^S12中,當綠像素28的周圍像素22 讯唬值之水平方向的走勢變化係較垂直方向小,則以水平 f向為基準,將每一紅/藍像素24/ 26水平二側鄰接之二綠 像素28加以平肖,此平均值即成為每_紅/ _/26像素中 之綠色元素,以補足其綠色元素;而當綠像素則圍的像 素22訊號值之垂直方向的走勢變化係較水平方向小,則以 垂直方向為基準,將每一紅/藍像素24/26垂直二側鄰接之 一綠像素28加以平均,以補足紅/藍像素24/26中之綠色元 素0 在如步驟S10及S12重建完成該等像素22所遺失之綠色1246851 5 Description of invention (5) Flow, please cooperate with the second figure, the method package of the present invention. First, as in step S10, receive the signal from the pixel array 20 of the image, and then by the left? * 旙 之 , , , , 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每/ Blue pixel 24/26 value to judge; then, as in the step, the direction of the smallest change, each red / resident image sinus IS12 is averaged according to 28, the average is the upper image 2 2 adjacent to the green Pixel 6 _ Ben 10 is the value of the parent red/blue pixel 24/26. "The steps S10 and S12 are repeated, and the green elements lost in the red and blue pixels 24, 26 are sequentially scanned and reconstructed. The reconstruction of the green element is completed. The above is scanned from right to left or from top to bottom. "2t: S1 (^S12, when the pixel 20 around the green pixel 28 changes in the horizontal direction of the signal value is vertical If the direction is small, the two green pixels 28 adjacent to each other of the horizontal red/blue pixels 24/26 are flattened, and the average value becomes green in every _red/_/26 pixels. Element to complement its green element; and when the green pixel is around, the vertical direction of the pixel 22 signal value The system is smaller than the horizontal direction, and the green pixels 28 adjacent to each other on the two sides of each red/blue pixel 24/26 are averaged to complement the green element in the red/blue pixel 24/26. Resetting the green color lost by the pixels 22 in steps S10 and S12
I24685l ^------- - 元素之後,接 藍色元夸这/上下來係以内插法補足之該等像素2 2所遺失之 藍色及紅多色7^素,以補足每一綠像素28所遺失之 以及補足> $素’補足每一藍像素2 6所遺失之紅色元素, Sl4所示,母斜紅像素24所遺失之藍色元素。首先’如步驟 22,以、;影像像素陣列20中水平方向排列之像素 紅色元插法補足之該等像素22所遺失之藍色元素及/或 插法補足,而後接續如步驟s16,再針對垂直方向,以内 及/或紅影像像素陣列2〇中之像素22所遺失之藍色元素 色元素、工色元素’如此即完成該等像素22之紅色元素及藍 素,二之重建,進而使每一像素22各含有綠、藍、紅三元 驟siΓ成像素色彩之重建程序而結束插補運作流程,即步 在上述補足像素色彩之内插法中,於重建完成綠色元 參、之後’係先以水平方向而後再以垂直方向分別進行藍、 、、工元素之重建;然而,本發明之藍、紅元素係基於綠元素 之變化量而計算,故當不限定藍、紅元素抑或紅、藍元素 之重建順序’且不限定水平方向及垂直方向之重建順序, 亦即本發明亦可以先重建垂直方向之藍、紅元素而後再行 水平方向重建者來實施。 至此’本發明之補足像素色彩内插法的精神已說明完 畢’以下特以一具體範例來詳細驗證說明本發明之内插 法’以使熟習此項技術者將可參酌此範例之描述而獲得足 夠的知識而據以實施。 利用本發明之補足像素色彩之内插法作為影像處理系I24685l ^------- - After the element, the blue element is boasted. This is up to the blue and red multi-color 7^ which are missing by the pixel 2 to interpolate. The green pixel 28 is missing and complemented by > $ prime' complements the red element lost by each blue pixel 26, as shown by Sl4, the blue element lost by the mother diagonal red pixel 24. First, as in step 22, the pixel red element interpolation arranged in the horizontal direction of the image pixel array 20 complements the blue elements and/or interpolations lost by the pixels 22, and then continues as in step s16, and then The blue element color element and the work color element lost in the vertical direction, the inner and/or the pixel 22 in the red image pixel array 2, thus completing the red element and the blue element of the pixel 22, and then reconstructing Each of the pixels 22 each includes a green, blue, and red ternary process to complete the interpolation operation process, that is, the step of inserting the complementary pixel color into the interpolation method, after the reconstruction completes the green meta-parameter, after The blue, red, and red elements are reconstructed in the horizontal direction and then in the vertical direction. However, the blue and red elements of the present invention are calculated based on the amount of change of the green element, so when blue, red, or red is not limited The reconstruction order of the blue elements is not limited to the reconstruction order of the horizontal direction and the vertical direction, that is, the present invention can also reconstruct the blue and red elements in the vertical direction and then the horizontal direction. It was implemented. So far, the spirit of the complementary pixel color interpolation method of the present invention has been described. 'The following is a specific example to verify the interpolation of the present invention in detail, so that those skilled in the art can obtain the description of this example. Sufficient knowledge to implement. Using the interpolation method of complementary pixel color of the present invention as an image processing system
11 第9頁 i I246851 __ 五、發明說明(7) ’ 统Φ11 Page 9 i I246851 __ V. Description of invention (7) ’
^卞色彩重建的實際應用係如第四A圖至第四c圖、第五A 二至第五D圖以及第六a圖至第六d圖所示,首先,如第四A 圖戶斤- «y _ P 不’衫像通過彩色濾、光陣列(c ο 1 〇r f i 11 er ar r ay, ,A)及影像感測器陣列之後形成如圖所示之影像像素陣 2 ^在此影像進行後續處理之前,必需所將,,遺失的,,色事 逢刀加以重建。本發明先對綠(G)顏色進行計算,首先, 叶對綠藍綠藍(GBGB)列處理,在第四A圖中,Gs原為不存 :,B5位置之&的重建需參考&四周之&、匕、、&四二綠 光度值,且經過一定的判斷,此判斷原則之計算式如下·、、'、 △ Η = | G4 — G6 I + | B5 — B3 + B5 — B7 I ; △ V = I G2 — G8 I + I B5 — Bi + B5 — B9 I ;^ The practical application of color reconstruction is as shown in the fourth A to fourth c, the fifth A to the fifth D, and the sixth to sixth d, first, as the fourth A - «y _ P not 'shirts are formed by color filters, light arrays (c ο 1 〇rfi 11 er ar r ay, , A) and image sensor arrays to form image pixel arrays as shown in the figure 2 ^here Before the image is processed for follow-up, it is necessary to reconstruct, lose, and color. The invention first calculates the green (G) color. First, the leaf is processed in the green, blue, green and blue (GBGB) column. In the fourth A picture, the Gs is not stored: the reconstruction of the B5 position & The four-two green luminosity values of the surrounding &, 匕,, & and after a certain judgment, the calculation formula of this judgment principle is as follows: ·, △ △ | = | G4 — G6 I + | B5 — B3 + B5 —B7 I ; Δ V = I G2 — G8 I + I B5 — Bi + B5 — B9 I ;
其中,ΔΗ代表水平方向之訊號走勢變化,而Δν 垂直方向之訊號走勢變化。 I 當 ΑΗ < Δν,則心=(G4 +G6 ) + 2 ; 當 A Η > △ V,則 G5 = ( G2 + G8 ) + 2, 進而將B5位置之所遺失2G5予以補足。 如此依序將GBGB列中之B位置所遺失的G,值以前述内 插方法求出,因此,第四A圖變成第四b圖,GBGB列中之每 一B位置各具有綠色元素G,。 母 在完成GBGB列之綠色元素重建之後,接著,針對綠紅 綠紅(GRGR)列處理,如第四B圖所示,&原係不存在的f 位置之G5的重建需參考其四周S、G4、Ge、Gs,且經過一定 的判斷,此判斷原則之計算式如下: & Δ Η = I G4 - G6 I + | R5 — R3 + R5 — R7 I ;Among them, ΔΗ represents the change of the signal direction in the horizontal direction, and the signal of the vertical direction of Δν changes. I When ΑΗ < Δν, then heart = (G4 + G6 ) + 2 ; When A Η > △ V, then G5 = ( G2 + G8 ) + 2, and then the 2G5 lost in the B5 position is complemented. In this way, the value of G lost in the B position in the GBGB column is sequentially obtained by the interpolation method. Therefore, the fourth A picture becomes the fourth b picture, and each B position in the GBGB column has a green element G, . After the mother completes the green element reconstruction of the GBGB column, and then processes the green, red, green and red (GRGR) column, as shown in the fourth B, the reconstruction of the G5 where the original position does not exist needs to refer to its surrounding S. , G4, Ge, Gs, and after a certain judgment, the calculation formula of this judgment principle is as follows: & Δ Η = I G4 - G6 I + | R5 - R3 + R5 - R7 I ;
第10頁 1246851 五、發明說明(8) △ V = | G2 - Gg 丨 + I R5 —心 + R5 — R9 | ; 當△ Η < △ V,則 G5 = ( G4 + G6 ) + 2 ; 當△ H > △ V,則 G5 = ( G2 + G8 ) + 2, 進而將R5位置之所遺失之G5予以補足。 如此依序將GRGR列中之R位置所遺失之G,值藉由前述 内插方法予以求出,因此,第四B圖變成第四C圖,使GRGR 列中之每一 R位置各具有綠色元素G ’ 。至此,已完成影像 像素陣列中所有像素之綠顏色重建。 在完成G顏色重建之後,接著,參考水平方向之藍像 素值(B)將水平GBGB列中缺少的藍色元素B,值計算出來, 如第五A圖所示,BG,原為不存在的,Gg位置之B/的重建需 參考h水平二侧之Βι及匕,差值、&及匕,差值以及G(),計算 式如下: B〇J =[ (B, -G/ ) + (β2 -G2j ) ] ^ 2 + G〇 式(1) 如此依序將水平方向之GBGB列中之G像素所缺少之B,值一 一計算出來,因此,第五A圖變成第五B圖,使GBGB列中之 每一 G位置各具有藍色元素B,。 接續如第五C圖所示,參考水平方向之r值將水平⑶⑶ 列所缺少的紅色R,值計算出來,在第五C圖中,R(),原為不 存在的’ Gg位置之rq’的重建需參考心水平二側之&及心,差 值、&及Gg差值以及,計算式如下: V =[(比—A,)+ ( r2 — g2,)] + 2 +G〇 式(2 ) 如此依序將水平方向iGRGR列中所缺少的R,值--計算出 來,因此’第五C圖變成第五D圖,GRGR列中之每一G位置Page 10 1246851 V. INSTRUCTIONS (8) △ V = | G2 - Gg 丨 + I R5 - heart + R5 - R9 | ; When △ Η < △ V, then G5 = ( G4 + G6 ) + 2 ; △ H > Δ V, then G5 = ( G2 + G8 ) + 2, and then the missing G5 of the R5 position is complemented. In this way, the G value lost by the R position in the GRGR column is sequentially obtained by the above interpolation method. Therefore, the fourth B picture becomes the fourth C picture, so that each R position in the GRGR column has a green color. Element G '. At this point, the green color reconstruction of all pixels in the image pixel array has been completed. After the G color reconstruction is completed, the value of the blue element B missing in the horizontal GBGB column is calculated by referring to the blue pixel value (B) in the horizontal direction. As shown in FIG. 5A, the BG is originally absent. For the reconstruction of B/ in the Gg position, refer to the ι and 匕, difference, & and 匕, difference and G() on the two sides of the h level. The calculation formula is as follows: B〇J =[ (B, -G/ ) + (β2 -G2j ) ] ^ 2 + G〇 (1) In this way, the B, which is missing from the G pixel in the GBGB column in the horizontal direction, is calculated one by one, and therefore, the fifth A is changed to the fifth B. Figure, so that each G position in the GBGB column has a blue element B,. As shown in the fifth C diagram, the r value in the reference horizontal direction is calculated from the red R value missing in the horizontal (3) (3) column. In the fifth C picture, R() is originally the rq of the non-existent 'Gg position. 'Reconstruction needs to refer to the & and heart, difference, & and Gg difference on both sides of the heart level and, as follows: V = [(比—A,)+ ( r2 — g2,)] + 2 + G〇(2) thus calculates the R, the value - which is missing in the horizontal direction iGRGR column, so that the 'fifth C picture becomes the fifth D picture, and each G position in the GRGR column
第11頁 五、發明說明(9) f具有紅色元素R,。至此,已針對水平方 陣列中藍(β)顏色及紅(R)顏色之重建。 几成影像像素 在完成水平方向之藍、紅顏色重建之後, 垂直方向之藍、紅顏色,其重建方法及原 ’重建 :。首先,如第以圖所示,參考垂直方向之、:於:平方 方向中將含GR’或“,之像素所缺少之β,值 將垂直 =直-側4叫差值、&叫’差值以 ς, 下,係同於上式(1 ) ·· 吖式如 B。’ …-Gl,)+ (b2 一心,)]+ 2 + ^ 如:依,直方向中將細,賴G’之像素所。式,) 每-行之每一像素各具有藍t元ί?Α,成弟六8圖,使 接續如帛六c圖所示,參考垂直方向之r值將垂 中3 BG或GB,之像素所缺少的紅色元素R,值計 = G第Γ亩圖原為不存在的,°。位置之R。,的重建需參ί &垂直二侧之RlAGl’差值、& 差值以 ^ 下,係同於上式(2) : G Τπ巧如 R°’ =[ (Rl —Gl,)+ (H,)] + 2 +G。 式(2、 如此依=將垂直方向中之像素所缺少的1^,值一 一計算出 來,使付第六C圖之影像像素陣列變成第六D圖所示之熊 樣,令每-像素各含有RGB三顏色值,進而完成整^ 重建之程序。 1冢 在瞭解本發明之具體實施方法之後,以下特針對一具 1246851Page 11 V. Description of invention (9) f has a red element R,. So far, the reconstruction of the blue (β) color and the red (R) color in the horizontal square array has been targeted. Several image pixels After the blue and red color reconstruction in the horizontal direction, the blue and red colors in the vertical direction, the reconstruction method and the original 'reconstruction:. First, as shown in the figure, refer to the vertical direction: in the square direction will contain GR' or ", the pixel is missing β, the value will be vertical = straight - side 4 called difference, & called ' The difference is ς, ,, is the same as the above formula (1) ·· 吖 is like B. '...-Gl,) + (b2 one heart,)] + 2 + ^ If: 依,直向中细细,赖G's pixel. Formula,) Each pixel of each line has a blue t-element Α?, a six-figure figure of the younger brother, so that the splicing is as shown in the figure c, and the r value in the vertical direction will hang. 3 BG or GB, the red element R missing from the pixel, the value = G Γ 图 map originally does not exist, °. Position R., reconstruction needs to participate in ί & vertical two sides of the RlAGl 'difference , & difference is ^, which is the same as above (2): G Τ π is as R°' = [ (Rl — Gl,) + (H,)] + 2 + G. = Calculate the value of 1^, which is missing from the pixels in the vertical direction, so that the image pixel array of the sixth C picture becomes the bear sample shown in the sixth D picture, so that each pixel contains RGB three color values. , and then complete the process of reconstruction. 1冢Understanding the hair After the specific implementation method of Ming, the following special ones are for one 1246851
體比較例說明運帛纟發明<方 證本發明所達成之作用及功效。如=知方法之差異,以驗 擬一條接近黑色的直線(深色表示七圖所示,首先,模 (淺色表示),採用習知色彩插補、過一接近白色的區域 垂直與水平方向的訊號走勢變化而*僅以G值變化來判斷 過程之計算式如下: 叩衣取插補值Gc,其判斷 ^ 直:變化量(G 卜G4) = 1233-230丨=3 ; 水平:變化量(G2-G3)=丨24_2〇| = 4 ;The comparative example illustrates the effect and efficacy achieved by the present invention. For example, = the difference between the methods, to verify a line close to black (dark color indicates seven figures, first, the mode (light color), using conventional color interpolation, passing a vertical and horizontal area close to white The signal trend changes and * only the G value change is used to judge the process as follows: 叩 clothes take the interpolation value Gc, its judgment ^ straight: change amount (G 卜 G4) = 1233-230 丨 = 3; level: change Quantity (G2-G3)=丨24_2〇| = 4 ;
^ ^ 則(水平變化量)> (垂直變化量)。 若,驾知般僅以G值變化來判斷,則因判斷資料不足而導 致系統誤判係垂直方向之訊號變化量較小,使得系統以 (Gl+G4)/2來計算中心Gc值,因而造成誤判,使得g值成為 2 0,2 3 1,2 4而不連續,令此線看起來呈現斷掉狀態。 相反地’利用本發明之色彩插補方法,係先以下式計 算G值之垂直與水平方向的訊號走勢變化: 垂直 G:變化量(G1-G4) = 1233-2301 = 3 ; 水平 G:變化量(G2-G3 ) = 124-201 = 4 ; 接著再同時加上R值輔助判斷,其計算式如下:^ ^ then (horizontal variation) > (vertical variation). If the driver knows that only the G value changes, the system misjudges the signal in the vertical direction due to insufficient data, so that the system calculates the center Gc value by (Gl+G4)/2, thus causing The misjudgment makes the g value become 2 0, 2 3 1, 2 4 is not continuous, making the line appear to be in a broken state. Conversely, by using the color interpolation method of the present invention, the vertical and horizontal signal trend changes of the G value are calculated by the following formula: Vertical G: Change amount (G1-G4) = 1233-2301 = 3; Level G: Change The quantity (G2-G3) = 124-201 = 4; then add the R value to assist the judgment, the calculation formula is as follows:
垂直 R:變化量(2RC-R5-R8 ) = 150-20 0-2031 二 353 ; 水平 R:變化量(2RC-R6-R7) = |5 0-2 1 -231 = 6 ; 則(垂直G + 垂直R) > (水平G + 水平R)。 因此,加入R值判斷後,較能真實反應實際之訊號走勢變 化,得到水平方向之訊號變化較小之資訊,故系統將以Vertical R: variation (2RC-R5-R8) = 150-20 0-2031 2353; horizontal R: variation (2RC-R6-R7) = |5 0-2 1 -231 = 6; then (vertical G + Vertical R) > (Level G + Level R). Therefore, after the R value is judged, it is more realistic to reflect the actual signal change, and the information with less change in the horizontal direction is obtained, so the system will
第13頁 1246851 五、發明說明(11)Page 13 1246851 V. Description of invention (11)
(G2 + G3)/2來計算中心Gc值,進而得到一 孕父為正禮之插播 值,使G值為20,22,24,故此條線看 之插補 而呈現較連續且清晰之畫質。 研禪 因此,本發明利用在内插計算前,考慮〇值同時一 考慮周邊B、R值的方向性,以加入邊緣及走勢判斷之流 程,進而利用訊號變化較小之水平或垂直方向的二個$係 素值來加以平均,以獲得一較為準確之(^值,而後再以G值 為基礎内插求出Β值及R值,使整個内插過程之訊號數值呈 現良好之連接關係,達到提供準確插補色彩值之最終目 2,藉以達成解析度高且穩度之功效,令影像自然呈現平 滑之圖像’以確實改善習知插補系統誤差大之缺失者。(G2 + G3)/2 to calculate the center Gc value, and then get the insertion value of a pregnant parent, so that the G value is 20, 22, 24, so the line looks at the interpolation and presents a more continuous and clear picture. quality. Therefore, the present invention utilizes the enthalpy value and considers the directionality of the surrounding B and R values before the interpolation calculation, and adds the process of judging the edge and the trend, and then uses the horizontal or vertical direction of the signal change less. The values of the primordial values are averaged to obtain a more accurate (^ value, and then the Β value and the R value are interpolated based on the G value, so that the signal values of the entire interpolation process exhibit a good connection relationship. The ultimate goal of providing accurate interpolation color values is achieved, so as to achieve a high resolution and stability effect, so that the image naturally presents a smooth image 'to actually improve the missing of the conventional interpolation system error.
^以上所述係藉由實施例說明本發明之特點,其目的在 ,热習該技術者能暸解本發明之内容並據以實施,而非限 疋本發明之專利範圍,故,凡其他未脫離本發明所揭示之 精神所完成之等效修飾或修改,仍應包含在以下所述之申 請專利範圍中。 圖號說明: 1 0紅色像素 14綠色像素 2 〇影像像素陣列 2 4紅像素 2 8綠像素 1 2藍色像素 22像素 2 6藍像素The above description of the features of the present invention is provided by the embodiments of the present invention, and it is intended that the skilled person can understand the contents of the present invention and implement it instead of being limited to the scope of the present invention. Equivalent modifications or modifications made from the spirit of the present invention should still be included in the scope of the claims described below. Figure number description: 1 0 red pixels 14 green pixels 2 〇 image pixel array 2 4 red pixels 2 8 green pixels 1 2 blue pixels 22 pixels 2 6 blue pixels
第14頁 1246851 圖式簡單說明 第一圖為習知在影像晝素陣列中插補色彩之示意圖。 第二圖為本發明所插補之影像像素陣列的示意圖。 第三圖為本發明補足像素色彩之内插法的流程圖。 第四A圖至第四C圖為本發明重建綠色元素之各步驟像素陣 列不意圖。 第五A圖至第五D圖為本發明以水平方向重建藍色及紅色元 素之各步驟像素陣列示意圖。 第六A圖至第六D圖為本發明以垂直方向重建藍色及紅色元 素之各步驟像素陣列示意圖。Page 14 1246851 Brief Description of the Diagram The first figure is a schematic diagram of the interpolation of colors in an image pixel array. The second figure is a schematic diagram of an image pixel array interpolated by the present invention. The third figure is a flow chart of the interpolation method of complementing the pixel color of the present invention. The fourth to fourth C diagrams are not intended to be a pixel array for each step of reconstructing a green element of the present invention. The fifth to fifth figures D are schematic diagrams of pixel arrays for reconstructing the blue and red elements in the horizontal direction in the present invention. 6A to 6D are schematic views of pixel arrays of steps of reconstructing blue and red elements in a vertical direction according to the present invention.
第七圖為本發明模擬一實際影像之像素陣列的示意圖及列 示像素之光度值。Figure 7 is a schematic diagram of a pixel array simulating an actual image of the present invention and showing the photometric values of the pixels.
第15頁Page 15
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW92124825A TWI246851B (en) | 2003-09-09 | 2003-09-09 | Interpolation method for compensating pixel color |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW92124825A TWI246851B (en) | 2003-09-09 | 2003-09-09 | Interpolation method for compensating pixel color |
Publications (2)
Publication Number | Publication Date |
---|---|
TW200511828A TW200511828A (en) | 2005-03-16 |
TWI246851B true TWI246851B (en) | 2006-01-01 |
Family
ID=37193850
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW92124825A TWI246851B (en) | 2003-09-09 | 2003-09-09 | Interpolation method for compensating pixel color |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI246851B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7929759B2 (en) | 2006-09-01 | 2011-04-19 | Mstar Semiconductor, Inc. | Method and device for reconstructing missing color component of pixel |
US9596447B2 (en) | 2010-07-21 | 2017-03-14 | Qualcomm Incorporated | Providing frame packing type information for video coding |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI342157B (en) | 2006-09-19 | 2011-05-11 | Realtek Semiconductor Corp | De-interlacing methods and related apparatuses |
CN115294927B (en) * | 2022-09-28 | 2022-12-27 | 长春希达电子技术有限公司 | Color compensation method based on pixel multiplexing, storage medium and system |
-
2003
- 2003-09-09 TW TW92124825A patent/TWI246851B/en not_active IP Right Cessation
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7929759B2 (en) | 2006-09-01 | 2011-04-19 | Mstar Semiconductor, Inc. | Method and device for reconstructing missing color component of pixel |
US9596447B2 (en) | 2010-07-21 | 2017-03-14 | Qualcomm Incorporated | Providing frame packing type information for video coding |
Also Published As
Publication number | Publication date |
---|---|
TW200511828A (en) | 2005-03-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102461174B (en) | Color filter array pattern having four-channels | |
JP5345944B2 (en) | Low resolution image generation | |
US8253832B2 (en) | Interpolation for four-channel color filter array | |
US8237831B2 (en) | Four-channel color filter array interpolation | |
KR100615277B1 (en) | Method and apparatus for compensating Image sensor lens shading | |
US20130051665A1 (en) | Image processing apparatus, image processing method, and program | |
CN103004211B (en) | The method of imaging device and process photographic images | |
US20070019087A1 (en) | Pixel signal processor and pixel signal processing method | |
JPH0823543A (en) | Image pickup device | |
JP2009504012A (en) | Color and panchromatic pixel processing | |
JPH08298670A (en) | Adaptive color interpolation single sensor color electronic camera | |
KR20090023690A (en) | Solid-state image sensor | |
WO2007078912A1 (en) | Method and apparatus providing color interpolation in color filter arrays using edge detection and correction terms | |
JP2013081222A (en) | Image sensor having improved photosensitivity | |
JP2001016597A5 (en) | ||
JP2010537555A (en) | Image sensor with color filter array with panchromatic checkerboard pattern | |
US7969479B2 (en) | Method and device for detecting color temperature | |
TWI449027B (en) | Adaptive pixel compensation method | |
JPWO2012081175A1 (en) | Image generating apparatus, image generating system, method, and program | |
JP2004023792A (en) | Method and apparatus for correcting color non-uniformity in digital camera | |
US9160999B2 (en) | Image processing device and imaging device | |
JP3458080B2 (en) | Color imaging device | |
CN103621070B (en) | Imaging device and control method thereof | |
TWI246851B (en) | Interpolation method for compensating pixel color | |
US7324707B2 (en) | Interpolation method for generating pixel color |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |