TWI246851B - Interpolation method for compensating pixel color - Google Patents

Abstract

This invention provides an interpolation method for compensating the pixel color. It applies the compensating method for the color of the array formed by green, red, blue pixels. Namely, each pixel comprises the three primary colors --- red, green, blue. The interpolation method is that it receives the signal of pixel array, and determines the tendency variation of the signal in the horizontal and vertical direction around the four green pixels. Afterwards, it averages the two adjacent green pixels to each red/blue pixel. Further, it uses this average value to compensate for the green primary color data of red/blue pixels. Furthermore, it compensates the blue or/and red prime colors lost by each pixel for the pixels in the horizontal and vertical directions by interpolation method respectively. Moreover, it makes each pixel have the three primary colors --- red, green, blue. Eventually, it provides an accurate interpolation color value. Therefore, it achieves the effect of high-accurate and stable resolution.

Description

1246851 V. INSTRUCTIONS (1) (1) [Technical field to which the invention belongs] The present invention relates to a method for complementing the color of pixels, and two methods for increasing the process of changing the trend of the signal E* color interpolation j疋= for accurate The color interpolation value. (B), [Prior Art] Press, image sensor array is widely used in digital photography $ video signal device, the most image on each image sensor; the early position is called pixel (pixel) In other words, 'each pixel is an electric body. Especially since the pixel itself only responds to the intensity of the light, but the color of the light has no dissociation ability at all, so the image sensor array itself can only take the gray level image, if you want to capture the color Image = to add a red (R), green (G), blue (B) primary color filter or filter in front of each optoelectronic body of the image sensor array, so that each photoelectric The body can only receive and measure the luminosity of one of the primary colors, wherein the R filter, the G filter, and the B filter pass only red, green, and blue light, respectively. As shown in the figure, the image pixels of the image sensor array are generally arranged in green and blue (G, b)-columns, and the other column is red and green (R columns, and then arranged in order. The average RGB matrix arrangement, and another common arrangement is CYGM (Cyan - Yell〇w - Green - Magenta). Since each image element has only a single color element, it is received by the image processor. After the image of the sensor array, the number of radiances of the image is used to reconstruct each image by interpolation (interp〇lat i〇n).

1246851 V. Description of invention (2) The color elements lost by the pixels, so that each pixel has three primary colors. The color interpolation method uses the other pixels next to each primary color pixel to calculate the remaining two colors for each primary color pixel. For example, as shown in the first figure, each red pixel 10 has four blue pixels 12 and four green pixels 14 respectively, and the pixel interpolation system utilizes the luminosity average of the last four blue pixels 12. The value and the average of the luminosity of the four green pixels η calculate the missing green and blue data for the center red pixel 1〇, so that the red pixel obtains a complete RGB photometric data. Similarly, the interpolation principles of the blue and green pixels 12 and 14 are also the same. However, when shooting some images with detailed color lines or precise color changes, if the average = point pixel is located at the edge of the image or the signal trend changes greatly, then the average value will be affected by this. The influence of the point is a big mistake. 1 big 1 The resolution here is worse, and the color noise (c〇1〇rn〇ise) pattern appears, which affects the overall image quality. 〆 In order to improve this problem, the edge phase of the color reconstruction of the n n^ is: inside;; such as: special: announcement 41 3797 flat, vertical and 45 degree direction 'the water of the central pixel, resulting in imputation The value does not necessarily mean that there is still a possibility of a judgment. Therefore, the present invention is acupuncture, :, not? For the resolution of stability. Color interpolation, to provide the standard: the title • propose - to complement the pixel, the image of the dense color change can still == degree to make fine color lines and fine (3), [invention content]

1246851 ~------ V. Description of the Invention (3) The main purpose of the present invention is to provide a method for complementing the color of the pixel, by adding the edge and signal trending process before interpolation calculation. And the judgment process considers the direction of the surrounding green value and the blue/red value at the same time, and averages the color values in the correct direction, so that the signal value of the whole process shows a good connection relationship in the whole ° to provide complementary colors. Values, indeed improve the lack of conventional errors. Mouth Another object of the present invention is to provide a complement to achieve a high degree of image resolution and a degree of natural image smoothness. 7 output system is used to ί a shadow:: two columns:: Ming, fill: like: color interpolation method color elements are complemented = 丄,, work, 'two pixels lost color signal, and judge each _砰jv. Receive the image pixel array trend change; then: the base =: the horizontal and vertical signals adjacent to the two green pixels to be added] minimum = direction, the green element I in each red / blue pixel 1 The average value obtained becomes the pixel of each red/blue, respectively, and the element is inferior to the horizontal and vertical directions. Furthermore, each pixel contains green, red, and / / / P. It is easy to understand that the present invention _ β fine 1 case with the accompanying drawings detailed description, more effective. Purpose, technical content, characteristics and achievements: (four implementation methods Ι, ΤΙ 1246851 five, invention description (4)

In the present invention, four green pixels around the blue pixel are interpolated, and the judging step is to change the signal at the same time to average the signal by changing the green pixel to provide a value of 'based on the green element. The interpolated calculated values of the incoming and/or blue elements present a good connection. As shown in the second figure, in the ray image pixel array 20, it is composed of a complex 24, a blue pixel 26, and a green pixel 28, and the red and green pixels (R, G) are sequentially arranged around the pixel 24 or the blue pixel 26. The other two color elements with each primary color pixel 22 having only a single element 2 2 are red, blue, and green. Since the red, blue and green colors can provide more accurate luminosity data, the pixel 28 is used as a reference, and the surrounding green pixels 28 are averaged. The luminosity value of the green element lost by the average is calculated before the first time. Complementary red / signal edge and trend change judgment and green pixel consideration of the surrounding red, blue image of the smaller horizontal or vertical two red / blue pixels of the green element interpolation line red pixels lost by other pixels So that the number of signals of the entire interpolation process is composed of a plurality of pixels 2 2 generated by a color filter and a light slice, and the red pixel is formed into an array by a green and blue pixel (G, B) column and a column, thereby forming each One red has an array of four green pixels 28. Due to the color elements, each pixel must be complemented so that the luminance of the green primary color is the highest among the colors of each pixel. Therefore, the interpolation method of the present invention first changes the value of the green signal and changes the value of the two intervals. That is, it is realized as a red pixel 24 or a blue pixel 26 like a processing device. This complements the pixel color system to - as shown in the third figure, the flowchart of the interpolation/method is inserted and added to the interpolation process.

1246851 5 Description of invention (5) Flow, please cooperate with the second figure, the method package of the present invention. First, as in step S10, receive the signal from the pixel array 20 of the image, and then by the left? * 旙 之 , , , , 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每 每/ Blue pixel 24/26 value to judge; then, as in the step, the direction of the smallest change, each red / resident image sinus IS12 is averaged according to 28, the average is the upper image 2 2 adjacent to the green Pixel 6 _ Ben 10 is the value of the parent red/blue pixel 24/26. "The steps S10 and S12 are repeated, and the green elements lost in the red and blue pixels 24, 26 are sequentially scanned and reconstructed. The reconstruction of the green element is completed. The above is scanned from right to left or from top to bottom. "2t: S1 (^S12, when the pixel 20 around the green pixel 28 changes in the horizontal direction of the signal value is vertical If the direction is small, the two green pixels 28 adjacent to each other of the horizontal red/blue pixels 24/26 are flattened, and the average value becomes green in every _red/_/26 pixels. Element to complement its green element; and when the green pixel is around, the vertical direction of the pixel 22 signal value The system is smaller than the horizontal direction, and the green pixels 28 adjacent to each other on the two sides of each red/blue pixel 24/26 are averaged to complement the green element in the red/blue pixel 24/26. Resetting the green color lost by the pixels 22 in steps S10 and S12

I24685l ^------- - After the element, the blue element is boasted. This is up to the blue and red multi-color 7^ which are missing by the pixel 2 to interpolate. The green pixel 28 is missing and complemented by > $ prime' complements the red element lost by each blue pixel 26, as shown by Sl4, the blue element lost by the mother diagonal red pixel 24. First, as in step 22, the pixel red element interpolation arranged in the horizontal direction of the image pixel array 20 complements the blue elements and/or interpolations lost by the pixels 22, and then continues as in step s16, and then The blue element color element and the work color element lost in the vertical direction, the inner and/or the pixel 22 in the red image pixel array 2, thus completing the red element and the blue element of the pixel 22, and then reconstructing Each of the pixels 22 each includes a green, blue, and red ternary process to complete the interpolation operation process, that is, the step of inserting the complementary pixel color into the interpolation method, after the reconstruction completes the green meta-parameter, after The blue, red, and red elements are reconstructed in the horizontal direction and then in the vertical direction. However, the blue and red elements of the present invention are calculated based on the amount of change of the green element, so when blue, red, or red is not limited The reconstruction order of the blue elements is not limited to the reconstruction order of the horizontal direction and the vertical direction, that is, the present invention can also reconstruct the blue and red elements in the vertical direction and then the horizontal direction. It was implemented. So far, the spirit of the complementary pixel color interpolation method of the present invention has been described. 'The following is a specific example to verify the interpolation of the present invention in detail, so that those skilled in the art can obtain the description of this example. Sufficient knowledge to implement. Using the interpolation method of complementary pixel color of the present invention as an image processing system

11 Page 9 i I246851 __ V. Description of invention (7) ’

^ The practical application of color reconstruction is as shown in the fourth A to fourth c, the fifth A to the fifth D, and the sixth to sixth d, first, as the fourth A - «y _ P not 'shirts are formed by color filters, light arrays (c ο 1 〇rfi 11 er ar r ay, , A) and image sensor arrays to form image pixel arrays as shown in the figure 2 ^here Before the image is processed for follow-up, it is necessary to reconstruct, lose, and color. The invention first calculates the green (G) color. First, the leaf is processed in the green, blue, green and blue (GBGB) column. In the fourth A picture, the Gs is not stored: the reconstruction of the B5 position & The four-two green luminosity values of the surrounding &, 匕,, & and after a certain judgment, the calculation formula of this judgment principle is as follows: ·, △ △ | = | G4 — G6 I + | B5 — B3 + B5 —B7 I ; Δ V = I G2 — G8 I + I B5 — Bi + B5 — B9 I ;

Among them, ΔΗ represents the change of the signal direction in the horizontal direction, and the signal of the vertical direction of Δν changes. I When ΑΗ < Δν, then heart = (G4 + G6 ) + 2 ; When A Η > △ V, then G5 = ( G2 + G8 ) + 2, and then the 2G5 lost in the B5 position is complemented. In this way, the value of G lost in the B position in the GBGB column is sequentially obtained by the interpolation method. Therefore, the fourth A picture becomes the fourth b picture, and each B position in the GBGB column has a green element G, . After the mother completes the green element reconstruction of the GBGB column, and then processes the green, red, green and red (GRGR) column, as shown in the fourth B, the reconstruction of the G5 where the original position does not exist needs to refer to its surrounding S. , G4, Ge, Gs, and after a certain judgment, the calculation formula of this judgment principle is as follows: & Δ Η = I G4 - G6 I + | R5 - R3 + R5 - R7 I ;

Page 10 1246851 V. INSTRUCTIONS (8) △ V = | G2 - Gg 丨 + I R5 - heart + R5 - R9 | ; When △ Η < △ V, then G5 = ( G4 + G6 ) + 2 ; △ H > Δ V, then G5 = ( G2 + G8 ) + 2, and then the missing G5 of the R5 position is complemented. In this way, the G value lost by the R position in the GRGR column is sequentially obtained by the above interpolation method. Therefore, the fourth B picture becomes the fourth C picture, so that each R position in the GRGR column has a green color. Element G '. At this point, the green color reconstruction of all pixels in the image pixel array has been completed. After the G color reconstruction is completed, the value of the blue element B missing in the horizontal GBGB column is calculated by referring to the blue pixel value (B) in the horizontal direction. As shown in FIG. 5A, the BG is originally absent. For the reconstruction of B/ in the Gg position, refer to the ι and 匕, difference, & and 匕, difference and G() on the two sides of the h level. The calculation formula is as follows: B〇J =[ (B, -G/ ) + (β2 -G2j ) ] ^ 2 + G〇 (1) In this way, the B, which is missing from the G pixel in the GBGB column in the horizontal direction, is calculated one by one, and therefore, the fifth A is changed to the fifth B. Figure, so that each G position in the GBGB column has a blue element B,. As shown in the fifth C diagram, the r value in the reference horizontal direction is calculated from the red R value missing in the horizontal (3) (3) column. In the fifth C picture, R() is originally the rq of the non-existent 'Gg position. 'Reconstruction needs to refer to the & and heart, difference, & and Gg difference on both sides of the heart level and, as follows: V = [(比—A,)+ ( r2 — g2,)] + 2 + G〇(2) thus calculates the R, the value - which is missing in the horizontal direction iGRGR column, so that the 'fifth C picture becomes the fifth D picture, and each G position in the GRGR column

Page 11 V. Description of invention (9) f has a red element R,. So far, the reconstruction of the blue (β) color and the red (R) color in the horizontal square array has been targeted. Several image pixels After the blue and red color reconstruction in the horizontal direction, the blue and red colors in the vertical direction, the reconstruction method and the original 'reconstruction:. First, as shown in the figure, refer to the vertical direction: in the square direction will contain GR' or ", the pixel is missing β, the value will be vertical = straight - side 4 called difference, & called ' The difference is ς, ,, is the same as the above formula (1) ·· 吖 is like B. '...-Gl,) + (b2 one heart,)] + 2 + ^ If: 依,直向中细细,赖G's pixel. Formula,) Each pixel of each line has a blue t-element Α?, a six-figure figure of the younger brother, so that the splicing is as shown in the figure c, and the r value in the vertical direction will hang. 3 BG or GB, the red element R missing from the pixel, the value = G Γ 图 map originally does not exist, °. Position R., reconstruction needs to participate in ί & vertical two sides of the RlAGl 'difference , & difference is ^, which is the same as above (2): G Τ π is as R°' = [ (Rl — Gl,) + (H,)] + 2 + G. = Calculate the value of 1^, which is missing from the pixels in the vertical direction, so that the image pixel array of the sixth C picture becomes the bear sample shown in the sixth D picture, so that each pixel contains RGB three color values. , and then complete the process of reconstruction. 1冢Understanding the hair After the specific implementation method of Ming, the following special ones are for one 1246851

The comparative example illustrates the effect and efficacy achieved by the present invention. For example, = the difference between the methods, to verify a line close to black (dark color indicates seven figures, first, the mode (light color), using conventional color interpolation, passing a vertical and horizontal area close to white The signal trend changes and * only the G value change is used to judge the process as follows: 叩 clothes take the interpolation value Gc, its judgment ^ straight: change amount (G 卜 G4) = 1233-230 丨 = 3; level: change Quantity (G2-G3)=丨24_2〇| = 4 ;

^ ^ then (horizontal variation) > (vertical variation). If the driver knows that only the G value changes, the system misjudges the signal in the vertical direction due to insufficient data, so that the system calculates the center Gc value by (Gl+G4)/2, thus causing The misjudgment makes the g value become 2 0, 2 3 1, 2 4 is not continuous, making the line appear to be in a broken state. Conversely, by using the color interpolation method of the present invention, the vertical and horizontal signal trend changes of the G value are calculated by the following formula: Vertical G: Change amount (G1-G4) = 1233-2301 = 3; Level G: Change The quantity (G2-G3) = 124-201 = 4; then add the R value to assist the judgment, the calculation formula is as follows:

Vertical R: variation (2RC-R5-R8) = 150-20 0-2031 2353; horizontal R: variation (2RC-R6-R7) = |5 0-2 1 -231 = 6; then (vertical G + Vertical R) > (Level G + Level R). Therefore, after the R value is judged, it is more realistic to reflect the actual signal change, and the information with less change in the horizontal direction is obtained, so the system will

Page 13 1246851 V. Description of invention (11)

(G2 + G3)/2 to calculate the center Gc value, and then get the insertion value of a pregnant parent, so that the G value is 20, 22, 24, so the line looks at the interpolation and presents a more continuous and clear picture. quality. Therefore, the present invention utilizes the enthalpy value and considers the directionality of the surrounding B and R values before the interpolation calculation, and adds the process of judging the edge and the trend, and then uses the horizontal or vertical direction of the signal change less. The values of the primordial values are averaged to obtain a more accurate (^ value, and then the Β value and the R value are interpolated based on the G value, so that the signal values of the entire interpolation process exhibit a good connection relationship. The ultimate goal of providing accurate interpolation color values is achieved, so as to achieve a high resolution and stability effect, so that the image naturally presents a smooth image 'to actually improve the missing of the conventional interpolation system error.

The above description of the features of the present invention is provided by the embodiments of the present invention, and it is intended that the skilled person can understand the contents of the present invention and implement it instead of being limited to the scope of the present invention. Equivalent modifications or modifications made from the spirit of the present invention should still be included in the scope of the claims described below. Figure number description: 1 0 red pixels 14 green pixels 2 〇 image pixel array 2 4 red pixels 2 8 green pixels 1 2 blue pixels 22 pixels 2 6 blue pixels

Page 14 1246851 Brief Description of the Diagram The first figure is a schematic diagram of the interpolation of colors in an image pixel array. The second figure is a schematic diagram of an image pixel array interpolated by the present invention. The third figure is a flow chart of the interpolation method of complementing the pixel color of the present invention. The fourth to fourth C diagrams are not intended to be a pixel array for each step of reconstructing a green element of the present invention. The fifth to fifth figures D are schematic diagrams of pixel arrays for reconstructing the blue and red elements in the horizontal direction in the present invention. 6A to 6D are schematic views of pixel arrays of steps of reconstructing blue and red elements in a vertical direction according to the present invention.

Figure 7 is a schematic diagram of a pixel array simulating an actual image of the present invention and showing the photometric values of the pixels.

Page 15

Claims (1)

1246851 VI. The scope of the patent application is applied to the light passing through a color filter. The image pixel array is a red image. The interpolation method is used to make each image of the image contain a red color. The color elements lost by the image pixel array, blue pixel and green pixel generated after the film are complemented by blue and green elements. The interpolation of the complement pixel color is two: material silly + = 遽, and judge In the image pixel array, the signal trend in the vertical direction changes. · Silly: force: the direction of the small scent, the average of each green pixel adjacent to each red/blue pixel is averaged, and the average value becomes the data of each green element. And the pixels in the current pixel for the horizontal and vertical directions of t, respectively, complement each of the blue elements or/and red elements lost by the pixel by interpolation, so that each of the pixels contains green, red, Blue three elements. 2. The interpolating method of complementary pixel colors as described in claim 1, wherein the pixel array is a green and blue pixel column and a red and green pixel column are sequentially arranged to form an array. 3. For the interpolation of complementary pixel colors as described in item 1 of the patent application, wherein the step of determining the change of the signal trend is based on the horizontal and vertical directions of each of the green pixels, according to the surrounding green pixels and The value of the red/blue pixel is judged. 4. Interpolation of the complementary pixel color as described in item 1 of the patent application scope, wherein 'when the trend of the horizontal pixel signal value of the green pixel is smaller than the vertical direction', the horizontal direction is used as a reference. The green pixels of each of the red/blue pixels are adjacent to each other on the two sides of the horizontal, and the average value is 1268851. The patent application scope is the mother's red/blue pixel. 5. ^::: Its green element. ^ , Gu Di 1 mentioned in the complement of the turbulence of the ten to the upper ^, when the green pixel around the pixel signal / ph, =; ΐ: small direction, then the vertical direction based on ί 1C two The vertical-side adjacent two of the green pixels are averaged: this flat;: red/ is the mother's green element in the red/blue pixel, and the complement 1+ mean is 2 patent application scope! The term is ^. Among them, 'the blue element that is missing from the pixels is 辛\色=插插:, complement the pixels of the array to the color = ", the interpolation method of the complementary pixel color, the step 'first for vertical The direction alignment complements: then the pixels arranged in the horizontal direction complement the color elements. 8. In the first item of the patent application, the auxiliary "stem:: interpolation of pixel colors, :! ίίΐ The missing blue element or / and red element complements the mother - the blue and red feet lost by the green pixel - the red element lost by the blue pixel, the blue element lost by the element. The red image is applied to the light through a color filter. The image pixel array includes the first interpolation method for each image to have a pixel and a second element for each pixel, and the complement pixel color is interpolated. Method Pack 9 · An image pixel array generated after the interpolation of the pixel color is complemented by a pixel element, a pixel, a pixel, and a third pixel, and the missing color element is added to the element, page 17, 1246851 栝 the following steps: receiving the image pixel array, the level around the pixel is changed according to the direction of the smallest change, the first pixel is averaged, and the first element of the second pixel is lost to the horizontal and vertical directions/the pixel Each of the pixels includes a first, a first color, such as the first, second, and blue pixels, and the pixel array is sequentially arranged to form an array II. Judging the horizontal and vertical direction of the signal, the value of the two pixels is judged. 1 2 · If the scope of the patent application is ninth, the steps of complementing the pixels are first for the horizontal side and then for the vertical direction. 13 If the patent application scope is ninth, the step of complementing the pixels is first for vertical a signal of the square, and determining a change in the direction of the signal in the vertical direction of the image pixel array; and averaging each of the second/third pixels, the average value obtained is each of the second/data; Equal pixels, each of which complements each element or/and the third element by interpolation, thereby making each of the second and third elements. In the interpolation method of complementing the pixel color, the second pixel is an interpolation method of the complemented pixel color, which is a green pixel, a red pixel column, a green, a blue pixel column, and a red and green image. The step of deriving the color of each of the first image according to the first pixel and the second/second item of the surrounding image, the missing second element or/and the third element The pixels arranged to complement the color elements, the pixels of which complement the color elements. = the complement of the complementary pixel color, the missing second element or / and the third element of the direction of the pixels complement the color element, 1246851 VI. Applying for a patent range Then, the pixels arranged in the horizontal direction complement the color elements. 1 . The interpolation method of the complementary pixel color according to claim 9 , wherein the step of complementing the second element or/and the third element lost by the pixels complements each of the first pixels The lost second and third elements 'complement each third element lost by the second pixel' and complement each second element lost by the third pixel. Page 19