WO2007078116A1 - Apparatus and method for compensating hue declination, and image processor using the same - Google Patents

Apparatus and method for compensating hue declination, and image processor using the same Download PDF

Info

Publication number
WO2007078116A1
WO2007078116A1 PCT/KR2006/005847 KR2006005847W WO2007078116A1 WO 2007078116 A1 WO2007078116 A1 WO 2007078116A1 KR 2006005847 W KR2006005847 W KR 2006005847W WO 2007078116 A1 WO2007078116 A1 WO 2007078116A1
Authority
WO
WIPO (PCT)
Prior art keywords
compensation
image
pixels
luminance
unit
Prior art date
Application number
PCT/KR2006/005847
Other languages
French (fr)
Inventor
Yo-Hwan Noh
Ji-Cheol Hyun
Original Assignee
Mtekvision Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mtekvision Co., Ltd. filed Critical Mtekvision Co., Ltd.
Publication of WO2007078116A1 publication Critical patent/WO2007078116A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/643Hue control means, e.g. flesh tone control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/40Picture signal circuits
    • H04N1/401Compensating positionally unequal response of the pick-up or reproducing head

Definitions

  • the present invention is related to an image sensor, more specifically, an apparatus and a method for removing color deviation in the corner of a photographed image in image sensor.
  • An image sensor is a semiconductor element which converts an optical image into an electric signal.
  • a CCD(Charge Coupled Device) is an element in which each of MOS(Metal-Oxide-Silicon) capacitors is very neighboring each other and charge carriers are stored in the capacitor transmitted.
  • MOS(Metal-Oxide-Silicon) capacitors is very neighboring each other and charge carriers are stored in the capacitor transmitted.
  • CMOS(Complementary MOS) image sensor is an element which adopts a switching method of producing CMOS transistors as many as the number of pixels and detecting output of the pixel successively by using CMOS technology which uses control circuits and signal processing circuits as peripheral circuits.
  • the portable devices for example, digital cameras and mobile communication terminals
  • the image sensor is consisted of an array of small photosensitive diodes, called pixels or photosites.
  • the pixels do not extract color from light but convert photons of a wide spectrum band into electrons.
  • the sensor filters each pixel to receive a different color.
  • This type of sensors is known as a color filter array(CFA).
  • the different color filters are arranged in a predetermined pattern across the sensor.
  • the most common pattern is a Bayer patter which is widely employed in the CFA. Namely, a half of the total number of pixels is green (G), and each quarter of the
  • red, green and blue filters are arranged in a particular sequence to form a repetitive pattern.
  • the Bayer pattern is composed of a 2 x 2 array.
  • the Bayer pattern is based on the premise that the human eye extracts most of luminance information from green color of an image. Therefore, an image with high resolution can be generated when more of the pixels are made to be green, compared to
  • the pixels in the center part and the pixels in the outer part of the color filter array of an image sensor are exposed to a light source from different positions.
  • Fig. 1 shows the color unevenness phenomenon occurring at the corner of each quadrant of the image.
  • Fig. 1 not on the center of the image but on the corner of the each 4 quadrant(A, B, C, D), one of red, green or blue color is highly distinquished from the other colors, which results in the unevenness of color deviation over all.
  • Such an unevenness color deviation further causes image distortion since not only one color is distinguished on all 4 quadrants but a different color is distinguished at a different quadrant, for example red is distinguished at the A corner and blue at the C corner.
  • an apparatus and a method for compensating color deviation and an image processor using the apparatus and method which can improve uneven color deviation occurring in the image are provided.
  • An apparatus and a method for compensating color deviation and an image processor using the apparatus and method which can reduce the image distortion caused by the color deviation according to the differences between the properties of each color occurring at the corner of the image are provided.
  • An aspect of the present invention features, an apparatus for compensating the color deviation in an image having uneven color deviation, including; a horizontal compensation curve generating unit analyzing a luminance of pixels included in the first row of the image and generating a horizontal compensation curve according to the luminance; a vertical compensation curve generating unit analyzing a luminance of pixels included in the first column of the image and generating a vertical compensation curve according to the luminance; a compensation image generating unit combining the
  • the horizontal compensation curve generating unit includes, a luminance analyzing unit analyzing luminance of the pixels of the first row; a section
  • the horizontal compensation curve generating unit generates two or more horizontal compensation curves having a different interval of the section and generates a final horizontal compensation curve by combining them.
  • the vertical compensation curve generating unit includes: a luminance analyzing unit analyzing luminance of the pixels of the first column; a section dividing unit dividing the pixels into sections having an equal interval; and a compensation value
  • interpolating unit calculating compensation values of the pixels on the edge(boundary) of the section and interpolating compensation values of other pixels in the section linearly using the compensate value, wherein the vertical compensation curve is generated by using the interpolated compensation value.
  • the vertical compensation curve generating unit generates two or more horizontal compensation curves having a different interval of the section and generates a final horizontal compensation curve by combining them.
  • the apparatus for compensating the color deviation can generate compensation image corresponding to red, green and blue colors in the image, respectively.
  • An aspect of the present invention features, an image processor of an image device which compensates the uneven color deviation of an image-
  • the image device includes a sensor unit, the image processor and a display unit- including a line processing unit which color-interpolates digital image signals inputted from the sensor unit and generates an image lens shading corrected; a color deviation compensation unit combining a horizontal compensation curve generated by analyzing the luminance of pixels included in the first row of the image and a vertical compensation curve generated by analyzing the luminance of pixels included in the first column of the image and generating a compensation image according to the entire image and carrying out the compensation; and a subsequent processing unit processing the data outputted from the color deviation compensation unit to be displayed through the display unit.
  • the color deviation compensation unit carries out compensation by
  • An aspect of the present invention features, a method for compensating the color deviation in an image having uneven color deviation, including analyzing a luminance of pixels included in the first row and the first column of the image, respectively; generating a horizontal compensation curve and a vertical compensation curve according to the luminance; generating a compensation image according to the entire image by combining the vertical compensation curve and the horizontal compensation curve; and carrying out the compensation by applying the compensation image to the image.
  • the step of analyzing the luminance of pixels included in the first row and the first column of the image respectively includes analyzing the luminance of the pixels of the first row and the first column; dividing the pixels into sections having an equal interval; calculating compensation values of the pixels on the edge(boundary) of the section; interpolating compensation values of other pixels in the section linearly using the compensate value; and repeating the step of interpolating compensation values of other pixels linearly in the section using the compensation value corresponding to all the pixels of the first row and the first column, wherein the horizontal compensation curve is generated from the interpolated compensation value.
  • the step of generating a horizontal compensation curve and a vertical compensation curve according to the luminance generates a final horizontal compensation curve by generating and combining two or more horizontal compensation curves corresponding to sections having a different interval and a final vertical compensation curve by generating and combining two or more vertical compensation
  • Fig. 1 shows the color unevenness phenomenon occurring at the corner of each quadrant of the image.
  • Fig.2 is a structure diagram of an image device according to an embodiment of
  • Fig. 3 is a structure diagram of a color deviation compensation unit according
  • Fig. 4 is a block diagram of each compensation curve generating unit according to an embodiment of the present invention.
  • Fig. 5 to Fig. 8 show methods for generating a compensation image according to an embodiment of the present invention.
  • Fig. 9 is a flow chart illustrating a method for compensating the uneven color
  • first and second can be used in describing various elements, but the above elements shall not be restricted to the above terms. The above terms are used only to distinguish one element from the other. For instance, the first element can be named the second element, and vice versa, without departing the scope of claims of the present invention.
  • the term “and/or” shall include the combination of a plurality of listed items or any of the plurality of listed items.
  • Fig. 1 is used as an image to be compensated.
  • Fig.2 sis a structure diagram of an image device according to an embodiment of the present invention.
  • an image device 200 includes a sensor unit 210, an image processing unit 220 and a display unit 230. Besides, the image device 200 can also include a key input unit, a memory etc., but descriptions on them are omitted since they are not related to the gist of the present invention.
  • the sensor unit 210 includes a color filter array(CFA) 212 and an A/D converter 214.
  • the sensor unit 210 may further include an external lens (not illustrated).
  • the color filter array(CFA) 212 converts optical object signals inputted through the lens into electric signals and outputs the electric signal.
  • the color filter array(CFA) 212 can use a variety of patterns including the Bayer pattern, and an image signal having color information on only one of red, green and blue colors information is outputted to each pixel. An image signal having information on red color is outputted
  • each pixel value obtained through the color filter array 212 having the Bayer pattern , etc. is interpolated (for example, averaging the values of 2 pixels of right and left or 4 pixels of right and left and upper and lower and analogizing the omitted color information). The interpolation is performed by the interpolation unit 221.
  • the A/D converter 214 converts an image signal converted by the color filter array (CFA) 212 to a digital signal and transmits the digital signal to the interpolation unit 221.
  • CFA color filter array
  • the image processing unit 220 includes the interpolation unit 221, a memory for interpolation 222, a lens shading compensation unit 223, a color deviation compensation unit 224, a color adjustment unit 225, a gamma conversion unit 226, a gamma table 227, a format converion unit 228, and a format conversion table 229.
  • the image processing unit 220 may further include a timing generating unit(not illustrated) generating various timing signals from a horizontal synchronize signal(Hsync), a vertical synchronize signal(Vsync) and a pixel clock(PCLK).
  • the interpolation unit 221 generates pixel signals of red, green, and blue colors
  • the interpolation unit 221 may generate the pixel signals of green and blue for the pixel corresponding to red color by performing an interpolating calculation of the pixel signals of neighboring pixels. For this, the pixel signals of the neighboring pixels are recorded temporarily in the memory for interpolation 222, and the interpolation unit 221 uses these recorded
  • the lens shading compensation unit 223 performs luminance and level analysis
  • the lens shading compensation unit 223 compensates image signals of all the pixels in the pixel array corresponding one frame, namely, the pixel signals having information on red, green and blue colors, in accordance with the level set by setting the auto exposure value, so that the quality of an original image is not deteriorated.
  • the color deviation compensation unit 224 compensates color deviation of the image with uneven color deviation.
  • the compensation image which can compensate uneven color deviation phenomenon accruing at the corner of each quadrant of the image as shown in Fig. 1 according to a predetermined method is generated for the image of which the lens shading phenomenon is compensated through the lens shading compensation unit 223.
  • the structure of the color deviation compensation unit 224 and the method of generating the compensation image will be explained in detail with reference to the accompanying Fig. 3.
  • the color adjustment unit 225 adjusts color tone
  • the gamma conversion unit 226 converts image data to be appropriate for device characteristics(gamma characteristics) of the display unit 230 to display the image on the display unit 230 (for example, LCD, CRT etc.).
  • the conversion table is stored in the gamma table 227 for converting the image data into the gamma property of image displaying device of display unit 230.
  • the format conversion unit 228 converts pixel signals to have a digital format, such as NTSC, YUV, YCbCr, etc., and outputs them.
  • the format conversion table 229 is a table for converting formats of the pixel signals to display signal formats such as NTSC or YUV, etc.
  • Fig. 3 is a block diagram of the color deviation compensation unit 224 according to an embodiment of the present invention
  • Fig. 4 is a block diagrm of the compensation curve generating unit according to an embodiment of the present invention.
  • Fig. 5 to Fig. 8 illustrate a method for generating the compensation image according to an embodiment of the present invention.
  • the color deviation compensation unit 224 includes a horizontal compensation curve generating unit 310, a vertical compensation curve generating unit 320, a compensation image generating unit 330 and a compensation unit 340.
  • the horizontal compensation curve generating unit 310 analyzes the luminance of the pixels included in the first row of the image, of which the compensation for lens shading phenomenon is completed and color interpolation is performed by the
  • a horizontal compensation curve is generated to have uniform
  • the vertical compensation curve generating unit 320 analyzes the luminance of the pixels included in the first column in the same image. And a vertical compensation curve is generated to have uniform luminance for the first column, based on the analyzed luminance of the pixels.
  • the horizontal compensation curve generating unit 310 or
  • the vertical compensation curve generating unit 320 includes a luminance analyzing unit 410, a section dividing unit 420 and a compensation value interpolation unit 430.
  • the description is mostly based on the horizontal compensation curve generating unit 310, but it is apparent that the same explanation can be adapted to the vertical compensation curve generating unit 320.
  • the luminance analyzing unit 410 analyzes luminance of the pixels from the first column to the pixels of the last column for the pixels corresponding to the first row of the image.
  • Fig. 5 shows the luminance distribution in the first row of the image
  • the compensation curve may be generated having q part 610 which compensates the part 510 of Fig. 5 and a part 620 which compensates the part 520 of Fig. 5 as shown in Fig. 6.
  • the section dividing unit 420 divides the pixels corresponding to the first row or the first column by an equal interval from the first pixel and determines pixels for the edge(boundary). of each section.
  • the compensation value interpolation unit 430 calculates compensate values
  • the compensation value of the pixels included in a corresponding section may be interpolated by employing a linear interpolation based on the compensation values corresponding to both sides of the edge(boundary) within the corresponding section.
  • a compensation curve is generated based on the compensation value of each pixel interpolated and calculated.
  • the compensation value (Cl, C2, C3, C4, C5%) of the pixels(l, 2, 3, 4, 5 %) corresponding to the edge(boundary) of each section(Bl, B2, B3, ...) is outputted from the first pixel of the first row.
  • the section interval can be the certain number of pixels such as 16 pixels or 32 pixels, etc.
  • the pixels included in the first section Bl have a compensation value as the value of a linear function expressed by a straight line connecting from Cl and C2 which are the edge(boundary) of the first section Bl.
  • the pixels included in the second section B2 have a compensation value as the value of a linear function expressed by a straight line connecting from C2 and C3 which are the edge(boundary) of the second section B2.
  • the compensate values of all the pixels of the first row can be determined and a horizontal compensation curve can be generated, accordingly.
  • the horizontal compensation curve generating unit 310 can generate another horizontal compensation curve by changing an interval of each section. If an
  • interval of a section in Fig. 7(a) is 32 pixels
  • an interval of a section in Fig. 7(b) is not 32 pixels but 16 pixels or 8 pixels, etc.
  • the method for obtaining the compensation curve is the same as described above only except an interval of a section.
  • pixels in the first row becomes a form of enabling the real luminance of each pixel to be uniform by employing a method of generating various compensation curves with different intervals of the section and calculating their average value or their medium value.
  • the horizontal compensation curve generating unit 310 generates a horizontal compensation curve corresponding to the first row of the image
  • the vertical compensation curve generating unit 320 generates a vertical compensation curve corresponding to the first column of the image.
  • the compensation image generating unit 330 generates an overall compensation image corresponding to the total pixels by combining the vertical compensation curve and the horizontal compensation curve. Referring to Fig. 8, the compensation image generating unit 330 generates the compensation image as in Fig. 8(d) by generating and combining the horizontal compensation curve 820 of the horizontal direction and the vertical compensation curve 810 of the vertical direction
  • a method of calculating a compensation value corresponding to the pixel of (x,y) coordinates among the images is described for example.
  • a compensation value corresponding x-coordinates from the horizontal compensation curve 820 and a compensation value corresponding to y-coordinates from vertical compensation curve 810 are selected and added, multiplied or averaged, etc., to provide a desired
  • the compensation unit 340 performs compensation so as to compensate the unevenness of the color deviation by applying the compensation image generated in the compensation image generating unit 330 to the entire image.
  • the vertical compensation curve, the horizontal compensation curve and the compensation image are tabled as s lookup table with the compensation value for each pixel and then stored in a memory(not illustrated) or a
  • the color deviation compensation unit 224 of the present invention can generate compensate images which compensate unevenness of the color deviation corresponding to each of red, green and blue components, respectively, included in each pixel of the image. Namely, the first vertical compensation curve and the first horizontal compensation curve are needed to generate the compensation image corresponding to red component, the second vertical compensation curve and the second horizontal compensation curve are needed to generate the compensation image corresponding to green component, and the third vertical compensation curve and the third horizontal compensation curve are needed to generate the compensation image corresponding to blue component, respectively.
  • Fig. 9 shows a flow chart illustrating a method for compensating the uneven color deviation according to an embodiment of present invention.
  • the horizontal compensation curve generating unit 310 analyzes the luminance of the pixels included in the first row of an image.
  • the vertical compensation curve generating unit 320 analyzes the luminance
  • a vertical compensation curve and a horizontal compensation curve are generated according to the method described with Fig. 6 and Fig.7 based on the luminance information analyzed in the step 910. The generation of the vertical
  • compensation curve and the horizontal compensation curve can be performed successively or simultaneously.
  • the compensation image generating unit 330 generates the compensation image corresponding to the entire image by combining the vertical compensation curve and the horizontal compensation curve in the step 930.
  • the compensation image may have a type shown in Fig. 8(d), and this can be made a type of the lookup table.
  • the compensation unit 340 performs the compensation by applying the compensation image to the image, and compensates the unevenness of color deviation of the image in the step 940.
  • the apparatus and method for compensating color deviation and the image processor using the apparatus and method according to the present invention can improve uneven color deviation occurring in the image.
  • the method for compensating color deviation and the image processor using the apparatus and method can reduce the image distortion caused by the color deviation according to the differences between the properties of each color occurring at the corner of the image. Therefore, an image with neither the color deviation nor distortion though the color correction or gamma conversion may be generated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Color Television Image Signal Generators (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Image Processing (AREA)

Abstract

The present invention is related to an apparatus for compensating the color deviation which compensates color deviation of an image with uneven color deviation comprising horizontal compensation curve generating unit analyzes the luminance of pixels included in the first row of the image and generates a horizontal compensation curve according to the luminance; vertical compensation curve generating unit analyzes the luminance of pixels included in the first column of the image and generates a vertical compensation curve according to the luminance; compensation image generating unit synthesizes the vertical compensation curve and the horizontal compensation curve and generates compensation image according to the entire image; and compensation unit carries out compensation by applying the compensation image to the image. The uneven color deviation in the image can be improved. And especially distortion caused by the color deviation according to the differences between the properties of each color occurring at the corner of the image can be reduced.

Description

[DESCRIPTION]
[Invention Title]
APPARATUS AND METHOD FOR COMPENSATING HUE DECLINATION, AND IMAGE PROCESSOR USING THE SAME
[Technical Field]
The present invention is related to an image sensor, more specifically, an apparatus and a method for removing color deviation in the corner of a photographed image in image sensor.
[Background Art]
An image sensor is a semiconductor element which converts an optical image into an electric signal. A CCD(Charge Coupled Device) is an element in which each of MOS(Metal-Oxide-Silicon) capacitors is very neighboring each other and charge carriers are stored in the capacitor transmitted. On the other hand, a
CMOS(Complementary MOS) image sensor is an element which adopts a switching method of producing CMOS transistors as many as the number of pixels and detecting output of the pixel successively by using CMOS technology which uses control circuits and signal processing circuits as peripheral circuits. The portable devices (for example, digital cameras and mobile communication terminals) having an image sensor have been developed and are being sold. The image sensor is consisted of an array of small photosensitive diodes, called pixels or photosites.
The pixels do not extract color from light but convert photons of a wide spectrum band into electrons. To record color images with a single sensor, the sensor filters each pixel to receive a different color. This type of sensors is known as a color filter array(CFA). The different color filters are arranged in a predetermined pattern across the sensor.
The most common pattern is a Bayer patter which is widely employed in the CFA. Namely, a half of the total number of pixels is green (G), and each quarter of the
total number is assigned to red (R) and blue (B), respectively. In order to obtain color
information, red, green and blue filters are arranged in a particular sequence to form a repetitive pattern. The Bayer pattern is composed of a 2 x 2 array.
The Bayer pattern is based on the premise that the human eye extracts most of luminance information from green color of an image. Therefore, an image with high resolution can be generated when more of the pixels are made to be green, compared to
when an equal number of red, green and blue pixels is alternated.
However, in response to trends for portable devices in recently being developed and marketed with slimmer and more microminiaturized, the demand for image sensors with high-pixel is increasing. As a result, it causes an image distortion phenomenon due to small external lenses and high f number, apparatus of lenses, and micro lenses positioned on each pixel, etc.
The pixels in the center part and the pixels in the outer part of the color filter array of an image sensor are exposed to a light source from different positions. These
minute differences in position cause differences in illumination, and the differences in illumination influence color due to differences in light wavelength and refractive index of lenses. As a result, color distortion and reduction in signal amplitude dependant on the position of the pixel inevitably occur which cause deterioration in the quality of original images. To resolve this problem, a method of compensating the lens shading
phenomenon is introduced to equalize the luminance of entire images when the images of a white area are photographed.
But the correction is processed centering on the center of the image and sweepingly according to the distant from the center of the image.
Fig. 1 shows the color unevenness phenomenon occurring at the corner of each quadrant of the image. Referring to Fig. 1, not on the center of the image but on the corner of the each 4 quadrant(A, B, C, D), one of red, green or blue color is highly distinquished from the other colors, which results in the unevenness of color deviation over all. Such an unevenness color deviation further causes image distortion since not only one color is distinguished on all 4 quadrants but a different color is distinguished at a different quadrant, for example red is distinguished at the A corner and blue at the C corner.
[Disclosure]
[Technical Problem]
Therefore, an apparatus and a method for compensating color deviation and an image processor using the apparatus and method which can improve uneven color deviation occurring in the image are provided. An apparatus and a method for compensating color deviation and an image processor using the apparatus and method which can reduce the image distortion caused by the color deviation according to the differences between the properties of each color occurring at the corner of the image are provided. [Technical Solution]
An aspect of the present invention features, an apparatus for compensating the color deviation in an image having uneven color deviation, including; a horizontal compensation curve generating unit analyzing a luminance of pixels included in the first row of the image and generating a horizontal compensation curve according to the luminance; a vertical compensation curve generating unit analyzing a luminance of pixels included in the first column of the image and generating a vertical compensation curve according to the luminance; a compensation image generating unit combining the
vertical compensation curve and the horizontal compensation curve and generating a compensation image according to the entire image; and a compensation unit performing compensation by applying the compensation image to the image.
Wherein the horizontal compensation curve generating unit includes, a luminance analyzing unit analyzing luminance of the pixels of the first row; a section
dividing unit dividing the pixels into sections having an equal interval; and a compensation value interpolating unit calculating compensation values of the pixels on the edge(boundary) of the section and interpolating compensation values of other pixels in the section linearly using the compensate value, wherein the horizontal compensation curve is generated by using the interpolated compensation value. Wherein the horizontal compensation curve generating unit generates two or more horizontal compensation curves having a different interval of the section and generates a final horizontal compensation curve by combining them.
Wherein the vertical compensation curve generating unit includes: a luminance analyzing unit analyzing luminance of the pixels of the first column; a section dividing unit dividing the pixels into sections having an equal interval; and a compensation value
interpolating unit calculating compensation values of the pixels on the edge(boundary) of the section and interpolating compensation values of other pixels in the section linearly using the compensate value, wherein the vertical compensation curve is generated by using the interpolated compensation value. Wherein the vertical compensation curve generating unit generates two or more horizontal compensation curves having a different interval of the section and generates a final horizontal compensation curve by combining them. The apparatus for compensating the color deviation can generate compensation image corresponding to red, green and blue colors in the image, respectively.
Wherein the vertical compensation curve, the horizontal compensation curve
and the compensation image are generated in a lookup table.
An aspect of the present invention features, an image processor of an image device which compensates the uneven color deviation of an image- wherein the image device includes a sensor unit, the image processor and a display unit- including a line processing unit which color-interpolates digital image signals inputted from the sensor unit and generates an image lens shading corrected; a color deviation compensation unit combining a horizontal compensation curve generated by analyzing the luminance of pixels included in the first row of the image and a vertical compensation curve generated by analyzing the luminance of pixels included in the first column of the image and generating a compensation image according to the entire image and carrying out the compensation; and a subsequent processing unit processing the data outputted from the color deviation compensation unit to be displayed through the display unit.
Wherein the color deviation compensation unit carries out compensation by
generating the compensation images corresponding to red, green and blue colors in the image, respectively. An aspect of the present invention features, a method for compensating the color deviation in an image having uneven color deviation, including analyzing a luminance of pixels included in the first row and the first column of the image, respectively; generating a horizontal compensation curve and a vertical compensation curve according to the luminance; generating a compensation image according to the entire image by combining the vertical compensation curve and the horizontal compensation curve; and carrying out the compensation by applying the compensation image to the image.
Wherein the step of analyzing the luminance of pixels included in the first row and the first column of the image, respectively includes analyzing the luminance of the pixels of the first row and the first column; dividing the pixels into sections having an equal interval; calculating compensation values of the pixels on the edge(boundary) of the section; interpolating compensation values of other pixels in the section linearly using the compensate value; and repeating the step of interpolating compensation values of other pixels linearly in the section using the compensation value corresponding to all the pixels of the first row and the first column, wherein the horizontal compensation curve is generated from the interpolated compensation value.
Wherein the step of generating a horizontal compensation curve and a vertical compensation curve according to the luminance, generates a final horizontal compensation curve by generating and combining two or more horizontal compensation curves corresponding to sections having a different interval and a final vertical compensation curve by generating and combining two or more vertical compensation
curves corresponding to sections having a different interval, respectively. Wherein the step of analyzing a luminance of pixels included in the first row
and the first column of the image to the step of carrying out the compensation by applying the compensation image to the image are performed repetitively for red, green and blue colors in the image to generate the compensation image corresponding to each
color. The objects, specified advantages and new features will become more apparent through the below description and desirable embodiments with reference to the accompanying drawings.
[Description of Drawings]
Fig. 1 shows the color unevenness phenomenon occurring at the corner of each quadrant of the image.
Fig.2 is a structure diagram of an image device according to an embodiment of
the present invention.
Fig. 3 is a structure diagram of a color deviation compensation unit according
to an embodiment of the present invention.
Fig. 4 is a block diagram of each compensation curve generating unit according to an embodiment of the present invention
Fig. 5 to Fig. 8 show methods for generating a compensation image according to an embodiment of the present invention.
Fig. 9 is a flow chart illustrating a method for compensating the uneven color
deviation according to an embodiment of present invention.
[Mode for Invention]
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Since there can be a variety of permutations and embodiments of the present invention, certain embodiments will be illustrated and described with reference to the accompanying drawings. This, however, is by no means to restrict the present invention to certain embodiments, and shall be construed as including all permutations, equivalents and substitutes covered by the spirit and scope of the present invention.
Terms such as "first" and "second" can be used in describing various elements, but the above elements shall not be restricted to the above terms. The above terms are used only to distinguish one element from the other. For instance, the first element can be named the second element, and vice versa, without departing the scope of claims of the present invention. The term "and/or" shall include the combination of a plurality of listed items or any of the plurality of listed items.
The terms used in the description are intended to describe certain embodiments only, and shall by no means restrict the present invention. Unless clearly used stated otherwise, expressions in the singular number include a the plural meaning, hi the present description, an expression such as "including, including" or "stored ", "loaded or mounted", "inserted" is intended to designate a characteristic, a number, a step, an operation, an element, a part or combinations thereof, and shall not be construed to preclude any presence or possibility of one or more other characteristics, numbers, steps,
operations, elements, parts or combinations thereof.
Unless otherwise defined specifically, all terms, including technical terms and
scientific terms, used herein have the same meaning as how they are generally understood by those of ordinary skill in the art to which the invention pertains. Any term that is defined in a general dictionary shall be construed to have the same meaning in the context of the relevant art, and, unless otherwise defined explicitly, shall not be interpreted to have an idealistic or excessively formalistic meaning. In the present invention, the image having uneven color deviation as shown in
Fig. 1 is used as an image to be compensated.
Fig.2 sis a structure diagram of an image device according to an embodiment of the present invention.
Referring to Fig. 2, an image device 200 includes a sensor unit 210, an image processing unit 220 and a display unit 230. Besides, the image device 200 can also include a key input unit, a memory etc., but descriptions on them are omitted since they are not related to the gist of the present invention.
The sensor unit 210 includes a color filter array(CFA) 212 and an A/D converter 214. The sensor unit 210 may further include an external lens (not illustrated). The color filter array(CFA) 212 converts optical object signals inputted through the lens into electric signals and outputs the electric signal. Here, the color filter array(CFA) 212 can use a variety of patterns including the Bayer pattern, and an image signal having color information on only one of red, green and blue colors information is outputted to each pixel. An image signal having information on red color is outputted
from the pixel corresponding an R(red) pattern, an image signal having information on green color is outputted from the pixel corresponding a G(green) pattern, and an image signal having information on blue color is outputted from the pixel corresponding a B(blue) pattern. Each pixel value obtained through the color filter array 212 having the Bayer pattern , etc. is interpolated (for example, averaging the values of 2 pixels of right and left or 4 pixels of right and left and upper and lower and analogizing the omitted color information). The interpolation is performed by the interpolation unit 221.
The A/D converter 214 converts an image signal converted by the color filter array (CFA) 212 to a digital signal and transmits the digital signal to the interpolation unit 221.
The image processing unit 220 includes the interpolation unit 221, a memory for interpolation 222, a lens shading compensation unit 223, a color deviation compensation unit 224, a color adjustment unit 225, a gamma conversion unit 226, a gamma table 227, a format converion unit 228, and a format conversion table 229. The image processing unit 220 may further include a timing generating unit(not illustrated) generating various timing signals from a horizontal synchronize signal(Hsync), a vertical synchronize signal(Vsync) and a pixel clock(PCLK).
The interpolation unit 221 generates pixel signals of red, green, and blue colors
corresponding to each pixel. The pixel signals of green(G) or blue(B) cannot be obtained from the pixel corresponding to red(R) color when an image signal outputted from the color filter array 212 has the Bayer pattern. Therefore, the interpolation unit 221 may generate the pixel signals of green and blue for the pixel corresponding to red color by performing an interpolating calculation of the pixel signals of neighboring pixels. For this, the pixel signals of the neighboring pixels are recorded temporarily in the memory for interpolation 222, and the interpolation unit 221 uses these recorded
pixel signals to perform the interpolating calculation. The lens shading compensation unit 223 performs luminance and level analysis
of the pixel signals for each pixel, detection of a center pixel of the lens shading image, and detection of a slope of the lens shading image and generates a mask image which can compensate the lens shading phenomenon. The compensation by the level analysis, detection of the center pixel of the lens shading image, and detection of the slope is performed through setting an auto exposure value. The level is related to brightness of each pixel, for instant, if the levels of the pixels are all 10, the overall brightness of the image may be 10. As described above, the lens shading compensation unit 223 compensates image signals of all the pixels in the pixel array corresponding one frame, namely, the pixel signals having information on red, green and blue colors, in accordance with the level set by setting the auto exposure value, so that the quality of an original image is not deteriorated.
The color deviation compensation unit 224 compensates color deviation of the image with uneven color deviation. The compensation image which can compensate uneven color deviation phenomenon accruing at the corner of each quadrant of the image as shown in Fig. 1 according to a predetermined method is generated for the image of which the lens shading phenomenon is compensated through the lens shading compensation unit 223. The structure of the color deviation compensation unit 224 and the method of generating the compensation image will be explained in detail with reference to the accompanying Fig. 3.
The color adjustment unit 225 adjusts color tone, the gamma conversion unit 226 converts image data to be appropriate for device characteristics(gamma characteristics) of the display unit 230 to display the image on the display unit 230 (for example, LCD, CRT etc.). The conversion table is stored in the gamma table 227 for converting the image data into the gamma property of image displaying device of display unit 230.
As a means to convert pixel signals to have a format appropriate for the display unit 230, the format conversion unit 228 converts pixel signals to have a digital format, such as NTSC, YUV, YCbCr, etc., and outputs them. The format conversion table 229 is a table for converting formats of the pixel signals to display signal formats such as NTSC or YUV, etc.
Fig. 3 is a block diagram of the color deviation compensation unit 224 according to an embodiment of the present invention, and Fig. 4 is a block diagrm of the compensation curve generating unit according to an embodiment of the present invention. And Fig. 5 to Fig. 8 illustrate a method for generating the compensation image according to an embodiment of the present invention.
Referring to Fig. 3, the color deviation compensation unit 224 includes a horizontal compensation curve generating unit 310, a vertical compensation curve generating unit 320, a compensation image generating unit 330 and a compensation unit 340.
The horizontal compensation curve generating unit 310 analyzes the luminance of the pixels included in the first row of the image, of which the compensation for lens shading phenomenon is completed and color interpolation is performed by the
interpolation unit 221. A horizontal compensation curve is generated to have uniform
luminance for all the first row, based on the luminance of the analyzed pixels
The vertical compensation curve generating unit 320 analyzes the luminance of the pixels included in the first column in the same image. And a vertical compensation curve is generated to have uniform luminance for the first column, based on the analyzed luminance of the pixels.
Referring to Fig. 4, the horizontal compensation curve generating unit 310 or
the vertical compensation curve generating unit 320 includes a luminance analyzing unit 410, a section dividing unit 420 and a compensation value interpolation unit 430. Hereinafter, the description is mostly based on the horizontal compensation curve generating unit 310, but it is apparent that the same explanation can be adapted to the vertical compensation curve generating unit 320.
The luminance analyzing unit 410 analyzes luminance of the pixels from the first column to the pixels of the last column for the pixels corresponding to the first row of the image. Fig. 5 shows the luminance distribution in the first row of the image
shown in Fig. 1. Here, it is confirmed that the luminance distribution is not symmetrical about the curve but the part 510 is different from the part 520. It is because even though the lens shading compensation unit 223 of the fore part of the color deviation compensation unit 224 compensates lens shading phenomenon, it cannot compensate the color deviation phenomenon caused by uneven characteristics of the micro lenses positioned on the image sensor. Therefore, the compensation curve may be generated having q part 610 which compensates the part 510 of Fig. 5 and a part 620 which compensates the part 520 of Fig. 5 as shown in Fig. 6.
The section dividing unit 420 divides the pixels corresponding to the first row or the first column by an equal interval from the first pixel and determines pixels for the edge(boundary). of each section. The compensation value interpolation unit 430 calculates compensate values
corresponding to the pixels for the edge(boundary) of the section divided by the section dividing unit 420. And the compensation value of the pixels included in a corresponding section may be interpolated by employing a linear interpolation based on the compensation values corresponding to both sides of the edge(boundary) within the corresponding section. A compensation curve is generated based on the compensation value of each pixel interpolated and calculated.
Referring to Fig.7(a), the compensation value (Cl, C2, C3, C4, C5...) of the pixels(l, 2, 3, 4, 5 ...) corresponding to the edge(boundary) of each section(Bl, B2, B3, ...) is outputted from the first pixel of the first row. Here, the section interval can be the certain number of pixels such as 16 pixels or 32 pixels, etc. And the pixels included in the first section Bl have a compensation value as the value of a linear function expressed by a straight line connecting from Cl and C2 which are the edge(boundary) of the first section Bl. And the pixels included in the second section B2 have a compensation value as the value of a linear function expressed by a straight line connecting from C2 and C3 which are the edge(boundary) of the second section B2. Applying this process to the third section B3 and the forth section B4, the compensate values of all the pixels of the first row can be determined and a horizontal compensation curve can be generated, accordingly. And the horizontal compensation curve generating unit 310 can generate another horizontal compensation curve by changing an interval of each section. If an
interval of a section in Fig. 7(a) is 32 pixels, an interval of a section in Fig. 7(b) is not 32 pixels but 16 pixels or 8 pixels, etc. The method for obtaining the compensation curve is the same as described above only except an interval of a section.
Therefore, a compensation curve corresponding to compensation values of the
pixels in the first row becomes a form of enabling the real luminance of each pixel to be uniform by employing a method of generating various compensation curves with different intervals of the section and calculating their average value or their medium value.
By the method described earlier, the horizontal compensation curve generating unit 310 generates a horizontal compensation curve corresponding to the first row of the image, and the vertical compensation curve generating unit 320 generates a vertical compensation curve corresponding to the first column of the image. The compensation image generating unit 330 generates an overall compensation image corresponding to the total pixels by combining the vertical compensation curve and the horizontal compensation curve. Referring to Fig. 8, the compensation image generating unit 330 generates the compensation image as in Fig. 8(d) by generating and combining the horizontal compensation curve 820 of the horizontal direction and the vertical compensation curve 810 of the vertical direction
A method of calculating a compensation value corresponding to the pixel of (x,y) coordinates among the images is described for example. A compensation value corresponding x-coordinates from the horizontal compensation curve 820 and a compensation value corresponding to y-coordinates from vertical compensation curve 810 are selected and added, multiplied or averaged, etc., to provide a desired
compensation value.
The compensation unit 340 performs compensation so as to compensate the unevenness of the color deviation by applying the compensation image generated in the compensation image generating unit 330 to the entire image.
In the present invention, the vertical compensation curve, the horizontal compensation curve and the compensation image are tabled as s lookup table with the compensation value for each pixel and then stored in a memory(not illustrated) or a
register(not illustrated) and used.
The color deviation compensation unit 224 of the present invention can generate compensate images which compensate unevenness of the color deviation corresponding to each of red, green and blue components, respectively, included in each pixel of the image. Namely, the first vertical compensation curve and the first horizontal compensation curve are needed to generate the compensation image corresponding to red component, the second vertical compensation curve and the second horizontal compensation curve are needed to generate the compensation image corresponding to green component, and the third vertical compensation curve and the third horizontal compensation curve are needed to generate the compensation image corresponding to blue component, respectively.
Fig. 9 shows a flow chart illustrating a method for compensating the uneven color deviation according to an embodiment of present invention.
Referring to Fig. 9, in the step 910, the horizontal compensation curve generating unit 310 analyzes the luminance of the pixels included in the first row of an image. And the vertical compensation curve generating unit 320 analyzes the luminance
of the pixels included in the first column of an image.
In the step 920, a vertical compensation curve and a horizontal compensation curve are generated according to the method described with Fig. 6 and Fig.7 based on the luminance information analyzed in the step 910. The generation of the vertical
compensation curve and the horizontal compensation curve can be performed successively or simultaneously.
The compensation image generating unit 330 generates the compensation image corresponding to the entire image by combining the vertical compensation curve and the horizontal compensation curve in the step 930. The compensation image may have a type shown in Fig. 8(d), and this can be made a type of the lookup table. The compensation unit 340 performs the compensation by applying the compensation image to the image, and compensates the unevenness of color deviation of the image in the step 940.
While the invention has been described with reference to the disclosed embodiments, it is to be appreciated that those skilled in the art can change or modify the embodiments without departing from the scope and spirit of the invention or its
equivalents as stated below in the claims.
[Industrial Applicability]
As described earlier, the apparatus and method for compensating color deviation and the image processor using the apparatus and method according to the present invention can improve uneven color deviation occurring in the image.
And according to an embodiment of present invention, the apparatus and
method for compensating color deviation and the image processor using the apparatus and method can reduce the image distortion caused by the color deviation according to the differences between the properties of each color occurring at the corner of the image. Therefore, an image with neither the color deviation nor distortion though the color correction or gamma conversion may be generated.
It is possible to produce an image sensor module which satisfies the manufacturing demands to be high-pixel, slim and small and outputs the image with even property through the entire image.

Claims

[CLAIMS]
[CLAIM l ]
An apparatus for compensating the color deviation in an image having uneven
color deviation, comprising: a horizontal compensation curve generating unit analyzing a luminance of
pixels included in the first row of the image and generating a horizontal compensation curve according to the luminance; a vertical compensation curve generating unit analyzing a luminance of pixels included in the first column of the image and generating a vertical compensation curve according to the luminance; a compensation image generating unit combining the vertical compensation
curve and the horizontal compensation curve and generating a compensation image according to the entire image; and a compensation unit performing compensation by applying the compensation image to the image.
[CLAIM 2]
The apparatus for compensating the color deviation of claim 1, wherein the
horizontal compensation curve generating unit comprises, a luminance, analyzing unit analyzing luminance of the pixels of the first row; a section dividing unit dividing the pixels into sections having an equal interval; and a compensation value interpolating unit calculating compensation values of the pixels on the edge(boundary) of the section and interpolating compensation values of
other pixels in the section linearly using the compensate value,
wherein the horizontal compensation curve is generated by using the interpolated compensation value.
[CLAIM 3]
The apparatus for compensating the color deviation of claim 2, wherein the horizontal compensation curve generating unit generates two or more horizontal compensation curves having a different interval of the section and generates a final horizontal compensation curve by combining them.
[CLAIM 4]
The apparatus for compensating the color deviation of claim 1, wherein the vertical compensation curve generating unit comprises: a luminance analyzing unit analyzing luminance of the pixels of the first column; a section dividing unit dividing the pixels into sections having an equal interval; and a compensation value interpolating unit calculating compensation values of the pixels on the edge(boundary) of the section and interpolating compensation values of other pixels in the section linearly using the compensate value, wherein the vertical compensation curve is generated by using the interpolated compensation value. [CLAIM 5]
The apparatus for compensating the color deviation of claim 4, wherein the
vertical compensation curve generating unit generates two or more horizontal compensation curves having a different interval of the section and generates a final horizontal compensation curve by combining them.
[CLAIM 6]
The apparatus for compensating the color deviation of claim 1, wherein the compensation image is generated corresponding to red, green and blue colors in the image, respectively.
[CLAIM 7]
The apparatus for compensating the color deviation of claim 1, wherein the vertical compensation curve, the horizontal compensation curve and the compensation image are generated in a lookup table.
[CLAIM 8]
An image processor of an image device which compensates the uneven color
deviation of an image- wherein the image device comprises a sensor unit, the image processor and a display unit- comprising a line processing unit which color-interpolates digital image signals inputted from the sensor unit and generates an image lens shading corrected; a color deviation compensation unit combining a horizontal compensation
curve generated by analyzing the luminance of pixels included in the first row of the
image and a vertical compensation curve generated by analyzing the luminance of pixels included in the first column of the image and generating a compensation image according to the entire image and carrying out the compensation; and a subsequent processing unit processing the data outputted from the color deviation compensation unit to be displayed through the display unit.
[CLAIM 9] The image process of claim 8, wherein the color deviation compensation unit carries out compensation by generating the compensation images corresponding to red, green and blue colors in the image, respectively.
[CLAIM 10]
A method for compensating the color deviation in an image having uneven color deviation, comprising: analyzing a luminance of pixels included in the first row and the first column of the image, respectively; generating a horizontal compensation curve and a vertical compensation curve according to the luminance; generating a compensation image according to the entire image by combining the vertical compensation curve and the horizontal compensation curve; and carrying out the compensation by applying the compensation image to the image.
[CLAIM Il ]
The method for compensating the color deviation of claim 10, wherein the step of analyzing the luminance of pixels included in the first row and the first column of the image, respectively comprises: analyzing the luminance of the pixels of the first row and the first column; dividing the pixels into sections having an equal interval; calculating compensation values of the pixels on the edge(boundary) of the section; interpolating compensation values of other pixels in the section linearly using the compensate value; and repeating the step of interpolating compensation values of other pixels linearly in the section using the compensation value corresponding to all the pixels of the first
row and the first column, wherein the horizontal compensation curve is generated from the interpolated compensation value.
[CLAIM 12]
The method for compensating the color deviation of claim 10, wherein the step of generating a horizontal compensation curve and a vertical compensation curve according to the luminance, generates a final horizontal compensation curve by generating and combining two or more horizontal compensation curves corresponding
to sections having a different interval and a final vertical compensation curve by generating and combining two or more vertical compensation curves corresponding to sections having a different interval, respectively.
[CLAIM 13]
The method for compensating the color deviation of claim 10, wherein the step of analyzing a luminance of pixels included in the first row and the first column of the image to the step of carrying out the compensation by applying the compensation image to the image are performed repetitively for red, green and blue colors in the image to generate the compensation image corresponding to each color.
PCT/KR2006/005847 2005-12-30 2006-12-28 Apparatus and method for compensating hue declination, and image processor using the same WO2007078116A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020050134915A KR100769553B1 (en) 2005-12-30 2005-12-30 Apparatus and method for compensating hue declination, and image processor using it
KR10-2005-0134915 2005-12-30

Publications (1)

Publication Number Publication Date
WO2007078116A1 true WO2007078116A1 (en) 2007-07-12

Family

ID=38228415

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2006/005847 WO2007078116A1 (en) 2005-12-30 2006-12-28 Apparatus and method for compensating hue declination, and image processor using the same

Country Status (2)

Country Link
KR (1) KR100769553B1 (en)
WO (1) WO2007078116A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09130603A (en) * 1995-10-31 1997-05-16 Olympus Optical Co Ltd Shading correction device
US6563537B1 (en) * 1997-07-31 2003-05-13 Fuji Photo Film Co., Ltd. Image signal interpolation
JP2003169255A (en) * 2001-11-30 2003-06-13 Sony Corp Shading correction method
US20040174445A1 (en) * 2003-03-04 2004-09-09 Matsushita Electric Industrial Co., Ltd. Shading correction method and system and digital camera

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3946866B2 (en) 1997-07-31 2007-07-18 富士フイルム株式会社 Image signal processing apparatus and medium storing program
KR20020057526A (en) * 2001-01-05 2002-07-11 엘지전자 주식회사 Method for interpolating image
JP2005175913A (en) 2003-12-11 2005-06-30 Olympus Corp Image processor

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09130603A (en) * 1995-10-31 1997-05-16 Olympus Optical Co Ltd Shading correction device
US6563537B1 (en) * 1997-07-31 2003-05-13 Fuji Photo Film Co., Ltd. Image signal interpolation
JP2003169255A (en) * 2001-11-30 2003-06-13 Sony Corp Shading correction method
US20040174445A1 (en) * 2003-03-04 2004-09-09 Matsushita Electric Industrial Co., Ltd. Shading correction method and system and digital camera

Also Published As

Publication number Publication date
KR100769553B1 (en) 2007-10-23
KR20070071450A (en) 2007-07-04

Similar Documents

Publication Publication Date Title
US8059169B2 (en) Apparatus and method for compensating color, and image processor, digital processing apparatus, recording medium using it
KR100615277B1 (en) Method and apparatus for compensating Image sensor lens shading
JP3824237B2 (en) Image processing apparatus and method, recording medium, and program
US8106976B2 (en) Peripheral light amount correction apparatus, peripheral light amount correction method, electronic information device, control program and readable recording medium
US9055181B2 (en) Solid-state imaging device, image processing apparatus, and a camera module having an image synthesizer configured to synthesize color information
US7626619B2 (en) Digital camera
US7916191B2 (en) Image processing apparatus, method, program, and recording medium
US8284278B2 (en) Image processing apparatus, imaging apparatus, method of correction coefficient calculation, and storage medium storing image processing program
KR20070069449A (en) Lens shading compensation apparatus and method, and image processor using it
CN101335900A (en) Image processing device, image processing method, program, and imaging device
EP3902242B1 (en) Image sensor and signal processing method
KR20030009150A (en) Image signal processing apparatus
US7728881B2 (en) Color signal correcting method, apparatus, and program
WO2007075066A1 (en) Image processor, apparatus and method for lens shading compensation
KR100731812B1 (en) Color deviation compensating apparatus and method, image processor using it, recorded medium
JP2010288093A (en) Image processing apparatus, solid-state imaging apparatus, and electronic information apparatus
US20070024718A1 (en) Image capturing device and image adjusting method thereof
WO2007078116A1 (en) Apparatus and method for compensating hue declination, and image processor using the same
KR100747729B1 (en) Image processor, device for compensating of lens shading and the same method
KR100566571B1 (en) Method and apparatus for auto compensating image sensor lens shading
KR100843624B1 (en) Image processor, apparatus and method for lens shading compensation
JP2003333612A (en) Hue noise filter, solid-state image pickup device, and photographing device
KR20050053143A (en) Image correction method for digital camera
JP2009171378A (en) Image pickup signal processing circuit, image pickup signal processing method, program and imaging apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06835547

Country of ref document: EP

Kind code of ref document: A1