JP2011250276A - Image processing device, image processing method, and imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve a problem in that, in an image including both bright and dark regions, the dark region is sometimes inappropriately adjusted by white-balancing.SOLUTION: An image processing device 200 that processes image data output from an imaging unit 100 comprises: a white balance processing unit 210 which applies a white balance adjustment to the image data; a color adjustment determination unit 220 which determines whether or not to apply a color adjustment to every pixel or every area with a certain size of the image data subjected to the white balance adjustment; a color adjustment unit 230 which, when the color adjustment determination unit 220 determines that color adjustment is necessary, applies the color adjustment to relevant pixels or areas subjected to the white balance adjustment by the white balance processing unit 210. The color adjustment determination unit 220 determines whether or not to apply the color adjustment in accordance with pixel luminance and color deviation.

Description

  The present invention relates to an image processing apparatus and method for processing image data obtained by an image sensor, and an image imaging apparatus including the image processing apparatus, and more particularly to a color adjustment technique suitable for in-vehicle camera applications.

  In general cameras such as digital cameras, a color called white balance is applied to image data obtained by an image sensor (sensor) in order to show the color of the captured image naturally (similar to human eyes). Processing to adjust the taste. Normally, white balance is a dark part composed of pixels with low brightness, such as night images, because the color is adjusted using pixel values (RGB values, etc.) of the pixels of the image data whose brightness is a predetermined value or higher. In the case of an image with many areas, white balance tends to be not performed correctly.

  In the case of an in-vehicle camera, white balance is not correctly performed due to sensor performance and individual differences, and false color noise occurs in a dark area. In addition, when photographing the front of the host vehicle with an in-vehicle camera at night, only the central part of the photographed image is brightened by the light of the headlight, and the periphery of the image becomes a dark part area. Occurs, and the image quality is degraded. That is, in the in-vehicle camera, a false color is generated in a dark area that is not visible around the captured image.

  In Patent Document 1, in an electronic device having a photographing function such as a digital camera or a camera-equipped mobile phone, a process for further correcting the color after white balance is performed on image data obtained by an image sensor. Has been disclosed to obtain an image that reflects the color of the subject in the color environment at the time of shooting, but the bright area and the dark area coexist because of the method of correcting the color of the entire screen. In the case of an image to be printed, the color of the dark area is also adjusted, and an unnatural color may be displayed in the dark area.

  As described above, even if normal white balance is performed, if the entire screen is bright, it can be adjusted to a natural color, but there are bright areas with high luminance and dark areas with low luminance within the entire screen. In the case of coexistence, the color of the dark area is also adjusted to adjust the color of the bright area, and there is a problem that the color component of the dark area, which should originally be black, is gained and colored. It was. In addition, there is a problem that the color of the white balance result becomes unnatural due to individual differences among sensors. This cannot be solved even if the color correction method described in Patent Document 1 is applied.

  In general digital cameras and the like, it is required to faithfully reproduce the color, so image processing is performed so that the color in the dark area remains, but in the in-vehicle camera, the area where the false color is generated cannot be visually recognized. Therefore, it is determined that there is no significant problem even if the color of the pixel in the dark area is eliminated. Even with a simple process of eliminating the color of the pixels in the dark area, a sufficient effect can be obtained in the case of an in-vehicle camera.

  The present invention has been made in view of the above points, and is an image processing apparatus and method suitable for use in an in-vehicle camera and the like, which suppresses the appearance of false color noise in a dark area of an image, and the image processing apparatus. It aims at providing the image pick-up device provided with.

  In order to achieve the above object, according to a first aspect of the present invention, there is provided an image processing apparatus for processing image data obtained by an image sensor, wherein the white balance processing means performs white balance processing on the image data, and the white balance processing means. For the image data that has been subjected to white balance processing in step 1, the color adjustment is performed by the color adjustment determination unit that determines whether or not the color adjustment is performed for each pixel or each region having a certain size, and the color adjustment is performed by the color adjustment determination unit. And a tint adjusting unit that performs tint adjustment on the pixel or region of the image data subjected to white balance processing by the white balance processing unit when it is determined to be necessary.

  According to a second aspect of the present invention, in the image processing apparatus according to the first aspect, the tint adjustment determination unit determines whether or not to perform the tint adjustment from the luminance level of the pixel and the color deviation. To do.

  A third aspect of the present invention is the image processing apparatus according to the first or second aspect, further comprising pixel position information calculating means for calculating position information of pixels on the image, wherein the color adjusting means The degree of color adjustment is changed based on the position information calculated by the information calculation means.

  The invention of claim 4 is the image processing apparatus according to any one of claims 1 to 3, further comprising bright pixel counting means for counting the number of pixels having a luminance of a certain value or more from the entire image, When the count number of the bright pixel counting means is a certain number or more, the color adjustment is not performed by the color adjustment means on the image data subjected to the white balance processing.

  According to a fifth aspect of the present invention, in the image processing apparatus according to any one of the first to third aspects of the present invention, the image processing apparatus further includes an exposure time acquisition unit that acquires an exposure time of the image sensor, and the exposure time acquisition unit acquires the exposure time. When the exposure time is less than a predetermined value, the color adjustment is not performed by the color adjustment means on the image data subjected to the white balance processing.

  According to a sixth aspect of the present invention, in an image processing method for processing image data obtained by an image sensor, a white balance processing process for performing white balance processing on the image data, and an image subjected to white balance processing in the white balance processing process For data, for each pixel or area having a certain size, if it is determined that color adjustment is necessary in the color adjustment determination process for determining whether to perform color adjustment, and the color adjustment determination process, A tint adjustment process for performing tint adjustment on the pixel or region of the image data subjected to the white balance process in the white balance process.

  According to a seventh aspect of the present invention, in the image processing method according to the sixth aspect, in the hue adjustment determination step, it is determined whether or not the color adjustment is performed based on a luminance level and a color deviation of the pixel. To do.

  According to an eighth aspect of the present invention, in the image processing method according to the sixth or seventh aspect, the image processing method further includes a pixel position information calculation process for calculating pixel position information on the image, and the color adjustment process includes the pixel position information. The degree of color adjustment is changed based on the position information calculated in the information calculation process.

  The invention of claim 9 is the image processing method according to any one of claims 6 to 8, further comprising a bright pixel counting step of counting the number of pixels having a luminance of a certain value or more from the entire image, When the count obtained in the bright pixel counting process is a certain number or more, the color adjustment is not performed in the color adjustment process on the image data subjected to the white balance processing. .

  A tenth aspect of the present invention is the image processing method according to any one of the sixth to eighth aspects, further comprising an exposure time acquisition process for acquiring an exposure time of the image sensor, wherein the acquisition is performed in the exposure time acquisition process. If the exposure time is less than a certain value, the color adjustment is not performed in the color adjustment process on the image data subjected to the white balance process.

  The invention according to claim 11 is the imaging unit according to any one of claims 1 to 5, comprising an optical system and an imaging device that converts imaging light obtained through the optical system into image data of an electrical signal. And an image capturing device including a display device that displays image data processed by the image processing device.

  The invention of claim 12 is characterized in that the image pickup apparatus of claim 11 is an in-vehicle camera apparatus.

  According to the image processing apparatus and method of the present invention, for the image after white balance, in order to readjust the color of only a pixel having a low luminance and biased color or an area of a certain size, For an image in which the dark area and the dark area coexist, an unnatural color in the dark area can be suppressed. In addition, by adjusting the degree of color adjustment using the pixel position as a parameter at the time of color adjustment, it is possible to more effectively suppress the unnatural color in the dark area according to the pixel position. Become.

  Therefore, according to the image pickup apparatus including the image processing apparatus of the present invention, it is possible to suppress the false color noise from being noticeable in the dark part of the video. In addition, since the effect is improved by a relatively simple process, it is possible to mount with a reduced hardware circuit scale.

1 is an overall configuration diagram of a first embodiment of the present invention. It is a process flowchart of the color adjustment determination part and color adjustment part in FIG. It is a whole block diagram of the 2nd Example of this invention. It is a process flowchart of the color adjustment determination part and color adjustment part in FIG. It is a whole block diagram of the 3rd Example of this invention. 6 is a process flowchart of a color adjustment determination unit and a color adjustment unit in FIG. 5. It is a whole block diagram of the 4th Example of this invention. It is a process flowchart of the color adjustment determination part and color adjustment part in FIG.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 shows an overall configuration diagram of a first embodiment of the present invention. In FIG. 1, reference numeral 200 denotes an image processing apparatus according to the present invention, and the image processing apparatus 200, the imaging unit 100, and the display apparatus 300 constitute an image imaging apparatus. And this image pick-up device is mounted and used for vehicles as an in-vehicle camera device, for example. The same applies to the cases of Examples 2 to 4 described later.

  Although not shown in FIG. 1, the imaging unit 100 includes an optical system, an imaging element (sensor) such as a CCD or a CMOM, an A / D converter, and the like, and converts imaging light obtained through the optical system into an electrical signal by the sensor. Then, the analog signal of the electric signal is converted into image data of a digital signal by an A / D converter.

  The image processing apparatus 200 takes in image data output from the imaging unit 100 and performs predetermined image processing. The image processing apparatus 200 determines whether to adjust the color of each pixel with respect to the white balance processing unit 210 that adjusts the white balance of the output image data of the imaging unit 100 and the image data after the white balance. A color adjustment determination unit 220; and a color adjustment unit 230 that performs color adjustment on the pixel of the image data after white balance when the color adjustment determination unit 220 determines that the color adjustment is necessary. Have The image processing apparatus 200 further includes an MTF correction unit, a gamma correction unit, and the like, which are omitted in FIG.

  The display device 300 receives image data after predetermined processing output from the image processing device 200, converts it into, for example, an NTSC video signal, and displays it.

  Here, the image processing apparatus 200 includes, for example, a CPU, a ROM, a RAM, and the like. When the CPU executes a program stored in the ROM, the white balance processing unit 210, the color adjustment determination unit 220, the color tone, and the like. The functions of the adjustment unit 230 and other processing units (MTF correction unit, gamma correction unit, etc.) are realized. The RAM is used to store image data being processed, necessary threshold values, parameters, and the like.

  Hereinafter, processing in the color adjustment determination unit 220 and the color adjustment unit 230 in the image processing apparatus 200 will be described in detail. Note that the white balance adjustment processing in the white balance processing unit 210 is the same as the conventional one.

  In order to adjust the color tone in the dark area with respect to the image data after white balance, the color tone adjustment determination unit 220 determines whether the luminance is sufficiently small for each pixel and whether there is a color bias. . When the color adjustment determination unit 220 determines that the luminance is sufficiently low and there is a color bias, the color adjustment unit 230 adjusts the color of the pixel.

  FIG. 2 shows a process flowchart of the color adjustment determination unit 220 and the color adjustment unit 230 in the present embodiment.

The color adjustment determination unit 220 first captures the first pixel of the image data after white balance (step 1001). Then, the sum S of the RGB components of the pixel is calculated (step 1002). That is,
S = (R component value) + (G component value) + (B component value)
Is calculated. The value of S is defined as the degree of brightness of the pixel.

Next, the color adjustment determination unit 220 calculates the component ratio R of each component with respect to the sum S of RGB components (step 1003). Now, assuming that the component ratios of the R component, G component, and B component are Rr, Rg, and Rb, respectively,
Rr = (R component value) / S
Rg = (G component value) / S
Rb = (B component value) / S
It is represented by This component ratio (ratio) is defined as the degree of color deviation.

Subsequently, the color adjustment determination unit 220 determines whether or not to perform color adjustment on the pixel (step 1004). In this embodiment, whether or not to adjust the color of each component (RGB) of the pixel is determined as follows.
S <Ts and Rr> Trr ⇒ adjust the R component S <Ts and Rg> Trg ⇒ adjust the G component S <Ts and Rb> Trb ⇒ adjust the B component where Ts is the brightness threshold . A pixel having S greater than Ts is determined to be a bright pixel, and color adjustment is not performed. Trr is a threshold value of the degree of bias of the R component. When the component ratio Rr of the R component is larger than Trr, it is determined that there is a bias of the R component, and the color of the R component is adjusted under the condition of S> Ts. The target of. The same applies to the G component and the B component. Note that the thresholds Trr, Trg, Trb of the degree of bias of each component are Trr = Trg = Trb.

  When the color adjustment determination unit 220 determines that the color adjustment is to be performed, the color adjustment unit 230 performs the color adjustment of the pixel (step 1005). Here, when it is determined that the R component or the B component is subjected to the color adjustment, the color adjustment is performed by setting the value of the R component or the B component to be the same as the value of the G component. . In addition, when it is determined that the G component performs the color adjustment, the color adjustment is performed by halving the value of the G component.

  On the other hand, when it is not determined that the color adjustment is performed by the color adjustment determination unit 220, the color adjustment unit 230 ends the process without doing anything for the pixel. That is, the process of step 1005 is skipped.

  Next, the color adjustment determination unit 220 determines whether the processing of all the pixels has been completed for the image data after white balance (step 1006). If the processing for all pixels is not completed, the color adjustment determination unit 220 takes in the next pixel (step 1007) and executes the processing of steps 1002 to 1004 again. In addition, the color adjustment unit 230 executes the color adjustment processing in Step 1005 when the color adjustment determination unit 220 determines that the color adjustment is performed.

  By performing the processes of the color adjustment determination unit 220 and the color adjustment unit 230 for all the pixels of the image data after white balance, the color adjustment is performed only for pixels with low luminance and color bias. It will be. Therefore, an unnatural color of the dark area after white balance can be suppressed for an image in which a bright area and a dark area coexist.

  Here, although all the RGB components are subject to color adjustment, the G component may not be subjected to color adjustment. In this case, it is not necessary to calculate the composition ratio of the G component. The conditions for determining whether or not to adjust the color of the R component and the B component are the same as described above. In addition, a pixel that is determined to be subjected to color adjustment is adjusted in color by making the component value (R or B component) to be adjusted the same as the value of the G component.

  FIG. 3 shows an overall configuration diagram of the second embodiment of the present invention. In FIG. 3, the difference from the previous FIG. 1 is that the image processing apparatus 200 further includes a bright pixel counter unit 240. The other configuration is the same as in FIG. The bright pixel counter unit 240 receives the image data after white balance output from the white balance processing unit 210 and counts the number of pixels having a luminance of a certain value or more from the entire screen (one frame). . The luminance may be the previous S value. The color adjustment determination unit 220 does not perform the color adjustment determination process when the count value in the bright pixel counter unit 240 is equal to or greater than a certain value. In this case, the color adjustment unit 230 does not perform the color adjustment process.

  FIG. 4 shows a process flowchart of the color adjustment determination unit 220 and the color adjustment unit 230 in this embodiment. In FIG. 4, the difference from FIG. 2 is that step 1000 is added. Except this, it is exactly the same as FIG.

  Prior to capturing pixels of image data after white balance, the color adjustment determination unit 220 determines whether the count number of the bright pixel counter unit 240 is equal to or greater than a certain number (step 1000). If the count number of the bright pixel counter unit 240 is equal to or greater than a certain number, the process is terminated at that time. On the other hand, the process proceeds to step 1001 only when the count number of the bright pixel counter unit 240 is less than a certain number. The processing after step 1001 is the same as that in FIG.

  According to the present embodiment, when the whole image is bright, the image data after white balance is output as it is, so that it is possible to make the color of the photographed image look natural.

  Note that the color adjustment unit 230 determines whether or not the count number of the bright pixel counter unit 240 is equal to or greater than a certain number. If the count number is equal to or greater than the certain number, the white balance processing is performed regardless of the determination result in the color adjustment determination unit 220. The image data subjected to white balance adjustment by the unit 210 may be output as it is.

  FIG. 5 shows an overall configuration diagram of the third embodiment of the present invention. In FIG. 5, the difference from the previous FIG. 1 is that the image processing apparatus 200 further includes an exposure time acquisition unit 250. The other configuration is the same as in FIG. The exposure time acquisition unit 250 acquires the exposure time of the sensor (imaging device) of the imaging unit 100. The exposure time reflects the brightness of the subject. When the exposure time of the sensor acquired by the exposure time acquisition unit 250 is a predetermined value or less, the color adjustment determination unit 220 does not perform the color adjustment determination process. In this case, the color adjustment unit 230 does not perform the color adjustment process.

  FIG. 6 shows a process flowchart of the color adjustment determination unit 220 and the color adjustment unit 230 in this embodiment. In FIG. 6, the difference from the previous FIG. 2 is that step 1000 'is added. Except this, it is exactly the same as FIG.

  The color adjustment determination unit 220 determines whether or not the exposure time of the sensor acquired by the exposure time acquisition unit 250 is equal to or less than a predetermined number before capturing the pixels of the image data after white balance (step 1000 ′). If the exposure time of the sensor acquired by the exposure time acquisition unit 250 is equal to or less than a certain value, the process is terminated at that time. On the other hand, the process proceeds to step 1001 only when the exposure time of the sensor acquired by the exposure time acquisition unit 250 is equal to or greater than a certain value. The processing after step 1001 is the same as that in FIG.

  Also in this embodiment, when the whole image is bright, the image data after white balance is output as it is, so that it is possible to make the color of the photographed image look natural.

  In the present embodiment as well, the tint adjustment unit 230 determines whether the exposure time of the sensor acquired by the exposure time acquisition unit 250 is equal to or less than a certain value. Regardless of the determination result, the image data subjected to white balance adjustment by the white balance processing unit 210 may be output as it is.

  FIG. 7 shows an overall configuration diagram of the fourth embodiment of the present invention. In FIG. 7, the difference from the previous FIG. 1 is that the image processing apparatus 200 further includes a pixel position information calculation unit 260. The other configuration is the same as in FIG.

  The pixel position information calculation unit 260 calculates the position information of each pixel of the image data obtained by the imaging unit 100. In general, the imaging unit 100 includes a synchronization signal generator that generates a horizontal / vertical synchronization signal and a clock signal, and reads image data from a sensor in synchronization with the horizontal / vertical synchronization signal and the clock signal. The pixel position information calculation unit 260 takes in the horizontal / vertical synchronization signal and the clock signal from the synchronization signal generator in the imaging unit 100, and calculates the position information of each pixel of the image data. In the case of a configuration in which a synchronization signal generator is externally attached, it may be taken in from the synchronization signal generator.

  If the color adjustment determination unit 220 determines that the color adjustment is performed on the target pixel, the color adjustment unit 230 adjusts the color of the pixel. At this time, the pixel position information calculation unit 260 The degree of color adjustment is changed based on the position information calculated in step (1). For example, the saturation of the color is lowered as the pixel is farther from the center of the image.

  FIG. 8 is a process flowchart of the color adjustment determination unit 220 and the color adjustment unit 230 in the present embodiment.

The color adjustment determination unit 220 first captures the first pixel of the image data after white balance adjusted by the white balance processing unit 210 (step 2001). Then, the sum S of each component (R, G, B) of the pixel is calculated (step 2002), and the component ratio R (Rr, Rg, Rb) of each component is calculated (step 2003). As described above, these values are obtained as follows.
S = (R component value) + (G component value) + (B component value)
Rr = (R component value) / S
Rg = (G component value) / S
Rb = (B component value) / S
Here, S represents the degree of brightness of the pixel, and Rr, Rg, and Rb represent the bias of each component of the pixel.

Subsequently, the color adjustment determination unit 220 performs threshold processing on the calculated values of S and Rr, Rg, and Rb, and determines whether or not to perform color adjustment for the pixel (step 2004). Here, the threshold value for S is Ts, the threshold values for Rr, Rg, and Rb are Trr, Trg, and Trb, respectively, and the determination conditions are obtained as follows. Note that Trr = Trg = Trb.
(1) When S <Ts and Rr> Trr, the R component is left as it is, and the G component and the B component are adjusted.
(2) When S <Ts and Rg> Trg, the G component is left as it is, and the R component and the B component are adjusted.
(3) In the case of S <Ts and Rb> Trb, the B component is left as it is, and the R component and the G component are adjusted.

  When the color adjustment determination unit 220 determines that the color adjustment is performed, the color adjustment unit 230 adjusts the color of the pixel according to the determination condition. In this case, in this embodiment, the color is adjusted using the position information on the image of the pixel calculated by the pixel position information calculation unit 260 as a parameter (step 2005). For example, a process of lowering the color saturation for a pixel farther from the center of the image is performed.

  Hereinafter, the color adjustment processing in the color adjustment unit 230 will be described in detail by taking as an example the case where the determination condition (1) is satisfied. The processing when the determination conditions (2) and (3) are satisfied can be similarly analogized.

Now, in the case where the maximum component is the R component and the minimum component is, for example, the B component among the RGB components of the pixel for which the color adjustment is performed, the G component and the B component other than the maximum R component are
G_delta ← D x (R component + B component)
B_delta ← D x (R component + B component)
G component ← G component + G_delta
B component ← B component + B_delta
However, D = (| X−width / 2 | + | Y−height / 2 |) / (| X−width / 2 | + | Y−height / 2 |)
The color is adjusted with (X, Y) as the pixel position, width = pixel width, and height = image height. Thereby, the saturation of the pixel can be reduced.

  Here, D is a parameter indicating a distance from the center of the image, and takes a value of 0 to 1. D = 0 indicates the center of the image, and in this case, the saturation does not change. D = 1 indicates the farthest distance from the image center. In this case, the saturation is close to zero. That is, by performing the above calculation, the saturation of the pixels near the center of the image is not reduced so much, and the saturation can be decreased as the distance from the center of the image increases.

By the way, with the above calculation, the luminance of the pixel after adjustment of the G and B components increases. Therefore, in order to set the luminance to a value before adjustment, the luminance Y ′ is calculated from the RGB values after adjustment of the G and B components, and the luminance of the RGB values before adjustment is set as Y.
dY ← Y'-Y
R component ← R component-dY
G component ← G component-dY
B component ← B component-dY
And correct. Thereby, it is possible to reduce the saturation without increasing the luminance value of the pixel for which the color adjustment is performed.

  Returning to FIG. 8, when it is not determined that the color adjustment is performed by the color adjustment determination unit 220, the color adjustment unit 230 ends the process without doing anything for the pixel. That is, step 2005 is skipped.

  Next, the color adjustment determination unit 220 determines whether or not the processing for all the pixels has been completed for the image data after white balance (step 2006). If the processing for all pixels is not completed, the color adjustment determination unit 220 fetches the next pixel (step 2007) and executes the processing of steps 2002 to 2004 again. If the color adjustment determination unit 220 determines that the color adjustment is to be performed, the color adjustment unit 230 performs the color adjustment processing in step 2005.

  By performing the processes of the color adjustment determination unit 220 and the color adjustment unit 230 for all the pixels of the image data after white balance, as in the first embodiment, the luminance is small and the color deviation is small. Color adjustment is performed only for certain pixels. Furthermore, in this embodiment, when performing color adjustment, the degree of color adjustment can be changed using the pixel position as a parameter. Therefore, it is possible to more effectively suppress the unnatural color of the dark area after white balance depending on the pixel position for an image in which the bright area and the dark area coexist.

  Note that the color adjustment is performed by setting the R or B component value to be the same as the G component value or the G component value according to the determination condition for the pixel for which the color adjustment is performed, as in the first embodiment. Can be halved. In this case, by multiplying the value by D, the degree of color adjustment can be similarly changed according to the position of the pixel on the image.

  Further, if the bright pixel counter unit 240 in FIG. 3 or the exposure time acquisition unit 250 in FIG. 5 is further added to the configuration in FIG. 7, the white balance is adjusted when the entire image is bright, as in the second and third embodiments. It becomes possible not to perform the color adjustment for the subsequent image data.

  In the description so far, the determination of the color adjustment and the color adjustment are performed for each pixel with respect to the image data after white balance, but an area having a certain size (m × n pixels). It may be done every time. In this case, for example, the average value of each pixel included in the region may be used as S of the RGB sum and the component ratios (bias) Rr, Rg, Rb of each component. In addition, the color adjustment may be performed for each pixel included in the area.

DESCRIPTION OF SYMBOLS 100 Image pick-up part 200 Image processing apparatus 210 White balance process part 220 Tint adjustment determination part 230 Tint adjustment part 240 Bright pixel counter part 250 Exposure time acquisition part 260 Pixel position information calculation part 300 Display apparatus

International Publication WO2005 / 041588

Claims (12)

In an image processing apparatus that processes image data obtained by an image sensor,
White balance processing means for performing white balance processing on the image data;
Color adjustment determination means for determining whether or not to perform color adjustment for each pixel or area having a certain size for the image data subjected to white balance processing by the white balance processing means;
When it is determined that the color adjustment is necessary by the color adjustment determination means, a color adjustment means for adjusting the color of the pixel or region of the image data subjected to white balance processing by the white balance processing means;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the color adjustment determination unit determines whether to perform color adjustment based on a luminance level of a pixel and a color deviation. Pixel position information calculating means for calculating pixel position information on the image;
The image processing apparatus according to claim 1, wherein the color adjustment unit changes a degree of color adjustment based on the position information calculated by the pixel position information calculation unit. It further has a bright pixel counting means for counting the number of pixels having a luminance of a certain value or more from the entire image,
2. The color adjustment by the color adjustment unit is not performed on the image data subjected to the white balance processing when the count number of the bright pixel counting unit is a certain number or more. 4. The image processing device according to any one of items 1 to 3. Further comprising an exposure time acquisition means for acquiring an exposure time of the image sensor;
When the exposure time acquired by the exposure time acquisition unit is a predetermined value or less, the color adjustment is not performed by the color adjustment unit on the image data subjected to the white balance processing. The image processing apparatus according to claim 1. In an image processing method for processing image data obtained by an image sensor,
A white balance process for performing white balance processing on the image data;
A color adjustment determination process for determining whether or not to perform color adjustment for each pixel or an area having a certain size for the image data subjected to white balance processing in the white balance processing process;
When it is determined that the color adjustment is necessary in the color adjustment determination process, a color adjustment process for performing color adjustment on the pixel or region of the image data subjected to the white balance process in the white balance process;
An image processing method comprising:   The image processing method according to claim 6, wherein in the color adjustment determination process, it is determined whether to perform color adjustment based on a luminance level of a pixel and a color deviation. A pixel position information calculation process for calculating pixel position information on the image;
8. The image processing method according to claim 6, wherein in the color adjustment process, a degree of color adjustment is changed based on the position information calculated in the pixel position information calculation process. A bright pixel counting process for counting the number of pixels having a luminance of a certain value or more from the entire image;
When the count obtained in the bright pixel counting process is a certain number or more, the color adjustment is not performed in the color adjustment process on the image data subjected to the white balance processing. The image processing method according to claim 6. Further comprising an exposure time acquisition step of acquiring an exposure time of the image sensor;
When the exposure time acquired in the exposure time acquisition process is a predetermined value or less, the color adjustment is not performed in the color adjustment process on the image data subjected to the white balance process. The image processing method according to claim 6. An imaging unit having an optical system and an imaging element that converts imaging light obtained through the optical system into image data of an electrical signal;
The image processing apparatus according to any one of claims 1 to 5,
A display device for displaying image data processed by the image processing device;
An image pickup apparatus comprising:   The image capturing apparatus according to claim 11, wherein the image capturing apparatus is an in-vehicle camera apparatus.

Images