JP7039262B2 - Imaging device, its control method, and control program - Google Patents

Description

The present invention relates to an image pickup device, a control method thereof, and a control program, and more particularly to an image pickup device using an image pickup element such as a CMOS image sensor.

Generally, in an image pickup device such as a digital camera, an image pickup element such as a CMOS sensor having a plurality of pixels in which optical filters (hereinafter referred to as color filters) having different light transmittances for each wavelength are arranged to reproduce colors is used. Has been done.

For example, as a color filter, a filter that transmits only a specific wavelength according to the absorption spectrum of a material (dye, pigment, etc.) using a color-colored layer such as green (G), blue (B), or red (R) is used. There is. And these color filters are Bayer-arranged.

When light is transmitted through such a color filter, it is possible to obtain an image signal including color information by color separation into light having three wavelengths of green, blue, and red. Then, the pixel signal, which is the output of the image pickup device, is image-processed according to the output value of each color (R, G, and B), and color reproduction is performed.

When manufacturing the above-mentioned image sensor, the output value of each color may inevitably vary depending on the image sensor, and therefore the output value of each color is adjusted. One of the adjustments is gain correction.

In the gain correction, it is used to obtain an appropriate output for a predetermined reference light source or to make the color ratio of each color an appropriate ratio to the reference light source. That is, the output value is adjusted by multiplying the gain for each color by the image processing circuit.

By the way, the color filter has a temperature dependence (temperature change coefficient) in which the light transmittance (transmittance) for each wavelength depends on the temperature.

HOYA CANDEO OPTRONICS Co., Ltd. 2014 "Color Filter Glass" Catalog Page 5 https: // www. hoyacandeo. co. jp / Japanese / products / eo_pdf / catalog_j. pdf

However, in the color filter, since the materials (dye, pigment, etc.) used for each color are different, the temperature change with respect to the absorption spectrum is different. Therefore, the temperature dependence (temperature coefficient of variation) differs depending on each color.

Therefore, even if the output value is adjusted to be the reference color at the reference temperature (for example, 20 ° C.), the spectral wavelength transmitted for each color may shift depending on the temperature. Therefore, it may not be possible to reproduce colors properly.

Furthermore, if the temperature at which the output value is adjusted is not the reference temperature, the output value after adjustment may deviate, and an appropriate color ratio may not be obtained at the reference temperature.

Therefore, an object of the present invention is to provide an image pickup apparatus capable of stably performing color reproduction by reducing the influence of the usage environment such as the environmental temperature, a control method thereof, and a control program.

In order to achieve the above object, the image pickup apparatus according to the present invention includes a plurality of unit pixels arranged in a two-dimensional matrix and an optical filter arranged corresponding to each of the plurality of unit pixels. An image pickup device in which a unit pixel has an image pickup element that receives an optical image via the optical filter, and the image pickup element outputs an image signal corresponding to the optical image, and is arranged in association with the unit pixel. Each of the optical filters corresponds to each of a plurality of colors, and the spectral transmission rate of the optical filter changes according to the temperature, and the detection means for detecting the temperature of the image pickup element to obtain the detection temperature and the detection temperature. Based on the above , with respect to the pixel output which is the output of the unit pixel, the optical filter of another color due to the deviation from the pixel output corresponding to the optical filter of the reference color among the plurality of colors. It is characterized by having a correction means for correcting the pixel output corresponding to the above .

According to the present invention, it is possible to stably reproduce colors by reducing the influence of the usage environment such as the environmental temperature.

It is a block diagram which shows the structure of the example of the image pickup apparatus according to 1st Embodiment of this invention. It is a figure which shows the structure of the example of the image pickup device shown in FIG. It is a figure for demonstrating an example of the spectral transmittance in the pixel shown in FIG. FIG. 2 is a diagram for explaining an example of a pixel output of each color and a temperature change of a color ratio according to the pixel output when an image is acquired with a specific brightness in a predetermined light source (for example, B light source) in the image sensor shown in FIG. Is. It is a flowchart for demonstrating an example of a shooting operation performed by the camera shown in FIG. 1. It is a figure for demonstrating the correction effect by the temperature correction process shown in FIG. It is a flowchart for demonstrating adjustment in a manufacturing process in the camera by 2nd Embodiment of this invention. It is a figure for demonstrating the correction target value for every temperature in the camera by the 2nd Embodiment of this invention.

Hereinafter, an example of the image pickup apparatus according to the embodiment of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing a configuration of an example of an image pickup apparatus according to the first embodiment of the present invention.

The illustrated image pickup device is, for example, a digital camera (hereinafter, simply referred to as a camera), and has a photographing lens unit (hereinafter, simply referred to as a photographing lens) 100. An optical image is formed on the image pickup surface of the image pickup element 101 via the photographing lens 100. Then, the image pickup device 101 outputs an electric signal (analog signal) corresponding to the optical image. The image sensor 101 is, for example, a CMOS image sensor.

A diaphragm 214 and a shutter 215 are arranged between the photographing lens 100 and the image pickup element 101. The aperture 214 is used for adjusting the amount of light.

The analog signal, which is the output of the image sensor 101, is sent to the analog signal processing circuit (AFE) 104. The analog signal processing circuit 104 performs correlation double sampling processing, signal amplification, reference level adjustment, A / D conversion processing, and the like on the analog signal output from the image pickup element 101, and outputs a digital signal. The digital signal processing circuit 105 performs digital signal processing such as reference level adjustment on the digital signal that is the output of the analog signal processing circuit 104.

The image processing circuit 106 includes a Raw image correction unit 203 and a development processing unit 204. The Raw image correction unit 203 performs image processing such as offset correction, gain correction, and defect correction on the digital signal output from the digital signal processing circuit 105 based on the correction data recorded in the memory circuit 107. ..

The development processing unit 204 performs development processing on the digital signal corrected by the Raw image correction unit 203 based on other information (for example, gamma information, color temperature information, white balance information, filtering information, etc.). Output image data.

In the Raw image correction unit 203, offset correction and gain correction are performed for each color, and correction can be performed so that the balance for each color changes by these processes.

Adjustment data, correction data, correction calculation coefficients, and the like are recorded in advance in the memory circuit 107. Image data or the like output from the image processing circuit 106 is recorded in the recording circuit 108. The memory circuit 107 is, for example, a non-volatile memory, and the recording circuit 108 is a recording medium such as a memory card.

The control circuit 109 controls the entire camera. The operation circuit 110 receives an operation of an operation member (not shown) provided in the camera, and sends a command corresponding to the operation to the control circuit 109. The operation member includes, for example, a shooting preparation start switch SW1, a shooting start switch SW2, a still image shooting / moving image shooting switching switch, a single shooting / continuous shooting switching switch, and the like.

The display circuit 111 displays an image obtained by shooting, a live view image, various setting screens, and the like under the control of the control circuit 109.

The camera is provided with a temperature detection unit (Temp) 205, and the temperature in the vicinity of the image pickup device 101 is detected by the Temp 205. In the illustrated example, Temp 205 is placed in the vicinity of the image sensor 101 to detect a temperature that correlates with the temperature of the image sensor 101. The image sensor 101 may be provided with Temp 205.

FIG. 2 is a diagram showing the configuration of an example of the image pickup device shown in FIG. 1. 2 (a) is a cross-sectional view of a unit pixel, and FIG. 2 (b) is a view of a plurality of pixels viewed from above.

With reference to FIG. 2A, the image pickup device 101 has a plurality of unit pixels (hereinafter, simply referred to as pixels) arranged in a two-dimensional matrix, and the pixels are one microlens (ML). It has 102, a color filter 103, a wiring layer 301, and a photodiode (PD) 201 which is a photoelectric conversion unit.

FIG. 2B shows a top view of the image pickup element 101 when viewed from the side of the photographing lens 100. In the illustrated example, the four pixels shown in FIG. 2A are two-dimensionally shown. It is arranged. However, in reality, the arrangement shown in FIG. 2B is repeated, and the image pickup device 101 has, for example, several thousand pixels × several thousand pixels (for example, 6000 pixels × 4000 pixels).

In the example shown in FIG. 2B, a red filter is used as the color filter 103 for the upper left pixel (hereinafter, this pixel is referred to as an R pixel). A green filter is used as the color filter 103 for each of the upper right and lower left pixels (hereinafter, these pixels are referred to as G1 pixel and G2 pixel, respectively). A blue filter is used as the color filter 103 in the lower right pixel (hereinafter, this pixel is referred to as a B pixel), and these R pixels, G1 pixels, G2 pixels, and B pixels are Bayer-arranged.

As described above, the spectral transmittance of the color filter arranged at least in a part of the pixel is different from the spectral transmittance of the color filter arranged in the rest of the pixel.

FIG. 3 is a diagram for explaining an example of the spectral transmittance in the pixel shown in FIG. 2. FIG. 3 (a) is a diagram showing the spectral transmittance at room temperature (for example, 20 ° C.), which is a reference temperature, and FIG. 3 (b) is a diagram showing spectral transmittance at a temperature higher than the reference temperature (for example, 40 ° C.). It is a figure which shows the rate. Further, FIG. 3C is a diagram showing the spectral transmittance at a temperature lower than the reference temperature (for example, 0 ° C.).

As shown in FIGS. 3A to 3C, the B pixel is output in the short wavelength region, the G pixel (G1 and G2 pixels) is output in the medium wavelength region, and the R pixel is output in the long wavelength region at all temperatures. Will be higher. That is, it has sensitivity. As the temperature rises, as shown in FIG. 3 (b), the spectral transmittance shifts to a longer wavelength side than the distribution shown in FIG. 4 (a). The amount of wavelength shift differs depending on the color.

Here, assuming that the wavelength shift amount of the B pixel is ΔBh, the shift amount of the G pixel is ΔGh, and the shift amount of the R pixel is ΔRh, the color filter characteristic is assumed to be ΔBh> ΔGh> ΔRh.

Further, when the temperature becomes low, as shown in FIG. 3 (c), the spectral transmittance shifts to a shorter wavelength side than the distribution shown in FIG. 4 (a). The wavelength shift amount also differs depending on the color.

Here, assuming that the wavelength shift amount of the B pixel is ΔBl, the shift amount of the G pixel is ΔGl, and the shift amount of the R pixel is ΔRl, it is assumed that the color filter characteristic is ΔBl> ΔGl> ΔRl.

Therefore, the temperature dependence (ΔλT) of the spectral transmittance λ corresponding to the color filter of each color is expressed by the following equation (1).
ΔλT (B)> ΔλT (G)> ΔλT (R) (1)

FIG. 4 illustrates an example of the temperature change of the pixel output of each color and the color ratio according to the pixel output when an image is acquired with a specific luminance in a predetermined light source (for example, B light source) in the image sensor shown in FIG. It is a figure to do. 4 (a) is a diagram showing the pixel output of each color, and FIG. 4 (b) is a diagram showing the temperature change of the color ratio.

First, referring to FIG. 4A, when the reference temperature Tstd is set to 20 ° C., the output of the G pixel is the highest at the reference temperature. Then, the output is lower in the order of the B pixel and the R pixel. When the temperature changes from the reference temperature Tstd, the spectroscopy shifts to the long wavelength side at a high temperature with the temperature change.

As a result, the output difference between the B pixel and the R pixel becomes small, and in the illustrated example, a phenomenon occurs in which the outputs of the B pixel and the R pixel are inverted in the vicinity of 40 ° C.

On the other hand, when the temperature changes to a low temperature, the spectroscopy shifts to a shorter wavelength side than the reference temperature, so that the output of the B pixel tends to increase and the output of the R pixel tends to decrease. In the illustrated example, although it is difficult to understand, the output of the G pixel also changes according to the temperature, and the output tends to decrease at a high temperature.

Subsequently, with reference to FIG. 5 (b), FIG. 5 (b) shows the output ratio (R / G) between the R pixel and the G pixel and the output ratio (B / G) between the B pixel and the G pixel. Is shown as an example of standardizing with a color ratio of a reference temperature Tstd, and here, a change in the color ratio with temperature is shown.

From the reference temperature Tstd (20 ° C.), the R / G tends to be high and the B / G tends to be low at high temperatures, while the R / G tends to be low and the B / G tends to be high at low temperatures. That is, the slope mg of the output change due to the temperature of the G pixel, the slope mr of the output change due to the temperature of the R pixel, and the slope mb of the output change due to the temperature of the B pixel are different from each other.

Therefore, the value obtained by multiplying the temperature change ΔT from the reference temperature Tstd by the slopes mg, mr, and mb of the temperature change is the output deviation. As a result, the color ratio changes according to the change in temperature.

FIG. 5 is a flowchart for explaining an example of a shooting operation performed by the camera shown in FIG.

The control circuit 109 starts the shooting operation when the shooting preparation start switch SW1 is turned on. Then, the control circuit 109 detects the temperature Temp in the vicinity of the image pickup device 101 by the Temp 205 (step S501).

Subsequently, the control circuit 109 obtains a temperature correction coefficient for canceling the output change for each color due to the temperature described in FIG. 4 based on the detected temperature detected by Temp 205. Then, the control circuit 109 stores the temperature correction coefficient in a predetermined area of the memory circuit 107 as the temperature correction data of the pixel output corresponding to each color (step S502).

For example, the control circuit 109 has temperature correction data G (g), G (r), and temperature correction data G (g), G (r) of each color based on the reference temperature Tstd stored in advance, the slopes mg, mr, and mb due to the temperature change of each color and the detection temperature Temp. G (b) is obtained by the following equations (2) to (4).
Temperature correction data of G pixel G (g) = (Temp-Tstd) × mg (2)
R pixel temperature correction data G (r) = (Temp-Tstd) × mr (3)
B pixel temperature correction data: G (b) = (Temp-Tstd) × mb (4)

It should be noted that, by turning on SW1, the known photometric operation, distance measurement operation, focus adjustment operation, and the like are performed in addition to the processes of steps S501 to S502 described above, but they are not directly related to the present invention and will be described here. Omit.

Next, the control circuit 109 determines whether or not the shooting operation start switch SW2 is turned on (step S503). When SW2 is OFF (NO in step S503), the control circuit 109 determines whether or not SW1 is OFF (step S504). When SW1 is ON (NO in step S504), the control circuit 109 returns to the process of step S501. On the other hand, when SW1 is OFF (YES in step S504), the control circuit 109 ends the photographing operation.

When SW2 is turned ON (YES in step S503), the control circuit 109 accumulates a charge corresponding to the optical image in the image pickup device 102 (step S505). Here, the control circuit 109 controls the aperture 214 and the shutter 215 to form an optical image on the image pickup element 101 via the photographing lens 100.

As a result, the optical image is received by the PD 201 via the ML 102, the color filter 103 of each color, and the wiring layer 301.

Subsequently, the control circuit 109 performs a read operation to read out the electric charge accumulated in the image pickup device 101 (that is, PD201) (step S506). In step S506, the analog signal output of the image pickup element 101 is subjected to A / D conversion processing in the analog signal processing circuit 104, and then the reference level is adjusted in the digital signal processing circuit 105.

Next, the control circuit 109 controls the image processing circuit 106 and performs offset correction for correcting the offset component of the digital signal by the Raw image correction unit 203 (step S507). For example, in order to correct the offset caused by the characteristics of each column in the image sensor 101, the deviation amount is measured in advance, and the offset correction data for canceling the deviation amount is stored in the memory circuit 107. Then, the image processing circuit 106 reads the offset correction data from the memory circuit 107 and performs offset correction.

The offset amount may be measured using the OB (optical black) region, which is a light-shielding pixel region provided in the image sensor 101, and the offset amount may be corrected by correcting the deviation amount from the reference value.

Next, the control circuit 109 controls the image processing circuit 106 to perform gain correction at the reference temperature Tstd (step S508). Here, gain correction is performed in order to suppress output variations due to variations in the output circuit, analog signal processing circuit 104, and digital signal processing circuit 105 provided in the image pickup element 101 and variations in the output of each color at the reference temperature. Will be.

Therefore, the deviation amount (variation in output) is measured in advance, and the gain correction data for canceling the variation in the output is stored in the memory circuit 107. Then, the image processing circuit 106 reads the gain correction data from the memory circuit 107 and performs gain correction.

Next, the control circuit 109 controls the image processing circuit 106 and uses the temperature correction data G (g), G (r), and G (b) to correct the output change component due to the temperature with respect to the output of each color. (Step S509). Here, the image processing circuit 106 corrects the output of each color and changes the balance of the correction value with respect to the pixel output for each color.

As a result, the output is the same as the output of each pixel at the reference temperature Tstd regardless of the detected temperature, so that the ratio for each color can be corrected to be the same regardless of the temperature.

FIG. 6 is a diagram for explaining a correction effect by the temperature correction process shown in FIG. 6 (a) is a diagram showing the temperature correction of the output of the G pixel, and FIG. 6 (b) is a diagram showing the temperature correction of the output of the R pixel. Further, FIG. 6C is a diagram showing temperature correction of the output of the B pixel.

In the illustrated example, the output at the reference temperature Tstd and the output change before and after the temperature correction at the detected temperature Temp are shown. The pixel outputs Gin, Rin, and Bin before temperature correction at the detection temperature Temp are multiplied by the correction data G (g), G (r), and G (b) for each output of each color. As a result, it can be seen that the output is corrected to almost the same output as that taken at the reference temperature Tstd.

Subsequently, the control circuit 109 controls the image processing circuit 106 to perform development processing on the image signal (Raw output) whose temperature has been corrected by the development processing unit 204 (step S510). Here, the development processing unit 204 converts the Raw output into YUV and performs development processing such as gamma correction, color temperature correction, white balance correction, and filtering processing. Further, the development processing unit 204 performs a compression process of compressing the image data into a JPEG format or the like.

Next, the control circuit 109 stores the image data (for example, a JPEG image) and the image signal (Raw image) in the recording circuit 108 (step S511). Then, the control circuit 109 ends the photographing operation.

In the above example, the temperature is corrected for each color at the stage of the Raw image. This has the advantage that in the subsequent image processing, for example, when correcting the color temperature of the subject, it is possible to avoid complicating the correction parameters considering the environmental temperature and the color temperature. .. However, if there is no limitation such as securing the memory capacity, the temperature correction coefficient processing may be performed at the time of the image processing in the subsequent stage.

Further, in the above example, the temperature is detected and the temperature correction data is obtained by the inclination and the temperature change, but the process is not limited to such a process. For example, the temperature correction data table corresponding to the detected temperature may be recorded in the memory circuit 107, and the temperature correction data may be selected from the temperature correction data table according to the detected temperature.

Further, in the above example, the output of each color is corrected. On the other hand, for example, in order to correct only the deviation of the color ratio, the color ratio coefficient for correcting the output of other colors (for example, R pixel and B pixel) due to the deviation from the reference color (for example, G pixel) is used. You may make a correction in preparation for it.

In addition, in the above example, the Raw output before the development process is temperature-corrected, but it may be any as long as it suppresses the temperature change of the spectral transmittance for each color. Therefore, not limited to Raw output, temperature correction may be performed by output correction (for example, white balance correction) for each color in the development process.

[Modification example]
By the way, in general, a camera is provided with various drive modes. For example, there are a drive mode for shooting only one shot such as still image (single shot) shooting and a drive mode for continuously shooting such as moving image or continuous shooting.

In the case of continuous shooting such as movie shooting, the temperature may gradually rise due to the heat generated by the image sensor driven, and the temperature correction data may be switched during movie recording. However, since the temperature changes gradually, there is no sense of discomfort between the adjacent frames due to the change in color due to the temperature change. On the other hand, when the temperature correction data is switched, the change due to the temperature correction of the adjacent frame is conspicuous at the time of switching, which may give a sense of discomfort.

Therefore, correction due to temperature change may be performed for still images (single shooting, shooting for each frame), and control may be performed so that temperature correction is not performed for moving images or continuous shooting that are continuous shooting. Such control is performed by the control circuit 109 according to the drive mode set by the operation circuit 110.

As described above, in the first embodiment of the present invention, color reproduction can be faithfully performed regardless of the temperature change of the image pickup device.

In the above-described embodiment, the image sensor including the color filters of a plurality of colors has been described. However, even when the optical filter of a single color is provided, the same applies as long as the spectral transmittance changes according to the temperature. The present invention can be applied to the above.

[Second Embodiment]
Subsequently, an example of the camera according to the second embodiment of the present invention will be described. The configuration of the camera and the configuration of the image sensor are the same as those of the first embodiment.

In the above-mentioned first embodiment, the correction according to the temperature change with respect to the reference temperature Tstd has been described. On the other hand, in the camera, adjustments are made to absorb individual variations so that the color ratio becomes appropriate at the reference temperature Tstd. In this adjustment, in the manufacturing process, adjustment is performed so that an appropriate pixel output of each color can be obtained under a reference light source.

However, in the manufacturing process, it is difficult to adjust the reference temperature due to the heat generated by the camera itself and the environmental temperature of the adjusting device because other adjustments are also made. Therefore, if the temperature at the time of adjustment deviates from the reference temperature, the reference adjustment value (adjustment value at the reference temperature Tstd) may deviate and proper adjustment may not be possible.

FIG. 7 is a flowchart for explaining adjustment in the manufacturing process in the camera according to the second embodiment of the present invention.

When the control circuit 109 detects that the adjustment tool is attached to the camera, the control circuit 109 starts the adjustment. First, the drive mode is set to the adjustment mode in the camera (step S701). Here, it is set so that the temperature correction described in the first embodiment is not performed.

Subsequently, a reference light source for adjustment (for example, B light source) is set (step S702). Then, an appropriate output value of each color at the reference temperature Tstd is stored as an adjustment target value in a memory (not shown) provided in the adjustment tool (step S703).

Subsequently, the control circuit 109 detects the temperature by Temp 205 (step S704). The control circuit 109 performs adjustment target value correction for reselecting a value suitable for the detection temperature as a target value from the adjustment targets set in advance according to the temperature change of the pixel output of each color (step S705). Then, the control circuit 109 stores the correction value (correction target value) of the adjustment target value in the memory provided in the adjustment tool.

FIG. 8 is a diagram for explaining a correction target value for each temperature in the camera according to the second embodiment of the present invention. 8 (a) is a diagram showing the correction target value of the G pixel, and FIG. 8 (b) is a diagram showing the correction target value of the R pixel. Further, FIG. 8C is a diagram showing a correction target value of the B pixel.

As shown in the figure, for the pixel output of each color, the target value is gradually switched according to the temperature to obtain the correction target value (adjustment target value). Here, the reference target value is modified according to the detected temperature obtained in step S704 described above. That is, the correction target value set in step S705 becomes the adjusted output target value, and the pixel output adjusted according to the correction target value can reproduce an appropriate color at the reference temperature Tstd.

With reference to FIG. 7 again, the control circuit 109 accumulates electric charges in the image pickup device 101 in the same manner as in the process of step S505 described above (step S706). Then, the control circuit 109 reads out the electric charge in the same manner as in step S506 described above (step S707).

Subsequently, the control circuit 109 controls the image processing circuit 106 to obtain a difference from the correction target value (adjustment target value) for the pixel output of each color and generate an adjustment value (correction value) (step S708). Here, the image processing circuit 106 obtains the correction gain at which the pixel output of each color is the correction target value as the adjustment data.

Next, the control circuit 109 records the adjustment data in the memory circuit 107 (step S709). Then, the control circuit 109 ends the adjustment operation. The above adjustment data is used as correction data for correcting the pixel output of each color at the time of shooting.

As described above, in the second embodiment of the present invention, even when the detected temperature deviates from the reference temperature during the adjustment in the manufacturing process or the like, the deviation of the adjustment data with respect to the reference temperature can be suppressed. As a result, color reproduction can be faithfully performed regardless of the temperature change of the image sensor.

Although the present invention has been described above based on the embodiments, the present invention is not limited to these embodiments, and various embodiments within the range not deviating from the gist of the present invention are also included in the present invention. ..

For example, the function of the above embodiment may be used as a control method, and the image pickup apparatus may be made to execute this control method. Further, a program having the functions of the above-described embodiment may be used as a control program, and the control program may be executed by a computer included in the image pickup apparatus. The control program is recorded on, for example, a computer-readable recording medium.

[Other embodiments]
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

101 Image sensor 103 Optical filter (color filter)
104 Analog Signal Processing Circuit (AFE)
105 Digital Signal Processing Circuit (DFE)
106 Image processing circuit 109 Control circuit 200 Unit pixel 201 Photodiode (PD)
205 Temperature detector (Temp)

Claims (12)

An image pickup device including a plurality of unit pixels arranged in a two-dimensional matrix and an optical filter arranged corresponding to each of the plurality of unit pixels, and the unit pixels receive an optical image via the optical filter. The image pickup device is an image pickup device that outputs an image signal corresponding to the optical image.
Each of the optical filters arranged in correspondence with the unit pixel corresponds to each of a plurality of colors.
The spectral transmittance of the optical filter changes depending on the temperature,
A detection means that detects the temperature of the image sensor and obtains the detection temperature,
Based on the detection temperature, with respect to the pixel output which is the output of the unit pixel, the other colors due to the deviation from the pixel output corresponding to the optical filter of the reference color among the plurality of colors. A correction means for correcting the pixel output corresponding to the optical filter ,
An imaging device characterized by having. The image pickup apparatus according to claim 1 , wherein the optical filter includes a first filter that transmits red, a second filter that transmits green, and a third filter that transmits blue. .. The image pickup apparatus according to claim 2, wherein the correction means corrects the pixel output for each color based on the temperature detected by the detection means. The image pickup apparatus according to claim 3, wherein the unit pixels are arranged in a Bayer array. The image pickup apparatus according to claim 3 or 4, wherein the correction means corrects the ratio of each color of the pixel output to a predetermined reference light to a predetermined ratio. It has a storage means for storing correction data corresponding to the temperature, and has a storage means.
Any of claims 3 to 5, wherein the correction means selects the correction data from the storage means based on the detection temperature and corrects the pixel output according to the selected correction data. The image pickup apparatus according to item 1. The claim is characterized in that the correction means obtains correction data for correcting the pixel output based on a predetermined reference temperature and a slope indicating a change in the pixel output due to a change in temperature with respect to the reference temperature for each color. Item 6. The image pickup apparatus according to any one of Items 3 to 5. The image pickup apparatus according to any one of claims 3 to 5, wherein the correction means corrects a target value indicating a pixel output for each color at a predetermined reference temperature based on the detection temperature. .. The image pickup apparatus according to any one of claims 3 to 8, wherein the correction means corrects the pixel output before the image signal which is the output of the image pickup element is developed. It has a first mode for shooting each frame and a second mode for continuously shooting frames, and when the first mode is selected, the correction means is controlled to output the pixels. The image pickup apparatus according to any one of claims 3 to 9, further comprising a control means for performing the correction. An image pickup device including a plurality of unit pixels arranged in a two-dimensional matrix and an optical filter arranged corresponding to each of the plurality of unit pixels, and the unit pixels receive an optical image via the optical filter. The method for controlling an image pickup device, wherein the image pickup element outputs an image signal corresponding to the optical image.
Each of the optical filters arranged in correspondence with the unit pixel corresponds to each of a plurality of colors.
The spectral transmittance of the optical filter changes depending on the temperature,
A detection step of detecting the temperature of the image sensor to obtain the detected temperature,
Based on the detection temperature, with respect to the pixel output which is the output of the unit pixel, the other colors due to the deviation from the pixel output corresponding to the optical filter of the reference color among the plurality of colors. A correction step for correcting the pixel output corresponding to the optical filter ,
A control method characterized by having. An image pickup device including a plurality of unit pixels arranged in a two-dimensional matrix and an optical filter arranged corresponding to each of the plurality of unit pixels, and the unit pixels receive an optical image via the optical filter. A control program used in an image pickup device that outputs an image signal corresponding to the optical image of the image pickup device.
Each of the optical filters arranged in correspondence with the unit pixel corresponds to each of a plurality of colors.
The spectral transmittance of the optical filter changes depending on the temperature,
The computer included in the image pickup device
A detection step of detecting the temperature of the image sensor to obtain the detected temperature,
Based on the detection temperature, with respect to the pixel output which is the output of the unit pixel, the other colors due to the deviation from the pixel output corresponding to the optical filter of the reference color among the plurality of colors. A correction step for correcting the pixel output corresponding to the optical filter ,
A control program characterized by executing.

Images