JP7479831B2 - Imaging device, control method thereof, and program - Google Patents

Description

The present invention relates to an imaging apparatus and a control method and program thereof, and in particular to correction of the luminance of image data when the luminance of the image data is equal to or exceeds a predetermined threshold value.

Conventionally, various techniques have been known for imaging devices such as digital cameras to obtain images with appropriate brightness corresponding to any subject. For example, when a person's face is present within the imaging area (photographing screen), the face area detected by face detection is determined to be the main subject, and the imaging device automatically adjusts the focus, white balance, exposure, etc. so that the face area has appropriate brightness. Patent Document 1 proposes a technique for generating a photometric value for exposure control by weighting the photometric value of the part recognized as a face and the photometric value of the entire screen in a digital camera.

In addition to elements such as brightness and color, light also has a property called polarization. Polarization can be thought of as the vibration direction of light, and it is known that light emitted from a light source has various vibration direction components (polarization direction) when reflected by a subject. However, in reality, polarized and non-polarized light are all combined before reaching the human eye, so humans have few opportunities to sense the polarization direction of light. Meanwhile, there is known technology that suppresses unnecessary reflected light by controlling the polarization angle of light, for example by using a PL (Polarized Light) filter.

In recent years, technologies have been proposed that actively utilize this polarized component. For example, Patent Document 1 proposes a technology in which not only a color filter but also a polarizer is placed on top of specific pixels of the multiple light receiving elements that make up a CCD sensor. Patent Document 2 also proposes a technology in which polarizing filters with different polarization angles are inserted into the optical path of a digital camera. For example, the technology in Patent Document 2 discloses that it is possible to obtain an image from which specular reflection has been removed by obtaining images with different polarization angles for each region of the image sensor and combining these at any ratio.

JP 2014-11754 A JP 2016-10063 A

For example, when using the technology disclosed in Patent Document 1 or Patent Document 2 to synthesize images acquired through filters with different polarization angles at an arbitrary ratio, if an image acquired at a certain polarization angle becomes saturated, the brightness of the synthesized image may not be reproduced correctly. Furthermore, in a configuration in which polarizing filters are arranged in accordance with RGB color filters, if only the output from a pixel with a specific polarization angle and a specific color (such as a G pixel) is saturated, there is a risk that color reproducibility will also decrease.

The objective of the present invention is to prevent images with unnatural brightness from being acquired, even when multiple images are acquired using different polarization angles.

In order to solve the above-mentioned problems, the imaging device of the present invention has an imaging element that captures an optical image of a subject obtained through a polarizing filter having an area having a plurality of different polarization angles, a calculation means that calculates polarization information of the subject based on a plurality of image data for different polarization angles output from the imaging element, a judgment means that judges whether the luminance of at least one of the plurality of image data is equal to or greater than a predetermined threshold, and a luminance correction means that corrects the luminance of the image data based on a result of the judgment by the judgment means, wherein the imaging element has color filters of a plurality of colors arranged to match the areas of the polarizing filter, and the judgment means judges whether the luminance of at least two of the plurality of image data for the different polarization angles output from the imaging element through a first color filter of the color filters is equal to or greater than the predetermined threshold, and the luminance correction means corrects the luminance of the plurality of images obtained through the first color filter based on polarization information of the subject based on a plurality of image data obtained through a second color filter of a different color from the first color filter based on the result of the judgment by the judgment means.

According to the present invention, even when multiple images are acquired using different polarization angles, it is possible to prevent images with unnatural brightness from being acquired.

1 is a block diagram illustrating a configuration of an image pickup apparatus 100 according to a first embodiment of the present invention. 2 is a diagram illustrating an example of the relationship between pixels and polarizing filters of a sensor 102 according to the first embodiment of the present invention. FIG. 1A and 1B are diagrams illustrating exemplary distribution diagrams obtained by plotting pixel signal levels according to the polarization angle of a corresponding pixel according to the first embodiment of the present invention. FIG. 2 is a diagram for illustrating an example of a weighted averaging method according to the first embodiment of the present invention. 10 is a diagram for explaining an example of an angle-dependent component of the polarization angle in a state where the luminance value of a pixel at a given polarization angle θ is saturated; FIG. 5 is a flowchart showing an image synthesis process for each polarization angle according to the first embodiment of the present invention. 10A and 10B are diagrams illustrating an example of the relationship between the pixels of a sensor 102, polarizing filters, and color filters according to a second embodiment of the present invention. 10 is a diagram illustrating an example of an angle-dependent component of the polarization angle in a saturated state of luminance values at two or more different polarization angles θ. FIG. 13 is a flowchart showing an image synthesis process for each polarization angle according to the second embodiment of the present invention.

First Embodiment
(Basic configuration of the imaging device 100)
A preferred embodiment of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is a block diagram for explaining the configuration of an image pickup apparatus 100, which is a first embodiment of an image pickup apparatus embodying the present invention. One or more of the functional blocks shown in FIG. 1 may be realized by hardware such as an ASIC or a programmable logic array (PLA). They may also be realized by a programmable processor (microprocessor, microcomputer) such as a CPU or MPU executing software. They may also be realized by a combination of software and hardware. Therefore, even if different functional blocks are described as operating subjects in the following description, the same hardware may be realized as the subject.

The optical lens 101 is an imaging optical system that includes a focus lens, a shift lens, a zoom lens, an aperture, etc. (not shown) and guides a light beam representing an optical image of a subject into the imaging device 100, and can focus light on the imaging surface of the sensor 102 (described later).

The sensor 102 is an imaging means that employs a charge-storage type solid-state imaging element such as a CMOS that can receive the light beam of the subject guided by the optical lens 101 and convert it into an electrical image signal. In the imaging device 100, it is possible to change the sensitivity (light receiving sensitivity) when converting the optical image corresponding to the light beam of the subject into an electrical signal. The brightness of the image signal can be adjusted by adjusting this light receiving sensitivity and the amount of digital gain after conversion into an image signal. In this embodiment, these are collectively referred to as the shooting sensitivity, and in the imaging device 100, this shooting sensitivity can be adjusted by changing the ISO sensitivity.

The sensor 102 has a polarizing filter on each pixel, and the polarization angle of the polarizing filter is at least three different angles. Details of the sensor 102 having this polarizing filter will be described with reference to FIG. 2. FIG. 2 is a diagram illustrating an example of the relationship between the pixels and the polarizing filter of the sensor 102 according to the first embodiment of the present invention. The sensor 102 has a polarizing filter on each pixel, and the polarization angle of the polarizing filter is at least three different angles. Details of the sensor 102 having this polarizing filter will be described with reference to FIG. 2.

As shown in FIG. 2, the sensor 102 has a partial region 201 in which, for example, 16 pixels (4 consecutive vertical pixels × 4 consecutive horizontal pixels) form one pixel group, and polarizing filters with polarization angles of 0°, 45°, 90°, and 135° are regularly arranged to match each pixel. Note that the arrangement of the polarization angles is not limited to this, but it is preferable to regularly arrange the polarizing filters because this reduces the processing load when obtaining image data for each polarization angle. In addition, polarization angles other than the four angles described above may be used. Therefore, when the partial region 201 is used as a reference, the sensor 102 can obtain pixel outputs (image signals) captured at four polarization angles.

Returning to FIG. 1, the image acquisition unit 103 is an image acquisition means that acquires the output of the sensor 102 as image data. Based on the output of the sensor 102, the image data for each polarization angle is output to the polarization calculation unit 104. In addition, the image data for recording is output to the image processing unit 105.

The image processing unit 105 is an image processing means that executes various processes such as arbitrary synthesis processing using image data corresponding to each polarization angle, de-Bayer processing, gamma correction, etc. As a specific example of synthesis processing, image data of an arbitrary polarization angle is selected and output based on the judgment result by the polarization calculation unit 104 described later. Alternatively, image data of one frame in which the degree of reflection in the image data is arbitrarily adjusted can be generated by performing a weighted average and outputting the image data of each polarization angle. Then, after performing synthesis processing, the image processing unit 105 can perform predetermined image processing such as the above-mentioned de-Bayer processing, gamma correction, knee correction, noise reduction, etc. Note that in this embodiment, the various processes performed on the image data output to the signal output unit 106 are not limited to these, and other processes may be performed.

The signal output unit 106 is a signal output means that outputs the image signal input from the image processing unit 105 to a storage means (including an external storage medium) not shown, and outputs image data for display to a display unit not shown.

The polarization calculation unit 104 is a calculation means (polarization information acquisition means) that calculates the polarization angle corresponding to the subject included in the imaging range based on the image data output from the image acquisition unit 103, and can acquire the polarization information of the subject. Specifically, the polarization calculation unit 104 calculates the signal level of the pixel according to the above four polarization angles, with four pixels corresponding to 0°, 45°, 90°, and 135° as one set, based on the signal output from the pixel corresponding to the polarizing filter of each polarization angle. Here, the unit of the brightness value is 1BV in the so-called APEX (ADDITIVE SYSTEM OF PHOTOGRAPHIC EXPOSURE) system, which is one step of the brightness value, but the brightness value may be expressed using other units.

Figure 3 is an exemplary diagram illustrating a distribution diagram obtained by plotting pixel signal levels according to the polarization angle of a corresponding pixel according to the first embodiment of the present invention. As shown in Figure 3, in this embodiment, the function (fitting curve) I(θ) obtained based on image data of multiple polarization angles can be expressed as a sine function or cosine function with a period of 180°, and the larger the amplitude of the curve, the higher the degree of polarization.

If the luminance value of one pixel for each of three or more polarization angles is known, the function I(θ) can be calculated by applying an optimization technique such as the least squares method. In this embodiment, in order to obtain a more accurate fitting curve, the polarization angles to be sampled are spaced apart to a certain extent, and sampling images are obtained at four polarization angles spaced 45° apart.

Based on the function I(θ) shown in FIG. 3, it can be seen that, for example, the minimum luminance value of a set of pixels used to calculate the fitting curve is located after a polarization angle of 135°, and the maximum luminance value is located between polarization angles of 45° and 90°. In this way, by determining the function I(θ), it is possible to calculate a luminance value according to the polarization angle.

Returning to FIG. 1, the camera control unit 107 is a control means that controls each unit of the imaging device 100 in an integrated manner, and includes a microprocessor (CPU) (not shown), and is connected to a ROM (Read Only Memory) and a RAM. The ROM is a non-volatile storage element in which programs for operating the camera control unit 107 and various adjustment parameters are recorded. Programs read from the ROM are deployed in the volatile RAM and executed. Note that, in this embodiment, the camera control unit 107 controls the operation of each unit described above, but the configuration may also be such that each unit other than the camera control unit 107 cooperates to control each operation.

The processes controlled by the camera control unit 107 include, for example, a correction process (brightness value correction process) for the luminance value of each pixel calculated by the polarization calculation unit 104. Another process controlled by the camera control unit 107 is a weighted averaging process at the time of synthesis for images corresponding to each polarization angle, based on the luminance value of each pixel calculated by the polarization calculation unit. The weighted averaging process will be described with reference to FIG. 4.

Figure 4 is a diagram for explaining an example of the weighted average processing method according to the first embodiment of the present invention, where Figure 4(a) shows a state in which the reflection of the water surface in the subject image is suppressed, and Figure 4(b) shows a state in which the reflection of the water surface is emphasized. It is assumed that the luminance value for each polarization angle of the subject in each diagram of Figure 4 changes according to the function I(θ) shown in Figure 3 described above.

As shown in FIG. 4(a), in order to suppress the reflection of light on the water surface, it is necessary to suppress the polarization component of the subject that corresponds to the reflected light. For example, in the function I(θ) shown in FIG. 3, the luminance value is highest near the polarization angle θ = 45°, and lowest near the polarization angle θ = 135°. Therefore, by reducing the weighting of the output signal corresponding to the polarization angle θ = 45° and increasing the weighting of the output signal corresponding to the polarization angle θ = 135°, the degree of reflection on the water surface can be suppressed in the image after the pixel outputs of each polarization angle are combined.

On the other hand, there are cases where it is desired to leave (or emphasize) the polarization components of the subject that correspond to the reflected light in the image, for example to check the degree of reflection on the water surface. For example, the example shown in FIG. 4(b) shows a case where a landscape image is acquired in which the reflection on the water surface is emphasized. In this case, the weighting of the output signal corresponding to a polarization angle θ = 45° is greater than the weighting of the output signal corresponding to a polarization angle θ = 135°, and the pixel outputs of each polarization angle are combined to obtain the image that the user desires.

Here, when performing the weighted averaging process described above, the luminance value of a particular polarization angle may become saturated, for example, when the luminance value of a particular object is high. FIG. 5 is a diagram illustrating an example of the angle-dependent component of the polarization angle when the luminance value of a pixel at a particular polarization angle θ is saturated. In the example illustrated in FIG. 5, the luminance value of one pixel corresponding to a polarization angle that falls within a particular range centered on a polarization angle of 45° becomes saturated. In this case, if the saturated pixel is used for synthesis as is, there is a risk that an image with an unnatural brightness compared to the actual brightness of the object may be obtained. Therefore, in this embodiment, this problem is solved by performing luminance value correction based on the function I(θ) on the image signal (output signal) corresponding to the saturated polarization angle.

Figure 6 is a flowchart showing the image synthesis process for each polarization angle according to the first embodiment of the present invention. As shown in Figure 6, first, in step S601, the polarization calculation unit 104 calculates the luminance values of a set of pixels (four pixels) each having a different polarization angle, and detects the luminance value of one pixel for each polarization angle.

Next, in step S602, the polarization calculation unit 104 calculates the angle-dependent component of the polarization angle based on the luminance value (output) of one pixel for each polarization angle calculated in step S601. Specifically, in this embodiment, the above-mentioned function (fitting curve) I(θ) is calculated as the angle-dependent component of the polarization angle. Note that a maximum luminance value Imax and a minimum luminance value Imin may also be calculated from the function I(θ), and the difference between the two may be calculated as the angle-dependent component of the polarization angle of the subject. In this case, the difference Imax-Imin indicates the degree of reflection in the subject, so it is also possible to determine whether or not a subject with a high degree of reflection exists based on the angle-dependent component of the polarization angle.

Next, in step S603, the camera control unit 107 determines whether the luminance value detected in step S601 has reached a saturation level (whether it is equal to or greater than a predetermined threshold). Note that the predetermined threshold for determining the saturation level is stored in advance in a memory (not shown) provided in the imaging device 100.

If it is determined that the luminance value of none of the pixels has reached the saturation level (NO in step S603), the process proceeds to step S605, where the camera control unit 107 performs weighted averaging processing at an arbitrary ratio using the output signals of each pixel. Note that the arbitrary ratio described above is stored in advance in a memory (not shown) provided in the imaging device 100.

If it is determined that there is a pixel whose luminance value has reached the saturation level (YES in step S603), the process proceeds to step S604, where the camera control unit 107 corrects the luminance value of the pixel whose luminance value has reached the saturation level (performs luminance value correction processing). For example, as shown in FIG. 5, if the luminance level of a pixel with a polarization angle θ = 45° has reached the saturation level, the actual luminance value cannot be detected.

However, as described above, in this embodiment, since the function I(θ) is calculated as the angle-dependent component of the polarization angle, the luminance value at the polarization angle θ=45° can be predicted based on the function I(θ). In other words, the luminance value of a pixel at a polarization angle that has reached the saturation level can be calculated based on the luminance values of pixels at other polarization angles (θ=0°, 90°, 135°). Therefore, in the process of step S604 according to this embodiment, the luminance value of the saturated pixel is corrected based on the function I(θ), and the weighted averaging process of step S605 is performed on the saturated pixel using the corrected luminance value.

With the configuration described above, the imaging device 100 according to this embodiment can reduce the unnatural brightness of the image obtained after combining pixels of each polarization angle by calculating (predicting) the pixel output of a saturated polarization angle from the pixel output of an arbitrary polarization angle. In other words, the imaging device 100 according to this embodiment can prevent the acquisition of an image with unnatural brightness even when acquiring multiple images with different polarization angles.

Second Embodiment
Next, an imaging device according to a second embodiment of the present invention will be described with reference to Figures 7 to 9. Note that since the configuration of the imaging device 100 is the same as that of the first embodiment described above, a description thereof will be omitted, and only the differences from the first embodiment will be described.

In the first embodiment described above, a configuration was described in which the luminance value of a pixel that has reached the saturation level is corrected using the luminance value of a pixel that corresponds to another polarization angle. However, for example, if the luminance values of multiple pixels that correspond to different polarization angles are saturated, the luminance value correction may not be performed correctly. For example, in the first embodiment described above, if the luminance values of two or more pixels among the pixels that correspond to four polarization angles are saturated, the function I(θ) cannot be calculated, and therefore the luminance value correction process cannot be performed correctly. Therefore, in the imaging device 100 according to the second embodiment of the present invention, the luminance level of a pixel that has reached the saturation level is corrected based on the luminance value of the pixel output through a different color filter.

Figure 7 is a diagram illustrating an example of the relationship between the pixels, polarizing filters, and color filters of the sensor 102 according to the second embodiment of the present invention. Note that the configuration other than the color filters is substantially the same as that of the sensor 102 illustrated in Figure 2. As illustrated in Figure 7, the same color filters are arranged for every four pixels (two consecutive vertical pixels x two consecutive horizontal pixels) with different polarization angles for the sensor 102. In this embodiment, as illustrated in Figure 7, a color filter R is arranged to match the top four pixels of the sensor 102, which is arranged in a vertical four pixels x horizontal four pixels. In addition, color filters Gb and Gr are arranged to match the bottom four pixels and the top right four pixels. And a color filter B is arranged to match the bottom four pixels. That is, the sensor 102 according to this embodiment is equipped with a so-called Bayer array color filter to match four pixel units corresponding to different polarization angles.

Therefore, when the partial area 201 of the sensor 102 described above is used as a reference, pixel output (image signal) captured at four polarization angles for each color filter (not shown) can be obtained, and an image signal can be obtained for each polarization angle that combines the R, Gr, Gb, and B color components.

Figure 8 is a diagram illustrating an example of the angle-dependent component of the polarization angle in a saturated state of brightness values at two or more different polarization angles θ. In the example illustrated in Figure 8, it is assumed that two of the G pixels (Gr, Gb) are saturated. In order to calculate the function IG(θ) for the G pixel, pixel outputs for three or more different polarization angles are required, but because two pixel outputs (brightness values) are saturated, the function IG(θ) cannot be calculated correctly.

Here, compared to the G pixel, the R pixel and the B pixel have a characteristic that they are less sensitive to light and are less likely to saturate. Therefore, in the imaging device 100 according to this embodiment, when the luminance value of the G pixel reaches the saturation level, the luminance level of the G pixel is calculated based on the angle-dependent components IR(θ) and IB(θ) of the R pixel and the B pixel that correspond to the same polarization angle.

Figure 9 is a flowchart showing the image synthesis process for each polarization angle according to the second embodiment of the present invention. Note that the processes in steps S901 to S903 and step S907 in Figure 9 are substantially the same as the processes in steps S601 to S603 and step S605 in the first embodiment described above, so explanations will be omitted.

If it is determined that there is a pixel whose brightness value has reached the saturation level (YES in step S903), the process proceeds to step S904. Then, in step S904, the camera control unit 107 determines whether or not there are multiple pixels whose brightness value has reached the saturation level in a set of pixels (i.e., a group of pixels obtained with the same color filter). In this embodiment, pixel outputs corresponding to four different polarization angles are obtained for one color filter, so it is determined whether or not the brightness levels of half or more of these pixels (i.e., two pixels) have reached the saturation level.

If it is determined that the luminance values of only a predetermined number of pixels (one in this embodiment) in one pixel group have reached the saturation level (NO in step S904), proceed to step S906. If it is determined that the luminance values of multiple pixels (two in this embodiment) in one pixel group have reached the saturation level (YES in step S904), proceed to step S905. Note that the process in step S906 is substantially the same as the process in step S604 in the first embodiment described above, and therefore will not be described here.

In step S905, when the luminance value of one pixel output through an arbitrary color filter is saturated, the camera control unit 107 calculates (corrects) the luminance value of the saturated pixel based on the angle-dependent component of the polarization angle based on the luminance value of the pixel output through another color filter. For example, as shown in FIG. 8, assume that the luminance value of the G pixel based on the polarization angle θ = 45° has reached the saturation level. In this case, the luminance value of the pixel corresponding to the polarization angle at which the G pixel has reached the saturation level is calculated based on the function IR (θ) or function IB (θ) obtained based on the luminance value of the pixel corresponding to the R pixel or B pixel. Note that the weighted averaging process after the luminance correction process is substantially the same as the first embodiment described above, so a description thereof will be omitted.

With the configuration described above, the imaging device 100 according to this embodiment can calculate (predict) saturated pixel outputs based on pixel outputs obtained through other color filters when multiple pixel outputs obtained through any color filter are saturated. Therefore, even when images obtained at multiple different polarization angles are saturated, the imaging device 100 according to this embodiment can reduce the unnatural brightness of the image obtained after combining the pixels of each polarization angle. In other words, the imaging device 100 according to this embodiment can suppress the acquisition of images with unnatural brightness even when multiple images are acquired using different polarization angles.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these, and various modifications and variations are possible within the scope of the gist of the present invention. For example, in the above-described embodiment, an imaging device with an integrated optical lens was described, but a configuration that employs a lens-interchangeable imaging device in which so-called interchangeable lenses can be attached and detached may also be used.

In addition, in the above-described embodiment, a configuration was described in which the degree of weighting for images with different polarization angles was adjusted, but for example, a configuration in which the weighting for the output of saturated pixels is set to 0 so that saturated pixels are not used in image synthesis may be used.

In addition, in the above-described embodiment, an example was described in which a polarizing filter with a different polarization angle was used for each pixel and pixel group constituting the sensor 102, but the present invention is not limited to this. For example, the sensor 102 in each of the above-described embodiments may be configured to have a polarizing filter so that multiple different polarization angles correspond to one pixel. In this case, since one pixel signal can be polarized through different polarization angles, it is possible to obtain image data in which light other than that in multiple vibration directions is removed on a pixel-by-pixel basis.

In the above embodiment, a digital camera has been described as an example of an imaging device for implementing the present invention, but the present invention is not limited to this. For example, imaging devices other than digital cameras, such as portable devices such as digital video cameras and smartphones, wearable devices, in-vehicle cameras, and security cameras, may be used.

100 Imaging device 102 Sensor 104 Polarization calculation unit 107 Camera control unit

Claims (4)

an image sensor that captures an optical image of a subject through a polarizing filter having areas with a plurality of different polarization angles;
a calculation means for calculating polarization information of an object based on a plurality of image data for different polarization angles output from the image sensor;
a determination means for determining whether or not a luminance of at least one of the plurality of image data is equal to or greater than a predetermined threshold value;
a luminance correction unit that corrects the luminance of the image data based on a result of the determination by the determination unit;
having
the imaging element is provided with color filters of a plurality of colors arranged in accordance with the area of the polarizing filter,
the determining means determines whether or not luminance of at least two of the plurality of image data for each of the different polarization angles output from the imaging element through a first color filter of the color filters is equal to or greater than the predetermined threshold value;
The imaging device is characterized in that, based on the result of judgment by the judgment means, when the luminance of at least two image data obtained through the first color filter is equal to or greater than the predetermined threshold, the luminance correction means corrects the luminance of the multiple images obtained through the first color filter based on polarization information of the subject based on multiple image data obtained through a second color filter of a different color from the first color filter . The polarization information is an angle-dependent component with respect to a polarization angle of an object,
the calculation means calculates the angle-dependent component based on luminance of pixels corresponding to three or more different polarization angles;
The imaging device according to claim 1 , characterized in that the luminance correction means corrects the luminance of the first image data based on the angle-dependent component when first image data exists whose luminance is equal to or greater than the predetermined threshold value. 1. A method for controlling an image capture device having an image capture element that captures an optical image of a subject through a polarizing filter having areas with a plurality of different polarization angles, comprising:
a calculation step of calculating polarization information of an object based on a plurality of image data for different polarization angles output from the image sensor;
a determination step of determining whether or not a luminance of at least one image data item among the plurality of image data items is equal to or greater than a predetermined threshold value;
a luminance correction step of correcting the luminance of the image data;
having
the imaging element is provided with color filters of a plurality of colors arranged in accordance with the area of the polarizing filter,
In the determination step, it is determined whether or not the luminance of at least two of the plurality of image data for each of the different polarization angles output from the imaging element through a first color filter of the color filters is equal to or greater than the predetermined threshold value;
A method for controlling an imaging device, characterized in that in the brightness correction process, when the brightness of at least two image data obtained through the first color filter is equal to or greater than the predetermined threshold based on the result of the judgment in the judgment process, the brightness of the multiple images obtained through the first color filter is corrected based on polarization information of the subject based on multiple image data obtained through a second color filter of a different color from the first color filter . A computer-readable program for causing a computer to execute the method for controlling an image pickup apparatus according to claim 3 .

Images