JP2000324505A - Image input device and lens for exchange - Google Patents

Abstract

PROBLEM TO BE SOLVED: To correct deterioration of sensitivity and fluctuation of hue due to shading or a reduced peripheral light by controlling the gain for every color component in an image signal in accordance with lens information and a distance from the center of an image pickup surface. SOLUTION: The image signal generated by a CCD imaging device 11 is digitized by an A/D converting part 14 and supplied to a gain control part 15 and, then, gain is controlled for ever color component. The gain control part 15 fetches the image signal in accordance with the positions of the respective pixels of the device 11. Then the gain control part 15 calculates the cumulative value of the distance L from the center of the image pickup surface at every image signal corresponding to each pixel and calculates the controlled variable of gain through the use of the cumulative value and the value of a coefficient which is supplied from a coefficient calculating part 23. Besides, the control part 15 controls the gain for every color component of the image signal by the calculated gain controlled variable. That is, the gain is controlled for every color component of each image signal in accordance with the lens information and the distance from the center of the image pickup surface.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image capturing apparatus having an image pickup device with an on-chip microlens for capturing an optical image of a subject and generating a color image signal composed of a plurality of color components, and the image capturing apparatus. The present invention relates to an interchangeable lens mounted on an apparatus.

[0002]

2. Description of the Related Art Conventionally, there is an interline type CCD image pickup device provided with an on-chip microlens in order to suppress a deterioration in sensitivity due to a decrease in aperture ratio. FIG. 5 is a diagram showing an example of a cross-sectional view of such a CCD image sensor. In the figure, a CCD image sensor 100
, A light receiving unit 101 for converting light into electric charges is formed for each pixel, and a transfer unit 102 for transferring electric charges generated in each light receiving unit 101 is formed. Further, the CCD image sensor 100
In the above, on the upper surface of each light receiving unit 101, a color filter 103 stained with red R, green G, and blue B is formed, and on the upper surface of each color filter 103, a condenser lens is formed for each pixel. On-chip micro lens 10
4 are arranged.

Incidentally, such a CCD image pickup device 10
In an electronic camera equipped with a camera lens 0, the amount of incident light from the photographing lens is limited by a stop, and an optical image is formed on the light receiving unit 101 via the on-chip micro lens 104. Such an optical image is photoelectrically converted to generate an image signal composed of RGB color components. However, the signal level of the image signal generated in this way changes as shown in FIG. 6 according to the aperture value, due to the chromatic aberration of the on-chip micro lens 104 and the like, in accordance with the aperture value. That is, the RG of the image signal
The ratio (corresponding to hue) of each color component of B fluctuates according to the aperture value.

For this reason, in an electronic camera equipped with a CCD image pickup device having the characteristics shown in FIG. 6, if the photographic lens is stopped after performing auto white balance in the open state, the B component and the R component are excessively adjusted. And the entire image has a reddish color (B <G <R). In FIG. 6, when the aperture value is small, each of the RGB color components shows a relationship of “R <G <B”. Such a magnitude relationship of each color component depends on the characteristic (pixel or pixel) specific to the CCD image sensor. It depends on the size of the light receiving unit and the height, curvature, refractive index, etc. of the on-chip micro lens.

[0005] Further, the fluctuation of the ratio (corresponding to the hue) of each color component of RGB depends on the position of the exit pupil of the photographing lens and the CCD.
It also occurs when the number of light rays incident on the on-chip microlens 104 from an oblique direction increases according to the distance from the image pickup device 100 (hereinafter, referred to as “exit pupil distance”). Accordingly, the present applicant has filed an application for outputting an image signal having an accurate hue by correcting the ratio of the color stimulus values of the image signal even when the aperture value or the exit pupil distance of the photographing lens changes. (JP-A-8-6599 and JP-A-8-223587).

[0006]

By the way, it is known that in a CCD image sensor, shading occurs in which peripheral pixels have lower light receiving efficiency than central pixels. For example, in a pixel at the center of the CCD image sensor 100, a light beam incident on the on-chip micro lens 104 is incident from a vertical direction as shown in FIG.
While all reach the light receiving unit 101, the luminous flux incident on the on-chip microlens 104 in the peripheral pixels of the CCD image sensor 100 is incident obliquely as shown in FIG. The unit does not reach the light receiving unit 101. For this reason, the efficiency of light reception is reduced in the pixels at the periphery of the CCD image sensor 100.

The decrease in light receiving efficiency due to shading becomes more pronounced as the aperture value of the photographing lens increases.
Even if the distance from the optical axis of the taking lens is the same, different characteristics are exhibited depending on the exit pupil distance and the radius of the exit pupil (hereinafter, referred to as “exit pupil radius”). In general, when the exit pupil distance is long, the effect of shading is reduced because the taking lens is closer to the telecentric optical system.

The photographic lens has a property that the amount of peripheral light decreases according to the angle of view (hereinafter, referred to as “peripheral light reduction”). That is, the signal level of the image signal changes according to the distance from the center of the imaging surface (corresponding to the optical axis of the photographing lens). Therefore, the periphery of the image is affected by both shading and vignetting.

Therefore, the signal level of the image signal is not limited to the aperture value of the photographing lens and the exit pupil distance as described in JP-A-8-6599 and JP-A-8-223587. It also changes depending on the distance from the center and the radius of the exit pupil. For example, when the exit pupil distance is short and the exit pupil radius is long, the change in the signal level of the image signal with respect to the aperture value and the distance from the center of the imaging surface is as shown in FIG.
FIG. 8A shows a case where the exit pupil distance is long and the exit pupil radius is short, as shown in FIG. Therefore, in an electronic camera equipped with a CCD image pickup device having such characteristics, when the auto white balance is performed so that the balance of each of the R, G, and B color components is optimized at the center of the screen, the periphery of the screen is blue-green. The result is a tinted color (R <G <B).

In FIGS. 8 (a) and 8 (b), when the distance from the center of the imaging surface is long, each of the RGB color components is "R <
The relationship of G <B is shown, and the magnitude relationship of each color component is determined by the inherent characteristics of the CCD image sensor (the size of the pixel and the light receiving unit, the height, curvature, refractive index, and the like of the on-chip micro lens). different. By the way, the phenomenon in which the signal level of the image signal changes as described above occurs as long as a color image is captured by an electronic camera equipped with an imaging device with an on-chip microlens. Can be designed so as to be suitable for the image pickup device, and thus does not cause a serious problem.

However, in an existing interchangeable lens type electronic camera using an interchangeable lens for a silver halide single-lens reflex camera, the interchangeable lens is designed for a film, and the characteristics of an image pickup device with an on-chip micro lens are taken into consideration. Therefore, the phenomenon that the signal level of the image signal changes becomes a serious problem. In addition, since the size of the image sensor mounted on such a lens-interchangeable electronic camera is larger than the size of the image sensor mounted on the lens-integrated electronic camera, the incident light of the peripheral pixels increases from the vertical direction. It is inclined and easily affected by shading.

Therefore, the present invention according to the first to seventh aspects provides an image capturing apparatus capable of correcting a deterioration in sensitivity and a change in hue due to shading and vignetting (a property that the amount of peripheral light decreases in accordance with the angle of view). The purpose is to provide. Further, according to the inventions described in claims 8 and 9, an exchange capable of supplying information necessary for correcting sensitivity deterioration and hue fluctuation due to shading and vignetting to an image capturing device. It is intended to provide a lens.

[0013]

According to the first aspect of the present invention, there is provided an image capturing device having an on-chip microlens for capturing an optical image of a subject and generating an image signal including a plurality of color components. 4 corresponds to the CCD image sensor 11 of FIG. 4) and lens information including at least information on the position of the exit pupil. Gain control means for controlling the gain for each color component of the image signal according to the distance from the center of the surface (FIGS. 1, 3,
(Corresponding to the gain control unit 15 of FIG. 4, the gain control unit 31 of FIG. 2, and the coefficient calculation unit 23 of FIGS. 1 to 4).

An image capturing device according to a second aspect of the present invention includes a camera body 1 and an interchangeable lens 3 in FIG. 1, a camera body 30 and an interchangeable lens 3 in FIG. 2, a camera body 40 and an interchangeable lens 41 in FIG. The camera body 50 and the interchangeable lens 3), a photographic lens for forming an optical image of a subject (corresponding to the photographic lens 4 in FIGS. 1 to 4), and an opening through which an incident light beam from the photographic lens passes. Diaphragm means for adjusting the aperture value by changing the diameter of the opening (FIG. 1)
And an image sensor with an on-chip microlens that captures an optical image formed via a photographic lens and generates an image signal composed of a plurality of color components. (Corresponding to the CCD image sensor 11 shown in FIGS. 1 to 4), lens information including information on the position of the exit pupil of the photographing lens, and information on the aperture value adjusted by the diaphragm means or the radius of the exit pupil of the photographing lens. And gain control for controlling the gain for each color component of the image signal in accordance with the lens information and the distance from the center of the imaging surface in accordance with the lens information and the distance from the center of the imaging surface. Means (corresponding to the gain control unit 15 of FIGS. 1, 3, and 4, the gain control unit 31 of FIG. 2, and the coefficient calculation unit 23 of FIGS. 1 to 4).

The image capturing device according to claim 3 (FIG. 1)
The camera body 1 of FIG. 2, the camera body 30 of FIG. 2, the camera body 40 of FIG. 3, and the camera body 50 of FIG. (Corresponding to lens mount 2 in FIG. 4),
An imaging device with an on-chip microlens that captures an optical image of a subject formed via a photographing lens in an interchangeable lens that is joined to a mount unit and generates an image signal including a plurality of color components (FIGS. And aperture control means (corresponding to the aperture control unit 20 in FIGS. 1 to 4) which adjusts the aperture value by changing the diameter of the aperture of the aperture in the interchangeable lens. )), And lens information including identification information of the taking lens in the interchangeable lens, information on the position of the exit pupil of the taking lens, and information on the aperture value adjusted by the aperture control means or the radius of the exit pupil of the taking lens. At the same time, the image signal is taken in association with the position on the imaging surface of the imaging device, and the gain is controlled for each color component of the image signal according to the lens information and the distance from the center of the imaging surface. In the control unit, characterized in that it comprises (FIG. 1, FIG. 3, the gain control unit 15 of FIG. 4, the gain control unit 31 of FIG. 2, corresponds to the coefficient calculating unit 23 of FIGS. 1-4).

According to a fourth aspect of the present invention, the gain control means of the image capturing apparatus uses a plurality of polynomials (i.e., a plurality of polynomials) including coefficients determined for each color component of the image signal in accordance with lens information, using a distance from the center of the imaging surface as a variable. Formula 5 to Formula 7 or Formula 8 to Formula 10
, A gain control amount of each color component of the image signal is calculated, and gain control is performed for each color component based on the control amount.

According to a fourth aspect of the present invention, the gain control means may calculate a coefficient corresponding to the lens information taken together with the image signal by a predetermined arithmetic expression as a method of determining the coefficient of the polynomial. A table storing coefficients previously associated with various lens information is provided, and a coefficient corresponding to the lens information captured together with the image signal is calculated.
You may select from that table.

The gain control means of the image capturing apparatus according to claim 5 stores the value of the power of the distance from the center of the imaging surface in association with the position on the imaging surface (FIG. 2).
Corresponding to the power value table 32), and using the value stored in the table as the value of the power of the variable of the polynomial,
It is characterized in that a control amount of a gain of each color component of the image signal is calculated.

The gain control means of the image capturing apparatus divides the image signal into a plurality of regions, and controls the gain of each color component of the image signal corresponding to a representative position for each region. Is calculated according to the lens information and the distance from the center of the imaging surface, and the control amount is used to interpolate the control amount of the gain of each color component of the image signal that does not correspond to the representative position, based on each control amount. It is characterized in that gain control is performed for each color component.

According to a seventh aspect of the present invention, there is provided an image capturing apparatus which captures lens information, captures an image signal generated by the image capturing element in association with a position on the image capturing surface of the image capturing element, and captures the captured lens information and image signal. Recording means for recording the lens information and the image signal in response to the instruction, and outputting the recorded lens information and the image signal in response to the instruction. And an instruction to control the gain of each color component of the image signal by the gain control means, or to record the lens information and the image signal by the recording means. Switching means (switches 52 to 5 in FIG. 4) for switching the capture destination of the data to either the gain control means or the recording means. And corresponding to the switch control unit, not shown) and characterized by comprising a.

The interchangeable lens described in claim 8 (corresponding to the interchangeable lens 3 in FIGS. 1, 2, and 4 and the interchangeable lens 41 in FIG. 3) can be configured such that the image capturing device sets a gain for each color component of an image signal. Information supply means (encoder 6 in FIGS. 1 to 4, FIGS. 1 and 2) for supplying lens information including at least information on the position of the exit pupil of the photographing lens to the image capturing device as one of the parameters when performing the control. ROM of FIG.
7, corresponding to the ROM 42 and the exit pupil information acquisition unit 43 in FIG. 3).

The interchangeable lens according to claim 9 (FIGS. 1, 2, and 4)
(Corresponding to the interchangeable lens 3 of FIG. 3 and the interchangeable lens 41 of FIG. 3) (encoder 6 of FIGS. 1 to 4, ROM 7 of FIGS. 1, 2, and 4; ROM 42 of FIG. (Corresponding to 43) supplies the image capturing device with lens information including information on the position of the exit pupil of the taking lens and information on the radius of the exit pupil of the taking lens.

In the first to third, eighth, and ninth aspects, the information relating to the position of the exit pupil includes the distance from the imaging surface to the exit pupil (the exit pupil distance) and the distance of the exit pupil. This corresponds to information that can be calculated (aperture value, focal length, information indicating characteristics of a photographing lens, and the like). In claim 2, claim 3, and claim 9, the information on the radius of the exit pupil corresponds to the radius of the exit pupil (exit pupil radius) and information on which the exit pupil radius can be calculated. Further, in each claim,
The lens information includes not only “information on the position of the exit pupil” and “information on the radius of the exit pupil” but also, for example, information indicating the characteristics of the photographing lens, an aperture value, a focal length, and an automatic Various information such as parameters for white balance may be included.

[0024]

Embodiments of the present invention will be described below with reference to the drawings. << First Embodiment >> FIG. 1 is a diagram showing a configuration of a first embodiment. In the first embodiment, a camera body (corresponding to an electronic camera with interchangeable lenses) equipped with the image capturing device according to the first, third, and fourth aspects.
And the interchangeable lens according to claim 8 and claim 9, and also corresponds to the image capturing device according to claim 2.

In FIG. 1, a camera body 1 (here,
An interchangeable lens 3 (here, an interchangeable lens for a single-lens reflex camera) is mounted on a single-lens reflex lens-interchangeable electronic camera via a lens mount 2.
The interchangeable lens 3 has a diaphragm 5 disposed on the optical axis of the photographing lens 4, an encoder 6 for detecting the position of the photographing lens 4, and identification information of the photographing lens 4 (for example, the type of the lens and the lens ROM 7 in which a model number or the like is recorded.

On the other hand, the camera body 1 has a main mirror 8, a sub-mirror 9, a mechanical shutter 10 and a C with an on-chip micro lens on the optical axis of the taking lens 4.
A CD image pickup device 11 is arranged, a photometry unit 12 is arranged in a reflection direction of the main mirror 8, and an AF sensor 13 is arranged in a reflection direction of the sub mirror 9. Although FIG. 1 shows a configuration in which the camera body 1 includes the mechanical shutter 10, the present invention is applicable to a configuration in which the mechanical shutter is omitted by using the electronic shutter function of the CCD image sensor 11. it can. Incidentally, in the camera body 1, a focusing screen, a pentaprism, and the like are arranged in the reflection direction of the main mirror 8, and an optical finder and the like are arranged in the reflection direction of the pentaprism.

In the camera body 1, the output of the CCD image pickup device 11 is connected to an A / D converter 14, and the A / D converter
The output of the conversion unit 14 is connected to a gain control unit 15, the output of the gain control unit 15 is connected to a signal processing unit 16, and the output of the signal processing unit 16 is connected to a display unit 17 and a recording unit 18. The CCD image sensor 11 includes a light receiving unit, a transfer unit, a color filter, and an on-chip micro lens, and generates an image signal composed of each color component of RGB, similarly to the CCD image sensor 100 of FIG.

That is, the image signal generated by the CCD image sensor 11 is digitized by the A / D converter 14 and supplied to the gain controller 15, where gain control described later is performed for each color component. Will be.
The image signal whose gain has been controlled by the gain control unit 15 is displayed on the display unit 17 via the signal processing unit 16 or subjected to signal processing such as interpolation processing, gradation processing, and image compression. The image is recorded in the recording unit 18 as an image file.

Further, the camera body 1 has a CPU 19, an aperture control unit 20, an AF control unit 21, and a shutter control unit 22 (mechanical shutter 10 or CC).
The electronic shutter is controlled by the D imaging element 11). The outputs of the encoder 6, the photometry unit 12, and the AF sensor 13 of the interchangeable lens 3 are connected to the CPU 19, and the aperture control unit 20, the AF control unit 21, the shutter control unit 22
Is connected to the output of the CPU 19.

That is, the CPU 19 controls the encoder 6,
An aperture value, an exposure period, a focal length, a focus position, and the like are calculated based on information supplied from the photometry unit 12 and the AF sensor 13 and supplied to the aperture control unit 20, the AF control unit 21, and the shutter control unit 22. . By the way, the camera body 1
The gain control unit 15 calculates a gain control amount used when controlling the gain of each color component of the image signal, and the gain control amount is determined by a polynomial expression (corresponding to Expressions 5 to 7) described later. Is calculated.

The camera body 1 includes a coefficient calculator 23 for calculating the coefficients of such a polynomial, an exit pupil information calculator 24 for calculating an exit pupil distance and an exit pupil radius used for calculating the coefficients. Information indicating the characteristics (for example, characteristics of the exit pupil distance, exit pupil radius, and characteristics of vignetting) of various interchangeable lenses that can be connected to the camera body 1 (hereinafter, referred to as “lens characteristic information”). ) Is stored in association with the identification information of each photographing lens.

The exit pupil information calculator 24 includes the interchangeable lens 3
The output of the ROM 7, the output of the CPU 19, and the output of the photographing lens table 25 are connected to each other.
The output of the CPU 19 and the output of the exit pupil information calculation unit 24 are connected. The output of the coefficient calculator 23 is connected to the gain controller 15. Incidentally, the coefficient calculation unit 23 includes a table storing information indicating characteristics of hue variation due to an aperture value (hereinafter referred to as “aperture-dependent characteristic information”) as shown in FIG. A table storing information indicating characteristics (hereinafter, referred to as “shading characteristic information”) in association with the exit pupil distance and the exit pupil radius. Hereinafter, these tables will be referred to as on-chip microlens tables. The information stored in the on-chip micro lens table is as follows:
Information obtained in advance through experiments and simulations, for example, a polynomial (corresponding to Equations 5 to 7) described later.
And an arithmetic expression for calculating the value of the coefficient.

In the first embodiment, the gain control section 15 captures an image signal in association with the position of each pixel of the CCD image sensor 11 (here, the position indicated by the XY coordinate system). And In the first embodiment, an image signal generated at a pixel located at an arbitrary coordinate (x, y) and supplied to the gain control unit 15 is converted into Rin (x, y), Gin for each of RGB color components. (x, y) and Bin (x, y), the gain of which is controlled by the gain control unit 15 and the signal processing unit 1
6 is converted to Rout for each color component of RGB.
(x, y), Gout (x, y), Bout (x, y), and Rgain (L), Ggain (L), Bgain (L) shown in the following equations 1 to 3 are gain control amounts. It is assumed that gain control is performed for each of the RGB color components.

Rout (x, y) = Rgain (L) · Rin (x, y) Equation 1 Gout (x, y) = Ggain (L) · Gin (x, y) Equation 2 Bout (x, y) = Bgain (L) · Bin (x, y) Expression 3 where the coordinates of the center of the imaging surface (corresponding to the optical axis of the imaging lens 4) are (x0, y0). L = √ ((x−x0) ² + (y−y0) ² ) Equation 4 holds.

That is, the control amount of the gain for the image signal generated by the pixel located at the arbitrary coordinate (x, y) is calculated from the arbitrary coordinate (x, y) to the coordinate (x0, y0) of the center of the imaging surface. )) Corresponds to a value of a polynomial in which the distance L to the variable is a variable. Therefore,
In the first embodiment, the control amount of the gain Rgain (L) = A0 · ( 1 + A1 · L 2 + A2 · L 4 + A3 · L 6) ··· Equation 5 Ggain (L) = B0 · ( 1 + B1 ・ L ² + B2 ・ L ⁴ + B3 ・ L ⁶ ) ・ ・ ・ Equation 6 Bgain (L) = C0 ・ (1 + C1 ・ L ² + C2 ・ L ⁴ + C3 ・ L ⁶ ) ・ ・ ・Let it be the value represented by Equation 7.

The operation of the first embodiment will be described below. Here, the operation for controlling the gain of each color component of the image signal will be mainly described. When the interchangeable lens 3 is mounted on the camera body 1, the exit pupil information calculating unit 24 stores lens characteristic information corresponding to the identification information of the photographing lens 4 supplied from the ROM 7 of the interchangeable lens 3 into a photographing lens table 25. Search from. The exit pupil information calculation unit 2
When recognizing that the release button (not shown) is fully depressed, the aperture 4 captures the aperture value and the focal length calculated by the CPU 19 as described above, and outputs the lens characteristic information (here, the exit pupil distance and the exit pupil distance. The exit pupil distance and the exit pupil radius at the time of photographing are calculated using the information indicating the characteristics), the aperture value, and the focal length.

Further, the exit pupil information calculator 24 supplies the coefficient calculator 23 with the exit pupil distance and the exit pupil radius calculated as described above, and the lens characteristic information retrieved from the photographing lens table 25. In general, the exit pupil distance and the exit pupil radius hardly change due to the focus position. However, when the photographing lens 4 is a close-up lens, the amount of extension of the lens due to focus adjustment is large. The exit pupil radius changes greatly depending on the focus position. Therefore, the exit pupil information calculation unit 24
When the taking lens 4 is a close-up lens, the focus position is taken from the CPU 19 in addition to the aperture value and the focal length, and
It may be used when calculating the exit pupil distance and the exit pupil radius.

When calculating the aperture value, the exposure period, the focal length, and the focus position as described above, the CPU 19 calculates the parameters for the automatic white balance according to the photometric value of the subject luminance measured by the photometric unit 12. I do. In addition,
The parameters for the auto white balance may be calculated by any known method without depending on the photometric value of the subject luminance measured by the photometric unit 12.

The coefficient calculator 23 takes in the aperture value calculated by the CPU 19 and the parameters for auto white balance, and searches the internal on-chip micro lens table for aperture dependent characteristic information corresponding to the aperture value,
A0, B0, and C0 in Equations 5 to 7 are calculated using the aperture-dependent characteristic information and the parameters for auto white balance.
Also, when the exit pupil distance and the exit pupil radius are supplied from the exit pupil information calculator 24, the coefficient calculator 23 searches the on-chip micro lens table for shading characteristic information corresponding to the exit pupil distance and the exit pupil radius. I do. Then, the coefficient calculating unit 23 captures the focal length calculated by the CPU 19, and the focal length and the lens characteristic information (here, information indicating the characteristic of the peripheral dimming) supplied through the exit pupil information calculating unit 24. ) And the shading characteristic information, A1 to A3, B1 to B3, C1 to C3
Is calculated.

That is, in the first embodiment, the coefficient calculation unit 23 calculates A0, B0, and C0 as coefficients for correcting a change in hue, and corrects the sensitivity deterioration due to shading and vignetting. A1 to A3, B1
~ B3 and C1 ~ C3 are calculated. The value of each coefficient calculated by the coefficient calculation unit 23 in this way is supplied to the gain control unit 15.

The gain control unit 15 calculates the power of the distance L from the center of the imaging surface (Equation 5) for each image signal corresponding to each pixel.
The value of L ² , L ⁴ , L ⁶ in Equation 7 is calculated, and the gain control amount (Equation 5 to Equation 7) is calculated using the calculated value and the coefficient value supplied from the coefficient calculating unit 23. Rgain (L), Ggain (L), Bgain
(Equivalent to (L)). Also, the gain control unit 15
Controls the gain for each color component of the image signal based on the gain control amount calculated in this manner.

As described above, in the first embodiment, the interchangeable lens 3 supplies the information such as the position of the photographing lens 4 from the encoder 6 to the camera body 1 side, and
The identification information of the photographing lens 4 necessary for retrieving the lens characteristic information from the OM 7 can be supplied to the camera body 1 side. That is, the interchangeable lens 3 can provide the camera body 1 with information on which the exit pupil distance and the exit pupil radius can be calculated.

In addition to the exit pupil distance and the exit pupil radius, the camera body 1 includes information including lens characteristic information, an aperture value, a focal length, and a parameter for auto white balance corresponding to a photometric value of subject brightness (each The gain is controlled for each color component of the image signal according to the distance from the center of the imaging surface. Therefore, according to the first embodiment, C with on-chip microlens
The image signal generated by the CD image sensor 11 can be corrected at the same time for sensitivity deterioration and hue fluctuation due to shading and vignetting.

{Second Embodiment} FIG. 2 is a diagram showing a configuration of a second embodiment. In the second embodiment, a camera body (corresponding to an electronic camera of interchangeable lens type) equipped with the image capturing device according to claim 1, claim 3 to claim 5, claim 8 and claim 9 corresponds to the interchangeable lens, and also corresponds to the image capturing device according to claim 2.

In FIG. 2, components having the same functions as those shown in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted here. The difference between the camera body 1 shown in FIG. 1 and the camera body 30 shown in FIG. 2 is that a gain control unit 31 is provided in FIG. 2 instead of the gain control unit 15 in FIG.
L ² , L ⁴ , L ⁶ in Equations 5 to 7 (square, fourth and sixth powers of distance L from the center of the screen to each pixel) are stored in association with the coordinates of each pixel, The output of the power value table 32 in FIG. 2 is connected to the gain control unit 31.

The operation of the second embodiment will be described below. Here, the operation of the gain control section 31 will be mainly described. In the second embodiment, similarly to the first embodiment, the exit pupil distance and the exit pupil radius are calculated by the exit pupil information calculation unit 24, and the coefficient calculation unit 23 calculates Equations 5 to 5.
A0, B0, C0, A1 to A3, B1 to B3, and C1 to C3 in Equation 7 are calculated.

When calculating the gain control amount of the image signal corresponding to each pixel, the gain control unit 31 searches the power value table 32 for L ² , L ⁴ , and L ⁶ corresponding to the coordinates of each pixel. . That is, the gain control unit 31 uses the L ² , L ⁴ , and L ⁶ retrieved in this manner and the value of the coefficient supplied from the coefficient calculation unit 23 to control the gain (Rgain (Rgain ( L), Gg
ain (L) and Bgain (L)), and the gain is controlled for each color component of the image signal by the calculated gain control amount.

That is, in the second embodiment, L ² , L ⁴ , and L ⁶ are obtained by searching the power value table 32, so that each time the gain control amount is calculated, L ² , L ⁴ , L ⁶
Can be shortened in comparison with the first embodiment in which it is necessary to calculate the gain. Therefore, according to the second embodiment, the sensitivity of the image signal generated by the CCD image pickup device 11 with the on-chip microlens and the deterioration of the sensitivity and the variation of the hue due to the shading and the peripheral dimming are promptly corrected. be able to.

Third Embodiment Hereinafter, a third embodiment will be described. In the third embodiment, a camera body (corresponding to an electronic camera of a lens interchangeable type) equipped with the image capturing device according to the first, third, fourth, and sixth aspects is described. The present invention corresponds to the interchangeable lens according to the eighth and ninth aspects, and also corresponds to the image capturing device according to the second aspect.

The hardware configuration of the camera body and the interchangeable lens corresponding to the third embodiment is the same as the configuration of the camera body 1 and the interchangeable lens 3 of FIG. 1 (the structure of the first embodiment). Therefore, illustration is omitted. However,
The operation of the gain control unit 15 according to the third embodiment is different from the operation of the gain control unit 15 according to the first embodiment. The third
The gain control unit 15 according to the first embodiment converts the image signal to 16 × 1
It is assumed that the data is divided into a plurality of blocks of about six pixels and handled, and the coordinates of a representative pixel (hereinafter, referred to as a representative point) are recorded for each block.

Hereinafter, the operation of the third embodiment will be described. Here, the operation of the gain control unit 15 will be mainly described. In the third embodiment, as in the first embodiment, the exit pupil distance and the exit pupil radius are calculated by the exit pupil information calculation unit 24, and the equations 5 to 5 are calculated by the coefficient calculation unit 23.
A0, B0, C0, A1 to A3, B1 to B3, and C1 to C3 in Equation 7 are calculated.

The gain control unit 15 calculates the power of the distance L from the center of the imaging surface (corresponding to L ² , L ⁴ , and L ⁶ in Expressions 5 to 7) for each image signal corresponding to the representative point of each block. ) Is calculated, and the gain control amount at the representative point is calculated using the value and the coefficient value supplied from the coefficient calculation unit 23 (Equations 5 to 7).
Rgain (L), Ggain (L), and Bgain (L)).

The gain control unit 15 interpolates the gain control amounts of pixels other than the representative points in the same block, based on the gain control amounts at the representative points. For example,
As a method of performing interpolation, a method of setting a gain control amount at a pixel other than the representative point as a gain control amount at a representative point, or a method of performing linear interpolation of the gain control amount of a representative point between two adjacent blocks And so on. Others
Any method may be used for performing the interpolation.

Further, the gain control section 15 controls the gain for each color component of the image signal based on the gain control amount obtained by calculation or interpolation. That is, the third
According to the embodiment, since the gain control amount at the representative point may be calculated, the time required for gain control can be reduced as compared with the case where the gain control amounts at all pixels are calculated.

Since the amount of change in the signal level of the image signal of each pixel due to shading or vignetting changes gradually as the distance from the center of the imaging surface increases, the gain is controlled by dividing the block as described above. Even if it is performed, the effect on the image quality is small. Therefore, in the third embodiment, the gain control can be performed in a short time without deteriorating the image quality.

Therefore, according to the third embodiment, the sensitivity of the image signal generated by the CCD image pickup device 11 with the on-chip microlens and the correction of the deterioration of the sensitivity and the variation of the hue due to the shading and the peripheral dimming are corrected. It can be done promptly. In the third embodiment, an example has been described in which the image signal is divided into a plurality of blocks of about 16 × 16 pixels. However, the size of each block may be, for example, about 32 × 32 pixels. CCD image sensor 1
When the number of pixels of 1 is large, it may be further increased.

Further, in the third embodiment, the description has been made assuming that the hardware configurations of the camera body and the interchangeable lens are the same as those in FIG. 1, but the hardware of the camera body and the interchangeable lens of the third embodiment are described. The wear may be the same as in FIG. As described above, when the hardware configurations of the camera body and the interchangeable lens are the same as those in FIG.
In the embodiment, the gain control unit 31 stores the values of L ² , L ⁴ , and L ⁶ in Expressions 5 to 7 corresponding to the representative points of each block in the power value table 32 so that the gain control unit 31 When calculating the gain control amount, L ² corresponding to the coordinates of the representative point,
Since L ⁴ and L ⁶ may be retrieved from the power value table 32, the time required to calculate the gain control amount can be further reduced.

In each of the above-described embodiments, it is not considered that an interchangeable lens whose lens characteristic information is not stored in the taking lens table 25 is mounted on the camera body 1. When the lens characteristic information is recorded in the ROM 7 of the interchangeable lens, the exit pupil information calculating unit 24 can fetch the lens characteristic information from the ROM 7 and calculate the exit pupil distance and the exit pupil radius.

In addition, the RO of a newly released interchangeable lens
In FIG. 1, when the ROM 7, the CPU 19, and the photographing lens table 25 are connected, the lens characteristic of the photographing lens included in the interchangeable lens newly sold is stored in M 7. Information C
It can be stored in the photographing lens table 25 via the PU 19.

That is, the CPU 19 fetches the identification information of the photographing lens recorded in the ROM 7, determines whether or not the lens characteristic information corresponding to the identification information exists in the photographing lens table 25, and determines whether the lens characteristic information is present. Is not present in the taking lens table 25, the ROM 7
, The lens characteristic information of the taking lens may be fetched and added to the taking lens table 25. As described above, once the lens characteristic information is captured and recorded in the camera body, the exit pupil information calculation unit 24 does not need to access the ROM in the interchangeable lens every time the lens characteristic information is required. If a non-volatile memory such as a flash memory is used as a memory area for adding the lens characteristic information to the photographing lens table 25, the camera body can store the lens characteristic information without supplying power. Can be held.

{Fourth Embodiment} FIG. 3 is a diagram showing a configuration of a fourth embodiment. In the fourth embodiment, a camera body (corresponding to an electronic camera with interchangeable lenses) equipped with the image capturing device according to claims 1, 3, and 4 is provided. 9 corresponds to the interchangeable lens, and also corresponds to the image capturing device according to claim 2.

In FIG. 3, components having the same functions as those of the configuration shown in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted. The difference between the camera body 1 shown in FIG. 1 and the camera body 40 shown in FIG. 3 is that the exit pupil information calculation unit 24 and the photographing lens table 25 in FIG. 1 are not present in FIG. The difference between the interchangeable lens 3 shown in FIG. 1 and the interchangeable lens 41 shown in FIG.
3 in that a ROM 42 is provided and an exit pupil information acquisition unit 43 is provided in FIG. The output of the encoder 6 and the ROM 42 are connected to the exit pupil information acquisition unit 43 of FIG. 3, and a drive circuit (not shown) of the diaphragm 5 is connected.
Are connected, and the output of the exit pupil information acquisition unit 43 in FIG. 3 is connected to the coefficient calculation unit 23. Further, the ROM 42 of FIG.
It is assumed that lens characteristic information of the photographing lens 4 is recorded in the.

Hereinafter, the operation of the fourth embodiment will be described. Here, the operation for controlling the gain of each color component of the image signal will be mainly described. The exit pupil information acquisition unit 43 calculates an aperture value and a focal length at the time of photographing based on information supplied from the encoder 6 and the drive circuit of the aperture 5 (when the interchangeable lens 3 is a close-up lens, the focus position is also determined). calculate). Further, the exit pupil information acquisition unit 43 takes in the lens characteristic information from the ROM 42, and uses the lens characteristic information and the aperture value and the focal length calculated as described above (when the photographing lens 4 is a close-up lens, The focus position is also used), and the exit pupil distance and the exit pupil radius at the time of photographing are calculated.

Further, the exit pupil information acquisition section 43 is provided with a ROM
The lens characteristic information supplied from the CPU 42 and the exit pupil distance and the exit pupil radius calculated as described above are calculated by the coefficient calculation unit 2.
Supply 3

The coefficient calculation unit 23 calculates A0 to A3, B0 to B3, and C0 to C3 in Equations 5 to 7 in the same manner as in the first embodiment. (Or
As in the third embodiment, the gain is controlled for each color component of the image signal. As described above, in the fourth embodiment, the lens characteristic information, the exit pupil distance, and the exit pupil radius are supplied from the interchangeable lens side, so that all of the interchangeable lenses that can be connected to the camera body have There is no need to record lens characteristic information in the camera body in advance.

Therefore, in the fourth embodiment, any interchangeable lens which has the lens characteristic information of the photographing lens and has the same function as the exit pupil information acquisition section, regardless of which interchangeable lens is attached, With respect to the image signal generated by the CCD image pickup device 11 with the on-chip micro lens, it is possible to reliably correct the sensitivity deterioration and the hue fluctuation due to shading and vignetting.

In the fourth embodiment, the exit pupil distance and the exit pupil radius are calculated by the exit pupil information acquisition unit 43 using lens characteristic information and the like. If the table storing the exit pupil distance and the exit pupil radius is stored in the ROM 42 in advance, the exit pupil distance and the exit pupil radius are determined by the photographing. Using the aperture value and the focal length at the time (when the taking lens 4 is a close-up lens, the focus position is also used), the table may be obtained by searching.

Further, in the fourth embodiment, the gain control unit 15 is provided in the camera body 40, and the gain is controlled in the same manner as in the first embodiment (or the third embodiment). The gain control unit 15 and the power value table 32 of FIG. 2 may be provided instead of the gain control unit 15, and the gain control may be performed in the same manner as in the second embodiment. Fifth Embodiment Hereinafter, a fifth embodiment will be described.

According to the fifth embodiment, a camera body (corresponding to an electronic camera of interchangeable lens type) equipped with the image capturing device according to the first, third, or fifth aspect of the present invention.
And the interchangeable lens according to claims 8 and 9. The hardware configuration of the camera main body corresponding to the fifth embodiment is the same as the configuration of the camera main body 1 of FIG. 1 (the configuration of the first embodiment) or the configuration of the camera main body 30 of FIG. 2 (the second embodiment). The hardware configuration of the interchangeable lens is the same as that of the interchangeable lens 3 of FIGS. 1 and 2 (the structure of the first and second embodiments) or the interchangeable lens of FIG. Configuration of 41 (Configuration of Fourth Embodiment)
The illustration is omitted because it is the same as.

In the fifth embodiment, when the interchangeable lens 3 is mounted on the camera body 1 (or 30), the output of the ROM 7 is connected to the exit pupil information calculation unit 24, and the camera body 1 (or 30) , 30), the output of the exit pupil information acquisition unit 43 is connected to the exit pupil information calculation unit 24. Further, the operation of the exit pupil information calculation unit 24 of the fifth embodiment is different from the operation of the exit pupil information calculation unit 24 of the first embodiment or the second embodiment.

The operation of the fifth embodiment will be described below. Here, the operation of the exit pupil information calculation section 24 will be mainly described. When the identification information of the photographing lens 4 is supplied from the interchangeable lens side, the exit pupil information calculation unit 24 corresponds to the identification information as in the first embodiment (or the second embodiment). The lens characteristic information is retrieved from the photographing lens table 25, and the retrieved lens characteristic information and the CPU
The exit pupil distance and the exit pupil radius at the time of photographing are calculated using the aperture value and the focal length calculated in 19 (when the photographing lens 4 is a close-up lens, the focus position is also used). In addition, the exit pupil information calculation unit 24 supplies the lens characteristic information retrieved from the photographing lens table 25 and the exit pupil distance and the exit pupil radius calculated as described above to the coefficient calculation unit 23.

On the other hand, when the lens characteristic information of the photographing lens 4 and the exit pupil distance and the exit pupil radius are supplied from the interchangeable lens side, the exit pupil information calculation unit 24 outputs the lens characteristic information, the exit pupil distance and the exit pupil distance. The pupil radius is supplied to the coefficient calculation unit 23. Note that the coefficient calculation unit 23 calculates A0 to A3, B0 to B3, and C0 to C3 of Expressions 5 to 7 as in the first embodiment, and the gain control unit 15 (or 31) calculates As in the first embodiment (or the second embodiment), gain control is performed for each color component of the image signal.

Therefore, in the fifth embodiment, even if the standard of the interchangeable lens is changed from the structure of the interchangeable lens 3 of FIG. 1 or 2 to the structure of the interchangeable lens 41 of FIG. 3, the structure of the camera body is changed. Without this, it is possible to reliably correct the sensitivity degradation and the hue fluctuation due to shading and vignetting on the image signal generated by the CCD image pickup device 11 with the on-chip microlens.

{Sixth Embodiment} FIG. 4 is a diagram showing a configuration of a sixth embodiment. In the sixth embodiment, a camera body (corresponding to a lens-interchangeable electronic camera) equipped with the image capturing device according to the first, third, fourth, and seventh aspects is described. The present invention corresponds to the interchangeable lens according to the eighth and ninth aspects, and also corresponds to the image capturing device according to the second aspect.

In FIG. 4, components having the same functions as those of the configuration shown in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted here. The difference between the camera body 1 shown in FIG. 1 and the camera body 50 shown in FIG. 4 is that, in FIG. 4, a file management unit 51 is provided, an A / D conversion unit 14, a gain control unit 15, Switch 5 between management unit 51
2, a switch 53 is provided between the signal processing unit 16, the recording unit 18, and the file management unit 51.
9, a switch 54 is provided between the coefficient calculation unit 23 and the exit pupil information calculation unit 24 and the file management unit 51.
The difference is that a switch 55 is provided between M7, the exit pupil information calculation unit 24, and the file management unit 51. In the sixth embodiment, switching of the switches 52, 53, 54, and 55 is controlled by a switch control unit, but is not illustrated here.

The file management unit 51 is supplied with the aperture value, the focal length, and the parameters for auto white balance (including the focus position when the photographing lens 4 is a close-up lens) output from the CPU 19 via the switch 54. R
When the identification information of the photographing lens 4 output from the OM 7 is supplied via the switch 55, the information is stored in the header area of the image file. In addition, the file management unit 51
When the image signal digitized by the A / D converter 14 is supplied via the switch 52, the image signal is sequentially stored in the data area of the image file.

When the image signal for one frame is stored in the data area of the image file, the file management unit 51 supplies the image file to the recording unit 18 via the switch 53. The recording unit 18 records the image file supplied in this manner (hereinafter, referred to as a “gain control and signal processing unexecuted file”). Note that the “gain control and signal processing unexecuted file” recorded in the recording unit 18 may be supplied externally via an external output terminal (not shown) or a recording medium. Further, the “unexecuted gain control and signal processing file” recorded in the recording unit 18 is supplied to the coefficient calculation unit 23, the exit pupil information calculation unit 24, the gain control unit 15, and the like via the file management unit 51, and Therefore, gain control and signal processing may be performed.

On the other hand, each part of the camera body 50 is
Camera body 1 shown in FIG. 1 via 2, 53, 54, 55
When the connection is made in the same manner as in the first embodiment, the recording unit records an image file (hereinafter, referred to as a “gain control executed file”) in which an image signal subjected to gain control is stored as in the first embodiment. I do. That is, in the sixth embodiment, by switching the switches 52, 53, 54, and 55, the image signal is stored as a “gain control and signal processing unexecuted file” or as a “gain control executed file”. Can be switched.

By the way, the file format in which the image signal is stored is determined according to the instruction of the photographer. That is, the camera body 50 can receive a photographer's instruction by providing a mode in which the photographer can directly set the file format. The camera body 50
When the high-speed shooting mode or the continuous shooting mode is set by the photographer, it may be determined that the image signal has been requested to be stored as a “gain control and signal processing non-executing file”. However, in such a case, it is necessary to control the gain of the image signal stored in the “gain control and signal processing not executed file” again.

For example, the gain controller 15 and the coefficient calculator 2
3. A program for performing the same operation as that of the exit pupil information calculation unit 24 and the photographing lens table 25 can be provided as an application (in the form of a recording medium). Table can be installed. Therefore, such personal computers etc.
It is possible to perform gain control on the image signal stored in the “gain control and signal processing unexecuted file” in the same manner as in the first embodiment.

Further, the file management section 51 can read out the “gain control and signal processing unexecuted file” recorded in the recording section 18 and store the “gain control and signal processing unexecuted file” in the header area. The stored information is supplied to the coefficient calculator 23 and the exit pupil information calculator 24 via the switches 54 and 55, and the image signal stored in the data area is also supplied to the gain controller 15 via the switch 52. Is possible, the gain control unit 15 can control the gain for the image signal stored in the “gain control and signal processing unexecuted file”.

That is, in the sixth embodiment, when it is premised that the gain control for the image signal is performed again, the image signal is stored as a “gain control and signal signal processing unexecuted file”. Time can be reduced. In each of the above-described embodiments, the gain control amount is a value represented by Expressions 5 to 7. For example, the gain control amount is Ggain (L) = B0 · (1 + B1 · L ² + B2 ・ L ⁴ + B3 ・ L ⁶ ) ・ ・ ・ Equation 8 (same as Equation 6) Rgain (L) = D0 ・ Ggain (L) ・ (1 + D1 ・ L ² + D2 ・ L ⁴ + D3 ・ L ⁶ ) ・ ・ ・ Equation 9 Bgain (L) = E0 · Ggain (L) · (1 + E1 · L ² + E2 · L ⁴ + E3 · L ⁶ ) ··· It may be a value represented by Equation 10. .

That is, in Equations 8 to 10, the gain control amount Rgain (L) for the R component and the gain control amount Bgain (L) for the B component are the gain control amount Gg for the G component.
is obtained by correcting the ain (L), when performing such correction ^{(1 + D1 · L 2 +} D2 · L 4 + D3 · L 6) and ^{(1 + E1 · L 2 +} E2 · L
⁴ + E3 · L ⁶ ) is used. Therefore, the gain control amounts calculated by Expressions 8 to 10 can be obtained with higher accuracy than in the case where RGB values are separately corrected as shown in Expressions 5 to 7.

The gain control amount is a value calculated not only in the form of exponentiation as shown in Equations 5 to 7 or 8 to 10, but also in an approximate expression using a trigonometric function or a log function. May be. Further, each of the above-described embodiments has a C
Although the description has been made using the CD image pickup device, the present invention relates to the CC
It is not limited to D, but an image sensor other than CCD, for example, CM
The present invention can also be applied to an OS image sensor or a camera using another amplification type solid-state imaging device.

In each of the embodiments described above, the description has been made using the single-lens reflex camera body and the interchangeable lens. However, the present invention is not limited to the single-lens reflex camera.
Applicable to a camera body equipped with a liquid crystal finder that displays an image signal by performing AF or AE (auto exposure) based on an image signal generated by a CCD image sensor, and an interchangeable lens attached to the camera body can do.

In general, in a single-lens reflex camera body, the aperture value at the time of performing AF is set to F due to optical restrictions.
Although it is necessary to make the brightness higher than 5.6, the camera body that performs AF or AE based on the image signal has no optical limitation, and adjusts the aperture and shutter speed in accordance with the brightness of the subject while adjusting the image. The signal can be monitored with a liquid crystal finder, and AE can be performed with an aperture value for actually photographing. In such a camera body, the auto white balance can also be corrected in advance by the feedback processing of the image signal.

Therefore, when the present invention is applied to such a camera body, the gain control unit does not need to correct the hue fluctuation, so that the coefficient calculation unit calculates A0 = B0 = C0 = 1 can be set. Further, in each of the above-described embodiments, the description has been made using the interchangeable lens-type electronic camera and the interchangeable lens. It is possible to correct sensitivity deterioration and hue fluctuation due to peripheral dimming. However, in such a lens-integrated electronic camera, the lens mount 2 and the ROM
7 is unnecessary, and the photographing lens table 25 only needs to store the lens characteristic information of the integrated photographing lens, and the exit pupil information calculation unit 25 can directly refer to the lens characteristic information. Therefore, if the present invention is applied to a lens-integrated electronic camera, for example, even when a lens with a large peripheral dimming or a lens with a short exit pupil distance is used, a good image can be obtained. A small and lightweight camera can be provided.

[0088]

As described above, according to any one of the first to sixth aspects of the present invention, an image signal generated by an image pickup device having an on-chip micro lens is shaded and peripherally shaded. It is possible to correct sensitivity deterioration and hue fluctuation due to light reduction.

In particular, according to the fifth or sixth aspect of the present invention, it is possible to quickly correct sensitivity deterioration and hue fluctuation due to shading and vignetting of an image signal. According to the seventh aspect of the present invention, it is determined whether or not the sensitivity of the image signal generated by the imaging device with the on-chip microlens and the degradation of the hue due to shading and vignetting are corrected. When switching is performed and no correction is performed, the lens information and the image signal that has not been corrected are recorded, so that the recording process can be completed at a high speed, and the correction for the recorded image signal can be performed again. is there.

Further, according to the invention described in claim 8 or claim 9, an image capturing device that generates an image signal by an image pickup device with an on-chip micro lens is provided.
It is possible to provide information necessary for correcting sensitivity deterioration and hue fluctuation due to shading of the image signal and vignetting.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of a first embodiment.

FIG. 2 is a diagram illustrating a configuration of a second embodiment.

FIG. 3 is a diagram illustrating a configuration of a fourth embodiment.

FIG. 4 is a diagram showing a configuration of a sixth embodiment.

FIG. 5 is a diagram illustrating an example of a cross-sectional view of a CCD image sensor.

FIG. 6 is a diagram showing a change in a signal level of an image signal with respect to an aperture value.

FIG. 7 is a diagram showing a state of a light beam incident on an on-chip microlens.

FIG. 8 is a diagram illustrating a change in a signal level of an image signal with respect to a distance from a center of an imaging surface.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1, 30, 40, 50 Camera body 2, 41 Lens mount 3 Interchangeable lens 4 Shooting lens 5 Aperture 6 Encoder 7, 42 ROM 8 Main mirror 9 Submirror 10 Mechanical shutter 11, 100 CCD image sensor 12 Photometry unit 13 AF sensor 14A / D conversion unit 15, 31 gain control unit 16 signal processing unit 17 display unit 18 recording unit 19 CPU 20 aperture control unit 21 AF control unit 22 shutter control unit 23 coefficient calculation unit 24 exit pupil information calculation unit 25 shooting lens table 32 Power value table 43 Exit pupil information acquisition unit 51 File management unit 52, 53, 54, 55 Switch 101 Light receiving unit 102 Transfer unit 130 Color filter 104 On-chip micro lens

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C022 AA13 AB12 AB17 AB20 AB22 AC52 AC54 AC56 5C024 AA01 BA01 CA03 CA17 DA01 DA04 EA04 FA01 FA08 FA11 GA11 HA14 HA21 HA25 HA27 JA04 5C065 AA03 BB06 BB08 BB11 CC01 DD02 DD17 EE02 EE05 EE05 EE13 GG15 GG18 GG31 GG32 GG44 GG49

Claims (9)

[Claims] An image pickup device with an on-chip microlens for capturing an optical image of an object to generate an image signal composed of a plurality of color components, and lens information including at least information on the position of an exit pupil, Gain control means for capturing the image signal in association with a position on the imaging surface of the imaging device, and controlling gain for each color component of the image signal according to the lens information and the distance from the center of the imaging surface; An image capturing device comprising: 2. A photographic lens for forming an optical image of a subject, and an aperture through which an incident light beam from the photographic lens passes, and an aperture means for adjusting the aperture value by changing the diameter of the aperture. An imaging element with an on-chip micro lens that captures an optical image formed through the imaging lens and generates an image signal composed of a plurality of color components; and information regarding the position of an exit pupil of the imaging lens. In addition to taking in lens information including an aperture value adjusted by the aperture means or information on the radius of the exit pupil of the taking lens, the image signal is taken in association with a position on the imaging surface of the imaging device, and An image capturing apparatus comprising: gain control means for controlling a gain for each color component of the image signal in accordance with information and a distance from a center of the imaging surface. 3. An optical image of a subject formed through a mount for joining an interchangeable lens having a built-in photographing lens and an aperture, and a photographing lens in the interchangeable lens joined to the mount. An image sensor with an on-chip micro lens that generates an image signal composed of a plurality of color components; an aperture control unit that adjusts an aperture value by changing a diameter of an aperture of an aperture in the interchangeable lens; The lens information including the identification information of the photographing lens in the information on the position of the exit pupil of the photographing lens and the aperture value adjusted by the aperture control means or information on the radius of the exit pupil of the photographing lens,
Gain control means for fetching the image signal in association with a position on the imaging surface of the imaging device and controlling a gain for each color component of the image signal in accordance with the lens information and a distance from the center of the imaging surface An image capturing device comprising: 4. The image capturing device according to claim 1, wherein the gain control unit uses a distance from a center of the imaging surface as a variable and sets the gain according to the lens information. A gain control amount of each color component of the image signal is calculated by a plurality of polynomials including coefficients determined for each color component of the image signal, and gain control is performed for each color component based on the control amount. Image capturing device. 5. The image capturing device according to claim 4, wherein the gain control unit stores a value of a power of a distance from a center of the imaging surface in association with a position on the imaging surface. An image capturing apparatus for calculating a control amount of a gain of each color component of the image signal by using a value stored in the table as a value of a power of a variable of the polynomial. 6. The image capturing device according to claim 1, wherein the gain control unit divides the image signal into a plurality of regions, and each of the plurality of regions serves as a representative. The control amount of the gain of each color component of the image signal corresponding to the position is calculated in accordance with the lens information and the distance from the center of the imaging surface, and the control amount is used to calculate an image signal that does not correspond to a representative position. An image capturing device interpolating a gain control amount of each color component and performing gain control for each color component based on each control amount. 7. The image capturing device according to claim 1, wherein the lens information is captured, and an image signal generated by the image capturing device is captured on an image capturing surface of the image capturing device. Recording that captures the lens information and image signal captured in association with the position, receives an instruction requesting the recorded lens information and image signal, and outputs the recorded lens information and image signal according to the instruction. Means for controlling the gain of each color component of the image signal by the gain control means, or accepting an instruction to record the lens information and the image signal by the recording means; Switching means for switching the destination of the information and the image signal to one of the gain control means and the recording means; Image capture device, characterized in that the. 8. An image capturing device that captures an optical image of a subject with an image sensor having an on-chip microlens, generates an image signal including a plurality of color components, and controls a gain for each color component of the image signal. An interchangeable lens provided with a photographing lens for forming an optical image of a subject, wherein at least the photographing is performed as one of parameters when the image capturing device controls a gain for each color component of the image signal. An interchangeable lens, comprising: an information supply unit that supplies lens information including information on a position of an exit pupil of a lens to the image capturing device. 9. The interchangeable lens according to claim 8, wherein the information supply unit transmits the lens information including information on a position of an exit pupil of the photographing lens and information on a radius of an exit pupil of the photographing lens to the image. An interchangeable lens that is supplied to a capturing device.