JP4823167B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus such as a digital camera or a video camera, and more particularly to an imaging apparatus that performs focus detection based on an output from an imaging element.

  Patent Document 1 discloses an image pickup apparatus that performs optical focus detection based on an output from a part of pixels by making optical characteristics of some pixels constituting an image pickup element used in the image pickup apparatus different from those of other pixels. Are disclosed.

  In the imaging apparatus disclosed in Patent Document 1, a plurality of focus detection pixels that are paired with each other are arranged in a part of the imaging element. Here, FIG. 5 shows a pixel arrangement example of an image sensor in which focus detection pixels are arranged in some rows of the pixel matrix.

  In FIG. 5, R, G, and B are normal imaging pixels in which a red filter, a green filter, and a blue filter are arranged, respectively. In addition, S1 and S2 are first and second focus detection pixels, which have different optical characteristics from the imaging pixels.

  FIG. 6 shows the structure of the first focus detection pixel S1. In FIG. 6, a microlens 501 is formed on the light incident side of the first focus detection pixel. Reference numeral 502 denotes a smooth layer constituting a plane for forming the microlens 501.

  Reference numeral 503 denotes a light shielding layer, which has a diaphragm opening that is eccentric in one direction with respect to the center O of the photoelectric conversion region 504 of the first focus detection pixel S1.

  FIG. 7 shows the structure of the second focus detection pixel S2. In FIG. 7, a microlens 601 is formed on the light incident side of the second focus detection pixel. Reference numeral 602 denotes a smooth layer that forms a plane for forming the microlens 601.

  Reference numeral 603 denotes a light shielding layer, and an aperture opening that is decentered in the opposite direction to the light shielding layer 503 provided in the first focus detection pixel S1 with respect to the center O of the photoelectric conversion region 604 of the second focus detection pixel S2. Have That is, the light shielding layers 503 and 603 of the first and second focus detection pixels S1 and S2 have diaphragm openings at symmetrical positions with the optical axis of each microlens interposed therebetween.

  According to such a configuration, the pupil of the imaging optical system is divided symmetrically when the imaging optical system is viewed from the first focus detection pixel S1 and when viewed from the second focus detection pixel S2. Is equivalent to

  In FIG. 5, two images closer to each other are formed in the row including the first focus detection pixel S1 and the row including the second focus detection pixel S2 as the number of pixels of the image sensor increases. In a state where the imaging optical system is in focus with respect to the subject, the outputs (image signals) obtained from the row including the first focus detection pixel S1 and the row including the second focus detection pixel S2 match each other.

  On the other hand, if the imaging optical system is out of focus, a phase difference occurs between the image signals obtained from the row including the first focus detection pixel S1 and the row including the second focus detection pixel S2. The direction of the phase difference is reversed between the front pin state and the rear pin state.

8A and 8B show the relationship between the focus state and the phase difference. In these figures, close together the two focus detection pixels S1, S2 shown in FIG. 5 are denoted by the respective A, and B. In addition, imaging pixels are omitted.

  The light beam from a specific point on the subject passes through the divided pupil corresponding to the focus detection pixel A, enters the focus detection pixel A, and passes through the divided pupil corresponding to the focus detection pixel B. It is divided into a light beam ΦLb incident on B. Since these two light beams are incident from the same point on the subject, when the imaging optical system is in focus, one point on the image sensor passes through the same microlens as shown in FIG. 8A. To reach. Accordingly, the image signals obtained from the row including the first focus detection pixel A (S1) and the row including the second focus detection pixel B (S2) respectively coincide with each other.

  However, as shown in FIG. 8B, in a state where the focus is shifted by x, the arrival positions of the two light beams ΦLa and ΦLb are shifted from each other by the change in the incident angle of the light beams ΦLa and ΦLb to the microlens. Therefore, there is a phase difference between the image signals obtained from the row including the first focus detection pixel A (S1) and the row including the second focus detection pixel B (S2).

  Using the above, the imaging apparatus disclosed in Patent Document 1 performs focus detection using an imaging element.

  However, when a still image is acquired using an image sensor including a focus detection pixel in this way, pixel data corresponding to the position of the focus detection pixel is lost. When the signal obtained from the focus detection pixel is used as an image signal for a still image, since the field of view of the focus detection pixel is different from the field of view of a normal imaging pixel, the signal from the focus detection pixel and the surrounding pixels The continuity with the signal is lost and a good image cannot be obtained.

In order to solve such a problem, in the imaging apparatus disclosed in Patent Document 1, an image signal corresponding to a signal from a focus detection pixel is interpolated using an image signal of its peripheral pixels.
JP 2000-156823 A

  However, as disclosed in Patent Document 1, when the image signal of the focus detection pixel is interpolated with the image signal of the peripheral pixel, an image acquired by the peripheral pixel is acquired by a pixel in another region. The sharpness may be lower than that of the image.

  In addition, when receiving a subject image with a low spatial frequency, the continuity of the image signal from the focus detection pixel with respect to the image signal from the peripheral imaging pixel is different from the visual field of the focus detection pixel and the peripheral imaging pixel. Becomes lower. For this reason, it is preferable to interpolate the image signal at the position of the focus detection pixel based on the image signal from the surrounding imaging pixels. In this case, since the spatial frequency of the subject image is low, the reduction in sharpness due to the interpolation processing is not noticeable.

  On the other hand, when a subject image having a high spatial frequency is received, the image signal at the position of the focus detection pixel is originally less continuous than the image signals from the surrounding imaging pixels. For this reason, the reduction in sharpness due to the interpolation processing becomes conspicuous. Therefore, as the number of focus detection pixels increases, the image area with low sharpness by interpolation processing increases, and the quality of the obtained image decreases.

Further, the phase difference sensor having different field provided on the image sensor, when performing focus detection based on the phase difference obtained by their phase difference sensor, provided with a stop for dividing the pupil in front of the phase difference sensor Yes. Further, the phase difference sensor is not provided with a color filter on the light incident surface. For these reasons, the image signal output from the phase difference sensor differs from the signal level of the pixels located in the periphery, and the image signal output from the phase difference sensor cannot be used as it is for still image data.

  By the way, in general, an image signal at a focal position with a large defocus amount has few high-frequency components. Conversely, the image signal at the focal position where the defocus amount is small has the highest number of high frequency components within the defocus range.

  The present invention provides an imaging apparatus capable of acquiring a high sharpness image even when the number of focus detection pixels in the imaging element increases, and a control method therefor.

  An imaging apparatus as one aspect of the present invention photoelectrically converts a first pixel group that photoelectrically converts a subject image formed by a light beam from an imaging optical system, and a split light beam among the light beams from the imaging optical system. An imaging device having a second pixel group including a plurality of focus detection pixels, focus detection means for detecting a focus state of the imaging optical system based on an output from the second pixel group, and the first pixel group Based on the output of the first pixel group, the frequency component detection means for detecting the spatial frequency component of the formed subject image and the partial image corresponding to the second pixel group among the images obtained by the output from the image sensor Image generating means for generating. Further, the imaging apparatus includes control means for switching whether or not to cause the image generation means to generate a partial image in accordance with the spatial frequency component detected by the frequency component detection means.

  According to another aspect of the present invention, there is provided a control method for an image pickup apparatus, the first pixel group for photoelectrically converting a subject image formed by a light beam from an image pickup optical system, and a division of a light beam from the image pickup optical system. It is a control method of an imaging device provided with an imaging device which has the 2nd pixel group containing a plurality of focus detection pixels which carry out photoelectric conversion of the emitted light beam. The control method includes detecting a focus state of the imaging optical system based on an output from the second pixel group, detecting a spatial frequency component of a subject image formed on the first pixel group, Generating a partial image corresponding to the second pixel group in the image obtained by the output from the image sensor based on the output of the first pixel group. Further, the control method includes a step of switching whether or not to generate a partial image according to the detected spatial frequency component.

  In the present invention, whether to generate a partial image corresponding to the second pixel group is switched according to the spatial frequency component of the subject image. For this reason, for example, by preventing the generation of the partial image when the spatial frequency of the subject image is high, an image with high sharpness can be obtained even if the number of focus detection pixels in the image sensor increases. Is possible.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows the configuration of a digital camera as an image pickup apparatus that is Embodiment 1 of the present invention.

  The camera 100 includes an imaging optical system 101 that forms a subject image from a subject by a light beam, a lens control unit 102 that controls the position of a focus lens (not shown) included in the imaging optical system 101, and the imaging optical system 101. And a diaphragm 103 for adjusting the amount of incident light. Furthermore, the camera 100 includes an image sensor 104 as a photoelectric conversion element configured by a CMOS sensor in which a subject image is formed on the light receiving surface by a light beam from the image pickup optical system 101.

  The imaging element 104 has a color filter of any one of R, G, and B, and is an imaging pixel group (consisting of a plurality of imaging pixels that photoelectrically convert a subject image formed by the imaging optical system 101 ( A first pixel group) 105. The imaging pixel group 105 outputs an image signal used for generating a subject image. Further, the image sensor 104 includes a focus detection pixel group (second pixel group) 106 that outputs a pair of image signals used for detection of the focus state (focus detection) of the imaging optical system 101.

  The focus detection pixel group 106 includes a plurality of first and second focus detection pixels that photoelectrically convert a light beam that has been pupil-divided by a pupil-division optical system 107 described later. A plurality of first focus detection pixels constitute a first phase difference sensor, and a plurality of second focus detection pixels constitute a second phase difference sensor. The first phase difference sensor outputs one image signal of the pair of image signals, and the second phase difference sensor outputs the other image signal of the pair of image signals.

  Further, the image sensor 104 includes a pupil division optical system 107 for causing each of the first phase difference sensor and the second phase difference sensor to make the pupil-divided light flux out of the light flux from the imaging optical system 101 incident. Yes.

  Here, FIG. 2 shows a pixel array of the image sensor 104 used in this embodiment. In FIG. 2, the first focus detection pixel in the focus detection pixel group 106 is indicated as S1, and the second focus detection pixel is indicated as S2.

  The structures of the first and second focus detection pixels S1 and S2 are the same as those shown in FIGS. That is, the light shielding layer provided in the first and second focus detection pixels S1 and S2 has a structure having a diaphragm opening at a symmetrical position across the optical axis of the microlens as the pupil division optical system 107. ing.

  In FIG. 2, a pixel row in which the first focus detection pixels S1 are discretely inserted constitutes a first phase difference sensor. In addition, the pixel row in which the second focus detection pixels S2 are discretely inserted is arranged at a second position with a predetermined interval (one pixel interval in FIG. 2) with respect to the first phase difference sensor. A phase difference sensor is configured. One focus detection pixel group (second pixel group) including these first and second phase difference sensors forms one focus detection area. In FIG. 2, a first focus detection area and a second focus detection area are arranged above and below the image sensor 104, respectively.

As shown in FIG. 1, the camera 100 includes a focus detection unit (focus detection unit) that obtains a phase difference between a pair of image signals output from the first and second phase difference sensors in each focus detection area using correlation calculation. ) 108.

  Here, “a pair of image signals output from the first and second phase difference sensors (in other words, the focus detection pixel group 106)” basically refers to only the output signals of the focus detection pixels S1 and S2. It is a pair of generated image signals. However, a pair of image signals may be generated from the output signals of the entire focus detection pixel group.

  The focus detection unit 108 further calculates a defocus amount indicating a focus state of the imaging optical system 101 with respect to a subject on which an image is formed in the focus detection area based on the phase difference.

  In the present embodiment, the case where the focus detection unit 108 calculates the defocus amount will be described. However, the focus detection unit 108 calculates the phase difference of the image signal, and the camera control unit 116 described later calculates the phase difference. The defocus amount may be calculated based on this. In this embodiment, the focus state is described as the defocus amount, but the phase difference may be handled as the focus state.

  In this manner, the focus detection unit 108 performs focus detection (defocus amount calculation) individually in each focus detection area.

In the focus detection pixel group 106 (first and second focus detection pixels S1 and S2), as can be seen from FIGS. 6 and 7, the field of view is limited by the light shielding layer provided for each pixel. Therefore, the level of the image signal from the focus detection pixel group 106 is the level of the image signal output from a plurality of pixels located in the vicinity of the focus detection pixel group 106 in the imaging pixel group 105 (hereinafter referred to as the neighborhood pixel group). (For example, it becomes lower) .

  Therefore, the camera 100 includes a gain adjustment unit 110 that adjusts the gain for the image signal from the focus detection pixel group 106 so that the image signal from the focus detection pixel group 106 approaches the level of the image signal of the neighboring pixel group. .

  In addition, the camera 100 includes a spatial frequency detection unit (frequency component detection unit) 109 that detects the intensity of a specific frequency component (high frequency component) included in an image signal from a neighboring pixel group (imaging pixel group 105). The high frequency component represents a spatial frequency component of the subject image formed on the neighboring pixel group (on the first pixel group).

  Further, the camera 100 includes a pixel interpolation unit (image generation unit) 111 that generates image data corresponding to the focus detection pixel group 106 by interpolating based on the output of the neighboring pixel group. In other words, the pixel interpolation unit 111 generates a partial image corresponding to the focus detection pixel group 106 in the entire image obtained by the output from the imaging element 104 based on the output of the imaging pixel group 105 (neighboring pixel group). To do.

  The “image data (partial image) corresponding to the focus detection pixel group 106” may be image data for an area covering the entire focus detection pixel group 106, or image data for each of the focus detection pixels S1 and S2. May be.

  The camera 100 also includes an image processing unit 112 that performs image processing such as gamma correction, white balance adjustment, display resampling, and image compression coding on the image signal output from the imaging pixel group 105.

  Furthermore, the camera 100 includes a display unit 113 that displays image data (still image data) output from the image processing unit 112, and a recording unit 114 that records the image data on a recording medium such as a semiconductor memory or an optical disk. In addition, the camera 100 includes an operation unit 115 that receives a user's operation input and a camera control unit 116 that controls the entire camera 100.

  Based on the defocus amount obtained from the focus detection unit 108, the camera control unit 116 calculates the drive amount of the focus lens for obtaining focus. The calculated drive amount is output to the lens control unit 102, and the lens control unit 102 moves the focus lens based on the drive amount. In this way, autofocus (AF) is performed, and the in-focus state of the imaging optical system 101 can be obtained.

  FIG. 3 shows the operation of the camera 100 (mainly the camera control unit 116) of the present embodiment. This operation is executed according to a computer program stored in a memory (not shown) in the camera control unit 116.

  The camera control unit 116 starts the operation from step S301 when an AF command signal from the operation unit 115 (for example, a signal output by half-pressing the release button) is input. Although not specifically described here, it is assumed that an imaging preparation operation such as an exposure calculation is performed in parallel with the AF operation.

  In step S <b> 301, the camera control unit 116 starts charge accumulation in the focus detection pixel group 106 in the image sensor 104. After completing the charge accumulation, the camera control unit 116 causes the focus detection pixel group 106 to output an image signal to the focus detection unit 108. The focus detection unit 108 calculates the defocus amount as described above and outputs it to the camera control unit 116. As described above, the camera control unit 116 calculates the driving amount of the focus lens and outputs it to the lens control unit 102 to move the focus lens toward the in-focus position.

  Since the exposure condition may have changed due to the change in the subject image after the focus lens is moved, the exposure calculation is performed again at the new focus lens position. Thereafter, the process proceeds to step S302.

  In step S <b> 302, the camera control unit 116 determines whether an imaging command signal (for example, a signal output when the release button is fully pressed) is input from the operation unit 115. If the imaging command signal is not input, the determination in this step is repeated. On the other hand, when the imaging command signal is input, the process proceeds to step S303.

  In step S <b> 303, the camera control unit 116 causes the image sensor 104 to start charge accumulation in the imaging pixel group 105 and the focus detection pixel group 106 for imaging to acquire a subject image. After the accumulation is completed, the camera control unit 116 outputs the image signal of the imaging pixel 105 to the spatial frequency detection unit 109 and the pixel interpolation unit 111, and the image signal of the focus detection pixel group 106 to the spatial frequency detection unit 109 and the gain adjustment unit 110. To output. After this output, the process proceeds to step S304.

  In step S304, the camera control unit 116 initializes a counter (n = 1). The numerical value n of the counter corresponds to the number of n focus detection areas provided on the image sensor 104.

Next, in step S305, the camera control unit 116 causes the spatial frequency detection unit 109 to detect a high frequency component from the image signal of the neighboring pixel group arranged in the vicinity of the focus detection pixel group 106 in the nth focus detection area . Then, the camera control unit 116 determines whether or not the intensity of the detected high frequency component is higher than a predetermined threshold (predetermined value). The determination is made by image data interpolation by the pixel interpolation unit 111 for generating image data in which the spatial frequency of the subject image formed in the nth focus detection area corresponds to this focus detection area (focus detection pixel group 106). This is a determination as to whether or not the value is such that a good overall image is obtained.

  Here, in many cases, an image signal (subject image) in a state where the defocus amount is large has few high-frequency components (low contrast). Conversely, the image signal in a state where the defocus amount is small (a state close to the in-focus state) has a high frequency component (contrast is high). As described above, when the image data interpolation performed by the pixel interpolation unit 111 is performed in a state where the spatial frequency of the subject image is low, the reduction in the sharpness of the image is not noticeable, but when the spatial interpolation is performed in a state where the spatial frequency of the subject image is high. The reduction in sharpness is noticeable.

  Therefore, in this embodiment, whether to perform the image data interpolation by the pixel interpolation unit 111 is switched according to the intensity of the spatial frequency of the subject image (the high frequency component of the image signal). That is, when the detected intensity is higher than the threshold, the process proceeds to step S306 without performing the image data interpolation, and when the detected intensity is lower than the threshold, the process proceeds to step S308 to perform the image data interpolation.

  In step S306, the camera control unit 116 compares the average image signal of the nth focus detection area (hereinafter referred to as the nth focus detection pixel group 106) with the average image signal of the neighboring pixel group. Then, the gain adjusting unit 110 adjusts the gain applied to the image signal of the nth focus detection pixel group 106 so that these signal levels are close to the same or the range where the signal levels can be regarded as the same. Note that the peak values of the image signals may be compared instead of comparing the average image signals of the pixel groups. After adjusting the gain in this way, the process proceeds to step S307.

  In step S307, the camera control unit 116 converts the image signal of the nth focus detection pixel group 106 that has been gain-adjusted in step S306 into a region corresponding to the nth focus detection pixel group 106 in the image signal of the imaging pixel group 105. (Or position). As a result, composite image data is generated in which an image based on the image signal from the imaging pixel group 105 and a partial image based on the image signal (image signal after gain adjustment) from the nth focus detection pixel group 106 are combined. The The camera control unit 116 outputs the composite image data to the image processing unit 112. Thereafter, the process proceeds to step S310.

  On the other hand, in step S308, the camera control unit 116 instructs the pixel interpolation unit 111 to perform interpolation corresponding to the nth focus detection pixel group 106 based on the image signal of the neighboring pixel group of the nth focus detection pixel group 106. Partial image data is generated by interpolation calculation. That is, the pixel interpolation unit 111 selects a partial image corresponding to the nth focus detection pixel group 106 out of the entire image obtained by the output from the imaging element 104 based on the output of the imaging pixel group 105 (neighboring pixel group). Generate.

Here, in this embodiment, due to the periodicity of the color filter arrangement of the imaging pixel group 105, it is necessary to interpolate a green component pixel signal particularly with respect to the focus detection pixels S1 and S2. Therefore, pixel signals corresponding to the positions of the focus detection pixels S1 and S2 are generated based on the signals of the green component pixels adjacent to the focus detection pixels S1 and S2 in the oblique direction in the neighboring pixel group in FIG. The neighboring pixels used for the interpolation are not limited to the green component pixels that are adjacent to the focus detection pixels S1 and S2 in the oblique direction. That is, the green component pixels that are further distant from each other may be used, and edge detection may be performed from the positional change in the signal level, and interpolation calculation may be performed in consideration of the edge position of the subject image.

  After the partial image data for interpolation is generated, the process proceeds to step S309.

  In step S309, the camera control unit 116 uses the image signal of the partial image data for interpolation for the nth focus detection pixel group 106 generated in step S308 as the nth focus detection pixel group in the image signal of the imaging pixel group 105. It is inserted into an area (or position) corresponding to 106. Thereby, composite image data in which an image based on the image signal from the imaging pixel group 105 and the partial image for interpolation with respect to the nth focus detection pixel group 106 are combined is generated. The camera control unit 116 outputs the composite image data to the image processing unit 112. Thereafter, the process proceeds to step S310.

  In step S310, the camera control unit 116 determines whether the processes in steps S305 to S309 have been completed for all (n) focus detection areas. If the processing has not been completed for all focus detection areas, the process proceeds to step S311 to increment the counter value by 1, and the process returns to step S305. As a result, the above processing for the next focus detection area is performed. On the other hand, if the above process is completed for all focus detection areas, the process proceeds to step S312.

  In step S312, the camera control unit 116 causes the image processing unit 112 to perform gamma correction, white balance adjustment, display resampling, and image compression encoding on the composite image data. The image processing unit 112 outputs the image data subjected to these processes to the display unit 113. The display unit 113 displays the image data so that the user can confirm the captured image.

  The image processing unit 112 also outputs the image data subjected to the above processing to the recording unit 114. The recording unit 114 records the image data on a recording medium.

  By the operation as described above, even if the number of focus detection pixels provided in the image sensor 104 is large, a good image having high sharpness can be acquired.

  FIG. 4 shows the configuration of a digital camera as an image pickup apparatus that is Embodiment 2 of the present invention. In the present embodiment, the same components as those in the first embodiment are denoted by the same reference numerals as those in the first embodiment, and the description is omitted.

  In the first embodiment, the case where the spatial frequency detection unit 109 that detects the intensity of the high frequency component of the image signal from the neighboring pixel group (the imaging pixel group 105) is described has been described. On the other hand, in the camera 400 of the present embodiment, a high-frequency component detection unit 401 a provided in the sharpness detection unit 401 as a focus evaluation unit is used instead of the spatial frequency detection unit 109.

  The high frequency component detection unit 401 a detects (extracts) a high frequency component included in the image signal from the imaging pixel group 105. Then, the sharpness detection unit 401 generates focus evaluation information (AF evaluation value signal) based on the high frequency component and outputs the focus evaluation information to the camera control unit 116. The focus evaluation information represents the contrast state of the subject image, in other words, the sharpness.

  The camera control unit 116 moves the focus lens to a position where the value of the focus evaluation information is maximized to obtain a focused state. This is a so-called contrast detection AF, and it is possible to obtain a focused state with higher accuracy and higher speed by combining with the AF using the phase difference described in the first embodiment (phase difference detection AF).

  For example, the camera control unit 116 first performs focus detection using the focus detection unit 108 described in the first embodiment, and moves the focus lens to the vicinity of the in-focus position. Next, the camera control unit 116 uses the focus evaluation information from the sharpness detection unit 401 to move the focus lens to a more accurate focus position.

  Further, the contrast detection AF is effective for maintaining a focused state when a moving image is captured by the camera 400.

  In this embodiment, the intensity of the high frequency component of the image signal from the neighboring pixel group obtained by the high frequency component detection unit 401a is compared with a predetermined threshold in step S305 in FIG. Thereby, the same effect as Example 1 can be acquired.

  In the present embodiment, the frequency range may be different between the high frequency component for which the intensity is determined in step S305 in FIG. 3 and the high frequency component used for generating the focus evaluation information. In this case, the filter coefficient of the filtering calculation performed for the frequency component detection in the high frequency component detection unit 401a is detected when detecting the high frequency component for determining the intensity and for generating the focus evaluation information. What is necessary is just to make it switch according to a case.

  The embodiments described above are merely representative examples, and various modifications and changes can be made to the embodiments when the present invention is implemented.

1 is a block diagram illustrating a configuration of a digital camera that is an embodiment of the present invention. The figure which shows the arrangement | sequence of the imaging pixel group in an Example, and a focus detection pixel group. The flowchart which shows operation | movement of the camera of an Example. FIG. 5 is a block diagram illustrating a configuration of a digital camera that is Embodiment 2 of the present invention. The figure which shows the arrangement | sequence of an imaging pixel group and a focus detection pixel group. The figure which shows the structure of a 1st focus detection pixel. The figure which shows the structure of a 2nd focus detection pixel. The schematic diagram for demonstrating the phase difference of the image signal according to a focus state (focusing state). The schematic diagram for demonstrating the phase difference of the image signal according to a focus state (front pin state).

Explanation of symbols

100 Digital camera (imaging device)
DESCRIPTION OF SYMBOLS 101 Imaging optical system 105 Imaging pixel group 106 Focus detection pixel group 107 Pupil division | segmentation optical system 109 Spatial frequency detection part 110 Gain adjustment part 111 Pixel interpolation part 112 Image processing part 116 Camera control part 400 Sharpness detection part 501 601 Micro lens 503 , 603 Light-shielding layer 504, 604 Photoelectric conversion region

Claims (5)

A second pixel group including a first pixel group that photoelectrically converts a subject image formed by a light beam from the imaging optical system, and a plurality of focus detection pixels that photoelectrically convert a divided light beam among the light beams from the imaging optical system; An image sensor having a pixel group;
Focus detection means for detecting a focus state of the imaging optical system based on an output from the second pixel group;
Frequency component detection means for detecting a spatial frequency component of a subject image formed on the first pixel group;
Image generating means for generating a partial image corresponding to the second pixel group in an image obtained by output from the imaging device based on the output of the first pixel group;
An imaging apparatus comprising: control means for switching whether to cause the image generation means to generate the partial image according to a spatial frequency component detected by the frequency component detection means.   The control unit does not cause the image generation unit to generate the partial image when the intensity of the spatial frequency component is higher than a predetermined value, and causes the image generation unit to generate the partial image when the intensity of the spatial frequency component is lower than the predetermined value. The imaging apparatus according to claim 1, wherein the partial image is generated. Adjustment means for performing gain adjustment on the output from the second pixel group;
The imaging apparatus according to claim 1, wherein the control unit causes the adjustment unit to perform the gain adjustment when the image generation unit does not generate the partial image. A focus evaluation unit that detects a frequency component included in the output from the first pixel group and generates focus evaluation information corresponding to a contrast state of the subject image;
The imaging apparatus according to claim 1, wherein the focus evaluation unit is used as the frequency component detection unit. A second pixel group including a first pixel group that photoelectrically converts a subject image formed by a light beam from the imaging optical system, and a plurality of focus detection pixels that photoelectrically convert a divided light beam among the light beams from the imaging optical system; A method for controlling an imaging device including an imaging device having a pixel group,
Detecting a focus state of the imaging optical system based on an output from the second pixel group;
Detecting a spatial frequency component of a subject image formed on the first pixel group;
Generating a partial image corresponding to the second pixel group in the image obtained by the output from the imaging element based on the output of the first pixel group;
And a step of switching whether or not to generate the partial image in accordance with the detected spatial frequency component.