JP6484004B2 - Imaging apparatus and control method thereof, imaging optical system and control method thereof - Google Patents

Description

The present invention relates to an imaging apparatus and a control method thereof , and an imaging optical system and a control method thereof, and more particularly to an automatic focus detection technique.

  As an automatic focus detection (AF) method for an imaging apparatus, a contrast AF method and a phase difference AF method are known. Both the contrast AF method and the phase difference AF method are AF methods that are often used in video cameras and digital still cameras, and there are devices in which an image sensor is used as a focus detection sensor. Since these AF methods perform focus detection using an optical image, the aberration of the optical system that forms the optical image may give an error to the focus detection result, and there is a method for reducing such an error. Proposed.

  On the other hand, it is known that the aberration of the master lens optical system when the converter lens is mounted is enlarged by the magnification of the converter lens.

  In Patent Literature 1, the focus detection correction amount is converted into the square of the imaging magnification of the converter lens, and the focus detection correction amount corresponding to the aberration of the optical system of the converter lens is further added to correct the focus detection result. A method is disclosed.

Japanese Patent No. 3345890

  However, the method of Patent Document 1 in which the focus detection error of the master lens is multiplied by the square of the magnification of the converter lens has a problem that the focus detection error cannot be sufficiently corrected. This is because the focus detection error of the converter lens is not only converted by the square of the magnification corresponding to the vertical magnification, but also changes the characteristics of the focus detection area and the imaging frequency characteristics depending on the horizontal magnification.

  In addition, the focus detection error is a difference between an aberration state in which the observer feels that the best focus state is originally in the captured image and an aberration state indicated by the focus detection result. However, even if the focus detection error amount is multiplied by the square of the correction amount as in the method described in Patent Document 1, the difference value of the aberration state after the converter lens is attached cannot be obtained correctly as the focus detection error amount.

  The present invention has been made in view of the above problems, and an object thereof is to accurately correct a focus detection error due to aberration of an optical system including a master lens and a converter lens.

In order to achieve the above object, an image pickup apparatus according to the present invention can perform automatic focus detection of a photographing optical system using an image signal obtained from a set focus detection region and can attach and detach a converter lens. When the converter lens is mounted, the information is related to the aberration of the imaging optical system, and each of the imaging optical systems has one modulation transfer function for each of a plurality of different spatial frequencies. The conversion means for converting the information on the image forming position based on the imaging magnification of the converter lens, and if the converter lens is not mounted, the information is related to the aberration of the imaging optical system not converted by the conversion means When the converter lens is mounted, the information related to the aberration converted by the conversion means is used to Correction means for calculating a correction value for correcting a difference in focus state due to a difference between a characteristic of a signal used to acquire a result of point detection and a characteristic of a signal of a shooting target image, and correction using the correction value Control means for controlling the position of a focus lens included in the photographing optical system based on the result of the automatic focus detection.

  According to the present invention, it is possible to accurately correct a focus detection error due to aberration of an optical system including a master lens and a converter lens.

The flowchart which shows AF operation | movement in embodiment. The flowchart which shows AF operation | movement in embodiment. 1 is a block diagram of a digital camera as an example of an imaging apparatus according to an embodiment. FIG. 3 is a diagram illustrating a configuration example of an image sensor in the embodiment. The figure which shows the relationship between the photoelectric conversion area | region and exit pupil in embodiment. FIG. 3 is a block diagram showing a configuration of a TVAF unit 130 in FIG. 2. The figure which shows the example of the focus detection area | region in embodiment. The flowchart of the vertical / horizontal BP correction value (BP1) calculation process in embodiment. The figure for demonstrating the vertical / horizontal BP correction value calculation process in embodiment. The figure for demonstrating the color BP correction value (BP2) calculation process in embodiment. The figure for demonstrating the spatial frequency BP correction value (BP3) calculation process in 1st Embodiment. The figure which shows the various spatial frequency characteristics in embodiment. The figure for demonstrating the spatial frequency BP correction value (BP3) calculation process in 2nd Embodiment. The flowchart for demonstrating the spatial frequency BP correction value (BP3) calculation process in 3rd Embodiment. 10 is a flowchart showing an AF operation in the fourth embodiment. 14 is a flowchart for explaining a BP correction value (BP) calculation process according to the fourth embodiment. The figure for demonstrating the BP correction value (BP) calculation process in 4th Embodiment. 14 is a flowchart for explaining a BP correction value (BP) calculation process in a modification of the fourth embodiment. The flowchart for demonstrating the BP correction value (BP) calculation process in 5th Embodiment. The figure for demonstrating the limit band process in 5th Embodiment. The block diagram of a digital camera as an example of the imaging device at the time of the converter lens mounting | wearing which concerns on 6th and 7th embodiment. The flowchart for demonstrating the spatial frequency BP correction value (BP3) calculation process in 6th Embodiment at the time of converter lens mounting | wearing. 10 is a flowchart for explaining a method for converting aberration information according to the magnification of a converter lens according to the sixth embodiment. The figure for demonstrating the aberration state after conversion by the magnification of the converter lens in 6th Embodiment. The figure for demonstrating the aberration information of the converter lens in 6th Embodiment. 15 is a flowchart for explaining a BP correction value (BP) calculation process in the seventh embodiment. The figure for demonstrating the BP correction value (BP) calculation process in 7th Embodiment. 15 is a flowchart for explaining a method for converting aberration information according to the magnification of a converter lens according to the seventh embodiment. The figure for demonstrating the aberration state after conversion by the magnification of the converter lens in 7th Embodiment.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings. The embodiments have specific and specific configurations to facilitate understanding and explanation of the invention, but the present invention is not limited to such specific configurations. For example, an embodiment in which the present invention is applied to a single-lens reflex digital camera capable of exchanging lenses will be described below, but the present invention can also be applied to a digital camera and video camera in which lenses cannot be interchanged. In addition, the present invention can be implemented with any electronic device equipped with a camera, such as a mobile phone, a personal computer (laptop, tablet, desktop type, etc.), a game machine, and the like.

● (first embodiment)

(Description of configuration of imaging apparatus-lens unit)
FIG. 2 is a block diagram illustrating a functional configuration example of a digital camera as an example of the imaging apparatus according to the embodiment. The digital camera of this embodiment is a lens interchangeable single-lens reflex camera, and includes a lens unit 100 and a camera body 120. The lens unit 100 is attached to the camera body 120 via a mount M indicated by a dotted line in the center of the figure.

  The lens unit 100 includes an optical system (a first lens group 101, a diaphragm 102, a second lens group 103, a focus lens group (hereinafter simply referred to as “focus lens”) 104), and a drive / control system. Thus, the lens unit 100 is a photographing lens that includes the focus lens 104 and forms an optical image of a subject.

  The first lens group 101 is disposed at the tip of the lens unit 100 and is held movably in the optical axis direction OA. The aperture 102 functions as a mechanical shutter that controls the exposure time during still image shooting, in addition to the function of adjusting the amount of light during shooting. The aperture 102 and the second lens group 103 are integrally movable in the optical axis direction OA, and a zoom function is realized by moving in conjunction with the first lens group 101. The focus lens 104 is also movable in the optical axis direction OA, and the subject distance (focus distance) at which the lens unit 100 is focused changes according to the position. By controlling the position of the focus lens 104 in the optical axis direction OA, focus adjustment for adjusting the in-focus distance of the lens unit 100 is performed.

  The drive / control system includes a zoom actuator 111, an aperture actuator 112, a focus actuator 113, a zoom drive circuit 114, an aperture drive circuit 115, a focus drive circuit 116, a lens MPU 117, and a lens memory 118.

  The zoom drive circuit 114 uses the zoom actuator 111 to drive the first lens group 101 and the third lens group 103 in the optical axis direction OA, and controls the angle of view of the optical system of the lens unit 100. The diaphragm drive circuit 115 drives the diaphragm 102 using the diaphragm actuator 112 and controls the aperture diameter and opening / closing operation of the diaphragm 102. The focus driving circuit 116 drives the focus lens 104 in the optical axis direction OA using the focus actuator 113, and controls the focusing distance of the optical system of the lens unit 100. The focus driving circuit 116 detects the current position of the focus lens 104 using the focus actuator 113.

  The lens MPU (processor) 117 performs all calculations and control related to the lens unit 100 and controls the zoom drive circuit 114, the aperture drive circuit 115, and the focus drive circuit 116. The lens MPU 117 is connected to the camera MPU 125 through the mount M, and communicates commands and data. For example, the lens MPU 117 detects the position of the focus lens 104 and notifies lens position information in response to a request from the camera MPU 125. This lens position information includes the position of the focus lens 104 in the optical axis direction OA, the position and diameter of the exit pupil in the optical axis direction OA when the optical system is not moving, and the optical axis of the lens frame that restricts the luminous flux of the exit pupil. Contains information such as position and diameter in direction OA. The lens MPU 117 controls the zoom drive circuit 114, the aperture drive circuit 115, and the focus drive circuit 116 in response to a request from the camera MPU 125. The lens memory 118 stores optical information necessary for automatic focus detection in advance. The camera MPU 125 controls the operation of the lens unit 100 by executing a program stored in, for example, a built-in nonvolatile memory or the lens memory 118.

(Explanation of imaging device configuration-camera body)
The camera body 120 includes an optical system (optical low-pass filter 121 and image sensor 122) and a drive / control system. The first lens group 101, the aperture 102, the second lens group 103, the focus lens 104 of the lens unit 100, and the optical low-pass filter 121 of the camera body 120 constitute a photographing optical system.

  The optical low-pass filter 121 reduces false colors and moire in the captured image. The image sensor 122 includes a CMOS image sensor and a peripheral circuit, and includes a plurality of pixels arranged in m pixels in the horizontal direction and n pixels in the vertical direction (n and m are integers of 2 or more). The image sensor 122 of the present embodiment has a pupil division function, and can perform phase difference AF using image data. The image processing circuit 124 generates data for phase difference AF and image data for display, recording, and contrast AF (TVAF) from the image data output from the image sensor 122.

  The drive / control system includes a sensor drive circuit 123, an image processing circuit 124, a camera MPU 125, a display 126, an operation switch group 127, a memory 128, a phase difference AF unit 129, and a TVAF unit 130.

  The sensor drive circuit 123 controls the operation of the image sensor 122, A / D converts the acquired image signal, and transmits it to the image processing circuit 124 and the camera MPU 125. The image processing circuit 124 performs general image processing performed by a digital camera, such as γ conversion, white balance adjustment processing, color interpolation processing, and compression coding processing, on the image data acquired by the image sensor 122.

  The camera MPU (processor) 125 performs all calculations and controls related to the camera body 120, and includes a sensor drive circuit 123, an image processing circuit 124, a display 126, an operation switch group 127, a memory 128, a phase difference AF unit 129, and a TVAF. The unit 130 is controlled. The camera MPU 125 is connected to the lens MPU 117 via the signal line of the mount M, and communicates commands and data with the lens MPU 117. The camera MPU 125 issues a lens position acquisition request, a diaphragm / focus lens / zoom drive request with a predetermined driving amount, an optical information acquisition request unique to the lens unit 100, and the like to the lens MPU 117. The camera MPU 125 includes a ROM 125a that stores a program for controlling camera operations, a RAM 125b that stores variables, and an EEPROM 125c that stores various parameters.

  The display 126 is configured by an LCD or the like, and displays information related to the shooting mode of the camera, a preview image before shooting and a confirmation image after shooting, a focus state display image at the time of focus detection, and the like. The operation switch group 127 includes a power switch, a release (shooting trigger) switch, a zoom operation switch, a shooting mode selection switch, and the like. A memory 128 as a recording unit of the present embodiment is a detachable flash memory, and records a captured image.

  The phase difference AF unit 129 performs focus detection processing by the phase difference detection method using the focus detection data obtained by the image processing circuit 124. More specifically, the image processing circuit 124 generates a pair of image data formed by a light beam passing through a pair of pupil regions of the photographing optical system as focus detection data, and the phase difference AF unit 129 The defocus amount is detected based on the image data shift amount. As described above, the phase difference AF unit 129 of the present embodiment performs phase difference AF (imaging surface phase difference AF) based on the output of the image sensor 122 without using a dedicated AF sensor. The operation of the phase difference AF unit 129 will be described in detail later.

  The TVAF unit 130 performs contrast type focus detection processing based on the TVAF evaluation value (contrast information of the image data) generated by the image processing circuit 124. In the contrast-type focus detection process, the focus lens 104 is moved and the focus lens position where the evaluation value reaches a peak is detected as the focus position.

  As described above, the digital camera according to the present embodiment can execute both phase difference AF and TVAF, and can be selectively used according to the situation or can be used in combination.

(Description of focus detection operation: phase difference AF)
Hereinafter, operations of the phase difference AF unit 129 and the TVAF unit 130 will be further described. First, the operation of the phase difference AF unit 129 will be described.

  FIG. 3A is a diagram showing a pixel arrangement of the image sensor 122 according to the present embodiment. The range of the vertical (Y direction) 6 rows and the horizontal (X direction) 8 columns of the two-dimensional CMOS area sensor is shown in the lens unit 100. The state observed from the side is shown. The image sensor 122 is provided with a Bayer color filter. The odd-numbered pixels have green (G) and red (R) color filters alternately from the left, and the even-numbered pixels sequentially from the left. Blue (B) and green (G) color filters are alternately arranged. In the pixel 211, a circle 211i represents an on-chip microlens, and a plurality of rectangles 211a and 211b arranged inside the on-chip microlens are photoelectric conversion units.

  In the image sensor 122 of this embodiment, the photoelectric conversion units of all the pixels are divided into two in the X direction, and the photoelectric conversion signals of the individual photoelectric conversion units and the sum of the photoelectric conversion signals can be read independently. Further, by subtracting the photoelectric conversion signal of one photoelectric conversion unit from the sum of the photoelectric conversion signals, a signal corresponding to the photoelectric conversion signal of the other photoelectric conversion unit can be obtained. The photoelectric conversion signal in each photoelectric conversion unit can be used as data for phase difference AF, or can be used to generate a parallax image constituting a 3D (3-Dimensional) image. The sum of photoelectric conversion signals can be used as normal captured image data.

  Here, a pixel signal when performing phase difference AF will be described. As will be described later, in the present embodiment, the exit lens of the photographing optical system is pupil-divided by the microlens 211i in FIG. 3A and the divided photoelectric conversion units 211a and 211b. Then, for a plurality of pixels 211 within a predetermined range arranged in the same pixel row, an output obtained by connecting the outputs of the photoelectric conversion unit 211a is combined and the output of the A image for AF and the output of the photoelectric conversion unit 211b are combined. This is an AF B image. As the outputs of the photoelectric conversion units 211a and 211b, pseudo luminance (Y) signals calculated by adding the outputs of green, red, blue, and green included in the unit array of the color filter are used. However, the AF A image and the B image may be knitted for each of red, blue, and green colors. By detecting the relative image shift amount between the AF A image and the B image generated in this way by correlation calculation, it is possible to detect the defocus amount (defocus amount) of the predetermined area. In the present embodiment, the sum of the output of one photoelectric conversion unit and the output of all the photoelectric conversion units is read from the image sensor 122. For example, when the output of the photoelectric conversion unit 211a and the sum of the outputs of the photoelectric conversion units 211a and 211b are read, the output of the photoelectric conversion unit 211b is obtained by subtracting the output of the photoelectric conversion unit 211a from the sum. Thereby, both an A image for AF and a B image can be obtained, and phase difference AF can be realized. Such an image sensor is known as disclosed in Japanese Patent Application Laid-Open No. 2004-134867, and thus further description of details is omitted.

  FIG. 3B is a diagram illustrating a configuration example of the readout circuit of the image sensor 122 of the present embodiment. Reference numeral 151 denotes a horizontal scanning circuit, and 153 denotes a vertical scanning circuit. In addition, horizontal scanning lines 152a and 152b and vertical scanning lines 154a and 154b are wired at the boundary between the pixels, and signals are read out to the photoelectric conversion units through these scanning lines.

  Note that the imaging device of the present embodiment has the following two types of readout modes in addition to the readout method in the pixel described above. The first readout mode is called an all-pixel readout mode and is a mode for capturing a high-definition still image. In this case, signals of all pixels are read out.

  The second readout mode is called a thinning readout mode, and is a mode for performing only moving image recording or preview image display. In this case, since the number of necessary pixels is smaller than that of all the pixels, the pixel group reads out only the pixels thinned out at a predetermined ratio in both the X direction and the Y direction. Similarly, when it is necessary to read out at high speed, the thinning-out reading mode is used similarly. When thinning out in the X direction, signal addition is performed to improve S / N, and thinning out in the Y direction ignores the signal output of the thinned out rows. The phase difference AF and the contrast AF are also usually performed based on the signal read in the second reading mode.

  FIG. 4 is a diagram for explaining the conjugate relationship between the exit pupil plane of the photographic optical system and the photoelectric conversion unit of the image sensor disposed near the center of the image plane, that is, in the vicinity of the center of the image plane, in the imaging apparatus of the present embodiment. The photoelectric conversion unit in the image sensor and the exit pupil plane of the photographing optical system are designed to have a conjugate relationship by an on-chip microlens. The exit pupil of the photographic optical system generally coincides with the surface on which the iris diaphragm for adjusting the amount of light is placed. On the other hand, the photographing optical system of the present embodiment is a zoom lens having a zooming function. However, depending on the optical type, when the zooming operation is performed, the distance and size of the exit pupil from the image plane change. FIG. 4 shows a state where the focal length of the lens unit 100 is at the center between the wide-angle end and the telephoto end. Using the exit pupil distance Zep in this state as a standard value, the optimum design of the eccentricity parameter according to the shape of the on-chip microlens and the image height (X, Y coordinates) is made.

  In FIG. 4A, 101 is a first lens group, 101 b is a lens barrel member that holds the first lens group, 104 is a focus lens, and 104 b is a lens barrel member that holds the focus lens 104. Reference numeral 102 denotes an aperture, reference numeral 102a denotes an aperture plate that defines an aperture diameter when the aperture is opened, and reference numeral 102b denotes an aperture blade for adjusting the aperture diameter when the aperture is closed. Note that reference numerals 101b, 102a, 102b, and 104b that act as limiting members for the light beam passing through the photographing optical system indicate optical virtual images when observed from the image plane. Further, the synthetic aperture in the vicinity of the stop 102 is defined as the exit pupil of the lens, and the distance from the image plane is Zep as described above.

  The pixel 211 is disposed in the vicinity of the center of the image plane, and is referred to as a central pixel in this embodiment. The central pixel 211 is composed of photoelectric conversion units 211a and 211b, wiring layers 211e to 211g, a color filter 211h, and an on-chip microlens 211i from the bottom layer. The two photoelectric conversion units are projected on the exit pupil plane of the photographing optical system by the on-chip microlens 211i. In other words, the exit pupil of the photographing optical system is projected onto the surface of the photoelectric conversion unit via the on-chip microlens 211i.

  FIG. 4B shows a projected image of the photoelectric conversion unit on the exit pupil plane of the photographing optical system, and the projected images on the photoelectric conversion units 211a and 211b are EP1a and EP1b, respectively. In the present embodiment, the image sensor 122 includes a pixel that can obtain the output of one of the two photoelectric conversion units 211a and 211b and the sum of both. The sum of both outputs is a photoelectric conversion of the light beam that has passed through both regions of the projection images EP1a and EP1b, which are almost the entire pupil region of the photographing optical system.

  In FIG. 4A, when the outermost part of the light beam passing through the photographing optical system is denoted by L, the light beam L is regulated by the aperture plate 102a of the diaphragm, and the projected images EP1a and EP1b are vignetted by the photographing optical system. Almost no occurrence. In FIG.4 (b), the light beam L of Fig.4 (a) is shown by TL. Since most of the projected images EP1a and EP1b of the photoelectric conversion unit are included in the circle indicated by TL, it can be seen that almost no vignetting occurs. Since the light beam L is limited only by the aperture plate 102a of the diaphragm, TL can be restated as 102a. At this time, the vignetting state of each of the projected images EP1a to EP1b is symmetric with respect to the optical axis at the center of the image plane, and the amount of light received by each of the photoelectric conversion units 211a and 211b is equal.

  When performing phase difference AF, the camera MPU 125 controls the sensor drive circuit 123 so as to read the above-described two types of outputs from the image sensor 122. Then, the camera MPU 125 gives information on the focus detection area to the image processing circuit 124, generates data for AF A and B images from the output of the pixels included in the focus detection area, and generates the phase difference AF unit 129. To supply to. The image processing circuit 124 generates AF A and B image data in accordance with this command and outputs it to the phase difference AF unit 129. The image processing circuit 124 also supplies RAW image data to the TVAF unit 130.

  As described above, the image sensor 122 constitutes a part of the focus detection apparatus for both the phase difference AF and the contrast AF.

  Here, as an example, the configuration in which the exit pupil is divided into two in the horizontal direction has been described. However, a configuration in which some of the pixels of the image sensor 122 are divided in the vertical direction may be used. Further, the exit pupil may be divided in both the horizontal and vertical directions. By providing pixels that divide the exit pupil in the vertical direction, phase difference AF corresponding to the contrast of the subject in the vertical direction as well as in the horizontal direction becomes possible.

(Description of focus detection operation: contrast AF)
Next, contrast AF (TVAF) will be described with reference to FIG. FIG. 5 is a block diagram showing the configuration of the TVAF unit 130. Contrast AF is realized by the camera MPU 125 and the TVAF unit 130 cooperating to repeatedly drive the focus lens 104 and calculate the evaluation value.

  When the RAW image data is input from the image processing circuit 124 to the TVAF unit 130, the AF evaluation signal processing circuit 401 extracts the green (G) signal from the Bayer array signal and emphasizes the low luminance component to increase the luminance. A gamma correction process for suppressing the component is performed. In this embodiment, a case where TVAF is performed using a green (G) signal will be described, but all signals of red (R), blue (B), and green (G) may be used. Further, a luminance (Y) signal may be generated using all RGB colors. The output signal generated by the AF evaluation signal processing circuit 401 is referred to as a luminance signal Y in the following description regardless of the type of signal used.

  It is assumed that a focus detection area is set in the area setting circuit 413 from the camera MPU 125. The region setting circuit 413 generates a gate signal that selects a signal in the set region. The gate signal is input to each circuit of the line peak detection circuit 402, the horizontal integration circuit 403, the line minimum value detection circuit 404, the line peak detection circuit 409, the vertical integration circuits 406 and 410, and the vertical peak detection circuits 405, 407, and 411. The Further, the timing at which the luminance signal Y is input to each circuit is controlled so that each focus evaluation value is generated by the luminance signal Y in the focus detection region. In the area setting circuit 413, a plurality of areas can be set in accordance with the focus detection area.

  A method for calculating the Y peak evaluation value will be described. The gamma-corrected luminance signal Y is input to the line peak detection circuit 402, and the Y line peak value for each horizontal line is obtained within the focus detection area set in the area setting circuit 413. The output of the line peak detection circuit 402 is peak-held in the vertical direction within the focus detection area by the vertical peak detection circuit 405, and a Y peak evaluation value is generated. The Y peak evaluation value is an effective index for determining a high brightness subject or a low illumination subject.

  A method for calculating the Y integral evaluation value will be described. The gamma-corrected luminance signal Y is input to the horizontal integration circuit 403, and an integral value of Y is obtained for each horizontal line within the focus detection area. Further, the output of the horizontal integration circuit 403 is integrated in the vertical direction in the focus detection region by the vertical integration circuit 406, and a Y integration evaluation value is generated. The Y integral evaluation value can be used as an index for determining the brightness of the entire focus detection area.

  A method for calculating the Max-Min evaluation value will be described. The gamma-corrected luminance signal Y is input to the line peak detection circuit 402, and the Y line peak value for each horizontal line is obtained within the focus detection area. Further, the luminance signal Y subjected to gamma correction is input to the line minimum value detection circuit 404, and the minimum value of Y is detected for each horizontal line in the focus detection area. The detected Y line peak value and minimum value for each horizontal line are input to the subtractor, and (line peak value−minimum value) is input to the vertical peak detection circuit 407. The vertical peak detection circuit 407 performs peak hold in the vertical direction within the focus detection area, and generates a Max-Min evaluation value. The Max-Min evaluation value is an effective index for determining low contrast and high contrast.

  A method for calculating the region peak evaluation value will be described. A specific frequency component is extracted from the gamma-corrected luminance signal Y through the BPF 408 to generate a focus signal. This focus signal is input to the line peak detection circuit 409, and the line peak value for each horizontal line is obtained within the focus detection area. The line peak value is peak-held in the focus detection area by the vertical peak detection circuit 411, and an area peak evaluation value is generated. The area peak evaluation value is an effective index for restart determination that determines whether or not to shift from the in-focus state to the process of searching for the in-focus point again because the change is small even when the subject moves within the focus detection area.

  A method for calculating the total line integral evaluation value will be described. Similar to the area peak evaluation value, the line peak detection circuit 409 obtains a line peak value for each horizontal line in the focus detection area. Next, the line peak value is input to the vertical integration circuit 410 and integrated with respect to the number of all horizontal scanning lines in the vertical direction within the focus detection area to generate an all-line integration evaluation value. The high-frequency all-line integral evaluation value is a main AF evaluation value because it has a wide dynamic range and high sensitivity due to the integration effect. Therefore, in this embodiment, when it is simply described as a focus evaluation value, it means an all-line integral evaluation value.

The AF control unit of the camera MPU 125 acquires each of the above-described focus evaluation values, and moves the focus lens 104 in a predetermined direction along the optical axis direction through the lens MPU 117. Then, the various evaluation values described above are calculated based on the newly obtained image data, and the focus lens position at which the total integrated evaluation value is the maximum value is detected.

  In the present embodiment, various AF evaluation values are calculated in the horizontal line direction and the vertical line direction by inputting each horizontal line and each vertical line to the TVAF unit 130 shown in FIG. Thereby, focus detection can be performed on the contrast information of the subject in two directions that are orthogonal to each other in the horizontal and vertical directions.

(Description of focus detection area)
FIG. 6 is a diagram illustrating an example of the focus detection area within the imaging range. As described above, both phase difference AF and contrast AF are performed based on signals obtained from pixels included in the focus detection area. In FIG. 6, a rectangle indicated by a dotted line indicates an imaging range 217 in which pixels of the image sensor 122 are formed. In the imaging range 217, focus detection areas 218ah, 218bh, and 218ch for phase difference AF are set. In the present embodiment, focus detection areas 218ah, 218bh, and 218ch for phase difference AF are set at a total of three locations, that is, the central portion of the imaging range 217 and two locations on the left and right. The focus detection areas 219a, 219b, and 219c for TVAF are set so as to include one of the focus detection areas 218ah, 218bh, and 218ch for phase difference AF. FIG. 6 is an example of setting the focus detection area, and the number, position, and size are not limited to those shown in the figure.

(Explanation of focus detection process flow)
Next, an automatic focus detection (AF) operation in the digital camera of this embodiment will be described with reference to FIGS. 1A and 1B. After the outline of the AF process is described, a detailed description will be given. In this embodiment, the camera MPU 125 first obtains the defocus amount (defocus amount) and the reliability of the defocus amount by applying the phase difference AF to each of the focus detection regions 218ah, 218bh, and 218ch. If the defocus amount having a predetermined reliability is obtained in all of the focus detection areas 218ah, 218bh, and 218ch, the camera MPU 125 moves the focus lens 104 to the in-focus position of the closest subject based on the defocus amount. Let

  On the other hand, when there is a focus detection area where a defocus amount having a predetermined reliability cannot be obtained, the camera MPU 125 acquires a focus evaluation value for the focus detection area for contrast AF including the focus detection area. Based on the change in the focus evaluation value and the relationship between the positions of the focus lens 104, the camera MPU 125 determines whether or not a subject exists closer to the subject distance corresponding to the defocus amount obtained by the phase difference AF. When it is determined that the subject is present on the closer side, the focus lens 104 is driven in the direction based on the change in the focus evaluation value.

  Note that if the focus evaluation value has not been obtained before, the amount of change in the focus evaluation value cannot be obtained. In that case, if there is a focus detection area in which the camera MPU 125 has a defocus amount that is larger than a predetermined defocus amount and has a predetermined reliability, the camera MPU 125 focuses on the closest subject in the focus detection region. The focus lens 104 is driven as described above. When a defocus amount having a predetermined reliability is not obtained, and when a defocus amount larger than a predetermined defocus amount is not obtained, the camera MPU 125 has a predetermined amount unrelated to the defocus amount. The focus lens 104 is driven. This is because when the focus lens 104 is driven based on a small defocus amount, it is highly likely that it is difficult to detect a change in the focus evaluation value at the next focus detection.

  When focus detection is finished by any method, the camera MPU 125 calculates various correction values and corrects the focus detection result. Then, the camera MPU 125 drives the focus lens 104 based on the corrected focus detection result.

  Details of the AF process described above will be described below with reference to the flowcharts shown in FIGS. 1A and 1B. The following AF processing operations are executed mainly by the camera MPU 125, unless other subjects are specified. When the camera MPU 125 drives and controls the lens unit 100 by transmitting a command or the like to the lens MPU 117, the operation subject may be described as the camera MPU 125 for the sake of brevity.

In S1, the camera MPU 125 sets a focus detection area. Here, it is assumed that three focus detection areas as shown in FIG. 6 are set for both phase difference AF and contrast AF. In S2, the camera MPU 125 sets a closeness determination flag in the RAM 125b to 1.

  In S3, the camera MPU 125 exposes the image sensor 122 to read out an image signal, and the image processing circuit 124 reads the image signal for phase difference AF based on the image data in the focus detection areas 218ah, 218bh, and 218ch for phase difference AF. Is generated. Further, the RAW image data generated by the image processing circuit 124 is supplied to the TVAF unit 130, and the TVAF unit 130 calculates the focus evaluation value based on the pixel data in the focus detection areas 219a, 219b, and 219c for TVAF. Here, when coordinates on the imaging surface are set as shown in FIG. 23A, (x, y) corresponding to the barycentric coordinates of each focus detection region is stored. In addition, before generating the image signal for phase difference AF, the image processing circuit 124 corrects the asymmetry of the exit pupil due to the vignetting of the light beam by the lens frame of the photographing lens (see Japanese Patent Application Laid-Open No. 2010-117679). May be applied. The focus evaluation value calculated by the TVAF unit 130 is stored in the RAM 125b in the camera MPU 125.

  In S4, the camera MPU 125 determines whether or not a reliable peak (maximum value) of the focus evaluation value is detected. If a reliable peak is detected, the camera MPU 125 advances the process to S20 to finish the focus detection process. The method for calculating the reliability of the peak of the focus evaluation value is not limited, but for example, a method described in FIGS. 10 to 13 of JP 2010-78810 A may be used. Specifically, whether the detected peak is the peak of a mountain, the difference between the maximum value and the minimum value of the focus evaluation value, the length of the portion that is inclined with an inclination of a certain value (SlopeThr) or more, and the inclination Judgment is made by comparing the slope of the current portion with the respective threshold values. If all the threshold values are satisfied, it can be determined that the peak is reliable.

  In the present embodiment, phase difference AF and contrast AF are used in combination. For this reason, if the presence of a closer subject is confirmed in the same focus detection area or another focus detection area, the focus evaluation value peak is detected even when a reliable focus evaluation value peak is detected. The process may be advanced to S5 without finishing the detection. However, in this case, the position of the focus lens 104 corresponding to the reliable focus evaluation value peak is stored, and the stored focus is obtained when a reliable focus detection result is not obtained in the processing after S5. The position of the lens 104 is a focus detection result.

  In S5, the phase difference AF unit 129 calculates a shift amount (phase difference) between the pair of image signals supplied from the image processing circuit 124 for each of the focus detection areas 218ch, 218ah, and 218bh, and the phase difference is stored in advance. Is converted to a defocus amount using the conversion factor. Here, the reliability of the calculated defocus amount is also determined, and only the defocus amount of the focus detection area determined to have the predetermined reliability is used in the subsequent AF processing. The phase difference detected between the pair of image signals includes more errors as the defocus amount increases due to the vignetting effect of the lens frame or the like. Therefore, when the obtained defocus amount is larger than the threshold value, when the degree of coincidence of the shape of the pair of image signals is low, or when the contrast of the image signals is low, the obtained defocus amount has a predetermined reliability. It can be determined that it is not (low reliability). Hereinafter, when it is determined that the obtained defocus amount has predetermined reliability, it is expressed as “the defocus amount has been calculated”. Further, when the defocus amount cannot be calculated for some reason, or when it is determined that the reliability of the defocus amount is low, it is expressed as “the defocus amount cannot be calculated”.

  In S6, the camera MPU 125 checks whether the defocus amount can be calculated in all of the focus detection areas 218ah, 218bh, and 218ch for phase difference AF set in S1. When the defocus amount can be calculated in all focus detection areas, the camera MPU 125 advances the process to S20, and among the calculated defocus amounts, the defocus amount indicating the closest subject is calculated. A vertical / horizontal BP correction value (BP1) is calculated for the focus detection area. Here, the reason for selecting the closest subject is that the subject that the photographer wants to focus on is often on the close side. The vertical / horizontal BP correction value (BP1) is the difference between the focus detection results when the focus detection is performed on the contrast of the subject in the horizontal direction and when the focus detection is performed on the contrast of the subject in the vertical direction. This is the value to be corrected.

  A general subject has contrast in both the horizontal direction and the vertical direction, and the evaluation of the focus state of the captured image is also made in view of the contrast in both the horizontal direction and the vertical direction. On the other hand, when focus detection is performed only in the horizontal direction as in the AF of the phase difference detection method described above, an error occurs between the focus detection result in the horizontal direction and the focus state in both the horizontal and vertical directions of the captured image. This error is caused by astigmatism of the photographing optical system. The vertical / horizontal BP correction value (BP1) is a correction value for correcting the error, and is calculated in consideration of the selected focus detection region, the position of the focus lens 104, the position of the first lens group 101 indicating the zoom state, and the like. Is done. Details of the calculation method will be described later.

  In S21, the camera MPU 125 calculates the color BP correction value (BP2) using the vertical or horizontal contrast information for the focus detection area that is the correction value calculation target in S20. The color BP correction value (BP2) is generated due to chromatic aberration of the photographing optical system, and is caused by the difference between the color balance of the signal used for focus detection and the color balance of the signal used for the photographed image or the developed image. For example, in the contrast AF of the present embodiment, the focus evaluation value is generated based on the output of a pixel (green pixel) having a green (G) color filter. Therefore, the focus position of the green wavelength is mainly detected. Become. However, since the captured image is generated using all RGB colors, focus evaluation is performed when the focus position of red (R) or blue (B) is different from green (G) (when axial chromatic aberration exists). Deviations (errors) occur from the focus detection result by value. The correction value for correcting the error is the color BP correction value (BP2). Details of the method for calculating the color BP correction value (BP2) will be described later.

  In S22, the camera MPU 125 uses the contrast information of the green signal or the luminance signal Y in the vertical direction or the horizontal direction with respect to the focus detection area to be corrected, and calculates the spatial frequency BP correction value (BP3) of a specific color. calculate. The spatial frequency BP correction value (BP3) is generated mainly by spherical aberration in the photographing optical system, and the difference between the evaluation frequency (band) of the signal used for focus detection and the evaluation frequency (band) when viewing the photographed image. Caused by. As described above, since the image signal at the time of focus detection is read from the image sensor in the second mode, the output signal is added or thinned out. For this reason, the output signal used for focus detection has a lower evaluation band than the captured image generated using the signals of all the pixels read in the first readout mode. It is the spatial frequency BP correction value (BP3) that corrects the focus detection shift caused by the difference between the evaluation bands. Details of the method of calculating the spatial frequency BP correction value (BP3) will be described later.

In S23, the camera MPU 125 corrects the focus detection result DEF_B by the following formula (1) using the calculated three types of correction values (BP1, BP2, BP3), and calculates the corrected focus detection result DEF_A. Note that the focus detection result DEF_B is the defocus amount when the focus detection result by the phase difference AF is used, the focus lens position corresponding to the peak of the focus evaluation value when the focus detection result by the contrast AF is used, and the current This is the difference from the focus lens position.
DEF_A = DEF_B + BP1 + BP2 + BP3 (1)

  In the present embodiment, the correction value for correcting the focus detection result is divided into three stages, and the vertical and horizontal (S20), color (S21), and spatial frequency (S22) are calculated.

  First, contrast in both vertical and horizontal directions is used for evaluation at the time of viewing a captured image, whereas focus detection calculates an error caused by using contrast information in one direction as a vertical and horizontal BP correction value (BP1). Next, the influence of the vertical / horizontal BP is separated, and the difference in focus position between the color of the signal used for the captured image and the color of the signal used for focus detection in the contrast information in one direction is expressed as a color BP correction value (BP2). Calculate as Further, with respect to a specific color such as green or a luminance signal in the contrast information in one direction, a spatial frequency BP correction value (a spatial frequency BP correction value ( BP3) is calculated. In this way, by calculating the three types of errors separately, the amount of calculation is reduced, and the data capacity stored in the lens or camera is reduced.

  In S <b> 24, the camera MPU 125 drives the focus lens 104 through the lens MPU 117 based on the corrected focus detection result DEF_A calculated by Expression (1).

  In S25, the camera MPU 125 superimposes the display (AF frame display) representing the defocus amount used to drive the focus lens 104 on the live view image, for example, and displays the focus detection area. finish.

  On the other hand, if there is a focus detection area where the defocus amount could not be calculated in S6, the camera MPU 125 advances the process to S7 in FIG. 1B. In S7, the camera MPU 125 determines whether or not the closeness determination flag is 1. The closeness determination flag is 1 when the focus lens has never been driven after the AF operation has started. If the focus lens drive is performed, the closeness determination flag is 0. If the closeness determination flag is 1, the camera MPU 125 advances the process to S8.

  If the camera MPU 125 cannot calculate the defocus amount in all focus detection areas in S8, or the defocus amount indicating the presence of the closest subject among the calculated defocus amounts is a predetermined threshold A. In the following cases, the process proceeds to S9. In S9, the camera MPU 125 drives the focus lens by a predetermined amount on the near side.

  Here, the reason why the predetermined amount of lens driving is performed in the case of Yes in S8 will be described. First, the case where there is no region where the defocus amount can be calculated among the plurality of focus detection regions is a case where no subject to be focused is found at the present time. Therefore, before determining that focusing is impossible, a predetermined amount of lens driving is performed to check the presence of a subject to be focused on in all focus detection areas, and a focus evaluation value described later is obtained. Enable to determine changes. Also, when the defocus amount indicating the presence of the closest subject in the calculated defocus amount is equal to or smaller than the predetermined threshold A, there is a focus detection region that is almost in focus at the present time. Is the case. In such a situation, a predetermined amount of lens drive is performed in order to confirm that there is a subject that is not detected at the present time closer to the focus detection area where the defocus amount could not be calculated. It is possible to determine a change in focus evaluation value. The predetermined amount for driving the focus lens in S9 may be determined in view of the sensitivity of the focus movement amount on the imaging surface to the F value of the photographing optical system and the lens driving amount.

  On the other hand, in the case of No in S8, that is, when the defocus amount indicating the presence of the closest subject in the calculated defocus amount is larger than the predetermined threshold A, the process proceeds to S10. In this case, there is a focus detection area where the defocus amount can be calculated, but the focus detection area is not in focus. Therefore, in step S10, the camera MPU 125 performs lens driving based on the defocus amount indicating the presence of the closest subject in the calculated defocus amount.

  After driving the lens in S9 or S10, the camera MPU 125 advances the process to S11, sets the closeness determination flag to 0, and returns the process to S3 in FIG. 1A.

  On the other hand, if the closeness determination flag is not 1 (0) in S7, the camera MPU 125 advances the process to S12. In S12, the camera MPU 125 determines whether or not the focus evaluation value of the focus detection area for TVAF corresponding to the focus detection area for which the defocus amount could not be calculated has changed by a predetermined threshold B or more before and after lens driving. . Although the focus evaluation value may increase or decrease, in S12, it is determined whether or not the absolute value of the change amount of the focus evaluation value is greater than or equal to a predetermined threshold B.

  Here, when the absolute value of the change amount of the focus evaluation value is equal to or greater than the predetermined threshold B, the defocus amount cannot be calculated, but the change in the blur state of the subject can be detected by increasing or decreasing the focus evaluation value. Means. Therefore, in the present embodiment, even when the defocus amount due to the phase difference AF cannot be detected, the presence of the subject is determined based on the increase / decrease of the focus evaluation value, and the AF process is continued. As a result, focus adjustment can be performed on a subject that has a large defocus amount and cannot be detected by phase difference AF.

  Here, the predetermined threshold B used for the determination is changed according to the lens driving amount. When the lens driving amount is large, a larger value is set for the threshold B than when the lens driving amount is small. This is because when the subject exists, the amount of change in the focus evaluation value increases as the lens driving amount increases. The threshold value B for each lens driving amount is stored in the EEPROM 125c.

  When the absolute value of the change amount of the focus evaluation value is equal to or greater than the threshold value B, the camera MPU 125 advances the process to S13, and the focus detection area where the change amount of the focus evaluation value is equal to or greater than the threshold value B indicates the presence of the infinite object. It is determined whether or not only the focus detection area. When the focus detection area indicates the presence of an object at infinity, the focus evaluation value decreases when the lens drive direction is close, or the focus evaluation value increases when the lens drive direction is infinity. It is.

  When the focus detection area where the change amount of the focus evaluation value is equal to or greater than the threshold B is not only the focus detection area indicating the presence of the infinity side subject, the camera MPU 125 advances the process to S14 and drives a predetermined amount of lens to the near side. Do. This is because there is a focus detection area indicating the presence of the near-side subject in the focus detection area where the change amount of the focus evaluation value is equal to or greater than the threshold value B. The reason for giving priority to the closest side is as described above.

  On the other hand, in S13, when the focus detection area where the change amount of the focus evaluation value is greater than or equal to the threshold B is only the focus detection area indicating the presence of the infinity side subject, the camera MPU 125 advances the process to S15. In step S15, the camera MPU 125 determines whether there is a focus detection area in which the defocus amount can be calculated. When there is a focus detection area where the defocus amount can be calculated (Yes in S15), the camera MPU 125 prioritizes the result of the phase difference AF over the presence of the infinitely far side object based on the focus evaluation value. To S20 of FIG. 1A.

  When there is no focus detection area where the defocus amount can be calculated (No in S15), the information indicating the presence of the subject is only the change in the focus evaluation value. Therefore, the camera MPU 125 drives a predetermined amount of lens toward the infinity side in S16 based on the change in the focus evaluation value, and returns the process to S3 in FIG. 1A.

  The predetermined amount of lens driving performed in S14 and S16 may be determined in view of the defocus amount that can be detected by the phase difference AF. Although the defocus amount that can be detected differs depending on the subject, a lens drive amount is set in advance so that the subject cannot be detected and passed by the lens drive from a state where the focus cannot be detected.

  If the absolute value of the change amount of the focus evaluation value is less than the predetermined threshold B (No in S12), the camera MPU 125 advances the process to S17 and determines the presence or absence of a focus detection region where the defocus amount can be calculated. If there is no focus detection area in which the defocus amount can be calculated, the camera MPU 125 advances the process to S18, drives the lens to a predetermined fixed point, and further advances the process to S19 to focus on the display 126. Display is performed and the AF process is terminated. This is a case where there is no focus detection area where the defocus amount can be calculated, and there is no focus detection area where the focus evaluation value changes before and after lens driving. In such a case, since there is no information indicating the presence of the subject, the camera MPU 125 determines that focusing cannot be performed and ends the AF process.

  On the other hand, if there is a focus detection area in which the defocus amount can be calculated in S17, the camera MPU 125 proceeds to S20 in FIG. 1A to correct the detected defocus amount (S20 to S23). The focus lens 104 is driven to the focal position. Thereafter, the camera MPU 125 displays the focus on the display 126 in S25, and ends the AF process.

(Calculation method of vertical / horizontal BP correction value)
Next, a method for calculating the vertical / horizontal BP correction value (BP1) performed in S20 of FIG. 1A will be described with reference to FIGS. FIG. 7 is a flowchart showing details of the calculation process of the vertical / horizontal BP correction value (BP1).

  In S100, the camera MPU 125 acquires vertical / horizontal BP correction information corresponding to the focus detection area set in advance in S1. The vertical / horizontal BP correction information is difference information on the vertical focus position with respect to the horizontal focus position. In the present embodiment, the vertical / horizontal BP correction information is stored in advance in the lens memory 118 of the lens unit 100, and the camera MPU 125 requests and acquires the lens MPU 117. However, it may be stored in the nonvolatile area of the RAM 125b in association with the lens unit identification information.

  FIG. 8A shows an example of vertical / horizontal BP correction information. Here, an example of the vertical and horizontal BP correction information corresponding to the central focus detection areas 219a and 218ah in FIG. 6 is shown, but the vertical and horizontal BP correction information is also stored for the other focus detection areas 219c and 218ch and 219b and 218bh. ing. However, the focus detection correction values of the focus detection areas existing at symmetrical positions across the optical axis of the photographing optical system are equal in design. In the present embodiment, since the focus detection areas 219c, 218ch and 219b, 218bh satisfy such a target relationship, only one of them may store the vertical / horizontal BP correction information. If the correction value does not change greatly depending on the position of the focus detection area, it may be stored as a common value.

  In the example shown in FIG. 8A, the zoom position (field angle) and focus lens position (focus distance) of the photographing optical system are divided into eight zones, and focus detection correction values BP111 to BP188 are stored for each zone. ing. As the number of divided zones increases, a highly accurate correction value corresponding to the position of the first lens group 101 and the position of the focus lens 104 of the photographing optical system can be obtained. The vertical / horizontal BP correction information can be used for both contrast AF and phase difference AF.

  In this way, in S100, the camera MPU 125 acquires correction values corresponding to the zoom position and the focus lens position according to the focus detection result that is the correction target.

  In step S101, the camera MPU 125 determines whether a reliable focus detection result is obtained in either the horizontal direction or the vertical direction in the focus detection area to be corrected. The method of determining the reliability of the focus detection result is as described above for both the phase difference AF and the contrast AF. Since the phase difference AF of this embodiment only performs focus detection in the horizontal direction, it is contrast AF that provides a reliable focus detection result in both the horizontal and vertical directions. For this reason, the following description regarding the vertical / horizontal BP correction value is based on the assumption of contrast AF. However, similar processing may be performed when focus detection of phase difference AF is performed in both horizontal and vertical directions. If it is determined in S101 that the horizontal and vertical focus detection results are reliable, the camera MPU 125 advances the process to S102.

  In S102, the camera MPU 125 determines whether or not the difference between the focus detection result in the horizontal direction and the focus detection result in the vertical direction is appropriate. This is a process performed to deal with the perspective conflict problem that occurs when an object at a distance close to an object at a distance is included in the focus detection area. For example, when a far subject has a contrast in the horizontal direction and a near subject has a contrast in the vertical direction, the absolute value is larger than the error caused by astigmatism of the photographing optical system or the sign is opposite. Differences in focus detection results may occur. If the difference between the horizontal focus detection result and the vertical focus detection result is larger than the predetermined determination value C, the camera MPU 125 determines that the difference is not valid (conflicts between near and far). Then, the horizontal direction or the vertical direction is selected as the direction indicating the closer focus detection result, and the process proceeds to S104. Note that the determination value C may be uniquely determined as a value that greatly exceeds a difference that may occur due to aberrations or the like, or may be set using the correction information obtained in S100.

  If it is determined in S102 that the difference between the focus detection result in the horizontal direction and the focus detection result in the vertical direction is appropriate, the camera MPU 125 advances the process to S106.

  On the other hand, if there is reliability in only one horizontal or vertical direction in S101, or if only one horizontal or vertical direction is selected in S102, the camera MPU 125 advances the process to S104. In S104, the camera MPU 125 selects the direction of the focus detection result. A direction in which a reliable focus detection result is calculated or a direction in which a focus detection result corresponding to a subject on the closer side is calculated in the perspective conflict determination is selected.

  Next, in step S105, the camera MPU 125 determines whether weighting in the horizontal direction and the vertical direction is possible. When S105 is executed, a reliable focus detection result in both the horizontal direction and the vertical direction is not obtained from the viewpoint of reliability of the focus evaluation value and perspective conflict, but the vertical and horizontal BP correction values are calculated. The determination to do is performed again. The reason for this will be described in detail with reference to FIG.

  FIG. 8B is a diagram showing an example of the relationship between the position of the focus lens 104 in the selected focus detection region and the focus evaluation value. Curves E_h and E_v in the figure show changes in the horizontal focus evaluation value and the vertical focus evaluation value detected by contrast AF. LP1, LP2, and LP3 each indicate a focus lens position. In FIG. 8B, LP3 is obtained as a reliable focus detection result from the horizontal focus evaluation value E_h, and LP1 is obtained as a reliable focus detection result from the vertical focus evaluation value E_v. Is shown. Since LP1 and LP3 are greatly different from each other, it is determined that they are in a perspective conflict state, and the focus detection result LP3 in the horizontal direction, which is the focus detection result on the closer side, is selected in S104.

  In such a situation, in S105, the camera MPU 125 determines whether or not there is a vertical focus detection result in the vicinity of the selected horizontal focus detection result LP3. Since LP2 exists in the situation as shown in FIG. 8B, the camera MPU 125 determines that weighting in the horizontal and vertical directions is possible, proceeds to S106, and sets the correction value of the focus detection result LP3 as the focus. Calculation is performed taking into consideration the influence of the detection result LP2.

In S100, BP1_B, which is one element of FIG. 8A, is acquired as the vertical and horizontal BP correction information, the horizontal focus evaluation value in LP3 in FIG. 8B is E_hp, and the vertical focus evaluation value in LP2 is the vertical focus evaluation value. It is assumed that E_vp. In this case, in S106, the camera MPU 125 calculates the vertical / horizontal BP correction value BP1 according to the following equation (2) based on the ratio of the focus evaluation value in the direction orthogonal to the correction direction to the total focus evaluation value.
BP1 = BP1_B × E_vp / (E_vp + E_hp) × (+1) (2)

In the present embodiment, in order to calculate a correction value for the focus detection result in the horizontal direction, the correction value BP1 is calculated using Equation (2). However, when correcting the focus detection result in the vertical direction, the following equation is used. It can be calculated in (3).
BP1 = BP1_B × E_hp / (E_vp + E_hp) × (−1) (3)

  When it is determined in S102 that the difference between the focus detection result in the horizontal direction and the focus detection result in the vertical direction is appropriate, if the focus detection result on the near side is the detection result in the horizontal direction, Equation (2) is obtained. If the detection result is, the correction value BP1 is calculated using Equation (3).

  As is obvious from Expressions (2) and (3), information indicating that the focus evaluation value is large is determined to be a large amount of contrast information included in the subject, and the vertical and horizontal BP correction value (BP1) is calculated. As described above, the vertical and horizontal BP correction information is

(Focus detection position of a subject having contrast information only in the vertical direction)-(Focus detection position of a subject having contrast information only in the horizontal direction)
It is. Therefore, the signs of the correction value BP1 for correcting the focus detection result in the horizontal direction and the correction value BP1 for correcting the focus detection result in the vertical direction are opposite. When the process of S106 is completed, the camera MPU 125 ends the vertical / horizontal BP correction value calculation process.
On the other hand, if it is determined in S105 that there is no vertical focus detection result in the vicinity of the selected horizontal focus detection result LP3, the camera MPU 125 advances the process to S103. In step S103, the camera MPU 125 determines that the contrast information included in the subject is substantially only in one direction, and thus sets BP1 = 0 and ends the vertical / horizontal BP correction value calculation processing.

  Thus, in this embodiment, since the correction value is calculated according to the contrast information of the subject in different directions, it is possible to calculate the correction value with high accuracy according to the pattern of the subject. In FIG. 8B, the case where the subject is competing for perspective has been described, but the maximum value is detected one by one in the horizontal direction and the vertical direction, and the focus detection result on one side is not reliable. Also, the correction value is calculated in the same way.

  However, the correction value calculation method in S106 is not limited to this. For example, when focus detection can be performed only in the horizontal direction as in the phase difference AF of the present embodiment, the correction value is calculated on the assumption that the amount of contrast information in the horizontal direction and the vertical direction of the subject is the same. May be. In that case, the correction value can be calculated by substituting E_hp = E_vp = 1 in the above-described equations (2) and (3). By performing such processing, the correction accuracy is reduced, but the load of correction value calculation can be reduced.

  In the above description, the focus detection result of contrast AF has been described, but the same processing can be performed on the focus detection result of phase difference AF. As a weighting coefficient when calculating the correction value, a change amount of the correlation amount calculated by the correlation calculation of the phase difference AF may be used. This utilizes the fact that the amount of change in the correlation amount increases as the contrast information of the subject increases, such as when the contrast of the subject is large or the number of edges having the contrast is large. As long as the evaluation value can obtain the same relationship, various evaluation values may be used without being limited to the change amount of the correlation amount.

  As described above, by correcting the focus detection result using the vertical and horizontal BP correction values, it is possible to perform highly accurate focus detection regardless of the amount of contrast information for each direction of the subject. Further, since the correction values in the horizontal direction and the vertical direction are calculated using the common correction information as shown in FIG. 8A, the correction values are corrected as compared with the case where each correction value is stored for each direction. The storage capacity of information can be reduced.

  In addition, when the focus detection results for each direction are greatly different, the influence of perspective conflict can be reduced by not calculating the vertical and horizontal BP correction values using these focus detection results. Furthermore, even when perspective conflict is assumed, more accurate correction can be performed by weighting the correction value based on the magnitude of the focus evaluation value for each direction.

(Calculation method of color BP correction value)
Next, a method for calculating the color BP correction value (BP2) performed in S21 of FIG. 1A will be described with reference to FIG. FIG. 9A is a flowchart showing details of the calculation process of the color BP correction value (BP2).

  In S200, the camera MPU 125 acquires color BP correction information corresponding to the focus detection area set in advance in S1. The color BP correction information is information on the difference in focus position detected using signals of other colors (red (R), blue (B)) with respect to the focus position detected using the green (G) signal. It is. In this embodiment, the color BP correction information is stored in advance in the lens memory 118 of the lens unit 100, and the camera MPU 125 is requested and acquired from the lens MPU 117, but is stored in the nonvolatile area of the RAM 125b. Also good.

  As the number of divided zones increases, a highly accurate correction value corresponding to the position of the first lens group 101 and the position of the focus lens 104 of the photographing optical system can be obtained. The color BP correction information can be used for both contrast AF and phase difference AF.

  In S200, the camera MPU 125 acquires correction values corresponding to the zoom position and the focus lens position according to the focus detection result to be corrected. FIGS. 9B and 9C show examples of color BP correction values. Here, an example of the color BP correction information corresponding to the central focus detection areas 219a and 218ah in FIG. 6 is shown, but the color BP correction information is also stored for the other focus detection areas 219c and 218ch and 219b and 218bh. ing. However, the focus detection correction values of the focus detection areas existing at symmetrical positions across the optical axis of the photographing optical system are equal in design. In the present embodiment, since the focus detection areas 219c, 218ch and 219b, 218bh satisfy such a target relationship, color BP correction information may be stored for only one of them. If the correction value does not change greatly depending on the position of the focus detection area, it may be stored as a common value.

In step S201, the camera MPU 125 calculates a color BP correction value. In S200, when BP_R is acquired from FIG. 9B and BP_B is acquired from FIG. 9C, the camera MPU 125 calculates the color BP correction value BP2 according to the following equation (4).
BP2 = K_R × BP_R + K_B × BP_B (4)

  K_R and K_B are coefficients for the correction information of each color. For a subject that contains many red colors, K_R takes a large value and is blue for a value that correlates with the magnitude relationship of red (R) and blue (B) information with respect to green (G) information contained in the subject. For a subject that contains many colors, K_B takes a large value. For a subject containing a lot of green, both K_R and K_B take small values. K_R and K_B may be set in advance based on spectral information representative of the subject. When the spectral information of the subject can be detected, K_R and K_B may be set according to the spectral information of the subject. When the calculation of the color BP correction value is finished in S201, the camera MPU 125 ends the color BP correction value calculation process.

  In the present embodiment, correction values are stored in a table format for each focus detection area as shown in FIGS. 8A, 9B, and 9C. However, it is not limited to this. For example, as shown in FIG. 23A, coordinates are set with the intersection of the image sensor 122 and the optical axis of the imaging optical system as the origin, and the horizontal and vertical directions of the imaging device as the X axis and Y axis, respectively. The correction value at the center coordinate of the focus detection area may be obtained by a function of X and Y. In this case, the amount of information to be stored as the focus detection correction value can be reduced.

  In the present embodiment, the correction value used for focus detection calculated using the vertical / horizontal BP correction information and the color BP correction information is calculated based on the spatial frequency information of the subject pattern. Therefore, highly accurate correction can be performed without increasing the amount of correction information to be stored. However, the correction value calculation method is not limited to this. Similar to the method of calculating the spatial frequency BP correction value described later, a correction value that matches the spatial frequency component of the subject may be calculated using vertical / horizontal BP correction information and color BP correction information for each spatial frequency.

(Calculation method of spatial frequency BP correction value)
Next, a method of calculating the spatial frequency BP correction value (BP3) performed in S22 of FIG. 1A will be described using FIG. FIG. 10A is a flowchart showing details of the calculation processing of the spatial frequency BP correction value (BP3).

  In S300, the camera MPU 125 acquires spatial frequency BP correction information corresponding to the focus detection area set in advance in S1. The spatial frequency BP correction information is information relating to the imaging position of the photographing optical system for each spatial frequency of the subject. In this embodiment, the spatial frequency BP correction information is stored in advance in the lens memory 118 of the lens unit 100, and the camera MPU 125 is requested and acquired from the lens MPU 117, but is stored in the nonvolatile area of the RAM 125b. May be.

  In this embodiment, the spatial frequency BP correction information is stored for each focus detection area. However, the correction value storage method is not limited to this. For example, as shown in FIG. 23A, coordinates are set with the intersection of the image sensor and the optical axis of the imaging optical system as the origin, and the horizontal and vertical directions of the image sensor 122 as the X axis and the Y axis, respectively. The correction value at the center coordinate of the focus detection area may be obtained by a function of X and Y. In this case, the amount of information to be stored as the focus detection correction value can be reduced.

An example of the spatial frequency BP correction information will be described with reference to FIG. 10B showing a defocus modulation transfer function (MTF) of the photographing optical system. In FIG. 10B, the horizontal axis indicates the position of the focus lens 104, and the vertical axis indicates the intensity of the MTF. The four types of curves depicted in FIG. 10B are MTF curves for each spatial frequency and indicate the higher spatial frequency in the order of MTF1, MTF2, MTF3, and MTF4. The MTF curve of the spatial frequency F1 (lp / mm) corresponds to MTF1, and similarly, the spatial frequencies F2, F3, and F4 (lp / mm) correspond to MTF2, MTF3, and MTF4, respectively. Further, LP4, LP5, LP 6, LP 7 shows the position of the focus lens 104 corresponding to the maximum value of the defocus MTF curve. The stored spatial frequency BP correction information is obtained by discretely sampling the curve of FIG. As an example, in the present embodiment, MTF data is sampled at 10 focus lens positions with respect to one MTF curve. For example, MTF1 (n) (1 ≦ n ≦ 10) is 10 for MTF1. Data is stored.

  Spatial frequency BP correction information, like vertical and horizontal BP correction information and color BP correction information, has eight zones for the zoom position (view angle) and focus lens position (focus distance) of the photographing optical system for each position of the focus detection area. Divide and store for each zone. As the number of divided zones increases, a highly accurate correction value corresponding to the position of the first lens group 101 and the position of the focus lens 104 of the photographing optical system can be obtained. The spatial frequency BP correction information can be used for both contrast AF and phase difference AF.

  In S300, the camera MPU 125 acquires correction values corresponding to the zoom position and the focus lens position according to the focus detection result to be corrected. In step S <b> 301, the camera MPU 125 calculates a band of a signal used when performing contrast AF or phase difference AF in the focus detection area to be corrected. In this embodiment, the camera MPU 125 calculates the AF evaluation band in view of the influence of the subject, the photographing optical system, the sampling frequency of the image sensor, and the digital filter used for evaluation. A method for calculating the AF evaluation band will be described later.

  Next, in S302, the camera MPU 125 calculates a band of a signal used for the captured image. Similar to the calculation of the AF evaluation band in S302, the camera MPU 125 calculates the shot image evaluation band in consideration of the frequency characteristics of the subject, the shooting optical system, and the image sensor, and the influence of the evaluation band of the viewer of the shot image.

  Here, the calculation of the AF evaluation band and the captured image evaluation band performed in S301 and S302 will be described with reference to FIG. FIG. 11 shows the intensity for each spatial frequency, with the horizontal axis indicating the spatial frequency and the vertical axis indicating the intensity.

  FIG. 11A shows the spatial frequency characteristic (I) of the subject. F1, F2, F3, and F4 on the horizontal axis are spatial frequencies corresponding to the MTF curves (MTF1 to MTF4) in FIG. Nq represents the Nyquist frequency determined by the pixel pitch of the image sensor 122. F1 to F4 and Nq are similarly shown in FIGS. 11B to 11F described later. In this embodiment, a representative value stored in advance is used as the spatial frequency characteristic (I) of the subject. In FIG. 11A, the spatial frequency characteristic (I) of the subject is drawn as a continuous curve, but a discrete value I (n) (1 ≦ n ≦ 4) corresponding to the spatial frequencies F1, F2, F3, and F4. ).

  In this embodiment, the representative value stored in advance as the spatial frequency characteristic of the subject is used. However, the spatial frequency characteristic of the subject to be used may be changed according to the subject for which focus detection is performed. The spatial frequency information (power spectrum) of the subject can be obtained by applying FFT processing or the like to the captured image signal. In this case, the calculation processing increases, but since a correction value corresponding to the subject for which focus detection is actually performed can be calculated, focus detection with high accuracy is possible. Further, several types of spatial frequency characteristics stored in advance may be properly used depending on the magnitude of the contrast information of the subject.

  FIG. 11B is a spatial frequency characteristic (O) of the photographing optical system. This information may be obtained through the lens MPU 117 or may be stored in the RAM 125b in the camera. The stored information may be a spatial frequency characteristic for each defocus state or only a spatial frequency characteristic at the time of focusing. Since the spatial frequency BP correction value is calculated in the vicinity of in-focus, correction can be performed with high accuracy by using the spatial frequency characteristics at the time of in-focus. However, although the calculation load increases, focus adjustment can be performed with higher accuracy by using the spatial frequency characteristics for each defocus state. What defocus state spatial frequency characteristic to use may be selected using the defocus amount obtained by the phase difference AF. In FIG. 11B, the spatial frequency characteristic (O) of the photographic optical system is drawn as a continuous curve, but a discrete value O (n) (1 ≦ n) corresponding to the spatial frequencies F1, F2, F3, and F4. ≦ 4).

  FIG. 11C shows the spatial frequency characteristic (L) of the optical low-pass filter 121. This information is stored in the RAM 125b in the camera. In FIG. 11C, the spatial frequency characteristic (L) of the optical low-pass filter 121 is drawn as a continuous curve, but the discrete value L (n) (1) corresponding to the spatial frequencies F1, F2, F3, and F4. ≦ n ≦ 4).

  FIG. 11D shows spatial frequency characteristics (M1, M2) by signal generation. As described above, the image sensor of this embodiment has two types of readout modes. In the first readout mode, that is, the all-pixel readout mode, the spatial frequency characteristics do not change during signal generation, as indicated by M1. On the other hand, in the second reading mode, that is, the thinning-out reading mode, the spatial frequency characteristic changes at the time of signal generation as indicated by M2. As described above, a signal is added at the time of decimation in the X direction to improve the S / N, so that a low-pass effect due to the addition occurs. M2 in FIG. 11D indicates a spatial frequency characteristic during signal generation in the second readout mode. Here, the influence of thinning is not taken into account, and the low-pass effect by addition is shown. In FIG. 11D, the spatial frequency characteristics (M1, M2) due to signal generation are drawn by continuous curves, but discrete values M1 (n), M2 (corresponding to the spatial frequencies F1, F2, F3, F4 ( n) (1 ≦ n ≦ 4).

  FIG. 11E shows the spatial frequency characteristic (D1) indicating the sensitivity for each spatial frequency when viewing a captured image and the spatial frequency characteristic (D2) of the digital filter used when processing the AF evaluation signal. Sensitivity for each spatial frequency at the time of appreciating a photographed image is affected by individual differences among viewers, viewing environment such as image size, viewing distance, and brightness. In this embodiment, the sensitivity for each spatial frequency during viewing is set and stored as a representative value. On the other hand, in the second readout mode, aliasing noise (aliasing) of the frequency component of the signal occurs due to the influence of thinning. In consideration of the influence, D2 shows the spatial frequency characteristics of the digital filter. In FIG. 11 (e), the spatial frequency characteristic (D1) at the time of viewing and the spatial frequency characteristic (D2) of the digital filter are drawn as curves, but are discrete values corresponding to the spatial frequencies F1, F2, F3, and F4. D1 (n), D2 (n) (1 ≦ n ≦ 4).

As described above, by storing various pieces of information in either the camera or the lens, the camera MPU 125 sets the evaluation band W1 and AF evaluation band W2 of the captured image to the following equations (5) and (6). Calculate based on
W1 (n) = I (n) × O (n) × L (n) × M1 (n) × D1 (n)
(1 ≦ n ≦ 4) (5)
W2 (n) = I (n) * O (n) * L (n) * M2 (n) * D2 (n)
(1 ≦ n ≦ 4) (6)

  FIG. 11F shows the evaluation band W1 and AF evaluation band W2 of the captured image. Quantifying the degree of influence of each spatial frequency on the factor that determines the in-focus state of the captured image by performing calculations such as Expression (5) and Expression (6) Can do. Similarly, it is possible to quantify how much influence the error of the focus detection result has for each spatial frequency.

  The information stored in the camera may store W1 and W2 calculated in advance. As described above, by calculating each correction, the correction value can be calculated flexibly when the digital filter or the like used for AF evaluation is changed. On the other hand, if they are stored in advance, calculations such as Equation (5) and Equation (6) and the storage capacity of various data can be reduced.

  In addition, since it is not necessary to finish all calculations in advance, for example, only the spatial frequency characteristics of the photographing optical system and the subject are calculated in advance and stored in the camera, thereby reducing the data storage capacity and the calculation amount. May be reduced.

  In FIG. 11, in order to simplify the description, the description has been made using discrete values corresponding to the four spatial frequencies (F1 to F4). However, as the number of spatial frequencies having data increases, the spatial frequency characteristics of the captured image and the AF evaluation band can be accurately reproduced, and the correction value can be calculated with high accuracy. On the other hand, the amount of calculation can be reduced by reducing the spatial frequency for weighting. It is also possible to have one spatial frequency representative of the spatial frequency characteristics of the evaluation band of the photographed image and the AF evaluation band, and perform subsequent calculations.

Returning to FIG. 10A, in step S303, the camera MPU 125 calculates a spatial frequency BP correction value (BP3). When calculating the spatial frequency BP correction value, the camera MPU 125 first calculates the defocus MTF (C1) of the captured image and the defocus MTF (C2) of the focus detection signal. C1 and C2 are calculated according to the following equation (7) using the defocus MTF information obtained in S300 and the evaluation bands W1 and W2 obtained in S301 and S302.
C1 (n) = MTF1 (n) × W1 (1) + MTF2 (n) × W1 (2) + MTF3 (n) × W1 (3) + MTF4 (n) × W1 (4) (7)
C2 (n) = MTF1 (n) × W2 (1) + MTF2 (n) × W2 (2) + MTF3 (n) × W2 (3) + MTF4 (n) × W2 (4) (8)

  In this way, the defocus MTF information for each spatial frequency shown in FIG. 10B is added based on the captured image calculated in S301 and S302 and the weight of the AF evaluation band, and the defocus MTF of the captured image is added. (C1) and AF defocus MTF (C2) are obtained. FIG. 10 (c) shows two obtained defocus MTFs C1 and C2. The horizontal axis represents the position of the focus lens 104, and the vertical axis represents the MTF value obtained by weighted addition for each spatial frequency. The camera MPU 125 detects the local maximum position of each MTF curve. P_img is detected as the position of the focus lens 104 corresponding to the maximum value of the curve C1. P_AF is detected as the position of the focus lens 104 corresponding to the maximum value of the curve C2.

In S303, the camera MPU 125 calculates the spatial frequency BP correction value (BP3) by the following equation (9).
BP3 = P_AF−P_img (9)

  According to Expression (9), it is possible to correct a correction value for correcting an error that may occur between the focus position of the captured image and the focus position detected by AF.

  As described above, the in-focus position of the captured image is determined by the spatial frequency characteristics of the subject, the imaging optical system, and the optical low-pass filter, the spatial frequency characteristics at the time of signal generation, and the spatial frequency characteristics indicating the sensitivity for each frequency during viewing. It varies depending on the image processing applied to the photographed image. In the present embodiment, the in-focus position of the photographed image can be calculated with high accuracy by calculating the spatial frequency characteristics going back to the process of generating the photographed image. For example, the in-focus position of the photographed image is changed by the recording size of the photographed image, super-resolution processing performed by image processing, sharpness, or the like. In addition, after recording a photographed image, the degree of image size and the magnification rate at which the image is viewed, the viewing distance for viewing, and the like affect the evaluation band of the viewer. As the image size becomes larger and the viewing distance becomes shorter, the focus position of the photographed image is also changed by setting the appreciator's evaluation band to emphasize the high frequency component.

  On the other hand, the in-focus position detected by AF also varies depending on the spatial frequency characteristics of the subject, the imaging optical system, and the optical low-pass filter, the spatial frequency characteristics at the time of signal generation, the digital filter spatial frequency characteristics used for AF evaluation, etc. To do. In the present embodiment, the in-focus position detected by the AF can be calculated with high accuracy by calculating the spatial frequency characteristics going back to the process of generating the signal used for the AF. For example, it is possible to flexibly cope with AF in the first reading mode. In that case, the weighting coefficient may be calculated by changing the spatial frequency characteristic at the time of signal generation to a characteristic corresponding to the first readout mode.

  In addition, since the imaging apparatus described in this embodiment is a lens interchangeable single-lens reflex camera, the lens unit 100 can be replaced. When the lens unit 100 is replaced, the lens MPU 117 transmits defocus MTF information corresponding to each spatial frequency to the camera body 120. Since the camera MPU 125 calculates the in-focus position of the captured image and the in-focus position detected by the AF, it is possible to calculate a highly accurate correction value for each interchangeable lens. The lens unit 100 may transmit not only the defocus MTF information but also information such as the spatial frequency characteristics of the photographing optical system to the camera body 120. The method of using the information is as described above.

  Similarly, when the camera body 120 is replaced, the pixel pitch, the characteristics of the optical low-pass filter, and the like may change. As described above, even in such a case, a correction value that matches the characteristics of the camera body 120 is calculated, so that correction can be performed with high accuracy.

  In the above description, the correction value is calculated by the camera MPU 125, but may be calculated by the lens MPU 117. In that case, the camera MPU 125 may transmit various information described with reference to FIG. 11 to the lens MPU 117, and the lens MPU 117 may calculate a correction value using the defocus MTF information or the like. In this case, the lens MPU 117 may correct the focus position transmitted from the camera MPU 125 and drive the lens in S24 of FIG. 1A.

  In the present embodiment, the correction value for AF is calculated by paying attention to the characteristics (vertical and horizontal, color, spatial frequency band) of the signal used for focus detection. Therefore, the correction value can be calculated by the same method regardless of the AF method. Since it is not necessary to have a correction method and data used for correction for each AF method, it is possible to reduce data storage capacity and calculation load.

● (Second Embodiment)
Next, a second embodiment of the present invention will be described. The main difference from the first embodiment is that the calculation method of the spatial frequency BP correction value is different. In the first embodiment, the defocus MTF information is used as a value representing the characteristic for each spatial frequency of the photographing optical system. However, since the defocus MTF information has a large amount of data, a large storage capacity, and a large calculation load, in the second embodiment, the spatial frequency BP correction value is calculated using the maximum value information of the defocus MTF. Thereby, it is possible to save the capacity of the lens memory 118 or the RAM 125b, to reduce the communication capacity between the lens and the camera, and to reduce the calculation load performed by the camera MPU 125.

The block diagram of the imaging apparatus (FIG. 2), the explanatory diagrams of the respective focus detection methods (FIGS. 3 to 5), the explanatory diagram of the focus detection area (FIG. 6), the flowchart of the focus detection process and various BP correction value calculation processes. (FIGS. 1A and 1B , FIG. 7, and FIG. 9A) are also used in this embodiment. The flowchart of the spatial frequency BP correction value calculation process (FIG. 10A) and the explanatory diagram of each evaluation band (FIG. 11) are also used.

  A method of calculating the spatial frequency BP correction value (BP3) in the present embodiment will be described with reference to FIG. In S300, the camera MPU 125 acquires spatial frequency BP correction information.

  FIG. 12 shows the position of the focus lens 104 indicating the maximum value of the defocus MTF for each spatial frequency, which is a characteristic of the photographing optical system. For the discrete spatial frequencies F1 to F4 shown in FIG. 10B, the focus lens positions LP4, LP5, LP6, and LP7 at which the defocus MTF reaches a peak (maximum value) are shown on the vertical axis. In this embodiment, these LP4 to LP7 are stored in the lens memory 118 or the RAM 125b as MTF_P (n) (1 ≦ n ≦ 4). As in the first embodiment, the stored information corresponds to the position of the focus detection area, the zoom position, and the focus lens position.

  In the second embodiment, in S300 of the spatial frequency BP correction value processing shown in FIG. 10A, the camera MPU 125 corresponds to the zoom position and the focus lens position corresponding to the focus detection result that is the correction target. Get the correction value. In S301 and S302, the camera MPU 125 performs the same processing as in the first embodiment.

In S303, the camera MPU 125 calculates a spatial frequency BP correction value (BP3). When calculating the spatial frequency BP correction value, the camera MPU 125 first calculates the in-focus position (P_img) of the captured image and the in-focus position (P_AF) detected by the AF according to the following equations (10) and (11). To do. For the calculation, the defocus MTF information MTF_P (n) obtained in S300 and the evaluation bands W1 and W2 obtained in S301 and S302 are used.
P_img = MTF_P (1) × W1 (1) + MTF_P (2) × W1 (2) + MTF_P (3) × W1 (3) + MTF_P (4) × W1 (4) (10)
P_AF = MTF_P (1) × W2 (1) + MTF_P (2) × W2 (2) + MTF_P (3) × W2 (3) + MTF_P (4) × W2 (4) (11)

  That is, the maximum value information MTF_P (n) of the defocus MTF for each spatial frequency shown in FIG. 12 is weighted and added with the captured image calculated in S301 and S302 and the AF evaluation bands W1 and W2. Thereby, the focus position (P_img) of the captured image and the focus position (P_AF) detected by the AF are calculated.

Next, the camera MPU 125 calculates the spatial frequency BP correction value (BP3) by the following equation (9), as in the first embodiment.
BP3 = P_AF−P_img (9)

  As described above, according to the second embodiment, the spatial frequency BP correction value can be calculated more easily. In the second embodiment, the accuracy of the spatial frequency BP correction value is slightly inferior to that of the first embodiment, but the amount of information stored for calculating the spatial frequency BP correction value is reduced, and communication between the lens and the camera is performed. Reduction of the amount and calculation load performed by the camera MPU 125 can be realized.

● (Third embodiment)
Next, a third embodiment of the present invention will be described. This embodiment is also different from the above-described embodiment in the method of calculating the spatial frequency BP correction value. In this embodiment, the calculation is not performed when there is no need to calculate the spatial frequency BP correction value, thereby reducing the communication capacity between the lens and the camera and the camera MPU 125 without reducing the accuracy of the spatial frequency BP correction value. Reduce the computational load performed by.

The block diagram of the imaging apparatus (FIG. 2), the explanatory diagrams of the respective focus detection methods (FIGS. 3 to 5), the explanatory diagram of the focus detection area (FIG. 6), the flowchart of the focus detection process and various BP correction value calculation processes. (FIGS. 1A and 1B , FIG. 7, and FIG. 9A) are also used in this embodiment. In addition, the diagrams related to the spatial frequency BP correction value calculation processing (FIGS. 10B to 10C) are also used.

  A method of calculating the spatial frequency BP correction value (BP3) in the third embodiment will be described with reference to the flowchart of FIG. In FIG. 13, the same processes as those in FIG. 10A are denoted by the same reference numerals, and redundant description is omitted.

  In S3000, the camera MPU 125 determines whether it is necessary to calculate a spatial frequency BP correction value. As can be seen from the description in the first embodiment, the spatial frequency BP correction value becomes smaller as the evaluation band W1 and AF evaluation band W2 of the captured image are similar. Therefore, in the third embodiment, when it is determined that the difference between the two evaluation bands is small enough that the spatial frequency BP correction value need not be calculated, the calculation of the correction value is omitted.

  Specifically, the calculation of the correction value is omitted when the condition that the difference between the two evaluation bands is sufficiently small is satisfied. For example, when the signal used for AF is also a signal read in the first reading mode, the evaluation band of the captured image is equal to the AF evaluation band. Furthermore, when a digital filter having a spatial frequency characteristic similar to the spatial frequency characteristic indicating the sensitivity for each spatial frequency when viewing a captured image is used when processing the AF evaluation signal, the spatial frequency characteristic during viewing and the digital filter Spatial frequency characteristics are equal. Such a situation occurs when an image to be displayed on the display 126 is enlarged and displayed.

  Similarly, when the captured image is generated with a signal read in the second readout mode, it is assumed that the evaluation band of the captured image is equal to the AF evaluation band. Such a situation occurs when the recording image size of the captured image is set small.

  In S3000, the camera MPU 125 determines that the calculation of the correction value is unnecessary when any of the predetermined conditions is satisfied, and advances the process to S3001. In step S3001, since the camera MPU 125 does not calculate the correction value, 0 is assigned to BP3, and the spatial frequency BP correction value (BP3) calculation process ends.

  On the other hand, when it is determined in S3000 that the correction value needs to be calculated, the camera MPU 125 performs S300 to S303 in the same manner as in the first embodiment (or the second embodiment).

  As described above, in the third embodiment, when it is determined that the calculation of the spatial frequency BP correction value is unnecessary, the calculation of the correction value is omitted, and thus the amount of data stored for calculating the correction value is reduced. Although not possible, it is possible to reduce the amount of data communication and the calculation load when calculating the correction value. It is also possible to combine with the second embodiment. In this case, not only the amount of data stored for calculating the correction value but also the data communication amount and calculation load when calculating the correction value are further reduced. be able to.

  In this embodiment, the omission of the spatial frequency BP correction value has been described. However, the vertical / horizontal BP correction value and the color BP correction value can also be omitted if it can be determined that they are unnecessary. For example, when focus detection is performed in consideration of both vertical and horizontal contrasts, calculation of the vertical and horizontal BP correction values may be omitted. If the color signal used for the captured image is the same as the color signal used for focus detection, the calculation of the color BP correction value may be omitted.

● (Fourth embodiment)
Next, a fourth embodiment of the present invention will be described. The main difference from the first embodiment is that the calculation method of various BP correction values is different. In the first embodiment, the vertical / horizontal BP correction value, the color BP correction value, and the spatial frequency BP correction value are calculated as different correction values. However, since the vertical / horizontal BP correction value and the color BP correction value depend on the spatial frequency to some extent, in the fourth embodiment, the vertical / horizontal BP correction value and the color BP correction value are also calculated in consideration of the spatial frequency. As a result, the required capacity of the lens memory 118 or the RAM 125b increases, but the correction value can be calculated with higher accuracy. Further, the amount of calculation can be reduced by changing the order of calculation in calculating the BP correction value, information on the coefficient to be temporarily stored, and the like.

  The block diagram of the imaging device (FIG. 2), the explanatory diagrams of each focus detection method (FIGS. 3 to 5), the explanatory diagram of the focus detection area (FIG. 6), and the explanatory diagram of each evaluation band (FIG. 11) Since it is common also in 4th Embodiment, it also diverts in the following description.

  A method for calculating a BP correction value (BP) in the fourth embodiment will be described with reference to FIGS.

  In FIG. 14, the same reference numerals as those in FIG. 1A are given to those performing the same process as the focus detection process in the first embodiment. 14 differs from FIG. 1A in that S20 to S22 are replaced with S400, and the process of S23 is replaced with S401. In S400, the camera MPU 125 calculates a BP correction value (BP) for collectively correcting various error factors such as direction (vertical and horizontal), color, and spatial frequency.

In step S401, the camera MPU 125 corrects the focus detection result DEF_B by the following equation (12) using the calculated BP correction value (BP), and calculates the corrected focus detection result DEF_A.
DEF_A = DEF_B + BP (12)

  In the present embodiment, each of the six spatial frequency combinations of the three colors R (red), G (green), and B (blue) and two directions of vertical (vertical) and horizontal (horizontal) is combined. A BP correction value is calculated using information on the position of the focus lens 104 indicating the maximum value of the focus MTF. As a result, the spatial frequency dependency can be taken into consideration for the color and direction (vertical and horizontal), and a more accurate BP correction value can be calculated, so that the correction accuracy can be improved.

  FIG. 15 is a flowchart showing details of the BP correction value calculation processing in S400 of FIG.

  In S500, the camera MPU 125 acquires parameters (calculation conditions) necessary for calculating the BP correction value. As described in the first embodiment, the BP correction value is a change in the photographing optical system such as the position of the focus lens 104, the position of the first lens group 101 indicating the zoom state, the position of the focus detection area, or the focus adjustment optics. It changes as the system changes. For this reason, the camera MPU 125 acquires information on the position of the focus lens 104, the position of the first lens group 101 indicating the zoom state, and the position of the focus detection area in S500, for example. Further, in step S500, the camera MPU 125 acquires setting information regarding the color and evaluation direction of the signal used for focus detection and the signal used for the captured image.

FIG. 16A shows an example of setting information related to color and evaluation direction. This setting information is information indicating the weighting level for each combination of contrast direction (horizontal and vertical) and color (red, green and blue) for evaluating the focus state. The setting information has different information for the focus detection and the captured image. For example, when correcting the result of contrast AF using a green signal in the horizontal direction, setting information for focus detection is
K_AF_RH = 0
K_AF_GH = 1
K_AF_BH = 0
K_AF_RV = 0
K_AF_GV = 0
K_AF_BV = 0
It may be determined as follows. With such setting information, it can be shown that the defocus MTF peak information of the focus detection signal is the same as the characteristics of the green signal in the horizontal direction.

On the other hand, the setting information for captured images is
K_IMG_RH = 0.15
K_IMG_GH = 0.29
K_IMG_BH = 0.06
K_IMG_RV = 0.15
K_IMG_GV = 0.29
K_IMG_BV = 0.06
It may be determined as follows. This is a value that is set on the assumption that weighting is performed to convert RGB signals into Y signals, the captured images are evaluated with Y signals, and the contrast in both the horizontal and vertical directions is evaluated equally. It is. However, the setting value and the type of the setting value are not limited to this.

  In step S501, the camera MPU 125 determines whether there is a change in a peak coefficient described later. This determination is performed in order to omit recalculation of the peak coefficient when various conditions in the BP correction value calculation performed in advance and the current BP correction value calculation are the same. In this embodiment, the camera MPU 125 determines that there is no change in the peak coefficient if there is no change in the setting information (FIG. 16 (a)) regarding the color for focus detection and for the captured image and the position of the focus detection area. , S502 to S504 are skipped, and the process proceeds to S505.

In S501, when calculating the peak coefficient for the first time or when it is determined that the peak coefficient has been changed, the camera MPU 125 advances the process to S502 and acquires BP correction information. The BP correction information is information regarding the imaging position of the photographing optical system for each spatial frequency of the subject. Each of the above-described six combinations of the three colors and the two directions is expressed by the following formula (13) using the spatial frequency f and the position (x, y) of the focus detection area on the image sensor 122 as variables. .
MTF_P_RH (f, x, y) = (rh (0) × x + rh (1) × y + rh (2)) × f ² + (rh (3) × x + rh (4) × y + rh (5)) × f + (rh ( 6) × x + rh (7) × y + rh (8)) (13)

  The expression (13) shows the expression of the information MTF_P_RH of the focus lens 104 position indicating the maximum value of the defocus MTF for each spatial frequency corresponding to the horizontal (H) direction for the red (R) signal. Other combinations are also expressed by the same formula. In this embodiment, rh (n) (0 ≦ n ≦ 8) is stored in advance in the lens memory 118 of the lens unit 100, and the camera MPU 125 requests the lens MPU 117 to rh (n) (0 ≦ n). ≦ 8) shall be obtained. However, rh (n) (0 ≦ n ≦ 8) may be stored in the nonvolatile area of the RAM 125b.

  Coefficients (rv, gh, gv, bh, bv) in each combination of red and vertical (MTF_P_RV), green and horizontal (MTF_P_GH), green and vertical (MTF_P_GV), blue and horizontal (MTF_P_BH), blue and vertical (MTF_P_BV) Is also stored in the same way.

In step S503, the camera MPU 125 weights the obtained BP correction information regarding the position of the focus detection region, the color of the evaluation signal, and the contrast direction. First, the camera MPU 125 calculates BP correction information using information on the position of the focus detection area when calculating the BP correction value. Specifically, the position information of the focus detection area is substituted into x and y in Expression (13). By this calculation, the expression (13) is expressed in the form of the following expression (14).
MTF_P_RH (f) = Arh × f ² + Brh × f + Crh (14)

  The camera MPU 125 similarly calculates MTF_P_RV (f), MTF_P_GH (f), MTF_P_GV (f), MTF_P_BH (f), and MTF_P_BV (f). These correspond to defocus MTF intermediate information.

  FIG. 16B shows an example of the BP correction information after the position information of the focus detection area is substituted in S502. The horizontal axis indicates the spatial frequency, and the vertical axis indicates the maximum value of the defocus MTF. It represents the position (peak position). As shown in the figure, when the chromatic aberration is large, the curves for each color are deviated, and when the vertical and horizontal differences are large, the horizontal and vertical curves in the figure are deviated. As described above, the fourth embodiment has defocus MTF information corresponding to the spatial frequency for each combination of color (RGB) and evaluation direction (H and V). Thereby, highly accurate BP correction value calculation is enabled.

Next, in S503, the camera MPU 125 weights the twelve coefficients (FIG. 16A) constituting the setting information acquired in S500 using the BP correction information. Thereby, the setting information is weighted with respect to the color and direction to be evaluated by focus detection and imaging. Specifically, the camera MPU 125 calculates a spatial frequency characteristic MTF_P_AF (f) for focus detection and a spatial frequency characteristic MTF_P_IMG (f) for a captured image using equations (15) and (16).
MTF_P_AF (f) =
K_AF_RH × MTF_P_RH (f)
+ K_AF_RV × MTF_P_RV (f)
+ K_AF_GH × MTF_P_GH (f)
+ K_AF_GV × MTF_P_GV (f)
+ K_AF_BH × MTF_P_BH (f)
+ K_AF_BV × MTF_P_BV (f) (15)
MTF_P_IMG (f) =
K_IMG_RH × MTF_P_RH (f)
+ K_IMG_RV × MTF_P_RV (f)
+ K_IMG_GH × MTF_P_GH (f)
+ K_IMG_GV × MTF_P_GV (f)
+ K_IMG_BH × MTF_P_BH (f)
+ K_IMG_BV × MTF_P_BV (f) (16)

FIG. 16C shows an example of MTF_P_AF (f) and MTF_P_IMG (f) in the same manner as FIG. 16B. In this embodiment, in this way, the calculation of the variables for the position of the focus detection region, the color and direction to be evaluated is performed prior to the calculation for the spatial frequency variable. As a result of the calculation, MTF_P_AF (f) and MTF_P_IMG (f) are expressed in the following formulas (17) and (18).
MTF_P_AF (f) = Aaf × f ² + Baf × f + Caf (17)
MTF_P_IMG (f) = Aimg × f ² + Bimg × f + Cimg (18)

  FIG. 16C shows focus lens positions (peak positions) LP4_AF, LP5_AF at which the defocus MTF obtained by substituting into the equation (17) for the discrete spatial frequencies F1 to F4 reaches a peak (maximum value). LP6_AF and LP7_AF are shown on the vertical axis.

  In S504, the camera MPU 125 stores the LP4_AF to LP7_AF in the lens memory 118 or the RAM 125b as the peak coefficient MTF_P_AF (n) (1 ≦ n ≦ 4). The camera MPU 125 also stores LP4_Img to LP7_Img in the lens memory 118 or the RAM 125b as the peak coefficient MTF_P_Img (n) (1 ≦ n ≦ 4), and advances the process to S505.

Next, in S505, the camera MPU 125 determines whether or not there is a change in the evaluation band of the focus detection signal or the captured image signal. If there is no change in the evaluation band, the process proceeds to S507 and the BP correction value is determined. Is calculated. When calculating the BP correction value, the camera MPU 125 first calculates the in-focus position (P_img) of the captured image and the in-focus position (P_AF) detected by the AF, as in the second embodiment, using the following equation (19): And (20). For the calculation, the evaluation bands W1 and W2 obtained in S301 and S302 of the first embodiment are used.
P_img = MTF_P_Img (1) × W1 (1) + MTF_P_Img (2) × W1 (2) + MTF_P_Img (3) × W1 (3) + MTF_P_Img (4) × W1 (4) (19)
P_AF = MTF_P_AF (1) × W2 (1) + MTF_P_AF (2) × W2 (2) + MTF_P_AF (3) × W2 (3) + MTF_P_AF (4) × W2 (4) (20)

  That is, the camera MPU 125 uses the defocus MTF maximum value information for each spatial frequency shown in FIG. 16C in the captured image calculated in S301 and S302 of the first embodiment and the AF evaluation bands W1 and W2. Add weight. Thereby, the focus position (P_img) of the captured image and the focus position (P_AF) detected by the AF are calculated.

Next, the camera MPU 125 calculates a BP correction value (BP) by the following equation (21), as in the first embodiment.
BP = P_AF−P_img (21)

  On the other hand, when it is determined in S505 that there is a change in the evaluation band, the camera MPU 125 advances the process to S506 and acquires evaluation band information. The evaluation band information corresponds to the evaluation band W1 and AF evaluation band W2 of the photographed image according to the first embodiment, and is based on the concept described with reference to FIG. Can be calculated. When the acquisition of the evaluation band information is completed in S506, the camera MPU 125 advances the process to S507 and calculates the BP correction value as described above.

  In the fourth embodiment, the processing related to the position of the focus detection region, the color of the evaluation signal, and the contrast direction is executed prior to the processing related to the evaluation band. This is because when the photographer determines the position of the focus detection area by setting, the frequency of the information on the position of the focus detection area and the color and direction to be evaluated is low. On the other hand, as described with reference to FIG. 11 of the first embodiment, the signal evaluation band is frequently changed by the readout mode of the image sensor or the digital filter of the AF evaluation signal. For example, in a low illuminance environment where the S / N of the signal decreases, it may be possible to change the band of the digital filter to a lower band. In the fourth embodiment, in such a case, a coefficient with a low change frequency (peak coefficient) is calculated and stored, and only a coefficient with a high change frequency (evaluation band) is calculated as necessary. Correction value calculation is performed. Thereby, when the photographer has set the position of the focus detection area, the amount of calculation can be reduced.

(Modification)
On the other hand, there may be a case where BP correction values corresponding to the positions of a plurality of focus detection areas are calculated. For example, it is conceivable to perform focus detection using a plurality of focus detection areas at the time of focus detection, or to acquire a plurality of defocus amounts within a shooting range in order to create a defocus map.

  In such a case, the calculation regarding the color of the evaluation signal, the direction of the contrast, and the evaluation band is performed in advance, and the calculation regarding the position of the focus detection area is performed while changing only the position information of the focus detection area, The amount of calculation can be reduced.

  FIG. 17 is a flowchart showing another example of the BP correction value calculation process in S400 of FIG. Steps for performing the same processing as in FIG. 15 are given the same reference numerals, and redundant descriptions are omitted.

  In step S601, the camera MPU 125 determines whether there is a change in a BP coefficient described later. This determination is performed in order to omit recalculation of the BP coefficient when various conditions in the calculation of the BP correction value performed in advance and the calculation of the current BP correction value are the same. In this embodiment, the camera MPU 125 determines the BP coefficient if there is no change in the setting information (FIG. 16A) regarding the colors for focus detection and the captured image and the evaluation direction (evaluation bands W1, W2). It is determined that there is no change, and the process skips to S605.

  In S601, when calculating the BP coefficient for the first time or when it is determined that the BP coefficient has been changed, the camera MPU 125 advances the process to S502, acquires the BP correction information as in the fourth embodiment, and performs the process in S603. Proceed to

  In step S <b> 603, the camera MPU 125 performs weighting on the color and contrast direction of the evaluation signal with respect to the peak information of the six types of defocus MTFs, as described using the equations (14) and (16). However, unlike S503, the position information of the focus detection area is not substituted into Expression (14). Therefore, MTF_P_RH (f, x, y), MTF_P_RV (f, x, y), MTF_P_GH (f, x, y), MTF_P_GV (f, x, y), MTF_P_BH (f, x, y), MTF_P_BV (f , X, y).

Then, the camera MPU 125 weights the twelve coefficients (FIG. 16A) constituting the setting information acquired in S500 with these BP correction information. Specifically, the camera MPU 125 obtains the spatial frequency characteristics MTF_P_AF (f, x, y) for focus detection and the spatial frequency characteristics MTF_P_IMG (f, x, y) for captured images using the expressions (22) and (23). Calculate using.
MTF_P_AF (f, x, y) =
K_AF_RH × MTF_P_RH (f, x, y)
+ K_AF_RV × MTF_P_RV (f, x, y)
+ K_AF_GH × MTF_P_GH (f, x, y)
+ K_AF_GV × MTF_P_GV (f, x, y)
+ K_AF_BH × MTF_P_BH (f, x, y)
+ K_AF_BV × MTF_P_BV (f, x, y) (22)
MTF_P_IMG (f, x, y) =
K_IMG_RH × MTF_P_RH (f, x, y)
+ K_IMG_RV × MTF_P_RV (f, x, y)
+ K_IMG_GH × MTF_P_GH (f, x, y)
+ K_IMG_GV × MTF_P_GV (f, x, y)
+ K_IMG_BH × MTF_P_BH (f, x, y)
+ K_IMG_BV × MTF_P_BV (f, x, y) (23)

Further, the camera MPU 125 weights the evaluation bands using the evaluation bands W1 and W2 obtained in S301 and S302 of the first embodiment, similarly to the equations (19) and (20). As a result, the in-focus position (P_img) of the captured image and the in-focus position (P_AF) detected by the AF are expressed as functions using the position (x, y) of the focus detection area as variables. 25).
P_img (x, y) =
MTF_P_Img (F1, x, y) × W1 (1)
+ MTF_P_Img (F2, x, y) × W1 (2)
+ MTF_P_Img (F3, x, y) × W1 (3)
+ MTF_P_Img (F4, x, y) × W1 (4) (24)
P_AF (x, y) =
MTF_P_AF (F1, x, y) × W2 (1)
+ MTF_P_AF (F2, x, y) × W2 (2)
+ MTF_P_AF (F3, x, y) × W2 (3)
+ MTF_P_AF (F4, x, y) × W2 (4) (25)

  In step S604, the camera MPU 125 stores the coefficients constituting the expressions (24) and (25) in the lens memory 118 or the RAM 125b as BP coefficients.

  Next, in S605, the camera MPU 125 determines whether or not there is a change in the position of the focus detection area. If there is no change, the process proceeds directly to S607. If there is a change, the camera MPU 125 determines the focus detection area in S606. After the position information is acquired, the process proceeds to S607.

In step S <b> 607, the camera MPU 125 substitutes the position (x1, y1) of the focus detection area where the BP correction value is calculated into the formulas (24) and (25), and the BP correction value (BP) according to the following formula (26). calculate.
BP = P_AF (x1, y1) −P_img (x1, y1) (26)

  With this configuration, it is possible to reduce the amount of calculation corresponding to the calculation of BP correction values corresponding to the positions of a plurality of focus detection areas.

  The contents of these arithmetic processes may be switched according to the state. For example, when there is one focus detection area used for focus detection, processing may be performed as shown in FIG. 15, and when there are a plurality of focus detection regions, processing may be performed as shown in FIG.

  By configuring as described above, the BP correction value can be calculated for the color and the vertical and horizontal BP in consideration of the spatial frequency, and more accurate correction can be performed.

● (Fifth Embodiment)
Next, a fifth embodiment of the present invention will be described. The BP correction value calculation method is different from that of the fourth embodiment. In the fourth embodiment, the BP correction value is calculated on the assumption that the evaluation band range of the BP correction information acquired from the photographing optical system is equal to the AF evaluation band and the evaluation band range of the photographed image. However, it is conceivable that the range of the evaluation band is extended to the high frequency band side as the pixel pitch of the image sensor is reduced. In addition, it is conceivable that the range of the evaluation band possessed as the BP correction information is expanded to the high frequency band side as the photographing optical system becomes more accurate.

  In the present embodiment, in order to calculate the BP correction value with high accuracy, each of the imaging device and the photographing optical system is provided with limit band information, and the correction value calculation processing is switched according to the magnitude relationship of each. By adjusting the evaluation band using the limit band information, the BP correction value can be calculated with high accuracy regardless of the combination of old and new imaging devices and photographing optical systems.

  In addition, a block diagram of the imaging device (FIG. 2), explanatory diagrams of each focus detection method (FIGS. 3 to 5), an explanatory diagram of the focus detection area (FIG. 6), an explanatory diagram of each evaluation band (FIG. 11), a focus Since the detection process (FIG. 14) is common to the fifth embodiment, it will be used in the following description.

  A calculation method of a BP correction value (BP) in the fifth embodiment will be described with reference to FIGS.

  In FIG. 18, the same reference numerals as those in FIG. 15 are attached to those performing the same processing as the focus detection processing in the fourth embodiment. The fifth embodiment is different in that a limit band process (S700) is provided before the BP correction value calculation process (S507). In the limit band processing, the magnitude relationship between the limit value (camera limit band) on the high frequency side of the evaluation band of the imaging apparatus and the limit value (lens limit band) on the high frequency side of the evaluation band of the photographing optical system is determined. Then, the discretization processing of MTF_P_AF (f) and MTF_P_IMG (f) represented by the equations (15) and (16) is switched according to the magnitude relationship.

  Hereinafter, the details of the limit band processing performed in S700 of FIG. 18 will be described with reference to FIG.

  In step S701, the camera MPU 125 acquires limit band information. Here, the camera MPU 125 acquires camera limit band information from the ROM 125 a and acquires lens limit band information from the lens memory 118. The camera limit band is set based on the Nyquist frequency determined mainly by the pixel pitch of the image sensor 122. On the other hand, for the lens limit band, a limit value of a band where the MTF response of the imaging optical system is equal to or greater than a threshold value, a limit value of a reliable band of measurement data, and the like are set.

  In step S <b> 702, the camera MPU 125 compares the camera limit band with the lens limit band. The camera MPU 125 advances the process to S703 when the camera limit band is larger than the lens limit band (the limit frequency is high), and ends the limit band process when the camera limit band is equal to or less than the lens limit band. .

  In step S703, the camera MPU 125 processes the peak coefficient. An example of processing the peak coefficient will be described with reference to FIG. FIG. 19B shows MTF_P_AF (f) and MTF_P_IMG (f) shown in FIG. 16C of the fourth embodiment. Here, the lens limit band is F4 and the camera limit band is F6. Nq is a Nyquist frequency determined by the pixel pitch of the image sensor 122, and the camera limit band is set lower than Nq.

  MTF_P_AF (f) is calculated from the BP correction information, the position of the focus detection area, the color of the evaluation signal, and the information on the evaluation direction. FIG. 19B shows focus lens positions (peak positions) LP4_AF, LP5_AF at which the defocus MTF obtained by substituting into the equation (17) for the discrete spatial frequencies F1 to F4 reaches a peak (maximum value). LP6_AF and LP7_AF are shown on the vertical axis.

  Since the lens limit band is F4, the accuracy of the peak position calculated by Expression (17) is not guaranteed at a spatial frequency higher than F4. Therefore, in the fifth embodiment, the peak positions LP8_AF and LP9_AF corresponding to the spatial frequencies F5 and F6 are calculated from the information on the peak positions corresponding to the spatial frequencies below F4. For simplicity, as shown in FIG. 19B, it is conceivable to use the peak values LP7_AF at the spatial frequency F4 as the peak positions LP8_AF and LP9_AF corresponding to the spatial frequencies F5 and F6. When it is desired to calculate with higher accuracy, it may be obtained by extrapolation calculation using a plurality of peak position information (LP4_AF, LP5_AF, LP6_AF, LP7_AF) corresponding to a spatial frequency of F4 or lower.

  The same processing is performed for MTF_P_IMG (f) to calculate peak positions LP8_Img and LP9_Img corresponding to the spatial frequencies F5 and F6. FIG. 19B shows an example in which the peak value LP7_Img at the spatial frequency F4 is also used as the peak positions LP8_Img and LP9_Img corresponding to the spatial frequencies F5 and F6.

  In S703, the camera MPU 125 stores LP4_AF to LP7_AF, LP8_AF, and LP9_AF as peak coefficients in the lens memory 118 or the RAM 125b as MTF_P_AF (n) (1 ≦ n ≦ 6). Similarly, the camera MPU 125 stores LP4_Img to LP7_Img, LP8_Img, and LP9_Img as MTF_P_Img (n) (1 ≦ n ≦ 6) in the lens memory 118 or the RAM 125b, and ends the limit band processing.

  In addition, the camera MPU 125 calculates BP correction values in the same manner as in equations (19) to (21) using information below the spatial frequency F6 that is the camera limit band as the AF evaluation band and the captured image evaluation band.

  As described above, when the camera limit band is equal to or less than the lens limit band in S702, the limit band processing is terminated without performing the peak coefficient processing in S703. For the reason that the peak coefficient processing may be omitted. This will be described with reference to FIG. FIG. 19C shows an example of MTF_P_AF (f) and MTF_P_IMG (f) for the same band as in FIG. 19B when the camera limit band is equal to or less than the lens limit band. Here, it is assumed that the camera limit band is F4 and the lens limit band is F6. As described above, the camera limit band is set lower than the Nyquist frequency Nq.

  When the peak coefficient processing is omitted, since the camera limit band is equal to or less than the lens limit band, information on the peak position relating to the photographing optical system exists excessively with respect to the evaluation range. On the other hand, the AF evaluation band and the captured image evaluation band described with reference to FIG. 11 are calculated in a band equal to or less than the camera limit band. In this embodiment, when the camera limit band is equal to or less than the lens limit band, the BP correction value is calculated without using the information on the peak position corresponding to the spatial frequency higher than the camera limit band. Since the camera limit band is set to be lower than the Nyquist frequency Nq determined by the pixel pitch of the image sensor 122, information exceeding the camera limit band is lost by sampling with pixels. Therefore, even if such processing is performed, the calculation accuracy of the BP correction value is maintained.

  In the fifth embodiment, the case where the information on the peak position (the focus lens position at which the defocus MTF reaches a peak) based on the fourth embodiment is used has been described. Not exclusively. For example, the defocus MTF information outside the corresponding range may be calculated using the defocus MTF information as described in the first embodiment.

  As described above, in the fifth embodiment, when the camera limit band is higher than the lens limit band, the number of discrete frequencies representing the spatial frequency characteristics for automatic focus detection and captured images is set as the camera limit band. Try to increase it together. Therefore, the BP correction value can be calculated with high accuracy regardless of the combination of the imaging device and the imaging optical system.

● (Sixth embodiment)
Next, a sixth embodiment of the present invention will be described. In the sixth embodiment, a method for calculating a spatial frequency BP correction value when a converter lens is attached to the camera described in the first embodiment will be described.

(Explanation of imaging device configuration-converter lens unit)
FIG. 20 is a block diagram illustrating a functional configuration example of a digital camera as an example of an imaging apparatus according to the sixth embodiment. The difference from the configuration shown in the block diagram of FIG. 2 is that a converter lens unit 600 is added. The same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted.

The converter lens unit 600 includes a converter lens 601 and a converter memory 602, and is a photographing lens that changes the focal length of the lens unit 100 that forms an optical image of a subject. In the following description, the lens unit 100 is referred to as a “master lens 100” in order to distinguish it from the converter lens 601. When the converter lens unit 600 is mounted, the zoom function is realized by the first lens group 101 , the second lens group 103, and the converter lens 601. The converter memory 602 stores in advance optical information necessary for automatic focus adjustment. The camera MPU 125 controls the operation of the master lens 100 by executing programs stored in, for example, a built-in nonvolatile memory, the lens memory 118, and the converter memory 602.

  The explanatory diagrams of the focus detection methods (FIGS. 3 to 5), the explanatory diagram of the focus detection area (FIG. 6), and the explanatory diagrams of the evaluation bands (FIG. 11) are also used in the sixth embodiment.

  Next, a method for calculating the spatial frequency BP correction value (BP3) in the sixth embodiment will be described with reference to FIGS. In FIG. 21, the same reference numerals as those in FIG. 10 are given to those performing the same processing as the spatial frequency BP correction value calculation processing in the first embodiment, and description thereof will be omitted as appropriate. The difference from the processing shown in FIG. 10 is that, in S3011 to S3014 of FIG. 21, the BP correction information of the converter lens 601 is acquired and the spherical aberration information is corrected, and then the correction value is calculated.

  In the sixth embodiment, in S300, the camera MPU 125 acquires spatial frequency BP correction information corresponding to the position (x, y) of the focus detection region set in advance in S1. The spatial frequency BP correction information is information relating to the imaging position of the photographing optical system for each spatial frequency of the subject. In this embodiment, the spatial frequency BP correction information is stored in advance in the lens memory 118 of the lens unit 100, and the camera MPU 125 is requested and acquired from the lens MPU 117, but is stored in the nonvolatile area of the RAM 125b. May be.

  In the sixth embodiment, for example, as shown in FIG. 23A, the intersection of the image sensor and the optical axis of the imaging optical system is used as the origin, and the horizontal direction and the vertical direction of the image sensor 122 are respectively X. The coordinates for the axis and the Y axis are set, and the correction value at the center coordinate of the focus detection area is obtained by a function of X and Y.

  Next, in S3011, the lens MPU 117 or the camera MPU 125 acquires the mounting information of the converter lens unit 600. Next, based on the information obtained in S3011, it is determined in S3012 whether or not the converter lens unit 600 is attached. If it is determined in S3012 that the converter lens unit 600 is attached, the process proceeds to S3013, and information on the converter lens 601 is acquired.

  In step S <b> 3013, the lens MPU 117 or the camera MPU 125 acquires the shooting magnification T of the converter lens 601 and spherical aberration information of the converter lens 601. In the sixth embodiment, the imaging magnification T and spherical aberration information of the converter lens 601 are stored in advance in the converter memory 602 of the converter lens unit 600, and are acquired at the request of the lens MPU 117. However, it may be stored in the nonvolatile area of the lens memory 118 or RAM 125b.

  Next, in S3014, the spherical aberration information is corrected from the spherical aberration information of the master lens 100 and the spherical aberration information of the converter lens 601 obtained in S300 and S3013. The detailed operation of S3014 will be described later.

  On the other hand, if it is determined in S3012 that the converter lens unit 600 is not attached, the process proceeds to S301, and the same process as that described with reference to FIG. 10 in the first embodiment is performed.

  Next, the spherical aberration information correction method performed in S3014 will be described with reference to FIGS.

  First, in S3110, the position information of the focus detection area is corrected based on the imaging magnification T of the converter lens 601 acquired in S3013. This is performed so that the same focus detection area on the imaging surface receives light beams that have passed through different areas of the master lens 100 before and after the converter lens unit 600 is mounted.

  First, the focal area magnification T1 indicating the movement rate of the focal detection area viewed from the master lens 100 when the converter lens unit 600 is mounted is set. Here, the focus area magnification T1 may be T1 = T, or may be a value obtained by multiplying the imaging magnification T of the converter lens 601 by a predetermined magnification Co1 as T1 = T × Co1. In this case, Co1 may be a value obtained in advance from a photographing magnification T defined as design information in consideration of manufacturing errors. Alternatively, the converter memory 602, the lens memory 118, or the RAM 125b may store in advance the photographing magnification T or the movement rate of the focus detection area corresponding to the characteristics of the converter lens 601, and the read information may be used as the focal area magnification T1. .

In the operation of S3014, the position of the focus detection area obtained by multiplying the position (x, y) of the focus detection area for acquiring the defocus MTF information of the master lens 100 shown in FIG. And For example, it is assumed that the position (x, y) of the focus detection area is set on the imaging surface before the converter lens unit 600 is mounted as shown in FIG. When the converter lens unit 600 is mounted, the position of the exit pupil of the master lens 100 that transmits light incident on the focus detection region at the position (x, y) is shifted. If the position of the focus detection area where the light transmitted through the shifted exit pupil enters is (Xt, Yt) when the converter lens unit 600 is not attached, the coordinates (x, y) is (Xt, Yt) = (x / T1, y / T1) (27)
It becomes.

  Here, the amount of longitudinal aberration, which will be described later, is converted with a light beam that has passed through approximately the same pupil region before and after the converter lens unit 600 is mounted, and the aberration (mainly astigmatism) state of the master lens 100 is made equivalent. , Conversion by magnification. Therefore, the position on the imaging surface is converted by the focal area magnification T1.

  In step S <b> 3111, the coordinate axis conversion of the focus lens position is performed based on the imaging magnification T of the converter lens 601. This is performed because the spatial frequency of the photographed subject image differs when the subject having the same spatial frequency is viewed before and after the converter lens unit 600 is mounted.

  First, the focus magnification T2 indicating the moving rate of the focus position by setting the converter lens unit 600 is set. Here, the focus magnification T2 may be T2 = T, or may be a value obtained by multiplying the imaging magnification T of the converter lens 601 by the predetermined magnification Co2 as T2 = T × Co2. In this case, Co2 may be a value obtained in advance from a photographing magnification T defined as design information in consideration of manufacturing errors. Alternatively, the converter memory 602, the lens memory 118, or the RAM 125b may store in advance the photographing magnification T or the moving rate of the focus position according to the characteristics of the converter lens 601, and the read information may be used as the focus magnification T2.

  Here, the coordinate conversion method of the focus lens position in S3111 will be described with reference to FIG. Since FIG. 10B shows the defocus MTF before the conversion in S3111 (before the converter lens unit 600 is mounted), it will be described in comparison with FIG. 23B (after the converter lens unit 600 is mounted). .

  In FIG. 23B, the horizontal axis indicates the position of the focus lens 104, and the vertical axis indicates the intensity of the MTF. The four types of curves depicted in FIG. 23B are MTF curves for each spatial frequency, showing the spatial frequency from the lowest to the highest in the order of MTF1, MTF2, MTF3, and MTF4. The MTF curve of the spatial frequency F1 (lp / mm) corresponds to MTF1, and the spatial frequencies F2, F3, F4 (lp / mm) correspond to MTF2, MTF3, and MTF4, respectively. LP4, LP5-2, LP6-2, and LP7-2 indicate the position of the focus lens 104 corresponding to the maximum value of each defocus MTF curve.

Here, one of the MTF curves from MTF1 to MTF4 is fixed, and the other MTF curves are shifted in the focus lens position (horizontal axis in FIG. 23B) direction. Here, the MTF curve from MTF2 to MTF4 is shifted to the focus lens position direction by the square magnification of the focus magnification T2 with MTF1 as a reference. Compared to FIG.
LP5_2-LP4 = (LP5-LP4) × T2 ² (28)
LP6_2-LP4 = (LP6-LP4) × T2 ² (29)
LP7_2−LP4 = (LP7−LP4) × T2 ² (30)
It has become. This is due to the change in the spatial frequency caused by the spherical aberration being magnified in the longitudinal magnification direction by the converter lens 601. With this operation, the longitudinal aberration amount is converted.

  In step S3112, spatial frequency label conversion is performed based on the imaging magnification T of the converter lens 601.

  First, the frequency magnification T3 indicating the conversion rate of the spatial frequency by setting the converter lens unit 600 is set. Here, the frequency magnification T3 may be T3 = T, or may be a value obtained by multiplying the imaging magnification T of the converter lens 601 by a predetermined magnification Co3, with T3 = T × Co3. In this case, Co3 may be a value obtained in advance from a photographing magnification T defined as design information in consideration of manufacturing errors. Alternatively, the converter memory 602, the lens memory 118, or the RAM 125b may store the imaging magnification T or the spatial frequency conversion rate according to the characteristics of the converter lens 601 in advance, and the read information may be used as the frequency magnification T3.

  In the operation of S3112, the spatial frequency information for acquiring the defocus MTF information shown in FIG. 10B of the master lens 100 is the spatial frequency information obtained by multiplying the frequency magnification T3. That is, the four types of curves depicted in FIG. 23B are MTF curves for each spatial frequency, and the MTF curve for the spatial frequency F1 (lp / mm) corresponds to MTF1. Similarly, spatial frequencies F2, F3, and F4 (lp / mm) correspond to MTF2, MTF3, and MTF4, respectively.

After the spatial frequency label is changed in the operation in S3112, the correspondence between the spatial frequency and the MTF curve is changed, and the label corresponding to the MTF curve of the spatial frequency Fa (lp / mm) is changed to MTF1. Similarly, the labels are changed so that the spatial frequencies Fb, Fc, and Fd (lp / mm) correspond to MTF2, MTF3, and MTF4, respectively. That is,
Fa = F1 × T3 (31)
Fb = F2 × T3 (32)
Fc = F3 × T3 (33)
Fd = F4 × T3 (34)
It becomes. This is because, when the subject having the same spatial frequency is viewed before and after the converter lens unit 600 is mounted, when the converter lens unit 600 is mounted, the light beam obtained from the high frequency region of the master lens 100 by the lateral magnification is displayed on the imaging surface. It is because it will acquire. This is because when the subject having the same spatial frequency is viewed before and after the converter lens unit 600 is mounted, the spatial frequency of the captured subject image is different.

  In other words, the subject signal acquired after the converter lens unit 600 is mounted forms an image as a subject having a low frequency for the lateral magnification compared to the case of the master lens 100 alone. Since the high-band aberration of the master lens 100 appears as a low-frequency aberration when the converter lens unit 600 is mounted, the spatial frequency label of the imaging optical system is changed by the frequency magnification T3.

  Next, in S3113, the defocus MTF information is corrected based on the aberration information of the converter lens 601 acquired in S3013. Here, when the aberration of the converter lens 601 is small, the processing may be omitted. For example, when the shooting F number in the shooting state is dark (large), it is considered that there is little aberration, so communication and arithmetic processing may be omitted.

FIG. 24 is an image diagram of the converter lens aberration information acquired in S3013. FIG. 24 shows the shift amounts in the focus lens direction of the maximum values LP4, LP5_2, LP6_2, and LP7_2 of each defocus MTF curve at each frequency Fa... Fn. As in S3101, when MTF1 is used as a reference,
LP5 — 3 = LP5 — 2+ (Hb−Ha) (35)
LP6 — 3 = LP6 — 2+ (Hc−Ha) (36)
LP7 — 3 = LP7 — 2+ (Hd−Ha) (37)
It becomes. The defocus MTF information after the processing of S3113 is as shown in FIG. When the converter lens unit 600 is mounted, the aberration information is corrected as described above, and then the processing from S301 in the first embodiment is performed to calculate a correction value.

  As described above, according to the sixth embodiment, it is possible to appropriately add aberration states by converting the aberration of the master lens by the magnification of the converter lens and further adding the aberration of the converter lens. it can. Furthermore, since the AF evaluation band and the captured image evaluation band are set from the synthesized aberration state and the difference is used as the focus detection amount correction value, focus detection can be performed with higher accuracy. Since similar aberration characteristics also appear in chromatic aberration and astigmatism, the same processing may be performed in the calculation of the vertical and horizontal BP and color BP in S20 and S21.

● (Seventh embodiment)
Next, a seventh embodiment of the present invention will be described. In the seventh embodiment, a method for calculating various BP correction values when the converter lens unit 600 is attached to the above-described fourth embodiment will be described.

The block diagram of the imaging device (FIG. 2 0 ), the explanatory diagrams of each focus detection method (FIGS. 3 to 5), the explanatory diagram of the focus detection area (FIG. 6), and the explanatory diagram of each evaluation band (FIG. 11) Since this is common to the seventh embodiment, it will be used in the following description.

  Next, a BP correction value calculation method according to the seventh embodiment will be described with reference to FIGS. In FIG. 25, the same reference numerals as those in FIG. 15 are given to those performing the same processing as the BP correction value calculation processing in the fourth embodiment, and description thereof will be omitted. The difference from the processing shown in FIG. 15 is that correction information is calculated after acquiring aberration information of the converter lens and correcting aberration information in S5001 to S5004 of FIG.

  In step S <b> 5001, the lens MPU 117 or the camera MPU 125 acquires the mounting information of the converter lens unit 600. Next, based on the information obtained in S5001, it is determined in S5002 whether or not the converter lens unit 600 is attached. If it is determined in S5002 that the converter lens unit 600 is attached, the process proceeds to S5003, and information on the converter lens 601 is acquired.

  In step S <b> 5003, the lens MPU 117 or the camera MPU 125 acquires the shooting magnification T of the converter lens 601 and the BP correction information of the converter lens 601. In the seventh embodiment, the imaging magnification T and the BP correction information of the converter lens 601 are stored in advance in the converter memory 602 of the converter lens unit 600, and are acquired at the request of the lens MPU 117. However, it may be stored in the nonvolatile area of the lens memory 118 or RAM 125b.

The BP correction information of the converter lens 601 is information regarding the imaging position of the photographing optical system for each spatial frequency of the subject. As in the case of only the master lens 100, for each of the six combinations of three RGB colors and two vertical and horizontal directions, the spatial frequency f and the position (x, y) of the focus detection area on the image sensor 122 are used as variables. (38).
MTF_T_P_RH (f, x, y) = (t_rh (0) × x + t_rh (1) × y + t_rh (2)) × f ² + (t_rh (3) × x + t_rh (4) × y + t_rh (5)) × f + (t_rh () 6) × x + t_rh (7) × y + t_rh (8)) (38)

  Expression (38) represents an expression of MTF_T_P_RH at the position of the focus lens 104 indicating the maximum value of the defocus MTF for each spatial frequency of the converter lens corresponding to the horizontal (H) direction for the red (R) signal. ing. In the seventh embodiment, t_rh (n) (0 ≦ n ≦ 8) is stored in the nonvolatile area of the converter memory 602, the lens memory 118, or the RAM 125b.

  Similarly, coefficients (t_rv, t_gh, t_g, t_g, t_g, and t_g, t_g, and t_gh, t_gv, red and vertical (MTF_T_P_RV), green and horizontal (MTF_T_P_GH), green and vertical (MTF_T_P_GV), blue and horizontal (MTF_T_P_BH), and blue and vertical (MTF_T_P_BV) , T_bv) is also stored.

Then, similarly to the process of S502, the aberration information of the converter lens 601 is calculated using the information about the position of the focus detection region when calculating the BP correction value. More specifically, the position information of the focus detection area is substituted into x and y in Expression (38). By this calculation, the aberration information of the converter lens 601 is expressed by the following equation (39).
MTF_T_P_RH (f) = T_Arh × f ² + T_Brh × f + T_Crh (39)
Similarly, MTF_T_P_RV (f), MTF_T_P_GH (f), MTF_T_P_GV (f), MTF_T_P_BH (f), and MTF_T_P_BV (f) are also calculated. These correspond to defocus MTF intermediate information.

  FIG. 26 shows the aberration information of the converter lens 601 after the position information of the focus detection area is substituted in S5003. The horizontal axis represents the spatial frequency, and the vertical axis represents the position (peak position) of the focus lens 104 indicating the maximum value of the defocus MTF. As shown in the figure, when the chromatic aberration is large, the curves for each color are deviated, and when the vertical and horizontal differences are large, the horizontal and vertical curves in the figure are deviated. As described above, the seventh embodiment has the defocus MTF information of the converter lens 601 corresponding to the spatial frequency for each combination of color (RGB) and evaluation direction (H and V).

  Next, in S5004, the aberration information is corrected from the BP correction information of the master lens 100 and the aberration information of the converter lens 601 obtained in S502 and S5003. The detailed operation of S5004 will be described later.

  On the other hand, if it is determined in S5002 that the converter lens unit 600 is not attached, the process proceeds to S503, and the same processing as in FIG. 15 in the fourth embodiment described above is performed.

  Next, the BP correction information correction method performed in S5004 will be described with reference to FIGS.

First, in S5100, the position information of the focus detection area is corrected based on the imaging magnification T of the converter lens 601 acquired in S5003. Here, the BP correction information of the master lens 100 at the position where the focus detection area is converted into (Xt, Yt) with the focus area magnification T1 of the converter lens 601 is MTF_P. Specifically, x = Xt and y = Yt described in Expression (27) are substituted into Expression (13),
MTF_P_RH (f, x, y) = (rh (0) × (x / T1) + rh (1) × (y / T1) + rh (2)) × f ² + (rh (3) × (x / T1) + Rh (4) × (y / T1) + rh (5)) × f + (rh (6) × (x / T1) + rh (7) × (y / T1) + rh (8)) (40)
Thus, the aberration characteristic at the position x of the image sensor 122 is replaced with the aberration characteristic of Xt. Similar processing is performed for red and vertical (MTF_P_RV), green and horizontal (MTF_P_GH), green and vertical (MTF_P_GV), blue and horizontal (MTF_P_BH), and blue and vertical (MTF_P_BV). An example of aberration information of the master lens 100 at this time is shown in FIG.

  In step S5101, the coordinate axis conversion of the focus lens position is performed based on the imaging magnification T of the converter lens 601 acquired in step S5003. Here, the single frequency peak information in the spatial frequency characteristics of MTF_P2_RH and other six types of aberration information is fixed, and the other spatial frequency characteristics are shifted in the direction of the focus lens position (vertical axis in FIG. 28 (b)). Let Here, MTF_P2_GH (F1) is used as a reference, and the MTF curve from MTF2 to MTF4 is extended by the square of the focus magnification T2 in the focus lens position direction. The focus magnification T2 is set as described in the sixth embodiment.

In FIG. 28, the coordinate axis conversion of the focus lens position in the seventh embodiment corresponds to the vertical axis that is the peak information of the defocus MTF. Accordingly, the peak position LPn of the defocus MTF set in FIG. 28A is set to the position of LPn_2, and the difference between the MTF_P_RH (f) and the reference MTF_P_GH (F1) is multiplied by the square of the converter lens focus magnification T2. Shift a minute. The longitudinal aberration amount can be converted by the following equation (41).
MTF_P_RH (f) = MTF_P_RH (f) + (MTF_P_RH (f) −MTF_P_GH (F1)) × T2 ² (41)
Similar processing is performed for red and vertical (MTF_P_RV), green and horizontal (MTF_P_GH), green and vertical (MTF_P_GV), blue and horizontal (MTF_P_BH), and blue and vertical (MTF_P_BV).

  Next, in the operation of S5102, the label conversion of the spatial frequency is performed based on the imaging magnification T of the converter lens 601 acquired in S5003. The replacement of the spatial frequency label by the frequency magnification T3 performed in S5103 corresponds to the horizontal axis conversion in FIG. 28 in the seventh embodiment. The frequency magnification T3 is set as described in the sixth embodiment.

When the spatial frequency after the spatial frequency label is changed by the operation in S5004 is Fa, Fb, Fc, Fd (lp / mm), the correspondence with the spatial frequencies F1, F2, F3, F4 before the replacement is the above-described formula. (31) to (34). Therefore, an expression obtained by substituting f = f / T3 into MTF_P_RH (f) is defined as MTF_P_RH (f) after label change.
MTF_P2_RH (f) = MTF_P_RH (f × T3) (42)
Similar processing is performed for red and vertical (MTF_P_RV), green and horizontal (MTF_P_GH), green and vertical (MTF_P_GV), blue and horizontal (MTF_P_BH), and blue and vertical (MTF_P_BV). FIG. 28B shows an example of aberration information after the processing of S5101, S5102.

In step S5103, the aberration information obtained in step S5102 is corrected based on the aberration information of the converter lens 601 acquired in step S5003. Here, when the aberration of the converter lens 601 is small, the processing may be omitted. For example, when the shooting F number in the shooting state is dark, it is considered that there is little aberration, so communication and arithmetic processing may be omitted. Specifically, the MTF_P2 function obtained in FIG. 27B and the MTF_T_P of the converter lens shown in FIG. 26 acquired in S5003 are added. The combined aberration information MTF_P3 is expressed by the following equation (43).
MTF_P3_RH (f) = MTF_P2_RH (f) + MTF_T_P_RH (f) (43)
Similarly, MTF_P3_RV (f), MTF_P3_GH (f), MTF_P3_GV (f), MTF_P3_BH (f), and MTF_P3_BV (f) are also calculated. An example of aberration information after the processing of S5103 is shown in FIG.

  When the operation up to S5103 is finished, the aberration information in the seventh embodiment is a function of the spatial frequency f and the position (x, y) of the focus detection region on the image sensor 122. When the converter lens unit 600 is mounted, after correcting the aberration information as described above, the processing after S503 described in the fourth embodiment is performed to calculate a correction value.

  As described above, it is possible to appropriately add aberration states by converting the aberration of the master lens by the magnification of the converter lens and adding the aberration of the converter lens.

  Furthermore, since the AF evaluation band and the captured image evaluation band are set from the synthesized aberration state and the difference is used as the focus detection amount correction value, focus detection can be performed with higher accuracy. In this case, since the aberration information is the defocus MTF peak information, the information stored in the memory can be further reduced.

DESCRIPTION OF SYMBOLS 100 ... Lens unit (master lens) 104 ... Focus lens, 113 ... Focus actuator, 117 ... Lens MPU, 118 ... Lens memory, 120 ... Camera body, 122 ... Image sensor, 125 ... Camera MPU, 129 ... Phase difference AF part , 130 ... TVAF, 600 ... Converter lens unit, 601 ... Converter lens, 602 ... Converter memory

Claims (20)

An imaging device capable of performing automatic focus detection of a photographing optical system using an image signal obtained from a set focus detection region, and having a detachable converter lens,
When the converter lens is mounted, the information is related to the aberration of the photographing optical system, and is related to the imaging position of the photographing optical system, one modulation transfer function for each of a plurality of different spatial frequencies. Conversion means for converting information based on the imaging magnification of the converter lens;
When the converter lens is not attached, information related to the aberration of the photographing optical system that is not converted by the converter is used, and when the converter lens is attached, the information is converted by the converter. Correction value for correcting the difference of the focus state due to the difference between the characteristics of the signal used to acquire the result of the automatic focus detection and the characteristics of the signal of the image to be photographed using information related to the aberration. Calculating means for calculating
An image pickup apparatus comprising: control means for controlling a position of a focus lens included in the photographing optical system based on a result of the automatic focus detection corrected by the correction value.   The imaging apparatus according to claim 1, wherein the information related to the aberration of the photographing optical system is information corresponding to at least one of the focus detection area, a focus lens position, and a spatial frequency. Said conversion means is caused by photographing magnification of said converter lens, the change in the position of the focus detection area, the change in the focus position, at least one of a change in our and spatial frequency to correct the aberrations of said converter lens as such, the imaging apparatus according to claim 1 or 2, characterized in that converting the information about the aberration of the photographing optical system. Information related to aberrations of the imaging optical system, the spherical aberration of the imaging optical system, an information about the astigmatism and the chromatic aberration, the imaging optical system corresponding to the maximum value of the modulation transfer function at a plurality of different spatial frequencies the imaging apparatus according to the information of the imaging position, to any one of claims 1 to 3, wherein the conversion on the basis of the yield difference information of said converter lens. The converting means calculates the local maximum value when the converter lens is not mounted, the difference between the local maximum value and a predetermined reference value as a square of the magnification determined based on the magnification of the converter lens. 5. The image pickup apparatus according to claim 4 , wherein information related to the aberration of the photographing optical system is converted so as to shift by an amount corresponding thereto. The converting means is configured to obtain the spatial frequency obtained by multiplying the spatial frequency when the converter lens is not mounted by a magnification determined on the basis of the magnification of the converter lens. 5. The imaging apparatus according to claim 4 , wherein information related to the aberration of the image is converted. The converting means has a position obtained by dividing the position of the focus detection area when the converter lens is not mounted by dividing the position of the focus detection area by a value determined based on the magnification of the converter lens. 5. The imaging apparatus according to claim 4 , wherein information relating to aberrations of the photographing optical system is converted. The imaging apparatus according to claim 4 , wherein the conversion unit adds aberration information of the converter lens to the information related to the converted aberration for each spatial frequency. Information on a plurality of focus lens positions corresponding to maximum values of modulation transfer functions corresponding to the plurality of different spatial frequencies is defined as a function having a first parameter and a second parameter as variables,
The image pickup device stores defocus MTF intermediate information using information on a plurality of focus lens positions corresponding to maximum values of modulation transfer functions corresponding to the plurality of different spatial frequencies and the first parameter. Further comprising
It said calculating means uses the second parameter and the defocus MTF intermediate information, the imaging apparatus according to any one of claims 4 to 8, characterized in that to calculate the correction value. The first parameter is a variable corresponding to chromatic aberration, astigmatism, and position of the focus detection region of the photographing optical system,
The imaging apparatus according to claim 9 , wherein the second parameter is a variable corresponding to a spherical aberration of the photographing optical system. The first parameter is a variable corresponding to chromatic aberration, astigmatism, and spherical aberration of the photographing optical system,
The imaging apparatus according to claim 9 , wherein the second parameter is a variable corresponding to a position of the focus detection area. And the converting means, in a case where predetermined conditions are satisfied, an imaging apparatus according to any one of claims 1 to 11, characterized in that no correction of the information related to the aberrations. A control method in an image pickup apparatus capable of performing automatic focus detection of a photographing optical system using an image signal obtained from a set focus detection area, wherein a converter lens can be attached and detached,
When the converter lens is mounted, information on the aberration of the photographing optical system, and information on the imaging position of the photographing optical system for each of the modulation transfer functions for each of a plurality of different spatial frequencies. A conversion step of converting based on the photographing magnification of the converter lens;
When the converter lens is not attached, using the aberration information of the imaging optical system that has not been converted by the conversion step, the characteristics of the signal used to acquire the result of the automatic focus detection, and the imaging target Calculating a correction value for correcting a difference in focus state due to a difference from the characteristics of the image signal;
When the converter lens is mounted, using the aberration information converted in the conversion step, the characteristics of the signal used to acquire the result of the automatic focus detection, and the characteristics of the signal of the image to be captured Calculating a correction value for correcting the difference in focus state due to the difference between
Controlling the position of the focus lens of the photographing optical system based on the result of the automatic focus detection corrected by the correction value;
A method for controlling an imaging apparatus, comprising: An imaging device capable of performing automatic focus detection of an imaging optical system using an image signal obtained from a set focus detection area, and an automatic imaging optical system using an image signal obtained from the set focus detection area An imaging optical system capable of mounting a converter lens mounted on an imaging device capable of performing focus detection,
When the converter lens is mounted, the information is related to the aberration of the photographing optical system, and is related to the imaging position of the photographing optical system, one modulation transfer function for each of a plurality of different spatial frequencies. Conversion means for converting information based on the imaging magnification of the converter lens;
Calculation means for calculating a correction value for correcting the automatic focus detection result based on the information related to the converted aberration of the photographing optical system;
A photographic optical system comprising: 15. The photographing optical system according to claim 14 , wherein the information related to the aberration of the photographing optical system is information corresponding to at least one of the focus detection region, the position of the focus lens, and the spatial frequency. The calculation unit corrects a difference in focus state due to a difference between a characteristic of a signal used for acquiring the result of the automatic focus detection and a characteristic of a signal of a photographing target image, which is caused by an aberration of the photographing optical system. The photographic optical system according to claim 14 , wherein a correction value for calculating the correction value is calculated. The information related to the aberration of the photographing optical system is information on the imaging position of the photographing optical system for each spatial frequency of the subject,
Said calculating means uses the information of the imaging position is corrected based on the aberration information of said converter lens, according to claim 14, characterized in that to calculate a correction value for correcting the auto-focus detection result The taking optical system described in 1. The conversion means corrects at least one of a change in position of the focus detection region, a change in focus position, and a change in spatial frequency caused by the imaging magnification of the converter lens, and the aberration of the converter lens. 15. The photographing optical system according to claim 14 , wherein information relating to aberrations of the photographing optical system is converted. 15. The photographing optical system according to claim 14 , wherein the conversion unit does not correct the aberration information when a predetermined condition is satisfied. An imaging device capable of performing automatic focus detection of an imaging optical system using an image signal obtained from a set focus detection area, and an automatic imaging optical system using an image signal obtained from the set focus detection area A control method of a photographing optical system capable of attaching a converter lens attached to an imaging device capable of performing focus detection,
When the converter lens is mounted, the information is related to the aberration of the photographing optical system, and is related to the imaging position of the photographing optical system, one modulation transfer function for each of a plurality of different spatial frequencies. A conversion process for converting information based on the imaging magnification of the converter lens;
A calculation step of calculating a correction value for correcting the automatic focus detection result based on the converted information related to the aberration of the photographing optical system;
A method for controlling a photographic optical system, comprising:

Images