JPH10170816A - Focusing information detector, focus detector, and camera using the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a focus detector capable of correcting the relative movement between a subject and a photographic optical system, even in the case the subject and the optical system are relatively moved during photographing, by taking in an image constituted of a luminous flux passing through the same pupil area several times and correcting the relative movement between the subject and the photographic optical system. SOLUTION: In order to perform a pupil time-division phase difference AF, a diaphragm disk 3a is rotated under the command of a system control part 7 so that a time-division phase difference diaphragm may lie in the optical path. And in the case of taking in plural images for focus detection, in addition to an operation of taking in every image constituted of the luminous flux passing through a different pupil area once, the image constituted of the luminous flux passing through the same pupil area is taken in at least twice, as for at least one pupil area, then, the relative movement between the subject and the photographic optical system is corrected. Thus, even in the case the subject and the photographic optical system are relatively moved, the movement on the image is corrected at time-division photographing, then, focusing is accomplished.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a focus detection device of an image pickup device using a solid-state image pickup device such as a digital camera.

[0002]

2. Description of the Related Art Conventionally, many phase difference type focus detection devices are used as an automatic focusing device used in a single-lens reflex type silver halide camera.

FIG. 9 is a diagram for explaining a phase difference type focus detection device. In FIG. 9, the light incident from the lens is reflected downward by the sub-mirror attached to the 45 ° mirror that is the main mirror,
The light is separated into two images by a lens of a secondary optical system called a spectacle lens, and is incident on an autofocus (hereinafter, referred to as AF) sensor. As shown in FIG. 10, the sensors are arranged side by side in two sets (sensor A and sensor B). Also, the spectacle lens plays a role of a pupil division optical system, and two images formed by the spectacle lens and formed on the sensor are light beams that have passed through different pupils. As shown in FIG. 10, the state differs depending on the respective states of focusing, front focus, and rear focus.

The relative displacement between the two images is calculated by correlating the output signals of the two sets of sensors, the defocus amount of the optical system is determined from the displacement, and the focus lens is controlled to obtain a total. I'm scorching.

[0005] However, the phase difference method used in a silver halide camera or the like requires a dedicated light receiving element (sensor) for focus detection, and an imaging optical system, a focus detection optical system, and a focus detection optical system. However, there is a problem that the positional accuracy of the light receiving element is strict and the adjustment thereof is difficult, and the focusing accuracy is reduced accordingly.

In a solid-state imaging device such as a digital camera,
A solid-state image sensor is used to obtain an image, and this image sensor can be used also as a focus detection sensor. This eliminates the need for preparing a dedicated sensor for focus detection. Furthermore, the same one will be used as the imaging optical system and the optical system for focus detection,
It is possible to prevent a decrease in focusing accuracy, which is caused by the above-described severe positional accuracy, and this is a great merit.

As described above, in the phase difference method of a silver halide camera, an image is separated into a plurality of images by a lens of a secondary optical system called a spectacle lens, and correlation of output signals obtained from a plurality of AF sensors dedicated to focus detection is performed. The defocus amount is obtained by calculation.

In order to construct a phase difference detection type AF system in a digital camera without using an AF-dedicated optical system and sensor, a movable pupil is inserted into a photographing optical system, and this pupil is inserted into the optical system. Moving, forming an optical image composed of light beams having different pupil regions on the solid-state imaging device, and obtaining a plurality of images composed of light beams having different pupil regions,
This corresponds to output signals obtained from a plurality of AF sensors dedicated to focus detection in the phase difference method of the silver halide camera. A phase difference method has been proposed.

[0009]

However, in order to construct a phase difference detection type AF system without using an AF-dedicated optical system and an AF-dedicated sensor, when obtaining a plurality of images having different pupil regions, If a method of dividing the pupil region in time series is used, it is impossible to capture a plurality of images at the same time. For this reason, when the subject and the optical system move relatively while capturing a plurality of images for focus detection, the movement appears as a positional shift of the image between the images, and the result of the correlation calculation results. Since it has a direct effect, it is necessary to correct the relative movement between the subject and the photographing optical system in consideration of the fact that the subject being photographed and the optical system have moved relatively.

SUMMARY OF THE INVENTION An object of the present invention is to provide a focus detection device capable of correcting a relative movement between an object and a photographing optical system even when the object and the optical system move relatively during photographing. is there.

[0011]

In order to solve the above-mentioned problems, a focus detection apparatus according to the present invention, when taking in a plurality of images for focus detection, converts each image composed of light beams passing through different pupil regions into one image. Apart from taking in each time, at least one
As for one pupil region, an image composed of a light beam passing through the same pupil region is captured at least twice, and the relative movement between the subject and the photographing optical system is corrected.

As a result, since there is no relative displacement between images due to differences in pupil positions (position displacement due to defocus) between images composed of light beams passing through the same pupil region, the subject and the photographing optical system If the relative position is not moving, there is no relative displacement between the images. If the relative position is moving, a positional displacement occurs, and it is determined whether or not the relative position between the subject and the imaging optical system is moving. It becomes possible. By utilizing this, it is possible to correct the relative movement between the subject and the photographing optical system.

According to a first aspect of the present invention, there is provided an optical system, a light receiving unit that receives two images through two different pupil regions of the optical system, and focus information according to a phase difference between the two images. A focus state detection device that obtains information for focusing based on an output of the light receiving unit, wherein the light receiving unit receives light through one of the two pupil regions. A correction operation unit for detecting an output from the light receiving unit based on the image at different times and obtaining information corresponding to a phase difference of an image received through the same pupil region at different times, and Correcting focus information by calculating the focus information in a state where the phase difference of the image through the same pupil region is corrected with respect to the phase difference of the image through the different pupil region by the information. There is provided a focusing information detecting apparatus for performing.

According to a third aspect of the present invention, the luminous flux of the photographic optical system is divided into at least two regions in a time-division manner, and an image composed of luminous fluxes passing through different pupil regions of the photographic optical system is projected on the image sensor. Pupil position moving means for causing the image sensor to receive at least two optical images composed of light beams having passed through at least two different pupil regions by the pupil position moving means, and at least based on the optical image obtained from the image sensor In a focus detection device that calculates a defocus of an optical system by performing a correlation operation on two output signals, a pupil region where one of two optical images used for the defocus operation is received by an image sensor to an optical image. The output signal of the image sensor is taken out a plurality of times at different times, an output signal corresponding to an optical image from the same pupil region is obtained, and correction information is obtained based on the output signal. , There is provided a focus detection apparatus which performs proper focus detection by correcting the influence of the relative movement of said de object and the photographing optical system during focusing operation processing.

According to a seventh aspect of the present invention, an image pickup device for photographing, an optical system for photographing, and a photographing light beam of this optical system are divided in time series into at least two regions, and different photographing optical systems are used. Pupil position moving means for projecting an image composed of a light beam passing through a pupil region onto the image sensor; and an optical image composed of light beams having passed through at least two different pupil regions by the pupil position moving device on the image sensor. A focus control unit that forms an image, calculates a defocus amount of the optical system by a correlation operation of at least two output images obtained from the solid-state imaging device, and performs focus control of the optical system based on the defocus amount; For at least one of the different pupil regions, at least two in the same pupil region
An object of the present invention is to provide a focus detection device which captures an image and corrects focus by correcting a relative movement between a subject and a photographing optical system.

[0016]

FIG. 1 is a view showing an embodiment of a focus detection device of the present invention and a camera using the same, wherein 1b is a lens group for focusing a photographic lens, and 1a is a focus lens of a photographic lens. A lens group other than the lens group for focusing 1b, 2 is a lens extension mechanism for extending the focusing lens group 1b, and includes a motor for moving the lens and its driver section. 3 is a shutter diaphragm including a pupil position moving mechanism. System, 4 is a CCD and an imaging signal processing system that photoelectrically converts an optical image into a video signal, 5 is an A / D converter that digitizes the video signal, and 6 is various digital video signals converted by 5. A digital signal processing unit for performing digital signal processing, 7 is a system control unit for the entire camera,
Reference numeral 8 denotes a P connected to a recording medium, a function card, or the like.
CMCIA-compliant slots and their controllers, 9 is used for temporarily storing digital video signals, etc., for example, a buffer memory such as a DRAM, 10 is an electronic viewfinder (EVF), 11 is a driver section of the EVF, 12 Is D for sending analog signal to driver
A / A converter 13 holds an image to be displayed on the EVF,
A VRAM 14 for outputting a digital signal to an A / A converter is provided with an external monochrome liquid crystal (E) for displaying camera mode data and the like.
XT. LCD), 15 is the EXT. It is a controller or driver for displaying on the LCD.

Next, the embodiment of FIG. 1 will be described. Here, the focus detection method and the focus detection device directly related to the present invention will be mainly described. Now, it is assumed that the power of the camera is turned on and the camera is in a photographable state. The shutter diaphragm system 3 includes several types of photographing diaphragms having different apertures, and a pupil time division phase difference aperture (hereinafter referred to as CCD or other image signal processing) having two holes formed in the horizontal direction in order to perform pupil time division phase difference AF. System 4
, The aperture hole on the left side is referred to as a left pupil and the right side hole is referred to as a right pupil), and the aperture disk 3a is rotated to select each of the apertures provided on concentric circles. A motor 3d for inserting a desired stop into the optical path, a light shielding plate 3b for shielding either the left pupil or the right pupil during pupil time division phase difference AF, and a motor 3c for moving the light shielding plate 3b.
Consists of

In order to perform the pupil time division phase difference AF, the diaphragm disk 3a is rotated by the instruction of the system control unit 7 so that the pupil time division phase difference stop comes in the optical path.
FIG. 2 is a diagram showing a positional relationship between the stop disk 3a and the light-shielding plate 3b. A circle A shown by a broken line in FIGS. 1 and 2 shows a pupil shape when the stop of the imaging optical system is opened. I have. First, FIG.
As shown in (a), the right pupil of the pupil time-division phase difference stop is closed by the light-shielding plate 3b, and an optical image composed of a light beam passing through the left pupil region of the photographing optical system is formed on the CCD. Take in. A consisting of the light beam that has passed through the left pupil region at this time
The F image data is referred to as a left image 1.

Next, in order to obtain AF image data consisting of light beams passing through different pupil regions, the motor 3c is driven,
The light-shielding plate 3b is moved as shown in FIG. 2B, and an optical image composed of a light beam passing through the right pupil region of the photographing optical system of the lens is formed on the CCD, and the image is captured. At this time, the AF image data composed of the light beam that has passed through the right pupil region is defined as a right image 1.

Further, in order to take in AF image data consisting of a light beam passing through the same pupil area, the light-shielding plate 3b is moved again as shown in FIG. 2A, and at this time, an image to be formed on the CCD is taken in. . At this time, the AF image data composed of the luminous flux passing through the right pupil region is defined as a left image 2.

The exposure for taking in the AF image data may be performed by preparing an electronic shutter, a mechanical shutter (not shown), and in some cases, preparing a pupil time-division phase difference diaphragm having a different pupil area or using an auxiliary light. Are prepared and adjusted by using them.

In this embodiment, the aperture for pupil division phase difference and the aperture for photography are selected by rotating the same aperture disk 3a. However, the aperture for pupil division phase difference and the aperture for photography are separately provided. It does not matter. In this case, it is possible to adjust the aperture value by adjusting the shooting aperture instead of preparing several apertures with different pupil areas as pupil time division phase difference apertures for adjusting the aperture value for exposure. Becomes

By the way, the left image 1, right image 1, and left image 2, which are the AF image data, and the subsequent main photographing,
It is desirable to be performed in a time as short as possible. Therefore, reading data for capturing AF image data takes a long time to read the entire screen of the solid-state imaging device, such as when reading an image of a main shooting,
A part of the image necessary for focus detection is read out at a higher speed than in the case of normal main photographing.

Such a reading method will be described below.
FIG. 3 shows a schematic view of an interline CCD. 31 is a pixel, 32 is a vertical charge transfer element, 33 is a horizontal charge transfer element, and 34 is an output unit. The signal charge photoelectrically converted by the pixel is sent to the vertical charge transfer element, and is sequentially transferred in the direction of the horizontal charge transfer element by four-phase drive pulses φV1, φV2, φV3 and φV4. The horizontal charge transfer element transfers the signal charges of one horizontal line transferred from the vertical charge transfer element to the output section by the two-phase driving pulses φH1 and φH2, where the signal charges are converted into voltages and output.

FIG. 4 is a schematic view of an image pickup area of a CCD.
In this example, in order to speed up the read operation, only a necessary read area is read at a normal speed, and in other cases, a sweep transfer for reading at a high speed is performed. 41 is an area to be read out as usual, and 42 and 43 are high-speed sweep transfer areas in the first half and the second half, respectively.

FIG. 5 is a timing chart for one vertical synchronizing period when the vertical charge transfer element of the CCD is driven in four phases. VD denotes a vertical synchronization signal and a vertical blanking period is indicated by a LOW potential, and HD denotes a horizontal synchronization signal and a horizontal blanking period is indicated by a LOW potential. φV1, φV2,
φV3 and φV4 denote four-phase driving pulses of the vertical charge transfer element, and 51 and 52 denote read pulses for transferring signal charges photoelectrically converted by the pixels to the vertical charge transfer element. Reference numerals 53 and 54 of the four-phase drive pulses indicate high-speed sweep transfer pulses for transferring the signal charges read to the vertical charge transfer elements in the regions 42 and 43 in FIG. 4 at high speed, respectively. By sweeping out the area other than the necessary reading area at high speed in this way, the speed of the partial reading operation can be increased.

The AF which has been read out at high speed in this way
Using the left image 1, right image 1, and left image 2, which are the image data for use, a correlation operation is performed to obtain a defocus amount. Less than,
The calculation algorithm will be described.

First, for the sake of simplicity, an example in which the relative position between the subject and the photographing optical system has not moved will be described.

Image data (left image) consisting of a light beam passing through the left pupil region and image data (right image) consisting of a light beam passing through the right pupil region are fetched, and the two output data are correlated. The correlation is called a “max algorithm”. The left image data is represented by a (i) (where i = 1, 2, 3,..., N), and the right image data is represented by b.
(I) (where i = 1, 2, 3,..., N), the correlation amount c (τ) becomes

[0030]

[Outside 1] Is represented by

Here, max [a (i + τ), b
(I)] is the larger value of a (i + τ) and b (i), and m is for calculating the correlation amount extracted from n output data a (i) and b (i). (M <n), and i ₀ is the number of data to be skipped when extracting m data from n data of the right image.

Actually, first, c (0) when τ = 0 is calculated. Next, as shown in FIG.
From (i), m pieces of data shifted to the right by τ = 1 are extracted, and the correlation amount c between this data and the data of the right image is extracted.
Calculate (1). In this way, τ = 0, 1, 2,
.., Τ are sequentially calculated. The shift amount τ when the minimum value is obtained among the correlation amounts c (τ)
Are the data a (i) of the left image and the data b (i) of the right image
Corresponds to the deviation amount. Furthermore, in order to improve the detection accuracy of the shift amount (calculate the shift amount τ to a value below the decimal point instead of an integer value (pixel)), an interpolation calculation is performed using the minimum value of the correlation amount and values before and after the correlation amount. , The shift amount may be calculated.

When a plurality of lines are used as data for the correlation calculation, for example, a correlation calculation is performed for each corresponding line, and an average of the obtained correlation value group is obtained. Before performing the calculation, the shift amount may be obtained by averaging a plurality of line data in the vertical direction to obtain data for one line and then performing a correlation operation. It is also possible to calculate a correlation between a plurality of lines.

Further, in order to reduce the influence of the pattern of the subject, the contrast, etc., the influence of the difference in photographing conditions, the influence of the color filter array built in the solid-state image sensor, the influence of noise, etc., the output data from the sensor is reduced. May be subjected to a filter operation, and then a correlation operation may be performed.

Since the relationship between the shift amount, the image plane movement amount, and the defocus amount is determined by the optical system, the defocus amount is obtained from the shift amount, and the extension amount necessary for focusing is obtained. Focus control is performed, and focus is achieved.

The method of performing focus detection using a plurality of images composed of light beams passing through different pupil regions when there is no relative movement between the subject and the optical system has been described above.

Hereinafter, a method for determining whether or not there is a relative movement between the subject and the optical system will be described.

For simplicity of explanation, a case where the subject makes a linear motion at a constant velocity in a plane perpendicular to the optical axis of the optical system as shown in FIG. If the capture interval of the left image 1, the right image 1, and the left image 2, which are the AF image data, is short, even if the relative movement between the subject and the optical system is not a constant speed movement, unless the speed change is particularly severe, It can be regarded as constant velocity motion.

FIG. 8 shows the data of the left image 1, the right image 1, and the left image 2 when there is no relative movement between the subject and the optical system (FIG. 8A) and when there is some movement (FIG. 8B). Is expressed.

In order to determine whether or not there is a relative movement between the subject and the optical system, image data consisting of light beams passing through the same pupil region, in this case, for the left image 1 and the left image 2, When the relative position of the system is not moving, the correlation calculation of the left image and the right image is performed in the same manner as that for determining the amount of the line, and the shift amount τ between the left image 1 and the left image 2 is calculated. Ask. When the shift amount is zero or within a predetermined threshold range, there is no relative movement (FIG. 8).
(A)), the shift amount between the left image and the right image is obtained by a correlation operation, and the focus amount is obtained from the value.

On the other hand, when the deviation τ between the left image 1 and the left image 2 is not zero or is not within a predetermined threshold range, it is determined that there is a relative movement (FIG. 8B). Now, let the deviation amount be τm. Now, if the time from capturing the left image 1 to capturing the right image 1 and the time from capturing the right image 1 to capturing the left image 2 are equal, the subject moves with respect to the optical axis of the optical system. Since a straight-line motion is performed in a vertical plane, the left image 1 is acquired, and then the right image 1 is acquired.
The shift amount on the image due to the movement until the image is taken is τ _m / 2. Next, the shift amount τ between the left image 1 and the right image 2
₀ is obtained by the correlation operation. At this time, τ0 includes a shift amount due to defocus and a shift amount due to movement. Therefore, in order to obtain the actual shift amount due to defocus, the shift amount may be subtracted in consideration of the shift amount due to movement. In this _{embodiment, τ = τ0-τ m /} 2 is the amount of deviation due to defocusing.

From this value, the amount of extension necessary for focusing is obtained, and the time required until the actual photographing is taken into consideration, taking into account the amount of movement, focus control, focusing, and then actual photographing.

In the actual photographing, the diaphragm disk 3a is rotated,
The iris is retracted from the optical path of the pupil time-division phase difference aperture, and an aperture for proper exposure is selected from among several types of imaging apertures having different apertures to perform imaging. Then, the data of the solid-state imaging device is read out for recording, subjected to image signal processing by the signal processing unit 6, and if necessary, subjected to processing such as image data compression.
The data is recorded on a recording medium via the CMCIA slot 8.

At this time, the image data is subjected to video processing for finder display in the signal processing section 6 and the VRAM
13 and is displayed on the EVF 10. This allows the photographer to check the subject image.

In this embodiment, the case where a single focus photographing lens is used has been described, but a zoom lens may be used as the photographing lens.

Although the case where the pupil is time-divided in the left and right (horizontal directions) as different pupil regions has been described, pupil time-division may be performed in the upper and lower directions (vertical direction) or in an oblique direction. Or focus detection may be performed using images obtained by three or more pupil time divisions.

In the embodiment, the switching order of the pupil regions is performed in the order of left and right, but the switching may be performed in the order of left and right and right and left and left. In addition, an example has been described in which an image is captured twice for the same pupil region. However, if the image is captured three or more times, it is possible to know a change in the movement of a relative movement that is not a uniform movement.

In this example, the case where the shift amount due to the relative movement is obtained from the left image 1 and the left image 2 and the correction is performed has been described. The shift amount between the image 1 and the left image 2 is obtained,
The average value may be regarded as a shift amount due to defocus.

[0049]

As described above, the first, third and seventh aspects of the present invention are described below.
According to the present invention, when capturing a plurality of images for focus detection, apart from capturing an image composed of light beams that have passed through different pupil regions once each, at least one pupil region has the same An image composed of a light beam that has passed through the pupil region is captured at least twice, and the relative movement between the subject and the photographing optical system is corrected. Can be corrected, and focusing can be performed.

According to the second, fourth, sixth, and eighth aspects of the present invention, it is possible to easily perform the processing for performing the focus detection of the first, third, and seventh aspects. Claim 1
According to the present invention as set forth in claims 0, 11, 12, 13, and 14, it is possible to capture a suitable image when performing the focus detection according to claims 1, 3, and 7.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a camera having a focus detection device according to the present invention.

FIG. 2 is a configuration diagram showing an aperture system constituting the pupil position moving mechanism shown in FIG.

FIG. 3 is a configuration diagram showing a schematic configuration of an interline type CCD.

FIG. 4 is an explanatory diagram showing an image pickup area of a CCD.

FIG. 5 is a waveform chart for explaining a driving operation of the CCD.

FIG. 6 is an explanatory diagram for explaining a correlation operation.

FIG. 7 is an explanatory diagram for describing a correction operation process according to the present invention.

FIG. 8 is an explanatory diagram for explaining the correction operation processing of the present invention together with FIG. 7;

FIG. 9 is a configuration diagram showing a conventional focus detection device.

FIG. 10 is an explanatory diagram for explaining a conventional focus detection operation.

[Explanation of symbols]

1a Focusing lens group of photographing lens 1b Lens group other than focusing lens group 1b of photographing lens 2 Lens extension mechanism 3 Shutter aperture system including pupil position moving mechanism 4 CCD and imaging signal processing system 5 A / D converter 6 Digital Signal processing unit 7 System control unit 8 PCMCIA-compliant slot and its controller unit 9 Buffer memory 10 Electronic viewfinder 11 EVF driver unit 12 D / A conversion unit 13 VRAM 14 External monochrome liquid crystal 15 EXT. Controller and driver for LCD display

Claims (16)

[Claims] 1. An optical system, a light receiving unit that receives two images through two different pupil regions of the optical system, and focus information according to a phase difference between the two images to an output of the light receiving unit. A focus state detection device that obtains information for focusing based on an image received by the light receiving unit through one of the two pupil regions. A correction operation unit is provided which detects information at different times and obtains information corresponding to a phase difference of an image received through the same pupil region at different times, and calculates the different pupil regions by the information in the correction operation unit. A focus information detecting device for calculating focus information in a state where the phase difference of the image passing through the same pupil region is corrected with respect to the phase difference of the passing image. 2. The method according to claim 1, wherein the calculating means calculates an amount corresponding to the shift amount corresponding to the phase difference in the image obtained by the correction calculating unit with respect to the focus shift amount corresponding to the phase difference of the image through the different pupil regions. The focusing information detecting device according to claim 1, wherein the focus information is obtained by subtraction. 3. A pupil position moving means for dividing a photographing light beam of the photographing optical system into at least two regions in a time-division manner, and projecting an image composed of light beams passing through different pupil regions of the photographing optical system onto the image sensor. , At least 2
At least two light fluxes having passed through two different pupil regions
A focus detection device that causes the image sensor to receive one optical image and calculates a correlation between at least two output signals based on the optical image obtained from the image sensor and obtains defocus of the optical system; An output signal corresponding to an optical image from the same pupil region is obtained by taking out an output signal of the image sensor for an optical image a plurality of times at different times from a pupil region in which one of the two optical images is received by the image sensor. A focus detection device that obtains correction information based on the output signal and corrects the influence of the relative movement between the subject and the photographing optical system in the defocus calculation process. 4. A method for detecting, as the correction information, information on a phase difference of an optical image through a pupil region that causes an image sensor to receive one optical image of the two optical systems based on the output signals extracted a plurality of times. Correction information calculating means for correcting the defocus based on the optical images from the different pupil regions by the correction information and obtaining a defocus corrected for the influence of the relative movement between the subject and the photographing optical system. The focus detection device according to claim 3, wherein: 5. The pupil position moving means has an opening in a photographing optical path for dividing a photographing light beam into two regions, and is composed of light beams of first and second pupil regions through the opening. 5. The image pickup device according to claim 3, wherein the image pickup device receives the image, and outputs the output of the image pickup device a plurality of times in a time-division manner while receiving the light flux in the first pupil region to obtain the correction information. The focus detection device as described in the above. 6. The focus detection apparatus according to claim 5, wherein said first pupil position moving means retracts said opening from a photographing optical path during photographing. 7. An image pickup device for photographing, an optical system for photographing, and a photographing light beam of the optical system is divided in time series into at least two regions, and a light beam passing through different pupil regions of the photographing optical system is obtained. Pupil position moving means for projecting an image formed on the image sensor, and an optical image formed of light beams having passed through at least two different pupil regions by the pupil position moving means is formed on the image sensor, and the solid-state imaging is performed. A focus control unit that obtains a defocus amount of the optical system by a correlation operation of at least two output images obtained from the elements, and performs focus control of the optical system based on the defocus amount;
For at least one of the different pupil regions, an image is captured at least twice in the same pupil region,
A focus detection device for correcting a relative movement between a subject and a photographing optical system. 8. The method according to claim 1, wherein when correcting the relative movement between the subject and the photographing optical system, the relative movement between the subject and the photographing optical system is corrected using a plurality of images captured in the same pupil region. 8. The focus detection device according to 7. 9. When correcting the relative movement between the subject and the photographing optical system, it is determined whether or not there is a difference in the defocus amount of the optical system by correlating the images using a plurality of images captured in the same pupil region. The focus detection apparatus according to claim 7, wherein the focus detection device determines whether or not the relative position between the subject and the photographing optical system has moved. 10. An image obtained from a light beam having passed through at least two different pupil regions and an image obtained from a light beam having passed through different pupil regions are captured in the same pupil region at least twice. 10. The focus detection device according to claim 7, wherein the same pupil region as an already obtained image is captured. 11. An image obtained from a light beam having passed through the at least two different pupil regions and an image capturing order at least twice in the same pupil region. 10. The image data is continuously taken in.
3. The focus detection device according to claim 1. 12. An image obtained from a light beam having passed through at least two different pupil regions, wherein two pupil regions in a horizontal direction, a vertical direction, or an oblique direction are used. , Or 8, or 9, or 10, or 11; 13. When two pupil regions in a horizontal direction, a vertical direction, or an oblique direction are used as an image obtained from a light beam that has passed through the at least two different pupil regions, an image capturing order is as follows. 10. The focus detection apparatus according to claim 7, wherein an image of the first pupil area, an image of the second pupil area, and an image of the first pupil area are taken in this order. 14. When two horizontal, vertical, or oblique pupil regions are used as an image obtained from a light beam that has passed through the at least two different pupil regions, the order of capturing the images is as follows: 10. The focus detection device according to claim 7, wherein an image of a first pupil region, an image of a first pupil region, and an image of a second pupil region are taken in this order. 15. A camera comprising the focus detection device according to claim 7, or 8, or 9, or 10, or 11, or 12, or 13, or 14. 16. The focus according to claim 9, wherein the correction of the relative movement between the subject and the photographing optical system is prohibited when there is no difference in the defocus amount of the optical system or the difference is within a predetermined range. Detection device.