JP6702737B2 - Image blur correction apparatus and method for controlling image blur correction apparatus - Google Patents

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image blur correction device that corrects image blur caused by camera shake and the like, and more particularly to an image blur correction device that has an assist function in panning shooting.

2. Description of the Related Art Conventionally, an imaging device capable of performing follow shot shooting has been known. Follow shot photography means that when the subject is moving at a certain speed, the background flows and the subject is stopped by panning the imaging device in accordance with the movement of the subject and exposing with an exposure time longer than usual. This is a method of capturing such an image. In addition, a method using an image blur correction device is known in order to easily perform such follow shot photography.

Patent Document 1 discloses an image shake correction apparatus that matches the amount of movement of a subject image on the imaging surface with the output timing of the shake detection unit to improve the detection accuracy of the angular velocity of the subject. Patent Document 2 discloses a photographing device that determines a shutter speed used when a subject light is imaged by an image sensor based on an angular velocity and a focal length.

JP, 2015-161730, A Japanese Patent Laid-Open No. 2015-102774

However, Patent Document 1 does not disclose an assist function for setting the exposure time at the time of panning. For this reason, it is difficult for a photographer who is unfamiliar with panning photography to calculate an appropriate exposure time for obtaining the intended panning amount. The imaging device of Patent Document 2 does not consider the variation in speed within the same subject. For example, when shooting a running animal, a part of the subject may flow depending on the setting and may be shot. This phenomenon occurs when there is a fast-moving part in the subject and a long exposure time is set for the speed of movement of that part. Feeling may be impaired.

The present invention is simple in realism obtainable image blur correction device shot image of, and provides control how the image shake correction apparatus.

An image blur correction device according to one aspect of the present invention includes a calculation unit that calculates a motion vector included in the image signal by using an image signal detected by an image sensor, and an image blur correction device based on a panning operation of a user. From the shake information detected by the angular velocity detecting means for detecting shake information, vector separation means for separating the motion vector into a background vector and a subject vector, and without using the background vector, the subject vector, the shake information, Further, the image blur correction lens included in the image pickup optical system is driven in the direction orthogonal to the optical axis using the subject vector without using the exposure time control unit that controls the exposure time using the focal length and the background vector. By doing so, an image blur correction control unit that performs image blur correction is provided. The calculating means calculates the maximum value of the subject vector and the average value of the subject vector by using the subject vector calculated for each of a plurality of blocks obtained by dividing the area of the subject, and the exposure time control means, Determining the maximum exposure time based on the difference between the maximum value of the subject vector and the average value of the subject vector, and the exposure time control means controls the exposure time so as not to exceed the maximum exposure time. Is characterized by.

According to another aspect of the present invention, there is provided a method of controlling an image blur correction device , which comprises a step of calculating a motion vector included in the image signal using an image signal detected by an image sensor, and an image blur caused by a panning operation of a user. A step of separating the motion vector into a background vector and a subject vector from the shake information detected by the angular velocity detecting means for detecting shake information of the correction device; and the subject vector and the shake information without using the background vector. , And controlling the exposure time using the focal length, and driving the image blur correction lens included in the imaging optical system in the direction orthogonal to the optical axis using the subject vector without using the background vector. Therefore, there is a step of performing image blur correction. In the calculating step, using the subject vector calculated for each of a plurality of blocks into which the subject area is divided, the maximum value of the subject vector and the average value of the subject vector are calculated, and in the controlling step, The maximum exposure time is determined based on the difference between the maximum value of the subject vector and the average value of the subject vector, and in the controlling step, the exposure time is controlled so as not to exceed the maximum exposure time. Is characterized by.

Other objects and features of the present invention will be described in the following embodiments.

According to the present invention, simple in realism obtainable image blur correction device shot image of, and may provide control how the image shake correction apparatus.

6 is a flowchart illustrating a method for controlling the image pickup apparatus according to the present embodiment. It is a block diagram of the imaging device in this embodiment. It is a block diagram of a camera shake correction control unit in the present embodiment. It is explanatory drawing of each axis and direction of the imaging device in this embodiment. It is explanatory drawing of the motion vector in this embodiment. 7 is a flowchart showing a method of calculating the drive amount of the image blur correction lens in the present embodiment. It is a flow chart which shows the exposure control method in this embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

First, with reference to FIG. 2A, the configuration and operation of the imaging device according to the present embodiment will be described. FIG. 2 a is a block diagram of the imaging device 201. In FIG. 2A, the optical unit 210 (imaging optical system) has a zoom lens 211, an image blur correction lens 212, a focus adjustment lens 213, a diaphragm 214, and a shutter 215. The lens drive control unit 220 is a control means for driving each component of the optical unit 210. The lens drive control unit 220 includes a zoom control unit 221, a camera shake correction control unit 222, a focus control unit 223, an aperture control unit 224, and a shutter control unit 225.

The image sensor 231 photoelectrically converts the optical image formed via the optical unit 210 and outputs an analog image signal (image data). The operation timing of the image pickup device 231 is controlled by the image pickup control section 232. The A/D converter 233 converts the analog image signal output from the image sensor 231 into a digital image signal. The digital image signal output from the A/D converter 233 is stored in the internal memory 243 via the image input unit 234. The image input unit 234 is controlled by the memory control circuit 241. The internal memory 243 is controlled by the system controller 280. The image processing unit 251 performs predetermined pixel interpolation processing and color conversion processing on the data (digital image data) from the A/D converter 233 or the data from the memory control circuit 241. The memory control circuit 241 controls the A/D converter 233, the image processing unit 251, the compression/decompression circuit 242, and the internal memory 243. The memory control unit 214 also controls recording of data on the recording medium 244.

The image data for display written in the internal memory 243 is displayed by the image display unit 206 such as TFT or LCD via the image display control unit 261. The internal memory 243 is a storage unit that stores captured still images and moving images, and can also be used as a work area of the system controller 280. The compression/expansion circuit 242 is a circuit for compressing or expanding image data. The compression/expansion circuit 242 reads the image stored in the internal memory 243, performs compression processing or expansion processing, and writes the processed data in the internal memory 243 again.

The system controller 280 includes a CPU and MPU and controls the entire imaging device 201. The power button 202, the release button 203, the zoom key 204, and the menu operation key 205 are operation means for inputting various operation instructions of the system controller 280. The operation unit is composed of a single switch or a combination of a plurality of switches, dials, and touch panels. A signal output according to the operation of the release button 203 is used as a trigger signal for operating a shutter for recording a still image and a trigger signal for starting and stopping moving image recording.

In the present embodiment, the system controller 280 includes a movement amount detection unit 281 (calculation unit), an exposure control unit 282 (control unit), and a focal length acquisition unit 283 (acquisition unit). The motion amount detection unit 281 detects the motion amount between the frames before and after the image capturing (between image frames acquired at different timings). In the present embodiment, the motion amount detection unit 281 calculates the motion vector of the subject included in the image (the image corresponding to the image data output from the image sensor 231). The focal length acquisition unit 283 acquires the focal length at the time of shooting. The exposure control unit 282 calculates an appropriate exposure value based on the measured brightness level, and controls exposure based on the calculated appropriate exposure value. In the present embodiment, the exposure control unit 282 controls the exposure time based on the motion vector of the subject, the shake information, and the focal length.

The system controller 280 controls the focal length by driving the zoom lens 211 in the optical axis direction based on the signal output according to the operation of the zoom key 204. In the present embodiment, the zoom control unit 221 calculates the zoom drive speed and the drive direction based on the direction and the operation amount of the zoom key 204 operated by the photographer according to the instruction of the system controller 280. The zoom lens 211 moves along the optical axis according to this calculation result. The power supply control unit 271 uses the signal from the power supply button 202 as a trigger to control the power supply 272 so as to supply power to each unit of the imaging device 201.

In the present embodiment, for example, the image blur correction device is configured by the camera shake correction control unit 222 (shake detection unit 2221) and the system controller 280 (motion amount detection unit 281, exposure control unit 282, focal length acquisition unit 283). It

Next, with reference to FIG. 2B, the configuration and operation of the camera shake correction control unit 222 will be described. FIG. 2B is a block diagram of the camera shake correction control unit 222. The camera shake correction control unit 222 is a correction unit that performs image blur correction by driving the image blur correction lens 212 included in the optical unit 210 in a direction orthogonal to the optical axis. The shake correction control unit 222 includes a shake detection sensor such as an angular velocity sensor (angular velocity detection unit) that detects an angular velocity (information about angular velocity) in the shake detection unit 2221 (detection unit). Shake information) is detected (obtained). The shake detection unit 2221a detects the vibration of the image pickup apparatus 201 in the pitch direction. The shake detection unit 2221b detects vibration in the yaw direction.

FIG. 3 is an explanatory diagram of each axis and direction of the image pickup apparatus 201. In the imaging device 201, the optical axis 302 is parallel to the Z axis, the pitch direction 303p corresponds to the rotation direction around the X axis, and the yaw direction 303y corresponds to the rotation direction around the Y axis. The roll direction corresponds to the rotation direction around the optical axis 302 (Z axis).

The signals acquired by the shake detection units 2221a and 2221b are converted into digital signals via the A/D converters 2222a and 2222b, respectively. The filters 2223a and 2223b remove low-frequency components equal to or lower than a predetermined low-frequency cutoff frequency from the angular velocity signals converted by the A/D converters 2222a and 222b, and output them. Also, the shake angle applied to the image pickup apparatus 201 is calculated by integrating the angular velocity signals output from the A/D converters 2222a and 2222b.

The target position calculation unit 2224 amplifies the shake angle calculated by the filters 2223a and 2223b based on the zoom position, the focus position, and the focal length and the photographing magnification obtained from these, to calculate the angle target value. This is because the blur correction sensitivity on the imaging surface with respect to the stroke of the image blur correction changes due to optical changes such as the focal length and the photographing magnification. The target position calculation unit 2224 calculates the drive amount of the image blur correction lens 212 based on the target angle value. It should be noted that the zoom position, the focus position, and the focal length and the photographing magnification obtained from them can be acquired via the system controller 280.

A signal indicating the difference between the target position calculated by the target position calculation unit 2224 and the current position of the image shake correction lens 212 acquired by the shake correction lens position detection units 2227a and 2227b is input to the position control unit 2225. It The driver 2226 drives the image blur correction lens 212 by supplying a drive current according to the drive amount of the image blur correction lens 212 according to the signal output from the position control unit 2225 to the driver 2226.

Next, with reference to FIG. 1, a process (a control method of the image pickup apparatus) when the image pickup apparatus 201 of the present embodiment is set to the follow shot assist mode will be described. FIG. 1 is a flowchart showing a control method of the image pickup apparatus 201 (image blur correction apparatus). Each step of FIG. 1 is mainly executed based on a command from the system controller 280 of the image pickup apparatus 201.

First, in step S101, the system controller 280 determines whether or not the imaging device 201 is set to the follow shot assist mode. When the follow shot assist mode is set, the process proceeds to step S102. On the other hand, when the follow shot assist mode is not set, the system controller 280 performs a normal image stabilizing process and repeats the determination of step S101 until the follow shot assist mode is set.

In step S102, the system controller 280 sets the background flow amount when performing panning shooting. At this time, the photographer sets (selects) an arbitrary background flow amount through the operation unit of the image pickup apparatus 201. The background flow amount can be expressed as a level of large/medium/small, for example. In addition, the background flow level and the image diagram are displayed together so that the background flow rate can be intuitively grasped, and the ratio of the total background angle to each background flow level is displayed. May be.

Subsequently, in step S103, the system controller 280 starts servo AF. By performing the servo AF, the subject can always be focused. In this embodiment, servo AF is performed as the focus control method, but the present invention is not limited to this, and other focus control methods may be used.

Subsequently, in step S104, the system controller 280 starts detecting a motion vector. Here, the system controller 280 (motion amount detection unit 281) detects (calculates) a motion vector from the live view image acquired at a predetermined frame rate. The motion amount detection unit 281 sets, for example, a search block obtained by dividing an image into a plurality of regions, and detects a motion vector between images in search block units.

When there are two time-sequentially acquired images, the motion amount detection unit 281 causes all areas of the previously acquired image (image data) to be divided into a plurality of blocks (for example, in FIG. 4A). Of image blocks 401a). Next, the motion amount detection unit 281 performs similar processing on images (image data) acquired later in time series. Then, the motion amount detection unit 281 compares the image block acquired earlier in time series with the image block acquired later in time series to calculate the degree of similarity. The motion amount detection unit 281 performs such processing on the entire area while shifting the comparison area in the other image data, and determines the area with the highest degree of similarity as the destination area. The motion amount detection unit 281 performs this process on all blocks of the image data, and calculates motion vectors for all blocks. Although such a processing method is called a block matching method, the motion vector may be calculated by another method.

The motion amount detection unit 281 constantly updates the value calculated in this way until immediately before the exposure unless the reliability is lower than a predetermined value. As a result, the calculation result is reflected until just before the exposure, so that the follow shot control can be performed with high accuracy during the exposure.

Subsequently, in step S105, the shake detection unit 2221 of the camera shake correction control unit 222 detects the angular velocity applied to the imaging device 201 with respect to each axis. Subsequently, in step S106, the system controller 280 determines whether or not the release button 203 is in a half-pressed state (hereinafter referred to as "S1_ON"). If it is S1_ON, the process proceeds to step S107. On the other hand, if S1_OFF, the system controller 280 repeats the determination of step S107 until S1_ON.

Subsequently, in step S107, the system controller 280 determines whether or not the release button 203 is fully pressed (hereinafter referred to as "S2_ON"). If it is S2_ON, the process proceeds to step S108. On the other hand, if S2_OFF, the determination of step S107 is repeated until S2_ON.

Subsequently, in step S108, the system controller 280 (focal length acquisition unit 283) acquires the focal length (shooting focal length) at the time of shooting. Subsequently, in step S109, the system controller 280 (movement amount detection unit 281) calculates the driving amount of the image blur correction lens 212. Here, a method of calculating the drive amount of the image blur correction lens 212 will be described with reference to FIG. FIG. 5 is a flowchart showing a method of calculating the drive amount of the image blur correction lens 212. Each step in FIG. 5 is mainly executed by the motion amount detection unit 281 and the camera shake correction control unit 222.

First, in step S501, the motion amount detection unit 281 performs histogram processing based on the motion vector detected (calculated) in step S104. Here, consider the case where the calculated motion vector is shown in FIG. 4A shows the direction of the motion vector, FIG. 4B shows the numerical value of the motion vector, and FIG. 4C shows the result of the histogram processing of the motion vector. As shown in FIGS. 4A and 4B, in the present embodiment, all the areas in the image are divided into a plurality of image blocks 401a by the motion amount detection unit 281. In the present embodiment, for simplification of description, the motion vector is calculated only in the horizontal movement of the image, but the present invention is not limited to this.

Subsequently, in step S502, the motion amount detection unit 281 estimates the background movement amount based on the angular velocity applied to the imaging device 201. The background movement amount A [pixel] can be obtained by the following equation (1).

A=f·tan(−ω/FR)/PP (1)
In Expression (1), f is the focal length [mm], FR is the frame rate [fps], and PP is the cell pitch [mm]. The angular velocity ω [rad/sec] can be acquired by the shake detection unit 2221 (shake detection sensor).

Subsequently, in step S503, the motion amount detection unit 281 performs a process of dividing (separating) the motion vector in the image into a background vector (background motion vector) and a subject vector (subject motion vector). If the background movement amount A is found to be "5" in step S502, it can be estimated that a numerical value other than the size "5" is the subject vector, as shown in FIG. 4C. In this way, the motion amount detection unit 281 extracts the subject vector from the motion vector. In the present embodiment, the background vector and the subject vector are separated from the angular velocity applied to the image pickup apparatus 201, but the present invention is not limited to this, and the motion vector in the image is set as the background vector by using another method. It may be separated from the subject vector. Generally, a photographer shoots while panning in order to keep the subject at one point within the angle of view. Therefore, a larger motion vector is output in the background, and the subject is output as a motion vector for the remaining blur amount. By utilizing this tendency, the motion vector in the image may be separated into the background vector and the subject vector. In this way, it is possible to determine that the separable region (background region) as the background is the hatched portion shown in FIG. 4B and the remaining portion is the subject (subject region).

Subsequently, in step S504, the system controller 280 calculates the drive amount of the image blur correction lens 212. The drive amount of the image blur correction lens 212 can be calculated from the subject vector. This is because, as described above, the subject vector is a motion vector corresponding to the remaining blurring amount and corresponds to the difference in angular velocity when the photographer performs a panning operation. The camera shake correction control unit 222 corrects the remaining blurring amount with the image blurring correction lens 212 based on a command from the system controller 280, and controls so as to stop the movement of the subject. The remaining blur amount can be corrected using, for example, a dominant vector having the largest numerical value among the subject vectors. Further, the residual blur amount may be corrected using the average value Va of the subject vector. This is the end of the flowchart (step S109) in FIG.

Subsequently, in step S110, the system controller 280 (exposure control unit 282) sets an exposure condition. Here, the exposure control method will be described with reference to FIG. FIG. 6 is a flowchart showing the exposure control method. The steps in FIG. 6 are mainly executed by the exposure control unit 282.

First, in step S601, the exposure control unit 282 calculates the first exposure time Tv' [sec] based on the background flow amount set in step S102 and the output of the shake detection unit 2221. Here, the background flow amount is X [%] with respect to the angle of view (set by the photographer in step S102), the angular velocity applied to the imaging device 201 is ω [deg/sec], and the focal length is f [mm]. . Further, the cell pitch of the image sensor 231 (sensor) is PP [mm/pixel], the pixel size is Gv [pixel] in the vertical direction, and Gh [pixel] in the horizontal direction. It is also assumed that the photographer is panning in the lateral direction.

When the background flow amount is converted into the number of pixels using these values, the background flow amount B [pixel] can be expressed by the following equation (2).

B=Gh×X×PP (2)
The first exposure time Tv′ [sec] is expressed by the following expression (3) using the background flow amount B [pixel].

Tv′=C·B/(f·ω) (3)
In Expression (3), C is an arbitrary constant.

Subsequently, in step S602, the exposure control unit 282 sets the upper limit value (maximum exposure time) of the exposure time based on the calculation result of the subject vector (motion vector of the subject). Here, the upper limit of the exposure time is the second exposure time Tvm [sec]. The second exposure time Tvm can be obtained as follows, for example. First, the exposure control unit 282 obtains the average value Va of the subject vector from the result of FIG. Next, the exposure control unit 282 obtains the maximum value Vm of the subject vector. When the object flow allowable value (predetermined allowable value) is I [pixel], the second exposure time Tvm needs to satisfy the following conditional expression (4).

(Vm-Va)*Tvm<I (4)
Therefore, the second exposure time Tvm is expressed by the following equation (5).

Tvm=I/(Vm-Va) (5)
Note that the object flow allowable value I is an arbitrary numerical value, and may be determined (changed) according to the object to be photographed and the photographing scene.

Subsequently, in step S603, the exposure control unit 282 compares the first exposure time Tv′ calculated in step S601 with the second exposure time Tvm calculated in step S602. As a result of comparing the first exposure time Tv′ and the second exposure time Tvm, when the first exposure time Tv′ is shorter than the second exposure time Tvm (Tv′<Tvm), the process proceeds to step S604, The exposure control unit 282 sets the exposure time used for shooting to the first exposure time Tv′. On the other hand, when the first exposure time Tv′ is equal to or longer than the second exposure time Tvm (Tv′≧Tvm), the process proceeds to step S605, and the exposure control unit 282 sets the exposure time used for the shooting to the second exposure time Tvm. Set to.

As described above, in the present embodiment, preferably, the exposure control unit 282 controls the exposure time so as not to exceed the maximum exposure time (second exposure time Tvm) according to the motion vector of the subject. More preferably, the motion amount detection unit 281 calculates the maximum value Vm and the average value Va of the motion vector at a plurality of positions of the subject as the subject motion vector. Then, the exposure control unit 282 determines the maximum exposure time based on the difference (Vm-Va) between the maximum value Vm of the motion vector and the average value Va. More preferably, the exposure controller 282 is based on the difference (Vm−Va) between the maximum value Vm and the average value Va of the motion vector and the object flow allowable value I determined according to the object or the shooting scene ( The maximum exposure time is determined, for example according to equation (5). Preferably, the exposure control unit 282 calculates the first exposure time Tv′ based on the shake information and the background flow amount set by the user (S601), and calculates the first exposure time and the maximum exposure time. The comparison is made (S603). When the first exposure time is shorter than the maximum exposure time, the first exposure time is set as the exposure time (S604), and when the first exposure time is longer than the maximum exposure time, the maximum exposure time is set as the exposure time. It is set (S605). As described above, by limiting the exposure time in consideration of the speed of the subject, it is possible to prevent the subject from flowing too much and set an appropriate exposure time according to the subject.

Subsequently, in step S606, the exposure control unit 282 calculates the proper exposure. The photometric value calculated here is Bv (Bv value). Subsequently, in step S607, the exposure control unit 282 is based on the Bv value obtained in step S606, the exposure time (Tv value) set in step S604 or step S605, and the diagram for the follow shot mode. Calculates and sets the Av value and the ISO sensitivity.

Here, the following formulas (6) to (9) are used for the exposure calculation.

Bv=Tv+Av-Sv (6)
Tv=-log2 (7)
Av=2log2 (8)
Sv=log2 (0.3×ISO sensitivity) (9)
The exposure control unit 282 sets the exposure value thus obtained, and ends the flow of FIG. 6 (step S110).

Subsequently, in step S111, the system controller 280 starts exposure. Then, in step S112, the camera shake correction control unit 222 drives the image blur correction lens 212 during exposure based on a command from the system controller 280. The image blur correction lens 212 is driven according to the drive amount calculated in step S109. In the present embodiment, the image sensor 231 photoelectrically converts the optical image while driving the image blur correction lens 212 in the direction orthogonal to the optical axis by the camera shake correction control unit 222 for the exposure time set in step S110. And output the image data.

Subsequently, in step S113, the system controller 280 determines whether or not the set exposure time has ended. If the exposure has not ended, the process returns to step S112. When the exposure is completed, the process proceeds to step S114. In step S114, the system controller 280 (camera shake correction control unit 222) returns the position of the image blur correction lens 212 to the initial position.

According to the present embodiment, the exposure time is limited by comparing the exposure time obtained from the background flow rate with the exposure time obtained from the maximum value of the subject vector. As a result, it is possible to prevent the subject from flowing and impairing the realism of the follow shot shooting. The method of calculating the exposure time is not limited to this. For example, a method of calculating the exposure time from the difference between the background vector and the subject vector, or a method of calculating the exposure time from the difference between the focus vector and the subject vector may be used.

Further, the method of limiting the exposure time is not limited to this. For example, an exposure time that is a constant multiple of the first exposure time may be set so that the panning effect can be reliably retained regardless of the size of the subject vector. As a result, even a photographer who is not accustomed to panning can automatically set an exposure time that allows the movement of the subject to be stopped while flowing the background without depending on the subject. Therefore, even an unskilled photographer can easily obtain a realistic shot image.

Although the present invention has been described above in detail based on its preferred embodiments, the present invention is not limited to the specific embodiments, and various forms within the scope of the present invention are also included in the present invention. .. Part of the above-described embodiments may be combined as appropriate. For example, the motion amount detection unit 281 calculates the minimum value of the motion vector at a plurality of positions of the subject as the motion vector of the subject, and the exposure control unit 282 controls the exposure time based on the minimum value of the motion vector. Good. In addition, the motion amount detection unit 281 calculates the motion vector of the subject and the motion vector of the background included in the image, and the exposure control unit 282 controls the exposure time based on the motion vector of the subject and the motion vector of the background. You may. Further, the camera shake correction control unit 222 can also perform image shake correction by driving the image sensor 231 in the direction orthogonal to the optical axis instead of the image shake correction lens 212. In this case, the image sensor 231 photoelectrically converts the optical image and outputs the image data while being driven by the camera shake correction control unit 222 during the set exposure time.

Further, in the case of supplying a software program that realizes the functions of the above-described embodiments from a recording medium directly or by using wired/wireless communication to a system or apparatus having a computer capable of executing the program and executing the program Also included in the present invention. Therefore, the program code itself supplied to and installed in the computer to implement the functional processing of the present invention by the computer also implements the present invention. That is, the computer program itself for realizing the functional processing of the present invention is also included in the present invention. In that case, the program may take any form such as an object code, a program executed by an interpreter, or script data supplied to an OS as long as it has the function of the program. The recording medium for supplying the program may be, for example, a hard disk, a magnetic recording medium such as a magnetic tape, an optical/magneto-optical storage medium, or a non-volatile semiconductor memory. Further, as a method of supplying the program, a method in which a computer program forming the present invention is stored in a server on a computer network and a connected client computer downloads the computer program and programs it is possible.

The image capturing apparatus according to the present embodiment can automatically set an exposure time that allows a photographer unfamiliar with follow shots to stop the movement of the subject while allowing the background to flow without depending on the subject. Therefore, according to the present embodiment, an image blur correction device, an imaging device, a lens device, a control method of the image blur correction device, a program, and a storage medium capable of easily obtaining a follow shot image with a realistic sensation are provided. be able to.

281 Motion amount detection unit (calculation means)
282 Exposure control unit (control means)
283 Focal length acquisition unit (acquisition means)

Claims (4)

Using the image signal detected by the image sensor, a calculating means for calculating a motion vector included in the image signal,
Vector separation means for separating the motion vector into a background vector and a subject vector from the shake information detected by the angular velocity detection means for detecting shake information of the image shake correction apparatus due to the panning operation of the user ,
Exposure time control means for controlling the exposure time using the subject vector, the shake information, and the focal length without using the background vector;
Image blur correction control means for performing image blur correction by driving the image blur correction lens included in the image pickup optical system in the direction orthogonal to the optical axis using the subject vector without using the background vector. Have,
The calculating means calculates the maximum value of the subject vector and the average value of the subject vector by using the subject vector calculated for each of a plurality of blocks obtained by dividing the region of the subject,
The exposure time control means determines the maximum exposure time based on the difference between the maximum value of the subject vector and the average value of the subject vector,
The image blur correction device, wherein the exposure time control means controls the exposure time so as not to exceed the maximum exposure time. The exposure time control means sets the maximum exposure time based on a difference between the maximum value of the subject vector and an average value of the subject vector and a subject flow allowable value determined according to the subject or a shooting scene. The image blur correction device according to claim 1, wherein the image blur correction device determines. The exposure time control means,
Calculating the first exposure time based on the shake information and the background flow amount set by the user,
When the first exposure time is shorter than the maximum exposure time, the first exposure time is set as the exposure time,
The image blur correction device according to claim 2, wherein when the first exposure time is longer than the maximum exposure time, the maximum exposure time is set as the exposure time. Calculating a motion vector included in the image signal using the image signal detected by the image sensor;
A step of separating the motion vector into a background vector and a subject vector from the shake information detected by the angular velocity detecting means for detecting shake information of the image blur correction device due to the panning operation of the user;
Controlling the exposure time using the subject vector, the shake information, and the focal length without using the background vector,
Driving the image blur correction lens included in the imaging optical system in the direction orthogonal to the optical axis using the subject vector without using the background vector, and performing image blur correction,
In the calculating step, the maximum value of the subject vector and the average value of the subject vector are calculated by using the subject vector calculated for each of a plurality of blocks into which the subject area is divided.
In the step of controlling, the maximum exposure time is determined based on the difference between the maximum value of the subject vector and the average value of the subject vector,
In the controlling step, the exposure time is controlled so as not to exceed the maximum exposure time.