JP2023122428A - Image blur correction device, control method therefor, program, and storage medium - Google Patents

Abstract

To provide an image blur correction device with which it is possible to appropriately correct image blurs, even when having captured a moving-image while walking, with a stabilizer mounted to an imaging device.SOLUTION: The image blur correction device comprises: a calculation unit that calculates the movement amount of a movement unit that moves a subject image on the image plane of an imaging element, in order to correct image blurs due to device shaking; an acquisition unit that acquires information regarding the movement position of the movement unit; a control unit that feedback controls the movement of the movement unit on the basis of information regarding the movement amount of the movement unit and information regarding the movement position of the movement unit; an electronic vibration correction unit that corrects the image data for electronic image blurs that was obtained by capturing images with the imaging element; and a selection unit that selects to cause the control unit to exercise feedback control in a first image blur correction mode, or exercise feedback control in a second image blur correction mode in which the position change amount of the movement unit due to a change of acceleration applied to the device is reduced to be smaller than in the first image blur correction mode.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image blur correction device used in an imaging device.

2. Description of the Related Art In recent years, many imaging devices such as digital cameras and video cameras are equipped with an image blur correction function for correcting vibrations and the like applied to the imaging device. With this image blur correction function, it has become possible to take an image with better image quality.

However, when moving images are shot while walking with an image pickup device, the image pickup device is subject to large vibrations, which may exceed the drive range of an image blur correction member such as a shift lens.

Japanese Patent Application Laid-Open No. 2002-200003 discloses a method of performing image blur correction control by expanding the drive range of a shift mechanism of a correction lens when a large vibration is applied to an image pickup apparatus such as when photographing while walking. According to this method, it is possible to reduce image blurring due to large shaking such as when shooting while walking by widening the correction angle of the shift mechanism.

JP 2010-139694 A

By the way, the image blur correction mechanism in the image pickup apparatus as described above has a shift mechanism for the image pickup device that picks up the subject image, and the image blur is reduced by shifting the image pickup device with respect to the optical axis of the image pickup optical system. there is something to do

Further, when shooting a moving image while walking, there is a case where an electric gimbal stabilizer (hereinafter referred to as a stabilizer) is attached to the imaging device in order to reduce shake of the imaging device.

When shooting while walking using a stabilizer, a large vibration acceleration is applied to the entire image pickup apparatus, but the vibration of the main body of the image pickup apparatus is suppressed by the effect of the stabilizer. However, when the same acceleration as that of the image pickup device body is applied to the image pickup device and the image pickup device is held by the image pickup device body via the shift mechanism as described above, the following problem occurs. In other words, although the main body of the image pickup device does not vibrate due to the effect of the stabilizer, only the image pickup element moves relative to the main body of the image pickup device, which may cause blurring of the image.

In the method disclosed in Patent Literature 1, no consideration is given to countermeasures against image blur as described above when a stabilizer is attached.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object of the present invention is to provide an image blur correction apparatus capable of appropriately correcting image blur even when moving images are taken while walking with a stabilizer attached to an image pickup apparatus. is to provide

An image blur correction device according to the present invention comprises: calculation means for calculating a movement amount of a movement means for moving a subject image on an image plane of an imaging device; Acquisition means for acquiring information on a movement position; Control means for feedback-controlling the movement of the movement means based on information on the amount of movement of the movement means and information on the movement position of the movement means; and the imaging device. and a correction means for performing electronic image blur correction on image data obtained by imaging in a second image blur correction mode. selection means for selecting whether to perform the feedback control in a second image blur correction mode in which the amount of positional variation of the moving means due to changes in acceleration applied to the apparatus is smaller than in the correction mode. Characterized by

Advantageous Effects of Invention According to the present invention, it is possible to appropriately correct image blurring even when a moving image is captured while walking with a stabilizer attached to an imaging device.

1 is a block diagram showing a schematic configuration of an imaging system according to a first embodiment of the present invention; FIG. 4 is a diagram showing the block configuration of a feedback control section of the image blur correction control section in the first embodiment; FIG. FIG. 4 is a diagram for explaining differences in output values of an acceleration sensor depending on shooting scenes; 4A and 4B are diagrams for explaining differences in output values of an angular velocity sensor depending on shooting scenes; FIG. FIG. 5 is a diagram for explaining relative differences in output values of an acceleration sensor and an angular velocity sensor depending on shooting scenes; 9 is a flowchart showing image blur correction mode selection processing according to the second embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. In addition, the following embodiments do not limit the invention according to the scope of claims. Although multiple features are described in the embodiments, not all of these multiple features are essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant description is omitted.

(First embodiment)
FIG. 1 is a block diagram showing a schematic configuration of an imaging system according to the first embodiment of the invention. The imaging system includes a camera body 100 and an interchangeable lens device (hereinafter referred to as “interchangeable lens”) 200 that is detachable from the camera body 100 . The camera body 100 may be a still camera or a video camera. Also, in this embodiment, a system in which an interchangeable lens is detachably attached to a camera body will be described, but the present invention can also be applied to an imaging device in which a camera and a lens are integrated.

In the camera body 100 , the imaging device 101 captures (photoelectrically converts) a subject image formed by the imaging optical system 210 of the interchangeable lens 200 . An output signal (imaging signal) from the imaging device 101 is input to the image processing unit 108 . The image processing unit 108 performs various image processing on the imaging signal to generate image data. The image data is displayed on a monitor (not shown) or recorded on a recording medium (not shown). Also, the image data generated by the image processing unit 108 is output to the motion vector detection unit and the electronic image stabilization correction unit 110 . A motion vector detection unit 109 detects motion information of feature points in the image data using a plurality of image data having different shooting times, which are continuously captured by the image sensor 101 and generated by the image processing unit 108 . Detect as a motion vector. Any known method such as a correlation method or a block matching method may be used as a motion vector detection method, and the description of the detection method is omitted. The electronic image stabilization correction unit 110 performs so-called electronic image stabilization (electronic image blur correction) such as image data clipping processing and geometric transformation processing on the image data output from the image processing unit 108 . A known method may be used for image data clipping processing and geometric transformation processing, and description thereof will be omitted. Note that the camera microcomputer 102 may set whether or not to execute electronic image stabilization and optical image stabilization, which will be described later, based on a user instruction, or automatically set based on various information such as the mode of the camera body 100. good too. In the first embodiment, it is assumed that optical image stabilization is performed, not electronic image stabilization.

The imaging device 101 can be moved in a direction intersecting the optical axis OP of the imaging optical system 210 by a shift mechanism 101a. For example, it is possible to shift within a plane orthogonal to the optical axis OP, or to rotate within a plane orthogonal to the optical axis OP with the optical axis OP as the center of rotation. In the following description, the case of shifting the image sensor 101 will be mainly described.

A camera shake detection unit 105 detects shake of the camera body 100 caused by a user's hand shake or the like (hereinafter referred to as “camera shake”), and outputs a camera shake detection signal representing the camera shake to the camera microcomputer 102. A camera shake detection unit 105 uses the detection results of the angular velocity detection sensor 111 and the acceleration detection sensor 112 to generate a camera shake detection signal. The camera microcomputer 102 has a function as a control section that controls movement of the imaging device 101 . The camera microcomputer 102 calculates the shift amount (movement amount) of the image sensor 101 for reducing (correcting) the image blur caused by the camera shake from the camera shake detection signal, and issues an image blur correction instruction including the shift amount. Output to the blur correction control unit 103 . The image blur correction control unit 103 controls the actuator included in the shift mechanism 101a according to the image blur correction instruction from the camera microcomputer 102, thereby shifting the image sensor 101 by the above shift amount. As a result, the subject image is moved on the image plane of the image sensor 101, and image blur correction is performed by shifting the image sensor 101. FIG.

The camera microcomputer 102 instructs the orientation detection unit 104 to detect the orientation of the camera body 100 (hereinafter referred to as “camera orientation”). Output. The camera posture includes a normal position, a vertical position (grip up, grip down), upward, and the like. The attitude detection unit 104 detects the camera attitude using the detection results of the angular velocity detection sensor 111 and the acceleration detection sensor 112 . Also, the camera microcomputer 102 can communicate with the lens microcomputer 226 via the camera communication section 106 and the lens communication section 229 in the interchangeable lens 200 .

In the interchangeable lens 200 , an imaging optical system 210 has a variable magnification lens 201 , a diaphragm 202 , a focus lens 203 and an image blur correction lens (optical element) 204 . The zoom control unit 221 can detect the position of the variable power lens 201 (hereinafter referred to as “zoom position”), and drives the variable power lens 201 in accordance with a zoom drive command from the camera microcomputer 102 to achieve variable power. conduct. The focus control unit 223 can detect the position of the focus lens 203 (hereinafter referred to as “focus position”), and performs focus adjustment by driving the focus lens 203 according to a focus drive command from the camera microcomputer 102 .

The aperture control unit 222 can detect the aperture diameter of the aperture 202 (hereinafter referred to as “aperture position”), and adjusts the amount of light by driving the aperture 202 in accordance with an aperture drive command from the camera microcomputer 102 . The diaphragm control unit 222 may detect and control the diaphragm position continuously, or detect and control the diaphragm position discontinuously such as open state, 2nd stage (intermediate), and 1st stage (minimum). may Further, in detecting the aperture position, the aperture position may be detected using the drive amount of the drive mechanism that drives the aperture 202 .

Then, the zoom position, aperture position, and focus position detected by the zoom control unit 221 , the aperture control unit 222 , and the focus control unit 223 are transmitted to the camera microcomputer 102 . The zoom position to be transmitted may be information on the position of the variable power lens 201 or information on the focal length corresponding to the zoom position.

The image blur correction lens 204 can be shifted in a direction including a direction component orthogonal to the optical axis by a shift mechanism 204a when correcting image blur. That is, it may be shifted within a plane orthogonal to the optical axis, or may be rotated around a point on the optical axis.

The lens shake detection unit 228 detects shake of the interchangeable lens 200 caused by user's hand shake (hereinafter referred to as “lens shake”) and outputs a lens shake detection signal representing the lens shake to the lens microcomputer 226 .

The lens microcomputer 226 uses the lens shake detection signal to calculate the shift amount of the image blur correction lens 204 for reducing (correcting) the image blur caused by the lens shake, and sends an image blur correction instruction including the shift amount to the image blur correction. Output to the control unit 224 . The image blur correction control unit 224 controls movement of the image blur correction lens 204 based on an image blur correction instruction from the lens microcomputer 226 . Specifically, by controlling the actuator included in the shift mechanism 204a in accordance with the image blur correction instruction, the lens image blur correction is performed by driving the image blur correction lens 204 by the calculated shift amount. The above-described image blur correction by shifting the image sensor 101 and lens image blur correction by driving the image blur correction lens 204 are generally called optical vibration reduction. Whether or not to perform optical image stabilization can be set independently for image blur correction by shifting the image sensor 101 and for lens image blur correction.

The lens microcomputer 226 has a function as a transmission section that reads out information such as image circle information (to be described later) stored in the data storage section (storage section) 227 and transmits the image circle information and the like to the camera body 100 .

The data storage unit 227 stores optical information such as the zoom range (focal length variable range), the focus range (focusable distance range), and the aperture value variable range of the imaging optical system 210 . The data storage unit 227 also stores information about the image circle of the imaging optical system 210 (hereinafter referred to as "image circle information"). Here, the image circle information includes information representing the position of the image circle and information representing the size of the image circle. In this embodiment, image circle center information representing the center position of the image circle is stored as information representing the position of the image circle.

When the camera body 100 is attached to, for example, an electric gimbal stabilizer (hereinafter referred to as a stabilizer) outside the camera and a moving image is captured while walking, the camera body 100 undergoes a change in acceleration in the direction of gravity due to the impact of the photographer's landing. At this time, the vibration of the camera body 100 is corrected by the stabilizer, and the camera body 100 hardly vibrates. On the other hand, the image sensor 101 is movably held with respect to the camera body 100 via the shift mechanism 101a. It fluctuates relative to 100. The fluctuation appears as a blur on the video, and the quality of the captured video is degraded.

On the other hand, if a mechanism is provided to fix the image pickup element 101 to the camera body 100, and a stabilizer is used with the image pickup element 101 mechanically fixed to the camera body 100, the above blurring does not occur. However, if a mechanism for mechanically fixing the image sensor 101 is provided in the camera body 100, the overall size of the camera body 100 is increased. Further, if the image sensor 101 is fixed to the camera body 100, the image blur correction operation by the image sensor 101 cannot be performed. In this case, the image pickup element 101 cannot correct the residual blur that could not be corrected by the stabilizer, so the residual blur is visible on the image, and the quality of the captured image is degraded.

Therefore, in this embodiment, the image blur correction control unit 103 is provided with a first image blur correction mode and a second image blur correction mode. The image blur correction control unit 103 selects which image blur correction mode is to be used for image blur correction control.

The first image blur correction mode is a mode in which normal image blur correction control is performed, and the second image blur correction mode is a mode in which image blur correction control is performed when a stabilizer is attached. The first and second image blur correction modes have different control parameters in the position feedback control of the image sensor 101 in the image blur correction control. In the second image blur correction mode, compared to the first image blur correction mode, the control parameter for the position feedback control of the image sensor 101 is set so that the positional fluctuation of the image sensor 101 due to changes in the acceleration applied to the camera body 100 becomes smaller. set.

FIG. 2 is a diagram showing the block configuration of the feedback control section of the image blur correction control section 103 in this embodiment. In this embodiment, PID control is used for feedback control.

A target position calculation unit 301 calculates a target position of the image sensor 101 for reducing image blur from the camera shake detection signal output from the camera shake detection unit 105 . The position detection unit 302 detects (acquires) the current position (movement position) of the image sensor 101 . In this embodiment, a Hall element is used for the position detection unit 302 . The PID control unit 303 receives as input a deviation 304 that is the difference between the output signals of the target position calculation unit 301 and the position detection unit 302, and calculates a driving amount 305 of the image sensor 101. FIG. The drive unit 306 drives the shift mechanism 101 a of the image sensor 101 based on the driving amount 305 of the image sensor 101 output from the PID control unit 303 .

The PID control unit 303 multiplies the deviation 304 by the gain Kp 312 of the P term, the signal obtained by performing the integration processing 310 on the deviation 304 and multiplying it by the gain Ki 313 of the I term, and the differential processing 311 on the deviation 304 to obtain the D term The signals multiplied by the gain Kd 314 are summed. Then, the driving amount 305 is obtained based on the summed result.

In the present embodiment, the P-term gain Kp312 in the PID control unit 303 of the image sensor 101 is set higher in the second image blur correction mode than in the first image blur correction mode. By setting the P-term gain Kp312 high, the electrical spring effect in the feedback control becomes stronger, and the amount of positional variation of the image sensor 101 due to changes in the acceleration of the camera body 100 can be reduced.

The user can manually select one of the first image blur correction mode and the second image blur correction mode through menu operations on the camera body 100 . When the user attaches the camera body 100 to the stabilizer and takes a picture while walking, when the user selects the second image blur correction mode on the menu screen of the camera body 100, the image blur correction control unit 103 selects the second image blur correction mode. Image blur correction control of the image sensor 101 is performed in the correction mode.

As described above, in the first embodiment, when shooting a moving image while walking with the stabilizer attached to the camera body 100, the electrical spring effect in the feedback control of the shift drive of the image sensor 101 is strengthened, to make it difficult to move against shock acceleration. As a result, it is possible to suppress deterioration in the quality of captured moving images due to blurring of images due to fluctuations in the position of the image sensor 101 against the intention of the photographer.

In the first embodiment, PID control is used for feedback control of the image sensor 101, and the P-term gain Kp312 is set higher in the second image blur correction mode than in the first image blur correction mode. , the invention is not limited thereto. In the second image blur correction mode, the I-term gain Ki313 or the D-term gain Kd314 of the PID control unit 303 may be set higher than in the first image blur correction mode. Further, among the P-term gain Kp312, the I-term gain Ki313, and the D-term gain Kd314, a plurality of gains or all of the gains may be set high.

When the gain Kp312 of the P term and the gain Kd314 of the D term are set high, the gain in the high frequency band increases, so the steady high frequency noise increases and the high frequency noise sound recorded in the captured moving image also increases. On the other hand, when the gain Ki 313 of the I term is set high, the gain in the low frequency band increases and the gain in the high frequency band does not increase, so the stationary high frequency noise does not change. Therefore, the high-frequency noise sound recorded in the captured moving image does not change. Therefore, in the second image blur correction mode, the gain of each term is set higher than that in the first image blur correction mode, and the amount of change in the gain of each term is set to the gain Kp312 of the P term and the gain of the D term The I-term gain Ki313 may be set to be larger than Kd314. By doing so, it is possible to suppress an increase in high-frequency noise recorded in the captured moving image in the second image blur correction mode.

Further, when PI control is used for feedback control, the gain of the P term or the gain of the I term may be set high in the second image blur correction mode, or the gains of both terms may be set high. For the reasons described above, in the second image blurring correction mode, the gain of each term is set higher than that in the first correction mode, and the amount of change in the gain of each term is set to may be set to be larger. By doing so, it is possible to suppress deterioration of high-frequency noise recorded in the captured moving image in the second image blur correction mode.

By setting the feedback control gain in the second image blur correction mode higher than that in the first image blur correction mode, the acceleration change of the camera body 100 causes the imaging device 101 to be unable to hold the command position. Positional variation of the imaging element 101 is reduced. Therefore, it is possible to reduce the blurring of the captured moving image.

In the above description, the feedback control gain is different between the first image blur correction mode and the second image blur correction mode. You may allow

Also, in the above description, the case where the image sensor moves due to the impact of walking when the stabilizer is attached has been described. However, there is a possibility that the image blur correction lens in the interchangeable lens will move due to the impact of walking. Therefore, in the case of shooting while walking, the control of the second image blur correction mode of the image sensor may be applied to the control of the image blur correction lens as well. As a result, it is possible to correct image blur caused by movement of the image blur correction lens.

(Second embodiment)
Next, a second embodiment of the invention will be described. In the second embodiment, a case will be described in which the image blur correction mode described in the first embodiment is selected by the imaging apparatus automatically determining the shooting situation. Since the configuration of the imaging system is the same as that of the first embodiment, the description is omitted, and only the difference in operation will be described.

The image blur correction control unit 103 of this embodiment automatically determines the photographing situation of the camera body 100 and selects an image blur correction mode. As an example, the image blur correction control unit 103 automatically determines the shooting situation of the camera body 100 based on the angular velocity information detected by the angular velocity detection sensor 111 and the acceleration information detected by the acceleration detection sensor 112, and selects the image blur correction mode. A case of selection will be described. When the second image blur correction mode is selected, position feedback of the image pickup device 101 in the image blur correction control unit 103 is performed so that the amount of positional variation of the image pickup device 101 due to changes in acceleration applied to the camera body 100 is reduced. Set the control parameters for the control.

FIG. 3A shows changes in acceleration in the direction of gravity detected by the acceleration detection sensor 112 when shooting a moving image while walking, with and without a stabilizer attached to the camera body 100. FIG. there is Comparing the case where the stabilizer is attached to the camera body 100 and the case where the stabilizer is not attached, there is no significant difference in the change in the gravitational acceleration applied to the camera body 100 .

Next, FIG. 3(b) shows changes in acceleration in the direction of gravity when the stabilizer is attached to the camera body 100, and when moving images are captured in a stationary state and when moving images are captured while walking. there is It can be seen that the change in the acceleration in the direction of gravity is greater when the moving image is captured while walking than when the moving image is captured in a stationary state. This is because when a moving image is captured while walking, the camera body 100 undergoes a change in acceleration in the gravitational direction due to the shock caused by the user landing on the ground.

FIG. 4 shows changes in angular velocity in the direction of gravity (angular velocity in the pitching direction of the camera) when shooting a moving image while walking with and without a stabilizer attached to the camera body 100 . It can be seen that the change in the angular velocity in the direction of gravity is relatively small when the stabilizer is attached to the camera body 100 and the image is captured compared to when the stabilizer is not attached. This is because the stabilizer detects changes in the angular velocity applied to the camera body 100 and operates to offset the changes.

From the results shown in FIGS. 3 and 4, the acceleration in the direction of gravity and the angular velocity applied to the camera body 100 when the stabilizer is attached to the camera body 100 and the moving image is captured in a stationary state and when the moving image is captured while walking. are shown in FIG. From FIG. 5, it can be seen that when moving images are taken while walking with the stabilizer attached, the change in angular velocity in the direction of gravity is relatively small, and the change in acceleration in the direction of gravity is relatively large (predetermined conditions are satisfied). I understand.

Using the results shown in FIG. 5, it is determined whether or not moving images are being captured while walking with the stabilizer attached to the camera body 100 . That is, when the change in the angular velocity in the direction of gravity applied to the camera body 100 is small and the change in the acceleration in the direction of gravity is large, it is determined that the camera body 100 is attached to the stabilizer and the user is shooting while walking. In this case, the image blur correction control unit 103 selects the second image blur correction mode, and performs image blur correction so that the amount of change in the position of the image sensor 101 due to changes in the acceleration applied to the camera body 100 in the direction of gravity is reduced. control.

FIG. 6 is a flowchart showing the operation of determining the image blur correction mode by the image blur correction control unit 103 in the second embodiment.

When the power of the camera body 100 is turned on and image blur correction control is started in the image blur correction control unit 103, the process proceeds to step S701.

In step S701, the image blur correction control unit 103 determines whether or not the acceleration in the gravitational direction detected by the acceleration detection sensor 112 has reached a predetermined value or more (threshold value or more). If it is determined that the acceleration is equal to or greater than the predetermined value, the process proceeds to step S702; otherwise, the process proceeds to step S704.

In step S702, the image blur correction control unit 103 determines whether the angular velocity in the gravitational direction detected by the angular velocity detection sensor 111 is equal to or less than a predetermined value (threshold value or less). If it is determined that the angular velocity in the direction of gravity is equal to or less than the predetermined value, the process proceeds to step S703; otherwise, the process proceeds to step S704.

In step S703, the image blur correction control unit 103 determines that the camera body 100 is attached to the stabilizer and that the user is shooting while walking, selects the second image blur correction mode, and proceeds to step S705.

On the other hand, in step S704, the image blur correction control unit 103 determines that the camera body 100 is attached to the stabilizer and the user is not shooting while walking, and selects the first image blur correction mode. The process proceeds to step S705.

In step S705, the image blur correction control unit 103 determines whether or not to continue the image blur correction process, and returns to step S701 if the image blur correction process is to be continued. On the other hand, when ending the image blur correction processing, the processing of this flow ends.

As described above, according to the second embodiment, in addition to the same effects as those of the first embodiment, the image blur correction control unit 103 can automatically select the image blur correction mode according to the photographing state. can. As a result, unlike the first embodiment, the photographer does not need to select an image blur correction mode, and the image blur correction control unit 103 selects an appropriate image blur correction mode according to the shooting conditions. It is possible to suppress deterioration in the quality of the image that has been processed.

In the second embodiment, the image blur correction mode is selected based on both the information on the acceleration in the gravitational direction and the angular velocity, but it is not always necessary to make the determination based on both information. The image blur correction mode may be selected by judging the photographing state from only the information on the acceleration in the direction of gravity.

(Third embodiment)
Next, a third embodiment of the invention will be described. In the third embodiment, in the first embodiment, the image blur caused by the position of the image sensor 101 relative to the camera body 100 is corrected by electronic image stabilization. explain. Since the configuration of the imaging system is the same as that of the first embodiment, the description is omitted, and only the difference in operation will be described. Note that the present embodiment assumes that the camera microcomputer 102 is set to execute electronic image stabilization in accordance with the menu operation of the camera body 100 by the user.

As described in the first embodiment, when a moving image is shot while walking with the stabilizer attached, the position of the image sensor 101 changes relative to the camera body 100 . The fluctuation appears as a blur on the video, degrading the quality of the video. In this embodiment, the image blur correction control unit 103 detects the relative positional change amount between the image sensor 101 and the camera body 100 based on the motion vector, which is the motion information detected by the motion vector detection unit 109 . Then, the image blur correction control unit 103 calculates the electronic image stabilization correction amount based on the information on the relative variation amount. The electronic image stabilization correction unit 110 performs electronic image stabilization so as to offset relative fluctuations between the image sensor 101 and the camera body 100 based on the electronic image stabilization correction amount. For example, the image clipping position from the first image data and the image clipping position from the second image data are determined based on the positional variation corresponding to the motion vector detected from the first image data and the second image data. shift. Alternatively, geometric transformation processing is performed on the second image data based on the positional variation amount corresponding to the motion vector detected from the first image data and the second image data.

As described above, even when a moving image is shot while walking with the stabilizer attached to the imaging device, image blurring can be appropriately corrected by electronic image stabilization.

Note that the electronic image stabilization in the present embodiment may be applied to image data that has not undergone image blur correction and lens image blur correction by shifting the image sensor 101, or may be applied to image data that has not been subjected to image blur correction or lens image blur correction by shifting the image sensor 101. It may be applied to image data that has undergone lens image blur correction.

Also, it may be combined with the first embodiment or the second embodiment. In this case, it is possible to reduce image blurring between images due to relative positional changes between the image sensor 101 and the camera body 100, which could not be suppressed by the control of the first and second embodiments. Furthermore, since the relative positional fluctuations between the image sensor 101 and the camera body 100 can be reduced by the control of the first and second embodiments, the motion vector detection accuracy can be improved, and the positional fluctuations can be reduced. Exceeding the correction range of electronic image stabilization can be suppressed.

(Other embodiments)
Further, the present invention supplies a program that implements one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device reads the program. It can also be realized by executing processing. It can also be implemented by a circuit (eg, ASIC) that implements one or more functions.

The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the claims are appended to make public the scope of the invention.

REFERENCE SIGNS LIST 100 camera main body 101 image sensor 101a shift mechanism 102 camera microcomputer 103 image blur correction control section 105 camera shake detection section 108 image processing section 109 motion vector detection section 110 electronic image stabilization correction section 111 angular velocity detection sensor 112 acceleration detection sensor 200 interchangeable lens 204 Image blur correction lens 204a Shift mechanism 224 Image blur correction control section 226 Lens microcomputer 227 Data storage section 301 Target position calculation section 302 Position detection section 303 PID control section

Claims (16)

a calculating means for calculating a movement amount of a moving means for moving a subject image on an image plane of an imaging element in order to correct image blurring due to shake of the apparatus;
Acquisition means for acquiring information on the movement position of the movement means;
control means for feedback-controlling the movement of the movement means based on information on the amount of movement of the movement means and information on the movement position of the movement means;
correction means for performing electronic image blur correction on image data obtained by imaging with the imaging device;
The control means is caused to perform the feedback control in the first image blur correction mode, or the positional fluctuation amount of the moving means due to changes in acceleration applied to the apparatus is made smaller than in the first image blur correction mode. selection means for selecting whether to perform the feedback control in the second image blur correction mode;
An image blur correction device comprising: 2. The image blur correction according to claim 1, wherein said selection means selects said feedback control in said second image blur correction mode when a vibration suppressing means for suppressing blur is mounted outside said apparatus. Device. 3. The image blur correction device according to claim 2, wherein the suppression means is an electric gimbal stabilizer. 4. The image blur correction device according to claim 1, wherein the moving means is means for moving the imaging element in a direction intersecting the optical axis. 4. The image blur correction according to claim 1, wherein the moving means is means for moving an image blur correction lens provided in the imaging optical system in a direction intersecting the optical axis. Device. 6. The image blur according to any one of claims 1 to 5, wherein in the second image blur correction mode, a gain of the feedback control is set higher than in the first image blur correction mode. compensator. 6. The second image blur correction mode, as compared with the first image blur correction mode, the configuration of the control block of the feedback control or the characteristics of the control filter is different, any one of claims 1 to 5, characterized in that. 1. The image blur correction device according to claim 1. 8. The image blur correction device according to claim 1, wherein said feedback control is PID control or PI control. 9. A method according to any one of claims 1 to 8, wherein said selection means selects feedback control in said second image blur correction mode when the angular velocity and acceleration of shake of the apparatus satisfy predetermined conditions. 10. The image blur correction device according to the above item. 10. The selecting means selects the feedback control in the second image blur correction mode when the angular velocity in the gravitational direction and the acceleration in the gravitational direction of shake of the apparatus satisfy predetermined conditions. 3. The image blur correction device according to . The selecting means selects feedback control in the second image blur correction mode when the angular velocity in the gravitational direction is equal to or less than a first threshold and the acceleration in the gravitational direction is equal to or greater than a second threshold. 11. The image blur correction device according to claim 10, characterized by: 9. The apparatus according to any one of claims 1 to 8, wherein said selection means is means for a user to manually select said first image blur correction mode or said second image blur correction mode. The image blur correction device described. a detecting means for detecting motion information based on a plurality of image data obtained by imaging with the imaging element;
13. The image blur correction apparatus according to claim 1, wherein said correction means performs said electronic image blur correction based on said motion information. a calculation step of calculating a movement amount of a moving means for moving the subject image on the image plane of the imaging device in order to correct image blurring due to shake of the apparatus;
an obtaining step of obtaining information on the movement position of the moving means;
a control step of feedback-controlling the movement of the moving means based on information on the amount of movement of the moving means and information on the movement position of the moving means;
a correction step of performing electronic image blur correction on image data obtained by imaging with the imaging element;
In the control step, the feedback control is performed in the first image blur correction mode, or the positional fluctuation amount of the moving means due to the change in the acceleration applied to the apparatus is made smaller than in the first image blur correction mode. a selection step of selecting whether to perform the feedback control in the second image blur correction mode;
A control method for an image blur correction device, comprising: A program for causing a computer to execute each step of the control method according to claim 14. A computer-readable storage medium storing a program for causing a computer to execute each step of the control method according to claim 14.

Images