JP5460170B2 - Imaging apparatus and control method thereof - Google Patents

Description

  The present invention relates to an image pickup apparatus having a plurality of image pickup means and shake correction means and a control method thereof, and more particularly to shake correction in shooting modes in which the respective image pickup by the image pickup means are different.

  In addition to the conventional imaging mode using one imaging unit, interest in simultaneous imaging of still images and moving images using a plurality of imaging units, or stereoscopic imaging is increasing. For example, Patent Document 1 discloses a still image shooting method during moving image shooting, and moving image shooting and still image shooting can be simultaneously performed using each imaging unit. Patent Document 2 discloses a method for reducing viewer fatigue by changing the exposure control in each mode, in which a stereoscopic shooting mode and a normal shooting mode can be selected.

JP-A-1-185533 JP 2008-187385 A

By the way, when moving image shooting and still image shooting are performed at the same time, measures are taken to reduce the influence of shake of the imaging device, but the correction characteristics in the shake correction amount calculation process differ between still images and moving images. The correction characteristics here include a gain, a cut-off frequency, or a range of output values used in the process of calculating the shake correction amount.
In general, when the shake of the imaging device is not large, the correction characteristics match in each case of a still image and a moving image. However, when the shake is large, the correction characteristics of the still image and the moving image do not match, and as a result, the position (correction position) of each shake correction means is different. If, for example, the stereoscopic shooting mode is selected in this state, there is a possibility that an accurate stereoscopic image may not be generated.
Accordingly, an object of the present invention is to provide an imaging apparatus capable of changing the correction characteristics of other shake correction means in accordance with the state of at least one shake correction means in an imaging apparatus having a stereoscopic shooting mode, and a control method therefor. It is.

In order to solve the above problems, the device according to the first aspect of the present invention is an imaging apparatus having a plurality of imaging means for imaging the same subject from different viewpoints, with respect to the plurality of image pickup means Operating means for selecting a shooting mode, a shake detecting means for detecting shake applied to the imaging device, and a correction amount calculation for calculating a shake correction amount for each imaging means according to an output of the shake detecting means Means, a plurality of shake correction means provided for each of the plurality of image pickup means for correcting shake of the optical image according to the shake correction amount, and the operation means for the plurality of image pickup means. When the selected shooting modes are different, the cut-off frequency used in the calculation process of the shake correction amount and the gain used in the calculation process of the shake correction amount for the plurality of shake correction units. Comprising a correction characteristic changing means for varying at least one of the range of operation output used in down or the shake correction amount calculation process, the.
An apparatus according to a second aspect of the present invention is an imaging apparatus including a plurality of imaging units for imaging the same subject from different viewpoints, and selects a shooting mode for each of the plurality of imaging units. Operating means, a shake detection means for detecting shake applied to the imaging device, a correction amount calculation means for calculating a shake correction amount for each imaging means in accordance with an output of the shake detection means, and a shake correction amount Accordingly, a plurality of shake correction units provided for the plurality of image pickup units in order to correct the shake of the optical image, and the plurality of shake correction units, the position of the shake correction unit or the shake correction amount Based on the information obtained in the calculation process, the cutoff frequency used in the calculation process of the shake correction amount, the gain used in the calculation process of the shake correction amount, or used in the calculation process of the shake correction amount And a correction characteristic changing means for varying at least one characteristic of the range of the operation output. In the case where stereoscopic imaging is performed by forming an optical image using the plurality of imaging units, the correction characteristic changing unit is configured such that any one of the plurality of shake correcting units has the position of the shake correcting unit at the center of the driving range. After determining whether they are close and matching the characteristics of the shake correction means to the characteristics of the shake correction means determined to be close to the center of the drive range, the state of the plurality of shake correction means is set to the center of the drive range. To match the state of the shake correction means determined to be close to.

  According to the present invention, the characteristics of the plurality of shake correction units can be changed based on the position of the shake correction unit corresponding to the plurality of imaging units or the information acquired in the calculation process of the shake correction amount. For example, when each imaging unit is in a different shooting mode, the correction characteristic of the shake correction unit corresponding to each mode is set, and when switching to the stereoscopic shooting mode, the discomfort given to the photographer is reduced and accurate. A stereoscopic image can be provided.

FIG. 7 is a diagram illustrating a configuration example of a main part related to shake correction processing in order to describe the embodiment according to the present invention in conjunction with FIGS. It is the figure which simplified and illustrated the external appearance of the imaging device. It is a block diagram which shows the structural example of the whole imaging device. It is a flowchart explaining the calculation process example of the shake correction amount which concerns on 1st Embodiment of this invention. It is explanatory drawing which shows the structural example of a digital filter. It is a flowchart explaining the example of a calculation process of the shake correction amount which concerns on 2nd Embodiment of this invention.

Embodiments according to the present invention will be described below in detail with reference to the accompanying drawings. Note that the imaging apparatus illustrated in FIGS. 2 and 3 will be described before the main part of the shake correction control in FIG. 1 is described.
FIG. 2 shows an example of the external configuration of the imaging apparatus according to the embodiment of the present invention. FIG. 2A is a front view of the imaging apparatus. An operation member 201 in which a zoom lever and a shutter release button are integrated is provided at the upper part of the main body of the imaging apparatus. The strobe light emitting unit 202 is located in the upper part of the front surface of the main body, and the lens barrel units 203 and 204 are arranged at a predetermined interval below the strobe light emitting unit 202. Each lens barrel portion constitutes an imaging means for photographing the same subject from different viewpoints, and is configured using an optical system component (an optical member such as a lens or a diaphragm) or a protection member. A grip portion 205 located on the right side of the lens barrel portion 204 is a portion where the photographer grips the imaging device.

  FIG. 2B is a rear view of the imaging apparatus. A display unit 206 as an image display means occupies most of the back of the main body, and operation members 207 and 208 are arranged on the right side. The operation member 207 is a cross button for performing a direction operation or the like for the photographer to select an item. The operation member 208 is a menu button for the photographer to switch modes. In the figure, for convenience of explanation, only these operation members are representatively shown.

  FIG. 3 is a block diagram illustrating the overall internal configuration of the imaging apparatus according to the embodiment of the invention. First, a first imaging system having an optical system and an imaging element will be described. Optical members housed in the lens barrel portion 203 include a zoom unit 301, a shift lens 303, an aperture / shutter unit 305, and a focus unit 307. The zoom unit 301 includes a zoom lens that performs zooming, and a zoom drive control unit 302 controls driving of the zoom unit 301. The shift lens 303 is a shake correction lens capable of changing the position on a plane substantially perpendicular to the optical axis of the imaging optical system, and the shift lens drive control unit 304 controls the drive of the shift lens 303. . The aperture / shutter unit 305 is used for exposure control, and the aperture / shutter drive control unit 306 controls the drive of the aperture / shutter unit 305. The focus unit 307 includes a focus adjustment lens, and the focus drive control unit 308 controls the drive of the focus unit 307.

  The imaging and signal processing unit includes an imaging unit 309, an imaging signal processing unit 310, and a video signal processing unit 311. The imaging unit 309 is configured using an imaging element, converts a light image that has passed through each lens group into an electrical signal, and outputs the electrical signal to the imaging signal processing unit 310. The imaging signal processing unit 310 converts the electrical signal output from the imaging unit 309 into a video signal. The video signal processing unit 311 performs necessary processing on the video signal output from the imaging signal processing unit 310 according to the application.

  Next, a second imaging system (see reference numerals 312 to 322) having the same optical system and imaging element will be described. It should be noted that the constituent elements indicated by reference numerals 312 to 322 are the same as the constituent elements described with reference numerals 301 to 311, and thus description thereof is omitted to avoid duplication. Unless otherwise noted, the description of the first imaging system can be similarly applied to the second imaging system. That is, for each component of the second imaging system, a code obtained by adding 11 to the code assigned to each component of the first imaging system is used.

The display control unit 325 performs display control in order to create a stereoscopic image by combining the left and right images obtained by the first imaging system and the second imaging system. The display unit 326 performs image display as necessary based on the signal output from the display control unit 325. The power supply unit 323 supplies power to each part of the system according to the application. Shake detecting unit 324 detects a degree of deflection applied to the imaging device, and notifies the detection result to the control unit 32 9 to be described later. Operation unit 327 constitute operation means for operating the imaging device, and sends an operation signal of the user to the control unit 32 9 to be described later. The storage unit 328 stores various data such as video information and programs.

Controller 32 9 for controlling the entire system is constructed using a central processing unit (CPU) or the like, the drive control unit of the respective signal processing unit, sends a control signal to the display control unit, etc., also various data The memory control is performed.

Next, the operation of the imaging apparatus having the above configuration will be described.
The operation unit 327 includes operation members 201, 207 and 208. The operation member 201 having the function of a shutter release button is configured such that a first switch (hereinafter referred to as SW1) and a second switch (hereinafter referred to as SW2) are sequentially turned on according to the amount of pressing. Yes. That is, SW1 is turned on when the user presses the shutter release button approximately half, and SW2 is turned on when the user presses the button to the end. When SW1 is turned on, the focus drive control unit 308 drives the focus unit 307 to perform focus adjustment, and the aperture / shutter drive control unit 306 drives the aperture / shutter unit 305 to set the exposure amount to an appropriate value. To do. When SW2 is turned on, image data obtained from the light image exposed to the imaging unit 309 is stored in the storage unit 328. The operation member 201 also functions as a zoom lever, if there is an operation instruction of zooming using the operation member 201, a zoom drive control section 302 is a zoom unit 301 receives the instruction via the control unit 32 9 To drive. As a result, the zoom lens moves to the instructed zoom position. By operation using the operation members 207 and 208, one of the still image shooting mode and the moving image shooting mode can be selected for each imaging system, and the stereoscopic shooting mode can also be selected.

  FIG. 1 is a block diagram illustrating a main part of an image stabilization control system according to an embodiment of the present invention. First, a first shake correction system corresponding to the first imaging system will be described. The first shake correction system includes a correction amount calculation unit that calculates a shake correction amount, and a shake correction unit that drives the shift lens 303 according to the shake correction amount to perform shake correction. The detection signal of the shake detection unit 324 is sent to a correction block (shake correction processing unit) for signal processing. The AD conversion unit 101 converts analog data, which is shake information detected by the shake detection unit 324, into digital data, and sends the conversion result to the digital low-pass filter 102. The digital low-pass filter 102 is a filter that passes a predetermined low frequency band. In the case where the data detected by the shake detection unit 324 is an angular velocity (or velocity) and the driving related to the angle (or position) as the displacement amount of the shift lens 303 is controlled, the digital low-pass filter 102 acts as an integrator. To do. That is, the digital low-pass filter 102 sets the angular velocity (or velocity) detected by the shake detection unit 324 to an angle (or position) as a displacement amount of the shift lens 303. The driving range limiting unit 103 limits the range of the calculation output by the digital low-pass filter 102. That is, the shake correction amount, which is the output result of the digital low-pass filter 102, is limited within a predetermined range. The digital low-pass filter 102 and the drive range limiting unit 103 constitute correction amount calculation means, and calculate the shake correction amount of the first imaging system. The correction characteristic changing unit 107 changes the cut-off frequency, gain, or limit range set by the drive range limiting unit 103 that defines the characteristics of the digital low-pass filter 102. Signals from the operation unit 327 and AD conversion units 106 and 112 described later are input to the correction characteristic changing unit 107. The operation unit 327 includes operation members 207 and 208 that are used to select a shooting mode for the imaging system.

  The shift lens drive control unit 304 includes a PID control unit 104, a DA conversion unit 105, and an AD conversion unit 106. The PID control unit 104 obtains a control amount from the deviation between the target position signal from the drive range limiting unit 103 and the current position signal indicating the position of the shift lens 303, and outputs a position command signal for the shift lens 303. In this PID control, control in which proportional control (P), integral control (I), and differential control (D) are selectively combined is performed. The DA converter 105 converts the digital signal from the PID controller 104 into an analog signal, and outputs the position control signal to a driving actuator (not shown) in order to drive the shift lens 303. The AD conversion unit 106 acquires an actual position signal indicating the position of the shift lens 303, converts it from analog data to digital data, and sends this to the PID control unit 104 and the correction characteristic changing unit 107.

  Next, a second shake correction system corresponding to the second imaging system will be described. The second shake correction system includes a correction amount calculation unit (see 108 and 109) for obtaining a shake correction amount, and a shake correction unit that drives the shift lens 314 according to the shake correction amount to perform shake correction. The constituent elements denoted by reference numerals 108 to 112 are the same as the constituent elements described with reference numerals 102 to 106 in the first shake correction system, and therefore their description is omitted to avoid duplication. Unless otherwise noted, the description relating to the first shake correction system can be similarly applied to the second shake correction system. That is, each component of the second shake correction system (excluding the AD conversion unit 101 and the correction characteristic changing unit 107) has a code obtained by adding 6 to the code attached to each component of the first shake correction system. Use.

  The correction characteristic changing unit 107 can change the other correction characteristic in accordance with the position of one of the shift lenses 303 and 314. The operation unit 327 includes an operation member 207 (cross button) and an operation member 208 (menu button), and the mode of each imaging system can be arbitrarily selected by combining these operations. A signal from the operation unit 327 is sent to the correction characteristic changing unit 107.

  Hereinafter, the mode using the first imaging system and the first shake correction system is the moving image shooting mode, and the mode using the second imaging system and the second shake correction system is the still image shooting mode. Although the case will be described, there is no problem even if the relationship between the two is reversed. In this case, in the first shake correction system, the characteristic of the digital low-pass filter 102 is set by the correction characteristic changing unit 107 so that the optimum correction characteristic for moving image shooting can be obtained. On the other hand, in the second shake correction system, the characteristic of the digital low-pass filter 108 is set by the correction characteristic changing unit 107 so that the optimal correction characteristic for still image shooting can be obtained. In the correction characteristic optimal for moving image shooting, it reacts sensitively to the shake of the imaging device, and emphasizes the appearance as a moving image. On the other hand, in the correction characteristics that are optimal for still image shooting, the image pickup apparatus responds insensitive to the shake of the imaging device, and emphasizes the image stabilization performance as a still image. In general, moving images tend to increase the cut-off frequency of the digital low-pass filter, decrease the gain, and widen the limit of the driving range as compared with still images. At this time, once a large shake is applied to the imaging apparatus, the shift lens 303 in the moving image shooting mode returns to the center position, whereas the shift lens 314 in the still image shooting mode has a mechanical end (mechanical end). ). As a result, the angle of view of both imaging systems is greatly different, which not only makes the photographer feel uncomfortable, but also when switching to the stereoscopic shooting mode, there is a possibility that an intended stereoscopic image cannot be created. Therefore, the correction characteristic changing unit 107 monitors the state of one shake correction system, and changes the correction characteristic of the other shake correction system in accordance with the state change. Thereby, a photographer's discomfort can be reduced.

[First Embodiment]
Hereinafter, a first embodiment of the present invention will be described with reference to FIG. FIG. 4 is a flowchart in the case where the correction characteristic of another shake correction system is changed according to the state of at least one shake correction system when calculating the shake correction amount based on the shake information detected by the shake detection unit 324. is there.
In step S401, a shake correction amount calculation process is started, and in step S402, shake information acquisition processing is performed. That is, the shake information detected by the shake detection unit 324 is converted from analog data to digital data by the AD conversion unit 101, and each shake correction system acquires the data. In order to describe the processes of the first and second shake correction systems in parallel, in FIG. 4, the line that proceeds from S402 to S411 and the line that proceeds from S402 to S403 are shown together without condition determination.

  In S403, a process for determining whether or not the current mode is a predetermined mode is performed. Here, the predetermined mode will be described as a still image mode and a moving image mode. In general, moving images tend to increase the cutoff frequency of the digital filter, decrease the gain, and widen the drive range as compared with still images. As a result, in the case of a still image, importance is attached to the image stabilization performance, and in the case of a moving image, the appearance is emphasized. As a result of the determination in S403, if the current mode is the still image mode or the moving image mode, the process proceeds to S404. Otherwise, the process proceeds to S410.

  In S <b> 404, the AD conversion unit 106 acquires the current position of the shift lens 303 or the integral value calculated in the calculation process in the PID control unit 104 as the state of the first shake correction system. In next step S405, the correction characteristic changing unit 107 compares the current position or the integral value acquired in step S404 with a predetermined value. Here, the predetermined value means a predetermined determination reference value. If the current position or the integral value is greater than or equal to the predetermined value, the process proceeds to S406. If the current position or the integral value is less than the predetermined value, the process proceeds to S410.

In step S406, the correction characteristic changing unit 107 changes the correction characteristic related to the second shake correction system. Here, the change of the correction characteristic means one of the following, and is to change the first and second shake correction systems so as to have the same or approximate correction characteristics.
Match the correction characteristic related to the second shake correction system with the correction characteristic related to the first shake correction system.
The correction characteristic related to the second shake correction system is set in the vicinity of the correction characteristic related to the first shake correction system (the former characteristic value is set to the vicinity value of the latter characteristic value).

  In the next step S407, a filter operation is performed by the digital low-pass filter 108 of the second shake correction system. The digital low-pass filter is a filter that allows a predetermined low frequency band to pass through, and functions as an integrator. This filter calculation is performed based on the correction characteristic changed in S406. In step S408, the driving range of the second shake correction system is changed. The drive range limiting unit 109 limits the output value obtained in S407, that is, the range of the shake correction amount that has passed through the digital low-pass filter 108. In this way, the shake correction amount is calculated for the second shake correction system in S409. Thereafter, the process proceeds to S413, and the shake correction amount calculation processing ends.

  When the process proceeds from S403 or S405 to S410, the calculation is performed by the digital low-pass filter 108 of the second shake correction system. In this case, the correction characteristic regarding the second shake correction system is the characteristic before the change. Then, the shake correction amount for the second shake correction system is calculated by the arithmetic processing of the digital low-pass filter 108 (S409).

  On the other hand, in steps S411 and 412, processing for the first shake correction system is performed. That is, in S411, the calculation is performed by the digital low-pass filter 102 of the first shake correction system. Then, the process proceeds to S412 and a shake correction amount is calculated for the first shake correction system, and the process proceeds to S413 and the shake correction amount calculation process ends. Note that the first shake correction system is assumed to have no change in the correction characteristics.

  The shake correction amount calculated in this way is sent to the shift lens drive control unit corresponding to each shake correction system. The above description can be similarly applied to the case where the first shake correction system and the second shake correction system are replaced to reverse the relationship therebetween.

  Next, the change of the correction characteristic will be described with a specific example. The digital low-pass filter has coefficients for determining a cutoff frequency and a gain, and the coefficients will be described below with reference to FIG.

FIG. 5A is a diagram illustrating the configuration of a non-recursive primary digital filter. The sampling period is represented by n, the input value at the current sampling time is denoted as X [n], and the input value at the previous sampling time is denoted as X [n-1]. “Z ⁻¹ ” represents a delay element, and constants a and b in a triangular frame indicating a multiplier element define the characteristics of this digital filter, and the cutoff frequency and gain are changed according to the combination. The “Σ” represents an addition element.
In this example, when the output value of the digital filter is written as Y [n], this is the sum of a term obtained by multiplying X [n] by a constant a and a term obtained by multiplying X [n-1] by a constant b. Obtained by the following formula.

上式中の定数a及びbの符号と大きさによりデジタルフィルタの特性が変化する。
図５（ｂ）は再帰型１次デジタルフィルタを例示した図である。サンプリング周期をnとして今回のサンプリング時点における入力値をX[n]と記し、前段の加算要素を経た後の中間値をZ[n]を記し、出力値をY[n]と記す。「Ｚ^-1」や「Σ」の意味は前述した通りであり、三角形枠内に示す定数a,b及びcは、このデジタルフィルタの特性を規定しており、その組み合わせに応じて、カットオフ周波数とゲインが変更される。中間値Z[n]は、入力値X[n]と、前回のサンプリング時点における中間値Z[n-１]に定数aを乗じたものを加算することで下式のように求まる。

The characteristics of the digital filter change depending on the signs and sizes of the constants a and b in the above equation.
FIG. 5B is a diagram illustrating a recursive primary digital filter. Assuming that the sampling period is n, the input value at the current sampling time is denoted as X [n], the intermediate value after passing through the previous addition element is denoted as Z [n], and the output value is denoted as Y [n]. The meanings of “Z ⁻¹ ” and “Σ” are as described above, and the constants a, b, and c shown in the triangular frame define the characteristics of this digital filter, and the cut-off depends on the combination. The frequency and gain are changed. The intermediate value Z [n] is obtained by adding the input value X [n] and the value obtained by multiplying the intermediate value Z [n-1] at the previous sampling time by a constant a as shown in the following equation.

さらに出力値Y[n]については、今回のサンプリング時点における中間値Z[n]に定数bを乗じた項と、前回のサンプリング時点における中間値Z[n-1]に定数cを乗じた項を加算した下式から算出される。

Furthermore, for the output value Y [n], the term obtained by multiplying the intermediate value Z [n] at the current sampling time by the constant b and the term obtained by multiplying the intermediate value Z [n-1] at the previous sampling time by the constant c. Is calculated from the following equation.

上式中の定数a,b,cの符号や大きさによってデジタルフィルタの特性が変化する。
２次以上の高次デジタルフィルタについても同様の構成となり、次数に応じて定数の個数は増えるが、この場合にも本発明の考え方を同様に適用できる。補正特性変更部１０７は、上記定係数の値を変更することにより、デジタルローパスフィルタに関するカットオフ周波数とゲインを変更する。そして該フィルタの出力はさらに駆動範囲制限部１０３，１０９を通過する際に制限され、シフトレンズ３０３，３１４の駆動範囲が変更される。

The characteristics of the digital filter vary depending on the sign and size of the constants a, b, and c in the above equation.
A second-order or higher-order digital filter has the same configuration, and the number of constants increases according to the order. However, the concept of the present invention can be applied in this case as well. The correction characteristic changing unit 107 changes the cutoff frequency and gain related to the digital low-pass filter by changing the value of the constant coefficient. The output of the filter is further restricted when passing through the drive range restriction units 103 and 109, and the drive ranges of the shift lenses 303 and 314 are changed.

[Second Embodiment]
Hereinafter, a second embodiment of the present invention will be described with reference to FIG. FIG. 6 is a flowchart illustrating a processing example in the case where the state and the correction characteristics of both shake correction systems are matched when the stereoscopic shooting mode is selected by a user operation using the operation unit 327.
In step S601, a shake correction amount calculation process starts. In step S602, a shake information acquisition process is performed. In other words, shake information is detected by the shake detection unit 324, and the analog data is converted into digital data by the AD conversion unit 101 to obtain the data. In step S603, the correction characteristic changing unit 107 determines whether or not the current mode is the stereoscopic shooting mode. The mode means a mode for performing stereoscopic shooting by forming an optical image with a plurality of imaging systems. As a result of the determination, in the case of the stereoscopic shooting mode, the process proceeds to S604, but in the case other than the stereoscopic shooting mode, the process proceeds to S608.

  In step S604, the correction characteristic changing unit 107 acquires detection results from the AD conversion units 106 and 112 and determines the states of the first shake correction system and the second shake correction system. As described above, the state is represented by the current position of the shift lens and the integrated value in the PID control unit. These are compared with the determination reference value. For example, the position of the shift lens is compared with the position serving as the drive center. As a result, if it is determined that each shift lens is in a position near the center, the process proceeds to S605. If not, the process proceeds to S608.

  In step S605, the correction characteristic changing unit 107 determines which state of the first and second shake correction systems is closer to the center of the drive range, that is, which shift lens of the shake correction system is closer to the drive center. Determine whether. As a result, if it is determined that the shift lens 303 related to the first shake correction system is closer to the drive center, the process proceeds to S606. On the contrary, if it is determined that the shift lens 314 related to the second shake correction system is closer to the drive center, the process proceeds to S607.

  In step S606, the correction characteristic changing unit 107 matches the characteristics of the second shake correction system with the characteristics of the first shake correction system. In step S607, the correction characteristic changing unit 107 changes the characteristics of the first shake correction system to those of the second shake correction system. Match the characteristics. The state where the shift lens is close to the drive center as the state of the shake correction system is a state where the change in the cut-off frequency and the gain are small, and is suitable for matching the characteristics and the state.

  In the stereoscopic shooting mode, as shown in S606 and S607, the characteristics of the first shake correction system and the characteristics of the second shake correction system are matched. That is, there are a case where the characteristics of the second shake correction system are matched with the characteristics of the first shake correction system and vice versa, and a case where both characteristics are adjusted to a fixed constant value prepared in advance. The constant value can be set based on the frequency of vibration. In normal shooting, a shake up to about 30 Hz is assumed, but there may be a frequency higher than that when shooting in a vehicle. At this time, even if the characteristic is changed, the control limit has been reached, so that the effect of shake correction cannot be expected. Therefore, it is preferable to set a constant value assuming a situation in which the shake has subsided in advance. The reason why the characteristic is changed before the state of the first shake correction system and the state of the second shake correction system are matched is that the state changes depending on the characteristic. Therefore, it is desirable to first match the characteristics of both, and then match the states of both.

  After S606 and S607, the process proceeds to S608, where calculation is performed by the digital low-pass filter 102 of the first shake correction system. In step S609, the digital low-pass filter 108 of the second shake correction system performs calculation. In S610, the correction characteristic changing unit 107 performs a process for matching the driving range between the first shake correction system and the second shake correction system. Thus, preparations for matching the states of the two are completed.

  In S611, processing for matching the state of the first shake correction system and the state of the second shake correction system is performed. Regarding the state to be matched at this time, when the state of the first shake correction system is matched with the state of the second shake correction system and vice versa, both states are set to a fixed state prepared in advance. May match. The shake information that is the input value is common to both, and the characteristics of the computation that is performed in the middle also match, so the shake correction amount that is the computation output result also matches. Then, the process proceeds to S612, and the shake correction amount calculation process ends.

  As described above, in the present embodiment, after the characteristics of the shake correction system are changed to match the characteristics of both systems to the predetermined characteristics, the state of the shake correction system is also matched to the predetermined state. As shown in S606 to S611, the characteristics and state of the shake correction system are matched with the characteristics and states of either the first shake correction system or the second shake correction system. At this time, for example, when the characteristics of one shake correction system of the first and second shake correction systems are matched with the characteristics of the other shake correction system, the other shake correction system is also in the state of the other shake correction system. Match the state of the correction system.

  As shown in steps S605 to S607, the correction characteristic changing unit 107 matches the characteristics of the other shake correction systems with the characteristics of the shake correction system determined to be close to the center of the driving range. Of the two shake correction systems, the characteristic of the other shake correction system coincides with the characteristic of the shake correction system having the shift lens near the drive center. Thereafter, the state of the shake correction system is also matched with the state of the shake correction system in which the shift lens is in the vicinity of the drive center.

  Eventually, the characteristics and states of the two shake correction systems coincide with each other, so that it is not necessary to perform the digital low-pass filter calculation process for each shake correction system. That is, the shake correction amount is calculated only in at least one image pickup system, and the calculation result is used for shake correction in other image pickup systems. Since it is necessary to align the outputs of a plurality of shake correction systems during stereoscopic shooting, only one shake correction system performs calculations in advance, and other shake correction systems can use the calculation results. After the characteristics and states are matched among the plurality of shake correction systems, the processing is performed according to the flowchart in which S604 to 607 and S609 to 611 are deleted in FIG. In this way, redundant calculations can be avoided and the calculation load can be reduced.

It should be noted that the above-described matching of characteristics and states does not necessarily mean exact matching, but if the difference in characteristics or status is within a predetermined tolerance, it is considered that the matching actually falls within the category of matching. be able to.
According to the second embodiment described above, when a stereoscopic shooting mode is selected, it is possible to generate an accurate stereoscopic image by aligning characteristics and states for a plurality of shake correction systems.

  As mentioned above, although preferred embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary. In particular, the description has been given assuming that the number of systems of the imaging system and the shake correction system is two, but the above description can be similarly applied even when the number of systems is increased to three or more. In the above embodiment, the image pickup apparatus has been described as an example. However, the present invention is not limited to this, and can be widely applied to various portable devices having an image pickup function.

101, 106, 112 AD conversion unit 102, 108 Digital low-pass filter 103, 109 Drive range limiting unit 104, 110 PID control unit 105, 111 DA conversion unit 107 Correction characteristic changing unit 303, 314 Shift lens (optical member)
304, 315 Shift lens drive control unit 309, 320 Imaging unit
324 shake detection unit
327 Operation unit
329 control unit

Claims (10)

An imaging apparatus including a plurality of imaging means for capturing the same subject from different viewpoints,
Operating means for selecting a shooting mode for each of the plurality of imaging means;
Shake detection means for detecting shake applied to the imaging device;
A correction amount calculation means for calculating a shake correction amount for each of the imaging means according to the output of the shake detection means;
A plurality of shake correction means provided for each of the plurality of imaging means in order to correct a shake of the optical image in accordance with the shake correction amount;
When the shooting modes selected by the operation unit for the plurality of imaging units are different, the cutoff frequency used in the calculation process of the shake correction amount and the calculation process of the shake correction amount for the plurality of shake correction units And a correction characteristic changing unit that changes at least one of a range of calculation output used in a calculation process of the gain or the shake correction amount . The correction characteristic changing means is based on the position acquired by the shake correction means or the information obtained in the calculation process of the shake correction amount when the shooting modes selected by the operation means are different for the plurality of image pickup means. The imaging apparatus according to claim 1 , wherein the plurality of shake correction units differ in cut-off frequency, gain, or calculation output range used in the calculation process of the shake correction amount . PID control means for selectively combining proportional control, differential control, and integral control is further provided.
The information acquired in the process of calculating the shake correction amount is an integral value obtained by the integration control, and the correction characteristic changing unit changes the characteristic of the shake correction unit based on the integral value. The imaging device according to claim 1 or 2. When moving image shooting is selected by the operation unit, the correction characteristic changing unit sets a cutoff frequency used in the calculation process of the shake correction amount compared to when still image shooting is selected by the operation unit. The imaging apparatus according to claim 1, wherein the imaging apparatus is raised. When moving image shooting is selected by the operation unit, the correction characteristic changing unit lowers the gain used in the calculation process of the shake correction amount compared to the case where still image shooting is selected by the operation unit. The imaging device according to any one of claims 1 to 4, wherein When the moving image shooting is selected by the operation means, the correction characteristic changing means is a range of the calculation output used in the process of calculating the shake correction amount compared to the case where the still image shooting is selected by the operation means. The imaging apparatus according to claim 1, wherein the imaging device is widened. An imaging apparatus including a plurality of imaging means for capturing the same subject from different viewpoints,
Operating means for selecting a shooting mode for each of the plurality of imaging means;
Shake detection means for detecting shake applied to the imaging device;
A correction amount calculation means for calculating a shake correction amount for each of the imaging means according to the output of the shake detection means;
A plurality of shake correction means provided for each of the plurality of imaging means in order to correct a shake of the optical image in accordance with the shake correction amount;
For the plurality of shake correction means, based on information obtained in the shake correction amount calculation process or the shake correction amount calculation process, the cutoff frequency used in the shake correction amount calculation process, and the shake correction amount calculation process Correction characteristic changing means for making different at least one characteristic of the range of the calculation output used in the calculation process of the gain used in the above or the shake correction amount,
In the case where stereoscopic imaging is performed by forming an optical image using the plurality of imaging units, the correction characteristic changing unit is configured such that any one of the plurality of shake correcting units has the position of the shake correcting unit at the center of the driving range. After determining whether they are close and matching the characteristics of the shake correction means to the characteristics of the shake correction means determined to be close to the center of the drive range, the state of the plurality of shake correction means is set to the center of the drive range. An image pickup apparatus that matches a state of a shake correction unit that is determined to be close to.   After the information and characteristics acquired in the process of calculating the position of the plurality of shake correction units or the shake correction amount are matched by the correction characteristic changing unit, the shake correction amount related to the shake correction unit is calculated by the correction amount calculation unit The imaging apparatus according to claim 7, wherein the calculated result is a calculation result of a shake correction amount related to a shake correction unit different from the shake correction unit. A method for controlling an image pickup apparatus including a plurality of image pickup means for shooting the same subject from different viewpoints,
An operation step of selecting a shooting mode for each of the plurality of imaging units by an operation unit;
A shake detection step for detecting shake applied to the imaging device;
A correction amount calculating step for calculating a shake correction amount for each of the imaging means according to the shake detected in the shake detecting step;
A shake correction step of performing shake correction by a plurality of shake correction means provided for each of the plurality of imaging means in order to correct a shake of an optical image in accordance with the shake correction amount;
When the shooting modes selected by the operation unit for the plurality of imaging units are different, the cutoff frequency used in the calculation process of the shake correction amount and the calculation process of the shake correction amount for the plurality of shake correction units And a correction characteristic changing step for varying at least one of the ranges of the calculation output used in the calculation process of the gain or the shake correction amount . A method for controlling an image pickup apparatus including a plurality of image pickup means for shooting the same subject from different viewpoints,
An operation step of selecting a shooting mode for each of the plurality of imaging units by an operation unit;
A shake detection step for detecting shake applied to the imaging device;
A correction amount calculating step for calculating a shake correction amount for each of the imaging means according to the shake detected in the shake detecting step;
A shake correction step of performing shake correction by a plurality of shake correction means provided for each of the plurality of imaging means in order to correct a shake of an optical image in accordance with the shake correction amount;
For the plurality of shake correction means, based on information obtained in the shake correction amount calculation process or the shake correction amount calculation process, the cutoff frequency used in the shake correction amount calculation process, and the shake correction amount calculation process A correction characteristic changing step that changes at least one characteristic of the range of the calculation output used in the calculation process of the gain or the shake correction amount used in
When stereoscopic imaging is performed by forming an optical image using the plurality of imaging units, in the correction characteristic changing step, among the plurality of shake correction units, the position of any shake correction unit is set to the center of the driving range. After determining whether they are close and matching the characteristics of the shake correction means to the characteristics of the shake correction means determined to be close to the center of the drive range, the state of the plurality of shake correction means is set to the center of the drive range. A control method for an image pickup apparatus, characterized by matching with a state of a shake correction unit determined to be close to.

Images