JP2005039534A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus for deciding an optimum image size in response to a vibration amount due to a camera-shake and a focal distance of a lens and capable of correcting the camera-shake of an image signal on the basis of the decided image size. <P>SOLUTION: The imaging apparatus is provided with: a means for detecting a maximum value of a camera-shake correction amount among camera-shake correction amounts calculated by a camera-shake correction amount calculation means; a means for calculating an effective image size to extract an image signal within a prescribed range subjected to camera-shake correction; a means for calculating an excess size in the camera-shake range; a means for calculating a coefficient value to adjust the camera-shake correction amount calculated by the camera-shake correction amount calculation means in response to the excessive size calculated by the excess size calculation means; a means for calculating correction vector data to correct an image signal photographed by the imaging section on the basis of the coefficient value calculated by the adjustment coefficient value calculation means and the camera-shake correction amount calculated by the camera-shake correction amount calculation means; and an image signal correction means for correcting the photographed image signal on the basis of the correction vector data calculated by the correction vector calculation means. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an imaging apparatus. More specifically, the present invention relates to an imaging apparatus that corrects camera shake of an image signal based on an image size determined according to a vibration amount due to camera shake and a focal length of a lens.

  In the prior art, in an imaging apparatus that can capture and record an image, such as a digital still camera or a video camera, the apparatus is downsized and the imaging magnification is also increased. Problems such as blurring and deterioration (bleeding or shifting) of recorded images have become prominent.

In order to prevent such problems, various techniques for preventing image degradation due to camera shake have been devised. For example, a camera shake detection signal output from a camera shake sensor that detects vibration caused by camera shake is sampled and held by a sample hold circuit, and the camera shake is detected. By correcting the position of the imaging output signal from the imaging means in accordance with the level of the camera shake signal sampled and held by the correction signal means, the level of the camera shake detection signal is held during correction of the screen of one field, and the screen of the reproduction screen is displayed. An imaging device that prevents blurring has been devised (for example, Patent Document 1).
JP-A-3-22766 (page 3-5, FIG. 1)

  However, in the conventional apparatus, the image size (hereinafter referred to as the effective image area size) of the image signal to be corrected for camera shake is fixed, and the wide angle (WIDE) side of the zoom lens even if the camera shake amount during shooting is constant. The camera shake correction amount may be small when the focal length is short (the focal length is short), and the camera shake correction amount is large when the telephoto (TELE) side of the zoom lens (the focal length is long) and the camera shake correction amount is large. In particular, on the telephoto (TELE) side of the zoom lens, when a large camera shake vibration is applied to the apparatus, the surplus portion in the range in which the camera shake can be corrected (hereinafter referred to as the camera shake correction range) is insufficient, and the camera shake correction range. Since the limit operation works at the end of the image, there is a problem that the image becomes unsightly.

  Also, normally, when the amount of camera shake correction is small, there is a sufficient surplus portion in the camera shake correction range.In such a state, the resolution is converted by enlarging the size of the effective image area, and in the spatial domain. It is possible to extract the high-frequency component of the image and minimize the degradation of the resolution. However, since the size of the effective image area is fixed, there is a problem that the resolution cannot be sufficiently extracted.

  Therefore, there is a problem to be solved by determining an optimal image size according to the vibration amount due to camera shake and the focal length of the lens, and correcting the camera shake of the image signal based on the determined image size.

  In order to solve the above-described problems, an imaging apparatus according to the present invention is configured as follows.

(1) An image pickup apparatus including a shake detection unit that detects a vibration amount due to a shake of the imaging unit as a shake signal, and the shake correction for correcting the image signal based on the shake signal detected by the shake detection unit A shake correction amount calculating means for calculating the amount, a maximum correction amount detecting means for detecting a maximum value of the shake correction amount among the shake correction amounts calculated by the shake correction amount calculating means, and the maximum correction amount detecting means. An image for calculating an effective image size for extracting an image signal in a predetermined range subjected to camera shake correction based on the maximum value of the camera shake correction amount detected in step S3 and an effective image size that is an image size that can be captured by the image sensor of the imaging unit A size calculation unit, a camera shake correction amount calculated by the camera shake correction amount calculation unit, an effective image size, and an effective image calculated by the image size calculation unit. Based on the size, a surplus size calculating unit that calculates a surplus size in a range to be corrected for camera shake, and a camera shake correction amount calculated by the camera shake correction amount calculating unit according to the surplus size calculated by the surplus size calculating unit An adjustment coefficient calculating means for calculating a coefficient value; and for correcting an image signal captured by the imaging unit based on the coefficient value calculated by the adjustment coefficient value calculating means and the camera shake correction amount calculated by the camera shake correction amount calculating means. Correction vector calculation means for calculating the correction vector data, and image signal correction means for correcting the image signal captured by the imaging unit based on the correction vector data calculated by the correction vector calculation means. An imaging apparatus characterized by comprising:
(2) An image pickup apparatus including a shake detection unit that detects a vibration amount due to a shake of the imaging unit as a shake signal, and the shake correction for correcting the image signal based on the shake signal detected by the shake detection unit A shake correction amount calculating means for calculating the amount, a maximum correction amount detecting means for detecting a maximum value of the shake correction amount among the shake correction amounts calculated by the shake correction amount calculating means, and the maximum correction amount detecting means. An image for calculating an effective image size for extracting an image signal in a predetermined range subjected to camera shake correction based on the maximum value of the camera shake correction amount detected in step S3 and an effective image size that is an image size that can be captured by the image sensor of the imaging unit. A size calculation unit, a camera shake correction amount calculated by the camera shake correction amount calculation unit, an effective image size, and an effective image calculated by the image size calculation unit. Based on the size, a surplus size calculating unit that calculates a surplus size in a range to be corrected for camera shake, and a camera shake correction amount calculated by the camera shake correction amount calculating unit according to the surplus size calculated by the surplus size calculating unit An adjustment coefficient calculating means for calculating a coefficient value; and for correcting an image signal captured by the imaging unit based on the coefficient value calculated by the adjustment coefficient value calculating means and the camera shake correction amount calculated by the camera shake correction amount calculating means. Correction vector calculation means for calculating the correction vector data, image signal correction means for correcting the image signal captured by the imaging unit based on the correction vector data calculated by the correction vector calculation means, and the image size calculation Based on the effective image size calculated by the means and the recorded image size when the image signal is recorded on a recording medium or recording device. A correction coefficient calculating means for calculating a conversion coefficient for converting the resolution of the image signal corrected by the image signal correcting means, and a correction by the image signal correcting means based on the conversion coefficient calculated by the conversion coefficient calculating means. And an image output means for converting the resolution of the image signal and outputting the converted image signal.

(3) An imaging apparatus including a camera shake detection unit that detects a vibration amount due to camera shake of the imaging unit as a camera shake signal, for correcting the camera shake of the image signal based on the camera shake signal detected by the camera shake detection unit. Camera shake correction amount calculation means for calculating a camera shake correction amount, a focal length detection unit for detecting focal length information of an imaging lens included in the imaging unit, and focal length information of the imaging lens detected by the focal length detection unit And an image size calculation means for calculating an effective image size for extracting an image signal in a predetermined range subjected to camera shake correction based on an effective image size that is an image size that can be captured by the image sensor of the imaging unit, and the camera shake correction amount Based on the image stabilization amount calculated by the calculation unit, the effective image size, and the effective image size calculated by the image size calculation unit A surplus size calculating means for calculating a surplus size in a range, and an adjustment for calculating a coefficient value for adjusting the hand shake correction amount calculated by the hand shake correction amount calculating means according to the surplus size calculated by the surplus size calculating means Correction vector data for correcting the image signal photographed by the imaging unit based on the coefficient value calculated by the coefficient calculation unit, the coefficient value calculated by the adjustment coefficient value calculation unit, and the camera shake correction amount calculated by the camera shake correction amount calculation unit Correction vector calculation means for calculating, and image signal correction means for correcting an image signal captured by the imaging unit based on the correction vector data calculated by the correction vector calculation means. Imaging device.
(4) An imaging apparatus including a camera shake detection unit that detects a vibration amount due to camera shake of the imaging unit as a camera shake signal, for correcting the camera shake of the image signal based on the camera shake signal detected by the camera shake detection unit. Camera shake correction amount calculation means for calculating a camera shake correction amount, a focal length detection unit for detecting focal length information of an imaging lens included in the imaging unit, and focal length information of the imaging lens detected by the focal length detection unit And an image size calculation means for calculating an effective image size for extracting an image signal in a predetermined range subjected to camera shake correction based on an effective image size that is an image size that can be captured by the image sensor of the imaging unit, and the camera shake correction amount Based on the image stabilization amount calculated by the calculation unit, the effective image size, and the effective image size calculated by the image size calculation unit A surplus size calculating means for calculating a surplus size in a range, and an adjustment for calculating a coefficient value for adjusting the hand shake correction amount calculated by the hand shake correction amount calculating means according to the surplus size calculated by the surplus size calculating means Correction vector data for correcting the image signal photographed by the imaging unit based on the coefficient value calculated by the coefficient calculation unit, the coefficient value calculated by the adjustment coefficient value calculation unit, and the camera shake correction amount calculated by the camera shake correction amount calculation unit A correction vector calculating means for calculating, an image signal correcting means for correcting an image signal captured by the imaging unit based on the correction vector data calculated by the correction vector calculating means, and an effective image calculated by the image size calculating means. Based on the size and the recorded image size when the image signal is recorded on a recording medium or a recording device, the image signal correcting means compensates the image signal. Conversion coefficient calculating means for calculating a conversion coefficient for converting the resolution of the image signal, and converting the resolution of the image signal corrected by the image signal correcting means based on the conversion coefficient calculated by the conversion coefficient calculating means. And an image output means for outputting the image.

  In the imaging apparatus having such a configuration, the maximum value of the camera shake correction amount is detected from the camera shake correction amount calculated based on the camera shake signal detected by the camera shake detection unit, and the maximum value of the camera shake correction amount and the imaging of the imaging unit are detected. Based on an effective image size that is an image size that can be captured by the element, an effective image size for extracting an image signal in a predetermined range subjected to camera shake correction is calculated.

  Alternatively, based on the focal length information of the imaging lens detected by the focal length detection unit and the effective image size that is an image size that can be captured by the imaging device of the imaging unit, an effective for extracting an image signal in a predetermined range corrected for camera shake Calculate the image size.

  Then, based on the camera shake correction amount calculated based on the camera shake signal detected by the camera shake detection unit, the effective image size, and the calculated effective image size, the surplus size in the range to be corrected is calculated, and the camera shake is corrected according to the surplus size. Correction vector data for calculating a coefficient value for adjusting the correction amount, and further correcting an image signal captured by the imaging unit based on the coefficient value and the camera shake correction amount calculated by the camera shake correction amount calculation means Is calculated.

  Since the image signal captured by the imaging unit is corrected based on the correction vector data calculated in this way, it is possible to perform camera shake correction with an optimal image size according to camera shake vibration or the focal length of the imaging lens. Become.

  Further, a conversion coefficient for converting the resolution of the image signal corrected by the image signal correction unit is calculated based on the effective image size and the recording image size when the image signal is recorded on the recording medium or the recording apparatus. Since the resolution of the image signal corrected based on the conversion coefficient is converted and output, the image signal that makes the best use of the resolution at the time of shooting can be recorded.

  Among the vibration amounts due to the camera shake of the photographer, a camera shake correction amount of a value that maximizes the camera shake correction amount (hereinafter referred to as the maximum camera shake correction amount) is detected, and an effective image size is calculated based on the detected maximum camera shake correction amount. Therefore, it is possible to obtain an excellent effect that it is possible to obtain an image signal in which camera shake correction is performed with an optimum image size corresponding to the camera shake of the photographer.

  In addition, by detecting the focal length data of the imaging lens and calculating the effective image size based on the detected focal length data, the camera shake is corrected by the optimum image size corresponding to the camera shake of the photographer and the focal length of the imaging lens. It is possible to obtain an excellent effect that a processed image signal can be obtained.

  In addition, since the shake correction of the image signal is performed by the correction vector data calculated using the effective image size described above, it is possible to realize the shake correction that reduces the limit operation at the end of the correctable range. There is an advantage that it is possible to obtain an image signal that sufficiently draws out the resolution at the time of shooting.

  Next, an embodiment of the imaging apparatus of the present invention will be described with reference to the drawings. However, the drawings are only for explanation, and do not limit the technical scope of the present invention.

  First, a first embodiment of the imaging apparatus according to the present invention will be described.

  FIG. 1 is a block diagram schematically showing the main components of the imaging apparatus of the first embodiment. The imaging unit 110, the correction circuit 120, the resolution conversion unit 130, the recording unit 140, the camera shake detection unit 150, An HPF (High Pass Filter) 160, a control unit 170, and the like are included.

  The imaging unit 110 includes an imaging element such as a lens and a CCD (Charge Coupled Device), a signal processing circuit, and the like, converts light from a subject input via the lens into an image signal by the imaging element, and performs signal processing. The circuit performs predetermined signal processing on the image signal and sends it to the correction circuit 120.

  The correction circuit 120 corrects the image signal sent from the imaging unit 110 based on the correction vector data specified by the control unit 170, extracts an image signal in a predetermined area (effective image area), and extracts a resolution conversion unit. To 130.

  The resolution conversion unit 130 converts the resolution of the image signal according to the resolution conversion coefficient corresponding to the image size (effective image area size) of the image signal sent from the correction circuit 120 according to the control unit 170, and the recording unit 140. To send.

  The image size that can be recorded in the recording unit 140 is determined by the recording method and recording medium, and the image signal sent from the correction circuit 120 cannot be transferred (recorded) to the recording unit 140 as it is. The image is converted into a recordable image size by conversion.

  Here, the vertical length of the effective image area is ah, the horizontal length is aw, the vertical conversion coefficient mh for the image size recorded in the recording unit 140, and the conversion coefficient of the horizontal conversion coefficient mw. Then, the vertical length ch and the horizontal length cw in the image size converted and output by the resolution converter 130 can be expressed by the following [Equation 1].

[Formula 1]
Length in the vertical direction after resolution conversion: ch = mh × ah
Horizontal length after resolution conversion: cw = mw x aw

  The recording unit 140 records the image signal output from the resolution conversion unit 130 under the control of the control unit 170. For example, an image signal is recorded on a hard disk device or a recording medium (memory card, magnetic tape, optical disk, etc.).

  The camera shake detection unit 150 detects the vibration amount due to the camera shake of the imaging unit 110, and sends the detected vibration amount to the microcomputer 160 as a camera shake signal. The camera shake signal is detected using a gyro sensor or an image recognition technique.

  The HPF (High Pass Filter) 160 distinguishes between low-frequency components close to DC (direct current) such as pan / tilt and hand-shake signals among signals output from the hand-shake detector 150, and suppresses the low-frequency components. It is a filter.

  The control unit 170 calculates a camera shake correction amount based on a camera shake signal sent from the camera shake detection circuit 150 sent via the HPF 160, and detects the maximum camera shake correction amount from the camera shake correction amounts calculated within a predetermined time. . Also, the effective image area (effective image size), surplus length (surplus area), integration coefficient value, correction vector / data, etc. are calculated, and based on these calculated data, the correction circuit 120, the resolution conversion unit 130, the recording The unit 140 and the like are controlled.

Next, the operation and processing of the control unit 170 will be described in detail according to the following order (1-1) to (1-6).
(1-1) Internal configuration of control unit (1-2) Method for detecting maximum camera shake correction amount (1-3) Method for calculating effective image area (effective image size) (1-4) Surplus length (surplus area) Calculation method (1-5) Integration coefficient value calculation method (1-6) Correction vector data calculation method

(1-1) Internal Configuration of Control Unit FIG. 2 is a block diagram showing the internal configuration of the control unit 170 in a simplified manner. The integrator 171, the delay unit 172, the surplus length calculation unit 173, and the integration coefficient calculation unit 174 are illustrated. , A multiplier 175 and the like.

  The integrator 171 integrates the camera shake correction amount calculated based on the camera shake signal from the camera shake detection unit 150 sent via the HPF 160 and the signal (correction vector data) output from the multiplier 155. And output.

  The delay unit 172 delays the signal (correction vector data) output from the integrator 171 by a predetermined time, and outputs the delayed signal to the surplus length calculation unit 173 and the multiplier 175.

  The surplus length calculation unit 173 calculates a surplus length that can be used for camera shake correction on the imaging surface based on a signal (correction vector data) output from the delay unit 172, and integrates the calculated surplus size data. The result is sent to the coefficient calculation unit 174.

  The integration coefficient calculation unit 174 calculates an integration coefficient based on the surplus length from the surplus length calculation unit 173, and sends the calculated integration coefficient value to the multiplier 175.

  The multiplier 175 multiplies the integration coefficient value from the integration coefficient calculation unit 174 and the signal (correction vector / data) output from the delay unit 172 and sends the result to the integrator 171.

(1-2) Detection Method of Maximum Camera Shake Correction Amount Next, a detection method of the maximum camera shake correction by the control unit 170 will be described.

  FIG. 3 is a graph schematically showing a temporal change in a camera shake correction amount calculated based on a camera shake signal detected by the camera shake detection unit 150.

  In the graph of FIG. 3, the control unit 170 compares the absolute value of S (t) with 0 as the reference position for camera shake correction and S (t) as the camera shake correction amount at time t. When the maximum camera shake correction amount between times 0 and T is tmax, the maximum camera shake correction amount Smax can be expressed by the following [Equation 2].

[Formula 2]
Maximum camera shake correction amount: Smax = max {| S (t) |}

  Further, assuming that the horizontal camera shake correction amount at time t is Sx (t) and the vertical camera shake correction amount is Sy (t), the maximum camera shake correction amounts Sxmax and Symax in each direction between time 0 and time T are: It can be represented by the following [Formula 3].

[Formula 3]
Maximum lateral camera shake correction amount: Sxmax = max {| Sx (t) |}
Maximum vertical camera shake correction amount: Symax = max {| Sy (t) |}

  Next, a detection flow of the maximum camera shake correction amount Smax will be described based on the flowchart of FIG.

  When the control unit 170 starts detecting the maximum camera shake correction amount, first, the control unit 170 clears the counter t for counting a predetermined set time T for detecting the maximum camera shake correction amount Smax to 0 (ST110).

  Next, the value of the maximum camera shake correction amount Smax is cleared to 0 (ST120).

  Then, the camera shake correction amount | S (t) | calculated based on the camera shake signal detected by the camera shake detection unit 150 is compared with the maximum camera shake correction amount Smax (ST130).

  When the absolute value | S (t) | of the camera shake correction amount is larger than the maximum camera shake correction amount Smax (| S (t) |> Smax), the value of | S (t) | is set to Smax, and the value of the counter t Is increased by one (ST130 → ST140, ST150).

  On the other hand, when the absolute value | S (t) | of the camera shake correction amount is equal to or less than the maximum camera shake correction amount Smax (| S (t) | ≦ Smax), the setting of Smax is not changed and the value of the counter t is set to one. Increase (ST130 → ST150).

  Then, the value of the counter t is compared with the set time T (ST150).

  While the counter t is less than the set time T (t <T), the above-described processing is repeated, and the camera shake correction amount | S (t) | calculated based on the camera shake signal detected by the camera shake detection unit 150 and the maximum camera shake. Compared with the correction amount Smax, the detection process of the value | S (t) | which becomes the maximum camera shake correction amount is repeated (ST160 → ST130 →... → ST160).

  When the counter t is equal to or longer than the set time T, the detection processing of the maximum camera shake correction amount is finished (ST160 → END).

  In this way, the absolute value Smax at the time of maximal out of the calculated camera shake correction amounts within a predetermined time is detected, and based on the detected maximum camera shake correction amount Smax, the effective image region, the surplus region, the integral Calculation of coefficient values and the like is performed.

(1-3) Method for Calculating Effective Image Area (Effective Image Size) Next, a method for calculating the effective image area (effective image size) by the control unit 170 will be described.

  FIG. 5 schematically shows a relationship between an effective image area (effective image size) indicating a range that can be imaged by the image sensor of the imaging unit 110 and an effective image area (effective image size) indicating an image size extracted by the correction circuit 120. FIG. A portion indicated by a thin line is an effective image area, and includes an effective image area indicated by a thick line.

  Here, the length of the effective image area in the vertical direction is bh, the length in the horizontal direction is bw, the length of the effective image area in the vertical direction ah, and the length in the horizontal direction is aw. For example, in a state in which no camera shake correction is performed, the effective image area is arranged at the center of the effective image area. At this time, the maximum horizontal camera shake correction amount is Sxmax, and the maximum vertical camera shake correction amount is Symax. Then, the length ah in the vertical direction and the length aw in the horizontal direction of the effective image area are calculated based on [Expression 4] shown below.

[Formula 4]
Length of effective image area in vertical direction: ah = bh-2 × Symax
The horizontal length of the effective image area: aw = bw−2 × Sxmax
However, bh ≧ ah, bw ≧ aw

  In this way, the vertical and horizontal lengths of the effective image area are calculated based on the vertical and horizontal maximum camera shake correction amounts Symax and Sxmax calculated by the method described in (1-2) above. As a result, an effective image area (effective image size) in which the optimum camera shake correction can be performed according to the camera shake state of the photographer is determined.

(1-4) Surplus Length (Surplus Area) Calculation Method Next, a surplus length (surplus area) calculation method performed by the control unit 170 will be described.

  6 illustrates an effective image area (effective image size) indicating a range that can be imaged by the image sensor of the imaging unit 110, an effective image area (effective image size) indicating an image size extracted by the correction circuit 120, and a surplus length ( It is the figure which showed schematically the relationship with the surplus area | region.

  As in FIG. 5, a portion indicated by a thin line is an effective image area, and includes an effective image area indicated by a thick line. In addition, the length of the effective image area in the vertical direction is bh, the length in the horizontal direction is bw, the length of the effective image area in the vertical direction ah, and the length in the horizontal direction is aw.

Here, in the effective image area, the coordinates of the correction vector data (arrow in FIG. 6) of the signal output from the delay unit 172 of FIG. In the case of vx ₋₁ , vy ₋₁ ), the region where camera shake correction can be performed is a region obtained by removing the effective image region (thick line) from the effective image region (thin line), and this region becomes a surplus region.

  At this time, the length between the top end of the effective image area and the top end of the effective image area is dh1, the length between the bottom end of the effective image area and the bottom end of the effective image area is dh2, and the length of the effective image area is the bottom end. If the length between the left end and the left end of the effective image area is dw1, and the length between the right end of the effective image area and the right end of the effective image area is dw2, the surplus length calculation unit 173 in FIG. Dh1, dh2, dw1, and dw2 are calculated based on [Expression 5] shown in FIG.

[Formula 5]
Upper length in the vertical direction: dh1 = {(bh-ah) / 2} -by _-1
Lower length in the vertical direction: dh2 = {(bh-ah) / 2} + vy _-1
Length of horizontal left part: dw1 = {(bw-aw) / 2} -vx _-1
Length of right side in horizontal direction: dw2 = {(bw-aw) / 2} + vx ₋₁

  Here, the surplus length calculation unit 173 in FIG. 2 compares the vertical lengths dh1 and dh2 and the horizontal length dw1 and dw2, respectively, and determines the shorter length of the surplus length dh and the horizontal surplus length dw. Select as. The extra length dh in the vertical direction and the extra length dw in the horizontal direction can be expressed by the following [Equation 6].

[Formula 6]
Surplus length in the vertical direction: dh = {(bh-ah) / 2}-| vy _-1 |
Surplus length in the horizontal direction: dw = {(bw−aw) / 2} − | vx ₋₁ |

  The surplus length calculation unit 173 outputs the calculated surplus lengths dh and dw to the integration coefficient calculation unit 175.

(1-5) Method for Calculating Integral Coefficient Value Subsequently, a method for calculating the integral coefficient value by the control unit 170 will be described.

  The integration coefficient value monotonously increases with respect to the surplus length. If f is a function that satisfies this relationship, ky is the integration coefficient value in the vertical direction, and kx is the integration coefficient value in the horizontal direction, 7].

[Formula 7]
Integration coefficient value in the vertical direction: ky = f (dh)
Horizontal integration coefficient value: kx = f (dw)

  For example, as shown in the table showing the relationship between the excess length and the integration coefficient value in FIG. In order to increase (shake correction amount), the integration coefficient value is increased. Conversely, if the surplus length is small but short (there is a small area where camera shake correction is possible), integration is performed to reduce the effect of camera shake correction (shake correction amount). A value that reduces the coefficient value is calculated.

  As a result, when shooting in a state where the surplus length is short, there is a possibility that the image will be corrected by hitting the end of the camera shake correction range (hereinafter referred to as the correction end). Therefore, by reducing the correction effect (camera shake correction amount), It is possible to reduce hitting the correction end.

  The integral coefficient calculation unit 175 sends the calculated integral coefficient values ky and kx to the multiplier 174.

(1-6) Correction Vector Data Calculation Method Next, a correction vector data calculation method performed by the control unit 170 will be described.

  The correction vector data is calculated by processing the integration coefficient values ky and kx sent from the integration coefficient calculation unit 175 by the multiplier 175 and the adder 171.

First, the multiplier 175 includes correction vector data (vx ₋₁ , vy ₋₁ ) of a signal output from the delay unit 172 of FIG. 2, that is, a signal immediately before the current time t (t−1), and The integration coefficient values ky and kx calculated by the integration coefficient calculation unit 175 are multiplied and sent to the adder 171.

  The adder 171 outputs the output signal from the multiplier 175, that is, the correction vector data of the signal immediately before the current time t (t-1), and the camera shake signal detected by the camera shake detection unit 150 at the current time t. Is integrated with the vector data.

Here, assuming that the vector data of the camera shake signal detected by the camera shake detection unit 150 is (mvx, mvy), the correction vector data vy ₀ in the vertical direction calculated by the multiplier 175 and the adder 171 and the correction in the horizontal direction. The vector data vx ₀ can be expressed by the following [Equation 8].

[Formula 8]
Correction vector data in the vertical direction: vy ₀ = mvy + (ky × vy ₋₁ )
Horizontal correction vector data: vx ₀ = mvx + (kx × vx ₋₁ )

Then, the correction vector data (vx ₀ , vy ₀ ) calculated by the control unit 170 is sent to the correction circuit 120, and the correction circuit 120 corrects the image signal based on the correction vector data.

  Next, an operation flow in the imaging apparatus of the first embodiment will be described with reference to FIG.

  First, when shooting is started, the camera shake detection unit 150 sends vibration due to camera shake as a camera shake signal to the HPF 160, and the HPF 160 suppresses the low frequency component of the camera shake signal from the camera shake detection unit 150 and sends it to the control unit 170.

  The control unit 170 calculates the camera shake correction amount S (t) calculated based on the camera shake signal detected by the camera shake detection unit 150 according to the maximum camera shake correction amount detection flow of FIG. 4 and detects the maximum camera shake correction amounts Sxmax and Symax. (ST210).

  Next, based on the effective image area (effective image size) of the imaging unit 110 and the detected maximum camera shake correction amount, the control unit 170 determines the effective image area (effective image size) in the vertical length ah and the horizontal direction. Is calculated (ST220).

  Next, based on the effective image region (effective image size) and the calculated effective image region (effective image size), the control unit 170 uses the surplus length calculation unit 173 to calculate the surplus length region dh, A surplus length dw in the direction is calculated (ST230).

  Next, the control unit 170 uses the integration coefficient calculation unit 175 to calculate the vertical and horizontal integration coefficient values ky and kx based on the calculated surplus length dh in the surplus length region and the surplus length dw in the horizontal direction. Calculate (ST240).

Next, the control unit 170 calculates the integration coefficient values ky and kx calculated by the integration coefficient calculation unit 175 and the correction vector data vy _{−1 of the} time (t−1) immediately before the current time t output from the delay unit 172. , Vx ₋₁ is multiplied by the multiplier 175 (ST250).

Next, the control unit 170 multiplies the vector data (mvx, mvy) of the camera shake signal detected by the camera shake detection unit 150 at the current time t and the data output by the multiplier 175, that is, the current time t. Correction vector data (vx ₀ , vy ₀ ) is calculated by integrating the correction vector data (ky × vy ₋₁ ) and (kx × vx ₋₁ ) at the time immediately before (t−1) (ST260). .

  Then, the control unit 170 sends the calculated correction vector data to the correction circuit 120, and the correction circuit 120 receives the image signal sent from the imaging unit 110 based on the correction vector data specified by the control unit 170. Is corrected, and an image signal of a predetermined area (effective image area) is extracted and sent to the resolution conversion unit 130 (ST270).

  The resolution conversion unit 130 converts the resolution of the image signal sent from the correction circuit 120 according to the resolution conversion coefficient designated by the control unit 170, and sends it to the recording unit 140 (ST280).

  The recording unit 140 records the image signal output from the resolution conversion unit 130 on, for example, a hard disk device or a recording medium (memory card, magnetic tape, optical disk, etc.) under the control of the control unit 170 (ST290).

  Note that each time the image signal correction processing is performed, the operations from the above-described steps ST210 to ST260 are repeatedly executed.

  If the maximum camera shake correction amount changes, the effective image area during shooting changes, that is, the recorded image size also changes. Therefore, the detection of the maximum camera shake correction amount in step ST210 is performed only at the start of shooting. As described above, after the size of the effective image area is set, it is possible not to change the size according to the maximum amount of camera shake correction.

  Next, a second embodiment of the image pickup apparatus of the present invention will be described.

  FIG. 9 is a block diagram schematically illustrating the main components of the image pickup apparatus according to the second embodiment. The image pickup unit 110, the correction circuit 120, the resolution conversion unit 130, the recording unit 140, the camera shake detection unit 150, An HPF (High Pass Filter) 160, a control unit 170, a focal length detection unit 180, and the like are included.

  In addition, the same figure number is given to what has a function equivalent to the imaging device (refer FIG. 1) of 1st Example.

  The imaging unit 110 includes an imaging element such as a lens and a CCD (Charge Coupled Device), a signal processing circuit, and the like, converts light from a subject input via the lens into an image signal by the imaging element, and performs signal processing. The circuit performs predetermined signal processing on the image signal and sends it to the correction circuit 120. Also, the focal length data of the lens is sent to the focal length detector 180.

  The correction circuit 120 corrects the image signal sent from the imaging unit 110 based on the correction vector data specified by the control unit 170, extracts an image signal in a predetermined area (effective image area), and extracts a resolution conversion unit. To 130.

  The resolution conversion unit 130 converts the resolution of the image signal sent from the correction circuit 120 in accordance with the resolution conversion coefficient designated by the control unit 170 and sends it to the recording unit 140.

  The resolution conversion unit 130 converts the resolution of the image signal according to the resolution conversion coefficient corresponding to the image size (effective image area size) of the image signal sent from the correction circuit 120 according to the control unit 170, and the recording unit 140. To send.

  The image size that can be recorded in the recording unit 140 is determined by the recording method and recording medium, and the image signal sent from the correction circuit 120 cannot be transferred (recorded) to the recording unit 140 as it is. The image is converted into a recordable image size by conversion.

  Here, the vertical length of the effective image area is ah, the horizontal length is aw, the vertical conversion coefficient mh for the image size recorded in the recording unit 140, and the conversion coefficient of the horizontal conversion coefficient mw. Then, the vertical length ch and the horizontal length cw in the image size converted and output by the resolution conversion unit 130 are expressed by [Expression 1] as in the first embodiment. it can.

[Formula 1]
Length in the vertical direction after resolution conversion: ch = mh × ah
Horizontal length after resolution conversion: cw = mw x aw

  The recording unit 140 records the image signal output from the resolution conversion unit 130 under the control of the control unit 170. For example, an image signal is recorded on a hard disk device or a recording medium (memory card, magnetic tape, optical disk, etc.).

  The camera shake detection unit 150 detects the vibration amount due to the camera shake of the imaging unit 110, and sends the detected vibration amount to the microcomputer 160 as a camera shake signal. The camera shake signal is detected using a gyro sensor or an image recognition technique.

  The HPF (High Pass Filter) 160 distinguishes between low-frequency components close to DC (direct current) such as pan / tilt and hand-shake signals among signals output from the hand-shake detector 150, and suppresses the low-frequency components. It is a filter.

  The control unit 170 calculates a camera shake correction amount based on the camera shake signal of the camera shake detection circuit 150 sent via the HPF 160, and the focal length of the lens sent from the camera shake correction amount and the focal length detection unit 180. An effective image area (effective image size) is calculated based on the data.

  Also, the surplus length (surplus area), the integral coefficient value, the correction vector data are calculated, and the correction circuit 120, the resolution conversion unit 130, the recording unit 140, and the like are controlled based on the calculated data.

  The focal length detection unit 180 detects the focal length data of the lens in the imaging unit 110 and sends it to the control unit 170.

Next, the operation and processing of the control unit 170 will be described in detail in the order of the following (2-1) to (2-6).
(2-1) Internal configuration of control unit (2-2) Effective image area (effective image size) calculation method (2-3) Surplus length (excess area) calculation method (2-4) Integration coefficient value calculation Method (2-5) Correction vector data calculation method

(2-1) Internal Configuration of Control Unit The control unit 170 includes an integrator 171, a delay unit 172, a surplus length calculation unit 173, an integral coefficient calculation unit 174, a multiplier 175, and the like in the first embodiment ( Since it is the same structure as FIG. 2 demonstrated by 1-1), and it is the same also about the function of each part 171-175, the description is abbreviate | omitted.

(2-2) Effective Image Area (Effective Image Size) Calculation Method Next, an effective image area (effective image size) calculation method will be described.

  Even if the camera shake vibration of the imaging unit 110 is constant during shooting, that is, the camera shake signal of the camera shake detection unit 150 is constant, the camera shake correction amount also changes when the focal length of the lens of the imaging unit 110 changes. The camera shake correction amount may be small when the focal length of the lens is short, and the camera shake correction amount is large when the focal length of the lens is long.

  In other words, there is no need for an area for camera shake correction when the focal length of the lens is short. Therefore, the effective image area size is increased (longitudinal and lateral lengths are increased) to reduce resolution degradation and the focal point of the lens. When the distance is long, an area for correcting camera shake is necessary, so that the size of the effective image area can be reduced (length and width are shortened).

  Therefore, the focal length detection unit 180 detects the focal length data of the lens in the imaging unit 110, and the control unit 170 calculates the camera shake correction amount S (t) calculated based on the camera shake signal detected by the camera shake detection unit 150, Based on the focal length data of the lens sent from the focal length detection unit 180, the size of the effective image area, that is, the vertical length ah of the effective image area and the horizontal length aw of the effective image area are determined. By calculating, an effective image area (effective image size) in which the optimum camera shake correction can be performed according to the focal length of the lens and the camera shake state of the photographer is determined.

(2-3) Surplus Length (Surplus Area) Calculation Method Next, a surplus length (surplus area) calculation method performed by the control unit 170 will be described. Similar to the description in (1-4) of the first embodiment described above, within the effective image area shown in FIG. 6, the signal output from the delay unit 172 in FIG. 2, that is, the time immediately before the current time t (t -1) When the coordinates of the correction vector data (arrows in FIG. 6) of the signal are (vx ₋₁ , vy ₋₁ ), the region where camera shake correction can be performed is from the effective image region (thin line) to the effective image region. This is an area excluding (thick line), and this area becomes a surplus area.

  At this time, the length between the top end of the effective image area and the top end of the effective image area is dh1, the length between the bottom end of the effective image area and the bottom end of the effective image area is dh2, and the length of the effective image area is the bottom end. If the length between the left end and the left end of the effective image area is dw1, and the length between the right end of the effective image area and the right end of the effective image area is dw2, the surplus length calculation unit 173 performs the first implementation. Based on [Expression 5] described in the example, dh1, dh2, dw1, and dw2 are calculated.

[Formula 5]
Upper length in the vertical direction: dh1 = {(bh-ah) / 2} -by _-1
Lower length in the vertical direction: dh2 = {(bh-ah) / 2} + vy _-1
Length of horizontal left part: dw1 = {(bw-aw) / 2} -vx _-1
Length of right side in horizontal direction: dw2 = {(bw-aw) / 2} + vx ₋₁

  Here, the surplus length calculation unit 173 compares the lengths dh1 and dh2 in the vertical direction and dw1 and dw2 in the horizontal direction, and selects the shorter one as the surplus length dh in the vertical direction and the surplus length dw in the horizontal direction. . The extra length dh in the vertical direction and the extra length dw in the horizontal direction can be expressed by [Expression 6] described in the first embodiment.

[Formula 6]
Surplus length in the vertical direction: dh = {(bh-ah) / 2}-| vy _-1 |
Surplus length in the horizontal direction: dw = {(bw−aw) / 2} − | vx ₋₁ |

  The surplus length calculation unit 173 outputs the calculated surplus lengths dh and dw to the integration coefficient calculation unit 175.

(2-4) Calculation Method of Integration Coefficient Value Subsequently, a calculation method of the integration coefficient value by the control unit 170 will be described. The calculation method of the integral coefficient value is the same as that described in (1-5) of the first embodiment. The integral coefficient value monotonously increases with respect to the surplus length, and a function satisfying this relationship is defined as f. Assuming that the vertical direction integral coefficient value is ky and the horizontal direction integral coefficient value is kx, it can be expressed by [Expression 7] described in the first embodiment.

[Formula 7]
Integration coefficient value in the vertical direction: ky = f (dh)
Horizontal integration coefficient value: kx = f (dw)

  For example, as shown in the table showing the relationship between the surplus length and the integral coefficient value in FIG. 7, the integral coefficient calculating unit 175 performs the correction effect (camera shake) when the surplus length is large (there are many areas where camera shake correction is possible). To increase the correction amount), increase the integral coefficient value. Conversely, if the surplus length is small but short (the area where camera shake correction is possible is small), the integral coefficient value is used to reduce the correction effect (shake correction amount). A value that reduces the value is calculated.

  As a result, when shooting in a state where the surplus length is short, there is a possibility that the image will be corrected by hitting the end of the camera shake correction range (hereinafter referred to as the correction end). Therefore, by reducing the correction effect (camera shake correction amount), It is possible to reduce hitting the correction end.

  The integral coefficient calculation unit 175 sends the calculated integral coefficient values ky and kx to the multiplier 174.

(2-5) Correction Vector Data Calculation Method Next, a correction vector data calculation method performed by the control unit 170 will be described. The correction vector data is obtained by processing the integration coefficient values ky and kx sent from the integration coefficient calculation unit 175 by the multiplier 175 and the adder 171 in the same manner as described in (1-5) of the first embodiment. Is calculated by

First, the multiplier 175 includes correction vector data (vx ₋₁ , vy ₋₁ ) of a signal output from the delay unit 172 of FIG. 2, that is, a signal immediately before the current time t (t−1), and The integration coefficient values ky and kx calculated by the integration coefficient calculation unit 175 are multiplied and sent to the adder 171.

  The adder 171 outputs the output signal from the multiplier 175, that is, the correction vector data of the signal immediately before the current time t (t-1), and the camera shake signal detected by the camera shake detection unit 150 at the current time t. Is integrated with the vector data.

Here, assuming that the vector data of the camera shake signal detected by the camera shake detection unit 150 is (mvx, mvy), the correction vector data vy ₀ in the vertical direction calculated by the multiplier 175 and the adder 171 and the correction in the horizontal direction. The vector data vx ₀ can be expressed by [Equation 8] described in the first embodiment.

[Formula 8]
Correction vector data in the vertical direction: vy ₀ = mvy + (ky × vy ₋₁ )
Horizontal correction vector data: vx ₀ = mvx + (kx × vx ₋₁ )

Then, the correction vector data (vx ₀ , vy ₀ ) calculated by the control unit 170 is sent to the correction circuit 120, and the correction circuit 120 corrects the image signal based on the correction vector data.

  Subsequently, an operation flow in the imaging apparatus of the second embodiment will be described with reference to FIG.

  First, when shooting is started, the camera shake detection unit 150 sends vibration due to camera shake as a camera shake signal to the HPF 160, and the HPF 160 suppresses the low frequency component of the camera shake signal from the camera shake detection unit 150 and sends it to the control unit 170.

  Control section 170 calculates a camera shake correction amount S (t) calculated based on the camera shake signal detected by camera shake detection section 150 (ST310).

  On the other hand, the focal length detection unit 180 detects the focal length data of the lens in the imaging unit 110 and sends it to the control unit according to the control flow of FIG. 11, and the control unit 170 detects the calculated camera shake correction amount and the focal length detection. Based on the focal length data of the lens sent from the unit 180, the longitudinal length ah and the lateral length aw of the effective image area (effective image size) are calculated (ST410, ST420).

  Next, based on the effective image region (effective image size) and the calculated effective image region (effective image size), the control unit 170 uses the surplus length calculation unit 173 to calculate the surplus length region dh, A surplus length dw in the direction is calculated (ST320).

  Next, the control unit 170 uses the integration coefficient calculation unit 175 to calculate the vertical and horizontal integration coefficient values ky and kx based on the calculated surplus length dh in the surplus length region and the surplus length dw in the horizontal direction. Calculate (ST330).

Next, the control unit 170 calculates the integration coefficient values ky and kx calculated by the integration coefficient calculation unit 175 and the correction vector data vy _{−1 of the} time (t−1) immediately before the current time t output from the delay unit 172. , Vx ₋₁ is multiplied by the multiplier 175 (ST340).

Next, the control unit 170 multiplies the vector data (mvx, mvy) of the camera shake signal detected by the camera shake detection unit 150 at the current time t and the data output by the multiplier 175, that is, the current time t. Correction vector data (vx ₀ , vy ₀ ) is calculated by integrating the correction vector data (ky × vy ₋₁ ) and (kx × vx ₋₁ ) at the time immediately before (t−1) (ST350). .

  Then, the control unit 170 sends the calculated correction vector data to the correction circuit 120, and the correction circuit 120 receives the image signal sent from the imaging unit 110 based on the correction vector data specified by the control unit 170. Is corrected, and an image signal of a predetermined area (effective image area) is extracted and sent to the resolution converter 130 (ST360).

  The resolution conversion unit 130 converts the resolution of the image signal sent from the correction circuit 120 according to the resolution conversion coefficient designated by the control unit 170 and sends it to the recording unit 140 (ST370).

  Recording section 140 records the image signal output from resolution conversion section 130, for example, on a hard disk device or a recording medium (memory card, magnetic tape, optical disk, etc.) under the control of control section 170 (ST380).

  The operations from step ST310 to ST350 described above are repeatedly executed every time the image signal correction process is performed.

  Also, if the camera shake correction amount changes, the effective image area being shot changes, that is, the recorded image size also changes. Therefore, the camera shake correction amount in step ST310 is detected only at the start of shooting. Thus, after the size of the effective image area is set, it is possible not to change the size according to the focal length of the lens and the amount of camera shake correction.

FIG. 2 is a block diagram schematically illustrating a main configuration of the imaging apparatus according to the first embodiment. It is the figure which showed the block diagram which simplified and showed the structure of the control part in the imaging device which concerns on this invention. 6 is a graph schematically showing a temporal change in a camera shake correction amount calculated based on a camera shake signal in the imaging apparatus according to the present invention. 4 is a flowchart for explaining a detection flow of a maximum camera shake correction amount by the imaging apparatus shown in FIG. 1. Explanatory drawing which showed schematically the relationship between the effective image area (effective image size) which shows the range which can be imaged with the image pick-up element of an imaging part, and the effective image area (effective image size) which shows the image size extracted by a correction circuit It is. The relationship between the effective image area (effective image size) indicating the range that can be imaged by the image sensor of the imaging unit, the effective image area (effective image size) indicating the image size extracted by the correction circuit, and the surplus length (excess area) is substantially omitted. It is explanatory drawing shown illustratively. It is explanatory drawing for demonstrating the relationship between a surplus length and an integral coefficient value. 3 is a flowchart for explaining an operation of the imaging apparatus illustrated in FIG. 1. It is the figure which showed the block diagram which simplified and showed the main components in the imaging device of a 2nd Example. 10 is a flowchart for explaining an operation of the imaging apparatus illustrated in FIG. 9. 10 is a flowchart for explaining an operation of a focal length detection unit in the imaging apparatus shown in FIG. 9.

Explanation of symbols

110; Imaging unit 120; Correction circuit 130; Resolution conversion unit 140; Recording unit 150; Camera shake detection unit 160; HPF (High Pass Filter)
170; control unit 171; integrator 172; delay unit 173; surplus length calculation unit 174; integral coefficient calculation unit 175; multiplier 180; focal length detection unit

Claims (4)

An imaging apparatus including a camera shake detection unit that detects a vibration amount due to camera shake of an imaging unit as a camera shake signal,
A camera shake correction amount calculating unit that calculates a camera shake correction amount for correcting the image signal based on a camera shake signal detected by the camera shake detecting unit;
A maximum correction amount detecting means for detecting a maximum value of the camera shake correction amount among the camera shake correction amounts calculated by the camera shake correction amount calculating means;
Based on the maximum value of the camera shake correction amount detected by the maximum correction amount detecting means and the effective image size that is an image size that can be captured by the image sensor of the imaging unit, an effective for extracting an image signal in a predetermined range subjected to camera shake correction Image size calculating means for calculating the image size;
Based on the camera shake correction amount calculated by the camera shake correction amount calculation unit, the effective image size, and the effective image size calculated by the image size calculation unit, an extra size calculation unit that calculates an extra size in a range to be subjected to camera shake correction;
An adjustment coefficient calculating means for calculating a coefficient value for adjusting the camera shake correction amount calculated by the camera shake correction amount calculating means according to the surplus size calculated by the surplus size calculating means;
Correction vector calculation for calculating correction vector data for correcting an image signal captured by the imaging unit based on the coefficient value calculated by the adjustment coefficient value calculation unit and the camera shake correction amount calculated by the camera shake correction amount calculation unit Means,
Image signal correction means for correcting an image signal captured by the imaging unit based on correction vector data calculated by the correction vector calculation means;
An image pickup apparatus comprising: An imaging apparatus including a camera shake detection unit that detects a vibration amount due to camera shake of an imaging unit as a camera shake signal,
A camera shake correction amount calculating unit that calculates a camera shake correction amount for correcting the image signal based on a camera shake signal detected by the camera shake detecting unit;
A maximum correction amount detecting means for detecting a maximum value of the camera shake correction amount among the camera shake correction amounts calculated by the camera shake correction amount calculating means;
Based on the maximum value of the camera shake correction amount detected by the maximum correction amount detecting means and the effective image size that is an image size that can be captured by the image sensor of the imaging unit, an effective for extracting an image signal in a predetermined range subjected to camera shake correction Image size calculating means for calculating the image size;
Based on the camera shake correction amount calculated by the camera shake correction amount calculation unit, the effective image size, and the effective image size calculated by the image size calculation unit, an extra size calculation unit that calculates an extra size in a range to be subjected to camera shake correction;
An adjustment coefficient calculating means for calculating a coefficient value for adjusting the camera shake correction amount calculated by the camera shake correction amount calculating means according to the surplus size calculated by the surplus size calculating means;
Correction vector calculation for calculating correction vector data for correcting an image signal captured by the imaging unit based on the coefficient value calculated by the adjustment coefficient value calculation unit and the camera shake correction amount calculated by the camera shake correction amount calculation unit Means,
Image signal correction means for correcting an image signal captured by the imaging unit based on correction vector data calculated by the correction vector calculation means;
Conversion for converting the resolution of the image signal corrected by the image signal correcting unit based on the effective image size calculated by the image size calculating unit and the recorded image size when the image signal is recorded on a recording medium or a recording apparatus. Conversion coefficient calculation means for calculating a coefficient;
An image output means for converting and outputting the resolution of the image signal corrected by the image signal correction means based on the conversion coefficient calculated by the conversion coefficient calculation means;
An image pickup apparatus comprising: An imaging apparatus including a camera shake detection unit that detects a vibration amount due to camera shake of an imaging unit as a camera shake signal,
A camera shake correction amount calculating unit that calculates a camera shake correction amount for correcting the camera shake of the image signal based on the camera shake signal detected by the camera shake detecting unit;
A focal length detection unit for detecting focal length information of an imaging lens included in the imaging unit;
An effective image for extracting an image signal in a predetermined range subjected to camera shake correction based on focal length information of the imaging lens detected by the focal length detection unit and an effective image size that is an image size that can be captured by the imaging device of the imaging unit. Image size calculating means for calculating the size;
Based on the camera shake correction amount calculated by the camera shake correction amount calculation unit, the effective image size, and the effective image size calculated by the image size calculation unit, an extra size calculation unit that calculates an extra size in a range to be subjected to camera shake correction;
An adjustment coefficient calculating means for calculating a coefficient value for adjusting the camera shake correction amount calculated by the camera shake correction amount calculating means according to the surplus size calculated by the surplus size calculating means;
Correction vector calculation for calculating correction vector data for correcting an image signal captured by the imaging unit based on the coefficient value calculated by the adjustment coefficient value calculation unit and the camera shake correction amount calculated by the camera shake correction amount calculation unit Means,
Image signal correction means for correcting an image signal captured by the imaging unit based on correction vector data calculated by the correction vector calculation means;
An image pickup apparatus comprising: An imaging apparatus including a camera shake detection unit that detects a vibration amount due to camera shake of an imaging unit as a camera shake signal,
A camera shake correction amount calculating unit that calculates a camera shake correction amount for correcting the camera shake of the image signal based on the camera shake signal detected by the camera shake detecting unit;
A focal length detection unit for detecting focal length information of an imaging lens included in the imaging unit;
An effective image for extracting an image signal in a predetermined range subjected to camera shake correction based on focal length information of the imaging lens detected by the focal length detection unit and an effective image size that is an image size that can be captured by the imaging device of the imaging unit. Image size calculating means for calculating the size;
Based on the camera shake correction amount calculated by the camera shake correction amount calculation unit, the effective image size, and the effective image size calculated by the image size calculation unit, an extra size calculation unit that calculates an extra size in a range to be subjected to camera shake correction;
An adjustment coefficient calculating means for calculating a coefficient value for adjusting the camera shake correction amount calculated by the camera shake correction amount calculating means according to the surplus size calculated by the surplus size calculating means;
Correction vector calculation for calculating correction vector data for correcting an image signal captured by the imaging unit based on the coefficient value calculated by the adjustment coefficient value calculation unit and the camera shake correction amount calculated by the camera shake correction amount calculation unit Means,
Image signal correction means for correcting an image signal captured by the imaging unit based on correction vector data calculated by the correction vector calculation means;
Conversion for converting the resolution of the image signal corrected by the image signal correcting unit based on the effective image size calculated by the image size calculating unit and the recorded image size when the image signal is recorded on a recording medium or a recording apparatus. Conversion coefficient calculation means for calculating a coefficient;
An image output means for converting and outputting the resolution of the image signal corrected by the image signal correction means based on the conversion coefficient calculated by the conversion coefficient calculation means;
An image pickup apparatus comprising:

Images