JP2002027312A - Image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image pickup device capable of conducting accurate hand shake correction and low power consumption suitable for a photographing mode by hand shake correction suitable for each type photographing mode. SOLUTION: The image pickup device shown in the Fig. comprises a CCD 23 for photographing an object to output image data; a first hand shake correcting means (a first shake detector 31a, a first shake correction 31b) for electronically correcting the hand shake; and a second hand shake correcting means (a second shake detector 7a, a second shake correction controller 7b and a shake corrector 24) for optically or mechanically correcting the hand shake in such a manner that, in a moving image photographing mode or a consecutive photographing mode. Deflection of an image during exposure is corrected by the second means, and deflection of the image between frames (image) is corrected by the first means.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image pickup apparatus, and more particularly, to a digital camera for inputting image data obtained by picking up an image of a subject (subject image) using a solid-state image sensor such as a CCD (Charge Coupled Device). The present invention relates to an imaging device used for a still camera, a digital video camera, and the like.

[0002]

2. Description of the Related Art Recently, digital cameras have been reduced in size and weight. In digital cameras, camera shake is likely to occur as the size and weight are reduced. Conventionally, various methods for preventing camera shake of a digital camera have been proposed.

For example, in an "imaging apparatus" described in Japanese Patent Application Laid-Open No. 2000-69351, an image signal between frames (images) is processed by image signal processing in accordance with a recording mode (moving image recording mode / still image recording mode). There is disclosed a technique for performing a camera shake correction by selectively selecting a first camera shake correction unit that corrects shake and a second camera shake correction unit that corrects image shake by optical or mechanical means. .

[0004]

However, in the "imaging device" described in Japanese Patent Application Laid-Open No. 2000-69351, the electronic device is controlled according to the recording mode (moving image recording mode / still image recording mode). Is only switching between dynamic hand-shake correction and mechanical or optical hand-shake correction. Therefore, when it is not possible to perform sufficient hand-shake correction according to the shooting mode such as video or panorama, There is a problem that energy may be consumed in some cases.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an image pickup apparatus capable of performing camera shake correction suitable for various photographing modes and performing high accuracy and low power consumption camera shake correction suitable for the photographing mode.

[0006]

Means for Solving the Problems The above-mentioned problems are solved,
In order to achieve the object, the invention according to claim 1 is an imaging apparatus having a moving image shooting mode for shooting a moving image of a subject, comprising: an imaging unit that captures an image of the subject and outputs image data; A first camera shake correction means for correcting camera shake and a second camera shake for optically or mechanically correcting camera shake
In the moving image shooting mode,
The image blur during exposure is corrected by the second camera shake correction unit, and the image shake between frames (images) is corrected by the first camera shake correction unit.

According to the above invention, the image pickup means picks up an object and outputs image data, the first camera shake correction means electronically corrects the camera shake, and the second camera shake correction means uses the optical or mechanical means. In the moving image shooting mode, the image blur during exposure is corrected by the second camera shake correction unit, and the image shake between frames (images) is corrected by the first camera shake correction unit. Is corrected.

According to a second aspect of the present invention, there is provided an image pickup apparatus having a continuous photographing mode for continuously photographing an object, an image pickup means for picking up an object and outputting image data, First camera shake correction means for correcting camera shake, and second camera shake correction for optically or mechanically correcting camera shake
In the continuous shooting mode,
The second camera shake correcting means corrects the image shake during exposure, and the first camera shake correcting means corrects the image shake between frames (images).

According to the above invention, the image pickup means picks up an object and outputs image data, the first camera shake correction means electronically corrects the camera shake, and the second camera shake correction means uses an optical or mechanical means. In the continuous shooting mode, the second image stabilizing unit corrects the image shake during exposure, and the first image stabilizing unit corrects the image between frames (images). To correct the shake.

According to a third aspect of the present invention, there is provided an image pickup apparatus having a multiple exposure photographing mode for photographing a subject with multiple exposures. A first camera shake correction unit for correcting the camera shake, and a second camera shake correction unit for optically or mechanically correcting the camera shake
In the multiple exposure shooting mode, the second camera shake correction unit corrects the image shake during exposure, and the first camera shake correction unit includes
This is for correcting image shake between frames (images).

According to the present invention, the image pickup means picks up an object and outputs image data, the first camera shake correction means electronically corrects the camera shake, and the second camera shake correction means uses an optical or mechanical In the multiple exposure shooting mode, the second image stabilization unit corrects image shake during exposure, and the first image stabilization unit corrects image movement between frames (images). To correct the shake.

According to a fourth aspect of the present invention, there is provided a photographing apparatus having a night scene photographing mode for photographing a subject at a long distance and a short distance and outputting image data by one shutter operation. An image pick-up unit for outputting image data, a first hand shake correcting unit for electronically correcting hand shake, and a second hand shake correcting unit for optically or mechanically correcting hand shake. The second image stabilization means corrects the image shake during exposure, and the first image stabilization means
This is for correcting image shake between frames (images).

According to the above invention, the image pickup means picks up an object and outputs image data, the first camera shake correction means electronically corrects the camera shake, and the second camera shake correction means uses the optical or mechanical means. In the night scene shooting mode, the second image stabilization unit corrects image shake during exposure, and the first image stabilization unit corrects image shake between frames (images). Is corrected.

According to a fifth aspect of the present invention, there is provided a digital camera having a panoramic photographing mode for photographing a wide-angle object into a plurality of continuous image data in a predetermined direction and outputting a panoramic image. A panoramic photographing mode, comprising: an image pickup unit that picks up an image and outputs image data; a first camera shake correction unit that electronically corrects camera shake; and a second camera shake correction unit that optically or mechanically corrects camera shake. Then, the shake of the image during exposure is corrected by the second shake correction means, and the shake of the image between frames (images) is corrected by the first shake correction means.

According to the above-mentioned invention, the image pickup means picks up an object and outputs image data, the first camera shake correction means electronically corrects the camera shake, and the first camera shake correction means and the second camera shake correction means. The camera shake correction means optically or mechanically corrects the camera shake.
The image blur correction during exposure is corrected by
Further, the first camera shake correcting means corrects the image shake between frames (images).

[0016] The invention according to claim 6 is the invention according to claim 5.
In the invention according to the present invention, further, display means for displaying a monitoring image, and in the panoramic shooting mode, control is performed to prohibit camera shake correction at least in a direction connecting the images while the monitoring image is displayed on the display means. Camera shake correction control means.

According to the above-mentioned invention, the camera shake correction control means performs control so as to prohibit camera shake correction at least in a direction connecting the images while the monitoring image is displayed on the display means in the panoramic photographing mode.

The invention according to claim 7 is the invention according to claim 6.
In the invention according to the first aspect, the camera shake correction control means permits the camera shake correction in the panorama shooting mode when an instruction to execute AF is matched. According to the above invention, the camera shake correction control means permits the camera shake correction in the panoramic shooting mode when an instruction to execute AF is matched.

The invention according to claim 8 is the invention according to claim 6.
According to the invention, the camera shake correction control means permits the camera shake correction in the panoramic shooting mode until the first image serving as a reference is completed. According to the above invention, the camera shake correction control means permits the camera shake correction in the panoramic shooting mode until the shooting of the first reference image is completed.

According to a ninth aspect of the present invention, there is provided an image pickup apparatus having a pixel shift shooting mode for performing pixel shift shooting and combining and outputting a plurality of images, wherein an image of a subject is shot and image data is output. Means for electronically correcting camera shake, and second camera shake correction means for optically or mechanically correcting camera shake. In the pixel shift shooting mode, the second camera shake is provided. The image shake during exposure is corrected by the correction means, and the image shake between frames (images) is corrected by the first camera shake correction means.

According to the above invention, the image pickup means picks up an object and outputs image data, the first camera shake correction means electronically corrects camera shake, and the second camera shake correction means uses optical or mechanical means. In the pixel shift shooting mode, the image blur during exposure is corrected by the second camera shake correcting unit, and the image blur between frames (images) is corrected by the first camera shake correcting unit. to correct.

According to a tenth aspect of the present invention, there is provided an imaging apparatus provided with a monitoring mode for imaging a subject and displaying image data on a display unit, comprising: an imaging unit for imaging the subject and outputting image data; A first camera-shake correction unit for optically or mechanically correcting the camera-shake, and a second camera-shake correction unit for optically or mechanically correcting the camera shake. And the first camera shake correcting means corrects the image shake between frames (images).

According to the above invention, the image pickup means picks up an object and outputs image data, the first camera shake correction means electronically corrects the camera shake, and the second camera shake correction means uses the optical or mechanical means. In the monitoring mode, the second camera shake correction means corrects the image shake during exposure, and the first camera shake correction means corrects the image shake between frames (images). to correct.

The invention according to claim 11 is the invention according to any one of claims 1 to 10,
The first and second image stabilization units perform image stabilization other than at the time of exposure, while the second image stabilization unit performs image stabilization at the time of exposure. According to the present invention, the first and second image stabilization units perform image stabilization other than during exposure, while the second image stabilization unit performs image stabilization during exposure.

According to a twelfth aspect of the present invention, in the invention according to the eleventh aspect, in the case of image blur correction other than at the time of exposure, the first camera shake correcting means is preferentially used. According to the above invention, in the case of image shake correction other than at the time of exposure, the first camera shake correction unit is preferentially used.

The invention according to claim 13 is the invention according to any one of claims 1 to 10, wherein
The first camera shake correction unit and the second camera shake correction unit perform shake correction based on the detection result of one shake detection unit that detects a shake. According to the above invention, the first camera shake correction unit and the second camera shake correction unit perform shake correction based on the detection result of one shake detection unit that detects a shake.

The invention according to claim 14 is the invention according to any one of claims 1 to 10,
The timing for switching between the first image stabilization unit and the second image stabilization unit is synchronized with the timing of a vertical synchronization signal of the imaging unit. According to the above invention, the timing of switching between the first camera shake correction unit and the second camera shake correction unit is synchronized with the timing of the vertical synchronization signal of the imaging unit.

The invention according to claim 15 is the invention according to any one of claims 1 to 10, wherein
The timing of switching between the first camera shake correction means and the second camera shake correction means is synchronized with the timing of starting the integration of the imaging means. According to the above-mentioned invention, the timing of switching between the first camera shake correction unit and the second camera shake correction unit is synchronized with the integration start timing of the imaging unit.

The invention according to claim 16 is the invention according to any one of claims 1 to 10, wherein
The second camera shake correcting means is a means for performing shake correction by displacing the image pickup means with a laminated piezoelectric element. According to the above invention, the laminated piezoelectric element is used as the second camera shake correction means.

[0030]

Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

(Embodiment 1) FIG. 1 is a block diagram showing an imaging apparatus according to Embodiment 1, in which 1 denotes a digital still camera (hereinafter referred to as a digital camera) which is an example of the imaging apparatus. Is shown.

The digital camera 1 shown in FIG. 1 can be roughly classified into an imaging block 2 for obtaining an analog image data by imaging a subject (subject image), and an analog image obtained by the imaging block 2. A signal processing block 3 for processing digital image data obtained by digitizing the data and outputting the processed digital image data to the outside.

In the digital camera 1, an A / D converter 4 for converting image data from analog to digital is provided between the imaging block 2 and the signal processing block 3, and a release (not shown) is provided in the signal processing block 3. A signal generator 5 for generating a signal in accordance with an operation of a key or a mode switch and outputting the signal to the signal processing block 3; a second shake detection unit 7a for detecting and correcting mechanical or optical camera shake The second shake correction control unit 7b and the display unit 6 for displaying a captured image are connected. When the release key of the signal generator 5 is half-pressed, the release 1 is turned on, and when fully pressed, the release 2 is turned on. When release 1 is turned on, AF, AE, and AWB are executed, and release 2 is performed.
When is turned on, shooting is performed.

The imaging block 2 includes an optical lens 20 and a second
The image pickup unit 21 and the like are provided movably under the control of the shake correction control unit 7b. The imaging unit 21 includes a mechanical mechanism 22 including a diaphragm and a mechanical shutter for blocking light incident on the lens 20 with an optical mechanism, a CCD 23 receiving light incident on the lens 20, and a CCD 23 supporting the CCD 23 and supporting the CCD 23. The image pickup apparatus further includes a shake correction unit that moves the light receiving surface between the image formation plane and the camera shake correction. CCD23
Is supplied to the A / D converter 4 via a CDS (correlation double sampling) circuit (not shown).

The signal processing block 3 has, for example, a system controller 30, a sensor data processing section 31, a display output processing section 32, a recording and storage section 33, and the like. The system controller 30 controls the operation of each unit in the apparatus, and includes an imaging operation, an A / D conversion, a recording operation,
It controls display operation, memory read / write, camera shake correction operation, and the like.

The system controller 30 is constituted by a microcomputer or the like, and controls each unit and executes arithmetic processing by operating the microcomputer according to various programs stored in the ROM in advance.

The sensor data processing section 31 has an A / D
The digital image data is input to the output of the converter 4 and various kinds of signal processing are performed, such as IPP processing (interpolation of image data, RGB → YUV conversion of image data, etc.) and JPEG processing (JP
EG-compliant image compression processing) and outputs input digital image data under the control of the system controller 30. The sensor data processing unit 31 includes a first shake detection unit 31a and a first shake correction unit 31b inside.
And

The first shake detecting section 31a detects a shake between images (frames) taken by image signal processing. The first shake correction unit 31b includes a first shake detection unit 31
The shake between images (between frames) detected in a is corrected by performing image signal processing (first shake correction). There are various methods for detecting and correcting a shake between images (between frames) by image signal processing. For example, a known field memory control method (for controlling a read address of a field memory according to a motion vector, The output screen is translated in the opposite direction to the movement to correct the screen shake) and CCD
A drive control method or the like can be used. In the above configuration, the first shake detecting unit 31a and the first shake correcting unit 31
b constitutes a first camera shake correction means.

The display output processing section 32 converts the digital image data input from the sensor data processing section 31 into a video signal and outputs the video signal to the display section 6. Record storage unit 33
Is, for example, a memory card for storing digital image data. The display unit 6 includes, for example, a liquid crystal monitor, and displays an image corresponding to the image data.

The second shake detecting section 7a and the second shake correction control section 7b are for correcting the shake in the image (frame) (second shake correction). The second shake detection unit 7
“a” includes, for example, mechanical means (for example, an acceleration sensor), and detects mechanical shake of a digital camera. Second
The shake correction control unit 7b drives and controls the shake correction unit 24 to correct the shake in the image (frame) according to the detection result of the second shake detection unit 7a. The shake correcting unit 24 is composed of, for example, an actuator and moves the CCD 23 to correct the shake of the image. The correction within the image (frame) is not limited to the mechanical method described above, but may be an optical method, or may be a method of moving the lens 20 instead of moving the CCD 23. good. That is, as a method of correcting the shake in the image (frame),
Known gimbal control, a variable vertex angle prism method, a method of moving and correcting a lens, and the like can be used. In the above configuration, the second shake detection unit 7a, the second shake correction control unit 7b, and the shake correction unit 24 constitute a second shake correction unit.

The system controller 30 has a monitoring mode (display mode) for displaying the captured image on the display unit 6 and a shooting mode for recording the captured image in the recording storage unit 33. A still image recording mode for recording a still image), a moving image recording mode for recording a moving image, a continuous shooting mode for continuously photographing a subject while the release key is pressed,
A multiple exposure mode for photographing a subject with multiple exposures, a night view photography mode for photographing a subject at a long distance and a short distance by one shutter operation and outputting image data, and a wide angle subject in a fixed direction. A panorama shooting mode in which a plurality of image data are captured and output as a panoramic image, and a CCD 23 in a first (first) and a second (second) mode
And a pixel shift photographing mode for combining the two image data to output a high quality image. These modes are switched by a mode switch of the signal generator 5.

The system controller 30 switches between the camera shake correcting means (the first camera shake correcting means and the second camera shake correcting means) when receiving an instruction to switch the photographing mode (recording mode) from the signal generator 5. .

Next, the details of the first and second camera shake correction means will be described. Table 1 below shows
Purposes of the first camera shake correction means and the second camera shake correction means
Means, shake correction between frames (images), shake correction within one frame (image), energy consumption.

[0044]

[Table 1]

FIG. 2 and FIG. 3 are explanatory diagrams for explaining a case of correcting image shake between frames (images).
In particular, FIG. 2 is a diagram showing a case where the shake between frames is not corrected,
FIG. 3 is a diagram showing a case where the shake between frames is corrected.

As shown in FIG. 2, when the shake between frames is not corrected, the position of the subject image shifts for each frame with the shake. On the other hand, as shown in FIG. 3, when the correction between frames is performed, the position of the subject image becomes a correct position without being affected by the shake.

FIGS. 4 and 5 are explanatory diagrams for explaining a case where the shake within one frame (image) is corrected. In particular, FIG. 4 is a diagram showing a case where the shake is not corrected within the frame. FIG. 5 is a diagram showing a case where the shake is corrected in the frame.

As shown in FIG. 4, when the shake in the frame is not corrected, the position of the subject image in the frame is shifted with the shake. On the other hand, as shown in FIG. 5, when the shake is corrected in the frame, the flow of the subject image can be corrected without being affected by the shake.

FIGS. 6 and 7 are explanatory diagrams for explaining the shake between frames and within a frame. In particular, FIG. 6 is a diagram for explaining the case where the shake between frames and within a frame is not corrected. 7
FIG. 8 is a diagram for explaining a case where the shake between frames is corrected.

As shown in FIG. 6, when the shake between frames and within a frame is not corrected, the position of the subject image between the frames and within the frame is shifted with the shake. On the other hand, as shown in FIG. 7, when the shake between the frames is corrected, the shake between the frames can be corrected, but the shake in the frame cannot be corrected.

Therefore, the first camera shake correction means can correct the shift between frames, but cannot correct the image flow during one-frame exposure. If the video image is printed out with the video image still, the image becomes a camera shake image.
In this case, in order to prevent the image quality from deteriorating due to camera shake, it is necessary to make corrections in frames even when shooting moving images.

8 to 11 are explanatory diagrams for explaining the effective range of the CCD 23 when displaying an image on the display (monitor) 6. FIG. FIG. 8 shows C in the case of displaying on the display unit 6.
FIG. 9 is a view showing an effective range of the CD 23, FIG. 9 is a view showing an example of a shake in the effective shooting range of the CCD 23, FIG. FIG. 6 is a diagram showing an example in which is displayed on a display unit.

In this embodiment, as shown in FIG. 8, a range narrower than the actual effective imaging range (a) of the CCD 23 is set as the display range (b) of the monitor. Thus, there is no uncomfortable feeling even if the screen is cut out by performing the shake correction by the CCD drive control method. As a specific example, even if the image shakes during the exposure as shown in FIG. 9, for example, the image is displayed on the display unit 6 as shown in FIG. On the other hand, when the effective range of the image sensor is displayed on the display unit 6, if a shake correction is performed by the CCD driving method, a portion having no data appears on the monitor as shown in FIG.

Next, a description will be given of the camera shake correction operation in each mode (moving image shooting mode, continuous shooting mode, multiple exposure shooting mode, night view shooting mode, panoramic shooting mode, pixel shift shooting mode, monitoring mode). FIG. 12 is a flowchart for explaining the basic operation of camera shake correction in the moving image shooting mode, the continuous shooting mode, and the multiple exposure shooting mode. FIG. 13 is a flowchart for explaining the basic operation of camera shake correction in the night scene shooting mode. ,
FIG. 15 is a flowchart for explaining the basic operation of camera shake correction in the panorama shooting mode, FIG. 16 is a flowchart for explaining the basic operation of camera shake correction in the pixel shift shooting mode, and FIG. 17 is a basic operation of camera shake correction in the monitoring mode. FIG. 18 is a timing chart for explaining camera shake correction timing in the moving image shooting mode, and FIG.
9 is a timing chart for explaining camera shake correction timing in the continuous shooting mode and the panoramic shooting mode, and FIG. 20 is a multiple exposure shooting mode, a night view shooting mode,
4 is a timing chart for explaining camera shake correction timing in a pixel shift shooting mode.

In FIGS. 18 to 20, (A) shows each sequence (monitoring, exposure, CDS data acquisition,
(B) timing of the CCD operation and the vertical synchronizing signal VD, (C) shake correction timing (part 1),
(D) shows the shake correction timing (No. 2).

First, a moving image shooting mode, a continuous shooting mode,
The camera shake correction in the multiple exposure shooting mode will be described with reference to FIG. 12 and FIGS. The camera shake correction in the moving image shooting mode, the continuous shooting mode, and the multiple exposure shooting mode is performed in substantially the same manner.

In FIG. 12, first, a mode switch of the signal generator 5 selects one of a moving image shooting mode, a continuous shooting mode, and a multiple exposure shooting mode, and the release key 2 of the release key of the signal generator 5 is turned on. Then, C
The exposure of the CD 23 is started (Step S1). And
During this exposure, the second shake detection unit 7a detects the shake (step S2), and the second shake correction control unit 7b sends the second shake
Based on the shake detection result of the shake detection unit 7a, the shake correction unit 24 is driven to correct the shake of the image (Step S).
3). As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

When the exposure is completed (step S
4), reading of an image from the CCD 23 is started (step S5), and during the period other than this exposure, the first shake detecting unit 31
“a” indicates a frame-to-frame (between images) based on the read image.
Is detected (step S6), and the first shake correction unit 3
1b performs the above-described image signal processing based on the shake detection result of the first shake detection unit 31a to correct the shake between frames of the image (Step S7). As described above, the shake detection and the shake correction by the first shake detecting means are performed while the exposure is not performed. When the image capture is completed (step S8), the sensor data processing unit 31 performs the IPP process and the JPEG process on the captured image, and stores the image subjected to the shake correction in the recording storage unit (card).
33 (step S9).

Subsequently, it is determined whether or not the photographing has been completed (step S10). If the photographing has not been completed, the process returns to step S1, where exposure is performed to capture the next image, while photographing is performed. If the processing has been completed, the processing ends.

When switching from the second shake correction to the first shake correction, the second camera shake correction means notifies the first camera shake correction means of the shake detection amount and the shake correction amount. The camera shake correction unit performs the first shake correction,
The shake detection amount and the shake correction amount of the second camera shake correction unit are reflected.

In the flowchart shown in FIG. 12, the case where neither the shake detection nor the shake correction is performed is described for the sake of explanation when the card recording is being performed. As shown in the timing chart, the card recording and the next CDS data acquisition are performed in parallel, so that the card recording (the next CDS data acquisition) is performed.
During the period, the first shake detection and the first shake correction are performed.

As shown in FIG. 18, the following sequences are continuously executed during recording of a moving image in synchronization with the vertical synchronization signal VD. Specifically, exposure, CDS data capture (correlated double sampling), IPP processing (aperture correction: edge enhancement, γ correction, color difference signal processing, etc.), JPEG processing (compression processing), card recording (image file writing) Is performed.

At the time of monitoring and at the time of moving image recording, vertical reading is performed by thinning out the effective lines, so that CDS data for one screen can be taken in one VD period. The monitoring operation can be performed in parallel with each process. Exposure and CDS data capture can be performed in parallel with IPP processing, JPEG compression, and card recording.

The first image stabilization in each sequence and the second
There are two types of timing for switching the camera shake correction, namely, the timing shown in FIG. 3C and the timing shown in FIG. In the case of FIG. 9C, the first camera shake correction and the second camera shake correction are switched at the timing of the vertical synchronization signal VD. In the case of FIG. 3D, the first camera shake correction and the second camera shake correction are switched during the CCD integration period.

The timing in the continuous shooting mode is substantially the same as the timing in the moving image shooting mode shown in FIG. 18 as shown in FIG. Means that the processing time is 1 V
D or more, and other processing time is also long. In the continuous shooting mode, a mechanical shutter is used.
Monitoring is interrupted when the mechanical shutter is closed.

The timing in the multiple exposure shooting mode is almost the same as the timing in the continuous shooting mode shown in FIG. 19 as shown in FIG. 20, but the image synthesizing process (using each pixel data Pixel interpolation calculation, etc.), the CDS data of a plurality of images is taken in, and the IPP processing,
JPEG compression and card recording are not performed. That is, in the case of the multiple exposure shooting mode, card recording is not performed for each shooting, and card recording is performed after the multiple exposure shooting is completed and image synthesis is performed. However, in a camera in which image synthesis processing is not performed in the camera, the operation is the same as that in FIG.
As in the panoramic shooting mode, data for associating a series of images is added. In the multiple exposure shooting mode, AE, AF, and AWB are executed for each shooting, but the AE is over without correction by the number of exposures.
The AE correction may be performed not at the time of exposure but at the time of image synthesis processing.

As described above, in the moving image photographing mode, the continuous photographing mode, and the multiple exposure photographing mode, the image blur during exposure is corrected by the second camera shake correcting means, and the first camera shake correcting means is used. Is used to correct the image shake between frames (images), so that the first camera shake correction unit and the second camera shake correction unit are switched according to the contents of the sequence executed in each shooting mode. Thus, low power consumption and highly accurate camera shake correction can be realized.

Next, the camera shake correction operation in the night view photographing mode will be described with reference to FIGS. In FIG. 13, first, the night scene shooting mode is selected by the mode switch of the signal generator 5, and when the release key 2 of the release key of the signal generator 5 is turned on, the focus of the lens 20 is set to infinity (step S11). ) First CCD2
The exposure of No. 3 is started (step S12). During this exposure, the second shake detecting section 7a detects the shake (step S13), and the second shake correction control section 7b drives the shake correction section 24 to correct the shake of the image. (Step S14). As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

When the exposure is completed (step S1)
5) The image capture from the CCD 23 is started (step S16), and the first shake detection unit 3
1a detects a shake between frames (between images) based on the read image (step S17), and the first shake correction unit 31b performs the above-described image signal processing to thereby determine a shake between frames of the image. The shake is corrected (step S18). As described above, the shake detection and the shake correction by the first camera shake correction unit are performed while the exposure is not performed.

When the capture of the first image is completed (step S19), the focus of the lens 20 is set to the human subject distance before the exposure of the second image is started (step S20). Subsequently, when exposure of the CCD 23 is started (step S21), the second shake detecting unit 7a detects a shake during this exposure (step S2).
2), the second shake correction control unit 7b drives the shake correction unit 24 to correct the shake of the image (step S23).
As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

When the exposure for the second image is completed (step S24), the image capture from the CCD 23 is started (step S25), and during the period other than the exposure, the first shake detecting unit 31a performs this operation. A shake between frames (between images) is detected based on the read image (step S2).
6) The first shake correcting unit 31b corrects the shake between frames of the image by performing the above-described image signal processing to correct the image (step S27). Thus, the first
The shake detection and shake correction by the shake detection means are performed while exposure is not performed.

When the capturing of the second image is completed (step 28), the sensor data processing section 31 combines the first and second images, and then performs the IPP.
The image subjected to the processing and the JPEG processing and subjected to the shake correction is recorded in the recording storage unit (card) 33 (step S29).

The timing in the night scene photographing mode is almost the same as the timing in the continuous photographing mode shown in FIG. 19 as shown in FIG. 20, but the image synthesizing process (using each pixel data using each pixel data) is performed from each photographed image. Pixel interpolation calculation, etc.), CDS data of a plurality of images is taken in,
Until the image synthesis processing is completed, the IPP processing, JPEG compression, and card recording are not performed. That is, in the case of the night scene shooting mode, card recording is not performed for each shooting, and after the night scene shooting is completed and image synthesis is performed, card recording is performed. However, in a camera in which the image synthesis processing is not performed in the camera, the operation is the same as that in FIG. 19, and data for associating a series of images is added as in the panoramic shooting mode. In the night view shooting mode, as shown in FIG. 20, shooting is performed after the focus is set to infinity and the human subject distance at each exposure.

As described above, in the night view photographing mode, the image blur during exposure is corrected by the second camera shake correcting means, and the image between frames (images) is corrected by the first camera shake correcting means. Since the shake is corrected, the first sequence depends on the contents of the sequence executed in each shooting mode.
The switching between the camera shake correction means and the second camera shake correction means can be performed, and low power consumption and highly accurate camera shake correction can be realized.

Next, the camera shake correction operation in the panorama shooting mode will be described with reference to FIG. 14, FIG. 15, and FIG. Here, a case will be described in which, after the release key 1 of the release key of the signal generator 5 is turned on, the camera shake correction in the direction connecting the images is permitted.

In FIG. 14, when the panorama shooting mode is selected by the mode switch of the signal generator 5 and the image connecting direction and the number of images to be connected (connected) are determined (step S41), the mode shifts to the monitoring mode (step S41).
42). Then, at the start of the monitoring mode, the system controller 30 prohibits camera shake correction in the image joining direction (step S43).

Subsequently, the exposure of the CCD 23 is started (step S44). During this exposure, the second shake detecting section 7a detects the shake (step S45), and the second shake correction control section 7b performs the shake correcting section based on the shake detection result of the second shake detecting section 7a. 24 is driven to correct image shake (step S46). As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

When the exposure is completed (step S4)
7), image capture from the CCD 23 is started (step S48). Then, during periods other than the exposure, the first shake detecting unit 31a detects a shake between frames (between images) based on the read image (step S49).
The shake correction unit 31b performs the above-described image signal processing to correct the shake between frames of the image (step S50). As described above, the shake detection and the shake correction by the first camera shake correction unit are performed during the exposure.

When the image capture is completed (step S51), the captured image is displayed on the monitor 6 on the monitor (step S52). Subsequently, it is determined whether or not the release key 1 of the release key of the signal generator 5 has been turned on (step S53). If the release 1 has not been turned on, the process proceeds to step S44 to repeat the same processing. If the release 1 has been turned on, the flow shifts to step S54 to determine whether or not the release key 2 of the release key of the signal generator 5 has been turned on. Release 2
If is not turned on, the process proceeds to step S55, in which the system controller 30 permits image stabilization in the image joining direction (step S56), executes AF, and fixes AE, AF, and AWB (step S56). Step S5
7). Then, the process returns to step S44.

On the other hand, if the release 2 has been performed in step S54, the flow shifts to step S59 in FIG.
Exposure of the CD 23 is started. During this exposure, the second shake detecting section 7a detects the shake (step S60), and the second shake correction control section 7b performs the shake correcting section based on the shake detection result of the second shake detecting section 7a. 24 is driven to correct image shake (step S61). As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

When the exposure is completed (step S6)
2) The capture of the image from the CCD 23 is started (step S63), and the first shake detection unit 3
1a detects a shake between frames (between images) based on the captured image (step S64), and the first shake correction unit 31b performs the above-described operation based on the shake detection result of the first shake detection unit 31a. The image signal processing is performed to correct the shake between frames of the image (step S65). As described above, the shake detection and the shake correction by the first camera shake correction unit are performed while the exposure is not performed.

Subsequently, when the image capture is completed (step S66), the sensor data processing unit 31
The P process and the JPEG process are performed, and the image whose shake has been corrected is recorded in the recording storage unit (card) 33 (step S67). Then, it is determined whether or not the photographing is completed (step S68). If the photographing is completed, the flow is terminated. If the photographing is not completed, the monitoring mode is performed (step S42 in FIG. 14). Move to

As shown in FIG. 19, the processing procedure and the processing timing in the panoramic shooting mode are almost the same as those in the moving image shooting mode shown in FIG.
Since data for all the pixels 3 is taken in, the processing time is 1 VD or more, and the other processing time is also long. In the panoramic shooting mode, a mechanical shutter is used, so that monitoring is interrupted when the mechanical shutter is closed. In the continuous shooting mode, shooting is continuously performed. In the panoramic shooting mode, when one image is shot, a monitoring mode (not shown) is started until the next shooting (determination of a composition of images) is started. Becomes Although not shown, in the panoramic shooting mode, the AE, AF, and AWB conditions of the first shooting (exposure) are fixed (held) until a series of connected shot images ends.

As described above, in the panoramic photographing mode, the image blur during exposure is corrected by the second camera shake correcting means, and the image between frames (images) is corrected by the first camera shake correcting means. Since the camera shake is corrected, it is possible to switch between the first camera shake correction unit and the second camera shake correction unit depending on the contents of the sequence executed in the panorama shooting mode, and to achieve low power consumption and high camera shake. Accurate camera shake correction can be realized.

Next, the camera shake correction in the image shifting mode will be described with reference to FIGS. In the pixel shift mode, when the release 2 is turned on, AE,
AF and AWB are shifted until the pixel shift shooting is completed, and a drive mechanism (not shown) shifts (moves) one pixel of the CCD 23 between the first and second shots.

In FIG. 16, first, when the pixel shift mode is selected by the mode switch of the signal generator 5 and the release key 2 of the release key is turned on, the first (first) exposure of the CCD 23 is started. (Step S71). Then, during this exposure, the second shake detection unit 7a detects the shake (step S72), and the second shake correction control unit 7b
In step S73, the second shake detecting unit 7a drives the shake correcting unit 24 to correct the image shake based on the shake detection result. As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

When the exposure of the first image is completed (step S74), the image capturing from the CCD 23 is started (step S75). During a period other than the exposure, the first shake detecting unit 31a detects a shake between frames (between images) based on the captured image (Step S76).
The shake correction unit 31b performs the above-described image signal processing based on the shake detection result of the first shake detection unit 31a to correct the shake between frames of the image (step S77). As described above, the shake detection and the shake correction by the first camera shake correction unit are performed while the exposure is not performed.

Subsequently, when the capturing of the first image is completed (step S78), the pixels of the CCD 23 are shifted (the CCD 23 is displaced by one pixel) (step S79). Exposure is started (step S80). Then, during this exposure, the second
The shake detection unit 7a detects the shake (step S81),
The second shake correction control unit 7b drives the shake correction unit 24 to correct the shake of the image (step S82). As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

Next, when the exposure of the second image is completed (step S83), the capture of the image of the second image is started (step S84). During the period other than the exposure, the first shake detecting unit 31a detects a shake between frames (between images) based on the captured image (step S85), and the first shake correction unit 31b performs Based on the shake detection result of the first shake detection unit 31a, the above-described image signal processing is performed to correct the shake between frames of the image (step S86). As described above, the shake detection and the shake correction by the first camera shake correction unit are performed while the exposure is not performed.

When the capture of the second image is completed (step S87), the captured first image and the second image are combined by the sensor data processing section 31 to generate a high quality image. After that (step S88),
The IPP process and the JPEG process are performed, and the image whose shake has been corrected is recorded in the recording storage unit (card) 33 (step S89).

The timing in the pixel shift photographing mode is almost the same as the timing in the continuous photographing mode shown in FIG. 19 as shown in FIG. 20, but the image synthesizing process (using each pixel data is performed) based on each photographed image. Pixel interpolating operation), IPS processing, JPEG compression, and card recording are not performed until the CDS data of a plurality of images is captured and the image synthesis processing is completed. However,
In a camera in which image synthesis processing is not performed in the camera, FIG.
The operation is similar to that of the panorama shooting mode, and data for associating a series of images is added as in the panoramic shooting mode. In the pixel shift shooting mode, as shown in FIG.
Photographing is performed by shifting the pixels of the CCD by one pixel. In the pixel shift shooting mode, the conditions of the AE, AF, and AWB of the first shooting (exposure) are fixed (held) until the end of the capture of the shifted shot image used for the composite image, similarly to the panorama shooting mode. You.

As described above, in the pixel shift photographing mode, the image blur during exposure is corrected by the second camera shake correcting means, and the image between frames (images) is corrected by the first camera shake correcting means. Is corrected, the first camera shake correction means and the second camera shake correction means can be switched depending on the contents of the sequence executed in the panorama shooting mode, and low power consumption can be achieved. Highly accurate camera shake correction can be realized.

Next, the camera shake correction operation in the monitoring mode will be described with reference to FIG. In FIG. 17, when the monitoring mode is selected by the mode switch of the signal generator 5, exposure of the CCD 23 is started (step S).
91). During this exposure, the second shake detection unit 7a detects a shake (step S92), and the second shake correction control unit 7
b is based on the shake detection result of the second shake detection unit 7a,
The image stabilization unit 24 is driven to correct image shake (step S93). As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

When the exposure is completed (step S9)
4) The image capture from the CCD 23 is started (step S95). During the period other than the exposure, the first shake detecting unit 31a detects a shake between frames (between images) based on the captured image (step S96).
The shake correction unit 31b performs the above-described image signal processing to correct the shake between frames of the image (step S97). As described above, the shake detection and the shake correction by the first camera shake correction unit are performed while the exposure is not performed.

Subsequently, when the image capture is completed (step S98), the captured image is displayed on the display unit 6 on the monitor (step S99). Then, it is determined whether or not the photographing has been completed (step S100). When the photographing has been completed, the flow is terminated, while when the photographing has not been completed, the process returns to step S91.

As described above, in the monitoring mode, the image shake during exposure is corrected by the second camera shake correction means, and the image shake between frames (images) is corrected by the first camera shake correction means. Can be switched between the first image stabilizing means and the second image stabilizing means depending on the contents of the sequence executed in the monitoring mode, thereby achieving low power consumption and high accuracy. Camera shake correction can be realized.

(Embodiment 2) FIG. 21 shows Embodiment 2 of the present invention.
FIG. 1 is a block diagram showing an imaging apparatus according to the present invention. In the figure, reference numeral 1 denotes a digital still camera (hereinafter, referred to as a digital camera) as an example of the imaging apparatus.

The configuration of the imaging apparatus according to the second embodiment differs from that of the first embodiment (FIG. 1) in that the imaging apparatus includes a shake determination unit 35. Other parts can use the same configuration as in the second embodiment. In FIG. 21, the same parts as those in FIG. 1 are denoted by the same reference numerals.

[0099] The shake determining section 35 is based on the focal length / exposure conditions (brightness, etc.) and the shake detection result (hand shake width / hand shake speed) of the second shake detecting section 7a. It is determined whether or not camera shake correction is necessary.
When determining that the camera shake correction is necessary, the camera shake determination unit 35 causes the second camera shake correction control unit 7b to perform the camera shake correction. Table 2 below shows elements for determining whether or not the camera shake correction of the camera shake determination unit 35 is necessary. For example, the shake determination unit 35
Alternatively, it is possible to determine the necessity of shake correction by numerically converting the element of the necessity of shake correction and substituting it into an expression for determining the necessity of shake correction.

[0100]

[Table 2]

The shake determination section 35 also has a function of converting (or replacing) part or all of the shake correction control data for switching the shake correction data before switching when the shake correction control is switched. By distributing the amount to each shake correction control, the dynamic range of the shake correction control is secured as much as possible. Further, the shake determination unit 35
Determines the execution priority and execution control amount of each shake correction control according to the setting mode and the execution contents of the sequence.

Embodiment 3 aims at performing shake correction in a wide dynamic range. This wide dynamic range is necessary because individual scenes (shooting)
This changes the necessary dynamic range. For example, in the case of the pixel shift shooting, the shooting period in which the shake occurs is classified, and during the first exposure, the image capturing period is completed after the first exposure is completed, and the second exposure is performed during the second exposure. is there. Also, in the case of moving image shooting, the process continues.

It is difficult to perform high-precision correction over a wide dynamic range by optical or mechanical means, and the required space and power consumption increase.
Also, in consideration of the follow-up performance of the image blur correction, if a large correction is required, the image blur between the frames (images) is corrected by image signal processing, and the correction smaller than the pixel or smaller than the pixel is performed optically or The image blur is corrected by mechanical means. On the other hand, image shake correction between frames (images) by image signal processing is of course useless as image shake correction during exposure, but during the period during which an image is captured after exposure is completed, Functions effectively as shake correction.

Therefore, in the second embodiment, the image blur correction at the time of exposure is performed by the second camera shake correction means, while the image vibration correction other than at the time of exposure is performed by the first and second camera shake correction means. And As a result, it is possible to follow a large camera shake correction at high speed, and to cope with high accuracy, power saving and space saving. Specifically, as described above, when the correction amount of the camera shake between the exposures cannot be corrected only by the image signal processing (the first camera shake correction unit), the camera shake correction by the second camera shake correction unit is also performed. In this way, shake correction is performed.

Next, a camera shake correction operation in the monitoring mode of the imaging apparatus according to the second embodiment will be described with reference to FIG. FIG. 22 is a flowchart for explaining a camera shake correction operation in the monitoring mode of the imaging apparatus according to the second embodiment.

In FIG. 22, first, exposure of the CCD 23 is started (step S111). During this exposure, the second shake detecting section 7a detects the shake (step S112), and the second shake correction control section 7b performs the shake based on the shake detection result of the second shake detecting section 7a. Correction unit 24
To correct image shake (step S11).
3). As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

When the exposure is completed (step S1)
14) Then, the capture of an image from the CCD 23 is started (step S116), and during the period other than the exposure, the first shake detection unit 31a detects a shake between frames (between images) based on the captured image. (Step S117), the first shake correction unit 31b performs the above-described image signal processing based on the detection result of the first shake detection unit 31a to correct the shake between frames of the image (Step S118). . As described above, the shake detection and the shake correction by the first camera shake correction unit are performed while the exposure is not performed.

[0108] The shake determination unit 35 uses the above-described method.
It is determined whether or not the second shake correction is necessary (Step S11)
9) If it is determined that the second shake correction is necessary, the process proceeds to step S120. If it is determined that the shake correction is not necessary, the process proceeds to step S122. In step S120, the second shake detection unit 7a detects the shake, and the second shake correction control unit 7b drives the shake correction unit 24 based on the shake detection result of the second shake detection unit 7a to Is performed (step S12).
1), proceed to step S122.

In step S122, it is determined whether or not the image capture has been completed. When the image capture has been completed, a monitor image is displayed on the display unit 6 (step S12).
3) Thereafter, it is determined whether or not the photographing has been completed (step S124). If the photographing has been completed, the flow is terminated. If the photographing has not been completed, the process returns to step S166.

Here, the camera shake correction operation in the monitoring mode has been described. However, the camera shake correction operation according to the second embodiment includes the above-described moving image shooting mode, continuous shooting mode, multiple exposure shooting mode, night view shooting mode, panorama shooting. mode,
Also, the present invention can be applied to the case of camera shake correction in the pixel shift shooting mode.

As described above, in the second embodiment, the shake determination unit 35 starts the image capture after the end of the exposure, and after the first shake detection and the first shake correction are completed, the second shake determination unit 35 sets the second shake correction. It is determined whether or not shake correction is necessary.
When it is determined that the shake correction is necessary, the second shake detection and the second shake correction are performed.
With low power consumption, highly accurate camera shake correction over a wide dynamic range can be performed.

(Embodiment 3) FIG. 19 shows Embodiment 3 of the present invention.
1 is a block diagram showing an imaging apparatus according to the present invention, in which 1 denotes a digital still camera (hereinafter referred to as a digital camera) as an example of the imaging apparatus.

The imaging apparatus according to the third embodiment differs from the imaging apparatus according to the first embodiment (FIG. 1) in that the first shake detecting unit 31
That is, a is deleted. Other parts can use the same configuration as in the first embodiment. 23, the same parts as those in FIG. 1 are denoted by the same reference numerals. In the third embodiment, the first shake correction unit 31b and the second shake correction unit 7b perform shake correction based on the shake detection result detected by the second shake detection unit 7a.

Next, a camera shake correction operation in the monitoring mode of the imaging apparatus according to the third embodiment will be described with reference to FIG. FIG. 24 is a flowchart illustrating a camera shake correction operation in the monitoring mode of the imaging apparatus according to Embodiment 3.

In FIG. 24, first, the exposure of the CCD 23 is started (step S131). During this exposure,
The second shake detecting unit 7a detects the shake (step S13).
2) The second shake correction control unit 7b drives the shake correction unit 24 to correct the image shake based on the shake detection result of the second shake detection unit 7a (step S133). As described above, the shake detection and the shake correction by the second camera shake correction unit are performed during the exposure.

When the exposure is completed (step S1)
34), image capture from the CCD 23 is started (step S135). During the period other than this exposure, the second
The shake detection unit 31a detects the shake (step S13).
6), the first shake correction unit 31b includes the second shake detection unit 3
Based on the detection result of 1a, the above-described image signal processing is performed to correct the shake between frames of the image (step S13).
7). As described above, the second shake detection and the first shake correction are performed while the exposure is not performed.

Subsequently, when the image capture is completed (step S138), the read image is displayed on the monitor 6 on the monitor (step S139). Then, it is determined whether or not the photographing has been completed (step S140). When the photographing has been completed, the flow is terminated, while when the photographing has not been completed, the process returns to step S131.

Here, the image stabilization operation in the monitoring mode has been described. However, the image stabilization operation according to the third embodiment includes the moving image shooting mode, the continuous shooting mode, the multiple exposure shooting mode, the night scene shooting mode, and the panoramic shooting mode. mode,
Also, the present invention can be applied to the case of camera shake correction in the pixel shift shooting mode.

As described above, in the third embodiment, the first shake correcting section 31a and the second shake correcting section 7b perform the shake based on the shake detection result detected by the second shake detecting section 7a. Since the correction is performed, it is possible to prevent the camera shake correction control from becoming unstable when the camera shake correction unit is switched due to a difference in the shake detection result, and it is possible to simplify the detection unit (cost reduction). .

The present invention is not limited to the above-described embodiment, but can be carried out with appropriate modifications without departing from the spirit of the invention.

[0121]

As described above, according to the first aspect of the present invention, the image pickup means picks up an object and outputs image data, and the first camera shake correction means electronically corrects the camera shake. The second camera shake correction means optically or mechanically corrects the camera shake, and in the moving image shooting mode, the second camera shake correction means corrects the shake of the image during exposure, and the first camera shake correction. Means for correcting image shake between frames (images), so that switching between the first camera shake correction means and the second camera shake correction means is performed depending on the contents of the sequence executed in the moving image shooting mode. This makes it possible to realize highly accurate camera shake correction with low power consumption.

According to the second aspect of the present invention, the image pickup means picks up an image of a subject and outputs image data, the first camera shake correction means electronically corrects the camera shake, and the second camera shake correction means. Compensates for camera shake optically or mechanically,
Further, in the continuous shooting mode, the image blur during exposure is corrected by the second camera shake correction unit, and the image shake between frames (images) is corrected by the first camera shake correction unit. Therefore, it is possible to switch between the first image stabilizing means and the second image stabilizing means depending on the contents of the sequence executed in the continuous shooting mode, and to achieve low power consumption and highly accurate image stabilization. Can be realized.

According to the third aspect of the present invention, the image pickup means picks up an image of a subject and outputs image data, and the first camera shake correction means electronically corrects the camera shake and the second camera shake correction. The means corrects the camera shake optically or mechanically, and furthermore, in the multiple exposure photographing mode, the image shake during exposure is corrected by the second camera shake correction means.
The image blur between frames (images) is corrected by the camera shake correction means, so that the first camera shake correction means and the second camera shake correction depend on the contents of the sequence executed in the multiple exposure shooting mode. The means can be switched, and low power consumption and highly accurate camera shake correction can be realized.

According to the fourth aspect of the invention, the image pickup means picks up an image of a subject and outputs image data, the first camera shake correction means electronically corrects the camera shake, and the second camera shake correction means. Compensates for camera shake optically or mechanically,
Further, in the night scene photographing mode, the image shake during exposure is corrected by the second camera shake correction unit, and the image shake between frames (images) is corrected by the first camera shake correction unit. Therefore, it is possible to switch between the first image stabilization unit and the second image stabilization unit depending on the contents of the sequence executed in the multiple exposure shooting mode, and to realize low power consumption and high accuracy image stabilization. Becomes possible.

According to the fifth aspect of the present invention, the image pickup means picks up an image of a subject and outputs image data, and the first camera shake correction means electronically corrects the camera shake, and outputs the first camera shake.
The camera shake correction means and the second camera shake correction means optically or mechanically correct the camera shake, and further, in the panoramic shooting mode, the second camera shake correction means corrects the image shake during exposure, and , By the first camera shake correction means,
Since we decided to correct image shake between frames (images),
It is possible to switch between the first image stabilizing means and the second image stabilizing means depending on the contents of the sequence executed in the panoramic shooting mode, and realize low power consumption and highly accurate image stabilization. Become.

According to the invention according to claim 6, in the invention according to claim 5, the camera shake correction control means comprises:
In the panoramic photographing mode, while the monitoring image is being displayed on the display means, control is performed so as to prohibit at least the camera shake correction in the direction of connecting the images.
In addition to the effects of the present invention, it is easy to set the composition for determining the joint of the images.

Further, according to the invention of claim 7, in the invention of claim 6, the camera shake correction control means comprises:
In the panoramic shooting mode, when the instruction to execute the AF is matched, the camera shake correction is permitted, so that the camera shake correction can be performed after the composition is determined.

According to the invention of claim 8, in the invention of claim 6, in the panoramic photographing mode, the photographing of the first reference image is completed until the photographing is completed.
Since the camera shake correction is allowed, in addition to the effect of the invention according to the sixth aspect, the camera shake correction can be performed when the first reference image is obtained.

According to the ninth aspect of the present invention, the image pickup means picks up an object and outputs image data, the first camera shake correction means electronically corrects the camera shake, and the second camera shake correction means. Compensates for camera shake optically or mechanically,
In the pixel shift photographing mode, the image shake during exposure is corrected by the second camera shake correction unit, and the image shake between frames (images) is corrected by the first camera shake correction unit. According to the contents of the sequence executed in the pixel shift shooting mode, the first camera shake correction unit and the second camera shake correction unit can be switched, and low power consumption and highly accurate camera shake correction can be realized. It becomes possible.

According to the tenth aspect of the present invention,
The imaging means captures a subject and outputs image data.
The camera shake correction means electronically corrects the camera shake, the second camera shake correction means optically or mechanically corrects the camera shake, and further, in the monitoring mode, the second camera shake correction means corrects the image under exposure by the second camera shake correction means. To compensate for the shake and
The image blur between the frames (images) is corrected by the camera shake correction means of (1), so that the first camera shake correction means and the second camera shake correction means depend on the contents of the sequence executed in the monitoring mode. Switching can be performed, and low power consumption and highly accurate camera shake correction can be realized.

According to the eleventh aspect of the present invention,
In the invention according to any one of claims 1 to 10, the first and second image stabilization units perform image shake correction other than at the time of exposure, and perform image shake correction at the time of exposure. Since the image stabilization is performed by the second image stabilization means, in addition to the effect of the invention according to any one of the first to tenth aspects, a highly accurate image stabilization can be performed in a wide dynamic range.

According to the twelfth aspect of the present invention,
In the invention according to the eleventh aspect, in the case of image blur correction other than at the time of exposure, the first camera shake correction unit is preferentially used, so in addition to the effect of the invention according to the eleventh aspect, High-precision camera shake correction can be performed with lower power consumption and a wide dynamic range.

According to the thirteenth aspect of the present invention,
In the invention according to any one of the first to tenth aspects, the first camera shake correction means and the second camera shake correction means perform a shake correction based on a detection result of one shake detection means for detecting a shake. Is performed, it is possible to prevent the camera shake correction control from becoming unstable when the camera shake correction unit is switched due to a difference in the shake detection result, and it is possible to simplify the detection unit (cost reduction).

According to the fourteenth aspect of the present invention,
In the invention according to any one of the first to tenth aspects, the timing for switching between the first camera shake correction unit and the second camera shake correction unit is synchronized with the timing of the vertical synchronization signal of the imaging unit. In addition, it is possible to switch between the first image stabilizing means and the second image stabilizing means with high accuracy at an accurate timing.

According to the fifteenth aspect of the present invention,
In the invention according to any one of the first to tenth aspects, the timing of switching between the first camera shake correction unit and the second camera shake correction unit is synchronized with the timing of starting integration of the imaging unit. It is possible to switch between the first image stabilizing means and the second image stabilizing means with high accuracy at an accurate timing.

According to the sixteenth aspect of the present invention,
In the invention according to any one of the first to tenth aspects, the laminated piezoelectric element is used as the second camera shake correction means, so that the second camera shake correction means can be downsized and the responsiveness can be improved. Can be improved, a small current drive can be performed, and a high load can be handled.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an imaging device according to a first embodiment;

FIG. 2 is an explanatory diagram for explaining a case in which shake between frames (between images) is not corrected.

FIG. 3 is an explanatory diagram for explaining a case where a shake between frames (between images) is corrected.

FIG. 4 is an explanatory diagram for explaining a case in which shake in a frame is not corrected.

FIG. 5 is an explanatory diagram for explaining a case in which shake in a frame is corrected.

FIG. 6 is an explanatory diagram for explaining a case in which shake between frames and within a frame are not corrected.

FIG. 7 is an explanatory diagram for explaining a case where a shake between frames is corrected.

FIG. 8 is a diagram showing an effective range of a CCD when displaying on a display unit.

FIG. 9 is a diagram for describing an example of image shake in an effective photographing range of a CCD.

FIG. 10 is a diagram illustrating an example of an image displayed on a display unit.

FIG. 11 is a diagram illustrating an example in which an image is displayed on a display unit in an effective range of a CCD.

FIG. 12 is a flowchart illustrating a basic operation of camera shake correction in a moving image shooting mode, a continuous shooting mode, and a multiple exposure shooting mode.

FIG. 13 is a flowchart illustrating a basic operation of camera shake correction in a night scene shooting mode.

FIG. 14 is a flowchart for explaining a basic operation of camera shake correction in a panoramic shooting mode (part 1).

FIG. 15 is a flowchart for explaining a basic operation of camera shake correction in the panorama shooting mode (part 2).

FIG. 16 is a flowchart illustrating a basic operation of camera shake correction in a pixel shift shooting mode.

FIG. 17 is a flowchart illustrating a basic operation of camera shake correction in a monitoring mode.

FIG. 18 is a timing chart for explaining camera shake correction timing in a moving image shooting mode.

FIG. 19 is a timing chart for explaining camera shake correction timing in a continuous shooting mode and a panoramic shooting mode.

FIG. 20 is a timing chart for explaining camera shake correction timing in a multiple exposure shooting mode, a night scene shooting mode, and a pixel shift shooting mode.

FIG. 21 is a block diagram illustrating an imaging device according to a second embodiment;

FIG. 22 is a flowchart for explaining a basic operation of camera shake correction in a monitoring mode of the imaging apparatus according to the second embodiment;

FIG. 23 is a block diagram illustrating an imaging device according to a third embodiment;

FIG. 24 is a flowchart illustrating a basic operation of camera shake correction in a monitoring mode of the imaging apparatus according to the third embodiment;

[Explanation of symbols]

 Reference Signs List 1 digital camera 2 imaging block 3 signal processing block 4 A / D converter 5 signal generator 6 display unit 7a second shake detection unit 7b second shake correction control unit 20 lens 21 imaging unit 22 shutter mechanism 23 CCD 24 shake Correction unit 30 System controller 31 Sensor data processing unit 31a First shake detection unit 31b First shake correction unit 32 Display output processing unit 33 Record storage unit 35 Shake determination unit

Claims (16)

[Claims] 1. An image pickup apparatus having a moving image photographing mode for photographing a moving image of an object, an image pickup means for picking up an object and outputting image data, and a first camera shake correcting means for electronically correcting camera shake. And a second camera shake correction unit that optically or mechanically corrects camera shake. In the moving image shooting mode, the second camera shake correction unit corrects image shake during exposure, and An image capturing apparatus, wherein image blur between frames (images) is corrected by a first camera shake correcting unit. 2. An image pickup apparatus having a continuous photographing mode for continuously photographing an object, an image pickup means for picking up an image of the object and outputting image data, and a first camera shake for electronically correcting camera shake. Correction means, and second camera shake correction means for optically or mechanically correcting camera shake, in the continuous shooting mode, the second camera shake correction means to correct the image shake during exposure, An image pickup apparatus for correcting image shake between frames (images) by the first camera shake correction means. 3. An image pickup apparatus provided with a multiple exposure photographing mode for photographing an object with multiple exposures, an image pickup means for picking up an image of the object and outputting image data, and a first camera shake correction means for electronically correcting camera shake. And a second camera shake correction unit that optically or mechanically corrects camera shake. In the multiple exposure shooting mode, the second camera shake correction unit corrects image shake during exposure, and The first
An image pickup apparatus wherein image shake between frames (images) is corrected by the camera shake correction means. 4. A photographing device having a night scene photographing mode for photographing a subject at a long distance and a short distance and outputting image data by one shutter operation, an imaging unit for photographing the subject and outputting image data. A first camera shake correction means for electronically correcting camera shake, and a second camera shake correction means for optically or mechanically correcting camera shake. In the night view shooting mode, the second camera shake correction means The image pickup apparatus according to claim 1, wherein the image shake during exposure is corrected, and the image shake between frames (images) is corrected by the first camera shake correction means. 5. A digital camera provided with a panoramic photographing mode in which a wide-angle subject is divided into a plurality of image data continuous in a certain direction and imaged and a panoramic image is output, the image of the object is imaged and image data is output. An image pickup unit, a first camera shake correction unit that electronically corrects camera shake, and a second camera shake correction unit that optically or mechanically corrects camera shake, wherein in the panoramic shooting mode, the second camera shake The correcting means corrects the shake of the image during the exposure.
An image pickup apparatus wherein image shake between frames (images) is corrected by the camera shake correction means. 6. A display means for displaying a monitoring image, and a control for prohibiting at least a camera shake correction in a direction connecting the images while the monitoring image is being displayed on the display means in the panoramic shooting mode. The image pickup apparatus according to claim 5, further comprising: camera shake correction control means. 7. In the panoramic photography mode, the camera shake correction control unit is configured to:
The photographing apparatus according to claim 6, wherein camera shake correction is permitted. 8. The imaging apparatus according to claim 6, wherein the camera shake correction control unit permits the camera shake correction in the panorama shooting mode until shooting of the first reference image is completed. . 9. An imaging apparatus having a pixel shift shooting mode for performing pixel shift shooting and combining and outputting a plurality of images, an image pickup means for picking up an object and outputting image data, and electronically shaking the camera. A first image stabilizing unit that corrects the image, and a second image stabilizing unit that optically or mechanically corrects the image stabilization. In the pixel shift photographing mode, the image being exposed by the second image stabilizing unit is provided. An image pickup apparatus, wherein the image stabilization is corrected, and the image stabilization between frames (images) is corrected by the first camera shake correction means. 10. An imaging apparatus having a monitoring mode for imaging a subject and displaying image data on a display unit, wherein: an imaging unit for imaging the subject and outputting image data; and a first means for electronically correcting camera shake. In the monitoring mode, the second camera shake correction unit corrects the image shake during exposure by using the second camera shake correction unit to optically or mechanically correct the camera shake. In addition, the first
An image pickup apparatus wherein image shake between frames (images) is corrected by the camera shake correction means. 11. The method according to claim 1, further comprising:
11. The image stabilizer according to claim 1, wherein the image blur is corrected by the second camera shake corrector, and the image shake at the time of exposure is corrected by the second camera shake corrector. The imaging device according to any one of the above. 12. In the case of image blur correction other than during exposure,
The photographing apparatus according to claim 11, wherein the first camera shake correction unit is preferentially used. 13. The apparatus according to claim 1, wherein the first camera shake correction unit and the second camera shake correction unit perform shake correction based on a detection result of one shake detection unit that detects a shake. The imaging device according to any one of claims 10 to 10. 14. The first image stabilizing means and the second image stabilizing means.
The imaging apparatus according to any one of claims 1 to 10, wherein a timing of switching the camera shake correction unit is synchronized with a timing of a vertical synchronization signal of the imaging unit. 15. The first image stabilizing unit and the second image stabilizing unit.
The imaging apparatus according to any one of claims 1 to 10, wherein a timing of switching the image stabilization unit is synchronized with a timing of starting integration of the imaging unit. 16. The photographing apparatus according to claim 1, wherein said second camera shake correction means performs shake correction by displacing said image pickup means with a laminated piezoelectric element. apparatus.