JP4468598B2 - Image processing apparatus and recording medium storing image processing program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing apparatus and a recording medium on which an image processing program is recorded, and more particularly to an image processing apparatus and a recording medium that can be applied to correcting camera shake of a captured image.
[0002]
[Prior art]
When shooting a subject with a silver film camera in hand, it is a common phenomenon that photographs taken by camera shake become unnatural. This also applies to an electronic camera called a digital still camera. In the electronic camera as well as a silver halide film camera, the realization of a method and a function for suppressing camera shake is a major issue. In silver halide film cameras, there is a well-known method of taking pictures while suppressing camera shake by driving the photographic optical system, but in electronic cameras, in addition to driving the photographic optical system, control at the time of shooting by electric signal processing is also possible. In addition, it is possible to suppress the influence of camera shake by correcting electronic images after shooting (hereinafter simply referred to as images).
[0003]
As one of the practically effective methods using electric signal processing, an electronic camera is equipped with a sensor (camera shake detection sensor) that detects camera shake movement represented by an angular velocity sensor and the like. There is a method of performing shutter control so as to detect and predict a motion direction, etc.) and to take a picture at a certain timing based on the temporal transition of camera shake. For example, Japanese Patent Application Laid-Open No. 5-107622 discloses that the camera shake is detected by an angular velocity sensor, and the shutter is released a predetermined time after the camera shake generates a maximum value. Since this method is taken when the influence of camera shake is relatively small, the resulting image is relatively inferior.
[0004]
As a method of correcting camera shake by electric signal processing, a method of processing an image after photographing to estimate and restore information that should be originally included in the camera shake portion is well known. Commonly used image processing uses a recovery filter (for example, an inverse filter or a Wiener filter) that recovers the camera shake part, or estimates information for restoring the camera shake part from the image point spread function (PSF) There are some that apply. For example, in Japanese Patent Application Laid-Open No. 11-134481, when a camera shake image is restored using a point spread function generated based on camera shake locus data, the restoration is performed in consideration of luminance values of pixels around pixels on the camera shake locus. The content of the effect is disclosed.
[0005]
[Problems to be solved by the invention]
However, in the method described in Japanese Patent Laid-Open No. 5-107622 described above, shooting is performed in a state that is shifted in time from the shutter timing originally intended by the photographer. There is a problem that a scene different from that may be shot.
[0006]
Further, in the method described in Japanese Patent Laid-Open No. 11-134481, the information that originally does not exist is estimated and restored. Therefore, if it is attempted to faithfully reproduce the shake portion, calculation time and time in image processing are increased. There is a problem of being connected.
[0007]
The present invention has been made paying attention to such a problem, and an object of the present invention is to provide an image processing apparatus capable of photographing a scene intended by a photographer while performing camera shake correction at high speed and with high accuracy. Is to provide.
[0008]
[Means for Solving the Problems]
  To achieve the above objective,Of the present inventionFirstImage processing apparatus according to aspectAn image processing apparatus that corrects camera shake in an image captured by an imaging apparatusBecauseA continuous shooting unit that continuously captures a subject at a predetermined time interval and acquires a plurality of images;For each of the plurality of acquired images,A camera shake detection unit that detects camera shake information related to camera shake of the imaging device;A selection unit that selects, as a correction target image, an image to be subjected to camera shake correction among the plurality of acquired images, and the plurality of acquired plurality of images based on the camera shake information detected for each of the plurality of images. The image with the smallest camera shake among the images is selected as the smallest camera shake image, and the camera shake correction information used for correcting the camera shake portion of the correction target image is calculated based on the selected minimum camera shake image and the correction target image. The correction target using the correction information calculation unit and the calculated camera shake correction information.Image blurportionA camera shake correction unit that corrects
[0009]
  Also,Of the present inventionSecondImage processing apparatus according to aspectIs the firstAspectThe image processing apparatus according to the aspect of the invention further includes a continuous shooting determination unit that determines whether or not to perform continuous shooting by the continuous shooting unit based on the camera shake information detected by the camera shake detection unit.
[0010]
  Also,Of the present inventionThirdImage processing apparatus according to aspectIs the firstOr the second aspectThe image processing apparatus according to the aspect of the invention further includes a camera shake information control unit configured to detect and process the camera shake information corresponding to the plurality of images captured by the continuous shooting unit.
[0011]
  Also,Of the present invention4thImage processing apparatus according to aspectIs the firstTo the thirdAny oneAspectIn the image processing apparatus according toThe selection unit, as the correction target image,The first image taken out of the plurality of images taken by the continuous shooting unitselect.
[0012]
  Also,Of the present invention5thImage processing apparatus according to aspectIs the firstTo the thirdAny oneAspectIn the image processing apparatus according toThe selection unit selects an image that the user desires to correct as the correction target image.
[0013]
  Also,Of the present invention6thImage processing apparatus according to aspectCorrects camera shake in images taken by imaging devicesAn image processing deviceContinuous shooting that captures multiple images by capturing a subject continuously at predetermined time intervalsDepartment and,SaidAccording to the timing of continuous shooting,SaidCamera shake detection that detects camera shake information related to camera shakeDepartment and, Shake detectionBy partDetected camera shake information and continuous shootingBy partObtainedDoubleBased on the number of images, camera shake correction is performed to correct a camera shake portion of the image for at least one of the plurality of images.AndIt comprises.
  An image processing apparatus according to a seventh aspect of the present invention is an image processing method for correcting camera shake of an image captured by an imaging apparatus, and continuously captures a plurality of subjects at a predetermined time interval. A step of acquiring an image, a step of detecting camera shake information related to camera shake of the imaging device for each of the plurality of acquired images, and correcting an image to be subjected to camera shake correction among the plurality of acquired images Selecting a target image, and, based on the camera shake information detected for each of the plurality of images, selecting an image with the minimum camera shake as the minimum image among the plurality of acquired images, Based on the selected hand movement minimum image and the image to be corrected, camera shake correction information used for correcting the camera shake portion of the image to be corrected is calculated. A step that, by using the camera shake correction information the calculated comprises the steps of: correcting the shake portion having said correction target image.
  A computer program according to an eighth aspect of the present invention is a computer program for causing a computer to perform an image processing method for correcting camera shake of an image taken by an imaging device, and the image processing method is performed for a predetermined time. Capturing a plurality of images by continuously photographing a subject at intervals, detecting camera shake information relating to camera shake of the imaging device for each of the plurality of acquired images, and the plurality of acquired plurality of images A step of selecting an image to be subjected to camera shake correction as an image to be corrected among the images; and based on the camera shake information detected for each of the plurality of images, the camera shake is minimized among the plurality of acquired images. Selected as the image with minimum camera shake, the selected image with the minimum camera shake and the correction target Based on the image, calculating camera shake correction information used for correcting the camera shake portion of the correction target image, and correcting the camera shake portion of the correction target image using the calculated camera shake correction information; Are provided.
  A recording medium according to the ninth aspect of the present invention is a computer-readable recording medium that stores a program that includes a command for causing a computer to execute processing for correcting camera shake of an image taken by an imaging apparatus. The process of correcting the camera shake includes a step of capturing a plurality of images by continuously photographing a subject at a predetermined time interval, and a camera shake related to camera shake of the imaging device for each of the acquired plurality of images. A step of detecting information, a step of selecting an image to be subjected to camera shake correction among the plurality of acquired images as a correction target image, and the camera shake information detected for each of the plurality of images, The image having the minimum camera shake is selected as the minimum camera shake image from the plurality of acquired images, and the selection is performed. The correction target image has a step of calculating camera shake correction information used for correcting a camera shake portion of the correction target image based on the camera shake minimum image and the correction target image, and using the calculated camera shake correction information. Correcting a camera shake portion.
[0014]
DETAILED DESCRIPTION OF THE INVENTION
First, an outline of the present embodiment will be described. One of the functions realized by an electronic camera is a “continuous shooting function” that continuously captures images at short time intervals and records a plurality of images. The electronic camera can be processed in various ways by image processing, and it can be expected that significant information is extracted from a plurality of images taken by this continuous shooting function and used to improve the image quality. This can also be applied to the camera shake problem. In other words, information for estimating and restoring the camera shake portion in the originally intended scene is extracted from a plurality of images obtained by shooting the same scene with the continuous shooting function in the presence of camera shake, and based on this information. If the camera shake portion of the image is estimated and restored, the influence of camera shake on the captured image can be minimized.
[0015]
The operation of this embodiment will be described below. The imaging apparatus includes a camera shake detection unit that detects movement of the imaging apparatus itself due to camera shake. In addition, the imaging device sets the shooting mode to a mode (continuous shooting mode) in which continuous shooting is possible by the continuous shooting determination unit based on information related to camera shake (camera shake information) detected by the camera shake detection unit during shooting. To make the continuous shooting function work. When shutter release of the imaging device is started in the continuous shooting mode, a plurality of images are shot at short time intervals, and at the same time, camera shake information detected from the camera shake detection unit according to the shooting timing is acquired by the camera shake information control unit Is done. A plurality of images acquired after shooting and camera shake information corresponding to each image are at least one image as a camera shake correction unit, such as an image taken first or an image designated by the user, in the camera shake correction unit. With respect to this image, the camera shake portion of the image to be corrected is corrected using camera shake correction information calculated based on a plurality of images and camera shake information. Regarding the calculation of camera shake correction information, for example, information for performing correction from an image in which camera shake is determined to be minimum based on camera shake information is calculated from a plurality of images, and correction is performed based on this.
[0016]
Hereinafter, the outline described above will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing a basic configuration of an electronic camera as an image processing apparatus according to the present invention. This electronic camera uses a single-plate color CCD image pickup device 1 having an electronic shutter function. A subject image is formed on the CCD image pickup device 1 through a lens 2 and an aperture / shutter mechanism 3, and the subject The image is photoelectrically converted and output as an image signal. The image signal of the subject image from the CCD image pickup device 1 is amplified by the amplifier 4 after being removed by a correlated double sampling circuit or the like (not shown) and further converted into a digital signal by the A / D converter 5. It is supplied to the camera signal processing circuit 6 where it is processed as image data.
[0017]
Further, the output of the A / D converter 5 is also supplied to the AF, AE, and AWB detection circuit 7, where an AE detection process for extracting AF information for automatically controlling the focus prior to actual photographing. Then, AE detection processing for extracting AE information for automatically controlling exposure and AWB detection processing for extracting AWB information for automatically setting white balance are performed. The AF information, AE information, and AWB information from the AF, AE, and AWB detection circuit 7 are supplied to the lens 2, the aperture / shutter mechanism 3 and the camera signal processing circuit 6 through the CPU 8, respectively.
[0018]
The camera signal processing circuit 6 and the CPU 8 are connected to a bus line 9, and a DRAM 11 used as a working memory when performing color processing of image data or the like is connected to the bus line 9 via a memory controller 10. In addition, a compression circuit (JPEG) 12 for compressing image data from the camera signal processing circuit 6 is connected. In addition, a memory card I / F 14 is connected to the bus line 9 in order to record the image data compressed by the compression circuit 12 in the memory card 13, and the image data recorded in the memory card 13 is stored in the bus line 9. A liquid crystal display element (LCD) 16 is connected via a display circuit 15 to read out and display or to display a photographing state. Further, a PCI / F 18 for transferring image data recorded on the memory card 13 to a personal computer (PC) 17 is connected to the bus line 9.
[0019]
Connected to the CPU 8 are a strobe device 19 that is controlled based on AE information from the AF, AE, and AWB detection circuit 7 and an input key 20 for setting various shooting modes, driving a trigger switch, and the like. The CCD image pickup device 1 is driven by a timing pulse from a timing generator (TG) 21 under the control of the CPU 8. In addition, a camera shake detection sensor 22 serving as a camera shake detection unit for detecting camera shake of the electronic camera is provided, and information relating to camera shake detected from the camera shake detection sensor 22 (camera shake information: for example, angular velocity due to camera shake, movement amount, camera shake direction, etc.) Information for detecting camera shake) is transmitted to the CPU 8 and a camera shake correction shooting mode determination circuit 23 which is a continuous shooting determination unit described later, and shooting control, camera shake correction processing, and the like are performed.
[0020]
In the electronic camera shown in FIG. 1, the operation of the input key 20 includes a normal shooting mode in which one image is acquired without performing camera shake correction, and a continuous shooting mode in which a plurality of images are acquired in order to perform camera shake correction. Alternatively, the camera shake correction shooting mode determination circuit 23 determines the camera shake information detected from the camera shake detection sensor 22. The camera shake correction shooting mode determination circuit 23 determines whether or not to perform continuous shooting for camera shake correction, which will be described later, based on the information regarding the shooting mode from the input key 20 and the camera shake information from the camera shake detection sensor 22. As an output, a shooting mode determination signal indicating the shooting mode is transmitted to the CPU 8. Then, the CPU 8 controls the shooting operation according to the selected shooting mode.
[0021]
That is, when the normal shooting mode is selected, one image signal is obtained from the CCD image pickup device 1 in one shooting by a normal shooting operation, and when the continuous shooting mode is selected, the CCD The electronic shutter function of the image sensor 1 or a known method such as a combination of the electronic shutter function and the aperture / shutter mechanism 3 can be used for a plurality of (for example, four, And the like, and the camera signal processing circuit 6 performs image data processing according to the shooting mode. When the continuous shooting mode is set by the camera shake correction shooting mode determination circuit 23, in addition to the manual shooting mode setting from the input key 20, camera shake is large due to camera shake information from the camera shake detection sensor 22 (for example, the angular velocity is high). Large), etc.
[0022]
Next, FIG. 2 is a diagram illustrating an example of a block diagram in the camera signal processing circuit 6. The shooting mode determination signal transmitted from the CPU 8 drives the first switch 31 and the second switch 32. When the shooting mode is the normal shooting mode, the image signal entering the first switch 31 from the A / D converter 5 is transmitted to the camera signal processing process unit 39 via the second switch 32, and the image signal is reproduced as an image. Processing is performed. On the other hand, when the shooting mode is the continuous shooting mode, the image signal (continuous shooting image signal) entering the first switch 31 from the A / D converter 5 is transmitted to the continuous shooting image recording control unit 34 which is a camera shake information control unit. The
[0023]
The continuous shot image recording control unit 34 stores the input continuous shot image signal in the continuous shot image storage buffer 33. A signal indicating camera shake information transmitted from the CPU 8 is transmitted to the camera shake information integrated control unit 35 serving as a camera shake information control unit. The camera shake information integration control unit 35 reads and stores camera shake information at the shooting timing of continuous shot images in response to the continuous shot image signal input from the continuous shot image recording control unit 34. In this embodiment, a dedicated buffer for storing continuous shot images is provided, but the DRAM 11 provided in the electronic camera may be used as a substitute for the continuous shot image storage buffer 33.
[0024]
After all the continuous shot image signals and camera shake information are transmitted, the continuous shot image recording control unit 34 sequentially reads the continuous shot image signals from the continuous shot image recording buffer 33. At the same time, camera shake information corresponding to the shooting timing of the continuous-shot image signal read from the continuous-shot image recording buffer 33 is sequentially read from the camera-shake information integration control unit 35 as the continuous-shot image signal is read.
[0025]
The read continuous image signal and the camera shake information corresponding to the read continuous image signal are transmitted to the camera shake correction target image selection unit 36 serving as a camera shake correction unit, and an image to be subjected to camera shake correction is selected. In the present embodiment, the first image captured in the group of continuously shot images is set as a target image for camera shake correction. This is because the image at the moment when the shutter release is started is often an image at the timing that the user should originally shoot. The selection of the image to be corrected is not limited to this. For example, an image having a large image blur (such as the maximum image blur) may be selected based on a camera shake signal. Alternatively, the CPU 8 may transmit a control signal related to the user's instruction to the camera shake correction target image selection unit 36 so that the user can select an image he / she desires to correct.
[0026]
The read continuous shot image signal and the camera shake information corresponding thereto are further transmitted to the camera shake correction information calculation unit 37 serving as a camera shake correction unit, and information for performing camera shake correction is calculated. Here, the image stabilization target image signal output from the image stabilization target image selection unit 36 is also used, for example, based on an image in which the image stabilization in the captured image is minimized, and the image stabilization is performed by configuring an image stabilization filter from this image. Calculate information.
[0027]
The camera shake correction target image signal selected by the camera shake correction target image selection unit 36 and the camera shake correction information calculated by the camera shake correction information calculation unit 37 are transmitted to the camera shake correction processing unit 38 serving as the camera shake correction unit. Based on the camera shake correction information, the camera shake correction processing unit 38 performs a process of correcting the camera shake portion of the image to be corrected. For example, when a camera shake minimum image restoration filter is transmitted as camera shake correction information, a camera shake correction process is performed by applying an image restoration algorithm based on the restoration filter to the camera shake correction target image signal.
[0028]
The camera shake correction target image signal whose camera shake has been corrected by the camera shake correction processing unit 38 is transmitted to the camera signal processing process unit 39 via the second switch 32, and a process for reproducing the image signal as an image is performed. The signal reproduced as an image is transmitted to the bus line 9 for subsequent processing. In the present embodiment, a signal processing process for image reproduction is incorporated after camera shake correction. However, the order may be reversed and the camera shake correction may be performed after performing the signal processing process for image reproduction.
[0029]
Next, FIG. 3 is a diagram illustrating an example of a flow of the camera shake correction processing algorithm in the present embodiment. Here, the camera shake correction processing algorithm represents from continuous shooting mode setting to image signal processing for a camera shake correction target image after camera shake correction.
[0030]
First, when a control signal for switching to the continuous shooting mode is output from the camera shake correction shooting mode determination circuit 23, the shooting mode is set to a continuous shooting (camera shake correction) mode (step S1). Next, when shutter release is started, the shutter is in an “open” state and continuous shooting is started (step S2). While the shutter is in the “open” state, the continuous shot image recording control unit 34 acquires the continuous shot image and camera shake information corresponding to the image in synchronization with the shutter control timing (step S3). Then, the shutter is closed and the continuous shooting is finished (step S4).
[0031]
Next, regarding the continuously shot image group that has been shot, the image that is first shot in the continuously shot image group is selected as the camera shake correction target image in the camera shake correction target image selection unit 36 (step S5). Thereafter, in the camera shake correction information calculation unit 37, an image (camera shake minimum image) in which the camera shake information in the continuous image group is minimized is detected as an image used for calculating the camera shake correction information (step S6). The camera shake minimum image detected here is compared with the camera shake correction target image (step S7). If both are the same images (Yes), the subsequent process for camera shake correction is not performed and the process skips to step S10. To do. When both are different (No), the process proceeds to the next step.
[0032]
  Next, in the camera shake correction information calculation unit 37,The image stabilization target image selected in step S5 andCamera shake correction information is calculated from the camera shake minimum image detected in step S6 (step S8). Then, using the calculated camera shake correction information, the camera shake correction processing unit 38 corrects the camera shake of the image to be corrected (step S9). Then, the camera signal processing target unit 39 performs image signal processing on the camera shake correction target image that has not been subjected to the camera shake correction processing because it is a camera shake correction target image or a camera shake minimum image that has been corrected for camera shake (step S10).
[0033]
  Next, FIG. 4 is a diagram illustrating an example of a procedure of camera shake correction processing in the present embodiment. In the continuous shooting mode with camera shake correction, when the time transition of camera shake information with respect to time is as shown in FIG. 4A, shooting is performed by generating shutter timing pulses (FIG. 4B) at regular short time intervals. As a result, a group of continuously shot images (FIG. 4C) consisting of four images is generated. Here, considering that the camera shake correction processing based on the present embodiment is performed, the first image ((d1) in FIG. 4) in the continuous-shot image group is selected as a camera shake correction target image. For the minimum camera shake image for calculating the camera shake correction information, the last image ((d2) in FIG. 4) in the group of continuous shot images is selected based on the size of the camera shake information when the shutter timing pulse is generated. And image stabilization target image signalImage stabilization target image signal andA camera shake correction process ((e) in FIG. 4) is performed by a signal representing the camera shake correction information calculated from the minimum camera shake image, and finally a camera shake correction image relating to the first image in the continuous shot image group is generated (FIG. 4). 4 (f)).
[0034]
As a camera shake correction method used in the present embodiment, a recovery filter is generated from an image that minimizes camera shake in a continuous shot image (that is, the same scene), and based on this, a restoration process is performed on the camera shake image to be corrected. It is feasible by performing. As a recovery filter generation method, for example, after performing correction (motion vector correction used in MPEG etc.) so that the position of the image is the same between the minimum image stabilization image and the image to be corrected, it is generated based on the correlation between the images. After calculating the point spread function (PSF) for both of the image blurring part and the camera shake part, the PSF of the minimum camera shake image is generated by replacing the PSF of the camera shake correction target image (the camera shake part by performing only the local part process) However, the method for generating the recovery filter is not particularly limited, and other general methods can be adopted.
[0035]
As described above, in the present embodiment, a continuous shooting mode for performing camera shake correction from the state of camera shake of the electronic camera is set, and continuous shooting is performed in the presence of camera shake, and a plurality of images related to the same scene and camera shake corresponding to the image are captured. Information is acquired, and an image to be corrected for camera shake is selected from them, and at the same time, camera shake correction information for correcting camera shake is calculated. Since an image obtained by performing the camera shake correction process on the image to be corrected based on the camera shake correction information is generated, it is possible to generate an image in which the influence of the camera shake is suppressed as a result.
[0036]
In addition, the image to be subjected to camera shake correction is selected by selecting a first image from a plurality of continuously shot images, that is, an image of a scene to be originally taken immediately after the user starts shutter release. It is possible to reproduce an image that has been subjected to camera shake correction. Further, for the calculation of the camera shake correction information, it is possible to generate highly reliable correction information for the same scene by using an image with the minimum camera shake from among a plurality of images taken continuously. Therefore, even if there is a camera shake, it is possible to provide an image in which the influence of the camera shake is suppressed on the scene that the user tried to shoot.
[0037]
As another embodiment, a program for executing the above-described camera shake correction processing operation is recorded on a recording medium, and a driver for the recording medium is attached to the imaging apparatus including the image processing apparatus, and the recording medium is attached to the recording medium. The recorded program may be read and executed by the CPU 8 of the imaging apparatus main body (electronic camera) via a driver.
[0038]
【The invention's effect】
According to the first aspect of the present invention, at least one of the images to be corrected in the camera shake correction unit based on the plurality of images of the same scene continuously shot by the continuous shooting unit and the camera shake information detected from the camera shake detection unit. Camera shake correction is performed on the above image. In other words, camera shake correction is performed by calculating information for correcting the camera shake portion of the correction target image from a plurality of images that are in the same scene as the correction target image, so that the photographer can perform the camera shake correction at high speed and with high accuracy. Can capture the intended scene.
[0039]
According to the second aspect of the present invention, the same effect as in the first aspect is obtained, and the continuous shooting determination unit determines whether or not to perform continuous shooting based on information from the camera shake detection unit. Switching to continuous shooting can be automatically performed according to the state of camera shake, and shooting can be controlled so that camera shake correction is performed only when camera shake correction is necessary.
[0040]
According to the invention described in claim 3, the same effects as in claim 1 can be obtained, and camera shake information can be detected, processed, and stored so as to correspond to a continuously shot image. Therefore, the relationship between the photographed image and the camera shake information can be made appropriate, and the subsequent camera shake correction processing can be performed appropriately.
[0041]
According to the invention described in claim 4, the same effect as in any one of claims 1 to 3 can be obtained, and camera shake is caused with respect to an image taken first among a plurality of images taken continuously. Since the correction is performed, it is possible to appropriately perform the camera shake correction for the scene corresponding to the timing immediately after the shutter release.
[0042]
According to the invention described in claim 5, the same effect as in any one of claims 1 to 3 can be obtained, and information from an image having the minimum camera shake information among a plurality of images can be obtained in the camera shake correction unit. Since camera shake correction is performed based on this, highly reliable correction information can be provided to the camera shake correction unit.
[0043]
According to the sixth aspect of the present invention, in the computer for controlling the processing for correcting the camera shake of the photographed image, a plurality of images and camera shake of the same scene photographed by the continuous photographing function are detected. The recording medium stores an image processing program for performing camera shake correction on at least one image to be corrected by a function for correcting camera shake from camera shake information detected by the function. In other words, camera shake correction is performed by calculating information for correcting the camera shake portion of the correction target image from a plurality of images that are in the same scene as the correction target image, so that the photographer can perform the camera shake correction at high speed and with high accuracy. Can capture the intended scene.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a basic configuration of an electronic camera as an image processing apparatus according to the present invention.
FIG. 2 is a diagram illustrating an example of a block diagram in a camera signal processing circuit 6;
FIG. 3 is a diagram illustrating an example of a flow of an image stabilization processing algorithm in the present embodiment.
FIG. 4 is a diagram illustrating an example of a procedure of camera shake correction processing in the present embodiment.
[Explanation of symbols]
1 CCD image sensor
2 Lens
3 Aperture / Shutter Mechanism
4 amplifiers
5 A / D converter
6 Camera signal processing circuit
7 AF, AE, AWB detection circuit
8 CPU
9 Bus line
10 Memory controller
11 DRAM
12 Compression circuit
13 Memory card
14 Memory card I / F
15 Display circuit
16 Liquid crystal display (LCD)
17 PC
18 PCI / F
19 Strobe device
20 Input key
21 Timing generator (TG)
22 Shake detection sensor
23 Camera shake correction shooting mode determination circuit
31 First switch
32 Second switch
33 Continuous shooting image recording buffer
34 Continuous Shooting Image Recording Control Unit
35 Camera shake information integrated control unit
36 Image selection unit for image stabilization
37 Image stabilization information calculation unit
38 Image stabilization processing unit
39 Camera signal processing section

Claims (9)

An image processing apparatus for correcting a shake of the image captured by the imaging device,
A continuous shooting unit that continuously captures a subject at predetermined time intervals and obtains a plurality of images;
For each of the plurality of acquired images, a camera shake detection unit that detects camera shake information related to camera shake of the imaging device;
A selection unit that selects, as a correction target image, an image to be subjected to camera shake correction among the plurality of acquired images;
Based on the camera shake information detected for each of the plurality of images, an image that minimizes camera shake is selected as the camera shake minimum image among the plurality of acquired images, and the selected camera shake minimum image and the correction A correction information calculation unit that calculates camera shake correction information used for correcting a camera shake part of the correction target image based on the target image;
A camera shake correction unit that corrects a camera shake part of the correction target image using the calculated camera shake correction information ;
An image processing apparatus comprising:   The continuous shooting determination unit for determining whether or not to perform continuous shooting by the continuous shooting unit based on the camera shake information detected by the camera shake detection unit. Image processing device. 3. The camera shake information control unit further controls to detect and process the camera shake information in correspondence with the plurality of images taken by the continuous shooting unit. 4. Image processing apparatus. The selection unit, the as the correction target image, any one of claims 1 to 3, characterized by selecting the first picture recorded among the continuous shooting the plurality of images taken by the photographing unit An image processing apparatus according to 1. The image processing apparatus according to claim 1, wherein the selection unit selects an image that the user desires to correct as the correction target image. An image processing device for correcting camera shake of an image taken by an imaging device,
A continuous shooting unit that continuously captures a subject at predetermined time intervals and obtains a plurality of images;
In accordance with the timing of the continuous shooting, the shake detecting unit detects the camera shake information about the shake of the image pickup device,
And hand shake information detected by the shake detection unit, based on the multiple images obtained by the continuous shooting section, corrects the camera shake portions the image has for at least one image of the images An image stabilization unit to
An image processing apparatus comprising:   An image processing method for correcting camera shake of an image taken by an imaging device,
  Capturing a plurality of images by continuously photographing a subject at a predetermined time interval;
  Detecting camera shake information related to camera shake of the imaging device for each of the plurality of acquired images;
  Selecting an image to be subjected to camera shake correction as a correction target image among the plurality of acquired images;
  Based on the camera shake information detected for each of the plurality of images, an image that minimizes camera shake is selected as the camera shake minimum image among the plurality of acquired images, and the selected camera shake minimum image and the correction Based on the target image, calculating camera shake correction information for correction of the camera shake portion of the correction target image;
  Using the calculated camera shake correction information to correct a camera shake portion of the correction target image;
  An image processing method comprising:   A computer program for causing a computer to perform an image processing method for correcting camera shake of an image captured by an imaging device, the image processing method comprising:
  Capturing a plurality of images by continuously photographing a subject at a predetermined time interval;
  Detecting camera shake information related to camera shake of the imaging device for each of the plurality of acquired images;
  Selecting an image to be subjected to camera shake correction as a correction target image among the plurality of acquired images;
  Based on the camera shake information detected for each of the plurality of images, an image that minimizes camera shake is selected as the camera shake minimum image from the plurality of acquired images, and the selected camera shake minimum image and the correction Based on the target image, calculating camera shake correction information for correction of the camera shake portion of the correction target image;
  Using the calculated camera shake correction information to correct a camera shake portion of the correction target image;
  A computer program comprising:   A computer-readable recording medium storing a program including a command for causing a computer to execute a process for correcting camera shake of an image captured by an imaging apparatus, wherein the process for correcting the camera shake includes:
  Capturing a plurality of images by continuously photographing a subject at a predetermined time interval;
  Detecting camera shake information related to camera shake of the imaging device for each of the plurality of acquired images;
Selecting an image to be subjected to camera shake correction as a correction target image among the plurality of acquired images;
Based on the camera shake information detected for each of the plurality of images, an image that minimizes camera shake is selected as the camera shake minimum image among the plurality of acquired images, and the selected camera shake minimum image and the correction Based on the target image, calculating camera shake correction information for correction of the camera shake portion of the correction target image;
Using the calculated camera shake correction information to correct a camera shake portion of the correction target image;
A recording medium comprising:

Images