JP2002247444A - Image processor and recording medium for recording image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor that can photograph a scene intended by a photographer while quickly compensating a camera-shake with high accuracy. SOLUTION: The image processor that compensates a camera-shake of an image photographed by an image pick up device, is provide with a consecutive shot section (CPU 8) that consecutively photographs an object at a prescribed time interval to acquire a plurality of images, a camera-shake detection section (camera-shape sensor 22) that detects camera-shake information with respect to the camera-shake according to the consecutive photographing timings, and camera-shake compensation sections (a camera-shake compensation object image selection section 36, a camera-shake compensation information calculation section 37, and a camera-shake compensation processing section 38) that correct a camera-shake of at least one image or more among a plurality of the images.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and a recording medium on which an image processing program is recorded, and more particularly to an image processing apparatus and a recording medium which can be used to correct camera shake of a captured image.

[0002]

2. Description of the Related Art When photographing a subject by holding a silver halide film camera by hand, it is a common phenomenon that a photographed image becomes unnatural due to camera shake.
The same applies to an electronic camera called a digital still camera, and realization of a method and a function for suppressing camera shake has become a major issue in an electronic camera, as in a silver halide film camera. In a silver halide film camera, it is well known that a method of driving a photographing optical system to suppress camera shake and perform photographing, but in an electronic camera, in addition to driving the photographing optical system, control during photographing by electric signal processing. In addition, the influence of camera shake can be suppressed by correcting an electronic image (hereinafter simply referred to as an image) after photographing.

One of the practically effective methods based on electric signal processing is a sensor (camera shake detection sensor) for detecting camera shake movement represented by an angular velocity sensor or the like.
Is provided in an electronic camera to detect and predict the movement of a camera shake (movement amount, movement direction, etc.), and to control the shutter so as to take an image at a certain timing from the temporal change of the camera shake. For example, Japanese Patent Application Laid-Open No. 5-107622 discloses that a camera shake is detected by an angular velocity sensor, and a shutter is released a predetermined time after the camera shake generates a maximum value. In this method, the image is captured at a time when the influence of camera shake is relatively small, and the resulting image is relatively comparable.

As a method of correcting camera shake by electric signal processing, a method of processing an image after photographing to estimate and restore information that the camera shake portion should originally have is well known. Commonly used image processing includes a method using a restoration filter (for example, an inverse filter or a Wiener filter) for restoring a blurred portion, and information for restoring a blurred portion from an image point spread function (PSF). There are some that apply. For example, in Japanese Patent Application Laid-Open No. 11-134481, when a camera shake image is restored using a point spread function generated based on camera shake trajectory data, restoration is performed in consideration of luminance values of pixels around pixels on the camera shake trajectory. To the effect.

[0005]

However, according to the method described in Japanese Patent Application Laid-Open No. 5-107622, the photographing is performed with a time lag from the shutter timing originally intended by the photographer. Has a problem that a scene different from the scene that the photographer was trying to photograph may be photographed.

[0006] Also, the above-mentioned Japanese Patent Application Laid-Open No. 11-134481.
According to the method described in Japanese Patent Publication No.
Since the restoration is performed, if the camera shake portion is to be faithfully reproduced, there is a problem in that the computational effort and time in image processing are increased.

The present invention has been made in view of such a problem, and an object of the present invention is to be able to photograph a scene intended by a photographer while performing camera shake correction at high speed and with high accuracy. An image processing device is provided.

[0008]

According to a first aspect of the present invention, there is provided an image processing apparatus for correcting a camera shake of an image photographed by an image pickup apparatus. According to the timing of the continuous shooting, and a continuous shooting unit that obtains a plurality of images by shooting
A camera shake detection unit that detects camera shake information related to camera shake of the imaging device, camera shake information detected by the camera shake detection unit, and a plurality of images obtained by the continuous shooting unit; A camera shake correction unit for correcting camera shake of at least one or more images.

According to a second aspect of the present invention, in the image processing apparatus according to the first aspect, whether or not to perform continuous shooting by the continuous shooting unit based on the camera shake information detected by the camera shake detection unit. Is further provided.

According to a third aspect, in the image processing apparatus according to the first aspect, the camera shake information is detected and processed in correspondence with the plurality of images photographed by the continuous photographing unit. And a camera shake information control unit for controlling the camera shake information.

According to a fourth aspect of the present invention, in the image processing apparatus according to any one of the first to third aspects, the image to be corrected by the camera shake correction unit is captured by the continuous shooting unit. This is the first image captured among a plurality of images.

According to a fifth aspect of the present invention, in the image processing apparatus according to any one of the first to third aspects, the camera shake correction unit determines that the camera shake among the plurality of images is the smallest. The image processing apparatus according to claim 1, wherein camera shake of a correction target image is corrected using information about the image.

According to a sixth aspect of the present invention, there is provided a computer-readable recording medium storing a program including an instruction for causing a computer to execute a process of correcting a camera shake of an image photographed by an imaging device. The processing of correcting the camera shake includes a continuous shooting step of continuously shooting a subject at a predetermined time interval to obtain a plurality of images, and detecting camera shake information regarding camera shake of the imaging apparatus according to the timing of the continuous shooting. Camera shake detection step, and camera shake information corresponding to each image detected in the camera shake detection step, based on the plurality of images obtained in the continuous shooting step, at least one or more of the plurality of images And a camera shake correction step of correcting camera shake of the image.

[0014]

DESCRIPTION OF THE PREFERRED EMBODIMENTS First, an outline of the present embodiment will be described. One of the functions realized by the electronic camera is a “continuous shooting function” that continuously captures images at short time intervals and records a plurality of images. The electronic camera can perform various processing by image processing, and it can be expected that significant information is extracted from a plurality of images photographed by the continuous shooting function and the image quality is improved using the extracted information. This also applies to camera shake problems. That is, information for estimating and restoring a camera shake portion in a scene originally intended to be taken is extracted from a plurality of images obtained by shooting the same scene by a continuous shooting function in a state where there is camera shake, and based on this information, By estimating and restoring the camera shake portion of the image, the influence of the camera shake of the captured image can be minimized.

The operation of this embodiment will be described below. The imaging apparatus has a camera shake detection unit that detects a movement of the imaging apparatus itself due to camera shake. In addition, the imaging device, at the time of shooting,
The continuous shooting determination unit sets the shooting mode to a mode capable of continuous shooting (continuous shooting mode) based on the information on the camera shake (camera shake information) detected by the camera shake detection unit, and causes the continuous shooting unit to function. . When the shutter release of the imaging device is started in the continuous shooting mode, a plurality of images are captured at short time intervals, and at the same time, the camera shake information detected by the camera shake detection unit is obtained by the camera shake information control unit according to the shooting timing. Is done. The plurality of images acquired after the photographing and the camera shake information corresponding to each image are processed by the camera shake correction unit at least one or more as the image whose camera shake is to be corrected, such as the first photographed image or the image designated by the user. The image blur correction of the image to be corrected is performed using the image correction information calculated based on the plurality of images and the camera shake information. As for the calculation of the camera shake correction information, for example, information for performing the correction is calculated from an image in which the camera shake is determined to be the minimum based on the camera shake information from a plurality of images, and the correction is performed based on the information.

Hereinafter, the outline described above will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing a basic configuration of an electronic camera as an image processing device according to the present invention. This electronic camera uses a single-plate type color CCD image pickup device 1 having an electronic shutter function, and a subject image is formed on the CCD image pickup device 1 via a lens 2 and an aperture / shutter mechanism 3. The image is photoelectrically converted and output as an image signal. The image signal of the subject image from the CCD image pickup device 1 is subjected to noise removal by a correlated double sampling circuit or the like (not shown), then amplified by an amplifier 4 and further converted to a digital signal by an A / D converter 5. The data is supplied to the camera signal processing circuit 6, where it is processed as image data.

The output of the A / D converter 5 is AF, A
E, also supplied to the AWB detection circuit 7, where the AF for automatically controlling the focus prior to the original photographing
An AE detection process for extracting information, an AE detection process for extracting AE information for automatically controlling exposure, and an AWB detection process for extracting AWB information for automatically setting white balance are performed. This AF, AE, AW
The AF information, AE information, and AWB information from the B detection circuit 7 are supplied to the lens 2, the aperture / shutter mechanism 3, and the camera signal processing circuit 6 via the CPU 8, respectively.

The camera signal processing circuit 6 and the CPU 8
A DRAM 11 used as a working memory when performing color processing of image data and the like is connected to the bus line 9 via a memory controller 10, and the camera signal processing circuit 6 is connected to the bus line 9. A compression circuit (JPEG) 12 for compressing image data from the camera is connected. The bus line 9 includes a compression circuit 12
A memory card I / F 14 is connected to record the image data compressed in step 3 on the memory card 13, and the image data recorded on the memory card 13 is read out and displayed, and the shooting state is displayed. For this purpose, a liquid crystal display (LCD) 16 is connected via a display circuit 15. Further, the memory card 13 is connected to the bus line 9.
Is connected to a personal computer (PC) 17 for transferring image data recorded in the personal computer (PC) 17.

The CPU 8 is connected to a strobe device 19 controlled based on AE information from the AF, AE, and AWB detection circuits 7 and an input key 20 for setting various photographing modes and driving a trigger switch. ing.
Note that the CCD image pickup device 1 is driven by a timing pulse from a timing generator (TG) 21 under the control of the CPU 8. The electronic camera further includes a camera shake detection sensor 22 serving as a camera shake detection unit for detecting camera shake. Information for detecting camera shake) is transmitted to the CPU 8 and a camera shake correction shooting mode determination circuit 23, which is a continuous shooting determination unit to be described later, to perform shooting control and camera shake correction processing.

In the electronic camera shown in FIG. 1, a normal photographing mode for acquiring one image without performing camera shake correction and a continuous photographing mode for acquiring a plurality of images for performing camera shake correction are set by input keys. The camera shake correction shooting mode determination circuit 23 makes a determination based on the operation of the camera 20 or the camera shake information detected by the camera shake detection sensor 22. The camera shake correction shooting mode determination circuit 23 determines whether or not to perform continuous shooting for camera shake correction, which will be described later, based on information about the shooting mode from the input key 20 and camera shake information from the camera shake detection sensor 22. The CPU 8 transmits a photographing mode determination signal indicating the photographing mode to the CPU 8 as an output of. Then, the CPU 8 controls the photographing operation according to the selected photographing mode.

That is, when the normal photographing mode is selected, one image signal is obtained from the CCD image sensor 1 in one photographing operation by a normal photographing operation, and when the continuous photographing mode is selected. A plurality of images (for example, four shots) are taken from the CCD image pickup device 1 in a single shot by a known method using the electronic shutter function of the CCD image pickup device 1 or a combination of the electronic shutter function and the aperture / shutter mechanism 3. , Etc.), and the camera signal processing circuit 6 performs image data processing according to the shooting mode. In the case where the continuous shooting mode is set by the camera shake correction shooting mode determination circuit 23, in addition to the manual shooting mode setting from the input key 20, the camera shake is large due to the camera shake information from the camera shake detection sensor 22 (for example, when the angular velocity is large). Large, etc.).

FIG. 2 is a block diagram showing an example of the camera signal processing circuit 6. As shown in FIG. The shooting mode determination signal transmitted from the CPU 8 drives the first switch 31 and the second switch 32. When the shooting mode is the normal shooting mode, the image signal input from the A / D converter 5 to the first switch 31 is transmitted to the camera signal processing unit 39 via the second switch 32, and is used to reproduce the image signal as an image. Processing is performed. On the other hand, when the shooting mode is the continuous shooting mode, an image signal (continuously shot image signal) input from the A / D converter 5 to the first switch 31 is transmitted to the continuously shot image recording control unit 34 which is a camera shake information control unit. You.

The continuous shot image recording control section 34 stores the input continuous shot image signal in the continuous shot image storage buffer 33. The signal indicating the camera shake information transmitted from the CPU 8 is transmitted to the camera shake information integrated control unit 35 which is a camera shake information control unit. In the camera shake information integrated control unit 35,
In response to the input of the continuous shot image signal in the continuous shot image recording control unit 34, the camera shake information at the time of shooting the continuous shot images is read and stored.
In the present embodiment, a dedicated buffer for storing continuously shot images is provided, but a DRAM provided in the electronic camera is provided.
11 may be used as a substitute for the continuously shot image storage buffer 33.

After the continuous shot image signal and the camera shake information are all transmitted, the continuous shot image recording control section 34 sequentially reads the continuous shot image signal from the continuous shot image recording buffer 33. At the same time, the camera shake information integrated control unit 35 sequentially reads out the camera shake information corresponding to the shooting timing of the continuous shot image signal read from the continuous shot image recording buffer 33 in accordance with the reading of the continuous shot image signal.

The read continuous image signal and the corresponding camera shake information are transmitted to a camera shake correction target image selector 36 which is a camera shake corrector, and selects an image to be subjected to camera shake correction. In the present embodiment, an image captured first in a group of continuously shot images is set as a target image for camera shake correction. this is,
This is because the image at the moment when the shutter release is started is often the image at the timing at which the user should originally shoot. The selection of the camera shake correction target image is not limited to this, and for example, an image having a large camera shake (such as a maximum camera shake) determined from a camera shake signal may be selected. Further, a control signal relating to a user's instruction may be transmitted from the CPU 8 to the image-blur correction target image selection unit 36 so that the user can himself select an image desired to be corrected.

The read continuous-shot image signal and the corresponding hand-shake information are further transmitted to a hand-shake correction information calculation unit 37 which is a hand-shake correction unit, and calculates information for performing a hand-shake correction. Here, the camera shake correction target image selection unit 3
6, using the image signal for image stabilization output from
For example, based on an image in which a camera shake is minimized in a captured image, camera shake correction information is calculated from this image by forming a shake recovery filter or the like.

The image signal for camera shake correction selected by the image selection unit for camera shake correction 36 and the camera shake correction information calculation unit 3
The camera shake correction information calculated in step 7 is transmitted to a camera shake correction processing unit 38 which is a camera shake correction unit. Camera shake correction processing unit 3
In step 8, based on the camera shake correction information, processing for correcting the camera shake portion of the image to be corrected is performed. For example, when the restoration filter for the minimum image of the camera shake is transmitted as the camera shake correction information, the camera shake correction process is performed by applying an image restoration algorithm based on the restoration filter to the image signal to be corrected.

The image signal subjected to camera shake correction, which has been corrected by the camera shake correction processing unit 38, is transmitted to the camera signal processing unit 39 via the second switch 32, and is subjected to processing for reproducing the image signal as an image. The signal reproduced as an image is transmitted to the bus line 9 to perform the subsequent processing. In the present embodiment, the signal processing process for image reproduction is incorporated after the camera shake correction. However, the camera shake correction may be performed after performing the signal processing process for image reproduction in the reverse order.

Next, FIG. 3 is a diagram showing an example of the flow of the camera shake correction processing algorithm in the present embodiment.
The camera shake correction processing algorithm referred to here indicates from setting of a continuous shooting mode to image signal processing of a camera shake correction target image after camera shake correction.

First, when a control signal for setting the continuous shooting mode is output from the camera shake correction shooting mode determination circuit 23, the shooting mode is set to the continuous shooting (camera shake correction) mode (step S1). Next, when the shutter release is started, the shutter is opened and the continuous shooting is started (step S2). While the shutter is in the "open" state, the continuously shot image recording control unit 34 acquires continuously shot images and hand shake information corresponding to the images in synchronization with the shutter control timing (step S3). Then, the shutter is set to the "closed" state to end the continuous shooting (step S).
4).

Next, with respect to the group of continuously shot images, the first image in the group of continuously shot images is selected as the image to be corrected by the camera shake correction image selecting unit 36 (step S5). After that, the camera shake correction information calculation unit 37 detects an image (minimum camera shake image) in which the camera shake information in the continuous shot image group is the smallest as the image used for calculating the camera shake correction information (step S6). The detected camera shake minimum image is compared with the camera shake correction target image (step S7), and when both images are the same image (Y
In step es), the process skips to step S10 without performing the subsequent process relating to camera shake correction. If the two are different (N
o) goes to the next step.

Next, in the camera shake correction information calculating section 37,
Camera shake correction information is calculated from the camera shake minimum image detected in step S6 (step S8). Thereafter, using the calculated camera shake correction information, the camera shake correction processor 38 corrects the camera shake of the image to be corrected (step S).
9). Then, the image signal processing is performed by the camera signal processing unit 39 on the image subjected to the camera shake correction which has not been subjected to the camera shake correction processing because it is the image subjected to the camera shake correction with the camera shake corrected or the image having the minimum camera shake (step S10).

Next, FIG. 4 is a diagram showing an example of the procedure of the camera shake correction processing in this embodiment. In the continuous shooting mode by the camera shake correction, when the time transition of the camera shake information with respect to time is as shown in FIG. 4A, the shutter timing pulse (FIG. 4B) is generated at a fixed short time interval. By doing so, a continuously shot image group ((c) in FIG. 4) including four images is generated. Here, considering that the camera shake correction processing based on the present embodiment is performed, the first image ((d in FIG.
1)) is selected. In addition, as for the camera shake minimum image for calculating the camera shake correction information, the last image ((d2) in FIG. 4) in the continuous shot image group is selected based on the size of the camera shake information when the shutter timing pulse is generated. Then, a camera shake correction process ((e) in FIG. 4) is performed using a signal representing the camera shake correction information calculated from the camera shake correction target image signal and the camera shake minimum image, and finally the camera shake relating to the first image in the continuous shot image group. A corrected image is generated ((f) in FIG. 4).

As a camera shake correction method used in the present embodiment, a recovery filter is generated from an image having a minimum camera shake in a continuous shot image (that is, the same scene), and a camera shake image to be corrected is generated based on the recovery filter. This can be realized by performing a restoration process. As a method of generating the restoration filter, for example, after performing correction (motion vector correction used in MPEG or the like) so that the image position is the same between the minimum image and the image to be corrected, generation is performed based on the correlation between the two images. And the point spread function (PS
After calculating F), there is a method of generating by replacing the PSF of the image with the minimum camera shake with the PSF of the image to be shake-corrected (cancelling the PSF of the camera-shake part by performing only the processing of the local part), and the like. The method of generating the recovery filter is not particularly limited, and other general methods can be adopted.

As described above, in the present embodiment, the continuous shooting mode for performing the camera shake correction from the camera shake state of the electronic camera is set, and the continuous shooting is performed with the camera shake, and a plurality of images and images related to the same scene are obtained. The camera shake information corresponding to the camera shake information is acquired, and the camera shake correction information for correcting the camera shake is calculated at the same time as selecting the image for which the camera shake is to be corrected. Then, an image obtained by performing a camera shake correction process on the image to be corrected based on the camera shake correction information is generated. As a result, an image in which the influence of the camera shake is suppressed can be generated.

The image to be subjected to camera shake correction is selected from among a plurality of continuously shot images, that is, the first image, that is, the image of the scene to be originally shot immediately after the user starts the shutter release. It is possible to reproduce an image subjected to camera shake correction in an intended scene. Furthermore, by using the image with the least camera shake among a plurality of images shot continuously for calculating the camera shake correction information, highly reliable correction information can be generated for the same scene. Therefore, even if there is a camera shake, it is possible to provide an image in which the influence of the camera shake is suppressed for the scene that the user tried to shoot.

In another embodiment, a program for executing the operation of the above-described camera shake correction processing is recorded on a recording medium, and an image pickup apparatus including an image processing apparatus is provided with a driver for the recording medium. The program recorded in the recording medium may be read and executed by the CPU 8 of the imaging apparatus main body (electronic camera) via the driver.

[0038]

According to the first aspect of the present invention, a plurality of images of the same scene continuously photographed by the continuous photographing unit and a camera shake correction unit based on the camera shake information detected by the camera shake detecting unit. Is performed on at least one image. That is, since the camera shake correction is performed by calculating information for correcting the camera shake portion of the correction target image from a plurality of images that are the same scene as the correction target image,
A scene intended by the photographer can be photographed while performing camera shake correction at high speed and with high accuracy.

According to the second aspect of the present invention, the same effects as those of the first aspect are obtained, and the continuous shooting determination section determines whether or not to perform continuous shooting based on information from the camera shake detection section. Since the determination is made, it is possible to automatically switch to continuous shooting in accordance with the state of camera shake, and it is possible to control shooting so that camera shake correction is performed only when camera shake correction is necessary.

According to the third aspect of the present invention, the same effects as those of the first aspect are obtained, and the camera shake information is detected, processed, stored, etc. so as to correspond to the continuously shot image. Is performed, the relationship between the captured image and the camera shake information can be made appropriate, and the subsequent camera shake correction processing can be appropriately performed.

According to the fourth aspect of the present invention, the same effects as those of any one of the first to third aspects can be obtained, and the first image among a plurality of continuously shot images can be obtained. Since the camera shake correction is performed for the scene, the camera shake correction can be appropriately performed on the scene corresponding to the timing immediately after the shutter release.

According to the fifth aspect of the present invention, the same effect as any one of the first to third aspects can be obtained, and the image blur correction unit can reduce the number of images having the minimum image blur information among the plurality of images. Is performed based on this information, highly reliable correction information can be provided to the camera shake correction unit.

According to the sixth aspect of the present invention, in a computer for controlling a process of correcting a camera shake of a photographed image, a plurality of images of the same scene photographed by a function of performing continuous photographing and a camera shake are provided. A recording medium that stores an image processing program for realizing camera shake correction on at least one or more images to be corrected by a function for correcting camera shake from camera shake information detected by a function for detecting image blur. That is, since information for correcting the camera shake portion of the correction target image is calculated from a plurality of images that are the same scene as the correction target image and the camera shake is corrected, the photographer can perform the camera shake correction at high speed and with high accuracy. Can shoot the intended scene.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a basic configuration of an electronic camera as an image processing device according to the present invention.

FIG. 2 is a diagram showing an example of a block diagram in a camera signal processing circuit 6.

FIG. 3 is a diagram illustrating an example of a flow of a camera shake correction processing algorithm according to the present embodiment.

FIG. 4 is a diagram illustrating an example of a procedure of a camera shake correction process according to the embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 CCD imaging element 2 Lens 3 Aperture / shutter mechanism 4 Amplifier 5 A / D converter 6 Camera signal processing circuit 7 AF, AE, AWB detection circuit 8 CPU 9 Bus line 10 Memory controller 11 DRAM 12 Compression circuit 13 Memory card 14 Memory Card I / F 15 Display circuit 16 Liquid crystal display element (LCD) 17 Personal computer (PC) 18 PCI / F 19 Strobe device 20 Input key 21 Timing generator (TG) 22 Camera shake detection sensor 23 Camera shake correction shooting mode determination circuit 31 First switch 32 second switch 33 continuous shooting image recording buffer 34 continuous shooting image recording control unit 35 camera shake information integration control unit 36 image stabilization target image selection unit 37 camera shake correction information calculation unit 38 camera shake correction processing unit 39 camera signal processing unit

Claims (6)

[Claims] An image processing apparatus for correcting a camera shake of an image captured by an image capturing apparatus, comprising: a continuous shooting section configured to continuously capture an image of a subject at predetermined time intervals to obtain a plurality of images; In accordance with the timing of the appropriate shooting, a camera shake detection unit that detects camera shake information regarding camera shake of the imaging device, based on the camera shake information detected by the camera shake detection unit, and a plurality of images obtained by the continuous shooting unit, An image processing apparatus, comprising: a camera shake correction unit that corrects a camera shake of at least one image among the plurality of images. 2. The apparatus according to claim 1, further comprising a continuous shooting determination unit that determines whether to perform continuous shooting by the continuous shooting unit based on the camera shake information detected by the camera shake detection unit. Item 2. The image processing device according to Item 1. 3. The apparatus according to claim 1, further comprising a camera shake information control unit that controls the camera shake information to be detected and processed in correspondence with the plurality of images shot by the continuous shooting unit. 2. The image processing device according to 1. 4. An image to be corrected by the camera shake correction unit,
The image processing apparatus according to any one of claims 1 to 3, wherein the image is a first image captured among the plurality of images captured by the continuous shooting unit. 5. The image stabilization unit according to claim 1, wherein the image stabilization unit corrects the image stabilization of the image to be corrected using information on an image determined to have a minimum image stabilization among the plurality of images. Item 4. The image processing device according to any one of Items 3. 6. A computer-readable recording medium storing a program including an instruction for causing a computer to execute a process of correcting a camera shake of an image captured by an imaging device, wherein the process of correcting the camera shake includes: A continuous shooting step of continuously photographing a subject at a predetermined time interval to obtain a plurality of images, and a camera shake detection step of detecting camera shake information regarding camera shake of the imaging apparatus according to the timing of the continuous shooting, Based on the camera shake information corresponding to each image detected in the camera shake detection step and the plurality of images obtained in the continuous shooting step, at least one image of the plurality of images is A camera shake correction step of correcting a camera shake portion of the recording medium.