JP4323969B2 - Imaging device - Google Patents

Description

  The present invention relates to a photographing apparatus that improves the accuracy of a photographed image by correcting camera shake.

  With the current camera, all the important tasks for shooting such as determining exposure and focusing are automated, and it is very unlikely that people who are unskilled in camera operation will fail to shoot.

  Recently, a system for preventing camera shake applied to the camera has been studied, and there are almost no factors that cause a photographer to make a shooting mistake.

  Here, a vibration-proof system that prevents camera shake will be briefly described.

  The camera shake at the time of shooting is usually a vibration of 1 Hz to 10 Hz as a frequency. However, as a basic idea for making it possible to take a photograph without image shake even if such a camera shake occurs at the time of exposure, Camera vibrations due to camera shake are detected, and the correction lens must be displaced within the plane orthogonal to the optical axis in accordance with the detection result (optical image stabilization system).

  That is, in order to take a picture that does not cause image shake even if camera shake occurs, it is necessary to first detect the camera vibration accurately and secondly correct the optical axis change due to camera shake.

  In principle, correction of image blur is performed by detecting acceleration, angular acceleration, angular velocity, angular displacement, and the like with a laser gyro etc., and mounting a vibration detection unit on the camera that appropriately calculates the detection result. be able to. Then, image blur correction is performed by driving a correction optical device that decenters the photographing optical axis based on camera shake detection information from the vibration detection unit.

On the other hand, shooting is repeated a plurality of times with an exposure time that does not cause camera shake, and a shot image (composite image) with a long exposure time is obtained by combining the images obtained by these shooting while correcting image misalignment. There is a method (for example, Patent Document 1).
Japanese Patent No. 3110797

  Recent digital cameras have become smaller than silver-salt compact cameras, and in particular, cameras having a VGA class image sensor have become smaller as they are built into portable electronic devices (for example, mobile phones).

  Under such circumstances, if the above-described optical image stabilization system is to be mounted on a camera, it is necessary to further downsize the shake correction optical device or downsize the vibration detection unit.

  However, in the shake correction optical device, there is a limit to downsizing because it is necessary to support the correction lens and drive it with high accuracy. Further, since most of the vibration detection units currently used utilize inertial force, there is a problem that when the vibration detection unit is downsized, the detection sensitivity is lowered and the shake correction cannot be performed with high accuracy.

  Furthermore, the shake applied to the camera includes an angular shake centered on a predetermined axis and a shift shake that shakes the camera in parallel, and the angular shake can be corrected by the optical image stabilization system, but it is difficult to take measures against the shift shake. . In particular, the shift shake tends to increase as the camera becomes smaller.

  On the other hand, as another anti-vibration system, the motion vector of the screen is detected by an image sensor as used for video recording with a video camera, and the image readout position is changed according to the motion vector. There is also a way to get a video without.

  In the case of such a method, there is an advantage that the entire product can be reduced in size because a dedicated vibration detection unit and correction lens such as the above-described optical image stabilization system are not required.

  However, this video camera anti-vibration system cannot be easily applied to digital cameras. The reason for this will be described below.

  The motion vector extraction in the video camera is performed every time the image is read. For example, if 15 frames are extracted per second, the extracted vectors are compared with each other to detect the motion vector.

  However, when a still image is shot with a digital camera, only one exposure is performed on the shooting subject. Therefore, it is impossible to detect a motion vector by comparing images as in a video camera.

  For this reason, it is not possible to simply adapt a video camera image stabilization system to a digital camera.

  On the other hand, in the image stabilization method as shown in Patent Document 1, since the photographing is repeated a plurality of times, the photographing time becomes long. For this reason, if this method is used unnecessarily, there may be an increase in failure photos such as subject blurring.

  Furthermore, in order to improve the exposure of a dark subject, it is necessary to acquire more images and combine them. This increases not only the calculation load but also the capacity for storing a plurality of images. There was a problem that would become.

In order to solve the above problems, the present invention uses a blur correction means for correcting an image blur generated when capturing an image, a first image taken by using the illumination means, and said illuminating means A shooting control means for obtaining a second image that is exposed with an exposure time longer than that of the first image and in which blurring that occurs during exposure is corrected by the blur correction means , the second image, and the first image The image capturing apparatus includes a composite exposure correction unit that corrects exposure by combining the images.

Further, the present invention provides a photographing control for acquiring a first image photographed using an illuminating means and a second image exposed with an exposure time longer than the first image without using the illuminating means. Means, recording means for recording the first image and the second image, and combining the second image and the first image after correcting blurring of the image occurring in the second image Thus, the photographing apparatus includes the output unit that outputs the first image and the second image to a device having application software for correcting exposure .

According to the present invention , it is possible to prevent deterioration of an image due to light emission of the illumination unit when attempting to correct the image blur.

  The best mode for carrying out the present invention is as described in Examples 1 to 6 described later.

  FIG. 1 is a diagram illustrating a configuration of a camera (imaging apparatus) that is Embodiment 1 of the present invention. A light beam (photographing light) incident from the photographing lens 11 is imaged on the imaging means 19 through the shutter 12a after the light amount is limited by the diaphragm 13a. The imaging means 19 is composed of a semiconductor imaging device such as a MOS or CCD.

  The taking lens 11 is composed of a plurality of optical lens groups, and some or all of these lens groups receive a driving force from the AF drive motor 14a and move on the optical axis 10 to reach a predetermined in-focus position. The focus is adjusted by stopping. The AF drive motor 14a operates by receiving a drive signal from the focus drive means 14b.

  In addition, some optical lens groups of the photographic lens 11 receive a driving force from the zoom drive motor 15a, move on the optical axis 10, and change to the photographic angle of view by stopping at a predetermined zoom position. . The zoom drive motor 15a operates by receiving a drive signal from the zoom drive means 15b.

  The diaphragm 13a has a plurality of diaphragm blades, and these diaphragm blades are actuated by receiving a driving force from the diaphragm driving means 13b to change an opening area (diaphragm aperture) serving as a light passage port. The shutter 12a has a plurality of shutter blades, and these shutter blades open and close an opening serving as a light passage port by receiving a driving force from the shutter driving means 12a. Thereby, the light beam incident on the imaging means 19 is controlled.

  Further, the strobe 16a operates (emits light) in response to a driving signal from the flash driving means 16b in accordance with conditions at the time of photographing (subject brightness, etc.).

  Further, in order to inform the photographer of the photographing operation, the speaker 17a operates (sounds) upon receiving a driving signal from the sounding driving means 17b.

  The operations of the focus drive unit 14b, zoom drive unit 15b, aperture drive unit 13b, shutter drive unit 12b, flash drive unit 16b, and sound generation drive unit 17b are controlled by the imaging control unit 18.

  The photographing control means 18 is adapted to receive operation signals from a release operation means 12c, an aperture operation means 13c, a zoom operation means 15c, a flash operation means 16c, and an anti-vibration operation means 121 to be described later. According to the state, the operation signals are given to the focus driving unit 14b, the zoom driving unit 15b, the aperture driving unit 13b, the shutter driving unit 12b, and the flash driving unit 16b, respectively, and shooting conditions are set to perform shooting.

  The aperture diameter of the aperture 13a and the light emission of the strobe 16a are normally set automatically on the camera side at the time of shooting. Therefore, the aperture operating means 13c and the flash operating means 16c are unnecessary, but the photographer can arbitrarily take a picture. It is provided for setting conditions.

  The imaging control unit 18 measures subject luminance (photometry) based on an image signal captured by the signal processing unit 111 described later, and based on the photometric result, the aperture diameter of the aperture 13a and the closing timing (exposure) of the shutter 12a. Time). Further, the photographing control unit 18 obtains the in-focus position of the photographing lens 11 based on the output from the signal processing unit 111 while driving the focus driving unit 14b.

  The video signal output from the imaging unit 19 is converted into a digital signal by the A / D conversion unit 110 and input to the signal processing unit 111. The signal processing unit 111 performs signal processing such as forming a luminance signal and a color signal on the input signal to form a color video signal.

  The video signal signal-processed by the signal processing unit 111 is input to the image correction unit 118 via the signal switching unit 112. The image correction unit 118 performs gamma correction and compression processing on the input signal. The signal of the image correction unit 118 is input to the display unit 120 and the recording unit 119, and the captured image is displayed on the display unit 120 and recorded on the recording unit 119.

In the operation described above, the following two types of anti-vibration systems of this embodiment are prepared.
1. Images are taken with appropriate exposure, and image blurring is corrected by image processing.
2. A plurality of continuous shots are taken with an exposure time that is shorter than appropriate and is less likely to cause camera shake, and an appropriate exposure is obtained by combining and blurring between the images.

  Here, the reason why two types of vibration isolation systems are prepared will be described.

  The image stabilization system 1 detects the amount and direction of camera shake based on the locus of a point image in the image, and restores the image by performing image calculation processing using a correction function having an inverse characteristic relationship with the amount and direction. Is the method.

  The basic principle has been proposed for a long time. For example, as disclosed in Japanese Patent Application Laid-Open No. Sho 62-127926, the amount of blur is recognized from a photographed image, and the direction of the blur is linearly approximated. Restore the blur-free image with the inverse function.

  However, the problem with this method is that it cannot be corrected well when the blurring is large or when alternating blurring (in a complicated blurring direction) occurs during exposure.

  In addition, when a secondary light source such as a strobe is used in combination, a blur region and a blur-suppressed region coexist in the image, so that the blur cannot be corrected.

  The latter will be supplementarily described with reference to FIG.

  The image in FIG. 2A is an image in which the main subject is irradiated with the strobe 16a and the exposure time of the background is improved by slow sync shooting to increase the shooting time.

Here, the main subject 124 is appropriately exposed by adjusting the exposure (FA) of the strobe 16a, and the exposure time can be optimized because the photographing time is extended with respect to the background.
However, since the photographing time is long, image degradation due to camera shake occurs. This image deterioration becomes a deteriorated image different from the background because the main subject 124 is exposed for the irradiation time of the strobe 16a.

  Here, it is considered that the amount and direction of blur are obtained based on the locus of the background point image (here, the edge of the window of the building), and the image is corrected accordingly.

  As shown in FIG. 2B, the corrected image can correct the blur with respect to the background. However, since the main subject 124 is not shaken during the strobe emission time that is originally strongly exposed, when the image is corrected, the deterioration of the image is increased.

  Of course, the above problem does not occur if the area irradiated with the strobe 16a is separated from the area not irradiated and the strobe irradiation area is not corrected for blurring. However, processing the image separately for each area is a computational burden. Is large and the corrected image becomes unnatural. For this purpose, an image stabilization system for aligning and synthesizing a plurality of images is also used.

The proper use of the two types of anti-vibration systems of this embodiment will be briefly described below.
1. When shooting with the flash 16a, two images are acquired.
2. In the case of the first image, the strobe 16a is caused to emit light and the image is taken with a short exposure time that does not cause camera shake (FIG. 3A). As a result, a proper exposure can be obtained for the main subject in the irradiation range of the strobe 16a by adjusting the amount of light of the strobe 16a, but the background that the strobe 16a does not reach is underexposed.
3. The second image is photographed at a photographing time (exactly, a time obtained by subtracting the photographing time of the first image) at which proper exposure is performed without using a strobe (FIG. 3B).
4). The blur-free image is restored by extracting the blur trajectory from the information in the second image and correcting the blur.
5. The positions of the first image and the second image are adjusted so that the respective feature points are aligned, and the blur between the two images is corrected and synthesized (FIG. 3C).

  As described above, when the blur is large or when the blur during the exposure is alternating, the blur cannot be corrected satisfactorily.

  For this reason, the camera does not correct the shake depending on the characteristics of the shake, and the shooting is performed in a short shooting time that does not cause a camera shake.

There are also several ways here,
Shooting with the gain of the image pickup means 19 increased. After the shooting, the gain of the image is increased. A plurality of images are aligned and combined and exposure compensation is appropriately selected. Obtainable.

  Returning to FIG. 1, if the photographic subject is dark and the exposure time is long, there is a risk of camera shake, so the photographer operates the image stabilization operation means 121 to turn on the image stabilization system.

  First, when the photographer presses the release button of the release operation means 12c halfway, a shooting preparation operation (focus adjustment operation, photometry operation, etc.) is started. The closing timing (exposure time) of the shutter 12a and the aperture diameter of the aperture 13a are set on the basis of the photometric value obtained by the photometric operation. Generally, the subject is dark under shooting conditions using an image stabilization system. Is fully open and the exposure time is long exposure.

  Here, the output of the vibration detection means 122 is input to the imaging control means 18.

  Since the vibration detecting means 122 only needs to detect the approximate size and frequency of hand shake, it may be a small and inexpensive acceleration sensor such as a piezoelectric or electrostatic semiconductor accelerometer.

  Based on the signal from the vibration detection unit 122 prior to shooting, the shooting control unit 18 has a large camera shake (for example, 10 mG) or a high main frequency of camera shake (for example, when the exposure time is ¼ second). When the frequency is 8 Hz and the exposure time is 1/2 second, it is determined that blur correction cannot be performed satisfactorily.

  In this case, the display unit 120 displays that there is a possibility that the blur correction cannot be performed well.

  Further, the display means 120 asks the photographer how to process the subsequent photographing.

  In other words, the user is presented with a selection of whether to shoot with the exposure time even in a state where blur correction cannot be performed, to shoot with a shorter exposure time, or to align and combine multiple images with shorter exposure times.

  The photographer selects his / her preference and continues shooting.

  If the user chooses to shoot with the exposure time as it is even if the blur cannot be corrected, the photographer prevents the camera shake by pressing the camera against a fixed object.

  In addition, when shooting with a shorter shooting time is selected, the camera automatically performs processing such as increasing the gain of the imaging means 19 at the time of shooting so as to optimize exposure.

  A case where a plurality of images having a short exposure time are combined will be described below.

  As described above, the exposure time is divided into a plurality of short exposure times based on the photometric value obtained by the photographing preparation operation (focus adjustment operation, photometry operation, etc.), and the photographing is set to be repeated by the divided number. When the exposure time is divided in such a short time, each image obtained by exposure is underexposed, but these images are less influenced by camera shake. Then, the exposure is improved by combining a plurality of images after completion of photographing to form a single image.

  However, when shooting multiple images, there may be a slight shift in the composition between the images due to camera shake during continuous shooting, even if there is no effect of camera shake in each image obtained by multiple shooting. is there. Here, if these images are combined as they are, the combined images become images in which the composition of each image is shifted by a shift amount.

  In this embodiment, a plurality of image signals output from the imaging unit 19 for each shooting in response to continuous shooting are converted into digital signals by the A / D conversion unit 110 and then subjected to signal processing by the signal processing unit 111. The

  On the other hand, since the image stabilization system is turned on by operating the image stabilization operation means 121 and the exposure compensation by combining a plurality of images is selected, the image data from the signal processing means 111 is sent to the signal switching means 112. To the image storage unit 114 (not input to the shake correction unit 113). The image storage unit 114 stores all of a plurality of captured images.

  The deviation detection unit 115 extracts a feature point in the image stored in the image storage unit 114, and determines a position coordinate of the feature point in the shooting screen.

  For example, as shown in FIG. 4, consider a case where a photograph is taken in which a person 124a stands on the background of a building 126a in a frame 125a. At this time, when a plurality of images are photographed, an image having a composition shifted from the frame 125a due to camera shake may be photographed as in the frame 125b.

  The shift detection means 115 takes out the edge 128a of the window 127a, which is a point with high brightness, from the building 126a located around the screen as a feature point by edge detection, and compares this feature point 128a with the feature point 128b in the frame 125b. Then, this difference is corrected (coordinate conversion).

  In FIG. 4, the frame 125b is coordinate-transformed such that the feature point 128b of the frame 125b overlaps the feature point 128a of the frame 125a as indicated by an arrow 129.

  Here, the reason why the periphery of the shooting screen is selected as the feature point will be described below.

  In many cases, the main subject is located near the center of the screen, and the main subject is often a person. In such a case, when the main subject is selected as a feature point, inconvenience due to subject shake occurs.

  In other words, not only the camera shake of the photographer but also the subject shake are superimposed when a plurality of shots are being taken, so that the coordinate conversion of the image is performed based on the subject shake.

  In this case, coordinate conversion is performed so that the composition of the main subject is appropriate, so it seems that a preferable image can be formed.However, generally, the movement of a person is complicated, and the accuracy of detection of deviation is large depending on the location where the feature points are selected. It depends.

  For example, if the eye of the main subject (person) is selected as a feature point, there will be an effect of blinking. If the tip of the hand is selected as a feature point, the hand will move easily. It will be different.

  Thus, even if coordinate conversion of an image is performed using one point of a person as a feature point, not all of the person is appropriately coordinate-converted. Even when a plurality of images are coordinate-converted and combined, The position of coordinates varies from image to image, and a preferable image cannot be obtained.

  Therefore, as in the present embodiment, it is possible to obtain a preferable image by selecting a still subject such as the background as a feature point and performing coordinate conversion of the image. In this case, the above-described subject shake affects.

  Therefore, in this embodiment, the light of the strobe 16a is irradiated on the subject only on one of the shooting frames divided into a plurality of times.

  Here, an image captured using the flash 16a is defined as an ST image, and a plurality of images captured without using the flash 16a are defined as an NST image group.

  At this time, there are the following differences between the ST image and the NST image group in addition to the above-described composition deviation.

  That is, the brightness of the subject area where the flash reached in the ST image is different from the brightness of the same area in each image of the NST image group.

  In the ST image, a sufficient exposure is obtained for a flashed subject, and a background that does not reach is insufficiently exposed. This is because, generally, a main subject such as a person is located near the camera, so that a flashlight arrives, and since the background is far from the camera, the flashlight does not reach.

  The background with insufficient exposure is compensated by combining the NST image group while correcting the composition deviation.

  FIG. 5 shows a method for selecting a feature point extraction region by the shift detection means 115. When the ST image 130 using the strobe 16a is compared with the NST image group (one image 131 is shown as an example) that does not use the strobe 16a, the strobe light reaches the ST image 130 and the NST image 131 shows the person 124a. The person is dark because there is no flashlight.

  On the other hand, in the background where the strobe light does not reach, the change in the brightness of the feature point 128a of the building does not change between the ST image 130 and the NST image 131.

  In this way, the background area where there is no change in brightness is not exposed because the strobe light does not reach, so this area is considered as the point of image composition, and this part is used as the feature point extraction area to correct composition deviations. To do.

  In FIG. 5, in the building 126a around the screen where there is no change in brightness in the ST image 130 and the NST image 131 as described above, the edge 128a of the window, which is a high luminance point, is extracted as a feature point by edge detection. .

  Then, the feature point 128a in the ST image 130 and the feature point 128b in the NST image 131 are compared as described with reference to FIG. 4, and the difference is corrected (coordinate conversion). That is, the coordinate conversion means 116 performs coordinate conversion of the NST image 131 so that the feature point 128b of the NST image 131 is superimposed on the feature point 128a of the ST image 130.

  Then, the coordinates of the feature point 128b are also obtained for each of the second and subsequent images 131 in the NST image group, and the coordinate conversion means 116 each sets the coordinates so as to overlap the coordinates of the feature point 128a determined in the ST image 130. The coordinates of the image (second image group) are converted.

  Here, for the purpose of explanation, the feature point coordinates for each image are obtained, but in practice, the correlation between the ST image 130 and the first image 131 of the NST image group is calculated, and the change of the corresponding pixel is calculated. The deviation detecting means 115 obtains the motion vector as a change of the feature point.

  Then, the change of the feature point is obtained for the second sheet of the NST image group by the correlation calculation with the image 130, and the change of the feature point of each image is obtained in the same manner.

  It should be noted that instead of selecting only one feature point, a plurality of points may be selected and the average value of the motion vectors of these points or the minimum value of the scalar may be used as the change of the feature point.

  Here, the reason why the minimum value is used as the change of the feature point is to select the feature point that does not move the most because the feature point selected around the screen may also move.

  Each image coordinate-transformed by the coordinate transformation means 116 is output to the image synthesis means 117, and each image is synthesized into one image.

  As described above, the ST image 130 using the strobe 16a is used as a reference (center), and each image 131 of the NST image group is coordinate-transformed so as to overlap the image.

  Here, the reason based on the ST image 130 will be described.

  When two photographs with different compositions are combined as shown in FIG. 4, a region 132 where the two images do not overlap is generated as shown in FIG. Therefore, the image composition unit 117 cuts the region 132 and performs diffusion complement processing only on the region where the two images overlap to obtain the original frame size.

  For this reason, the periphery of the screen of each image 131 in the NST image group is cut according to the direction and size of the composition deviation.

  Among the ST image 130 and each image 131 of the NST image group, the ST image 130 using the strobe 16a has the best image information.

  Therefore, in order not to cut the periphery of the ST image 130, it is preferable to superimpose the images 131 of the NST image group on the basis of the ST image 130 as a reference.

  In the case of a digital image, it is possible to correct the exposure by increasing the gain even for a single underexposed photo. However, if the gain is increased, the image becomes unsightly due to increased noise.

  However, when the gain of the entire image is increased by synthesizing many images as in the present embodiment, since the noise of each image is averaged, an image with a large S / N ratio can be obtained. As a result, noise can be suppressed and exposure can be optimized.

  If another way of thinking is taken, for example, it may be said that random noise included in the image is reduced by allowing a plurality of images to be taken with high sensitivity of the imaging means 19 while allowing noise, and averaging these.

  The synthesized image data is input to the image correction unit 118, subjected to gamma correction and compression processing, and then displayed as a captured image on the display unit 120 and recorded in the recording unit 119.

  FIG. 7 is a flowchart summarizing the shooting operation of the camera of this embodiment, and this flow starts when the camera is turned on.

  In step # 1001, the photographer waits until the switch sw1 is turned on by half-pressing the release button. When the switch sw1 is turned on, the process proceeds to step # 1002.

  In step # 1002, the imaging means 19 performs imaging. The photographing control unit 18 drives the AF driving motor 14a to move the photographing lens 11 in the optical axis direction while detecting the contrast of the image based on the output from the signal processing unit 111.

  Then, when the contrast is highest, driving of the photographing lens 11 is stopped to bring the photographing optical system into a focused state (AF by hill-climbing method). Note that focus adjustment can also be performed by phase difference detection.

  Further, the imaging control means 18 obtains the brightness of the object scene based on the output of the imaging means 19 at the same time.

  Here, as the object scene, the main subject of the screen and its periphery are separately measured, and the optimum exposure value for the entire screen is calculated from the photometric results.

    In step # 1002, the captured image is displayed on an external liquid crystal monitor of the camera (display means 120).

  In step # 1003, it is determined whether or not the photographer has turned on the image stabilization operation means 121. When the photographer is on, the process proceeds to step # 1004. When the photographer is off, the process proceeds to step # 1040.

  First, the flow performed when the image stabilization operation means 121 is turned on will be described.

  In step # 1004, the output of the vibration detection means 122 such as an acceleration sensor mounted on the camera is observed. If the output is abnormal, that is, the output of the acceleration sensor is larger than a predetermined value (for example, 10 mG or more), and the camera shake is If the frequency is large or the main frequency of camera shake is high (for example, 8 Hz when the exposure time determined by photometry in step 1002 is 1/4 second and 4 Hz or more when the exposure time is 1/2 second), the blur correction is good. Since it cannot be performed, the image stabilization by blur correction is not performed, and another image stabilization method is selected (proceed to step # 1025).

  If the output of the vibration detecting means 122 is within a predetermined range (when the shake is not so great and the frequency is low compared to the exposure time), the process proceeds to step # 1005.

  In step # 1005, it is determined whether or not the shooting setting using the strobe 16a is used. If the strobe 16a is not used, the process proceeds to step # 1006. If the shooting setting uses the strobe 16a, the process proceeds to step # 1015.

  This is because, as described with reference to FIG. 2, if an image obtained by photographing using the strobe 16a is corrected as it is, image degradation occurs in an area irradiated with the strobe 16a.

  First, a case where the strobe 16a is not used will be described.

In step # 1006, the process waits by circulating from step # 1001 to step # 1005 until the release button is pressed down and shooting is instructed (switch sw2 is turned on).
In step # 1007, shooting is started.
At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1008, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1009, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  In step # 1010, blur correction of the captured image stored in the image storage unit 114 is performed.

  As described above, this is a step of obtaining a blur locus from a bright spot of an image and approximating it to a simple formula, and a step of restoring a blur-free image by giving an inverse function of the approximate formula to the entire image. The image blurring is corrected by passing the step # 1010. The corrected image is again overwritten and stored in the image storage unit 114.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from a camera such as a semiconductor memory.

  In step # 1014, the process returns to the start. If the release button is half-pressed (switch sw1 is turned on) at step # 1014, the flow proceeds again to steps # 1001, # 1002, # 1003, and # 1004. Eventually, when the release button is fully depressed (switch sw2 is turned on) at step # 1014, the process does not return to the start and waits at step # 1014.

  Next, the case of shooting setting using the strobe 16a in step # 1005 will be described. In that case, the flow proceeds from step # 1005 to step # 1015.

In step # 1015, the process waits while circulating from step # 1001 to step # 1015 until the release button is pressed down and the photographing instruction is issued (switch sw2 is turned on).
In step # 1016, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1017, the first image using the strobe is taken. The exposure time at this time is set to an exposure time shorter than the camera shake limit determined by the focal length of the camera so that the obtained image is not affected by camera shake. For this reason, generally, the background other than the main subject properly irradiated with the strobe 16a (a region where the strobe 16a is not sufficiently irradiated) is underexposed.

  In step # 1017, the process waits until the photographing is completed, and once the photographing is completed, the photographed image is temporarily stored in the image storage unit 114.

  In step # 1018, a second image without using a strobe is taken. The exposure time at this time is set so that the exposure of the area such as the background that has been underexposed in the first image is appropriate (the exposure time that complements the exposure in the first image is set). . For this reason, exposure is generally performed for a long time, and the background exposure is improved, but an image with noticeable camera shake is obtained.

  In step # 1018, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1019, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  Thus, since the end of shooting is displayed after the second image is shot, the photographer does not notice that two images have been shot continuously, and can take shots at the same interval as normal shooting.

  In Step # 1020, only the second image stored in the image storage unit 114 is corrected.

  As described above, this is a step of obtaining a blur locus from a bright spot of an image and approximating it to a simple expression, and a step of restoring an image without blurring by giving an inverse function of the approximate expression to the entire image. The image blurring is corrected by passing the step # 1020. The corrected second image is again overwritten and stored in the image storage unit 114.

  The reason for not correcting the blur of the first image is that the exposure time is short and there is no influence of camera shake.

  In step # 1021, the deviation detection means 115 extracts a characteristic image (for example, the window edge 128a in FIG. 4) from the peripheral region of the image (for example, the building 126a in FIG. 4), and obtains the coordinates of the image.

  In step # 1022, the coordinate conversion means 116 performs the coordinate conversion of the second image on the first image.

  Here, the coordinate conversion of the second image is performed so as to eliminate the shift of the coordinates of the corresponding feature point (128b) of the second image after blur correction with respect to the feature point (for example, the edge 128a) of the first image. Do.

  In step # 1023, the images are combined. Here, image synthesis is performed by averaging the corresponding coordinate signals of the first and second images, and random noise in the image is reduced by averaging. The gain of the image with reduced noise is increased to optimize the exposure.

  In step # 1024, an area where the images do not overlap due to compositional deviations, such as the edge of the synthesized image, is cut, and the image is diffusion-supplemented so as to have the original frame size.

  Thereafter, the process proceeds to step # 1011. In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from a camera such as a semiconductor memory.

  In step # 1014, the process returns to the start.

  Next, in step # 1004, if the output of the vibration detecting means 122 is not in the normal state (the amount of camera shake is large or the camera shake frequency is high with respect to the exposure time), there is a possibility that good blur correction cannot be performed. Proceeding to step # 1025, the user is prompted to select another vibration isolation system.

  In step # 1025, whether or not to use a composite IS mode (composite image stabilization mode) that improves exposure by combining a plurality of images having exposure times that do not cause camera shake while correcting the deviation between consecutive shots is taken. (The display unit 120 displays whether blur correction does not function and whether to select the composite IS mode).

  If the composite IS mode is not selected, the process proceeds to step # 1034. If the composite IS mode is selected, the process proceeds to step # 1026.

  First, the case where the composite IS mode is selected will be described.

  In step # 1026, the number of images to be photographed and the respective exposure times are obtained from the photographing conditions such as the brightness of the subject obtained in step # 1002.

The shooting conditions here are: • Brightness of the subject • Focal length of the shooting optical system • Brightness of the shooting optical system (aperture value)
4 points of sensitivity of the imaging means 19

  For example, assume that the sensitivity of the imaging means 19 is set to ISO200. In this case, it is assumed that the brightness of the subject is photometrically measured and the aperture 13a is fully opened (for example, f2.8) and the shutter 12a requires an exposure time 1/8 in order to properly expose it.

  In this case, when the shooting focal length is 30 mm in terms of 35 mm film, there is a risk of camera shake in 1/8 shooting, so the exposure time is set to 1/32 so that there is no risk of camera shake, and four shots are taken. Set.

  When the shooting focal length is 300 mm, the exposure time is set to 1/320, which does not cause camera shake, and the shooting is set to be performed 40 times.

  In this way, the exposure time for shooting a plurality of images is determined according to the shooting conditions, and how many more images are to be shot is set according to the shooting conditions.

  Even when the same subject is photographed in a plurality of pieces, accurate information can be captured by the image capturing means 19 when the exposure condition for each photographing is as close to the appropriate exposure as possible.

  For this reason, in the case of a dark subject, when the photographing lens is narrowed down, or when the sensitivity of the image pickup means 19 is set low, it is effective to make the exposure time of each photographing as long as possible even for multiple photographing. Use exposure conditions. However, if the exposure time is too long, the influence of deterioration due to camera shake appears on the image plane. Therefore, as described above, when the shooting focal length is 30 mm in terms of 35 mm film, it is about one focal length at which there is no fear of camera shake. A certain exposure time 1/32 is set. The amount of exposure time is insufficient with the number of shots.

  When the focal length is long, if the exposure time is not further shortened, image deterioration occurs due to camera shake. Therefore, the exposure time is further shortened, and the number of shots is increased accordingly to perform exposure complementation.

  As described above, the exposure time in the multiple-photographing becomes longer as the photographing subject becomes darker and the photographing lens becomes darker, becomes longer as the sensitivity of the image sensor becomes lower, and becomes shorter as the focal length of the lens becomes longer.

  The number of shots in the multiple-shot shooting increases as the shooting subject becomes darker and the shooting lens darkens, increases as the sensitivity of the image pickup means 19 decreases, and increases as the focal length of the lens increases.

  After the above calculation is completed, the camera viewfinder, external LCD monitor, etc. (display unit 120) display that the image stabilization mode (multiple shooting mode) has been set, and at the same time, display the number of shots taken and shoot Inform the person.

  In step # 1027, the process waits by circulating from step # 1001 to step # 1027 until the release button is fully pressed and a shooting instruction is issued (switch sw2 is turned on).

  In step # 1028, the first image is taken.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  Steps # 1028 to # 1024 are operations in the composite shooting mode in which shooting with a short exposure time is repeated a plurality of times and combined to make the apparent exposure appropriate.

Here, as described in this step, the first shooting is performed by flashing the strobe 16a to obtain the ST image. (Of course, the flash 16a is not fired when it is not set for flash photography.)
In step # 1029, steps # 1028 and # 1029 are circulated and waited until all shooting is completed, and the image that has been shot is temporarily stored in the image storage means 114.

  When shooting is repeated in this circulation, the second and subsequent shots are taken without using the strobe 16a in order to obtain an NST image group. When shooting is completed, the process proceeds to step # 1030.

  In step # 1030, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  Even in the case of shooting a plurality of images, the sound representing the operation is one set (one time from the start of the exposure of the first shooting to the completion of the exposure of the last shooting), which makes the photographer feel uncomfortable with the shooting of the plurality of images. There is no.

  In step # 1031, the deviation detection means 115 extracts a characteristic image from the peripheral area of the image (for example, the edge 128a of the window 126a of the building 126a in FIG. 4), and obtains the coordinates of the image.

  This is because the images of the ST image and the NST image group are respectively compared, and the areas other than the areas with different brightness (that is, the areas where the flash of the strobe 16a sufficiently irradiates the subject) (that is, the flash of the strobe 16a sufficiently irradiates the subject) The feature points are extracted from the (not-contained area) and their coordinates are obtained.

  In step # 1032, the coordinate conversion means 116 performs coordinate conversion of each image, but only the first image (ST image using the strobe 16a) does not perform coordinate conversion (this image is used as a reference position for coordinate conversion). To do).

  In step # 1033, steps # 1031 and # 1032 are circulated and waited until coordinate conversion of all images is completed. When coordinate conversion of all images is completed, the flow proceeds to step # 1023.

  In step # 1023, the images are combined. Here, image synthesis is performed by averaging the signals of the coordinates corresponding to each image, and random noise in the image is reduced by averaging. The gain of the image with reduced noise is increased to optimize the exposure.

  In step # 1024, an area where the images do not overlap due to compositional deviation, such as the end of the synthesized image, is cut, and the image is diffusion-supplemented so as to have the original frame size.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  In step # 1014, the process returns to the start.

  Next, a case where the photographer does not select the composite IS mode in step # 1025 will be described. If the photographer does not select the composite IS mode in step # 1025, the process proceeds to step # 1034.

  Step # 1034 also provides two options.

  The first is a method in which the exposure time is shortened in order to suppress the influence of camera shake, and the gain of the imaging means 19 is increased by that amount to complement the exposure.

  The second is a method of continuing shooting with the gain and exposure time of the imaging means 19 as it is regardless of the influence of camera shake.

  In the first method, the influence of camera shake is reduced, but the noise is increased as the gain of the imaging means 19 is increased.

  In the second method, noise does not increase, but the exposure time is not short, so the influence of camera shake is likely to occur, and the photographer needs to shoot with the camera pressed against a fixed object such as a wall or handrail. . Since both have advantages and disadvantages, the photographer can select according to the shooting situation.

  First, a case where a setting with a short exposure time (first method) is selected will be described. In this case, in step # 1035, the exposure time is shortened. This exposure time is set to a camera shake limit determined by the focal length of the camera (generally referred to as a fraction of the focal length), and the imaging gain of the imaging means 19 is increased in order to compensate for the insufficient exposure.

  When the proper exposure cannot be obtained only by increasing the gain of the imaging means 19, the warning is given to the display means 120 so as to select the composite IS mode.

  In step # 1036, the process waits while circulating from step # 1001 to step # 1036 until the release button is fully pressed and a shooting instruction is issued (switch sw2 is turned on).

  In step # 1037, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1038, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1039, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  In step # 1014, the process returns to the start.

Next, a case where the exposure time is not set short (second method) will be described. In this case, the flow proceeds from step # 1034 to step # 1036. Since step # 1035 is skipped, there is no operation for setting the exposure time short and increasing the gain of the imaging means 19.
However, if the exposure time is set to be considerably longer than the camera shake limit determined by the focal length of the camera (generally referred to as a fraction of the focal length), a warning is given to the display means 120 to select the composite IS mode. Do.

In step # 1036, the process waits while circulating from step # 1001 to step # 1036 until the release button is fully pressed and a shooting instruction is issued (switch sw2 is turned on).
In step # 1037, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1038, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1039, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  In step # 1014, the process returns to the start.

  Next, the case where the image stabilization operation means 121 is off at step # 1003 will be described. At this time, the flow flows from step # 1003 to step # 1040.

  In step # 1040, it is determined whether or not the image capturing condition is such that image deterioration due to camera shake occurs unless the image stabilization system is used.

  As described above, the shooting conditions are the brightness of the subject, the brightness of the lens, the imaging sensitivity, and the shooting focal length. The exposure time is obtained based on the brightness of the subject, the brightness of the lens, and the imaging sensitivity. In step # 1040, it is determined whether there is a possibility of image degradation due to camera shake at the current photographing focal length.

  If there is a possibility of image degradation, the process proceeds to step # 1041, and if not, the process proceeds to step # 1042.

  In step # 1041, a display that recommends setting to the image stabilization mode is performed on the camera finder or the liquid crystal display (display unit 120).

  In step # 1042, the shutter release button is pressed all the way down until the shooting instruction is issued (switch sw2 is turned on), and the process waits while circulating from step # 1001 to step # 1042.

  In step # 1043, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1044, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1045, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  In step # 1014, the process returns to the start.

As described above, while the image stabilization system suppresses image degradation by correcting the blur as described above, the camera condition is controlled by other means in the shooting conditions where the blur correction cannot be performed satisfactorily. When measures are bulleted, they are as follows.
1. When the amount of blur is not so large and the frequency is low, and the shooting conditions do not use the strobe 16a.
→ Correct the blurring of the shot image.
2. When the amount of blur is not so large and the frequency is low, and the shooting conditions use the strobe 16a.
→ Sequentially captures an image with a short strobe (first image) and an image without a strobe (second image) with a long exposure time, and after correcting the blur of the second image, aligns the coordinates with the first image. (Matching gaps between consecutive shots)
3. When the amount of blur is large or the frequency is high, and when the synthetic IS mode is selected.
→ A single scene is divided into multiple images with a short exposure time, and the shots are combined, and their coordinates are aligned (alignment between consecutive shots). When using the flash, only the first flash is fired.
4). When the amount of blurring is large or the frequency is high, and the shooting with a short exposure time is selected without selecting the composite IS mode.
→ Set the exposure time short and increase the gain of the imaging means to complement the exposure.
5. When the amount of blur is large or the frequency is high, and when the composite IS mode is not selected and photographing with an appropriate exposure time is selected, or when the image stabilization operation means is off.
→ Normal shooting.

  As described above, since countermeasures against camera shake are set in multiple layers, image deterioration due to blurring hardly occurs and a load such as a memory capacity can be reduced.

  The first image captured by emitting the flash means (strobe 16a) in this manner and the second image not emitted by the flash means (strobe 16a) captured with a longer exposure time than the first image are sequentially provided. The image capturing control means 18 (steps # 1016 to # 1019 in FIG. 7) to be acquired, the shake correcting means 113 (step # 1020 in FIG. 7) for correcting the shake occurring in the second image, and the shake correcting means 113 are used to correct the shake. The combined exposure that corrects the exposure by aligning the shift between the second image and the first image (shift detection unit 115, coordinate conversion unit 116) (steps # 1021 and # 1022 in FIG. 7) and correcting the exposure. Correction means (image composition means 117) ((step # 1023 in FIG. 7) is provided.

  In this way, the second image has an exposure close to the appropriate exposure for photographing at a long time, and the camera shake during the photographing is corrected by the shake correcting means 113 (step # 1020 in FIG. 7).

  Then, a good image is obtained by aligning and synthesizing the subject imaged by the flash means (strobe 16a) with the first image appropriately exposed by the flash means. I can do it.

  Further, determination means (imaging control means 18, vibration detection means 122) (step # 1004 in FIG. 7) for determining whether or not correction can be corrected based on the magnitude of blur and the frequency of blur applied to the imaging apparatus is stored. The image is displayed based on the determination result of the determination unit and the correction unit 113 that corrects the blurring that occurs in the image (step # 1025 in FIG. 7). The apparent exposure is corrected by aligning and synthesizing the deviations between the plurality of images obtained by performing the photographing a plurality of times with the exposure time (the flow flows from step # 1025 to # 1033 in FIG. 7). If).

  In such shooting conditions where blur correction cannot be performed, the exposure is controlled to prevent blurring (including not only the above-described composition after continuous shooting with a short exposure time but also step # 1035 in FIG. 7). The exposure is improved by aligning and synthesizing the deviations between a plurality of continuous shot images.

  First, the differences from Example 1 are summarized.

  The obtained images are not combined in the camera, but are combined using an external device such as a personal computer after shooting.

  As a result, the calculation time of the camera is reduced and the chance of taking a shutter is not missed, and the calculation load inside the camera is reduced, so that a high-performance camera can be provided at a reasonable price.

  As described above, the work for correcting blurring, the work for aligning the feature points of a plurality of images, and the work for combining are processed not by the camera but by a personal computer or the like using the application software attached to the camera after shooting.

  At this time, the following measures are taken to simplify the processing.

  The photographed image is composed of a semiconductor memory or the like and is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera. (Images not in shake mode) and images in image stabilization mode (a method for correcting blur and a method for combining a plurality of images) are mixed.

  The operation of selecting an image for correcting blurring or an image captured in a plurality of images from these images is extremely troublesome as the amount of recorded images increases.

  Therefore, in the second embodiment, the image for correcting the blur and the image shot in a plurality of images are recorded so as to be identified in the recording unit 119.

  The application software attached to the camera recognizes the identifications, extracts only them, and automatically aligns and synthesizes a plurality of images.

  The synthesized image is recorded again in the recording unit 119, and the plurality of images recorded in the recording unit 119 are deleted. As a result, a margin is created in the recording capacity of the recording means 119.

  FIG. 8 is a diagram showing the cooperation between the personal computer and the camera, and is a diagram in which the digital camera 21 is connected to the notebook personal computer 23 with a USB cable 22 or the like. The cable connection terminal of the digital camera 21 constitutes image data output means.

  As a result, the digital camera 21 can exchange image data with the notebook computer 23 via the output means.

  Note that the image data may be controlled by removing the recording means 119 built in the digital camera 21 from the camera body and inserting it into the slot 24 provided in the notebook personal computer 23 or the like instead of using a cable such as USB. . In this case, the detachable recording means 119 itself constitutes the output means.

  Application software according to this embodiment is installed in the notebook computer 23 in advance.

The operation of this application software will be described below.
1. Among the recorded images of the recording means 119 of the digital camera 21, a plurality of images recorded for blur correction and image composition are identified and automatically taken into the notebook computer 23 (the data is moved, so the recording means 119 The composite image is deleted).
2. The notebook computer 23 corrects the blur of the captured image, corrects the shift between consecutive shots and corrects the coordinate conversion, and combines them to improve the exposure.
3. The synthesized image is subjected to gamma correction and compression processing, and further, the edge missing portion of each image at the time of synthesis is cut out, and the amount of reduction in the image size is diffusion-supplemented.
4). The synthesized image is returned to the recording means 119 again.

  Details will be described in the above.

  As shown in FIG. 9, the folder 25 of the recording means 119 in the camera is divided into four folders. The normal shooting folder 26 for storing the normally shot image and the image that needs to be corrected for blurring shot without firing the flash. Is stored, a combined image folder 28 for aligning and synthesizing a plurality of images when blurring cannot be corrected due to large blurring (or high-frequency blurring), and a strobe is emitted to shoot 1 A correction composition folder 29 is provided for photographing the first image with a short exposure time, photographing the second image on the premise of correcting blur, and aligning and combining them.

  The normal shooting folder 26 stores images of the first image 26a to the eleventh image 26e in the shooting order.

  Here, when there is an image to be subjected to blur correction or image composition by application software after the photographing is finished depending on the photographer's selection or photographing conditions, the number is left in the normal image folder 26 (third, fourth, seventh). , 8th, 9th and 10th images are not in the normal image folder 26).

  The shake correction image folder 27 stores a third image 27a and a fourth image 27b scheduled to be corrected by application software after shooting.

  In the same manner as in the first embodiment, these images are obtained when the image stabilization operation unit 121 is on and the output of the vibration detection unit 122 is stable (the camera shake is not large and the frequency is not high), and the strobe is not used. Is stored in the shake correction image folder 27.

  In the composite image folder 28, the 71st image 28a to the 84th image 28h taken continuously for composition (one image scene from the 71st image 28a to the 74th image 28d, from the 81st image 28e to the 84th image 28h). The next shooting scene) is stored.

  In the corrected composite image folder 29, a second image (92nd image 29b and 102nd image 29d) that does not use a strobe for correcting blurring by application software after shooting, and a strobe that uses a strobe that is aligned and combined with them are used. One image (the 91st image 29a and the 101st image 29c) is stored (the 91st image 29a and the 92nd image 29b are one shooting scene, the 101st image 29c and the 102nd image 29d are the next shooting scenes) .

  In the same manner as in the first embodiment, these images are obtained when the image stabilization operation unit 121 is on and the output of the vibration detection unit 122 is stable (the camera shake is not large and the frequency is not high), and the conditions using the strobe Is stored in this modified composite image folder 29.

  The digital camera 21 having the recording means 119 in which these images are recorded is connected to the notebook computer 23 by a USB cable 22 or the like, or the recording means 119 built in the digital camera 21 is removed from the camera body and the notebook computer is connected. 23, the notebook personal computer 23 moves the data to the notebook personal computer 23 together with the folders 27 to 29 requiring image processing.

[Image data stored in the shake correction image folder 27]
The blur locus of the third image 27a is detected in the application software (in the notebook computer) by a change in the point image or the like, and an inverse function of the locus is given to restore the image. The fourth image 27b is similarly restored.

  The processed third image 27a and fourth image 27b are recorded in the normal image folder 26 of the recording means 119, and the shake correction folder 27 is deleted (FIG. 10).

[Image data stored in composite image folder 28]
The respective images are aligned with respect to the 71st image 28a to the 74th image 28d that are continuously shot. The reference image at this time is the 71st image 28a photographed using the strobe 16a. Each image that has been aligned is subjected to composition processing and exposure compensation is performed (same as steps # 1031 to # 1024 in FIG. 7), gamma correction and compression processing are performed, and end portions of each image at the time of composition are lost. A portion of the image is cut out, and the amount of reduction in the image size is diffusion-compensated.

  Similarly, the images are aligned with respect to the 81st image 28e to the 84th image 28h, which are continuously shot. The reference image at this time is the 81st image 28e photographed using the strobe 16a. Each image that has been aligned is subjected to composition processing, exposure compensation is performed, gamma correction and compression processing are performed, and the edge missing portion of each image at the time of composition is cut out, and the image size is reduced. Complemented.

  The images recorded in this way are collectively moved to the shooting order position in each of the normal image folders 26 provided in the recording means 119 (image data does not remain in the notebook computer).

  In the case of the composition IS mode by image composition, one image before composition is also recorded in the pre-correction image folder 210 (automatically created in the recording means 119 after the image composition processing is performed). . This image is, for example, a first image when a plurality of images are taken continuously, or an image taken using the strobe 16a.

  In FIG. 10, in the pre-correction image folder 210, the 71st image 28a and the 81st image 28e before correction are also recorded together with the combined 7th image 28i and 8th image 28j stored in the normal image folder 26. Thus, the photographer can select either one according to his / her preference.

  The pre-correction images (the 72nd image 28b to the 74th image 28d and the 82nd image 28f to the 84th image 28h) that have not been recorded in the pre-correction folder 210 are deleted together with the composite image folder 28.

[Image data stored in the modified composite image folder 29]
The image data stored in the folder 29 is an image that is subjected to blur correction and is imaged using the strobe 16a.

  The blur correction is performed on the 92nd image 29b and the 102nd image 29d taken without using the strobe 16a. The locus of the 92nd image 29b is detected in the application software (within the notebook computer) by a change in the point image, etc., and an inverse function of the locus is given to restore the image. The same applies to the 102nd image 29d.

  The 91st image 29a continuously shot and the 92nd image 29b whose image has been corrected are aligned with each other, combined, and subjected to exposure compensation (steps # 1020 to # 1024 in FIG. 7). The same as the above), gamma correction and compression processing are performed, the edge missing portion of each image at the time of synthesis is cut out, and the amount of reduction in the image size is diffusion-supplemented.

  The images recorded in this way are collectively moved to the shooting order position in each of the normal image folders 26 provided in the recording means 119 (image data does not remain in the notebook computer).

  Further, an image photographed using the strobe 16a is recorded in the pre-correction image folder 210 (automatically created in the recording means 119 after the correction / combination processing is performed).

  In FIG. 10, the 91st image 29a and the 101st image 29e before correction are recorded together with the 9th image 29e and the 10th image 29f after correction composition stored in the normal image folder 26 in the image folder 210 before correction. Thus, the photographer can select either one according to his / her preference.

  Then, the pre-correction images (the 92nd image 29b and the 102nd image 29d) not recorded in the pre-correction folder 210 are deleted together with the modified composite image folder 29.

  FIG. 11 is a flowchart summarizing the photographing operation of the camera of the present embodiment, and steps having the same functions as those in FIG. 7 are denoted by the same step numbers.

  This flow starts when the camera is turned on.

  In step # 1001, the photographer waits until the switch sw1 is turned on by half-pressing the release button. When the switch sw1 is turned on, the process proceeds to step # 1002.

  In step # 1002, the imaging means 19 performs imaging. The photographing control unit 18 drives the AF driving motor 14a to move the photographing lens 11 in the optical axis direction while detecting the contrast of the image based on the output from the signal processing unit 111.

  Then, when the contrast is highest, driving of the photographing lens 11 is stopped to bring the photographing optical system into a focused state (AF by hill-climbing method). Note that focus adjustment can also be performed by phase difference detection.

  Further, the imaging control means 18 obtains the brightness of the object scene based on the output of the imaging means 19 at the same time.

Here, as the object scene, the main subject of the screen and its periphery are separately measured, and the optimum exposure value for the entire screen is calculated from the photometric results.
In step # 1002, the captured image is displayed on an external liquid crystal monitor of the camera (display means 120).

  In step # 1003, it is determined whether or not the photographer has turned on the image stabilization operation means 121. When the photographer is on, the process proceeds to step # 1004. When the photographer is off, the process proceeds to step # 1040.

  First, the flow performed when the image stabilization operation means 121 is turned on will be described.

  In step # 1004, the output of the vibration detecting means 122 such as an acceleration sensor mounted on the camera is observed. If the output is abnormal, that is, the output of the acceleration sensor is larger than a predetermined value (for example, 10 mG or more) and the camera shake is large. If the main frequency of camera shake is high (for example, 8 Hz when the exposure time determined by photometry in step 1002 is 1/4 second, 4 Hz or more when the exposure time is 1/2 second), the blur correction cannot be performed satisfactorily. Therefore, another image stabilization method is selected without performing image stabilization by correcting the shake (proceed to step # 1025).

  If the output of the vibration detecting means 122 is within a predetermined range (when the shake is not so great and the frequency is low compared to the exposure time), the process proceeds to step # 1005.

  In step # 1005, it is determined whether or not the shooting setting using the strobe 16a is used. If the strobe 16a is not used, the process proceeds to step # 1006. If the shooting setting uses the strobe 16a, the process proceeds to step # 1015.

  This is because, as described with reference to FIG. 2, if an image obtained by photographing using the strobe 16a is corrected as it is, image degradation occurs in an area irradiated with the strobe 16a.

  First, a case where the strobe 16a is not used will be described.

  In step # 1006, the process waits by circulating from step # 1001 to step # 1005 until the release button is pressed down and shooting is instructed (switch sw2 is turned on).

  In step # 1007, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1008, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1009, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  In step # 2001, the image data temporarily stored in the image storage unit 114 is recorded in the recording unit 119.

  The difference from the flowchart of FIG. 7 is that an image before image correction (gamma correction or compression processing in step # 1011) is recorded (for example, recording in the raw format).

  This is to prevent image degradation when image processing is performed later on a personal computer, and recording is performed without changing the state of the image as much as possible.

  If the image capacity is too large, the image data may be recorded after being reversibly compressed.

  At this time, the image is recorded in the shake correction image folder 27 shown in FIG.

  If the blur correction image folder 27 does not exist in the recording unit 119, the blur correction image folder 27 is created in this step, and the obtained image is stored therein.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  This is because the image is displayed on the display unit 120 in the next step.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1014, the process returns to the start.

  If the release button is half-pressed (switch sw1 is turned on) at step # 1014, the flow proceeds again to steps # 1001, # 1002, # 1003, and # 1004. Eventually, when the release button is fully pressed (switch sw2 is turned on) at step # 1014, the process does not return to the start, but waits at step # 1014.

  Next, the case of shooting setting using the strobe 16a in step # 1005 will be described.

In that case, the flow proceeds from step # 1005 to step # 1015.
In step # 1015, the process waits while circulating from step # 1001 to step # 1015 until the release button is pressed down and the photographing instruction is issued (switch sw2 is turned on).

  In step # 1016, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1017, the first image using the strobe is taken.

  The exposure time at this time is set to an exposure time shorter than the camera shake limit determined by the focal length of the camera so that the obtained image is not affected by camera shake.

  For this reason, generally, the background other than the main subject properly irradiated with the strobe 16a (an area where the strobe 16a is not sufficiently irradiated) is underexposed.

  In step # 1017, the process waits until the photographing is completed, and once the photographing is completed, the photographed image is temporarily stored in the image storage unit 114.

  In step # 1018, a second image without using a strobe is taken.

  The exposure time at this time is set so that the exposure of the area such as the background that has been underexposed in the first image is appropriate (the exposure time that complements the exposure in the first image is set).

  For this reason, generally, the exposure is performed for a long time, and although the background exposure is improved, the image is noticeable.

  In step # 1018, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1019, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  Thus, since the end of shooting is displayed after the second image has been shot, the photographer does not notice that two images have been shot continuously, and can shoot at the same interval as normal shooting.

  In step # 2002, the image data temporarily stored in the image storage unit 114 is recorded in the recording unit 119.

  The difference from the flowchart of FIG. 7 is that an image before image correction (gamma correction or compression processing in step # 1011) is recorded.

  This is to prevent image degradation when image processing is performed later on a personal computer. Recording is performed without changing the state of the image as much as possible (for example, recording in the raw format).

  If the image capacity is too large, the image data may be recorded after being reversibly compressed.

  At this time, the image is stored in the modified composite image folder 29 shown in FIG.

  If the modified composite image folder 29 does not exist in the recording unit 119, the modified composite image folder 29 is created in this step, and the obtained image is stored therein.

  Next, the process proceeds to step # 1011. In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  This is to display an image in the next step, and image correction processing is performed only on the image to be displayed.

  In step # 2003, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

At this time, only the first image taken using the strobe in step # 1017 is displayed.

  Next, in step # 1004, if the output of the vibration detection means 122 is not in the normal state (the amount of camera shake is large and the camera shake frequency is high with respect to the exposure time), there is a possibility that good blur correction cannot be performed. Proceed to 1025 to prompt the user to select another anti-vibration system.

  In step # 1025, the photographer is asked to select whether or not to use a composite IS mode in which a plurality of images having exposure times that do not cause camera shake are combined to improve exposure by correcting a shift between consecutive shots. (Display unit 120 displays whether blur correction does not function and whether to select the composite IS mode).

  If the composite IS mode is not selected, the process proceeds to step # 1034. If the composite IS mode is selected, the process proceeds to step # 1026.

  First, the case where the composite IS mode is selected will be described.

  In step # 1026, the number of images to be photographed and the respective exposure times are obtained from the photographing conditions such as the brightness of the subject obtained in step # 1002.

The shooting conditions here are: • Brightness of the subject • Focal length of the shooting optical system • Brightness of the shooting optical system (aperture value)
4 points of sensitivity of the imaging means 19

  For example, assume that the sensitivity of the imaging means 19 is set to ISO200. In this case, it is assumed that the brightness of the subject is photometrically measured and the aperture 13a is fully opened (for example, f2.8) and the shutter 12a requires an exposure time 1/8 in order to properly expose it.

  At this time, if the shooting focal length is 30 mm in terms of 35 mm film, there is a risk of camera shake in 1/8 shooting. Therefore, the exposure time is set to 1/32 so that there is no risk of camera shake, and four shots are taken. To do.

  When the shooting focal length is 300 mm, the exposure time is set to 1/320, which does not cause camera shake, and the shooting is set to be performed 40 times.

  In this way, the exposure time for shooting a plurality of images is determined according to the shooting conditions, and how many more images are to be shot is set according to the shooting conditions.

  Even if the same subject is photographed in a plurality of pieces, accurate information can be captured by the imaging means 19 when the exposure condition for each photographing is as close to the appropriate exposure as possible.

  Therefore, in the case of a dark subject, when the photographing lens is narrowed down, or when the sensitivity of the image pickup means 19 is set low, the exposure time of each photographing is made as long as possible even in the case of multiple photographing and effective exposure. Make it a condition.

  However, if the exposure time is too long, the effect of deterioration due to camera shake appears on the image plane. As described above, when the shooting focal length is 30 mm in terms of 35 mm film, it is about one focal length with no fear of camera shake. The exposure time is set to 1/32. The amount of exposure time is insufficient with the number of shots.

  When the focal length is long, image deterioration due to camera shake occurs unless the exposure time is further shortened. Therefore, the exposure time is further shortened, and the number of shots is increased correspondingly to perform exposure compensation.

  As described above, the exposure time in the multiple-image shooting becomes longer as the shooting subject is darker and the shooting lens is darker, and becomes longer as the sensitivity of the image sensor is lower, and becomes shorter as the focal length of the lens is longer.

  The number of shots in the multiple-shot shooting increases as the shooting subject becomes darker and the shooting lens darkens, increases as the sensitivity of the image pickup means 19 decreases, and increases as the focal length of the lens increases.

  After the above calculation is completed, the camera viewfinder, external liquid crystal monitor, etc. (display means 120) display that the image stabilization mode (multiple shooting mode) has been set, and at the same time, the number of shots taken is displayed and shot. Inform the person.

  In step # 1027, the process waits by circulating from step # 1001 to step # 1027 until the release button is fully pressed and a shooting instruction is issued (switch sw2 is turned on).

  In step # 1028, the first image is taken.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  Steps # 1028 to # 1024 are operations in the composite photographing mode in which photographing with a short exposure time is repeated a plurality of times and combined to make the apparent exposure appropriate.

  Here, as described in this step, the first shooting is performed by flashing the strobe 16a in order to obtain the above-described ST image (of course, the strobe 16a does not emit light when the strobe shooting setting is not set).

  In step # 1029, steps # 1028 and # 1029 are circulated and waited until all shooting is completed, and the image that has been shot is temporarily stored in the image storage means 114.

  When shooting is repeated in this circulation, the second and subsequent shots are taken without using the strobe 16a in order to obtain an NST image group. When shooting is completed, the process proceeds to step # 1030.

  In step # 1030, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  In this way, even when shooting multiple images, there is one set of pronunciations representing the operation (once from the start of exposure of the first shooting to the completion of exposure of the last shooting), thus giving the photographer a sense of incongruity of shooting multiple photos. There is no.

  In step # 2004, the image data temporarily stored in the image storage unit 114 is recorded in the recording unit 119.

  The difference from the flowchart of FIG. 7 is that an image before image correction (gamma correction or compression processing in step # 1011) is recorded.

  This is to prevent image degradation when image processing is performed later on a personal computer. Recording is performed without changing the state of the image as much as possible (for example, recording in the raw format).

  If the image capacity is too large, the image data may be recorded after being reversibly compressed.

At this time, the image is stored in the composite image folder 28 shown in FIG.
If the composite image folder 28 does not exist in the recording unit 119, the composite image folder 28 is created in this step, and the obtained image is stored therein.

  Next, the process proceeds to step # 1011. In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  This is to display an image in the next step, and image correction processing is performed only on the image to be displayed.

  In step # 2005, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  At this time, only a representative one of the plurality of images taken as described above is displayed.

  When the ST image captured using the strobe 16a and the NST image captured without using the strobe 16a are mixed (slow sync shooting) among a plurality of images, the ST image is displayed on the display unit 120.

  If there is no ST image captured using the strobe 16a in the plurality of images, the first image captured is displayed on the display means 120.

  At this time, this image is underexposed because the exposure time is shortened to such an extent that camera shake does not occur.

  Therefore, the image is gained up and displayed in a state close to that of the exposure-complemented image after the composition.

  When the gain is increased in this way, the noise increases, but the noise is not noticeable when displayed on a small monitor such as the display means 120 on the back of the camera.

  In step # 1014, the process returns to the start.

  Next, a case where the photographer does not select the composite IS mode in step # 1025 will be described.

  If the photographer does not select the composite IS mode in step # 1025, the process proceeds to step # 1034.

  Step # 1034 also provides two options.

  The first is a method in which the exposure time is shortened in order to suppress the influence of camera shake, and the gain of the imaging means 19 is increased by that amount to complement the exposure.

  The second is a method of continuing shooting with the gain and exposure time of the imaging means 19 as it is regardless of the influence of camera shake.

  In the first method, the influence of camera shake is reduced, but the noise is increased as the gain of the imaging means 19 is increased.

  The second method does not increase noise, but the exposure time is not short, so it is likely to be affected by camera shake, and the photographer needs to shoot with the camera pressed against a fixed object such as a wall or handrail. is there.

  Since both have advantages and disadvantages, the photographer can select according to the shooting situation.

  First, a case where a setting with a short exposure time (first method) is selected will be described.

  In this case, in step # 1035, the exposure time is shortened.

  This exposure time is set to a camera shake limit determined by the focal length of the camera (generally referred to as a fraction of the focal length), and the imaging gain of the imaging means 19 is increased in order to compensate for the underexposure caused thereby.

  When the proper exposure cannot be obtained only by increasing the gain of the imaging means 19, the warning is given to the display means 120 so as to select the composite IS mode.

  In step # 1036, the process waits while circulating from step # 1001 to step # 1036 until the release button is fully pressed and a shooting instruction is issued (switch sw2 is turned on).

  In step # 1037, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1038, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1039, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  In step # 1014, the process returns to the start.

  Next, a case where the exposure time is not set short (second method) will be described.

  In this case, the flow proceeds from step # 1034 to step # 1036. Since step # 1035 is skipped, there is no operation for setting the exposure time short and increasing the gain of the imaging means 19.

  However, if the exposure time is set to be considerably longer than the camera shake limit determined by the focal length of the camera (generally referred to as a fraction of the focal length), a warning is given to the display means 120 to select the composite IS mode. Do.

  In step # 1036, the process waits from step # 1001 to step # 1036 until the release button is fully pressed and a shooting instruction is issued.

  In step # 1037, shooting is started.

  At the same time, sounding to start shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1038, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage means 113.

  In step # 1039, the completion of shooting is pronounced by the speaker 17a via the tone driving means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  In step # 1014, the process returns to the start.

  Next, the case where the image stabilization operation means 121 is off at step # 1003 will be described.

  At this time, the flow flows from step # 1003 to step # 1040.

  In step # 1040, it is determined whether or not the image capturing condition is such that image deterioration due to camera shake occurs unless the image stabilization system is used.

  As described above, the shooting conditions are the brightness of the subject, the brightness of the lens, the imaging sensitivity, and the shooting focal length. The exposure time is obtained based on the brightness of the subject, the brightness of the lens, and the imaging sensitivity. In step # 1040, it is determined whether there is a possibility of image degradation due to camera shake at the current photographing focal length.

  If there is a possibility of image degradation, the process proceeds to step # 1041, and if not, the process proceeds to step # 1042.

  In step # 1041, display that recommends setting to the image stabilization mode is performed on the camera finder, external liquid crystal monitor, or the like (display unit 120).

  In Step # 1042, the release button is pressed down and the process waits from Step # 1001 to Step # 1042 until a shooting instruction is issued.

  In step # 1043, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  This sound is for example! An electronic sound such as a shutter opening sound in a film camera or a mirror-up sound may be used.

  In step # 1044, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1045, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  This sound is for example! An electronic sound such as a shutter closing sound, a mirror down sound or a film winding sound in a film camera or the like may be used.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  That is, in the case of an image that does not require post-processing in normal shooting, the image is recorded after performing gamma correction and compression processing.

  In step # 1014, the process returns to the start.

  The data recorded in the recording means 119 as described above is read for each folder (blur correction folder 27, composite image folder 28, correction composite folder 29) when connected to the notebook computer 23 as described above. Then, the image is processed and recorded in the recording means 119 again.

  The image recorded at this time is subjected to image correction such as gamma correction and compression processing, and is recorded in the same format as the normal image (for example, jpg format) (of course, it may be recorded in the raw format without image correction).

  FIG. 12 shows the flow of image processing in the notebook computer 23, which starts when it is recognized that the notebook computer 23 is connected to the designated digital camera 21 or the recording means 119 mounted on the camera.

  Steps having the same functions as those in FIGS. 7 and 11 are denoted by the same numbers.

  In step # 2006, the shake correction image folder 27, the composite image folder 28, and the correction composite image folder 29 of the recording means 119 are moved to the memory of the notebook personal computer 23 for each folder.

  At this time, the shake correction image folder 27, the composite image folder 28, and the correction composite image folder 29 of the recording unit 119 are deleted.

  Of course, for the sake of safety, the data in the shake correction image folder 27, the composite image folder 28, and the correction composite image folder 29 of the recording means 119 may not only be moved to the notebook computer 23 but also copied to the notebook computer 23.

  In step # 2007, it is determined whether or not there is the composite image folder 28 in the moved data. If there is the composite image folder 28, the process proceeds to step # 2008. Otherwise, the process proceeds to step # 2013.

  First, the case where the composite image folder 28 exists will be described.

  In step # 2008, a plurality of photographed images newly recorded on the notebook computer 23 are sequentially read out.

  Steps # 1031 to # 1033 are operations of the electronic correction unit that makes the apparent exposure appropriate by aligning the feature points of the recaptured image (the image stored in the notebook computer).

  In step # 1031, feature points in each image are extracted.

  In step # 1032, the coordinate conversion means 116 performs coordinate conversion of each image based on the extracted feature point coordinates. Here, only the image using the strobe 16a is not subjected to coordinate conversion. That is, an image using the strobe 16a is used as a reference for coordinate conversion.

  This is the first image during the first-curtain sync shooting and the last image during the second-curtain sync shooting.

  In step # 1023, the first reference image and the next image subjected to coordinate conversion are synthesized.

  Here, the synthesis of images is performed by averaging the signals of the coordinates corresponding to each image, and the random noise in the images is reduced by averaging. Then, the gain of the image with reduced noise is increased to optimize the exposure.

  In step # 1033, all the images of one scene (for example, the 71st image 28a to the 74th image 28d in FIG. 9) are waited by circulating through steps # 1031 to # 1033 until the coordinate conversion and composition are completed. When the coordinate conversion of the scene image is completed, the process proceeds to step # 1024.

  In step # 1024, the missing edge portion of each image at the time of synthesis is cut out, and the amount of reduction in the image size is subjected to diffusion complement.

  In step # 1011, image data is subjected to gamma correction and compression processing.

  In step # 2009, the resultant composite image is copied to a predetermined location in the normal photographing folder 25 of the recording means 119.

  At this time, an image (for example, the 71st image 28a and the 81st image 28e) photographed using a strobe is created and stored in an uncorrected image folder 210 (FIG. 10).

  As a result, the photographer can arbitrarily select the combined image and the uncorrected image.

  In step # 2010, it is determined whether or not all the images in the composite image folder 28 stored in the notebook computer 23 have been processed. If the processing has not been completed (for example, the 81st image 28e to the 84th image 28h in FIG. 9). Is unprocessed), the process returns to step # 2008 to start reading a new image.

  If processing of all the images in the folder is completed, the process proceeds to step # 2011.

  In step # 2011, it is determined whether or not all of the images that need to be processed stored in the notebook computer 23 have been processed. If the processing has not been completed, the process returns to step # 2007, and all of the processing has been completed. Then, the process proceeds to step # 2012.

  When all the images are processed in this way and the recording in the recording means 119 is completed, the notebook personal computer 23 displays the completion of all the processes in step # 2012.

  Simultaneously with this display processing, all images stored in the notebook computer 23 are erased.

  If the composite image folder 28 does not exist in step # 2007, the presence / absence of the corrected composite image folder 29 is determined in step # 2013. If there is the composite image folder 29, the process proceeds to step # 2008.

  In step # 2008, a plurality of photographed images recorded on the notebook computer 23 are sequentially read out.

  In step # 1020, blur correction is performed on an image (second image) shot without using the flash 16a.

  In this step, as described above, the locus of blur is obtained from the bright spots of the image and the like, a step of approximating a simple formula, and a step of restoring a blur-free image by giving an inverse function of the approximate formula to the entire image The image blurring is corrected by passing this step # 1020.

  In step 1021, feature points in each image are extracted.

  In step # 1022, the coordinate conversion means 116 aligns the image (second image) not using the strobe 16a with the image (first image) taken using the strobe 16a based on the coordinates of the extracted feature points. Perform coordinate transformation.

  In step # 1023, the first image and the second image whose coordinates are converted are synthesized.

  In step # 1024, the missing edge portion of each image at the time of synthesis is cut out, and the amount of reduction in the image size is subjected to diffusion complement.

  In step # 1011, image data is subjected to gamma correction and compression processing.

  In step # 2009, the resultant composite image is copied to a predetermined location in the normal photographing folder 26 of the recording means 119.

  At this time, an image (for example, the 91st image 29a and the 101st image 29c) photographed using a strobe is created in an uncorrected image folder 210 (FIG. 10) and stored therein.

  As a result, the photographer can arbitrarily select the combined image and the uncorrected image.

  In step # 2010, it is determined whether or not all the images in the modified composite image folder 29 stored in the notebook computer 23 have been processed. If the processing has not been completed (for example, the 101st image 29c and the 102nd image in FIG. 9). 29d is unprocessed), the process returns to step # 2008 to start reading a new image.

  If processing of all the images in the folder is completed, the process proceeds to step # 2011.

  In step # 2011, it is determined whether or not all of the images that need to be processed stored in the notebook computer 23 have been processed. If the processing has not been completed, the process returns to step # 2007, and all of the processing has been completed. Then, the process proceeds to step # 2012.

  When all the images are processed in this way and the recording in the recording means 119 is completed, the notebook personal computer 23 displays the completion of all the processes in step # 2012.

  Simultaneously with this display processing, all images stored in the notebook computer 23 are erased.

  If there is no corrected composite image folder 29 in step # 2013, the process proceeds to step # 2014. In step # 2014, the presence / absence of the shake corrected image folder 27 is determined. If there is the shake corrected image folder 27, the process proceeds to step # 2008. If not, the process proceeds to step # 2011.

  In step # 2008, a plurality of photographed images recorded on the notebook computer 23 are sequentially read out.

  In step # 1010, blur correction is performed on the read image.

  In this step, as described above, the locus of blur is obtained from the bright spots of the image and the like, a step of approximating a simple formula, and a step of restoring a blur-free image by giving an inverse function of the approximate formula to the entire image The image blurring is corrected by passing this step # 1010.

  In step # 1011, image data is subjected to gamma correction and compression processing.

  In step # 2009, the resultant composite image is copied to a predetermined location in the normal photographing folder 26 of the recording means 119.

  In step # 2010, it is determined whether or not all the images in the composite image folder 27 stored in the notebook computer 23 have been processed. If the processing has not been completed (for example, the fourth image 27b in FIG. 9 has not been processed). Returns to step # 2008 and starts reading a new image.

  If processing of all the images in the folder is completed, the process proceeds to step # 2011.

  In step # 2011, it is determined whether or not all of the images that need to be processed stored in the notebook computer 23 have been processed. If the processing has not been completed, the process returns to step # 2007, and all of the processing has been completed. Then, the process proceeds to step # 2012.

  When all the images are processed in this way and the recording in the recording means 119 is completed, the notebook personal computer 23 displays the completion of all the processes in step # 2012.

  Simultaneously with this display processing, all images stored in the notebook computer 23 are erased. Thus, this flow ends.

  In the above description, the digital camera 21 and the notebook computer 23 have been described as an example. However, the present invention is not limited to the notebook computer 23 but a desktop personal computer. Even if it is not a personal computer, it is possible to process a plurality of images by preparing a dedicated storage or dedicated processing device and connecting it to the camera (or inserting the recording medium 119 in the device). Needless to say.

  As described above, in the second embodiment, blur correction and image composition are performed by application software. Therefore, the load on the camera is reduced, and the camera can be provided at a reasonable price as the camera is downsized. .

  In this manner, the first image captured by emitting the flash means (strobe 16a) and the second image not acquired by the flash means captured with a longer exposure time than the first image are sequentially acquired. After correcting the blur occurring in the second image with the photographing device having the control means 18 (step # 1020 in FIG. 12), the first image and the image are aligned with the shift between them (step # 1021 in FIG. 12). To # 1023), the photographing apparatus is configured by application software for correcting exposure.

  Thus, the second image has an exposure close to proper exposure for long-time shooting, and the camera shake during the shooting is corrected by the shake correcting means of the application software.

  Then, a good image can be obtained by aligning and synthesizing the subject imaged by emitting light from the flash means and the subject within the reach of the flash means properly exposed by the flash means.

  Further, application software for correcting blur is provided with determination means (vibration detection means 122, shooting control means 18) for determining whether or not the blur generated in the image can be corrected based on the magnitude and frequency of the shake applied to the imaging apparatus. An image capturing apparatus that captures an image for use, and performs display based on the determination result of the determination means (step # 1025 in FIG. 11). This is a configuration in which shooting is performed a plurality of times with a shooting exposure time shorter than the time (steps # 1028 and # 1029 in FIG. 11). In steps # 1031 to # 1024), the apparent exposure is corrected.

  In such shooting conditions where blur correction cannot be performed, exposure is controlled to prevent blurring from increasing, and exposure is improved by aligning and synthesizing a gap between a plurality of continuous shot images.

  FIG. 13 is a flowchart of the third embodiment of the present invention. The difference from the first embodiment is that, when shooting is performed using the strobe 16a, blur correction is prohibited, and instead, the exposure time is short enough to prevent camera shake. The exposure is improved by aligning and synthesizing a plurality of images.

  In the flowchart of FIG. 13, steps having the same functions as those in FIG. 7 are represented by the same part numbers.

  This flow starts when the camera is turned on.

  In step # 1001, the photographer waits until the switch sw1 is turned on by half-pressing the release button. When the switch sw1 is turned on, the process proceeds to step # 1002.

  In step # 1002, the imaging means 19 performs imaging. Further, the imaging control means 18 obtains the brightness of the object scene based on the output of the imaging means 19 at the same time. In step # 1002, the captured image is displayed on an external liquid crystal monitor of the camera (display means 120).

  In step # 1003, it is determined whether or not the photographer has turned on the image stabilization operation means 121. When the photographer is on, the process proceeds to step # 1004. When the photographer is off, the process proceeds to step # 1040.

  When the photographer turns off the image stabilization operation means 121, the flow is the same as in FIG.

  A flow performed when the image stabilization operation unit 121 is turned on will be described.

  In step # 1004, the output of the vibration detection means 122 such as an acceleration sensor mounted on the camera is observed. If the output is abnormal, that is, the output of the acceleration sensor is larger than a predetermined value (for example, 10 mG or more), and the camera shake is not detected. If the frequency is large or the main frequency of camera shake is high (for example, 8 Hz when the exposure time determined by photometry in step 1002 is 1/4 second and 4 Hz or more when the exposure time is 1/2 second), the blur correction is good. Since it cannot be performed, the image stabilization by blur correction is not performed, and another image stabilization method is selected (proceed to step # 1026).

  If the output of the vibration detecting means 122 is within a predetermined range (when the shake is not so great and the frequency is low compared to the exposure time), the process proceeds to step # 1005.

  In step # 1005, it is determined whether or not shooting setting using the strobe 16a is performed. If the strobe 16a is not used, the process proceeds to step # 1006. If shooting setting using the strobe 16a is performed, the process proceeds to step # 1026.

  This is because, as described with reference to FIG. 7, if an image obtained by photographing using the strobe 16a is corrected as it is, image degradation occurs in an area irradiated with the strobe 16a.

  First, a case where the strobe 16a is not used will be described.

  In step # 1006, the process waits while circulating from step # 1001 to step # 1005 until the release button is fully pressed and a shooting instruction is issued.

  In step # 1007, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  In step # 1008, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1009, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  In step # 1010, blur correction of the captured image stored in the image storage unit 114 is performed.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  In step # 1014, the process returns to the start.

  Next, in step # 1004, if the output of the vibration detection means 122 is not in the normal state (the amount of camera shake is large and the camera shake frequency is high with respect to the exposure time), there is a possibility that good blur correction cannot be performed. Similarly, in step # 1005, the flow advances to step # 1026 also in the case of shooting setting using the strobe 16a in step # 1005.

  In step # 1026, the number of images to be photographed and the respective exposure times are obtained from the photographing conditions such as the brightness of the subject obtained in step # 1002.

  In step # 1027, the process waits while circulating from step # 1001 to step # 1027 until the release button is fully pressed and a shooting instruction is issued.

  In step # 1028, the first image is taken.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  Here, as described in this step, the first shooting is performed by flashing the strobe 16a in order to obtain the above-described ST image (of course, the strobe 16a does not emit light when the strobe shooting setting is not set).

  In step # 1029, steps # 1028 and # 1029 are circulated and waited until all shooting is completed, and the image that has been shot is temporarily stored in the image storage means 114.

  When shooting is repeated in this circulation, the second and subsequent shots are taken without using the strobe 16a in order to obtain an NST image group. When shooting is completed, the process proceeds to step # 1030.

  In step # 1030, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  In step # 1031, the deviation detection means 115 extracts a characteristic image from the peripheral area of the image (for example, the edge 128a of the window 126a of the building 126a in FIG. 4), and obtains the coordinates of the image.

  In step # 1032, the coordinate conversion means 116 performs coordinate conversion of each image.

  In step # 1033, steps # 1030, # 1031, and # 1032 are circulated and waited until coordinate conversion of all images is completed. When coordinate conversion of all images is completed, the process proceeds to step # 1023.

  In step # 1023, the images are combined.

  In step # 1024, an area where the images do not overlap due to compositional deviation, such as the end of the synthesized image, is cut, and the image is diffusion-supplemented so as to have the original frame size.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  In step # 1014, the process returns to the start.

  As described above, the image stabilization is basically an image stabilization system that suppresses image degradation, but shooting that presumes camera shake correction is prohibited under shooting conditions such as strobe shooting where blur correction cannot be performed satisfactorily. However, blurring is suppressed by other means.

  In the third embodiment, the flash unit (strobe 16a), the blur correction unit 113 (step # 1010 in FIG. 13) for correcting the blur generated in the recorded image, and the image obtained under the shooting conditions for shooting using the flash unit. In contrast, the shake correction operation control means (imaging control means 18) (step # 1005 in FIG. 13) for disabling the operation of the shake correction means, and the shooting conditions for shooting using the flash means, are repeated multiple times. Composite exposure correction means (shift detection means 115, coordinate conversion means 116, image composition means 117, etc.) for correcting the apparent exposure by aligning and synthesizing the deviations between the plurality of images (step # 1026 in FIG. 13). # 1024).

  This prevents the blur correction from being deteriorated by the flash means, and complements the exposure while suppressing the blur by the image alignment synthesis.

  The fourth embodiment is a method of synthesizing an image (blur correction or synthesis image) obtained by the method of the third embodiment by using an external device such as a personal computer after shooting, instead of synthesizing the image in the camera.

  Since the connection with the personal computer and the file storage method are the same as those in the second embodiment, the description thereof will be omitted.

  FIG. 14 is a flowchart of the fourth embodiment. The difference from the second embodiment is that when shooting is performed using the strobe 16a, image capturing for blur correction is prohibited, and instead, the exposure time is such that camera shake does not occur. This is the point of taking a picture to improve exposure by aligning and synthesizing a plurality of short images (actual blur correction and image synthesis are performed on a personal computer).

  In the flowchart of FIG. 14, steps having the same functions as those in FIG. 11 are represented by the same part numbers.

  This flow starts when the camera is turned on.

  In step # 1001, the photographer waits until the switch sw1 is turned on by half-pressing the release button. When the switch sw1 is turned on, the process proceeds to step # 1002.

  In step # 1002, the imaging means 19 performs imaging. Further, the imaging control means 18 obtains the brightness of the object scene based on the output of the imaging means 19 at the same time. In step # 1002, the captured image is displayed on an external liquid crystal monitor of the camera (display means 120).

  In step # 1003, it is determined whether or not the photographer has turned on the image stabilization operation means 121. When the photographer is on, the process proceeds to step # 1004. When the photographer is off, the process proceeds to step # 1040.

  When the photographer turns off the image stabilization operation means 121, the flow is the same as in FIG.

  A flow performed when the image stabilization operation unit 121 is turned on will be described.

  In step # 1004, the output of the vibration detecting means 122 such as an acceleration sensor mounted on the camera is observed. If the output is abnormal, that is, the output of the acceleration sensor is larger than a predetermined value (for example, 10 mG or more) and the camera shake is large. If the main frequency of camera shake is high (for example, 8 Hz when the exposure time determined by the photometry in step # 1002 is 1/4 second, 4 Hz or more when the exposure time is 1/2 second), the blur correction can be performed satisfactorily. Since there is no image stabilization due to blur correction, another image stabilization method is selected (proceed to step # 1026).

  If the output of the vibration detecting means 122 is within a predetermined range (when the shake is not so great and the frequency is low compared to the exposure time), the process proceeds to step # 1005.

  In step # 1005, it is determined whether or not shooting setting using the strobe 16a is performed. If the strobe 16a is not used, the process proceeds to step # 1006. If shooting setting using the strobe 16a is performed, the process proceeds to step # 1026.

  This is because, as described with reference to FIG. 2, if an image obtained by photographing using the strobe 16a is corrected as it is, image degradation occurs in an area irradiated with the strobe 16a.

  First, a case where the strobe 16a is not used will be described.

  In step # 1006, the process waits while circulating from step # 1001 to step # 1005 until the release button is fully pressed and a shooting instruction is issued.

  In step # 1007, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  In step # 1008, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1009, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  In step # 2001, the image data temporarily stored in the image storage unit 114 is recorded in the recording unit 119.

  A difference from the flowchart of FIG. 13 is that an image before image correction (gamma correction or compression processing in step # 1011) is recorded (for example, recording in the raw format).

  This is to prevent image degradation when image processing is performed later on a personal computer, and recording is performed without changing the state of the image as much as possible.

  If the image capacity is too large, the image data may be recorded after being reversibly compressed.

  At this time, the image is stored in the shake correction image folder 27 shown in FIG.

  If the blur correction image folder 27 does not exist in the recording unit 119, the blur correction image folder 27 is created in this step, and the obtained image is stored therein.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

This is because the image is displayed on the display means 120 in the next step.
In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.
In step # 1014, the process returns to the start.

  Next, in step # 1004, if the output of the vibration detection means 122 is not in the normal state (the amount of camera shake is large and the camera shake frequency is high with respect to the exposure time), there is a possibility that good blur correction cannot be performed. Similarly, in step # 1005, the flow advances to step # 1026 also in the case of shooting setting using the strobe 16a in step # 1005.

  In step # 1026, the number of images to be photographed and the respective exposure times are obtained from the photographing conditions such as the brightness of the subject obtained in step # 1002.

  In step # 1027, the process waits while circulating from step # 1001 to step # 1027 until the release button is fully pressed and a shooting instruction is issued.

  In step # 1028, the first image is taken.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  Here, as described in this step, the first shooting is performed by flashing the strobe 16a in order to obtain the above-described ST image (of course, the strobe 16a does not emit light when the strobe shooting setting is not set).

  In step # 1029, steps # 1028 and # 1029 are circulated and waited until all shooting is completed, and the image that has been shot is temporarily stored in the image storage means 114.

  When shooting is repeated in this circulation, the second and subsequent shots are taken without using the strobe 16a in order to obtain an NST image group.

  When shooting is completed, the process proceeds to step # 1030.

  In step # 1030, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  In step # 2004, the image data temporarily stored in the image storage unit 114 is recorded in the recording unit 119.

  The difference from the flowchart of FIG. 13 is that an image before image correction (gamma correction or compression processing in step # 1011) is recorded.

  This is to prevent image degradation when image processing is performed later on a personal computer. Recording is performed without changing the state of the image as much as possible (for example, recording in the raw format).

  If the image capacity is too large, the image data may be recorded after being reversibly compressed.

  At this time, the image is stored in the composite image folder 28 shown in FIG.

  If the composite image folder 28 does not exist in the recording unit 119, the composite image folder 28 is created in this step, and the obtained image is stored therein.

  Next, the process proceeds to step # 1011. In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  This is to display an image in the next step, and image correction processing is performed only on the image to be displayed.

  In step # 2005, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  At this time, only a representative one of the plurality of images taken as described above is displayed. When the ST image captured using the strobe 16a and the NST image captured without using the strobe 16a are mixed (slow sync shooting) among a plurality of images, the ST image is displayed on the display unit 120.

  If there is no ST image captured using the strobe 16a in the plurality of images, the first image captured is displayed on the display means 120.

  At this time, this image is underexposed because the exposure time is shortened to such an extent that camera shake does not occur.

  Therefore, the image is gained up and displayed in a state close to that of the exposure-complemented image after the composition.

  When the gain is increased in this way, the noise increases, but the noise is not noticeable when the small monitor 9 is displayed like the display means 120 on the back of the camera.

  In step # 1014, the process returns to the start.

  The blur correction and composition of the image data stored in the recording unit 119 is the same as the flow shown in FIG. 12 (however, there is no correction composition flow from step # 2013 to step 2008), and the description thereof will be omitted.

  As described above, the image stabilization is basically an image stabilization system that suppresses image degradation, but shooting that presumes camera shake correction is prohibited under shooting conditions such as strobe shooting where blur correction cannot be performed satisfactorily. However, blurring is suppressed by other means.

  In the fourth embodiment, there is provided a photographing apparatus for photographing an image for first application software for correcting blur, and an application for correcting blur under a flash unit (strobe 16a) and shooting conditions for shooting using the flash unit. When image shooting for software is prohibited (shooting control means 18, step # 1005 in FIG. 14), shooting is repeated a plurality of times, and the apparent exposure is obtained by aligning and synthesizing the deviations between the obtained images. The photographing of the image for the second application software that corrects the image (steps # 1026 to # 1030 in FIG. 14) is permitted.

  This prevents the blur correction from being deteriorated by the flash means, and complements the exposure while suppressing the blur by the image alignment synthesis.

  FIG. 15 is a flowchart of the fifth embodiment of the present invention, and is that the photographing using the strobe 16a is prohibited when photographing in the shake correction mode contrary to the third embodiment.

  In the flowchart of FIG. 15, steps having the same functions as those in FIG. 13 are represented by the same part numbers.

  This flow starts when the camera is turned on.

  In step # 1001, the photographer waits until the switch sw1 is turned on by half-pressing the release button. When the switch sw1 is turned on, the process proceeds to step # 1002.

  In step # 1002, the imaging means 19 performs imaging. Further, the imaging control means 18 obtains the brightness of the object scene based on the output of the imaging means 19 at the same time. In step # 1002, the captured image is displayed on an external liquid crystal monitor of the camera (display means 120).

  In step # 1003, it is determined whether or not the photographer has turned on the image stabilization operation means 121. When the photographer is on, the process proceeds to step # 1004. When the photographer is off, the process proceeds to step # 1040.

  Here, the image stabilization operation means 121 has a shape as shown in FIG. 16 and is photographed by operating any one of the image stabilization off mode 121a, the shake correction mode 121b, and the image composition mode 121c to match the index 121d. The mode is switched.

  When the photographer turns off the image stabilization operation means 121, the flow is the same as in FIG.

  A flow performed when the image stabilization operation unit 121 is turned on (either the shake correction mode or the image composition mode) will be described.

  In step # 1004, the output of the vibration detection means 122 such as an acceleration sensor mounted on the camera is observed. If the output is abnormal, that is, the output of the acceleration sensor is larger than a predetermined value (for example, 10 mG or more), and the camera shake is not detected. If the frequency is large or the main frequency of camera shake is high (for example, 8 Hz when the exposure time determined by photometry in Step # 1002 is 1/4 second, 4 Hz or more when the exposure time is 1/2 second), the blur correction is good. Therefore, another image stabilization method is selected without performing image stabilization by correcting the shake (proceed to step # 1026).

  If the output of the vibration detection means 122 is within the predetermined range (when the shake is not so great and the frequency is low compared to the exposure time), the process proceeds to step # 5001.

  In step # 5001, it is determined whether or not the shooting setting uses the blur correction mode. If the shooting setting uses the blur correction mode, the process proceeds to step # 5002, and if it is the image composition mode, the process proceeds to step # 1026.

  In step # 5002, the use of the strobe 16a is prohibited. If the photographer operates to use the strobe 16a, the display means 120 displays that the strobe cannot be used.

  This is because, as described with reference to FIG. 2, if an image obtained by photographing using the strobe 16a is corrected as it is, image degradation occurs in an area irradiated with the strobe 16a.

  In step # 1006, the process waits while circulating from step # 1001 to step # 1005 until the release button is fully pressed and a shooting instruction is issued.

  In step # 1007, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  In step # 1008, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1009, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  In step # 1010, blur correction of the captured image stored in the image storage unit 114 is performed.

  In step # 1011, signal gamma correction and compression processing are performed on the image whose shake has been corrected.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.

  In step # 1014, the process returns to the start.

  Next, in step # 1004, if the output of the vibration detection means 122 is not in the normal state (the amount of camera shake is large and the camera shake frequency is high with respect to the exposure time), there is a possibility that good blur correction cannot be performed. In step 1026, the flow advances to step # 1026 when the image composition mode is selected in step # 5001.

  In step # 1026, the number of images to be photographed and the respective exposure times are obtained from the photographing conditions such as the brightness of the subject obtained in step # 1002.

  In step # 1027, the process waits while circulating from step # 1001 to step # 1027 until the release button is fully pressed and a shooting instruction is issued.

  In step # 1028, the first image is taken.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  Here, as described in this step, the first shooting is performed by flashing the strobe 16a in order to obtain the above-described ST image (of course, the strobe 16a does not emit light when the strobe shooting setting is not set).

  In step # 1029, steps # 1028 and # 1029 are circulated and waited until all shooting is completed, and the image that has been shot is temporarily stored in the image storage means 114.

  When shooting is repeated in this circulation, the second and subsequent shots are taken without using the strobe 16a in order to obtain an NST image group.

  When shooting is completed, the process proceeds to step # 1030.

  In step # 1030, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  In step # 1031, the deviation detection means 115 extracts a characteristic image from the peripheral area of the image (for example, the edge 128a of the window 126a of the building 126a in FIG. 4), and obtains the coordinates of the image.

  In step # 1032, the coordinate conversion means 116 performs coordinate conversion of each image.

  In step # 1033, steps # 1030, # 1031, and # 1032 are circulated and waited until coordinate conversion of all images is completed. When coordinate conversion of all images is completed, the process proceeds to step # 1023.

  In step # 1023, the images are combined.

  In step # 1024, an area where the images do not overlap due to compositional deviation, such as the end of the synthesized image, is cut, and the image is diffusion-supplemented so as to have the original frame size.

  In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

In step # 1013, the image obtained in step # 1011 is recorded on a recording medium (recording means 119) that can be attached to and detached from the camera using, for example, a semiconductor memory.
In step # 1014, the process returns to the start.

  As described above, in the mode in which image deterioration is basically suppressed by correcting the blur, the flash photography is prohibited to prevent the image from being deteriorated by correcting the blur.

  In the fifth embodiment, the flash means (strobe 16a), the shake correction means 113 (step # 1010 in FIG. 15) for correcting the blur generated in the recorded image, and the flash means when the shake correction means is set to be effective are used. Flash photographing prohibiting means (photographing control means 18, steps # 5001 and # 5002 in FIG. 15) is provided.

  As a result, it is possible to prevent deterioration of blur correction by the flash means.

  The sixth embodiment is a method of synthesizing an image obtained by the method of the fifth embodiment (blur correction or synthesis image) using an external device such as a personal computer after shooting, instead of synthesizing the image in the camera.

  Since the connection with the personal computer and the file storage method are the same as those in the second embodiment, the description thereof will be omitted.

  FIG. 17 is a flowchart of the sixth embodiment, which is configured such that shooting using the strobe 16a is prohibited when shooting in the shake correction mode.

  In the flowchart of FIG. 17, steps having the same functions as those in FIGS. 14 and 15 are represented by the same part numbers.

  This flow starts when the camera is turned on.

  In step # 1001, the photographer waits until the switch sw1 is turned on by half-pressing the release button. When the switch sw1 is turned on, the process proceeds to step # 1002.

  In step # 1002, the imaging means 19 performs imaging.

  Further, the imaging control means 18 obtains the brightness of the object scene based on the output of the imaging means 19 at the same time.

  In step # 1002, the captured image is displayed on an external liquid crystal monitor of the camera (display means 120).

  In step # 1003, it is determined whether or not the photographer has turned on the image stabilization operation means 121. When the photographer is on, the process proceeds to step # 1004. When the photographer is off, the process proceeds to step # 1040.

  Here, the image stabilization operation means 121 has a shape as shown in FIG. 16, and is shot by operating any one of the image stabilization off mode 121a, the shake correction mode 121b, and the image composition mode 121c to match the index 121d. The mode is switched.

  When the photographer turns off the image stabilization operation means 121, the flow is the same as in FIG.

  A flow performed when the image stabilization operation unit 121 is turned on will be described.

  In step # 1004, the output of the vibration detection means 122 such as an acceleration sensor mounted on the camera is observed. If the output is abnormal, that is, the output of the acceleration sensor described above is larger than a predetermined value (for example, 10 mG or more), and the camera shake is not detected. If the frequency is large or the main frequency of camera shake is high (for example, 8 Hz when the exposure time determined by photometry in Step # 1002 is 1/4 second, 4 Hz or more when the exposure time is 1/2 second), the blur correction is good. Therefore, another image stabilization method is selected without performing image stabilization by correcting the shake (proceed to step # 1026).

  If the output of the vibration detecting means 122 is within a predetermined range (when the shake is not so great and the frequency is low compared to the exposure time), the process proceeds to step # 5001.

  In step # 5001, it is determined whether or not the shooting setting uses the shake correction mode. If the shooting setting uses the shake correction mode, the process proceeds to step # 5002, and if the image synthesis mode is set, the process proceeds to step # 1026.

  In step # 5002, the use of the strobe 16a is prohibited.

  If the photographer operates to use the strobe 16a, the display means 120 displays that the strobe cannot be used.

  This is because, as described with reference to FIG. 2, if an image obtained by photographing using the strobe 16a is corrected as it is, image degradation occurs in an area irradiated with the strobe 16a.

  In step # 1006, the process waits while circulating from step # 1001 to step # 1005 until the release button is fully pressed and a shooting instruction is issued.

  In step # 1007, shooting is started.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  In step # 1008, the process waits until shooting is completed, and once the shooting is completed, the shot image is temporarily stored in the image storage unit 114.

  In step # 1009, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  In step # 2001, the image data temporarily stored in the image storage unit 114 is recorded in the recording unit 119.

  At this time, the image is stored in the shake correction image folder 27 shown in FIG.

  In step # 1011, signal gamma correction and compression processing are performed on the image.

  This is because the image is displayed on the display unit 120 in the next step.

  In step # 1012, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1014, the process returns to the start.

  Next, in step # 1004, if the output of the vibration detecting means 122 is not in the normal state (the amount of camera shake is large and the camera shake frequency is high with respect to the exposure time), there is a possibility that good blur correction cannot be performed. Similarly, when the image composition mode is selected at step # 5001, the flow proceeds to step # 1026.

  In step # 1026, the number of images to be photographed and the respective exposure times are obtained from the photographing conditions such as the brightness of the subject obtained in step # 1002.

  In step # 1027, the process waits while circulating from step # 1001 to step # 1027 until the release button is fully pressed and a shooting instruction is issued.

  In step # 1028, the first image is taken.

  At the same time, sounding for starting shooting is performed by the speaker 17a via the sounding driving means 17b.

  In step # 1029, steps # 1028 and # 1029 are circulated and waited until all shooting is completed, and the image that has been shot is temporarily stored in the image storage means 114.

  When shooting is completed, the process proceeds to step # 1030.

  In step # 1030, the completion of shooting is sounded by the speaker 17a via the sound generation drive means 17b.

  In step # 2004, the image data temporarily stored in the image storage unit 114 is recorded in the recording unit 119.

  Next, the process proceeds to step # 1011. In step # 1011, signal gamma correction and compression processing are performed on the composite image.

  In step # 2005, the image obtained in step # 1011 is displayed on an external liquid crystal monitor or the like (display unit 120) disposed on the back of the camera.

  In step # 1014, the process returns to the start.

  The blur correction and composition of the image data recorded in the recording means 119 is the same as the flow shown in FIG. 12 (however, there is no correction composition flow from step # 2013 to step 2008), and the description thereof will be omitted.

  As described above, in the mode in which image deterioration is basically suppressed by correcting the blur, the flash photography is prohibited to prevent the image from being deteriorated by correcting the blur.

  In the sixth embodiment, flash photographing prohibiting means (capturing control means 18, steps # 5001 and # 5002 in FIG. 17) for prohibiting the use of flash means (strobe 16a) when photographing an image for application software for correcting blurring. It has composition which has.

  As a result, it is possible to prevent deterioration of blur correction by the flash means.

1 is a block diagram of a camera that is Embodiment 1 of the present invention. FIG. It is a figure which shows the state of an image at the time of performing blurring correction of a flash light emission image. It is a figure which shows the synthetic | combination state of the flash light emission image in Example 1 of this invention. It is a figure which shows the coordinate transformation of the image in Example 1 of this invention. It is a figure which shows the contrast of the flash image in Example 1 of this invention, and an image without a flash. It is a figure which shows the composition shift | offset | difference in Example 1 of this invention. It is a flowchart which shows operation | movement of the camera in Example 1 of this invention. It is a figure which shows the connection of the personal computer and camera in Example 2 of this invention. It is a figure which shows the storage method of the image in the camera in Example 2 of this invention. It is a figure which shows the storage method of the image in the camera after the image process in Example 2 of this invention. It is a flowchart which shows the operation | movement of the camera in Example 2 of this invention. It is a flowchart which shows the processing operation in the personal computer in Example 2 of this invention. It is a flowchart which shows the operation | movement of the camera in Example 3 of this invention. It is a flowchart which shows operation | movement of the camera in Example 4 of this invention. It is a flowchart which shows the operation | movement of the camera in Example 5 of this invention. It is a figure which shows the operation knob of the vibration proof operation means in Example 5 of this invention. It is a flowchart which shows the operation | movement of the camera in Example 6 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Optical axis 11 Shooting lens 12a Shutter 12b Shutter drive means 13a Aperture 13b Aperture drive means 14a AF drive motor 14b Focus drive means 15a Zoom drive motor 15b Zoom drive means 16a Strobe 16b Flash drive means 17a Speaker 17b Sound generation drive means 18 Shooting control means 18 DESCRIPTION OF SYMBOLS 19 Image pickup means 110 A / D conversion means 111 Signal processing means 112 Signal switching means 113 Shake correction means 114 Image storage means 115 Deviation detection means 116 Coordinate conversion means 117 Image composition means 118 Image correction means 119 Recording means 120 Display means 121 Vibration isolation Operating means 122 Vibration detecting means

Claims (4)

Blur correction means for correcting blur of an image that occurs when an image is shot;
The first image taken using an illumination unit, and said exposed with longer exposure time than the first image without the use of illuminating means, and blur occurring at the time of exposure is corrected by the shake correction means Photographing control means for acquiring two images ;
An imaging apparatus , comprising: a composite exposure correction unit that corrects exposure by combining the second image and the first image. 2. The image capturing control unit according to claim 1, wherein the image capturing control unit invalidates the operation of the shake correcting unit for a first image obtained under an image capturing condition for capturing an image using the illumination unit . Shooting device. 3. The photographing apparatus according to claim 1, wherein the composite exposure correction unit combines the second image that has been corrected for blur and the first image with a gap between the first image and the first image aligned . A photographing control means for obtaining a first image photographed using an illuminating means, and a second image exposed with an exposure time longer than the first image without using the illuminating means;
Recording means for recording the first image and the second image;
The first image with respect to a device having application software for correcting exposure by correcting the blurring of the image generated in the second image and then combining the second image and the first image And an output means for outputting the second image .

Images