JP2003280057A - Photographing device with shake correcting function - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing device with a shake correcting function which can obtain image data after an image blur is eliminated even if the large image blur exceeding a correctable range is generated. <P>SOLUTION: An imaging means 13 photographs an image with electric charges accumulated by photoelectrically converting a subject image formed on a photodetection surface 13a. According to a prediction displacement quantity that a displacement quantity calculating means 15 calculates based upon a detected angular speed, shake correcting means 19x and 19y displace an imaging position in two directions within the correctable range to correct an image blur. When the predicted displacement quantity exceeds the correctable range, an exposure control means 15 moves and holds electric charges which are accumulated so far and temporarily interrupts exposure, restarts the exposure after displacing the imaging position to the center of the correctable range simultaneously, and closes a shutter 14 after the remaining exposure time is elapsed. An image data generating means 16 individually processes electric charges accumulated before and after the exposure interruption to generate image data representing two images. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus having a shake correction function, and more specifically, it photoelectrically converts an image of a subject formed on a light receiving surface of an image pickup means by an image pickup optical system into electric charges. Image is captured by the image pickup means, and the image data representing the image is generated by processing the charges accumulated by the image pickup means. For example, image shake on the light receiving surface caused by camera shake during shooting is corrected to The present invention relates to an image pickup apparatus with a shake correction function that minimizes the influence on image pickup.

[0002]

2. Description of the Related Art Conventionally, a photographing apparatus of this kind is known as a video camera or a digital still camera. For example, in the case of a digital still camera, an image of a subject formed on a light receiving surface of an image pickup means by a photographing optical system. Is photoelectrically converted into electric charges to photograph an image, and the electric charges accumulated by the image pickup means are processed to generate image data representing the image. In a digital still camera using such an image pickup means, during exposure while the shutter is open, the image of the subject formed on the light receiving surface is photoelectrically converted to accumulate charges, and the accumulated charges are processed. Since it is designed to generate image data, the sensitivity is limited, and it is difficult to achieve a short shutter time like silver halide photography, and "image flow" occurs in the image obtained by camera shake. Blurring like this is likely to occur.

The shake correction usually detects angular velocities around two fixed axes orthogonal to the optical axis of the camera, finds the "tilt angle due to shake" of the camera around these two axes, and corresponds to this tilt angle. The correction lens included in the photographing optical system is displaced, the direction of the optical axis is adjusted, and the image pickup means is moved so as to correct the image blur. The element has a mechanism that moves in two axial directions.

Generally, as a mechanism for correcting image shake, shake correction is performed to independently correct image shake caused by movement of the image forming position on the light receiving surface in two different directions orthogonal to the optical axis of the camera. And a central processing unit (CP) of a microcomputer (hereinafter, referred to as a microcomputer).
U) respectively detects the shake amount in two directions based on the output of the shake detection sensor such as the angular velocity sensor, predicts the displacement amount of the image forming position on the light receiving surface based on the detected shake amount, and makes this prediction. On the basis of the displacement amount, the shake correction is performed by displacing and driving the elements of the driven system in two directions by the shake correcting unit so as to eliminate the image shake.

[0005]

By the way, in the mechanism for correcting the image blur, the components of the driven system are displaced in two directions by the shake compensating means, so that two different directions orthogonal to the optical axis of the camera are obtained. Further, the image blur is independently corrected by moving the image forming position on the light receiving surface. Therefore, the correctable range in which the image forming position on the light receiving surface can be moved and corrected is mechanically determined.

Therefore, if the amount of displacement predicted to be based on the detected shake amount and necessary to displace the image forming position on the light receiving surface so as to eliminate the image shake is within the correctable range, Although the shake can be eliminated, if a large shake occurs that requires correction with a displacement that exceeds the correctable range, the image shake caused by the camera shake remains without being eliminated. There was a problem.

Therefore, in view of the above-mentioned points, the present invention once sets the image formation position in the correctable range once when the image blur exceeds the correctable range in which the image formation position can be corrected by displacing the image forming position. By returning to the center and shooting the remaining shots separately from the previous shots, it is possible to obtain image data that eliminates the image shake even if a large image shake that exceeds the correctable range occurs. An object of the present invention is to provide an image pickup apparatus with a shake correction function.

[0008]

The invention according to claim 1 made in order to solve the above-mentioned problems has a photographing optical system and a light-receiving surface on which an image of an object is formed by the photographing optical system, Image capturing means for photoelectrically converting the subject image formed on the light receiving surface to capture an image with electric charges accumulated, and image data for processing the electric charges accumulated by the imaging means to generate image data representing an image. A generation unit, an angular velocity detection unit that detects an angular velocity around two axes orthogonal to the optical axis of the photographing optical system, and a shake based on the angular velocity around the two axes detected by the angular velocity detection unit A displacement amount calculating means for calculating a predicted displacement amount of the image forming position on the light receiving surface, and a range in which the image forming position on the light receiving surface can be corrected based on the predicted displacement amount calculated by the displacement amount calculating means. Is displaced in the two directions In an image pickup apparatus with a shake correction function, which comprises shake correction means for correcting image shake on a light-receiving surface due to shake, the predicted displacement amount calculated by the displacement amount calculation means during exposure can be corrected by the shake correction means. When the value exceeds the range, the electric charge accumulated in the image pickup means by the exposure so far is transferred and held, and the exposure is temporarily interrupted, and the image formation position on the light receiving surface is set to the above-mentioned position during the exposure interruption. The image data generating means further comprises an exposure control means for displacing the image data in the center of the correctable range by the shake correcting means, resuming the exposure, and closing the shutter to finish the exposure when the remaining exposure time has elapsed. However, with the shake correction function, the charges accumulated in the image pickup means are separately processed before and after the interruption of the exposure to generate image data representing two images. It resides in the shadow system.

According to the above-mentioned structure of the first aspect, the image pickup means picks up an image by the charges accumulated by photoelectrically converting the subject image formed on the light receiving surface by the photographing optical system, and the image data generating means. Processes the electric charges accumulated by the image pickup means to generate image data representing an image. The displacement amount calculation means calculates the predicted displacement amount of the image formation position on the light receiving surface due to the shake based on the angular velocities around the two axes orthogonal to the optical axis of the photographing optical system detected by the angular velocity detection means, Based on the predicted displacement amount calculated by the shake correcting means, the image forming position on the light receiving surface is displaced in two directions within the correctable range to correct the image shake on the light receiving surface due to the shake. Then, when the predicted displacement amount calculated by the displacement amount calculation means during exposure exceeds the correctable range by the shake correction means, the exposure control means transfers and holds the charge accumulated in the image pickup means by the previous exposure. At the same time, the exposure is temporarily interrupted, and the image-forming position on the light-receiving surface is displaced to the center of the correctable range by the shake compensator during the exposure interruption, and then the exposure is restarted, and the remaining exposure time elapses. At that point, the shutter is closed to end the exposure, and the image data generation means separately processes the charges accumulated in the imaging means before and after the interruption of the exposure to generate the image data representing two images. Two image data, each of which has no image blur, can be obtained by photographing once.

According to a second aspect of the present invention, in the image pickup apparatus with a shake correction function according to the first aspect, the image pickup means photoelectrically converts an image of a subject formed on the light receiving surface to accumulate charges. And a transfer unit which is provided along the light receiving unit so as to be shielded from light and temporarily stores electric charges transferred from the light receiving unit under the control of the exposure control unit. Is configured to separately process the electric charge accumulated in the transfer unit before the exposure interruption and the electric charge accumulated in the light receiving unit after the exposure interruption to separately process the two images. The present invention resides in an image pickup apparatus with a shake correction function characterized by generating data.

According to a second aspect of the present invention, the image pickup means photoelectrically converts the image of the subject formed on the light receiving surface of the light receiving portion to accumulate charges, and is shielded from light along the light receiving portion. The transfer section provided is adapted to temporarily store the charge transferred from the light receiving section under the control of the exposure control means, and the charge stored before the interruption of the exposure stored in the transfer section, Since the image data generating means separately processes the charges accumulated in the light receiving portion after the interruption of the exposure to generate two image data, the charges of the light receiving portion are transferred to the transfer portion during the interruption of the exposure. Only the image forming position needs to be adjusted to the center of the correctable range by the shake correcting unit, and two image data without image shake can be obtained by the short interruption required for displacing the image forming position to the center of the correctable range.

According to a third aspect of the present invention, in the image pickup apparatus with a shake correction function according to the first or second aspect, the two image data generated by the image data generating means are temporarily stored separately. Means and an image synthesizing means for obtaining one synthesized image data by synthesizing the two image data stored in the temporary storage means by making the pixel positions before and after the exposure interruption coincide and then synthesizing them. The image pickup apparatus with a shake correction function further comprises a recording medium for recording the combined image data obtained by the combining unit.

According to the third aspect of the present invention, the two image data generated by the image data generating means are temporarily stored separately in the temporary storage means, and the two stored image data are exposed by the image synthesizing means. Since the pixel positions before and after the interruption are matched and then added together to obtain one combined image data, and the combined image data obtained by the image combining means is recorded in the recording medium, each image of the two image data is recorded. Is underexposure, but is obtained by aligning two image data and then adding them together, and one combined image data recorded on the recording medium has sufficient exposure at the added portion and no image blurring. Has become.

According to a fourth aspect of the present invention, in the image pickup apparatus with a shake correction function according to the third aspect, the image synthesizing means treats a portion of the two image data which is not overlapped as the unnecessary information. It exists in a photographing device with a shake correction function, which is characterized by generating a composite image data by discarding and overlapping.

According to the structure described in claim 4, in obtaining one combined image data, the image synthesizing means discards a non-overlapping portion of two image data generated by the synthesizing as unnecessary information, and generates data by the overlapping portion. Therefore, the combined image data does not include image shake and underexposure data.

According to a fifth aspect of the present invention, in the image pickup apparatus with a shake correction function according to the fourth aspect, when an image is reproduced and displayed or printed by the composite image data,
The image pickup apparatus with a shake correction function further includes an image enlargement unit that enlarges an image so that at least one of an aspect ratio and the number of pixels is the same as a normal image.

According to the structure of claim 5, when the image is reproduced and displayed by the composite image data or when the image is printed,
Since the image enlarging means enlarges the image so that at least one of the aspect ratio and the number of pixels is the same as the normal image, the non-overlapping portion of the two image data generated by the synthesis is discarded, and the aspect ratio or the number of pixels. Even if is different from the normal image, the image displayed or printed by enlargement can be made the same as the normal screen.

According to a sixth aspect of the present invention, in the image pickup apparatus with a shake correction function according to any one of the first to fifth aspects, an ON state in which the exposure control means is selectively operated,
The image pickup apparatus with a shake correction function further includes a selection unit that selects one of the OFF states that do not work.

According to the sixth aspect of the present invention, the exposure control means can be selectively operated or not operated by the selection means. Therefore, even if a large shake occurs, shake correction is performed so as not to cause image shake. The photographer's will is free to choose.

[0020]

BEST MODE FOR CARRYING OUT THE INVENTION The present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing an embodiment of a photographing apparatus according to the present invention, and schematically shows a schematic configuration of a digital still camera with a shake correction function.

In FIG. 1, a digital still camera with a shake correction function is a photographing optical system 1 built in a camera body.
1, the image of the subject is formed on the light receiving surface 13a of the image pickup means 13 which is also a charge-coupled device (CCD) built in the camera body, and the subject image formed on the light receiving surface 13a is photoelectrically converted. The image is photographed by the accumulated electric charge, and the image blur caused by camera shake at the time of photographing is corrected so that the influence of the shake on photographing is minimized.

More specifically, the photographing optical system 11 includes a zoom lens 11A and a focus lens 11 as image pickup lenses.
B, and the image pickup means 13 is provided on the extension of the optical axis 11C.
A shutter 14 that controls the incidence of light on the light-receiving surface 13a of the image pickup unit 13 by opening and closing is provided between and.
When the shutter 14 is opened, a subject image is formed on the light receiving surface 13a of the image pickup means 13 via the photographing optical system 11, so that the charges photoelectrically converted from the subject image are transferred to the image pickup means 13 in pixel units. Accumulated. The charges accumulated in the image pickup unit 13 are processed by the image data generation circuit 16 in pixel units, and then used to generate image data representing an image of a subject. In generating the image data, the color and luminance information of the pixel, which is the analog value of the charge amount, is converted into a digital value. The image data converted into the digital value is taken into a microcomputer (microcomputer) 15 built in the camera body and recorded as photographing information in a portable recording medium 18 including a non-volatile memory such as an IC memory. It

FIG. 2 schematically shows an example of the structure of the image pickup means 13. The image pickup means 13 has a photodiode 3a as a pixel.
Have. The photodiodes 3a are arranged in a predetermined number in the horizontal and vertical directions. A vertical transfer register 3b, which is a transfer unit formed by a charge-coupled device (CCD), is provided for each column in the vertical direction of the photodiode, and each photodiode 3a vertically charges the charge (signal) accumulated by photoelectric conversion. By outputting to the corresponding part of the transfer register 3b, it is transferred to the vertical transfer register 3b and temporarily held there until further transfer.

Each vertical transfer register 3b is also a CCD.
Connected to the horizontal transfer register 3c formed by the above, and sequentially outputs the signal output from each photodiode to the corresponding portion of the horizontal transfer register. Further, the output of the horizontal transfer register 3c is connected to an image data generation circuit 16 which processes the accumulated charges to generate image data representing an image, and the image data generated here is fetched by the microcomputer 15. The vertical transfer register 3b and the horizontal transfer register 3c are shielded from light. Control signals from the microcomputer 15 control the output of signals from the photodiodes to the vertical transfer registers, the transfer of signals in the vertical transfer registers, and the transfer of signals in the horizontal transfer registers.

The microcomputer 15 is composed of a memory for storing programs and data, a central processing unit (microcomputer) which operates according to the programs stored in the memory, and the like.

The digital still camera also has an optical axis 11C.
Two axes x and y that are orthogonal to and orthogonal to each other
The x-axis angular velocity sensor 17ax and the y-axis angular velocity sensor 17ay, which detect the angular velocities around the respective axes and output detection signals according to the magnitude of the detected angular velocities, and the detection signals output by the respective angular velocity sensors are amplified to a predetermined level. Do x
Axis sensor amplifier 17bx and y-axis sensor amplifier 17b
y, which are built into the camera body.

The x-axis angular velocity sensor 17ax and the x-axis sensor amplifier 17bx detect the angular velocity around the axis x.
The axial angular velocity detecting means 17x is replaced by the y-axis angular velocity sensor 17ay.
The y-axis sensor amplifier 17by constitutes a y-axis angular velocity detecting means 17y for detecting an angular velocity around the axis y, and as a whole, detects an optical axis of the photographing optical system and shakes in two directions orthogonal to each other, and detects the shake. A shake detection unit that outputs a detection signal corresponding to the magnitude of the shake in the two directions is configured.

The microcomputer 15 uses the x-axis angular velocity detecting means 17
The detection signals corresponding to the detected angular velocities output by the x- and y-axis angular velocity detection means 17y are digitally converted at a predetermined sampling period and are respectively captured, and the captured detection signals are integrated to determine the camera "for each axis. The tilt angle due to shake "is calculated. Then, microcomputer 1
Numeral 5 predicts the amount of movement of the image formed on the light receiving surface 13a of the image pickup means 13 on the light receiving surface 13a in the axis x direction and the axis y direction based on the calculated tilt angle by a predetermined calculation formula. Each is obtained as a displacement amount, and the image forming position on the light receiving surface is displaced in each of the two directions by the obtained displacement amount. As a result, the microcomputer 15 constitutes a displacement amount calculation means for calculating the predicted displacement amount of the image forming position on the light receiving surface due to the shake based on the detected angular velocities around the two axes.

The calculation of the predicted displacement amount by the microcomputer 15 is performed by the amount of movement of the image on the light receiving surface 13a caused by the camera tilting by the tilt angle calculated for each axis, that is, the image formation on the light receiving surface 13a. The amount of movement of the position in the axis x direction and the axis y direction is calculated and obtained.

The digital still camera also moves the light-receiving surface 13a of the image pickup means 13 independently in the x-axis direction and the y-axis direction based on the calculated predicted displacement amounts in the x-axis direction and the y-axis direction. An x-direction correction actuator 19ax and a y-direction correction actuator 19ay for returning the imaging position moved on the light receiving surface 13a to the original position,
It has an x-direction correction drive circuit 19bx and a y-direction correction drive circuit 19by for driving the x-direction correction actuator 19ax and the y-direction correction actuator 19ay, respectively, which are built in the camera body.

The above-mentioned x-direction correction actuator 19a
The x and x direction correction drive circuit 19bx is the x direction shake correction means 19x, and the y direction correction actuator 19ay and the y direction correction drive circuit 19by are the y direction shake correction means 1.
9y respectively, and based on the calculated predicted displacement amount for shake correction, x-direction shake correction means 19x and y
Along with the microcomputer 15 for controlling the correction driving operation for operating the direction shake correcting means 19y to return the image forming position moved on the light receiving surface 13a to the original position by the shake, the optical axis of the photographing optical system and two directions orthogonal to each other. In addition, shake correction means for independently displacing the image forming position on the light receiving surface is configured. In addition, the light receiving surface 13a of the image pickup means 13 is provided by the shake correction means
There is a limit to the amount that can be moved, and this determines the correctable range in which image blur can be corrected.

The digital still camera further includes a switch (not shown) which is turned on / off by operating a shake correction button 21 provided on the outside of the camera body, as a selection means for selecting whether to activate or stop the shake correction function. As an imaging lens of the system 11, there are a zoom control unit 23A and a focus control unit 23B that drive the zoom lens 11A and the focus lens 11B to control zoom and focus, respectively, and these are built in the camera body.

The microcomputer 15 also has a shake correction button 21.
In addition to the processing for shake correction performed based on the signal of a switch (not shown) that is turned on and off by the operation of, the zoom control unit is operated based on the operation of the zoom operation button 25A and the release operation button 25B provided outside the camera body. 23A and the focus control unit 23B, the zoom lens 11A and the focus lens 1 of the photographing optical system 11
Other processes such as zoom driving and focus driving of 1B are also performed.

The microcomputer 15 further performs drive control of the shutter 14 via the shutter control section 23C based on the operation of the release operation button 25B, and also receives light through the photographing optical system 11 by opening the shutter 14. The subject image formed on the surface 13a is photoelectrically converted, and the image data generating circuit 16 processes the electric charges accumulated in the image pickup means 13 to perform control processing for controlling generation of image data representing an image.

Furthermore, when the predicted displacement amount calculated during the exposure in the state where the shutter 14 is opened in response to the operation of the release operation button 25B exceeds the correctable range, the microcomputer 15 takes an image by the exposure until then. The charges accumulated in the light receiving portion 3a (FIG. 2) of the means 13 are transferred to and held in the vertical transfer portion 3b, and the shutter 14 is closed to interrupt the exposure temporarily, and the light receiving surface 13a is interrupted during the interruption of the exposure. After the image forming position above is displaced to the center of the correctable range by the shake correcting means 17, the shutter 14 is opened to restart the exposure, and when the remaining exposure time has elapsed, the shutter is closed to end the exposure. Exposure control processing. The exposure time is determined by the microcomputer 15 according to the brightness of the subject measured by an exposure meter (not shown).

When the microcomputer 15 performs the above-mentioned exposure control processing, the charges accumulated from the opening of the shutter 14 to the interruption of exposure are stored in the vertical transfer portion 3b of the image pickup means 13, and the exposure is interrupted in the light receiving portion 3a. Charges accumulated until the rear shutter 14 is closed exist, and in such a case, the image data generation circuit 16 is under the control of the microcomputer 15 before and after the interruption of the exposure, the vertical transfer unit 3b and the light receiving unit 3a. Charge separately stored in each
Image data representing one image is generated.

The microcomputer 15 includes an image data generation circuit 16
When the two image data generated by the
The two frame memories as temporary storage means formed in M are temporarily stored separately, and the two temporarily stored image data are added up after matching the pixel positions before and after the exposure interruption. An image combining process is performed to obtain one combined image data, and the combined image data obtained by this process is recorded in the portable storage medium 18.

The microcomputer 15 performs the image pickup means 1 at the time when the exposure is interrupted when the pixel positions are matched.
The difference between the position 3 and the known position when the position is returned to the center of the correction control range during the interruption is calculated, and the pixels whose positions are different by the amount corresponding to this difference are accumulated in the electric charge at the same point of the subject image. One pixel of the combined image data corresponding to the image data obtained by the original exposure time based on the two image data by summing the data at the same point of the two image data, that is, adding the charges together. To get

When the microcomputer 15 performs the above-mentioned image combining process, the part of the two image data which does not overlap due to the combining is discarded as unnecessary information because the incomplete short exposure time is the image data part. Then, the composite image data is generated only by the overlapping portion of the two image data.

The composite image data described above has a different aspect ratio and a smaller number of pixels than the normal image data due to the discarding of the unnecessary information.
Therefore, when the image is reproduced and displayed by the combined image data, or when the image is printed, an image enlargement process is performed to enlarge the image so that at least one of the aspect ratio and the number of pixels is the same as the normal image. The same size display and printing as usual can be obtained.

It should be noted that the exposure control process as described above is not always performed, but it is selectively performed by operating a selection button (not shown) so that the photographer can turn off the work when he / she does not need it. It is preferable to be able to select one of the ON state in which it does not work and the OFF state in which it does not work.

With the above configuration, the shake correction button 21
In the normal shake correction when the shake correction function is activated by turning on, the microcomputer 15 shakes the optical axis 11C of the photographing optical system 11 with respect to the image pickup means 13 and two axes x and y orthogonal to each other. Occurs, x
An x-axis angular velocity detection means 17x including an axial angular velocity sensor 17ax and an x-axis sensor amplifier 17bx, and a y including a y-axis angular velocity sensor 17ay and a y-axis sensor amplifier 17by.
The detection signals corresponding to the angular velocities respectively generated by the shaft angular velocity detection means 17y are digitally converted at the first predetermined sampling period and fetched. Then, the microcomputer 15 detects the tilt angle based on the fetched detection signal, and calculates the predicted displacement amount for shake correction based on the tilt angle.

Further, the microcomputer 15 outputs a drive signal to the correction drive circuits 19bx, 19by of the shake correction means 19x, 19y based on the calculated predicted displacement amount to drive the correction actuators 19ax, 19ay. . Driven correction actuators 19ax, 19a
For y, the image pickup means 13 is moved in a plane orthogonal to the optical axis 11C to perform a shake correction operation in the horizontal direction which is the x-axis direction and the vertical direction which is the y-axis direction.

The outline of the digital still camera with the shake correction function has been described above. The details will be described below with reference to the flowcharts of FIGS. 3 and 4 showing the processing performed by the microcomputer 15.

The microcomputer 15 has a release operation button 25.
Throughout the period before and after B, normal shake correction processing such as angular velocity detection, tilt angle calculation, predicted displacement amount calculation for shake correction, and shake correction drive is always performed. During this period, the microcomputer 15 which is performing the shake correction operation, releases the release operation button 25B.
When is turned on, first, the image pickup means 13 is moved to a predetermined center position of the correctable range, then the processing of the flowchart shown in the figure is started, and the exposure time Tr is set based on the signal from the exposure meter (not shown). Along with the calculation (step S1), a shutter open signal for opening the shutter 14 is output to the shutter control unit 23C to open the shutter 14 (step S2), and then the time measurement of the time T is started (step S3). ). At the time when the time T after opening the shutter 14 has passed the exposure time calculated above for forming the subject image on the light receiving surface 13a and accumulating charges (step S
(When 4 is Y), a shutter close signal is output to the shutter controller 23C to close the shutter 14 (step S5).

The microcomputer 15 has a release operation button 25.
Throughout the period before and after B, normal shake correction processing such as angular velocity detection, tilt angle calculation, predicted displacement amount calculation for shake correction, and shake correction drive is always performed. However, if the predicted displacement amount calculated for shake correction exceeds the correctable range when the exposure time has not elapsed (step S6 is Y
In this case, it is determined that the image blur cannot be eliminated even by performing the shake correction based on the predicted displacement amount, and at this time, the shutter 14 is closed to stop the exposure so that the exposure is ended (step S7). It is possible to prevent the charge component due to the image shake from entering the charge accumulated by performing photoelectric conversion of the subject image by exposure while performing shake correction.

Then, the microcomputer 15 starts clocking for a predetermined fixed time t (described later), and the shutter 14
While the shutter is closed, a control signal is output to the image data generation circuit 16 and the shutter 1 is output to the image data generation circuit 16.
The electric charge accumulated in the light receiving portion 3a of the image pickup means 13 is transferred to the vertical transfer portion 3b before closing 4 (step S9).
Further, the microcomputer 15 shake-corrects a return correction process for returning the image pickup means 13 moved to a position displaced by the shake correction operation to a predetermined center position of the correctable range while the shutter 14 is closed. The processing is performed (step S10). This return correction processing is performed by the image pickup means 1
3 is returned to the center of the correctable range, and for this purpose it is necessary to calculate the return amount. In this return amount calculation, the position of the image pickup means 13 is always grasped and the shutter 104
It is possible to obtain the difference between the position of the image pickup means 13 and the known return position at the time when the exposure is interrupted by closing.

Further, the microcomputer 15 calculates the remaining exposure time Tr2 by subtracting the exposure time Tr1 until the exposure is interrupted from the exposure time Tr calculated in step S1 before and after instructing the above-mentioned return correction processing. (Step S
11). After that, the microcomputer 15 waits for a lapse of a certain time t (step S12), outputs a shutter open signal to the shutter control unit 23C to open the shutter 14 (step S13), and the time T thereafter. The measurement is started (step S14). When the time T after opening the shutter 14 has elapsed the above-mentioned remaining exposure time Tr2 calculated for forming the subject image on the light receiving surface 13a and accumulating charges (when step S15 is Y), the shutter controller A shutter close signal is output to 23C to finally close the shutter 14 (step S16).

After closing the shutter 14 in step S6 or step S16, the microcomputer 15 instructs the image data generation circuit 16 to generate image data (step S17), but the contents are largely different. In the former case, the charges held in the light receiving section 3a of the image pickup means 13 may be processed to generate image data representing one image. Further, the generated image data may be captured and recorded in the recording medium 18.

On the other hand, in the latter case, after the exposure is restarted, the shake correction operation is performed as before, and the shake-corrected subject image is formed on the light receiving surface 13a of the image pickup means 13. Is imaged, and electric charges obtained by photoelectrically converting the subject image are accumulated in the light receiving portion 3a. Therefore, the charges accumulated in the image pickup means 13 corresponding to the subject image formed before the exposure is interrupted are accumulated in the vertical transfer portion 3b in correspondence with the subject image formed after the exposure is restarted. Are stored in the light receiving section 3a, the microcomputer 15 outputs a control signal to the image data generating circuit 16, and the microcomputer 15 holds the control signals in the light receiving section 3a and the vertical transfer section 3b. The stored charges are processed separately to generate image data representing the two images.

When two pieces of image data are generated based on the charges accumulated in the image pickup means 13 before and after the interruption of exposure and after the interruption is restarted, the microcomputer 15 is a RAM as shown in FIG.
Two image data D1 and D are stored in two frame memories FM1 and FM2 formed as a temporary storage means in the inside.
2 is temporarily stored separately, and the stored two pieces of image data D1 and D2 are added together after the pixel positions before and after the exposure interruption are made coincident to be combined to obtain one combined image data. I do. In obtaining the synthetic image data, as shown by hatching in FIG. 5, the non-overlapping portion of the two image data generated by the synthesis is discarded as unnecessary information, and the synthetic image data is generated by the overlapping portion. The combined image data obtained by the image combination is recorded in the recording medium 18. The frame indicated by the alternate long and short dash line in FIG. 5 indicates the correctable range.

According to the above-described embodiment of the present invention, the image pickup means 13 photographs the object image formed on the light-receiving surface 13a by the photographing optical system 11 by photoelectric conversion to photograph an image, and image data is obtained. The generation circuit 16 uses the image pickup means 13
To generate image data representing an image. The microcomputer 15 uses the angular velocity detecting means 17x and 17y.
Based on the angular velocities around the two axes orthogonal to the optical axis of the photographing optical system 11 detected by, the predicted displacement amount of the image forming position on the light receiving surface 13a due to the shake is calculated, and the calculated predicted displacement amount is Based on this, the shake correction means 19x and 19y displace the image forming position on the light receiving surface 13a in two directions within the correctable range to correct the image shake on the light receiving surface 13a due to the shake.

Then, when the predicted displacement amount calculated by the microcomputer 15 during the exposure in which the shutter 14 is opened by the operation of the release operation button exceeds the correctable range by the shake correcting means 19x, 19y, the microcomputer 15 performs the previous exposure. The electric charge accumulated in the image pickup means 13 is transferred and held by the image pickup means 13 and the exposure is temporarily stopped. During the interruption of the exposure, the image forming position on the light receiving surface 13a is corrected by the shake correction means 19x, 1
The exposure is restarted after being displaced to the center of the correctable range by 9y, and the shutter 1 is released when the remaining exposure time elapses.
4 to close the exposure, and the image data generation circuit 16
The electric charges accumulated in the image pickup means 13 before and after the interruption of the exposure are separately processed to generate image data representing two images. Therefore, each shooting does not result in image blurring.
One image data can be obtained.

Specifically, the image pickup means 13 is provided such that the light receiving portion 3a photoelectrically converts the image of the subject formed on the light receiving surface 13a to accumulate charges, and is shielded along the light receiving portion 3a. The transferred vertical transfer unit 3b is configured to temporarily store the electric charge transferred from the light receiving unit 3a under the control of the microcomputer 15, and is stored before the interruption of the exposure stored in the vertical transfer unit 3b. The image data generation circuit 16 separately processes the electric charges and the electric charges accumulated in the light receiving unit 3a after the interruption of the exposure to generate two image data. Therefore, it is only necessary to transfer the charges of the light receiving portion 3a to the vertical transfer portion 3b during the interruption of the exposure, and the interruption for a short time necessary for displacing the image forming position to the center of the correctable range by the shake correcting means 19x and 19y. Thus, two image data without image blur can be obtained.

Further, the two image data generated by the image data generation circuit 16 are temporarily stored separately in two frame memories formed in the memory of the microcomputer 15, and the two stored image data are stored in the microcomputer 15 by the microcomputer 15. By the image combining process, the pixel positions before and after the exposure interruption are made coincident and then added together to obtain one combined image data, and the combined image data obtained by the image combining process is stored in the recording medium 18.
To record. Therefore, although the respective images of the two image data are underexposed, the two image data are aligned and then obtained, and one combined image data recorded on the recording medium 18 is the added portion. Thus, the exposure is sufficient and the image blur does not occur, and an image without the image blur can be obtained even if a large shake occurs.

In obtaining one combined image data by the image combining process, the non-overlapping part of the two image data generated by the combining is discarded as unnecessary information, and the data is generated by the overlapping part. Image blurring and underexposure data are not included, and an image of the same quality as the normal image can be obtained by the combined image data although the size is different from the normal image.

Further, since the image obtained from the combined image data has a small aspect ratio or the number of pixels unlike the normal image, the size of the aspect ratio or the number of pixels is the same as that of the normal image during reproduction display or printing. By enlarging the image, an image without image blur that is the same in size as the normal image can be obtained. However, in this case, the image becomes rougher by the amount of enlargement, but there is no problem in quality when the enlargement ratio is not so large.

Since the exposure control process can be selectively activated or deactivated, and whether or not the shake is corrected so as not to cause the image shake even when a large shake occurs, the photographer can freely select it. It can also be used when the photographer consciously wants to capture the image blur.

[0059]

As described above, according to the first aspect of the present invention, when the image blur exceeds the correctable range that can be corrected by displacing the image forming position on the light receiving surface, the image forming is performed once. By returning the position to the center of the correctable range and then taking the remaining shots separately from the previous shots, even if a large image shake that exceeds the correctable range occurs, each image will be captured in one shot. Although the image data is in the form of two image data without shake, image data without image shake can be obtained.

According to the second aspect of the present invention, it is only necessary to transfer the charges of the light receiving portion to the transfer portion during the interruption of the exposure, and it is necessary to displace the image forming position to the center of the correctable range by the shake correcting means. 2 with no image shake due to a short interruption
Since one image data is obtained, it can be realized without giving the photographer a feeling of strangeness that is significantly different from normal photographing.

According to the third aspect of the present invention, the respective images of the two image data are underexposed, but the two image data are aligned and then added together, and recorded on the recording medium. The two combined image data have sufficient exposure in the added portion and no image shake, so that image data that can be handled in the same manner as a normal image can be obtained.

According to the fourth aspect of the invention, the unnecessary information is discarded, and the composite image data is generated by the overlapping portion so that the composite image data does not include image shake and underexposure data. It is possible to obtain image data that can be treated in the same way as a normal image without any processing.

According to the fifth aspect of the present invention, the non-overlapping portions of the two image data generated by combining are discarded, and even if the aspect ratio or the number of pixels is different from that of the normal image, it is displayed or printed by enlarging. Since the generated image is the same as the normal screen, it is possible to obtain an image that is almost indistinguishable from the normal image.

According to the sixth aspect of the present invention, it is possible for the photographer to freely select whether or not to perform the shake correction so as not to cause the image shake even when a large shake occurs.
It does not impair the photographer's intentional shooting with shake.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of a camera body in an embodiment of an image pickup apparatus with a shake correction function according to the present invention.

FIG. 2 is a diagram schematically showing a configuration of an image pickup means in FIG.

FIG. 3 is a flowchart showing a part of processing performed by a microcomputer shown in FIG.

FIG. 4 is a flowchart showing another part of the processing performed by the microcomputer in FIG.

5 is an explanatory diagram for explaining an image combining process performed by the microcomputer in FIG. 1. FIG.

[Explanation of symbols]

11 photographing optical system 11C optical axis 13 imaging means 13a light receiving surface 14 shutter 15 microcomputer (displacement amount calculating means, exposure control means, image synthesizing means, image enlarging means) 16 image data generating circuit (image data generating means) 17x, 17y shake Detecting means (angular velocity detecting means) 18 Recording media 19x, 19y Shake correction means 21 Shake correction button 25B Release operation button 3a Light receiving section 3b Vertical transfer section x, y axes

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 5/335 H04N 5/335 P // H04N 101: 00 101: 00 F term (reference) 2H002 GA41 GA42 GA46 2H081 AA41 DD00 5C022 AA00 AA13 AB46 AB55 AC01 AC42 AC69 CA00 5C024 CY22 CY23 CY50 EX04 EX06 GY01 GZ28 HX28 HX58

Claims (6)

[Claims] 1. A photographing optical system and a light-receiving surface on which an image of a subject is formed by the photographing optical system, and the charge is accumulated by photoelectrically converting the subject image formed on the light-receiving surface. Image pickup means for picking up an image, image data generating means for processing the charges accumulated by the image pickup means to generate image data representing the image, and angular velocity about two axes orthogonal to the optical axis of the photographing optical system. An angular velocity detecting means for detecting the angular velocity, and a displacement amount calculating means for calculating a predicted displacement amount of the imaging position on the light receiving surface due to a shake based on the angular velocity around the two axes detected by the angular velocity detecting means. A shake that corrects the image shake on the light receiving surface due to the shake by displacing the imaging position on the light receiving surface in the two directions within the correctable range based on the predicted displacement amount calculated by the displacement amount calculating means. Shake correction machine including correction means In the imaging device with performance, the predicted displacement amount calculated by the displacement amount calculating means during exposure is
When exceeding the correctable range by the shake correction means, the electric charge accumulated in the image pickup means by the exposure so far is transferred and held, and the exposure is temporarily interrupted, and the light receiving surface is interrupted during the exposure interruption. Exposure control means for displacing the above image forming position to the center of the correctable range by the shake correction means, restarting exposure, and closing the shutter and terminating the exposure when the remaining exposure time elapses. Further, the image data generating means separately processes the charges accumulated in the image pickup means before and after the interruption of the exposure.
An image pickup apparatus with a shake correction function, which is characterized by generating image data representing one image. 2. The image pickup apparatus with a shake correction function according to claim 1, wherein the image pickup unit photoelectrically converts an image of a subject formed on the light receiving surface to accumulate charges, and the light receiving unit. And a transfer unit that is provided along the section so as to be shielded from light and temporarily stores the charges transferred from the light receiving unit under the control of the exposure control unit, and the image data generation unit stores the charge in the transfer unit. The electric charge accumulated before the interruption of the exposure and the electric charge accumulated after the interruption of the exposure accumulated in the light receiving unit are separately processed to generate the two image data. An imaging device with a shake correction function. 3. The image-capturing device with a shake correction function according to claim 1, wherein the two image data generated by the image data generation unit are temporarily stored separately, and the temporary storage unit. The image data stored in the image storage means, the image positions before and after the exposure interruption are made coincident, and the image data are combined to obtain one combined image data; and a combined image obtained by the image combining means. An image pickup apparatus with a shake correction function, further comprising: a recording medium for recording data. 4. The image pickup apparatus with a shake correction function according to claim 3, wherein the image synthesizing unit discards a non-overlapping portion of the two image data generated by the synthesizing as unnecessary information, and a superimposing image is formed by the overlapping portion. An imaging device with a shake correction function, which is characterized by generating data. 5. The image pickup apparatus with a shake correction function according to claim 4, wherein at least one of an aspect ratio and the number of pixels is the same as a normal image when the image is reproduced and displayed or printed by the composite image data. An image pickup apparatus with a shake correction function, further comprising image enlargement means for enlarging an image. 6. The image pickup apparatus with a shake correction function according to claim 1, further comprising a selection unit that selects one of an ON state in which the exposure control unit is selectively activated and an OFF state in which the exposure control unit is not activated. An image pickup apparatus with a shake correction function, which is provided.