JP2011155420A - Camera shake correction device, imaging processing method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To relatively enlarge a camera shake correctable range when picked-up images are blurred due to something other than a camera shake. <P>SOLUTION: An imaging apparatus 100 includes: a camera shake amount detection part 4 for successively detecting a camera shake amount when imaging an object; a stage driving part 6a for successively driving a stage part so as to correct the successively detected camera shake amount; a blur amount-specifying part 5 for specifying a blur amount generated in the picked-up image due to something other than the camera shake; and a correction control part 6b for controlling the drive of the stage part by the stage driving part so as to weaken the strength of camera shake correction processing as the specified blur amount increases. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a camera shake correction apparatus that performs camera shake correction when imaging a subject, an imaging processing method, and a program.

Conventionally, an imaging apparatus having a camera shake correction mechanism is known, and is configured to be able to select whether to use the camera shake correction mechanism for camera shake correction or to obtain a soft focus effect by a photographer's selection. (See, for example, Patent Document 1).
In addition, an imaging apparatus configured to obtain a soft focus effect by using a camera shake correction mechanism when camera shake correction is unnecessary is also known (see, for example, Patent Document 2).

Japanese Patent Laid-Open No. 2002-218312 JP-A-5-241064

By the way, the maximum drivable range of the image sensor and the lens for absorbing the shake component is limited by the mechanism of the apparatus. In other words, the maximum drivable range is set wider than the amplitude of the average camera shake frequency, but if a large camera shake occurs, the maximum drivable range will be exceeded and a sufficient camera shake correction effect will be obtained. It becomes impossible. In this case, the camera shake component that could not be absorbed even by the movement of the image sensor or the lens appears as a blur of the captured image, specifically, a directional blur (blur) if it is a still image.
On the other hand, in addition to the blur of the captured image as described above, blur caused by poor focus accuracy, blur that is intentionally set by the photographer, blur that is not intended but acceptable to the viewer, etc. There is. Further, the same image quality can be obtained even in an image in which flare is generated due to backlight or an image shot in a dark environment where the edge of the captured image is not easily sharpened.

  However, when blurring caused by other than the above-described camera shake is large, it is not meaningful to increase the accuracy of camera shake correction. In this case, if the image sensor or the lens is driven at a high speed in order to follow the detected camera shake, there is a problem that power consumption and driving sound increase.

  Accordingly, an object of the present invention is to provide a camera shake correction device, an imaging processing method, and a program capable of relatively expanding a camera shake correction possible range when a blur occurs due to other than camera shake in a captured image. is there.

In order to solve the above-described problem, the camera shake correction device according to the invention described in claim 1
A detection unit that sequentially detects the amount of camera shake when the subject is imaged by the imaging unit; a driving unit that sequentially drives the correction movable unit so as to correct the amount of camera shake sequentially detected by the detection unit; and the imaging unit. The specifying means for specifying the amount of blur caused by other than camera shake in the captured image to be picked up, and the correction by the driving means so as to decrease the strength of the camera shake correction processing as the amount of blur specified by the specifying means increases And a correction control means for controlling the driving of the movable part.

According to a second aspect of the present invention, in the camera shake correction device according to the first aspect,
The amount of blur caused due to camera shake other than camera shake is predicted based on the amount of blur actually measured with respect to the main subject included in the subject when the subject is imaged by the imaging unit, and based on the main subject. It is characterized in that it includes at least one of a blur amount to be performed, a blur amount specified based on a user operation, and a blur amount allowable at the time of viewing.

According to a third aspect of the present invention, in the camera shake correction device according to the first or second aspect,
A setting unit configured to set a soft focus processing mode for intentionally blurring a captured image captured by the imaging unit; and the correction control unit is configured to set the soft focus processing mode when the setting unit sets the soft focus processing mode. Control is performed to reduce the strength of the camera shake correction processing.

According to a fourth aspect of the present invention, in the camera shake correction device according to any one of the first to third aspects,
The correction control means includes a specifying means for specifying at least one of a movement amount and a moving speed of the correction movable unit driven by the driving means with respect to a camera shake amount detected by the detection means, Control is performed such that at least one of the moving amount and moving speed of the correction movable portion specified by the specifying means is reduced as the blur amount specified by the means increases.

According to a fifth aspect of the present invention, in the camera shake correction device according to the fourth aspect,
The correction control unit is configured to specify the correction unit specified by the specifying unit so that a movement amount of the correction movable unit within a new predetermined unit period is smaller than a movement amount of the previous predetermined unit period. It is characterized by controlling the amount of movement of the movable part.

According to a sixth aspect of the present invention, in the camera shake correction device according to the fourth aspect,
The correction control means sets a limit value of at least one of a maximum movement amount of the correction movable part by the driving means, an average movement amount within a predetermined time, a maximum movement speed, and an average movement speed within a predetermined time. It is characterized by changing.

The invention described in claim 7 is the camera shake correction device according to any one of claims 1 to 3,
The correction control means controls the positioning operation for moving the correction movable part to the center of the drivable range by the driving means, and the positioning by the driving means increases as the blur amount specified by the specifying means increases. It is characterized by controlling to increase the intensity of operation.

The imaging processing method of the invention according to claim 8 is:
Camera shake correction comprising detection means for sequentially detecting the amount of camera shake during imaging of a subject by the imaging means, and drive means for sequentially driving the correction movable unit so as to correct the amount of camera shake sequentially detected by the detection means In the imaging processing method using the apparatus, a process for identifying a blur amount caused by a non-shake in a captured image captured by the imaging unit, and a strength of the camera shake correction process as the identified blur amount increases. And a process of controlling the drive of the correction movable part by the driving means so as to weaken the driving means.

The program of the invention according to claim 9 is:
The computer of the camera shake correction apparatus sequentially drives the correction movable unit so as to correct the camera shake amount sequentially detected by the detection control unit and the detection control unit that sequentially detects the amount of camera shake when the subject is imaged by the imaging unit. Drive control means, specifying means for specifying the amount of blur caused by camera shake other than camera shake captured by the image pickup means, and the strength of camera shake correction processing is reduced as the amount of blur specified by the specifying means increases. The correction control means controls the drive of the correction movable part by the drive control means.

  According to the present invention, it is possible to relatively enlarge the range in which camera shake can be corrected in consideration of blurring caused by other than camera shake in the captured image.

It is a block diagram which shows schematic structure of the imaging device of one Embodiment to which this invention is applied. 3 is a flowchart illustrating an example of an operation related to an imaging operation process performed by the imaging apparatus of FIG. 1. 3 is a flowchart illustrating an example of an operation related to a camera shake correction process in the imaging operation process of FIG. 2. FIG. 4 is a schematic diagram for explaining an operation during the camera shake correction process of FIG. 3. It is a flowchart which shows an example of the operation | movement which concerns on the modification of camera shake correction processing.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.
FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to an embodiment to which the present invention is applied.

The imaging apparatus 100 according to the present embodiment specifies the amount of blur caused by other than camera shake in the captured image of the subject, and the stage unit by the stage driving unit 6a reduces the strength of the camera shake correction processing as the blur amount increases. Control the drive.
Specifically, as illustrated in FIG. 1, the imaging apparatus 100 includes a lens unit 1, an electronic imaging unit 2, a CDS / ADC unit 3, a camera shake amount detection unit 4, a blur amount specifying unit 5, and a camera shake. A correction unit 6, an image processing unit 7, a memory 8, a display control unit 9, a display unit 10, an image recording unit 11, an operation input unit 12, and a central control unit 13 are provided.

  Although not shown, the lens unit 1 includes a zoom lens group and a focus lens group, for example, and the position in the optical axis direction can be adjusted by a lens driving mechanism (for example, a motor).

The electronic imaging unit 2 is composed of, for example, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), and an optical image that has passed through various lenses and a diaphragm (not shown) of the lens unit 1. The electronic imaging unit 2 converts it into a two-dimensional image signal (RGB image data) and outputs it to the CDS / ADC unit 3.
Although illustration is omitted, the electronic imaging unit 2 is mounted on a stage unit that is driven in an XY direction (for example, a horizontal direction or a vertical direction) by a stage driving unit 6a (described later) of the camera shake correction unit 6. .
Here, the lens unit 1 and the electronic imaging unit 2 constitute imaging means for imaging a subject.

  The CDS / ADC unit 3 receives an image signal composed of RGB color components corresponding to the optical image of the subject output from the electronic imaging unit 2 and, if necessary, image data corresponding to the YUV color space (YUV image data). ) Or image data corresponding to the HSV color space (HSV image data) and output to the central control unit 13.

The camera shake amount detection unit 4 includes, for example, an angular velocity sensor, and detects the amount of camera shake when the lens unit 1 and the electronic imaging unit 2 capture an object. Specifically, the camera shake amount detection unit 4 sequentially detects the camera shake amount at predetermined intervals, and outputs camera shake amount data related to the detected camera shake amount to the camera shake correction unit 6.
Here, the camera shake amount detection unit 4 constitutes a detection unit that sequentially detects the amount of camera shake when the subject is imaged by the lens unit 1 and the electronic imaging unit 2.

The blur amount specifying unit 5 specifies the amount of blur generated due to other than camera shake in the captured image captured by the lens unit 1 and the electronic imaging unit 2.
Here, the blur that occurs in the captured image is roughly classified into those that are caused by camera shake and those that are caused by other than camera shake. When a camera shake occurs, the camera shake correction unit 6 corrects the camera shake by moving a stage unit on which the electronic imaging unit 2 is mounted in a predetermined direction (for example, a horizontal direction or a vertical direction). However, when the camera shake becomes larger than the maximum driveable range of the stage unit, the camera shake correction unit 6 cannot correct the camera shake component even by the movement of the stage unit. As a result, the captured image has a directional blur (blur). ) Occurs (see FIG. 4A). For example, in FIG. 4A, in the region where the thick (dark) solid line indicating the drive position of the stage portion extends substantially parallel to the left-right direction, the amount of camera shake (broken line) is the maximum drive of the stage portion. The camera shake component cannot be corrected beyond the possible range, and the captured image is blurred due to the camera shake.
Therefore, the blur amount specifying unit 5 specifies the blur amount other than the directional blur generated in the captured image as the blur amount generated due to the camera shake.

Specifically, the blur amount specifying unit 5, for example, information related to a focus position of a focus lens (not shown) of the lens unit 1 or information related to a high-frequency component of the live view image at the time of live view imaging of a subject. Based on the above, the blur amount may be actually measured by using the main subject included in the subject as a reference. In addition, the blur amount specifying unit 5 calculates, for example, a blur amount that is expected to occur in the captured image based on the main subject, based on information related to the focus position of the focus lens, imaging distance information, and the like. You may specify. Here, examples of the main subject include a person or an object that exists in a substantially central portion within the angle of view, a face person detected by the face detection process, an object, an animal, or a plant detected by the feature detection process. It is done. Note that the face detection process and the feature detection process are known techniques, and thus detailed description thereof is omitted here.
Further, for example, when the soft focus processing mode is set as the imaging mode in accordance with a predetermined operation by the user, the blur amount specifying unit 5 is based on the setting content (for example, the strength of smoothing) of the soft focus processing. Thus, the amount of blur occurring in the captured image may be specified by calculation.
The blur amount specifying unit 5 may calculate and specify a blur amount that is predicted to be acceptable at the time of viewing based on, for example, the set imaging scene mode or the type of the specified subject. .
Here, the blur amount specifying unit 5 constitutes a specifying unit that specifies the amount of blur that is caused due to other than camera shake in the captured image captured by the lens unit 1 and the electronic imaging unit 2.

  The camera shake correction unit 6 corrects camera shake during imaging of a subject, and specifically includes a stage drive unit 6a and a correction control unit 6b.

  The stage drive unit 6a moves the stage unit on which the electronic imaging unit 2 is mounted in the XY directions under the control of the correction control unit 6b. That is, the stage drive unit 6a sequentially drives the stage unit (correction movable unit) as a drive unit so as to correct the camera shake amount sequentially detected by the camera shake amount detection unit 4.

  The correction control unit 6b determines a camera shake correction amount according to the camera shake amount detected by the camera shake amount detection unit 4, and controls the driving of the stage drive unit 6a based on the camera shake correction amount. That is, when the camera shake amount data output from the camera shake amount detection unit 4 is input, the correction control unit 6b receives a camera shake correction amount (for example, a current value necessary for driving the stage drive unit 6a, Energization time, etc.) is calculated, and a control signal for driving the stage drive unit 6a is determined based on the calculated camera shake correction amount. Then, the correction control unit 6b controls the drive of the stage drive unit 6a according to the determined control signal to move the stage unit in the XY directions.

Further, the correction control unit 6b is a stage unit by the stage driving unit 6a so that the blur amount specified by the blur amount specifying unit 5, that is, the blur amount due to other than the hand shake increases, and the strength of the camera shake correction process is reduced. Control the drive.
Specifically, the correction control unit 6b includes a content specifying unit 6c that specifies operation contents such as a moving amount of the stage unit driven by the stage driving unit 6a with respect to the amount of camera shake, and the content specifying unit 6c. Converts the camera shake amount detected by the camera shake amount detection unit 4 into a movement amount (movement distance) of the stage unit. At this time, the correction control unit 6b determines whether or not the converted movement amount of the stage unit is larger than the allowable movement amount (movement distance) corresponding to the blur amount caused by other than the shaking of the stage unit. If it is determined that the movement amount of the stage portion is larger than the allowable movement amount, the content specifying portion 6c is designated to change so that the movement amount of the stage portion is smaller than the allowable movement amount (see FIG. 4B).
More specifically, every time the blur amount specifying unit 5 specifies the amount of blur caused by other than camera shake, the content specifying unit 6c sets the allowable amount of movement of the stage unit by the stage drive unit 6a based on the amount of blur. calculate. Then, every time it is determined that the amount of movement of the stage unit at the current camera shake correction timing is larger than the allowable amount of movement of the stage unit calculated by the content specifying unit 6c, the correction control unit 6b moves the amount of movement of the stage unit. Is designated to be changed by the content designating unit 6c so that is smaller than the allowable movement amount. In this way, the correction control unit causes the content specifying unit 6c to change and specify so that the amount of movement of the stage unit decreases as the amount of blur caused by other than camera shake increases.

  Further, the correction control unit 6b performs control so as to weaken the strength of the camera shake correction processing when the soft focus processing mode is set as the imaging mode. Also in this case, the correction control unit 6b performs the same process as described above, and specifies the content so that the moving amount of the stage unit (correction movable unit) decreases as the processing intensity increases based on the intensity of the soft focus process. It is designated by the part 6c.

  As described above, the correction control unit 6b is a correction control unit that controls the driving of the stage unit by the stage driving unit 6a so that the strength of the camera shake correction process is reduced as the blur amount specified by the blur amount specifying unit 5 increases. It is composed.

  The image processing unit 7 receives the image data output from the central control unit 13 when recording the image data output from the CDS / ADC unit 3, and performs various image processing, compression, and the like on the image data. File. Then, the image processing unit 7 transfers the filed image data to the image recording unit 11.

The image processing unit 7 includes a soft focus processing unit 7a that generates a soft focus image in which a captured image is intentionally blurred.
The soft focus processing unit 7a performs, for example, soft focus processing for smoothing each pixel of the input captured image using an averaging filter having a predetermined size. Here, the processing intensity of the soft focus process can be changed according to the size of the averaging filter used.
Accordingly, the soft focus processing unit 7a performs a soft focus process on the captured image, thereby generating a soft descriptive soft focus image in which the change in shading of the entire image is smoothed.
Note that smoothing of an image related to the soft focus process is a known technique, and thus detailed description thereof is omitted here.

  The memory 8 is composed of, for example, a DRAM or the like, and temporarily stores data processed by the image processing unit 7, the central control unit 13, and the like.

The display control unit 9 performs control for reading display image data temporarily stored in the memory 8 and displaying the read image data on the display unit 10.
Specifically, the display control unit 9 includes a VRAM, a VRAM controller, a digital video encoder, and the like (all not shown). The digital video encoder periodically reads the luminance signal Y and the color difference signals Cb and Cr read from the memory 8 and recorded in the VRAM under the control of the central control unit 13 from the VRAM via the VRAM controller. It reads out, generates a video signal based on these data, and outputs it to the display unit 10.

  The display unit 10 is, for example, a liquid crystal display device, and displays an image captured by the electronic imaging unit 2 on the display screen based on a video signal from the display control unit 9. Specifically, in the still image capturing mode or the moving image capturing mode, the display unit 10 sequentially updates a plurality of image frames generated by capturing an image of the subject by the electronic image capturing unit 2 at a predetermined frame rate. Is displayed.

  The image recording unit 11 includes, for example, a non-volatile memory or the like, and includes recording still image data or a plurality of image frames encoded in a predetermined compression format by an encoding unit (not shown) of the image processing unit 7. Is recorded.

  The operation input unit 12 is for performing a predetermined operation of the imaging apparatus 100. Specifically, the operation input unit 12 includes a shutter button related to an imaging instruction of a subject, a selection determination button related to an instruction to select an imaging mode or a function, a zoom button related to an instruction to adjust the zoom amount, etc. A predetermined operation signal is output to the central control unit 13 in response to the operation of these buttons.

In addition, the selection determination button of the operation input unit 12 centrally controls a setting instruction of a soft focus processing mode that intentionally blurs a captured image in a plurality of imaging modes to make a soft depiction based on a predetermined operation by a user. To the unit 13. The central control unit 13 sets the imaging mode to the soft focus processing mode based on the input setting instruction.
Here, the operation input unit 12 and the central control unit 13 constitute a setting unit that sets a soft focus processing mode for intentionally blurring a captured image captured by the lens unit 1 and the electronic imaging unit 2.

  The central control unit 13 controls each unit of the imaging apparatus 100. Specifically, the central control unit 13 includes a CPU, a RAM, and a ROM (all not shown), and performs various control operations according to various processing programs (not shown) for the imaging apparatus 100.

Next, imaging operation processing executed when the imaging device 100 images a subject will be described with reference to FIGS.
FIG. 2 is a flowchart illustrating an example of an operation related to the imaging operation process.

  The imaging operation processing is performed based on a predetermined operation of the operation input unit 12 by the user, for example, imaging in a still image imaging mode, a moving image imaging mode, or the like from among a plurality of modes in the menu screen displayed on the display unit 10. This is a process executed during an imaging operation in which a mode is selected and designated and imaging of a subject is performed under a predetermined condition in the imaging mode.

As shown in FIG. 2, first, the central control unit 13 determines the contents of various settings of the imaging device 100 and the imaging distance and imaging angle of the imaging device 100 with respect to the subject based on a predetermined operation of the operation input unit 12 by the user. It is determined whether or not the state of the subject imaged by the electronic imaging unit 2 has changed due to the change (step S1).
Here, when it is determined that the contents of various settings of the image capturing apparatus 100 and the state of the subject have changed (step S1; YES), the blur amount specifying unit 5 is a blur amount other than the directional blur that occurs in the captured image. Is specified as the amount of blur caused by other than camera shake (step S2).
Specifically, the blur amount specifying unit 5, for example, information related to a focus position of a focus lens (not shown) of the lens unit 1 or information related to a high-frequency component of the live view image at the time of live view imaging of a subject. On the basis of the main subject included in the subject, the setting amount of the soft focus processing (for example, smoothing) when the amount of blur is actually measured or the soft focus processing mode is set as the imaging mode Based on the intensity, the amount of blur occurring in the captured image is specified by calculation.

  Next, the content specifying unit 6c of the camera shake correction unit 6 uses the amount of movement per unit time of the stage unit by the stage driving unit 6a based on the amount of blur caused by other than the camera shake specified by the blur amount specifying unit 5 ( (Movement speed) is calculated (step S3). Subsequently, the correction control unit 6b sets the allowable movement amount (movement speed) per unit time of the stage unit newly calculated by the content specifying unit 6c as a camera shake correction condition (step S4).

Then, the camera shake correction unit 6 determines whether or not it is the execution timing of the camera shake correction process according to whether or not the camera shake is detected by the camera shake amount detection unit 4 (step S5). In addition, when it is determined in step S1 that the contents of various settings of the imaging apparatus 100 and the state of the subject have not changed (step S1; NO), the process proceeds to step S5, and the camera shake correction unit 6 Similarly, it is determined whether it is the execution timing of the camera shake correction process (step S5).
Here, if it is determined that it is not the time to execute the camera shake correction process (step S5; NO), the central control unit 13 determines whether or not the imaging of the subject in the imaging mode has ended (step S6). Specifically, the central control unit 13 shoots an object depending on, for example, whether an imaging end instruction is input based on a predetermined operation by the user, whether the temporary storage capacity of the memory 8 is exhausted, or the like. It is determined whether or not it has been completed.

  On the other hand, when it is determined in step S5 that it is the execution timing of the camera shake correction process (step S5; YES), the camera shake correction unit 6 performs the camera shake correction process for correcting the camera shake detected by the camera shake amount detection unit 4. Perform (Step S7; see FIG. 3).

Hereinafter, the camera shake correction process will be described in detail with reference to FIG.
Here, FIG. 3 is a flowchart illustrating an example of an operation related to the camera shake correction processing.

  As shown in FIG. 3, in the camera shake correction process, first, when the camera shake amount detection unit 4 newly generates camera shake after the previous camera shake amount detection timing, the amount and direction of the new camera shake are detected. (Step S21), the content specifying unit 6c converts the camera shake amount detected by the camera shake amount detection unit 4 into the movement amount (movement distance) of the current stage unit (step S22).

Next, the correction control unit 6b determines whether or not the converted movement amount (movement distance) of the stage unit is larger than an allowable movement amount (movement distance) corresponding to the blur amount caused by other than the shaking of the stage unit. Determination is made (step S23).
In step S1, after it is determined that the contents of various settings of the imaging apparatus 100 and the state of the subject have not changed (step S1; NO), the processing in steps S2 to S4 is not performed, and then in step S5. In the camera shake correction process (step S7) executed by determining that it is the execution timing of the camera shake correction process (step S5; YES), the correction control unit 6b, for example, satisfies the previous camera shake correction condition. Corresponding to the allowable movement amount (movement speed) per unit time of the stage unit set at the setting timing (step S4), the allowable movement amount (movement distance) corresponding to the blur amount caused by other than the shaking of the stage unit, The determination in step S23 may be performed using the allowable movement amount (movement distance) of the stage unit set as a default.

  If it is determined in step S23 that the movement amount of the stage unit is not larger than the allowable movement amount (step S23; NO), the correction control unit 6b performs the conversion of the stage unit at the converted camera shake correction timing. A control signal for driving the stage drive unit 6a is determined based on the movement direction detected by the movement amount and the camera shake amount detection unit 4, and the drive of the stage drive unit 6a is controlled according to the control signal to determine the stage unit. The direction is moved (step S24).

  On the other hand, if it is determined in step S23 that the movement amount of the stage unit is larger than the allowable movement amount (step S23; YES), the correction control unit 6b allows the movement amount of the stage unit at the current camera shake correction timing to be allowable. The content designation unit 6c is designated to change so as to be smaller than the movement amount (step S25; see FIG. 4B). For example, in FIG. 4B, the amount of movement of the stage unit (thick solid line) by the stage drive unit 6a is smaller than the amount of camera shake (broken line). In such a case, a non-correction amount that has not been subjected to camera shake correction is generated, but the non-correction amount performs camera shake correction even when camera shake occurs when blur occurs due to non-camera shake in the captured image of the subject. The unnecessary range is schematically shown. As a result, the amount of camera shake that can be tolerated compared to normal imaging can be increased, and the range of camera shake correction can be relatively enlarged even if the strength of camera shake correction processing is reduced. This can reduce the effects of camera shake.

  Thereafter, the process proceeds to step S24, and the correction control unit 6b determines the stage driving unit based on the movement amount of the designated stage unit and the movement direction detected by the camera shake amount detection unit 4 in substantially the same manner as described above. A control signal related to the driving of 6a is determined, and the driving of the stage driving unit 6a is controlled according to the control signal to move the stage unit in a predetermined direction (step S24). That is, in consideration of the blur amount other than the camera shake specified by the blur amount specifying unit 5, that is, the allowable blur amount, the camera shake correction unit 6 moves the stage unit with respect to the camera shake amount as the blur amount increases. A camera shake correction process with a smaller amount is performed.

When the camera shake correction process is completed, as shown in FIG. 2, the process proceeds to step S6, and the central control unit 13 determines whether or not the imaging of the subject in the imaging mode is completed (step S6).
Here, if it is determined that the imaging of the subject has not ended (step S6; NO), the central control unit 13 shifts the process to step S1 and performs the subsequent processes.
When it is determined in step S6 that the imaging of the subject has been completed (step S6; YES), the central control unit 13 ends the imaging operation process.

As described above, according to the imaging apparatus 100 of the present embodiment, the amount of blur caused by other than camera shake in the captured image of the subject is specified, and the strength of the camera shake correction processing is reduced as the amount of blur increases. Since the drive of the stage unit by the stage drive unit 6a is controlled, it is possible to relatively enlarge the camera shake correction possible range in consideration of the size of the blur caused due to other than camera shake in the captured image. Specifically, the greater the amount of blur caused due to other than camera shake in the captured image, the smaller the amount of movement (movement distance) of the stage unit by the stage drive unit 6a, thereby relatively expanding the range where camera shake can be corrected. be able to.
That is, for example, when a blur occurs due to camera shake other than camera shake as in the case where the soft focus processing mode is set, there is a range in which camera shake correction is not necessary even if camera shake occurs. For this reason, it is possible to enlarge the region in focus by increasing the amount of camera shake that can be tolerated compared to normal imaging. Thereby, even if the strength of the camera shake correction process is reduced, a captured image with less influence of the camera shake can be obtained.
Therefore, by changing the strength of the camera shake correction process based on the amount of blur caused by other than camera shake in the captured image of the subject, the camera shake correction possible range can be relatively enlarged.
Further, since it is not necessary to drive the stage unit on which the electronic imaging unit 2 is mounted at high speed in order to follow camera shake, it is possible to avoid an increase in power consumed and driving noise generated by the driving.

  In addition, since the blur correction range is relatively expanded in consideration of the size of blur caused by other than camera shake in the captured image, camera shake may occur in an imaging operation with a relatively long exposure time (slow shutter speed). Even if the intensity of the correction process is weakened, it is possible not only to obtain a captured image with little influence of camera shake, but also when taking an image at any timing in an imaging operation with a relatively short exposure time (fast shutter speed). The probability that the amount exceeds the driveable range of the stage portion can be reduced (see FIG. 4B). As a result, even if the camera shake correction process of the present embodiment is applied to the imaging of each image frame of a moving image, the same effect as described above can be obtained.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the above embodiment, the intensity of the camera shake correction process considering the amount of blur caused by other than camera shake is adjusted every time the camera shake amount detection unit 4 detects camera shake. It is not limited to this, and it may be performed every predetermined unit period (see FIG. 5).

That is, the content specifying unit 6c of the correction control unit 6b converts the amount of camera shake detected by the camera shake amount detection unit 4 at the current camera shake detection timing into the amount of movement (movement distance) of the current stage unit. The total movement amount (movement distance) of the stage unit when the stage unit is moved for a predetermined unit period is calculated with the movement amount of the stage unit this time.
Then, the correction control unit 6b determines that the total movement amount of the stage unit within the predetermined unit period is the total allowable movement amount within the predetermined unit period corresponding to the blur amount caused by the already set stage unit other than the camera shake. It is determined whether or not it is greater than (movement distance), and if it is determined that the total movement amount of the stage unit within a predetermined unit period is greater than the total allowable movement amount, the total movement amount of the stage unit within the predetermined unit period The content designation unit 6c is designated to change the amount of movement of the stage at the current camera shake correction timing so that is smaller than the total allowable movement amount.

Hereinafter, a modified example of the camera shake correction process will be described with reference to FIG.
As shown in FIG. 5, in this camera shake correction process, as in the above-described embodiment, first, the camera shake amount detection unit 4 newly generates camera shake after the previous camera shake amount detection timing. When the amount and direction are detected (step S21), the content specifying unit 6c converts the amount of camera shake detected by the camera shake amount detection unit 4 into the amount of movement (movement distance) of the current stage unit (step S22).

Next, the content specifying unit 6c calculates the total movement amount (movement distance) of the stage unit when the stage unit is moved for a predetermined unit period by the movement amount of the stage unit this time, and the correction control unit 6b. The total movement amount of the stage unit within the predetermined unit period is larger than the total allowable movement amount (movement distance) within the predetermined unit period corresponding to the blur amount caused by the shake other than the already set shake of the stage unit. It is determined whether it is larger (step S33).
Here, if it is determined that the total movement amount of the stage unit within the predetermined unit period is not larger than the total allowable movement amount (step S33; NO), the correction control unit 6b converts the current camera shake correction timing into a converted value. A control signal for driving the stage drive unit 6a is determined based on the movement amount of the stage unit and the movement direction detected by the camera shake amount detection unit 4, and the drive of the stage drive unit 6a is controlled according to the control signal. The stage unit is moved in a predetermined direction (step S34).

On the other hand, when it is determined in step S33 that the total movement amount of the stage unit within the predetermined unit period is larger than the total allowable movement amount (step S33; YES), the correction control unit 6b The content designation unit 6c is designated to change the movement amount of the stage unit at the current camera shake correction timing so that the total movement amount of the stage unit becomes smaller than the total allowable movement amount (step S35).
Thereafter, the process proceeds to step S34, and the correction control unit 6b moves in the movement direction detected by the movement amount of the stage unit and the amount of camera shake detection unit 4 within the specified predetermined unit period in substantially the same manner as described above. Based on this, a control signal for driving the stage drive unit 6a is determined, and the stage unit is moved in a predetermined direction by controlling the drive of the stage drive unit 6a according to the control signal (step S34).

Therefore, the amount of movement of the stage unit specified by the content specifying unit 6c is controlled so that the amount of movement of the stage unit within the new predetermined unit period is smaller than the amount of movement of the stage unit within the previous predetermined unit period. The adjustment of the strength of the camera shake correction process in consideration of the amount of blur caused by other than the camera shake in the captured image cannot be performed every time the camera shake is detected, that is, a relatively long predetermined unit period. It is possible to determine whether or not to reduce the strength of the camera shake correction process by comprehensively determining the size of the camera shake occurring in the camera.
As a result, the number of adjustments of the strength of camera shake correction processing can be reduced, power consumption can be reduced, and camera shake correction processing can be performed even with an imaging device equipped with an arithmetic device that does not have a high processing capacity. It can be done properly.

In the above-described embodiment, in the camera shake correction process, the amount of movement of the stage unit driven by the stage drive unit 6a is specified by the content specifying unit 6c with respect to the amount of camera shake, and the correction control unit 6b is specified. Whether or not to change the strength of the camera shake correction process is determined depending on whether the amount of movement is larger than the allowable movement amount corresponding to the amount of blur caused by other than the camera shake of the stage unit. However, the present invention is not limited to this, and it may be determined whether or not to change the strength of the camera shake correction process based on the moving speed of the stage unit.
That is, the content designating unit 6c may designate the moving speed of the stage unit in addition to the moving amount of the stage unit driven by the stage driving unit 6a with respect to the camera shake amount or instead of the moving amount of the stage unit. good. Whether or not the correction control unit 6b changes the strength of the camera shake correction process depending on whether or not the designated movement speed is higher than the allowable movement speed corresponding to the amount of blur caused by other than the camera shake of the stage unit. It may be determined.

Furthermore, in the above embodiment, when changing the strength of the camera shake correction process, the correction control unit 6b determines the maximum movement amount of the stage unit by the stage driving unit 6a, the average movement amount within a predetermined time, and the maximum movement speed. Further, the strength of the camera shake correction process may be weakened by changing at least one of the limit values of the average moving speed within a predetermined time.
Even in such a configuration, as in the above-described embodiment, it is possible to relatively enlarge the range in which camera shake can be corrected in consideration of the size of the blur that occurs due to non-camera shake in the captured image.

In the above embodiment, the correction control unit 6b is specified by the blur amount specifying unit 5 in addition to the limit of the moving amount and moving speed of the stage unit when changing the strength of the camera shake correction processing. As the amount of blur increases, the stage driving unit 6a in the camera shake correction process may be controlled to increase the strength of the centering operation of the stage unit, that is, the positioning operation for moving the stage unit gradually to the center of the driveable range. .
Even in such a configuration, as in the above-described embodiment, when blur occurs in the captured image of the subject due to other than camera shake, it is not possible to perform imaging with accurate focus. Even if the strength is weakened, a captured image with little influence of the camera shake can be obtained, and the camera shake correction possible range can be relatively enlarged.

Moreover, in the said embodiment, the stage part which mounted the electronic imaging part 2 is illustrated as a movable part for correction | amendment, The said stage part is moved to XY direction substantially orthogonal to an optical axis direction with respect to the lens part 1. FIG. Although the configuration is not limited to this, the configuration of the camera shake correction mechanism is not limited to this, and the configuration may be such that the lens unit 1 is moved in the X and Y directions with respect to the electronic imaging unit 2, or the lens unit 1 and the electronic unit The structure which moves both the imaging parts 2 may be sufficient.
That is, the camera shake correction mechanism has any configuration as long as at least one of the lens unit 1 and the electronic imaging unit 2 is moved in a direction substantially orthogonal to the optical axis direction with respect to the other to correct camera shake. There may be.

  Further, the configuration of the imaging apparatus 100 according to the camera shake correction apparatus is an example illustrated in the above embodiment, and is not limited thereto.

In addition, in the above-described embodiment, the functions as the detection unit, the drive unit, the specifying unit, and the correction control unit are controlled under the control of the central control unit 13, such as the camera shake amount detection unit 4, the stage drive unit 6a, the blur. The configuration is realized by driving the amount specifying unit 5 and the correction control unit 6b. However, the configuration is not limited to this, and is realized by executing a predetermined program or the like by the CPU of the central control unit 13. It is good also as a structure.
That is, a program memory (not shown) that stores a program stores a program including a detection control processing routine, a drive control processing routine, a specific processing routine, and a correction control processing routine. Then, the CPU of the central control unit 13 may function as a detection control unit that sequentially detects the amount of camera shake when the subject is imaged by the imaging unit. Further, the CPU of the central control unit 13 may function as a drive control unit that sequentially drives the correction movable unit so as to correct the amount of camera shake sequentially detected by the detection control unit by a drive control processing routine. In addition, the CPU of the central control unit 13 may function as a specifying unit that specifies the amount of blur caused due to other than camera shake in the captured image picked up by the image pickup unit by the specifying process routine. Further, the correction control for controlling the CPU of the central control unit 13 by the specific processing routine to control the driving of the correction movable unit by the drive control unit so that the strength of the camera shake correction process is reduced as the blur amount specified by the specifying unit increases. You may make it function as a means.

  Furthermore, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory or a portable recording medium such as a CD-ROM is applied in addition to a ROM or a hard disk. Is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

DESCRIPTION OF SYMBOLS 100 Imaging device 1 Lens part 2 Electronic imaging part 3 CDS / ADC part 4 Camera shake amount detection part 5 Blur amount specific | specification part 6 Camera shake correction part 6a Stage drive part 6b Correction control part 6c Content designation part 13 Central control part

Claims (9)

Detection means for sequentially detecting the amount of camera shake when the subject is imaged by the imaging means;
Drive means for sequentially driving the movable movable part for correction so as to correct the amount of camera shake sequentially detected by the detection means;
A specifying unit for specifying a blur amount caused by a non-shake in a captured image captured by the imaging unit;
Correction control means for controlling the drive of the correction movable part by the drive means so as to reduce the strength of the camera shake correction processing as the blur amount specified by the specifying means increases;
A camera shake correction device comprising:   The amount of blur caused due to camera shake other than camera shake is predicted based on the amount of blur actually measured with respect to the main subject included in the subject when the subject is imaged by the imaging unit, and based on the main subject. 2. The camera shake correction device according to claim 1, comprising at least one of a blur amount to be performed, a blur amount designated based on a user operation, and a blur amount allowable at the time of viewing. A setting unit for setting a soft focus processing mode for intentionally blurring a captured image captured by the imaging unit;
The correction control means includes
3. The camera shake correction apparatus according to claim 1, wherein when the soft focus processing mode is set by the setting unit, control is performed so as to weaken the strength of the camera shake correction processing. 4. The correction control means includes
A designation unit that designates at least one of a movement amount and a movement speed of the correction movable unit that is driven by the driving unit with respect to the amount of camera shake detected by the detection unit;
The control is performed so that at least one of the moving amount and the moving speed of the correction movable portion specified by the specifying device is reduced as the blur amount specified by the specifying device increases. The camera shake correction apparatus according to any one of 1 to 3. The correction control means includes
The movement amount of the correction movable portion specified by the specifying means is set so that the movement amount of the correction movable portion within the new predetermined unit period is smaller than the movement amount within the previous predetermined unit period. The camera shake correction apparatus according to claim 4, wherein the camera shake correction apparatus is controlled. The correction control means includes
At least one of a limit value is changed among the maximum movement amount of the correction movable part by the driving unit, the average movement amount within a predetermined time, the maximum movement speed, and the average movement speed within a predetermined time. The camera shake correction device according to claim 4. The correction control means includes
A positioning operation for moving the correction movable portion to the center of the drivable range is controlled by the driving means, and the strength of the positioning operation by the driving means is increased as the blur amount specified by the specifying means increases. The camera shake correction device according to claim 1, wherein the camera shake correction device is controlled as follows. Camera shake correction comprising detection means for sequentially detecting the amount of camera shake during imaging of a subject by the imaging means, and drive means for sequentially driving the correction movable unit so as to correct the amount of camera shake sequentially detected by the detection means An imaging processing method using an apparatus,
A process for identifying the amount of blur caused due to other than camera shake in the captured image captured by the imaging unit;
A process for controlling the drive of the correction movable part by the drive means so as to weaken the strength of the camera shake correction process as the specified amount of blur increases.
The imaging processing method characterized by performing. The computer of the image stabilizer
Detection control means for sequentially detecting the amount of camera shake when the subject is imaged by the imaging means;
Drive control means for sequentially driving the movable movable part for correction so as to correct the amount of camera shake sequentially detected by the detection control means;
A specifying means for specifying a blur amount caused by a non-shake in a captured image picked up by the image pickup means;
Correction control means for controlling the drive of the correction movable part by the drive control means so that the strength of the camera shake correction processing is weakened as the amount of blur specified by the specifying means increases;
A program characterized by functioning as

Images