JP2023008069A - Imaging device and control method of the same - Google Patents

Abstract

To provide an imaging device which can correct composition deviation.SOLUTION: An imaging device comprises: an instruction unit which instructs first and second compositions; an image deviation detection unit 18; and an image deviation correction unit 14. The first composition is, for example, an ideal composition decided by a user. The second composition is a composition adjusted to the approximate position or attitude with respect to the first composition when a composition is deviated from the first composition once decided by the user. The image deviation detection unit 18 compares data of a first image stored at the time of instruction of the first composition with data of a second image stored at the time of instruction of the second composition and detects a motion vector of the second image with respect to the first image. The image deviation correction unit 14 performs image deviation correction by moving an image pick-up device 6 on the basis of the detected motion vector.SELECTED DRAWING: Figure 1

Description

The present invention relates to a technique for correcting image shift with respect to composition shift.

When a photographer takes a picture of an intended subject, if there is a deviation from the composition once determined, the photographer may be forced to adjust the composition again. For example, when a photographer tries to shoot with an ideal composition determined by a tripod in a situation where a tripod cannot be used, there is a possibility that the composition will be out of alignment. An ideal composition is a composition with a background predetermined by the photographer, and a composition deviation corresponds to a composition in a state other than the ideal composition. For example, it is assumed that the photographer arranges an ideal composition and then visually confirms the subject, or waits until the subject outside the composition enters the composition before photographing. In this case, particularly in hand-held shooting or shooting using a monopod, there is a high possibility that the position of the imaging device will shift, resulting in a composition shift.

Japanese Patent Application Laid-Open No. 2002-200000 discloses a technique of calculating a correction amount of composition deviation from values of a gyro sensor or an acceleration sensor and correcting the composition by an image deviation correction unit.

JP 2017-55266 A

In the conventional technology disclosed in Japanese Patent Application Laid-Open No. 2002-200011, a process of calculating a correction amount for compositional deviation is performed by integrating the output of a gyro sensor or an acceleration sensor. However, if there is a long time from when the photographer sets the ideal composition to when the photographing is actually performed, the error in the correction amount of the composition deviation increases. In addition, when the photographer moves the image pickup device by a large amount, the movement may exceed the measurement range of the gyro sensor or the acceleration sensor. If the error in the correction amount of the compositional deviation becomes large, a compositional deviation correction residual error occurs, so the photographer needs to adjust the composition again. In the meantime, there is a possibility that the shooting timing will be lost.
SUMMARY OF THE INVENTION It is an object of the present invention to provide an imaging apparatus capable of correcting composition deviation.

An apparatus according to an embodiment of the present invention is an imaging apparatus that performs image shift correction for composition shift, stores data of a first image in response to a first composition instruction, and stores data of a first image after the first composition instruction. storage means for storing data of a second image according to an instruction of a certain second composition; first detection means for detecting a motion vector of the second image with respect to the first image; correction means for correcting an image shift of the second image with respect to the first image.

According to the present invention, it is possible to provide an imaging apparatus capable of correcting composition deviation.

It is a figure which shows the structure of the imaging device which concerns on embodiment of this invention. 4 is a flowchart for explaining processing in the first embodiment; 9 is a flowchart for explaining processing in the second embodiment; 10 is a flowchart for explaining processing in the third embodiment; FIG. 5 is a flowchart for explaining the process following FIG. 4; FIG. FIG. 14 is a flowchart for explaining processing in the fourth embodiment; FIG.

Preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings. In this embodiment, an example of a digital camera is shown as an imaging device, but the present invention can be applied to information processing devices such as camera-equipped mobile phones, smartphones, tablet terminals, and camera-equipped personal computers (PCs). be.

FIG. 1A is a central cross-sectional view of an imaging device according to this embodiment, and FIG. 1B is a block diagram showing the electrical configuration of the imaging device. An image pickup system is configured by a camera body 1 as an image pickup apparatus main body and a photographing lens 2 attached to the camera body 1 . For convenience of explanation, as shown in FIG. 1A, the X-axis, Y-axis, and Z-axis that are orthogonal to each other are defined with respect to the imaging apparatus. The Z-axis is an axis parallel to the optical axis 4 of the photographing lens 2 and substantially perpendicular to the light receiving surface (image pickup surface) of the image sensor 6 . The X-axis is the axis perpendicular to the Z-axis in the horizontal plane when the Z-axis is parallel to the horizontal direction. The Y-axis is the axis parallel to the vertical direction while the Z-axis is parallel to the horizontal direction.

The photographing lens 2 is a lens device having a lens barrel, and is attachable to and detachable from a camera body (hereinafter referred to as a body section) 1 . In a state in which the body portion 1 and the photographing lens 2 are mechanically coupled, the body portion 1 and the photographing lens 2 are electrically connected at the electrical contact 11 . It should be noted that the present invention is not limited to the interchangeable lens system, and can also be applied to an embodiment in which the photographing lens 2 and the main body 1 are integrated (non-detachable).

The imaging lens 2 has an imaging optical system 3 composed of a plurality of lenses. A lens drive unit 13 drives various lenses such as a focus lens, a zoom lens, and an image shift correction lens, which constitute the imaging optical system 3, and an aperture. A lens system control section (hereinafter referred to as a lens control section) 12 controls the photographing lens 2 , for example, controls the operation of the lens drive section 13 .

The body portion 1 includes a camera system control portion (hereinafter referred to as a camera control portion) 5 . The camera control section 5 can communicate with the lens control section 12, and controls the operation of the imaging system in a centralized manner. For example, a CPU (Central Processing Unit) included in the camera control section 5 executes a program to control the operation of each section constituting the imaging system.

Light from a subject that has passed through the imaging optical system 3 forms an image on the imaging device 6 . The imaging device 6 converts the optical image into an electric signal by photoelectric conversion and outputs the electric signal to the image processing unit 7 . At that time, the image sensor 6 can acquire the focus evaluation amount corresponding to the focus detection state and the appropriate exposure amount, and the imaging optical system 3 is appropriately adjusted based on each amount. As a result, the imaging element 6 is exposed to an appropriate amount of object light. Further, the amount of exposure to the imaging element 6 is controlled by the shutter unit 16 running the shutter curtain. Drive control of the shutter unit 16 is performed by the shutter driving section 17 according to commands from the camera control section 5 .

The image processing unit 7 has therein an A/D converter, a white balance adjustment circuit, a gamma correction circuit, an interpolation calculation circuit, etc., and generates digital data of an image (video) for recording. For example, the image processing unit 7 has a color interpolation processing circuit, and performs color interpolation (demosaicing) processing on Bayer array signals to generate a color image. Also, the image processing unit 7 compresses image data, moving image data, and audio data using a predetermined method.

The storage unit 8 includes a storage device that stores programs and the like executed by the camera control unit 5 . A semiconductor storage device such as an EEPROM (Electrically Erasable Programmable Read-Only Memory) or a memory card for storing various data generated by the image processing section 7 is used.

The display unit 9 displays captured images, setting screens, and the like. The display unit 9 includes a rear display device 9a and an EVF (electronic viewfinder) 9b. The rear display device 9a displays various kinds of information such as a subject image, a photographed image, setting information of the imaging device, and the like. The rear display device 9a includes a touch panel and has a function of detecting a touch operation as one of the operation detection units 10. FIG. Also, the user can confirm the subject image by looking through the EVF 9b.

The operation detection unit 10 detects operations on various operation members provided on the main unit 1 and notifies the camera control unit 5 of detection results. The camera control section 5 executes processing corresponding to the notification from the operation detection section 10 . For example, when the operation detection unit 10 detects that the release button is pressed, the camera control unit 5 controls a series of imaging operations such as imaging preparation processing, imaging processing, image processing, and recording processing according to the operation instruction.

The image shift correction unit 14 corrects the image shift by driving the imaging element 6 according to the command from the camera control unit 5 . The shake detector 15 detects shake of the main body 1 and outputs a detection signal to the camera controller 5 . For example, the shake detection unit 15 includes a shake detection sensor such as a vibration gyroscope, detects rotational shake of the main unit 1 including rotations around the X axis, Y axis, and Z axis, and outputs a shake detection result signal to the camera. Send to the control unit 5 .

Based on the blur detection result from the blur detector 15, the camera controller 5 controls the movement of the imaging element 6 by the image shift corrector 14 so that the detected blur is offset. For example, the image shift correction unit 14 includes a drive mechanism unit that moves the imaging element 6 in directions (X direction and Y direction) perpendicular to the optical axis 4 (Z axis). The image shift correction unit 14 can translate the imaging element 6 in a plane (in the XY plane) orthogonal to the optical axis 4 and rotate it around the optical axis 4 (around the Z axis).

The image shift detection unit 18 detects a motion vector by comparing the two images acquired by imaging, and transmits the motion vector to the camera control unit 5 . A motion vector can be calculated by a known method. The subject detection unit 19 and motion vector separation unit 20 will be described later.

The camera control section 5 transmits commands to the lens control section 12 via the electrical contact 11 . The lens control unit 12 drives the lens driving unit 13 according to the command from the camera control unit 5 and transmits the driving results (operation information of the photographing lens 2 and the like) to the camera control unit 5 .

[First embodiment]
FIG. 2 is a flowchart for explaining image deviation correction in this embodiment. The following processing is realized by the CPU of the camera control section 5 executing the program. First, the camera control unit 5 executes image update processing (S101). An image for adjusting the composition is displayed on the display section 9 (back display device 9a or EVF 9b). The user can adjust the composition while viewing the updated display image. Below, the first composition will be described as an ideal composition intended by the user.

After determining the first composition as an ideal composition, the user performs an operation of instructing the imaging device to select the first composition using the first instruction unit. The first instruction section is, for example, a release button provided on the main body section 1 . A switch interlocked with the release button is electrically connected to the operation detection section 10 . The release button is an operation member having a two-step operation stroke, and a first stroke operation by the user turns on a first switch (denoted as SW1) to issue a photographing preparation instruction such as distance measurement or photometry. A second switch (denoted as SW2) is turned on by a deeper second stroke operation, and a photographing instruction is issued.

As another example of the first instruction unit, there is a configuration using an eye sensor that detects that the user has come close to the EVF 9b provided in the main unit 1. FIG. When the user looks into the EVF 9b and takes his eyes off the EVF 9b when the first composition is determined, the eye sensor outputs an off signal. The operation detection section 10 detects the OFF signal of the eye sensor as the instruction signal of the first instruction section. Alternatively, since various operating members are provided in the main body 1 and the photographing lens 2, there is a method of assigning the function of the first instruction section to any existing operating member. Alternatively, a dedicated operation member may be provided for the first indicator.

The camera control unit 5 determines whether or not the operation detection unit 10 has detected an instruction signal from the first instruction unit (S102). For example, when the operation detection unit 10 detects the ON signal of SW1 as the instruction signal of the first instruction unit, the camera control unit 5 accepts the shooting preparation instruction and advances the processing to S103. If the operation detection unit 10 does not detect the instruction signal from the first instruction unit, the image is updated in S101, and the user continues to adjust the composition.

When the instruction signal of the first instruction unit is detected, the camera control unit 5 executes processing for storing data of the first image related to the first composition in the storage unit 8 (S103). The first image is used for motion vector detection, which will be described later. Next, the camera control unit 5 performs processing for updating the image (S104). While the image is being updated, the user can confirm the condition of the subject visually or through the rear display device 9a or the EVF 9b. At this time, the position and orientation of the imaging device may deviate from the position and orientation corresponding to the ideal composition. When compositional deviation occurs, the user needs to make adjustments to return to the ideal composition before the timing of photographing.

When the timing for photographing approaches, the user adjusts the position and posture of the imaging device so as to obtain an ideal composition. However, when shooting handheld or using a monopod, it may happen that the image pickup apparatus can only be returned to an approximate position or posture with respect to the ideal composition. Accordingly, the user performs an operation of instructing the imaging device to set the composition when the imaging device is adjusted to the approximate position and posture as the second composition. That is, the user instructs the second composition using the second instruction section for instructing the second composition. The second instruction section may be the same operation member as the first instruction section, or may be an operation member different from the first instruction section. The operation detection unit 10 can detect an instruction signal from a predetermined second instruction unit.

The camera control unit 5 determines whether or not the operation detection unit 10 has detected an instruction signal from the second instruction unit (S105). When the operation detection unit 10 detects the instruction signal of the second instruction unit, the process proceeds to S106. If the operation detection unit 10 does not detect the instruction signal from the second instruction unit, the image is updated in S104, and the user continues to roughly adjust the composition.

When the instruction signal of the second instruction unit is detected, the camera control unit 5 selects a second composition, that is, a composition at an approximate position or posture that does not strictly match the first composition. A process of storing the data of the second image in the storage unit 8 is performed (S106). Then, the image shift detection unit 18 compares the first image and the second image (S107), and detects a motion vector from the comparison result between the first image and the second image (S108). The motion vector detected by the image shift detection unit 18 corresponds to the amount of composition shift of the second image in the second composition with respect to the first image in the ideal composition. The motion vector detection result is sent to the camera control unit 5 .

The camera control unit 5 calculates the amount of movement of the image sensor 6 by the image shift correction unit 14 based on the motion vector detected in S108, and controls the movement of the image sensor 6 (S109). The movement amount of the image sensor 6 based on the motion vector is calculated by the camera control unit 5 so that the motion vector detected in S108 is offset. That is, the image shift correction unit 14 moves the imaging device 6 by the calculated movement amount, thereby correcting the image shift between the first composition and the second composition. The user can immediately shoot with an ideal composition.

For example, assuming that the first instruction section and the second instruction section are configured by SW1, the ON signal of SW1 is used as the instruction signal of the first instruction section. In this case, in S103, the image data is saved with the composition at the time of instruction for photographing preparation such as distance measurement and photometry. Further, the signal when SW1 is turned on again in a state where the image data is stored with the composition in S103 is used as the instruction signal of the second instruction section. When the user turns on SW1 again, the composition at the time when SW1 is turned on for the first time can be quickly returned to. In the case where SW1 constitutes the first instruction unit and SW2 constitutes the second instruction unit, it is assumed that the user turns on SW2 while the image data is stored in the composition in S103. In this case, the photographing process can be started immediately after quickly returning to the composition when SW1 is turned on.

Further, assuming that the first instruction section and the second instruction section are configured by an eye sensor, an OFF signal from the eye sensor is used as an instruction signal for the first instruction section. In S103, the image data is saved with the composition at the timing when the user takes his eyes off the EVF 9b. Furthermore, when the user looks into the EVF 9b again, an ON signal is input from the eyepiece sensor. The ON signal obtained from the eye sensor while the image data is stored with the composition in S103 is used as the instruction signal of the second instruction unit. By looking into the EVF 9b again, the user can quickly return to the composition at the timing when the eye was removed from the EVF 9b.

In the present embodiment, image shift correction is performed by translating the imaging device 6 based on the motion vector detection results for the first and second images. According to this embodiment, it is possible to provide an imaging apparatus that allows a user to shoot an image with an ideal composition without missing a shooting opportunity.

[Second embodiment]
A second embodiment of the present invention will be described with reference to FIG. FIG. 3 is a flow chart for explaining image deviation correction in this embodiment. Descriptions of the same matters as in the first embodiment will be omitted, and differences will be mainly described. This method of omitting descriptions is the same for the embodiments described later.

In this embodiment, after each data of the first and second images are saved, motion vectors are calculated (S101 to S108), and the process proceeds to S201. The camera control unit 5 controls the amount of movement of the image sensor 6 by the image shift correction unit 14 (hereinafter referred to as the first movement amount), and the amount of movement of the image sensor 6 by the image shift correction unit 14 based on the motion vector ( hereinafter referred to as a second movement amount). The camera control unit 5 determines whether the first movement amount is larger than the second movement amount (S202). If the first movement amount is larger than the second movement amount, the process proceeds to S109. If the first movement amount is less than or equal to the second movement amount, the process proceeds to S203.

When the first movement amount is larger than the second movement amount, the image sensor 6 can be moved by the image shift correction section 14 based on the motion vector. In this case, the camera control unit 5 corrects the composition shift by the image shift correction unit 14 (S109).

On the other hand, when the first movement amount is less than or equal to the second movement amount, the image shift correction unit 14 does not perform correction. The camera control unit 5 performs control to display a notification message indicating that the composition deviation has not been corrected on the rear display device 9a and the EVF 9b (S203). Alternatively, a speaker included in the main unit 1 may generate a notification sound.

According to the present embodiment, there is no wasted time due to photographing in a state in which the composition has not been corrected to the ideal composition, so convenience can be improved.

[Third embodiment]
A third embodiment of the present invention will be described with reference to FIGS. 4 and 5. FIG. 4 and 5 are flow charts for explaining image deviation correction in this embodiment. First, the image for adjusting the composition is updated on the rear display device 9a and the EVF 9b (S101). The blur detection unit 15 performs blur detection, and the blur detection result is updated (S301).

The user determines an ideal composition (first composition) and issues an instruction to the imaging device using the first instruction section. When the operation detection unit 10 detects the instruction signal of the first instruction unit (S102), data of the first image is stored in the storage unit 8 (S103). The result of detection by the blur detection unit 15 is stored in the storage unit 8 as the first result of blur detection (S302).

After saving the data of the first image, the image is updated (S104). While the image is being updated, the user confirms the condition of the subject visually or by the rear display device 9a or the EVF 9b. At this time, since the composition may deviate from the ideal composition, it is necessary to adjust the composition to the ideal composition before the shooting timing.

The data of the first image is saved, and as the image is updated, the blur detection result by the blur detector 15 is updated (S303). Next, the processes of S105 and S106 are executed, and the results of blur detection by the blur detection unit 15 are stored in the storage unit 8 as second blur detection results (S304).

The image shift detection unit 18 compares the first image and the second image (FIG. 5: S107), and detects a motion vector from the comparison result (S108). The motion vector detection result is sent to the camera control unit 5 . The camera control unit 5 calculates the amount of movement of the imaging device 6 by the image shift correction unit 14 based on the detected motion vector.

The camera control unit 5 also calculates an image blur correction amount based on the first blur detection result in S302 of FIG. 4 or the second blur detection result in S304. The image blur correction amount based on the blur detection result is a correction amount calculated so that the movement of the imaging device 6 cancels out the detected blur. As for the blur detection result, the result obtained by averaging the first blur detection result and the second blur detection result may be used. Alternatively, the amount of image shift correction may be calculated based on the blur detection result that satisfies a predetermined condition, for example, the larger blur detection result.

Next, the camera control unit 5 determines the amount of movement of the image sensor 6 (hereinafter referred to as the third amount of movement) by the image shift correction unit 14 based on the calculated motion vector and the blur detection result, and the first amount of movement (image The amount of movement of the imaging element 6 by the displacement correction unit 14) is compared (S305). Then, the camera control unit 5 determines whether or not the first movement amount is larger than the third movement amount (S306). If the first movement amount is larger than the third movement amount, image shift correction can be performed based on the motion vector, so the process proceeds to S109. The image shift correction unit 14 corrects the composition shift. Both the blur detected by the blur detection unit 15 and the composition shift detected by the image shift detection unit 18 can be corrected by the image shift correction unit 14 .

If the first movement amount is less than or equal to the third movement amount in S306, the camera control unit 5 subtracts the image shift correction amount (movement amount of the image sensor 6) based on the shake detection result from the first movement amount. Then, the amount of movement obtained is calculated (S307). Then, the imaging device 6 is moved by the image shift correction unit 14 according to the calculated movement amount. By doing so, it is possible to perform image blur correction during shooting, and perform shooting with correction to bring the composition closer to the ideal composition as much as possible.

After S307, in S308, the camera control unit 5 performs control to display a notification message indicating insufficient correction of compositional deviation on the rear display device 9a or the EVF 9b in order to display that the image deviation correction unit 14 has not completed the correction. conduct. Alternatively, the camera control unit 5 performs control to issue an alarm from a speaker provided in the main unit 1 .

According to the present embodiment, it is possible to eliminate wasted time due to shooting with a composition that has not been corrected to an ideal composition, and to shoot after adjusting the composition by the correction residual.

[Fourth embodiment]
A fourth embodiment of the present invention will be described with reference to FIGS. The main unit 1 according to this embodiment further includes a subject detection unit 19 and a motion vector separation unit 20 . The subject detection unit 19 detects the feature amount and motion amount of the subject's face part, object part, etc. from the imaged image. The subject detection unit 19 detects, for example, the main subject based on the amount of feature and the amount of movement, and outputs data of the result of subject detection to the camera control unit 5 .

A motion vector separation unit 20 separates the motion vectors detected by the image shift detection unit 18 into a plurality of regions. The motion vectors separated for each region include, for example, the following vectors.
- A first motion vector representing the motion of the background.
A second motion vector representing the motion of the subject detected by the subject detection unit 19;
In this embodiment, it is assumed that the motion vectors are separated into two types, but at least the first motion vector can be separated or extracted. method, etc.) can be used.

Image shift correction in this embodiment will be described with reference to the flowchart of FIG. In this embodiment, as in the first embodiment, each data of the first image in the first composition and the data of the second image in the second composition are stored, and the motion vector is calculated (from S101 to S108). The processing of S601 and S602, which are different points, will be described.

The motion vector separating unit 20 separates the motion vector detected in S108 into a first motion vector representing the motion of the background and a second motion vector representing the motion of the subject (S601). The image shift correction unit 14 moves the image sensor 6 based on the first motion vector representing the motion of the separated background (S602).

In the first to third embodiments, when a subject other than the background is included in the first image when the first composition is determined or in the second image when the second composition is determined, the motion vector may be affected by the subject. For example, when the image sensor 6 is moved by the amount of movement calculated by the image shift correction unit 14 based on the motion vector influenced by the subject, a correction residual may occur with respect to the first composition.

According to the present embodiment, the image sensor 6 moves according to the amount of movement calculated based on the first motion vector representing the motion of the separated background. It is possible to increase the scenes that can be done. In the present embodiment, the amount of movement of the image pickup device 6 in image shift correction is calculated based on the first motion vector. Thus, a photographing operation using the first motion vector is possible.
According to the above-described embodiment, it is possible to provide an image pickup apparatus capable of photographing with the composition determined by the first instruction without losing a photographing opportunity by enabling composition deviation correction.

[Modification]
Modified examples of the first to fourth embodiments will be described below.
In the first modified example, the lens controller 12 in the photographing lens 2 controls the movement of the correcting lens, thereby correcting the image deviation. That is, the lens driving section 13 has a function corresponding to the image shift correcting section 14 , and the lens control section 12 controls movement of the correcting lens (shift lens or the like) that constitutes the imaging optical system 3 .

A second modified example is a configuration in which both the composition deviation correction performed by the image deviation correction section 14 in the main body 1 and the composition deviation correction performed by the lens driving section 13 in the photographing lens 2 are used. In the third modification, the image processing unit 7 corrects the image deviation of the captured image so that the detected motion vectors are canceled. That is, the image processing section 7 has an image correcting section that corrects image displacement by clipping and rotating an image.

The above aspects are summarized as follows.
(A) An embodiment in which image deviation is corrected by driving an optical member.
(B) An embodiment in which image shift is corrected by driving an image sensor.
(C) An embodiment in which image deviation is corrected by image processing of captured images.
(D) An embodiment in which two or more of (A) to (C) are used in combination.
In the case of (A), the amount of movement of the imaging device is appropriately read as the amount of movement of the optical member in this specification. Further, in the case of (C), the amount of movement of the imaging element is appropriately read as the amount of correction in image processing (image extraction, processing, etc.) in this specification.
Although preferred embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

5 camera system control section 7 image processing section 14 image deviation correction section 18 image deviation detection section

Claims (11)

An imaging device that performs image shift correction for composition shift,
storage means for storing data of a first image in accordance with a first composition instruction, and storing data of a second image in response to a second composition instruction subsequent to the first composition instruction;
a first detection means for detecting a motion vector of the second image with respect to the first image;
and correction means for correcting an image shift of the second image with respect to the first image using the motion vector. a first instruction means for instructing the first composition;
and a second instruction means for instructing the second composition,
The first detection means stores the data of the first image stored in the storage means according to the instruction of the first instruction means and the data of the first image stored in the storage means according to the instruction of the second instruction means. 2. The imaging apparatus according to claim 1, wherein the motion vector is detected by comparing the data of the second image. When the second image is shifted from the first image, the correcting means corrects the image shift by controlling the movement of an optical member of an imaging optical system or an image pickup device, or by image processing. 3. The imaging apparatus according to claim 1, characterized by: The correction means calculates a movement amount of an optical member or an imaging device of an imaging optical system based on the motion vector or a correction amount by image processing, and the movement amount or the correction amount is a movement that allows the optical member or the imaging device to move. 3. The method according to claim 1 or 2, wherein, if the amount or the amount of correction that can be performed by the image processing is larger than the movement of the optical member or the imaging device based on the motion vector, or the correction by the image processing is not performed. imaging device. 3. The correcting means performs a process of notifying that the image shift correction is not performed when the movement of the optical member or the imaging device based on the motion vector or the correction by the image processing is not performed. 5. The imaging device according to 4. comprising a second detection means for detecting shake of the imaging device;
The correction means calculates a movement amount of the optical member or the imaging device or a correction amount by the image processing based on the motion vector and the detection result of the second detection means, When the amount of movement by which the member or the imaging device can be moved or the amount of correction by which the image processing is possible is large, the movement of the optical member or the imaging device based on the motion vector or the correction by the image processing is performed. Item 5. The imaging device according to item 4. The correction means is configured such that the movement of the optical member or the imaging element based on the motion vector and the detection result of the second detection means or the correction amount by the image processing is the amount of movement by which the optical member or the imaging element can be moved, or When the correction amount is greater than the correction amount that allows the image processing, the optical member or the optical member based on the detection result of the second detection means from the movement amount that can move the optical member or the imaging device or the correction amount that allows the image processing. An amount obtained by subtracting a moving amount of the imaging device or a correction amount by the image processing is calculated, and the movement of the optical member or the imaging device or the correction by the image processing is performed. 7. The imaging device according to 6. In the correcting means, the moving amount of the optical member or the imaging element based on the motion vector and the detection result of the second detecting means or the correction amount by the image processing is the moving amount capable of moving the optical member or the imaging element. 8. The imaging apparatus according to claim 7, further comprising a process of notifying insufficient image deviation correction when the amount of correction is greater than the amount of correction that can be processed by the image processing. Separating means for separating the motion vector into motion vectors in a plurality of regions,
9. The imaging apparatus according to any one of claims 1 to 8, wherein the correction means performs image shift correction using a separated motion vector representing the motion of the background. Equipped with subject detection means for detecting a subject from the imaged image,
The separation means separates a first motion vector representing the motion of the background from a second motion vector representing the motion of the subject detected by the subject detection means,
10. The imaging apparatus according to claim 9, wherein said correction means performs image shift correction using said first motion vector. A control method executed by an imaging device that performs image shift correction for composition shift,
The storage means stores the data of the first image in response to the first composition instruction, and the storage means stores the data of the second image in response to the second composition instruction subsequent to the first composition instruction. and
Detecting a motion vector of the second image with respect to the first image;
and a step of correcting an image shift of the second image with respect to the first image using the motion vector.

Images