JP2016090786A - Image blur correction device and control method of the same, program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To effectively use an imaging area of an imaging element as mush as possible in electronic image blur correction for moving image photographing.SOLUTION: An image blur correction device includes: a conversion part that converts the coordinates of an image acquired by an imaging element that photographing a subject image so as to correct image blur caused by vibration of the device; an image cutout part that cuts out predetermined ranges from the image the coordinates of which has been converted by the conversion part; and a control part that controls the cutout part to make a first cutout range of the image to be displayed on a display part that displays images different from a second cutout range of the image to be recorded in a storage part that stores images when the image cutout part cuts out the predetermined ranges from the image.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image blur correction technique in an imaging apparatus such as a digital camera or a digital video.

  In recent years, many digital cameras and digital video cameras are equipped with an image blur correction device having a function of correcting a camera shake of a photographer. Such an image blur correction apparatus is roughly divided into a shift lens in a photographing optical system and a mechanical image blur correction apparatus that corrects an image blur by moving an image sensor in a direction perpendicular to the optical axis. There is an electronic image blur correction device that corrects an image blur by controlling a cutout range of an image.

  For example, Patent Document 1 describes a technique for taking a moving image while electronically correcting an image blur.

JP 2000-357040 A

  As disclosed in Patent Document 1, electronic image blur correction cuts out a partial range of an image acquired by the image sensor in accordance with camera shake. The area (margin) other than the cutout range at this time is larger than the maximum amount of camera shake that is supposed to occur during shooting and needs to be set with a margin. This is because the amount of camera shake during shooting cannot be predicted in advance. Therefore, there is a problem that the imaging area of the imaging element cannot be effectively used.

  The present invention has been made in view of the above-described problems, and an object thereof is to make it possible to use an imaging region of an imaging device as effectively as possible in electronic image blur correction in moving image shooting.

  An image blur correction apparatus according to the present invention includes a conversion unit that converts coordinates of an image acquired by an image sensor that captures a subject image so as to correct an image blur caused by a shake of the apparatus, and a coordinate by the conversion unit. Cutting out a predetermined range from the converted image, a cutout range of the first image displayed on the display means for displaying the image when the image cutout means cuts out the image, and a record for recording the image And a control means for controlling the clipping means so as to differ from the clipping range of the second image recorded in the means.

  According to the present invention, it is possible to use the imaging region of the imaging device as effectively as possible in electronic image blur correction in moving image shooting.

1 is a block diagram illustrating a configuration of an imaging apparatus according to a first embodiment of the present invention. FIG. 6 is a diagram for explaining a difference between a display image and a recorded image in the first embodiment. The figure explaining the difference for every imaging | photography condition of a recorded image. 5 is a flowchart showing an image display operation in the first embodiment. 5 is a flowchart showing an image recording operation in the first embodiment. The figure explaining the difference between the display image and memory | storage image in 2nd Embodiment. The block diagram of the imaging device in 3rd Embodiment. The figure explaining the difference between the display image and memory | storage image in 3rd Embodiment. The figure explaining the difference between the display image and memory | storage image in 4th Embodiment. The block diagram of the imaging device in a 5th embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a block diagram showing the configuration of a camera (imaging device) according to the first embodiment of the present invention. In FIG. 1, an incident light beam (photographing light) from a lens unit 11 constituting a photographing optical system is imaged as a subject image on an image sensor 19 through a shutter 12a after the light amount is restricted by a diaphragm 13a. The image sensor 19 is a semiconductor image sensor such as a CMOS sensor or a CCD.

  The lens unit 11 is further composed of a plurality of optical lens groups, and some of these lens groups move on the optical axis 10 in response to the driving force from the AF drive motor 14a and stop at a predetermined in-focus position. To adjust the focus. The AF drive motor 14a is driven by receiving a drive signal from the focus drive unit 14b.

  In addition, some optical lens groups in the lens unit 11 move on the optical axis 10 in response to the driving force from the zoom drive motor 15a, and change the shooting angle of view by stopping at a predetermined zoom position. The zoom drive motor 15a is driven by receiving a drive signal from the zoom drive unit 15b.

  The diaphragm 13a has diaphragm blades, and the diaphragm blades are operated by receiving a driving force from the diaphragm driving unit 13b to change an opening area (diaphragm aperture) serving as a light passage port. The shutter 12a has shutter blades, and these shutter blades open and close an opening serving as a light passage port by receiving a driving force from the shutter driving unit 12b. Thereby, the light beam incident on the image sensor 19 is controlled.

  Further, the strobe 16a is driven (emitted) in response to a drive signal from the flash drive unit 16b in accordance with conditions at the time of photographing (subject brightness, etc.). Further, the speaker 17a is driven (sounded) in response to a driving signal from the sounding driving unit 17b in order to notify the photographer of the photographing operation.

  The focus drive unit 14b, zoom drive unit 15b, aperture drive unit 13b, shutter drive unit 12b, flash drive unit 16b, and sound generation drive unit 17b are controlled by the imaging control unit 18.

  The photographing control unit 18 is configured to receive operation signals from the release operation unit 12c, the aperture operation unit 13c, the zoom operation unit 15c, the flash operation unit 16c, and the image stabilization operation unit 119. Then, the operation signals are given to the focus driving unit 14b, the zoom driving unit 15b, the aperture driving unit 13b, the shutter driving unit 12b, and the flash driving unit 16b according to the shooting state of the camera to set shooting conditions, and shooting is performed. Is called.

  Note that the aperture diameter of the aperture 13a and the light emission of the strobe 16a are normally set automatically on the camera side at the time of shooting, so the aperture operation unit 13c and the flash operation unit 16c are usually unnecessary, but the photographer can arbitrarily set them. It is provided for users who want to set shooting conditions.

  The photographing control unit 18 measures subject luminance (photometry) based on an image signal captured by the signal processing unit 110 described later, and based on the photometric result, the aperture diameter of the aperture 13a and the closing timing (exposure) of the shutter 12a. Time). Further, the imaging control unit 18 obtains the in-focus position of the focus lens that is a part of the lens unit 11 based on the output of the signal processing unit 110 while driving the focus driving unit 14b.

  The video signal output from the image sensor 19 is input to the signal processing unit 110. The signal processing unit 110 performs signal processing such as forming a luminance signal and a color signal on the input signal to form a color video signal. Then, the video signal processed by the signal processing unit 110 is input to the image correction unit 111. The image correction unit 111 performs gamma correction and compression processing on the input signal.

  Next, image processing contents when the image stabilization operation unit 119 is operated to operate image blur correction that corrects image blur caused by the shake of the imaging apparatus will be described.

  The signal from the image correction unit 111 is input to the motion vector detection unit 112. The motion vector detection unit 112 detects a motion vector based on the coordinate change of the same feature point between the images sequentially input from the image correction unit 111. The coordinate conversion unit 113 performs coordinate conversion on the image from the image correction unit 111 based on the change of the motion vector obtained by the motion vector detection unit 112. As a result, a coordinate conversion image with reduced camera shake and subject blur is obtained.

  The first image cutout unit 114 sets only the image in the substantially central range as the first cutout range in the coordinate conversion image converted by the coordinate conversion unit 113. Then, the image of the margin part around the cutout range is used for the purpose of complementing a screen defect that occurs when the composition of the screen changes due to camera shake.

  It should be noted that the margin is provided with a sufficient amount so that satisfactory complementation is possible even when a large camera shake occurs, and the amount may be changed depending on the focal length or the subject distance. In other words, when the focal length of the photographic optical system is long (telephoto side), the amount of image blur on the screen increases due to camera shake, and when the subject is close, the effect of shift blur increases and the amount of image blur on the screen increases. . Therefore, the cutout range may be set narrowly according to them, and a lot of margins may be secured. The image display unit 115 displays the clipped image cut out by the first image cutout unit 114 on the external liquid crystal monitor of the imaging apparatus.

  The processing from the signal processing unit 110 to the image display by the image display unit 115 is performed in synchronization with the photographing operation by the photographer, and the photographer can continue photographing while confirming the image with reduced image blur. The coordinate conversion image that has undergone coordinate conversion by the coordinate conversion unit 113 is stored in the image storage unit 116.

  The second image cutout unit 117 operates when a predetermined section image is stored in the image storage unit 116. Although the details will be described later with reference to FIG. 2, the second image cutout unit 117 performs the second cutout on the maximum range in which the images in the predetermined section of the image after coordinate conversion stored in the image storage unit 116 overlap. Cut out as a range. In other words, the second cutout range is set in the state of the image after shooting in a predetermined section. The smaller the image blur amount and the smaller the image blur correction amount in the image in the predetermined section, the wider the overlapping range of the images and the wider the cutout range. The cutout image cut out by the second image cutout unit 117 is recorded in the image recording unit 118.

  FIG. 2A shows the cut-out images of the first image cut-out unit 114 displayed on the image display unit 115 in the order of image display. The image display unit 115 displays only the image in the first cutout range 22a among the images 21a captured by the image sensor. Here, the images 21a to 21e in FIG. 2A are displaced in the vertical direction. This is due to camera shake in the vertical direction, and the coordinate conversion unit 113 coordinates each image to reduce this. This is because of the conversion.

  As can be seen from FIG. 2A, the first cutout range 22 is sufficiently small for each image 21. For this reason, the margin of the first cutout range 22 is sufficiently provided even for an image that is largely displaced in the vertical direction as compared with the image 21a due to camera shake. As described above, this is because there is a case for correcting a larger camera shake.

  FIG. 2B shows the cut-out images of the second image cut-out unit 117 recorded in the image recording unit 118 in the order of image recording. In the image recording unit 118, the second cutout range 23a is recorded in the image 21a picked up by the image pickup device.

  As can be seen from FIG. 2B, the second cutout range 23 is larger than the first cutout range 22 for each image 21. This is because the maximum range in which the images 21a to 21e overlap after the image blur correction is performed on the images 21a to 21e is set as the second cutout range.

  In FIG. 2B, the margin of the second cutout range 23 is hardly provided even for an image that is largely shifted in the vertical direction as compared with the image 21a as in the image 21c. However, since the image for which the cutout range is set is already stored in the image storage unit 116 and the maximum amount of blur among these images is already known, there is no need to leave a margin in the margin. As described above, the second image cutout unit 117 operates when an image of a predetermined section is stored in the image storage unit 116. However, for the purpose of reducing the above-mentioned margin, the shooting condition is substantially omitted in the predetermined section. It is good to set to the section where the same captured image continues.

  For this purpose, the imaging condition change signal from the imaging control unit 18 in FIG. 1 is input to the second image clipping unit 117. The imaging condition change signal is as follows. First, the distance change from the imaging device to the subject to be photographed is determined from the contrast signal (detection of the focus state) input from the signal processing unit 110 to the photographing control unit 18 and the position (not shown) of the focus lens in the lens unit 11 at that time. There is a detection signal. In addition, a motion signal (panning and framing state detection) of the imaging apparatus input from the motion vector detection unit 112 to the shooting control unit 18, and a zoom change signal (shooting focal length of the shooting focal length) input from the zoom operation unit 15 c to the shooting control unit 18. Change detection). In addition, there is a release signal (shooting start / end detection) input to the shooting control unit 18 from the release operation unit 12c. The maximum overlapping range in all the images in the section where the photographing conditions are not changed is set as the second cutout range.

  This is because it is necessary to consider that the amount of image degradation due to camera shake increases due to the effect of shift blur when the distance from the imaging device to the subject is short, and that the amount of image degradation due to camera shake increases as the focal length increases. is there. Then, by separating such shooting conditions from other shooting conditions and setting the second cutout range each time, a cutout range based on an image with a high amount of camera shake is set even for an image with a small amount of camera shake. To prevent that.

  In order to increase the maximum overlapping range, it is preferable that the predetermined section described above is short. This is because, as the predetermined section becomes longer, a large blur such as a change in the posture of the photographer during that period is superimposed. Therefore, the second cutout range is reset before and after the time when the shooting scene changes greatly, such as the focus state, panning, and framing.

  3A and 3B are diagrams for explaining the second cutout range change for each predetermined section. FIG. 3A is an image displayed on the image display unit 115, and FIG. 3B is recorded on the recording unit 118. This is an image. Here, the images 21a to 21e are the same as the contents described in FIGS. 2 (a) and 2 (b).

  Even after zooming and panning indicated by an arrow 36 during shooting, the first cutout ranges 32a to 32e of the images 31a to 31e in FIG. 3A are the same as before zooming and panning. Here, as described above, since the focal length is increased by zooming, it is expected that the image shift due to camera shake will increase, and the first cutout range 31 may be set narrower (with a larger margin).

  On the other hand, in FIG. 3B, the second cut-out ranges 23a to 23e are set in the images 21a to 21e before the panning and zooming are generated by the arrow 36, and the images 31a to 31e after the panning and zooming are generated. The maximum overlapping range of these images is set as the second cutout range. In FIG. 3B, the focal length becomes longer due to zooming and the amount of image deviation increases, so the second cutout range 34a is narrower than the second cutout range 23a before panning and zooming.

  As described above, in the present embodiment, since the cutout range of the second image is reset according to the shooting conditions (the difference in the amount of screen deviation), when the amount of screen displacement is small, The screen can be used more effectively.

  In FIG. 3A, in the image 31c, a large blur occurs as the screen defect 34c occurs with respect to the first cutout range 32c. Therefore, the second image cutout range in FIG. 3B can be set narrower than the first cutout range in response to the large blurring, so that the screen defect 35c can be made inconspicuous. However, since it is not preferable to record an image that is narrower than the angle of view observed by the photographer during photographing, the second cutout range is set to be larger than the first cutout range. That is, the second cutout range is not made narrower than the first cutout range. From this, the screen defect 35c also occurs in the recorded image 31c, but it is possible to edit the image according to the photographer's preference by re-trimming the screen defect.

  FIG. 4 is a flowchart showing an operation from taking an image in this embodiment to displaying the taken image on the image display unit 115. This flow is accompanied by the start of shooting when the image stabilization operation unit 119 is on. And start. In order to make the description easy to understand, descriptions of functions and elements not directly related to the characteristic operation of the present embodiment are omitted.

  In step S <b> 4001, the image sensor 19 outputs subject information imaged through the lens unit 11 to the signal processing unit 110 by operating the release operation unit 12 c. In step S4002, with respect to the image signals processed by the signal processing unit 110 and the image correction unit 111, the motion vector detection unit 112 detects the motion vector of the image plane between successive images at the same feature point (the amount and direction of the displacement in the two-dimensional direction). ) Is detected.

  In step S4003, the coordinate conversion unit 113 performs coordinate conversion of an image corresponding to motion vector detection based on the motion vector obtained in step S4002. As a result, an image with reduced camera shake and subject blurring (image blurring) can be obtained. In step S4004, the coordinate-converted image is stored in the image storage unit 116. This stored image is cut out by the second image cutout unit and recorded in the image recording unit 118. Details of this will be described later with reference to FIG.

  In step S4005, the first image cutout unit 114 cuts out a predetermined range in the center of the image from the image of the coordinate conversion unit 113. In other words, the margin at the screen edge is cut off. Note that the margin at this time is set sufficiently larger than the camera shake correction amount predicted during shooting.

  In step S4006, an image in the range cut out by the first image cutout unit 114 (such as the range 22a in FIG. 2A) is displayed on the image display unit 115. The photographer can continue photographing while confirming the image with reduced camera shake displayed on the image display unit 115.

  FIG. 5 is a flowchart showing an operation from reading an image from the image storage unit 116 to recording it in the image recording unit 118 in this embodiment. Start when the memory is finished.

  Specifically, this flow starts when a shooting condition change signal from the shooting control unit 18 input to the second image cutout unit 117 is generated. In order to make the description easy to understand, descriptions of functions and elements not directly related to the characteristic operation of the present embodiment are omitted.

  In step S5001, images stored in the image storage unit 116 are sequentially read out. In step S5002, the read images are superimposed and combined in order. At this time, since each image is shifted according to the camera shake correction amount by the coordinate conversion unit 113, an area that does not overlap at the end of the image appears.

  In step S5003, the operation of step S5002 is returned to step S5001 until the superimposition processing of all the images under the same photographing condition is completed, and the operations of S5001 and S5002 are repeated and waited. When the superimposing process of the same photographing condition image is completed, the process proceeds to step S5004.

  In step S5004, the maximum area where all the images overlap in the image superimposed in step S5002 is obtained with a predetermined image aspect ratio. This area becomes the second cutout range cut out by the second image cutout unit 117. In step S5005, it is determined whether the second cutout range set in step S5004 is the same area as or wider than the first cutout range. If it is the same area or wider than that, the process proceeds to step S5007. Then, the process proceeds to step S5006.

  In step S5006, the second cutout range is set as the same range as the first cutout range. Accordingly, the second cutout range is not narrower than the first cutout range, and it is possible to prevent the image from being trimmed beyond the image that the photographer is viewing with the electronic viewfinder.

  In step S5007, the stored image is read again from the storage unit 116. In step S5008, the second image cutout unit 117 cuts out the image in the second cutout range obtained in steps S5004 to S5006 from the read image. In step S5009, the image cut out by the second image cutout unit 117 is recorded in the image recording unit 118.

  In step S5010, the operations of steps S5005 to S5007 are repeated until all images under the same shooting condition are cut out by the second image cutout unit 117 and recorded in the image recording unit 118.

  In step S5011, if an image of the next shooting condition is stored in the storage unit 116, the process returns to step S5001, and if not, this flow ends.

  As described above, according to the present embodiment, since the cutout range of the stored image can be made wider than the displayed image, the performance of the image sensor can be used effectively. Further, even when the photographer edits the obtained image, the degree of freedom of trimming can be increased due to the wide range of the image cutout.

  As described above, in the present embodiment, the image sensor 19, the coordinate conversion unit 113 that converts the coordinates of the image acquired by the image sensor based on the motion vector signal (motion vector detection unit 112) of the image sensor 19, and the coordinates Image cutout units 114 and 117 that set a predetermined cutout range in the coordinate conversion image transformed by the conversion unit 113 and cut out the image, an image display unit 115 that sequentially displays the cutout image cut out by the image cutout unit, An image pickup apparatus is configured with the recording unit 118 that records the cut-out image cut out by the image cut-out unit, and the image cut-out units 114 and 117 display an image displayed on the image display unit 115 and an image recorded on the recording unit 118. Make them different.

  More specifically, the image storage unit 116 that sequentially stores the output images of the image sensor 19 is provided, and the image cutout unit sets a predetermined first cutout range in the coordinate conversion image that has been subjected to coordinate conversion by the coordinate conversion unit 113, and is an image. A first image cutout unit 114 that performs cutout, and a second image cutout unit 117 that sets a second cutout range different from the first cutout range in the stored image of the image storage unit 116 and performs image cutout The image display unit 115 displays the first cutout image cut out by the first image cutout unit 114, and the image recording unit 118 records the second cutout image cut out by the second image cutout unit 117. To do.

  In addition, the second image cutout unit 117 sets an image cutout range based on a motion vector between images sequentially acquired by the image sensor 19 in a predetermined section (a section in which captured images having substantially the same conditions are continuous), and sets the cutout that has been set. An image in a predetermined section is cut out within a range. Further, a limiting unit (steps S5005 and S5006 in FIG. 5) is provided to restrict the second cutout range from becoming smaller than the first cutout range.

(Second Embodiment)
FIG. 6 is a diagram showing image clipping in the second embodiment of the present invention. In the first embodiment, the second cutout range 23 is set to the maximum range (AND range) in which images overlap, but in the second embodiment, the second cutout range 61 is coordinate-converted into various directions and the range is set. The minimum range (OR range) of the spread composite image is set.

  FIG. 6A shows an image displayed on the image display unit as in FIG. 2A, and the first cutout range 22 is also the same as that in the first embodiment of FIG. On the other hand, as shown in FIG. 6B, the image recorded in the recording unit 118 is cut out as follows from the image in the section photographed under the same photographing condition. That is, the second image cutout unit 117 cuts out the second cutout range 61 which is the minimum range including all the edges of the respective images whose positions are shifted by blurring correction. For this reason, there is an imaging range (screen loss) that cannot be acquired by the imaging device 19 due to camera shake, but a predetermined pattern 62 is displayed for the range. The photographer can use the image pickup device 19 more effectively by changing the editing section while viewing the amount and frequency of the lack of the screen during editing.

  For example, in FIG. 6B, if it is intended to set an area where all the images 21a to 21e overlap, a cutout range equivalent to the second cutout range 23 of FIG. 2B is required. However, if the images 21a and 21b are set as a predetermined section while observing the lack of the screen, the cutout range can be set wider than the second cutout range 23 as indicated by a broken line 63.

  As described above, according to the present embodiment, since the cutout range of the stored image can be made wider than the displayed image, the cutout range of the image is wide even when the photographer edits the obtained image. The degree of trimming can be increased.

(Third embodiment)
FIG. 7 is a block diagram of an imaging apparatus according to the third embodiment of the present invention. In the first embodiment, the second cutout range 23 is set to the maximum range in which images overlap, but in the third embodiment, the second cutout range is set to be the same as the image range, and coordinate conversion is not performed. The state is recorded in the recording unit 118.

  In FIG. 7, the signal of the image correction unit 111 is directly input to the image storage unit 116. Therefore, camera shake correction is not performed on the stored image in the image storage unit 116. At the same time, the motion vector information of the motion vector detection unit 112 is stored in association with the corresponding image. This is used when a stored image is played back after shooting.

  The second image cutout unit 117 sets the entire range in each image stored in the storage unit 116 as the cutout range. The image recording unit 118 records the image cut out by the second image cutout unit 117 together with the motion vector information.

  FIG. 8A shows an image displayed on the image display unit as in FIG. 2A, and the first cutout range 22 is also the same as that of the first embodiment of FIG. In contrast, as shown in FIG. 8B, the image recorded in the recording unit 118 is an image in which no blur correction is performed on the image of the section photographed under the same photographing condition. Therefore, the main subjects 82a to 82e to be photographed are shifted in the vertical direction of the screen. The second image cutout unit 117 cuts out the entire screen of each image as the second cutout range 81.

  Since each image recorded in the recording unit 118 is associated with the motion vector information detected by the motion vector detecting unit 112, when the image of the image recording unit 118 is reproduced after shooting, each image is used using the motion vector information. Is transformed. After that, the first image cutout unit 114 cuts out the image, and the image display unit 115 performs reproduction display.

  When the photographer edits the recorded image of the image recording unit 118, the photographer can perform blur correction with a desired characteristic on each image and trim the necessary range.

  As described above, according to the present embodiment, since the cutout range of the stored image can be made wider than the displayed image, the cutout range of the image is wide even when the photographer edits the obtained image. The degree of trimming can be increased.

(Fourth embodiment)
FIG. 9 is a diagram for explaining the cutout range of the fourth embodiment of the present invention, and the overall configuration of the imaging apparatus is the same as the block diagram of FIG. 1 showing the first embodiment. In the present embodiment, the cutout range of the image displayed on the image display unit 115 is different from those in the first to third embodiments.

  FIG. 9B shows an image recorded in the recording unit 118, which is the same as FIG. 2B, and has the same cutout range setting. In FIG. 9A, the cutout range 91 of the first image cutout unit 114 is the same as the entire screen (cutout range 91a) of the image at the start of shooting. The cutout range 91 becomes the display range of the image display unit 115. For this reason, a lack of screen 92 occurs due to the blur correction.

  However, since the photographer can look over the entire image range (field angle) captured by the image sensor 19, the photographer can make use of the image composition, panning, etc., and can effectively use the image sensor 19. The image recorded in the image recording unit 118 has a high quality because there is no lack of a screen, and a maximum range corresponding to the amount of blur generated during shooting is cut out, so that a wasteful image can be obtained.

  As described above, according to the present embodiment, since the image pickup device can be effectively used by changing the cut-out range of the displayed image and the stored image, editing that is easy to use and highly flexible at the time of shooting is possible. Become.

(Fifth embodiment)
In the fifth embodiment, the present invention is applied to an interchangeable lens camera (imaging device). FIG. 10 is a diagram illustrating a configuration of a camera (imaging device) according to the fifth embodiment. In FIG. 10, a camera 3000 is configured by mechanically and electrically detachably connecting an interchangeable lens 1000 and a camera body 2000 by lens mounts 1100 and 1200.

  In the present embodiment, the interchangeable lens 1000 includes a lens control unit 1010, and each unit of the interchangeable lens 1000 is controlled by the lens control unit 1010 communicating with the imaging control unit 18 on the camera body 2000 side.

  The other operations of the imaging apparatus and the image clipping method in the image blur correction are the same as those in the first embodiment, and thus description thereof is omitted.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

19: Image sensor, 112: Motion vector detection unit, 113: Coordinate conversion unit, 114: First image cutout unit, 115: Image display unit, 116: Image storage unit, 117: Second image cutout unit, 118: Image recording unit

Claims (11)

Conversion means for converting the coordinates of an image acquired by an image sensor that captures a subject image so as to correct image blur caused by shake of the apparatus;
Image cutout means for cutting out a predetermined range from the image whose coordinates have been converted by the conversion means;
When the image is cut out by the image cutout unit, the cutout range of the first image displayed on the display unit that displays the image is different from the cutout range of the second image recorded on the recording unit that records the image. Control means for controlling the clipping means;
An image blur correction apparatus comprising:   The image cut-out means includes a first cut-out means for cutting out a first image from the image whose coordinates have been converted by the conversion means, and a second image from the image whose coordinates have been converted by the conversion means and stored in the storage means. The image blur correction apparatus according to claim 1, further comprising a second cutout unit that cuts out an image.   The image blur correction apparatus according to claim 2, wherein the conversion unit converts the coordinates of the image acquired by the image sensor based on a motion vector of the image acquired by the image sensor.   The second cutout unit sets an image cutout range based on a motion vector between images sequentially acquired by the imaging element during a predetermined interval, and sets the image cutout range based on the set cutout range. The image blur correction apparatus according to claim 2, wherein the image is cut out.   5. The image blur correction apparatus according to claim 4, wherein the predetermined section is a section in which images having substantially the same shooting conditions are continuous.   6. The control unit according to claim 1, wherein the control unit controls the clipping unit so that the second image clipping range is the same size as or smaller than the first image clipping range. The image blur correction device according to 1.   The image blur correction apparatus according to claim 3, wherein the control unit stores the information on the motion vector in the storage unit in association with a corresponding image. An image sensor for capturing a subject image;
An image blur correction device according to any one of claims 1 to 7,
An imaging apparatus comprising: A conversion step of converting the coordinates of an image acquired by an image sensor that captures a subject image so as to correct image blur due to shake of the apparatus;
An image cutout step of cutting out a predetermined range from the image whose coordinates have been converted by the conversion step;
When the image is cut out by the image cutout step, the cutout range of the first image displayed on the display unit that displays the image is different from the cutout range of the second image recorded on the recording unit that records the image. A control step for controlling the cutout step;
An image blur correction method comprising:   The program for making a computer perform each process of the image blurring correction method of Claim 9.   A computer-readable storage medium storing a program for causing a computer to execute each step of the image blur correction method according to claim 9.

Images