JP2017212550A - Image reproducer, control method thereof, program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress unintended image segmentation range, when performing image segmentation and enlarged display for correcting image shake during image reproduction.SOLUTION: A shake correction part 108 includes: an acquisition unit for acquiring shake data indicating the shake of an imaging device recorded while capturing a video image; a generation unit for generating a shake graph representing time change of the shake data; a graph display unit for displaying a shake graph; a size calculation unit for calculating a segmentation size of each frame image constituting a video image, when reproducing the video image while correcting by using the shake data; a position calculation unit for calculating a segmentation position of each frame image, by using the segmentation size and a motion vector amount of a subject detected from the video image by detection means; and an image display unit for displaying each frame image while segmenting on the basis of the segmentation size and the segmentation position. The video image is reproduced by segmenting each frame image on the basis of the segmentation size and the segmentation position.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image reproducing apparatus having a function of correcting image shake when reproducing a moving image.

  When a moving image is recorded by an imaging device such as a video camera, the recorded image may be shaken due to a shake of the imaging device main body due to camera shake or the like. In order to correct such shake during playback of a moving image, a technique for acquiring a motion vector amount representing the shake of the image, determining a cutout position and cutout size of the image according to the motion vector amount, and cutting out and displaying the image is displayed. Are known. In addition, when recording a moving image, the shake of the imaging device is detected by an angular velocity sensor, and the amount of shake based on the angular velocity is recorded together with the image, and when the moving image is played back, the cutout position and cutout size of the image are determined according to the shake amount. A technique for determining, cutting out and displaying is known.

  In such a technique for correcting shake during reproduction of a moving image, an image cut out for correction is enlarged and displayed on a monitor. At this time, if the cutout size is large, that is, if the enlargement ratio of the image is small, large shake cannot be corrected, and if the cutout size is small, that is, if the enlargement ratio of the image is large, the image quality of the image is degraded. Therefore, it is necessary to appropriately determine the cutout size according to the shake of the image.

  For example, in Patent Document 1, the size of the cutout size is determined from two types depending on whether or not the shake is greater than the threshold, and when the cutout size changes during playback, the cutout size is changed smoothly so as not to give the user a sense of incongruity. A method has been proposed. Patent Document 2 proposes a method for correcting a shake suitable for each section by detecting a change in the composition of the image and determining a cutout size corresponding to the shake of the image for each same composition section. Has been.

JP 2012-44418 A Japanese Patent Laying-Open No. 2015-29250

  However, in the above-described conventional technology, the image playback apparatus automatically determines the cutout position and cutout size of the image according to the shake amount of the image, so that the cutout image may not match the user's intention. There was a problem. For example, in a scene with a large shake, the cutout size of the image may be reduced due to the shake correction during image reproduction, and the reduction in resolution may exceed the allowable range of the user. In some cases, the cutout position of the image becomes inappropriate, and the subject that is desired to appear is not shown.

  The present invention has been made in view of the above-described problems, and the purpose of the present invention is to make the image cutout range the user's intention when performing image cutout and enlarged display for correcting image shake during image reproduction. It is to suppress becoming contrary.

  An image reproduction apparatus according to the present invention includes an acquisition unit that acquires shake data representing a shake of an imaging device recorded at the time of capturing a moving image, a generation unit that generates a shake graph that represents a time change of the shake data, Graph display means for displaying a shake graph; and size calculation means for calculating a cutout size of each frame image constituting the moving image when the moving image is reproduced while performing shake correction using the shake data. Based on the cutout size and the cutout position of the frame image using the motion vector amount of the subject detected from the moving image by the detection unit, the cutout size and the cutout position, Image display means for cutting out and displaying each frame image, and each frame based on the cut size and the cut position. Before cutting out an image starts reproduction of the moving image, characterized in that it comprises a control means for controlling so as to display the deflection graph to the graph display means.

  According to the present invention, it is possible to suppress the image cutout range from being contrary to the user's intention when performing image cutout and enlarged display for correcting image shake during image reproduction. Become.

1 is a block diagram showing the configuration of a digital video camera that is a first embodiment of an imaging apparatus of the present invention. 1 is a block diagram as an image reproduction device of an imaging apparatus according to a first embodiment. The schematic diagram which shows the outline | summary of shake correction. The flowchart regarding the shake correction before reproduction | regeneration of a moving image. The schematic diagram of the graph displayed before reproduction | regeneration of a moving image. 6 is a flowchart regarding shake correction during image reproduction in the first embodiment. The schematic diagram of the graph superimposed and displayed on the image in 1st Embodiment. The block diagram as an image reproduction apparatus of the imaging device in 2nd Embodiment. The schematic diagram of the graph displayed before the image reproduction in 2nd Embodiment. 10 is a flowchart regarding shake correction during image reproduction in the second embodiment. The schematic diagram of the graph superimposed and displayed on the image in 2nd Embodiment. The block diagram as an image reproduction apparatus of the imaging device in 3rd Embodiment. 10 is a flowchart regarding shake correction before image reproduction in the third embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following embodiment, the case where the image reproducing apparatus is applied to a digital video camera will be described. However, the present invention is not limited to this, and the image reproducing apparatus may be a single unit, a single-lens reflex camera or a lens-integrated type. You may apply to a camera and a mobile phone with a camera function.

<First Embodiment>
FIG. 1 is a block diagram showing a configuration of a digital video camera 100 which is a first embodiment of an imaging apparatus of the present invention. One or more of the functional blocks may be realized by hardware such as an ASIC or a programmable logic array (PLA), or may be realized by executing software by a programmable processor such as a CPU or MPU. . Alternatively, it may be realized by a combination of hardware and software. Therefore, even when different functional blocks are described as the main subject of operation in the following description, the same hardware may be realized as the main subject.

  In FIG. 1, a photographing lens 101 is a photographing lens composed of a plurality of lens groups, and is represented by a single lens for convenience, but actually includes a zoom lens, a focus lens, a shift lens, and the like. The shutter 102 is a shutter having a diaphragm function, and adjusts the time for the image sensor 103 to receive light. The imaging element 103 has a configuration in which a plurality of pixels each having a photoelectric conversion element are arranged two-dimensionally. The image sensor 103 converts the subject optical image formed by the photographing lens 101 into an electrical signal at each pixel.

  The A / D converter 104 converts an analog signal into a digital signal. The A / D converter 104 converts an analog image signal output from the image sensor 103 into a digital image signal, and outputs image data in units of pixels. The image processing unit 105 performs color conversion processing such as predetermined pixel interpolation processing, resizing processing such as enlargement / reduction, and AWB processing (auto white balance processing) on the image data output from the A / D converter 104.

  The image data output from the A / D converter 104 is written into the memory 111 via the image processing unit 105 and the memory control unit 106 or via the memory control unit 106. The memory 111 stores image data converted into a digital signal by the A / D converter 104 and image data to be displayed on the display unit (image display unit) 110. Therefore, the memory 111 has a storage capacity sufficient to store a predetermined number of still images, a moving image and sound for a predetermined time.

  The GPU 107 is a rendering engine that draws various information displays and menu screens of the digital video camera 100 in a VRAM. In addition to a character string and figure drawing function, it has an enlargement / reduction drawing function, a rotation drawing function, and a layer composition function. The display I / F unit 108 performs superposition synthesis and resizing processing on the image data from the image processing unit 105 sent via the memory control unit 106 and the data in the VRAM drawn by the GPU 107, and performs D / A conversion. Is output to the device 109. The D / A converter 109 converts the image data output from the display I / F unit 108 into an analog signal and outputs the analog signal to the display unit 110. The display unit 110 includes a monitor, a finder, and the like that display the analog signal output from the D / A converter 109.

  The nonvolatile memory 113 is an electrically erasable / recordable memory, and for example, an EEPROM is used. In the nonvolatile memory 113, constants and programs for operating the system control unit 112 are recorded. The system control unit 112 controls the entire digital video camera 100. Each process of this embodiment is executed by executing a program recorded in the nonvolatile memory 113. Further, display control is performed by controlling the memory 111, the display I / F unit 108, the D / A converter 109, and the display unit 110.

  The operation unit 114 receives a user operation and inputs various operation instructions to the system control unit 112. The operation unit 114 includes a touch panel that can detect contact with the display unit 110 in addition to physical buttons. The touch panel and the display unit 110 can be configured integrally, and by associating the input coordinates on the touch panel with the display coordinates on the display unit 110, the user can directly operate the screen displayed on the display unit 110. Such a GUI can be configured.

  The power control unit 115 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not a battery is installed, the type of battery, and the remaining battery level. Further, the power supply control unit 115 controls the DC-DC converter based on the detection result and an instruction from the system control unit 112, and provides a necessary voltage to each unit of the digital video camera 100 for a necessary period. The power supply unit 116 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, and an AC adapter.

  The angular velocity sensor 117 detects the angular velocity of shake applied to the digital video camera 100. The shake correction unit 118 calculates the shake of the imaging apparatus from the angular velocity detected by the angular velocity sensor 117 and the motion vector amount calculated for the image data output from the image processing unit 105. Then, an optical image shake correction process for controlling the shift lens in the photographing lens 101 so as to cancel the calculated shake, or an electronic image shake correction process for cutting out part of the image data is performed. The calculated shake is recorded as metadata in association with the image so that it can be referred to when reproducing the image.

  The system timer 119 measures the time used for various controls and the time of a built-in clock. The system memory 120 is a memory for developing constants, variables, and programs read from the nonvolatile memory 113 for operation of the system control unit 112, and a RAM is used.

  The recording medium I / F 121 is an interface that connects the recording medium 122 and the digital video camera 100. The recording medium 122 is a recording medium such as a memory card, a hard disk, or a USB memory for recording captured images and metadata, and includes a semiconductor memory, a magnetic disk, or the like.

  FIG. 2 is a block diagram illustrating a configuration of the digital video camera 100 according to the present embodiment as an image reproducing apparatus. In FIG. 2, an image to which metadata including a shake amount at the time of shooting by the digital video camera 100 is recorded is recorded on the recording medium 122. However, the recording format of the metadata and the image data may be any format as long as the metadata and the image data can be acquired. For example, the metadata and the image data may be recorded separately.

  The recording medium I / F 121 acquires image data and metadata from the recording medium 122 and outputs them to the memory 111. The memory 111 stores image data and metadata output from the recording medium I / F 121 for several seconds. The metadata reading unit 201 reads the metadata stored in the memory 111 and outputs it to the shake data acquisition unit 202. The shake data acquisition unit 202 acquires shake data of the digital video camera 100 from the metadata output from the metadata reading unit 201.

  The correction strength setting unit 203 sets the shake correction strength according to the input from the operation unit 114. The cutout size setting unit 204 determines the cutout size of the image based on the acquired shake data and shake correction strength, and outputs the image cutout size to the image processing unit 105. The motion vector detection unit 205 detects a motion vector amount from the image stored in the memory and outputs it to the cutout position setting unit 206. The cutout position setting unit 206 determines an image cutout position based on the acquired motion vector amount and the cutout size of the image, and outputs the image cutout position to the image processing unit 105. The shake correction unit 118 described above implements the functions of the metadata reading unit 201, the shake data acquisition unit 202, the correction strength setting unit 203, the cutout size setting unit 204, the motion vector detection unit 205, and the cutout position setting unit 206. .

  The shake graph generation unit 207 generates a shake graph representing a time transition of shake based on the obtained shake data. The generated shake graph is superimposed on the image by the display I / F unit 108. The aforementioned GPU 107 implements the function of the shake graph generation unit 207.

  The image stored in the memory 111 is cut out as necessary by the image processing unit 105 and then displayed on the display unit 110 through the display I / F unit 108 and the D / A converter 109.

  FIG. 3A and FIG. 3B are schematic views showing an outline of image blur correction in the present embodiment. The shake correction at the time of image reproduction will be described with reference to FIG. With respect to the image data (frame image) 301 of the moving image stream developed in the memory 111, the cutout size setting unit 204 determines the size of the cutout frame 302, and the cutout position setting unit 206 determines the position of the cutout frame 302. Then, the image processing unit 105 enlarges the image in the cutout frame 302 so as to have the same size as the image data 301. An enlarged image 303 that is an image in the enlarged cutout frame 302 is displayed on the display unit 110 through the display I / F unit 108 and the D / A converter 109.

  Further, the image data of the next frame of the image data 301 is set as image data 304. Here, it is assumed that the area 305 in the image data 304 is the same area as the cutout frame 302 on the imaging surface. However, the image in the cutout frame 302 and the image in the region 305 are different from each other due to the camera shake of the photographer that occurred between the image data 301 and the image data 304. For this reason, a cutout frame 306 having a maximum similarity between the cutout frame 302 and the image is detected. The position of the cutout frame 306 can be determined by extracting feature points that match between the image data 301 and the image data 304 or by detecting a motion vector amount of the image data 304 with respect to the image data 301 using a block matching method or the like. The image in the cutout frame 306 is enlarged by the image processing unit 105 to be an enlarged image 307 and displayed on the display unit 110 in the same manner as the image in the cutout frame 302.

  FIG. 4 is a flowchart regarding a shake correction operation before reproduction of a moving image. In step S401, the metadata reading unit 201 reads metadata recorded in an image to be reproduced. Note that metadata is read from all frames of an image to be reproduced.

  In step S402, the shake data acquisition unit 202 acquires shake data from the metadata. In step 403, the shake graph generation unit 207 uses the obtained shake data to show a shake graph that represents a change in shake time with the shake (angle) of the digital video camera 100 during moving image shooting as the vertical axis and time as the horizontal axis. Is generated.

  In step S404, the display I / F unit 108 displays a shake graph on the display unit 110 (graph display). FIG. 5 is a schematic diagram showing a shake graph, and a curve 501 represents the magnitude of the shake in a certain time range.

  In step S405, the correction strength setting unit 203 determines whether there is a change request for shake correction strength. The shake correction strength is a strength for correcting the shake of the image. The larger the value, the larger the shake that can be corrected. On the other hand, the cut-out size cut out from the image data is reduced, and the cut-out size is enlarged and displayed on the entire screen, so that the resolution when displayed is deteriorated. The shake correction strengths 502 to 504 in FIG. 5 are indexes indicating whether or not the shake magnitude can be corrected. If the value indicated by the curve 501 is small with respect to each shake correction strength, the shake correction strength can be corrected. Indicates that there is a shake remaining. If the user needs to change the initial value of the shake correction strength (the shake correction strength 503 indicated by a thick line in FIG. 5), the user operates the operation unit 114 to change the shake correction strength to 502 or 504. . As an operation method of the operation unit 114, for example, touching an icon representing shake correction strength with a touch panel is conceivable. If there is no change request for shake correction strength, the process proceeds to step S406. If there is a change request for shake correction strength, the process proceeds to step S407.

  In step S406, the cutout size setting unit 204 sets the cutout size of the image to a predetermined size. In step S407, the cutout size setting unit 204 changes the cutout size of the image in accordance with the change of the shake correction strength (cutout size calculation). In step S408, the cutout position setting unit 206 sets a cutout position for the initial frame of the image (cutout position calculation). In step S408, the system control unit 112 starts image reproduction.

  FIG. 6 is a flowchart relating to a shake correction operation during reproduction of a moving image. In step S601, the correction strength setting unit 203 determines whether there is a change request for shake correction strength. If there is a request for changing the shake correction strength, the process proceeds to step S602; otherwise, the process proceeds to step S603.

  In step S602, the cutout size setting unit 204 sets the cutout size of the image of the previous frame as the cutout size of the current frame because there is no request for changing the correction strength. In step S603, the cutout size setting unit 204 changes the cutout size of the image based on the change in shake correction strength.

  In step S604, the motion vector detection unit 205 detects a motion vector amount from the current frame and the previous frame. In step S605, the cutout position setting unit 206 determines the cutout position of the current frame image from the cutout position of the previous frame image, the motion vector amount detected in step S604, and the cutout size of the image.

  In step S606, the image processing unit 105 cuts out an image based on the set cut size and cut position. In step S607, the image processing unit 105 enlarges the clipped image so as to have the same size as the original image. In step S608, the shake graph generation unit 207 generates a shake graph to be displayed superimposed on the image. At this time, a limited area is set for the display range of the shake graph so as not to disturb the image. Therefore, unlike the graph generated in step 403, the period represented by the horizontal axis of the graph is not a length of the entire image, but a certain period.

  In step S609, the display I / F unit 108 displays a shake graph superimposed on the image. FIG. 7 is a schematic diagram of a shake graph displayed superimposed on an image. The shake graph 701 represents a change in shake up to, for example, 15 seconds after the reproduction time. The correction intensity 702 represents the magnitude of shake that can be corrected with the current correction intensity. In FIG. 7, the display range of the shake graph is 15 seconds, but this time is an example.

  In step S610, the system control unit 112 determines whether or not the image stream has ended. If it has ended, the system control unit 112 proceeds to step S610. If not, the system control unit 112 returns to step S601 and proceeds to the next frame.

  In step S611, the system control unit 112 records the shake correction intensity transition changed during reproduction in association with the reproduced image. As a result, when the image is reproduced for the second time, it is possible to reproduce the image using the shake correction strength set for the first time without any user operation.

  As described above, in the present embodiment, the digital video camera 100 generates and displays a shake graph from shake data recorded in the metadata of the image during image playback. Then, the user determines whether or not the shake correction strength needs to be changed by looking at the shake graph, and changes the shake correction strength if necessary. As a result, it is possible to reproduce with the strength of shake correction that matches the user's preference (image quality, image clipping range, etc.).

<Second Embodiment>
In the first embodiment described above, the shake graph shows the time variation of the shake of the imaging apparatus based on the shake data. In the present embodiment, a time at which the shake tendency of the imaging apparatus changes is detected from a change in shake data (tendency change detection), and the time is displayed on a shake graph. Further, the time range displayed on the shake graph is lengthened when the time when the tendency of shake changes during image reproduction approaches. As a result, the user can easily understand the timing at which the shake correction strength may be better changed. In addition, it is possible to prepare for input when making changes.

  Since the configuration of the video camera 100 in the second embodiment of the present invention is substantially the same as the configuration of the first embodiment, detailed description of the configuration is omitted. Hereinafter, differences from the first embodiment will be described.

  FIG. 8 is a block diagram illustrating a configuration of the digital video camera 100 according to the second embodiment as an image reproducing device. As a difference from the first embodiment, the shake correction unit 118 will be described. Before outputting the shake data acquired by the shake data acquisition unit 202 to the shake graph generation unit 207, the shake data acquisition unit 202 passes through the shake change detection unit 801. The shake change detection unit 801 analyzes the shake data, detects a shake tendency change time that is a time when the shake tendency due to the magnitude of the shake, panning, tilting, etc. changes, and combines the shake data with the shake trend change time. The result is output to the shake graph generation unit 207.

  The shake graph generation unit 207 displays not only the time variation of the shake but also the time when the tendency of the shake changes on the shake graph. FIG. 9 is a schematic diagram of a graph displayed before reproduction of a moving image in the second embodiment. In this figure, for example, by displaying the shake tendency change time as indicated by a vertical line 901, the time at which the shake tendency in the moving image changes is easily shown to the user.

  FIG. 10 is a diagram showing step S608, which is a difference from the flowchart of the first embodiment, in the flowchart regarding the shake correction operation during moving image reproduction in the second embodiment.

  In step S1001 in the process of step S608, the shake change detection unit 801 detects whether or not the tendency of shake changes after a predetermined time. If the shake tendency does not change after a predetermined time, the process proceeds to step S1002, and if the shake tendency changes, the process proceeds to S1003.

  In step S1002, the shake graph generation unit 207 sets a range to be displayed on the shake graph as a predetermined time range. In step S1003, the shake graph generation unit 207 expands the time range displayed on the shake graph from the predetermined time range. That is, if the shake tendency does not change after a predetermined time, the change in the shake in the time range shown in the display frame 902 in FIG. 9 is displayed superimposed on the playback screen. On the other hand, when the tendency of shake changes after a predetermined time, a change in shake in a time range longer than the display frame 902 is superimposed and displayed on the playback screen as in the display frame 903 of FIG.

  In step S1004, after a shake graph is created, it is determined in step S1005 whether or not the shake graph includes a shake tendency change time. When the shake trend change time is included in the display range of the shake graph, the process proceeds to step S1006.

  In step S1006, the shake tendency change time is displayed on the shake graph. FIG. 11 is a schematic diagram illustrating a graph that is displayed superimposed on an image during playback of a moving image according to the second embodiment. The shake graph 1101 represents a change in shake up to 30 seconds after the playback time as a reference, and displays a longer time range than the shake graph 701 (FIG. 7) having a predetermined time range as a display range. A vertical line 1102 indicates the shake tendency change time. Thereby, the user can easily determine when the swing tendency changes with respect to the current playback time.

<Third Embodiment>
In the first embodiment and the second embodiment described above, the shake (angle) of the imaging device at the time of capturing a moving image is calculated from the shake data, and is used for setting the cutout size, and as the vertical axis of the shake graph. Using. In the present embodiment, not the shake of the image pickup apparatus but the shake of the image (the shake of the subject on the screen) is calculated (screen shake amount calculation) and used for setting the cutout size and used as the vertical axis of the shake graph. This makes it possible to generate shake graphs that are more accurate in accordance with shake correction and image appearance.

  Since the configuration of the digital video camera 100 in the third embodiment is substantially the same as the configuration of the first embodiment, detailed description of the configuration is omitted. Hereinafter, differences from the first embodiment will be described.

  In the block diagram showing the configuration of the digital video camera 100 in FIG. 1, in the third embodiment, the system control unit 112 acquires the focal length of the photographing lens 101 during recording. The acquired focal length is recorded in association with the image as metadata so that it can be referred to when reproducing the image.

  FIG. 12 is a block diagram illustrating a configuration of the digital video camera 100 as an image reproducing device according to the third embodiment. As a difference from the first embodiment, the shake correction unit 118 and the GPU 107 will be described.

  The metadata reading unit 201 reads the metadata stored in the memory 111 and outputs it to the shake data acquisition unit 202 and the focal length acquisition unit 1201. The focal length acquisition unit 1201 acquires the focal length of the lens at the time of recording from the metadata output from the metadata reading unit 201, and outputs it to the screen shake calculation unit 1202.

  A screen shake calculation unit 1202 calculates a screen shake amount from the shake data and the focal length. The shake data representing the shake of the imaging device does not necessarily match the shake state of the recorded image. That is, when the focal length is on the wide side, the shake of the imaging device does not significantly affect the recorded image. However, when the focal length is on the tele side, the shake of the imaging device greatly affects the recorded image. Therefore, a shake amount in accordance with the shake of the screen is calculated from the shake data and the focal length, and is used for the shake correction process. Thereby, more accurate image blur correction can be performed as compared with the case where only the shake data of the imaging apparatus is used.

  The screen shake graph generation unit 1203 in the GPU 107 generates a graph with the obtained screen shake amount (distance) as the vertical axis and time as the horizontal axis. By graphing the shake amount of the screen, the user can check the time change of the shake according to the shake state of the image.

  FIG. 13 is a flowchart illustrating a shake correction operation during image reproduction according to the third embodiment. Steps S1301 and S1302 are the same as steps S401 and S402 of the first embodiment. In step S1303, the focal length acquisition unit 1201 acquires the focal length from the metadata.

  In step S1304, it is determined whether the focal length is recorded in the metadata. If it is recorded, the process proceeds to step S1305. If it is not recorded, the process proceeds to step S1307. In step S1305, the screen shake calculation unit 1202 calculates the screen shake amount from the shake data and the focal length. In step S <b> 1306, the screen shake graph generation unit 1203 generates a shake graph representing the time change of the screen shake amount with the screen shake amount as the vertical axis and the time as the horizontal axis.

  Steps S1307 to S1313 are the same as steps S403 to S409 in the first embodiment.

  As described above, according to the first to third embodiments, the shake according to the user's preference can be obtained by determining the shake correction strength at the time of playing the image by the user viewing the shake graph before playing the image. It is possible to select the correction strength. Also, even if the shake correction strength selected before image playback during image playback is inappropriate in the scene being played back, the shake correction strength is changed as necessary using the image and shake graph during playback as a criterion. It becomes possible.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. Furthermore, each embodiment mentioned above shows only one embodiment of this invention, and you may combine a part of each embodiment suitably.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

DESCRIPTION OF SYMBOLS 100: Digital video camera, 101: Shooting lens, 102: Shutter, 103: Image sensor, 105: Image processing part, 107: GPU, 110: Display part, 112: System control part, 117: Angular velocity sensor, 118: Shake correction Part

Claims (13)

Acquisition means for acquiring shake data representing shake of the imaging device recorded at the time of capturing a moving image;
Generating means for generating a shake graph representing a time change of the shake data;
Graph display means for displaying the shake graph;
Size calculation means for calculating a cut-out size of each frame image constituting the moving image when the moving image is reproduced while performing shake correction using the shake data;
Position calculation means for calculating the cutout position of each frame image using the cutout size and the motion vector amount of the subject detected from the moving image by the detection means;
Image display means for cutting out and displaying each frame image based on the cutout size and the cutout position;
Control means for controlling to display the shake graph on the graph display means before cutting out each frame image based on the cut-out size and the cut-out position and starting playback of the moving image;
An image reproducing apparatus comprising:   2. The image reproduction apparatus according to claim 1, wherein the generation unit generates the shake graph in a predetermined time range based on a current time during reproduction of the moving image.   The image reproducing apparatus according to claim 2, wherein the image display unit also serves as the graph display unit.   4. The image reproduction apparatus according to claim 3, wherein the image display means displays a shake graph in the predetermined time range superimposed on the moving image being reproduced.   The image reproducing apparatus according to claim 1, further comprising changing means for changing the intensity of the shake correction.   6. The image reproducing apparatus according to claim 5, further comprising an input unit for a user to input the shake correction intensity to the changing unit.   The change means cuts out each frame image with a predetermined cut-out size when there is no user input to the input means. When there is a user input to the input means, the change means The image reproduction apparatus according to claim 6, wherein each frame image is cut out with a cut-out size based on intensity.   Providing further a tendency change detecting means for detecting a time when the tendency of the shake changes from the shake data, the generating means generating the shake graph so that the time when the tendency of the shake changes is displayed in the shake graph. The image reproducing apparatus according to claim 2, wherein:   The generation unit generates the shake graph in which the predetermined time range is expanded when the tendency of the shake changes after a predetermined time during reproduction of the moving image. Image playback device.   A focal length acquisition unit that acquires a focal length of the photographing lens recorded at the time of shooting the moving image, and a screen that calculates a screen shake amount that is a shake amount of the subject on the screen using the shake data and the focal length. The image processing apparatus further includes shake amount calculation means and switching means for switching data used when generating the shake graph between the shake data and the screen shake amount data, and the generation means has the focal length in the moving image. 2. The shake graph is generated using the shake data when not recorded, and the shake graph is generated using the screen shake amount when the focal length is recorded. 10. The image reproducing device according to any one of 9 above. An acquisition step of acquiring shake data representing the shake of the imaging device recorded at the time of capturing a moving image;
A generation step of generating a shake graph representing a time change of the shake data;
A graph display step of displaying the shake graph on a graph display means;
A size calculation step of calculating a cutout size of each frame image constituting the moving image when the moving image is reproduced while performing shake correction using the shake data;
A position calculating step of calculating a cutout position of each frame image using the cutout size and a motion vector amount of the subject detected from the moving image;
An image display step of cutting out each frame image based on the cutout size and the cutout position and displaying the image on an image display unit;
A control step for controlling to display the shake graph on the graph display means before cutting out each frame image based on the cut-out size and the cut-out position and starting playback of the moving image;
An image reproduction method comprising:   The program for making a computer perform each process of the image reproduction method of Claim 11.   A computer-readable storage medium storing a program for causing a computer to execute each step of the image reproduction method according to claim 11.

Images