JP2017220800A - Reproduction device, control method thereof, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To preliminarily notify a user of a deteriorating state of visibility of a video.SOLUTION: A memory 104 of a reproduction device stores video data with an amount of blur in photography. A frame pre-read part 111 of a control part 110 reads and acquires the data of a frame to be displayed and a subsequent frame from the memory 104. A blur amount calculation part 112 calculates the amount of blur from the pre-read frame, and a blur correction amount calculation part 113 calculates the correction amount of image blur on the basis of the amount of blur. A low visibility frame detection part 120 detects whether or not the visibility of a video deteriorates with respect to each frame by using the image data of the read frame, the amount of blur calculated by the blur amount calculation part 112 and the correction amount calculated by the blur correction amount calculation part 113. When the deteriorating state of the visibility of the video is detected by the low visibility frame detection part 120, a user notification part 116 performs notification processing to a user via a display device 106 before reproduction.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technology for detecting a state of reduced visibility of a video and notifying a user.

  In some cases, image blurring (so-called image blurring) is recorded due to a hand shake of a user holding an imaging recording device such as a video camera. In order to correct image blur at the time of video playback, a technique is known in which a video portion is generated outside a video region that is actually displayed by enlarging the video to change the cutout position of the video ( Patent Document 1). In addition, there is a technique for detecting shake of a video camera with a sensor at the time of imaging, recording shake data together with video data, and correcting the image blur using the shake data at the time of video playback (see Patent Document 2). In addition, there is a technique for detecting whether or not a specific subject is within the photographing range at the time of photographing, and in the case where the subject is not within the photographing range, a technique for notifying the movement of the imaging device is known (see Patent Document 3).

JP-A-7-143380 Japanese Patent Laid-Open No. 10-42233 JP 2007-142866 A

For example, if the image is enlarged for the purpose of image blur correction when the subject image is located at the edge of the screen, a phenomenon (frame out) that the subject image is not displayed on the screen occurs. Further, when correcting an image blur accompanied by a very large shake caused by an erroneous operation of the photographer, a phenomenon occurs in which the resolution becomes extremely coarse by greatly increasing the image enlargement ratio, and the image becomes difficult to view. In contrast to a phenomenon that may lead to a decrease in the visibility of the video, the user will notice that a decrease in the visibility has occurred after the playback of the video in the conventional technology. Since the user could not know that the visibility had deteriorated before playing the video, depending on the electronic magnification value and angle of view setting, the image of the subject of interest may not be displayed off the screen frame There is sex.
An object of the present invention is to notify a user in advance of a state in which the visibility of an image is lowered.

  An apparatus according to an embodiment of the present invention is a playback device that acquires and reproduces video data together with shake amount information at the time of imaging, and calculates a correction amount for correcting image blur of the video from the shake amount information. Correction amount calculating means, image processing means for acquiring the correction amount and generating video data in which image blur is corrected, and obtaining the video data, the shake amount, and the correction amount to obtain video visibility. A notification means for performing a process of notifying reproduction of a decrease in the visibility of the video before reproduction when a state in which the visibility of the video is lower than a predetermined state is detected by a detection means for detecting a lowered state; .

  ADVANTAGE OF THE INVENTION According to this invention, a user can be notified beforehand about the fall state of the visibility of a video.

It is a block diagram which shows the structural example of the reproducing | regenerating apparatus which concerns on embodiment of this invention. It is a figure which shows the example of UI (user interface) screen of 1st Embodiment. It is a figure which shows the example of UI screen of 2nd Embodiment. It is a flowchart explaining the detection and notification process of 3rd Embodiment.

In the following, matters common to each embodiment of the present invention are described, and then each embodiment is described in detail.
FIG. 1 is a block diagram showing a configuration example of a playback apparatus according to an embodiment of the present invention. The playback device of this embodiment includes a video playback unit 100. The video playback unit 100 prefetches frames included in the video data to correct image blur, and plays back and outputs the corrected data. When the video playback unit 100 confirms the visibility of the frame before playback and corrects the image blur, and determines that there is a possibility that a specific subject is out of the frame, the video playback unit 100 performs processing for notifying the user of the corresponding frame in advance. Do. Hereinafter, each part will be described in detail.

  Video data is recorded on the recording medium 101. For example, shake information such as camera shake and a video scene number are added to the video data as metadata. The shake information and the video scene number may be information recorded separately from the video data, not the additional information to the video data.

  The drive unit 102 acquires video data and metadata from the recording medium 101. The decoding unit 103 decodes the video data acquired from the recording medium 101 and outputs the decoded digital video signal to the memory 104 together with the acquired metadata. The memory 104 is a storage device having a capacity for storing the decoded video data and metadata for a predetermined time (for example, several seconds). By storing video data for a predetermined time in the memory 104, image data that is temporally ahead of the reproduced image (image being reproduced) output to the display device 106 is acquired from the memory 104. So-called prefetching becomes possible.

  The control unit 110 includes a microcomputer. FIG. 1 shows functional blocks realized by a program executed by the microcomputer. The image processing unit 105 reproduces the video data according to the cutout position and cutout size of the image determined by the processing of the control unit 110. Specifically, for each of a plurality of unit images (in this example, frame images) constituting the video represented by the video data, the image processing unit 105 sequentially outputs images of a predetermined cutout size from a predetermined cutout position of the unit image. cut. Then, the image processing unit 105 performs electronic zoom processing on the cut-out image and outputs it to the display device 106. The unit image constituting the video may be a field image instead of the frame image. The display device 106 performs video display by sequentially displaying an image output from the image processing unit 105 and an image subsequent to the image.

  Next, the configuration of the control unit 110 will be described. The control unit 110 includes a frame prefetching unit 111, a shake amount calculation unit 112, a first shake correction amount calculation unit 113, a second shake correction amount calculation unit 114, a user input unit 115, and a low visibility frame detection unit 120. .

  The frame prefetching unit 111 performs prefetching by extracting data of a plurality of frames in time series from the digital image data stored in the memory 104. The number of frames to be prefetched is determined in advance, and the data over a plurality of read frames is output to the shake amount calculation unit 112 and the low visibility frame detection unit 120.

  The shake amount calculation unit 112 detects a motion vector by a comparison process between frames before and after the currently output frame (frame to be displayed) among the plurality of pre-read frames. Based on the detected motion vector, the vector shake amount of the frame is calculated. This vector shake amount information may be recorded on the recording medium 101 together with the video data at the time of recording, and read and used at the time of reproduction. In addition to this, gyro sensor information (angular velocity sensor value or the like) may be recorded in advance on the recording medium 101 together with the video data, and read and used during reproduction. As for the vector shake amount of the frame, if a low frequency component shake that falls below a predetermined threshold in the same direction is detected for a certain period of time, the overall shake amount is reduced from the overall shake amount by a general process at the time of panning detection. The component shake amount may be subtracted. In this case, a shake amount of a predetermined frequency band component is calculated, and a shake component of an intentional motion by a photographer such as panning or tilting can be excluded.

  The first shake correction amount calculation unit 113 calculates the image blur correction amount based on the vector shake amount, the shake amount by the gyro sensor, or both from the shake amount calculation unit 112. The image blur correction process is a process of calculating the cutout position and cutout size of an image and notifying the image processing unit 105 to correct the shake of the output frame.

  The low visibility frame detection unit 120 includes an in-frame subject detection unit 121, a subject correction frame outside detection unit 122, a continuous subject correction outside frame detection unit 123, and a continuous subject shake amount detection unit 124. The low visibility frame detection unit 120 detects a state of reduced visibility of an arbitrary frame that has been prefetched by the frame prefetching unit 111. In the first embodiment, the low-visibility frame is detected by an in-frame subject detection unit (hereinafter simply referred to as a subject detection unit) 121, a subject correction frame detection unit 122, and a continuous subject correction frame detection unit (hereinafter, continuous frame detection). Part) 123). In the second embodiment, the low-visibility frame is detected by the continuous subject shake amount detection unit 124. In the third embodiment, the detection is performed by the subject detection unit 121, the subject correction out-of-frame detection unit 122, the continuous out-of-frame detection unit 123, and the continuous subject shake amount detection unit 124.

[First Embodiment]
In this embodiment, the low-visibility frame detection unit 120 acquires image data from the frame prefetching unit 111, and the subject detection unit 121 determines whether a specific subject is displayed in an arbitrary frame that has been prefetched. Is detected. The subject correction out-of-frame detection unit 122 detects whether a specific subject is displayed when an arbitrary frame image is corrected. This correction is performed based on the shake correction amount calculated by the first shake correction amount calculation unit 113, and is a process of correcting the image based on the calculated cutout position and cutout size. The specific subject is a subject of interest detected in a frame image, for example. Only when a specific subject is detected by the subject detection unit 121 and not detected by the subject correction frame detection unit 122, it is assumed that the specific subject is “detected outside the frame”. The frame is a predetermined screen frame, and a specific example will be described later with reference to FIG.

  The out-of-frame detection unit 123 is specified when the subject detection unit 121 and the subject correction out-of-frame detection unit 122 “detected out-of-frame” in a predetermined number or more of arbitrary frames that have been pre-read. Are detected as out-of-frame subjects. The continuous out-of-frame detection unit 123 includes information on the detected out-of-frame subject and information indicating how far (for example, how many pixels) the out-of-frame subject is out of the frame (hereinafter referred to as out-of-frame size information). To notify.

  The control unit 110 includes a user notification unit 116. The user notification unit 116 acquires information on the out-of-frame subject and out-of-frame size information from the continuous out-of-frame detection unit 123, displays the out-of-frame subject and the protruding state outside the frame on the screen by the display device 106, and performs processing for notifying the user. . For example, the display device 106 performs display to emphasize the corresponding frame when an out-of-frame subject is detected, and simultaneously displays out-of-frame size information.

  The control unit 110 includes a second shake correction amount calculation unit 114 and a user input unit 115. When it is detected that a specific subject is displayed as an out-of-frame subject, the second shake correction amount calculation unit 114 calculates a shake correction amount based on the out-of-frame size information acquired from the continuous out-of-frame detection unit 123. The shake correction amount is calculated by recalculating the cutout position and cutout size of the image so that the detected image of the specific subject is within the frame. In addition, the second shake correction amount calculation unit 114 performs processing by acquiring the cutout position and cutout size instructed by the user input unit 115. In this case, the user can confirm the image of the out-of-frame subject on the screen and the state where it is out of the frame, and can instruct the second shake correction amount calculation unit 114.

The image processing unit 105 acquires the following shake correction amount from the first or second shake correction amount calculation unit.
The first shake correction amount calculated by the first shake correction amount calculation unit 113 when the second shake correction amount calculation unit 114 does not calculate the second shake correction amount.
The second shake correction amount when the second shake correction amount calculation unit 114 calculates the second shake correction amount.

  The image processing unit 105 changes the angle of view by electronic zoom processing based on the acquired first or second shake correction amount, and generates image data in which image blur is corrected. The low visibility type determination unit 130 (outside frame determination unit 131, shake amount determination unit 132) will be described in an embodiment described later.

  Next, a specific example of screen display by the display device 106 will be described with reference to FIG. A screen frame 200 on the display screen indicates a range in which thumbnails of recorded videos are displayed. In this example, it is shown that the user selects the video 201 with the cursor 202 and further selects the screen setting menu 204 with the menu 203. At this time, it is assumed that the subject 205 is selected as the specific subject. That is, the subject 205 is a subject of interest in the frame image.

  When the user selects the screen setting menu 204, a screen frame 210 is displayed. A plurality of images are displayed on the screen frame 210 for each frame. In the area 211, as shown in a frame 213 and a frame 215, images of each frame are displayed in time series from left to right. For each frame, a plurality of frames may be displayed together. An image that cannot be displayed within the frame can be displayed by the user performing an operation of moving the slide bar 212 left and right.

  When the out-of-frame detection unit 123 detects an out-of-frame subject, the cursor 214 automatically designates the corresponding frame. In this example, the first frame found in time series is given priority, but another target frame (such as the next detected frame) may be highlighted at the same time. The designated frame is displayed in area 220. The area 220 is displayed as an angle of view in which the shake is not corrected with the frame prefetched by the frame prefetching unit 111 as it is.

  A broken-line rectangular frame 221 is a correction frame for correcting image blur based on the shake correction amount calculated by the first shake correction amount calculation unit 113. The subject 222 is an out-of-frame subject, and the image is displayed outside the rectangular frame 221. The slide bar 230 of the user input unit 115 is used to change the cutout enlargement ratio, and the cross key 240 of the user input unit 115 is an operation part used to change the cutout position. The user changes the cut-out magnification by operating the slide bar 230 and corrects the angle of view by changing the cut-out position using the cross key 240. The cutout enlargement ratio and the cutout position changed here are applied to all frames in the video 201. By changing the angle of view, all or a part of the out-of-frame subject can be corrected so as to be within a predetermined screen frame. Alternatively, the display device 106 displays an image in which the angle of view is automatically corrected so that all or part of the out-of-frame subject is within a predetermined screen frame, so that the user can confirm the image. Note that if the set cut-out position becomes a fixed position after that, there may be a problem in visibility. In this case, the user does not operate the cutout position, and the image blur is corrected based on the shake correction amount by the first shake correction amount calculation unit 113 for the cutout position. The same applies to the embodiments described later. In addition, the angle of view correction is automatically performed based on the shake correction amount calculated by the second shake correction amount calculation unit 114 and applied to all frames in the region 220, the rectangular frame 221, and the video 201. Good.

  The playback apparatus according to the present embodiment detects whether or not a specific subject is out of the frame and whether or not the enlargement rate of the video is extremely large before video playback. These detections are performed based on image data generated in a state where image blur is corrected. The user can correct the angle of view so that the photographed subject of interest is always displayed within the screen frame. According to this embodiment, since it is possible to notify the viewer in advance of the frame in the video when it is determined that the visibility of the video may be lower than a predetermined state, convenience is improved. To do.

[Second Embodiment]
The second embodiment of the present invention will be described below. The difference between the present embodiment and the first embodiment is the processing in the low visibility frame detection unit 120. The detection process by the continuous subject shake amount detection unit 124 will be mainly described, and the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

  The low-visibility frame detection unit 120 in FIG. 1 acquires the shake amount calculated by the shake amount calculation unit 112 in a predetermined number or more of the arbitrary frames that have been pre-read by the frame pre-read unit 111. . The continuous subject shake amount detection unit 124 compares the maximum value and the minimum value of the acquired shake amount, and detects that the shake is large when the difference between the maximum value and the minimum value exceeds a predetermined threshold. When it is detected that the shake is large, the low visibility frame detection unit 120 determines that the shake is caused by an erroneous operation by the user. In this case, it is determined that there is no need to correct the shake as an image. For this reason, the continuous subject shake amount detection unit 124 instructs the user notification unit 116 to notify that it is recommended not to perform image blur correction. Then, the continuous subject shake amount detection unit 124 notifies the second shake correction amount calculation unit 114 of the detection result indicating that the shake is large and the shake amount to be corrected. In this case, the shake amount to be corrected is zero (that is, there is no need for correction because the shake is caused by a user's erroneous operation).

  When the second shake correction amount calculation unit 114 calculates the second shake correction amount, the image processing unit 105 acquires the second shake correction amount and performs processing. That is, even if the second shake correction amount calculated by the second shake correction amount calculation unit 114 is zero, the shake correction amount is calculated, so the first shake correction amount calculation unit 113 performs the first correction. The second shake correction amount is acquired instead of the first shake correction amount.

  A specific example of the screen display in the present embodiment will be described with reference to FIG. The screen frame 300 displays the selected video for each frame. The display area 301 expresses that each frame is displayed in chronological order from left to right by distinguishing the magnitude of shake by color coding (shown as a difference in hatching line types in FIG. 3). In this example, the color 302, the color 303, and the color 304 are color-coded according to the magnitude of the shake and are represented by a horizontal bar graph. The color 302 indicates that the shake is small, the color 303 indicates that the shake is moderate, and the color 304 indicates that the shake is large. When the continuous subject shake amount detection unit 124 detects a shake amount equal to or greater than a predetermined threshold, the cursor 305 indicates the corresponding frame. By displaying on the screen the ratio of the frame in which the detection result indicating that the shake is large is obtained, the user can easily grasp the shake ratio in the entire frame. The frame 306 is a partial frame display so that the portion of the frame indicated by the cursor 305 can be easily seen.

  The designated frame image is displayed in area 310. In the area 310, an image is displayed as an angle of view in which the shake is not corrected with the frame image prefetched by the frame prefetching unit 111 as it is. A broken-line rectangular frame 311 is a correction frame for correcting shake based on the shake correction amount calculated by the first shake correction amount calculation unit 113.

  The user can correct the angle of view by changing the cut-out magnification with the slide bar 320 of the user input unit 115 and changing the cut-out position with the cross key 330 of the user input unit 115. The changed cut-out magnification and cut-out position are applied to all frames in the video 201. The angle of view correction is automatically performed based on the second shake correction amount calculated by the second shake correction amount calculation unit 114, and is applied to the area 310, the rectangular frame 311 and all the frames in the video. Also good.

  In this embodiment, when it is detected that the shake at the time of imaging is very large, a notification recommending that image blur correction not be performed is performed, so that image blur correction can be appropriately performed according to the situation. is there.

[Third Embodiment]
The third embodiment of the present invention will be described below. In this embodiment, the low visibility frame detection unit 120 performs both detections described in the first embodiment and the second embodiment. The low visibility type determination unit 130 in FIG. 1 acquires two types of detection results from the low visibility frame detection unit 120. The first detection result is the detection result of the continuous out-of-frame detection unit 123, and the second detection result is the detection result of the continuous subject shake amount detection unit 124. In the user notification process, the process of the first embodiment or the process of the second embodiment is executed according to these detection results. Specifically, there are four cases shown in the following (1) to (4).

(1) When the first detection result is determined to be detected, and the second detection result is not determined to be detected, the low visibility type determination unit 130 has detected that only the detection outside the continuous frame detection unit 123 has occurred. to decide. The out-of-frame determination unit 131 performs out-of-frame determination when the continuous out-of-frame detection unit 123 detects that a specific subject is an out-of-frame subject, and determines that there is a first detection result. In this case, the aforementioned out-of-frame size information, which is the detection result of the continuous out-of-frame detection unit 123, is output to the user notification unit 116. Similarly, the out-of-frame size information, which is the detection result of the continuous out-of-frame detection unit 123, is also notified to the second shake correction amount calculation unit 114. The subsequent processing is the same as in the first embodiment. In other words, when the second shake correction amount is calculated by the second shake correction amount calculation unit 114, the second shake correction amount is not the first shake correction amount by the first shake correction amount calculation unit 113, but the second shake correction amount. The image processing unit 105 is notified. The screen display example is performed as described in FIG. 2 as in the case of the first embodiment.

(2) When the first detection result is not determined to be detected and the second detection result is determined to be detected, the low visibility type determination unit 130 generates only the detection of the continuous subject shake amount detection unit 124 Judge that you are doing. The shake amount determination unit 132 determines the shake amount when the continuous subject shake amount detection unit 124 detects that the difference in shake amount is large, and determines that the second detection result is present. In this case, a shake amount that is a detection result of the continuous subject shake amount detection unit 124, that is, zero is output to the user notification unit 116. Similarly, the second shake correction amount calculation unit 114 is notified of the shake amount (0) that is the detection result of the continuous subject shake amount detection unit 124. The subsequent processing is the same as in the second embodiment. That is, when the second shake correction amount is calculated by the second shake correction amount calculation unit 114, the second shake correction amount is not the first shake correction amount by the first shake correction amount calculation unit 113, but the second shake correction amount. The image processing unit 105 is notified. The screen display example is performed as described with reference to FIG. 3 as in the case of the second embodiment.

(3) When it is determined that both the first and second detection results are detected The out-of-frame determination unit 131 determines that there is a first detection result, and the shake amount determination unit 132 determines that there is a second detection result. In this case, the process is executed according to a setting determined in advance by the user. That is, the process in the case of (1) or the process in the case of (2) is selected.

(4) When neither the first detection result nor the second detection result is determined to be detected The out-of-frame determination unit 131 does not determine that the first detection result is detected, and the shake amount determination unit 132 detects the second detection result Not determined. In this case, the notification process to the user is not performed. Or similarly to the case of (3), a process is performed according to the setting previously defined by the user. In the case of (4), since the first and second detection results do not exist, the instruction by the cursor 214 in FIG. 2 or the instruction by the cursor 305 in FIG. 3 is not performed.

  The above processing will be described with reference to the flowchart of FIG. Each step of S400-S406 has shown the process which the low visibility classification determination part 130 performs. A description will be given using two detection results: a first detection result by the continuous out-of-frame detection unit 123 and a second detection result by the continuous subject shake amount detection unit 124.

  In S400, a determination process is performed to determine whether both the first and second detection results are detected. That is, the determination is made for the case (3). If the determination condition (3) is satisfied, the process proceeds to S401. If the determination condition is not satisfied, the process proceeds to S402. In S401, a process according to a setting predetermined by the user is executed. That is, one of the processing in the case of (1) and the processing in the case of (2) is performed.

  S402 is a determination process of whether or not the first detection result is detected. If it is determined that the first detection result is detected, the process proceeds to S403. If the first detection result is not determined to be detected, the process proceeds to S404. The process of S403 corresponds to the process in the case of (1), and the aforementioned out-of-frame size information, which is the detection result of the continuous out-of-frame detection unit 123, is output to the user notification unit 116. Similarly, the out-of-frame size information, which is the detection result of the continuous out-of-frame detection unit 123, is also output to the second shake correction amount calculation unit 114.

  S404 is a determination process of whether or not the second detection result is detected. When it is determined that the second detection result is detected, the process proceeds to S405, and when the second detection result is not determined to be detected, the process proceeds to S406. The process of S405 corresponds to the process of (2), and the shake amount (0) that is the detection result of the continuous subject shake amount detection unit 124 is output to the user notification unit 116. Similarly, the shake amount (0) that is the detection result of the continuous subject shake amount detection unit 124 is output to the second shake correction amount calculation unit 114.

  S406 is a case where none of the detections have been made, and corresponds to the process in the case of (4). In this case, the user is not notified. Alternatively, a predetermined process is executed according to a setting determined in advance by the user.

  According to this embodiment, based on the determination of the first and second detection results, image blur correction can be appropriately executed by the processing of the first embodiment and the processing of the second embodiment.

[Other Embodiments]
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

DESCRIPTION OF SYMBOLS 100 ... Video reproduction part 104 ... Memory 105 ... Image processing part 106 ... Display device 110 ... Control part 112 ... Shake amount calculation part 113 ... First shake correction amount calculation unit 114 ... Second shake correction amount calculation unit 116 ... User notification unit 120 ... Low visibility frame detection unit 130 ... Low visibility type determination Part

Claims (15)

A playback device that acquires and plays back video data together with information on the amount of shake during imaging,
A correction amount calculating means for calculating a correction amount for correcting image blur of the video from the information on the shake amount;
Image processing means for acquiring the correction amount and generating video data in which image blur is corrected;
When the state in which the visibility of the video is lower than a predetermined state is detected by a detection unit that acquires the video data, the shake amount, and the correction amount and detects a state in which the visibility of the video is reduced And a notifying means for performing a process of notifying the reduction in the visibility of the video before playback. Storage means for storing information on the shake amount and the video data;
Obtaining means for obtaining data of a plurality of images constituting the video data from the storage means;
The playback apparatus according to claim 1, further comprising: a shake amount calculation unit that calculates the shake amount from data of the plurality of images and outputs the shake amount to the correction amount calculation unit. The acquisition unit pre-reads the video data of a plurality of frames from the storage unit, and outputs to the detection unit and the shake amount calculation unit,
The reproducing apparatus according to claim 2, wherein the correction amount calculating unit calculates a correction amount for correcting an image blur related to the video data of the frame read from the storage unit. The detection means includes
First detection for acquiring video data of the frame and detecting whether an image of a specific subject exists in the video of the frame;
When the image of the specific subject is detected in the video of the frame and the image of the specific subject is not detected in the video of the frame whose image blur is corrected, the image of the specific subject is out of the frame of the screen. A second detection for detecting being located at
The playback apparatus according to claim 3, wherein a third detection is performed to detect that the image of the specific subject is located outside the frame of the screen by the second detection in the plurality of frames.   When the detection unit detects that the image of the specific subject is located outside the frame of the screen in the third detection, the visibility of the image of the frame including the image of the specific subject is in a state of being deteriorated. 5. The playback apparatus according to claim 4, wherein the notification means performs a process of notifying that. The correction amount calculating means includes
First correction amount calculating means for acquiring information on the shake amount and calculating a first correction amount;
6. The reproducing apparatus according to claim 3, further comprising a second correction amount calculation unit that acquires a detection result of the detection unit and calculates a second correction amount.   The detection means calculates a difference between the maximum value and the minimum value of the shake amount acquired for each of the plurality of frames read from the storage means, and the shake is large when the difference is larger than a threshold value. A detection result indicating that the image processing means outputs the video data before the image blur is corrected, when the image processing means obtains the second correction amount. The playback apparatus according to claim 6.   In the third detection, when the detection means detects that the image of the specific subject is located outside the frame of the screen, it performs out-of-frame determination, and for a plurality of frames read from the storage means It comprises a determination unit that calculates a difference between a maximum value and a minimum value of the obtained shake amounts, and performs a shake amount determination when the detection unit detects that the difference is larger than a threshold value. The reproducing apparatus according to claim 4. The determination unit determines that a first detection result indicating that the image of the specific subject is located outside the frame of the screen is obtained in the out-of-frame determination, and the difference is a threshold value in the shake amount determination. If it is determined that the second detection result indicating greater than is not obtained, the first detection result is output to the notification means;
9. The playback apparatus according to claim 8, wherein the notifying unit performs processing for acquiring the first detection result and notifying the frame out of the specific subject. The determination unit determines that a first detection result indicating that the image of the specific subject is located outside the frame of the screen is not obtained in the out-of-frame determination, and the difference is determined in the shake amount determination. When it is determined that a second detection result indicating that is greater than a threshold value has been obtained, the second detection result is output to the notification means,
10. The playback apparatus according to claim 8, wherein the notification unit acquires the second detection result and performs notification processing that recommends that the image blur correction not be performed.   When it is determined that the first and second detection results are obtained, the determination unit outputs the first or second detection result to the notification unit according to a predetermined setting, and the first and second detection results are output. The playback apparatus according to claim 9 or 10, wherein when it is determined that the second detection result is not obtained, the first and second detection results are not output to the notification unit.   When the detection unit detects that the image of the specific subject is located outside the frame of the screen in the third detection, the display unit includes a display unit that displays the image of the specific subject and the frame of the screen. The playback apparatus according to claim 4.   8. The playback apparatus according to claim 7, further comprising display means for displaying, on a screen, a ratio of a frame in which a detection result indicating that shake is large when the difference is greater than a threshold value, to a screen. A control method that is executed by a playback device that acquires and plays back video data together with information on the amount of shake during imaging,
A step of calculating a correction amount for correcting an image blur of the video from the information of the shake amount, and a correction amount calculation unit;
An image processing means for generating video data in which the correction amount is acquired and image blur is corrected;
When the state in which the visibility of the video is lower than a predetermined state is detected by a detection unit that acquires the video data, the shake amount, and the correction amount and detects a state in which the visibility of the video is reduced And a step of performing a process of notifying the noticeability of the video before reproduction by a notifying means. 14. A program that causes a computer to function as each unit included in the playback apparatus according to claim 1.

Images