JP2018074337A - Moving image processing device, moving image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily edit a moving image with a special effect.SOLUTION: A moving image processing device processes a moving image including a first moving image part and a second moving image part obtained by applying a special effect to one section in the first moving image part. The moving image processing device comprises: display control means of controlling so as to display a display item indicating the moving image including the first and second moving image parts and an identification display item that allows a user to identify a position of the one section in the first moving image part; and reception means of receiving instructions to change the one section. The display control means updates the display item so as to indicate a moving image including the first moving image part and a moving image formed by applying the special effect to the changed section, when receiving the instructions to change the section.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a moving image processing apparatus, a moving image processing method, a program, and a recording medium.

In recent years, there have been proposed devices capable of applying various special effects to captured moving images. For example, an apparatus that combines a moving image in which a part of a short-time original moving image is played back fast and a moving image in which the same partial section is played back slowly into the original moving image is combined into one moving image is considered. It is done.
When such a moving image is generated, the start timing of the partial section used for fast reverse playback during shooting of the moving image is not always the timing desired by the photographer. The video may not be the same. In such a case, it is not easy for the photographer to specify the timing at which he / she wants to apply a special effect even if he / she tries to edit the moving image after shooting.

Patent Document 1 discloses a video distribution apparatus that utilizes metadata as a point of interest for reproduction and editing of a moving image, and extracts and provides a point of interest according to individual preferences.
Patent Document 2 discloses a recording information presentation device that focuses on a moving image object and graphs the movement according to the direction to help find a place where the object has a remarkable movement.

JP 2012-129724 A JP 2006-33504 A

However, in the devices of Patent Document 1 and Patent Document 2, it is difficult to specify the timing at which a special effect is to be applied, and even if it can be specified, it is not easy to edit a moving image so as to apply a desired special effect. There is.
The present invention has been made in view of the above-described problems, and an object thereof is to make it possible to easily edit a moving image having a special effect.

  The present invention is a moving image processing apparatus that processes a moving image including a first moving image portion and a second moving image portion in which a special effect is applied to a partial section of the first moving image portion. And display control means for controlling to display a display item indicating a moving image including the second moving image portion, and an identification display item that allows a user to identify the position of the partial section in the first moving image portion, Receiving means for accepting an instruction to change a partial section, and when the display control means accepts an instruction to change the partial section, the first moving image section and the section after the change The display item is updated so as to show a moving image including a moving image generated by applying the special effect.

  According to the present invention, a moving image having a special effect can be easily edited.

It is a block diagram which shows a moving image processing device. It is an image figure which shows the moving image which a moving image processing apparatus handles. It is a flowchart which shows the imaging | photography process of a moving image processing device. It is a flowchart which shows the moving image edit process of a moving image processing device.

Hereinafter, the moving image processing apparatus 100 according to the present embodiment will be described with reference to the drawings. The moving image processing apparatus 100 can edit a moving image in accordance with a user operation. For example, a digital video camera or the like can be applied to the moving image processing apparatus 100.
FIG. 1 is a block diagram of the moving image processing apparatus 100.
The moving image processing apparatus 100 includes a CPU 101, an operation unit 102, a display unit 103, an imaging unit 104, an image holding unit 105, a storage unit 106, a reproduction unit 107, an effect creation unit 108, a moving image combination unit 109, a marker management unit 110, and the like. . Each component is connected by a bus 111.
The CPU 101 controls the operation by transmitting a control code to each component through the bus 111. The CPU 101 also performs control when data is transmitted and received between the components via the bus 111. The CPU 101 is an example of a control unit, a generation unit, a regulation unit, and a reception unit that control each component.

The operation unit 102 receives an operation from the user. The operation unit 102 includes an operation button, a touch panel configured integrally with the display unit 103, and the like. The CPU 101 reads the content of the operation received by the operation unit 102.
The display unit 103 displays a menu for the user to select a function of the moving image processing apparatus 100 and perform other operations, display an operation result, a finder at the time of shooting, and an image at the time of reproduction. The CPU 101 instructs the display unit 103 to display corresponding to the content of the user operation read from the operation unit 102, and the display unit 103 performs display according to the instruction. The CPU 101 is an example of a display control unit that controls the display unit 103.

The imaging unit 104 images a subject. When the operation unit 102 receives a shooting operation, the CPU 101 instructs the imaging unit 104 to perform shooting. The CPU 101 holds the shot image in the image holding unit 105 when shooting is completed.
The image holding unit 105 has a removable external memory (recording medium) that is not shown. The image holding unit 105 records image data in an external memory.
The storage unit 106 stores information necessary for the operation of the moving image processing apparatus 100. The storage unit 106 also stores a program for realizing processing of a flowchart to be described later and various setting values set by the user.

  The reproduction unit 107 reproduces the image held in the image holding unit 105. The reproduction unit 107 reads the image list information from the image holding unit 105 and displays it on the display unit 103. When the user selects a desired image from the image group displayed on the display unit 103 via the operation unit 102, the reproduction unit 107 displays the selected image on the display unit 103. The image includes a still image and a moving image, and the reproduction unit 107 reproduces the moving image if the selected image is a moving image.

  The effect creation unit 108 processes the input moving image to create a moving image including a special effect. A moving image is composed of a series of frames in which one frame corresponds to one frame. Special effects are effects that look different from the original video. The special effects of the present embodiment will be described for the case of a fast reverse playback effect and a slow playback effect. Here, the fast reverse playback effect is an effect realized by rearranging the frames in the reverse order on the time axis and deleting the frames every predetermined number of frames. The fast-rewinding moving image with the fast-rewinding effect is a moving image in which the original moving image is reversely reproduced. On the other hand, the slow reproduction effect is an effect realized by duplicating each frame by a specified number of frames without changing the order of the frames on the time axis. The slow playback video with the slow playback effect is a video that is played back at a speed slower than the playback speed of the original video.

  The moving image combining unit 109 combines a plurality of input moving images to generate one moving image. In this embodiment, the moving image combining unit 109 combines the original moving image with the moving image with the special effect created by the effect creating unit 108. The CPU 101 stores the combined moving image as a moving image file in the image holding unit 105 according to the user's selection.

  The marker management unit 110 reads, writes, and moves the positions of various markers assigned to the moving image frame. The marker management unit 110 associates the target moving image file name with the frame number of the moving image file for each marker to be managed, and holds the information. Further, the marker management unit 110 provides or updates marker information as necessary when a change in the marker position occurs.

FIG. 2 is an image diagram showing a moving image processed by the moving image processing apparatus 100.
FIG. 2A is an image diagram showing a moving image generated by the moving image processing apparatus 100.
The frame display unit 2101 displays the currently designated frame in the moving image. In FIG. 2A, the frame number is displayed on the frame display unit 2101 for convenience, but an image of a frame corresponding to the frame number is actually displayed as a still image.
A frame group 2102 indicates a sequence of frames of the moving image. The numbers in the frame of FIG. 2A indicate the frame number, and the same number indicates the same frame. Here, for the sake of convenience, the entire moving image is represented by about 40 frames for a moving image of 10 seconds as a whole. However, in the case of a 30 fps moving image, the moving image is actually drawn from 300 frames in a moving image of 10 seconds. Composed. Note that the frame group 2102 is expressed by reducing the number of frames for the sake of convenience, and a moving image of one second is composed of four frames.

In the moving image processing apparatus 100 of the present embodiment, when a 5-second moving image is shot, the latter 2 seconds are automatically selected as the effect target portion, and the special effect is applied using the selected effect target portion as a whole. Generate a 10-second video.
Specifically, the effect creating unit 108 creates a moving image with a special effect using the frame of the selected effect target portion. Here, the effect creation unit 108 rearranges the frames of the selected effect target portion in reverse order on the time axis and deletes frames every predetermined number of frames, thereby performing a fast rewind playback effect of 1 second. Create a video. Further, the effect creation unit 108 creates a slow playback moving image of 4 seconds with a slow playback effect by duplicating the frames of the selected effect target portion in the order of the time axis and by copying the frames for a specified number of frames. Next, the moving image combining unit 109 combines the created moving images in the order of the original moving image, the fast reverse reproduction moving image, and the slow reproduction moving image, and generates a moving image of 10 seconds as a whole.
When the video generated by the playback unit 107 is played back, the second half of the original video is played back fast and the second half of the original video is played back slowly after the original video that was shot. The latter half will be emphasized.

Of the frame group 2102, the captured original moving image is the original 2110 interval, the fast reverse playback moving image is the Rewind 2111, and the slow playback moving image is the slow 2112 interval.
The effect target portion in the latter half 2 seconds of the original moving image used for creating Rewind 2111 and Slow 2112 is a section of Selected 2113.
As described above, the frame group 2102 includes a first moving image portion that is a captured original moving image, and a second moving image portion that is subjected to a special effect using a partial section of the original moving image, that is, an effect target portion. .

  The seek bar 2103 is used together with the slider 2104. The seek bar 2103 is a display item indicating the entire moving image. A slider 2104 is a display item indicating the position of a frame that is currently reproduced or instructed in the entire moving image. In FIG. 2A, the slider 2104 is positioned at the frame number 13, and “13” (actually an image with the frame number 13) is displayed on the frame display unit 2101. The slider 2104 can move on the seek bar 2103, and the display content of the frame display unit 2101 changes with the movement.

The S marker 2105 indicates the start point of the effect target part (partial section) of the original moving image used for creating the Rewind 2111 and the Slow 2112. If the movie is still being shot, the second half of the original movie is 2 seconds, that is, 3 seconds after the start. The end point of the effect target part is the end of the original moving image.
The S marker 2105 can be moved along the seek bar 2103 in accordance with an operation through the operation unit 102 by the user. The S marker 2105 can be moved only within the range of the original moving image. When the S marker 2105 is moved, the slider 2104 moves to the same position as the S marker 2105 in conjunction. Therefore, an image of a frame corresponding to the position of the moving S marker 2105 is displayed on the frame display unit 2101. The S marker 2105 is an example of an identification display item that allows the user to identify the position of the effect target portion in the original moving image.

An RS marker 2106 indicates the start point of a fast-rewinding moving image on the seek bar 2103. The frame immediately before the frame indicated by the RS marker 2106 is the end of the photographed original moving image.
An RE marker 2107 indicates the end point of the fast reverse playback moving image on the seek bar 2103. A section surrounded by the RS marker 2106 and the RE marker 2107 corresponds to a section of Rewind 2111 in the frame group 2102.
An SS marker 2108 indicates the start point of the slow playback moving image on the seek bar 2103.
An SE marker 2109 indicates the end point of the slow-motion playback video on the seek bar 2103. A section surrounded by the SS marker 2108 and the SE marker 2109 corresponds to a section of Slow 2112 in the frame group 2102.

  On the display unit 103, a frame display unit 2101, a seek bar 2103, an RS marker 2106, an RE marker 2107, an SS marker 2108, and an SE marker 2109 are displayed as shown in FIG. Accordingly, the user can identify the section of Original 2110, the section of Rewind 2111, the section of Slow 2112, and the section of Selected 2113 by viewing the display unit 103.

FIG. 2B is an image diagram illustrating a moving image when the effect target portion of the moving image illustrated in FIG.
As described above, when the moving image processing apparatus 100 according to the present embodiment captures a moving image of 5 seconds, the latter 2 seconds are automatically selected as the effect target portion. At this time, a progress bar that allows the user to visually recognize the elapsed time is displayed on the display unit 103, and a marker is displayed in a portion corresponding to 3 seconds after the start of shooting on the progress bar. Therefore, the user can grasp the timing that is the starting point of the effect target portion in the original moving image. However, the subject does not always move as expected by the user, and the user may want to shift the start point of the effect target portion after shooting.

FIG. 2B shows the moving image after the S marker 2105 indicating the start point of the effect target portion of the moving image of FIG. 2A is moved in the backward direction of the time axis.
The section of Original 2210 is the same as that of Original 2110. On the other hand, the S marker 2205 moves backward by two frames (0.5 seconds) compared to the S marker 2105 in the section of Original 2210.
As the S marker 2205 moves, the slider 2204 also moves to the position of the S marker 2205. At the same time, the frame displayed on the frame display unit 2201 is also changed to display a frame corresponding to the position of the slider 2204.
By moving the S marker 2205, the Selected 2213 of the effect target portion also changes. Since the S marker 2205 is moved backward by two frames (0.5 seconds) compared to the S marker 2105, the Selected 2213 starts later by two frames than the Selected 2113, and becomes shorter by two frames.

When the position of the S marker 2205 is confirmed, the moving image is reconstructed. That is, a fast reverse playback video and a slow playback video with special effects applied using the new Selected 2213 are created and combined as Rewind 2211 and Slow 2212, respectively.
Since Rewind 2211 and Slow 2212 correspond to Selected 2213, the length is shorter than that of Rewind 2111 and Slow 2112, and the contents of the frames constituting the same are also changed.

Since the original 2210 is combined with the Rewind 2211 and Slow 2212 in the entire moving image, the length of the entire moving image also changes, and the frame group 2202 is shorter than the frame group 2102. Corresponding to the length of the frame group 2202, the seek bar 2203 is also shortened.
Further, the positions of the RS marker 2206, the RE marker 2207, the SS marker 2208, and the SE marker 2209 change in accordance with changes in the Rewind 2211 and Slow 2212, and are moved and displayed on the seek bar 2203 at positions corresponding to the Rewind 2211 and Slow 2212.

FIG. 2C shows the moving image after the S marker 2105 indicating the start point of the effect target portion of the moving image of FIG. 2A is moved in the forward direction of the time axis.
The section of Original 2310 is the same as Original 2110. On the other hand, the S marker 2305 moves two frames (0.5 seconds) ahead of the S marker 2105 in the section of Original 2310.
As the S marker 2305 moves, the slider 2304 also moves to the position of the S marker 2305. At the same time, the frame displayed on the frame display unit 2301 also changes to a frame display corresponding to the position of the slider 2304.
By moving the S marker 2305, the Selected 2313 of the effect target portion also changes. Since the S marker 2305 is moved two frames (0.5 seconds) ahead of the S marker 2105, the Selected 2313 starts two frames earlier than the Selected 2113 and is two frames longer.

When the position of the S marker 2305 is fixed, the moving image is reconstructed. That is, a fast reverse playback video and a slow playback video with special effects using the new Selected 2313 are created and combined as Rewind 2311 and Slow 2312, respectively.
Since Rewind 2311 and Slow 2312 correspond to Selected 2313, the length is longer than that of Rewind 2111 and Slow 2112, and the contents of the frames constituting the length are also changed.

Since the original 2310, Rewind 2311, and Slow 2312 are combined in the entire moving image, the length of the entire moving image also changes, and the frame group 2302 becomes longer than the frame group 2102. Corresponding to the length of the frame group 2302, the seek bar 2303 also becomes longer. However, in FIG. 2C, the middle of Slow 2312 is omitted for the sake of drawing.
Further, the positions of the RS marker 2306, the RE marker 2307, the SS marker 2308, and the SE marker 2309 are changed in accordance with the change of the Rewind 2311 and the Slow 2312, and are moved to the positions corresponding to the Rewind 2311 and the Slow 2312 on the seek bar 2303.

Next, shooting processing of the moving image processing apparatus 100 will be described with reference to the flowchart shown in FIG. The flowchart in FIG. 3 is realized by the CPU 101 executing a program recorded in the storage unit 106. In the description of the flowchart of FIG. 3, specific numerical values such as the number of seconds are examples and can be changed as appropriate.
In step S <b> 301, the CPU 101 instructs the imaging unit 104 to start shooting in response to a shooting instruction via the operation unit 102 by the user.
In S302, the CPU 101 displays a progress bar corresponding to 5 seconds from the start of shooting to the end of shooting together with the image being shot on the display unit 103, and displays a pointer indicating the passage of shooting time on the progress bar. The CPU 101 also displays a marker at a position corresponding to the progress bar 3 seconds after the start of shooting. The moving image from the point in time when the pointer passes the marker becomes the effect target part used for creating the fast reverse reproduction moving image and the slow reproduction moving image.

In step S303, the CPU 101 determines whether 3 seconds have elapsed since the start of shooting. If 3 seconds have elapsed, the process proceeds to S304, and if not, the process waits until it has elapsed.
In S304, the marker management unit 110 embeds the S marker in a frame that is captured 3 seconds after the start of capturing, that is, a frame that is captured when the pointer passes the marker on the progress bar. Specifically, the marker management unit 110 embeds the S marker by recording an ID representing the S marker in the header portion of the frame. Note that the marker management unit 110 may create an information file associated with the moving image file, and record the frame number and the S marker in association with the created information file.

In step S305, the CPU 101 determines whether 5 seconds have elapsed since the start of shooting. When 5 seconds have elapsed, the process proceeds to S306, and when it has not elapsed, the process waits until it has elapsed.
In step S <b> 306, the CPU 101 causes the imaging unit 104 to finish shooting.

In step S <b> 307, the CPU 101 transmits, to the effect creation unit 108, a portion of the captured moving image from the frame in which the S marker is embedded to the last frame for which shooting has been completed (effect target portion). The effect creation unit 108 rearranges the frames of the received moving image in reverse order on the time axis, and deletes the frames every predetermined number of frames, thereby creating a fast reverse playback moving image. The effect creating unit 108 transmits the created fast reverse playback moving image to the moving image combining unit 109, and the moving image combining unit 109 combines the fast reverse playback moving image after the original moving image.
In S308, the marker management unit 110 embeds an RS marker in the start frame of the fast reverse playback video among the combined video and embeds an RE marker in the end frame of the fast reverse playback video. Specifically, like the S marker, the marker management unit 110 records the IDs representing the RS marker and the RE marker in the header portions of the start frame of the fast reverse playback video and the end frame of the fast reverse playback video, respectively. Embed the marker and RE marker. The marker management unit 110 may create an information file associated with the moving image file, and record the frame number, the RS marker, and the RE marker in association with the created information file. However, it is preferable that the recording method of all markers is unified.

  In step S <b> 309, the CPU 101 transmits, to the effect creation unit 108, a moving image of a portion (effect target portion) from the frame in which the S marker is embedded to the last frame in which shooting has been completed. The effect creating unit 108 creates a slow-playing moving image by duplicating the frames of the received moving image in a predetermined number of frames in the order of the time axis. The effect creating unit 108 transmits the created slow playback video to the video combining unit 109, and the video combining unit 109 combines the slow playback video after the fast reverse playback video.

  In S310, the marker management unit 110 embeds an SS marker in the start frame of the slow playback video among the combined video and embeds an SE marker in the end frame of the slow playback video. Specifically, like the S marker, the marker management unit 110 records the SS marker and the ID indicating the SE marker in the header portion of the start frame of the slow playback video and the end frame of the slow playback video, respectively. Embed SE marker. The marker management unit 110 may create an information file associated with the moving image file, and record the frame number, the SS marker, and the SE marker in association with the created information file. However, it is preferable that the recording method of all markers is unified.

  In S <b> 311, the CPU 101 transmits a moving image in which the fast-rewinding moving image and the slow-reproducing moving image are combined with the original moving image to the image holding unit 105, and generates and stores a moving image file. At this time, if the marker is recorded in the information file, the information file is also stored in the image holding unit 105.

Next, the moving image editing process of the moving image processing apparatus 100 will be described with reference to the flowchart shown in FIG. The flowchart in FIG. 4 is realized by the CPU 101 executing a program recorded in the storage unit 106.
In step S <b> 401, the CPU 101 instructs the playback unit 107 to start playback of a moving image in response to a playback instruction via the operation unit 102 by the user.
In step S <b> 402, the reproduction unit 107 reads a moving image file from the image holding unit 105.

In step S <b> 403, the reproduction unit 107 converts the first frame from the read moving image into image display data, and displays the image display data on the frame display unit 2101 of the display unit 103.
In step S <b> 404, the CPU 101 displays a seek bar 2103 indicating the entire moving image and a slider 2104 indicating the position of the frame being displayed on the seek bar 2103 on the display unit 103. At this time, since the frame being displayed is the first frame of the moving image, the CPU 101 displays the slider 2104 so as to be positioned at the left end of the seek bar 2103.

In step S <b> 405, the CPU 101 inquires the marker management unit 110 and acquires the positions of the S marker 2105, the RS marker 2106, the RE marker 2107, the SS marker 2108, and the SE marker 2109 from the marker management unit 110. The CPU 101 displays an S marker 2105, an RS marker 2106, an RE marker 2107, an SS marker 2108, and an SE marker 2109 on the display unit 103 according to the acquired position.
In S <b> 406, the CPU 101 receives a user operation, and reads the position of the section after the change when the operation for changing the section where the special effect is applied in the original moving image is performed. Specifically, the user can move the S marker 2105 being displayed on the display unit 103 via the operation unit 102 along the seek bar 2103 to the back or front of the time axis. The CPU 101 reads the position of the S marker 2105 changed by the user. The CPU 101 notifies the marker management unit 110 of the position of the read S marker.

  In S407, the marker management unit 110 determines whether or not the position of the S marker 2105 is within a predetermined section. As described above, since the S marker 2105 can move only in the section of the original moving image, it can move only from the position corresponding to the first frame on the seek bar 2103 to the frame immediately before the RS marker 2106. When it is outside the section but not within the predetermined section, the marker management unit 110 notifies the CPU 101 of the position of the predetermined section closest to the notified position, and the CPU 101 changes the S marker 2105 to the notified position. Display and return to S406. As described above, the CPU 101 restricts the S marker 2105 so that it cannot be changed outside the predetermined section. On the other hand, if it is determined that the notified position is within the predetermined section, the process proceeds to S408.

In step S408, the CPU 101 updates and displays the position of the currently displayed S marker 2105. When the CPU 101 moves and displays the S marker 2105, the CPU 101 updates and displays the slider 2104 so that the slider 2104 moves to the same position as the S marker 2105. In addition, the marker management unit 110 embeds an S marker in a frame corresponding to the notified position. This process is the same as the process of S304.
Further, the playback unit 107 displays the frame indicated by the slider 2104 on the frame display unit 2101 as the slider 2104 moves. Therefore, the user can confirm the contents of the frame at that position while moving the S marker 2105 being displayed, so that the desired start position of the effect target portion can be accurately specified.

  In step S <b> 409, the CPU 101 determines whether the user has instructed to reconstruct a moving image via the operation unit 102. That is, when the user specifies the start position of the desired effect target portion, it is possible to instruct the reconstruction of the moving image via the operation unit 102. If the moving image reconstruction is not instructed, the process returns to S406. If the moving image reconstruction is instructed, the moving image reconstruction process is started in S410 and thereafter.

In S410, the CPU 101 deletes the slow playback moving image from the existing moving image. In the case of the moving image shown in FIG. 2A, the CPU 101 deletes a portion corresponding to Slow 2112.
In S411, the CPU 101 deletes the fast reverse playback moving image from the existing moving image. In the case of the moving image shown in FIG. 2A, the CPU 101 deletes a portion corresponding to Rewind 2111.
At this point, only the original video that was shot remains in the video. That is, in the case of the moving image shown in FIG. 2A, a portion corresponding to Original 2110 remains.

In S412, the CPU 101 extracts, from the remaining moving images, moving images from the frame in which the changed S marker is embedded to the last frame of the remaining moving images as an effect target portion for moving image reconstruction, and the effect creating unit 108 Send to.
In S413, the effect creating unit 108 creates a fast-rewinding moving image by rearranging the frames of the received moving image in reverse order on the time axis and deleting the frames every predetermined number of frames. The effect creating unit 108 transmits the created fast reverse playback moving image to the moving image combining unit 109, and the moving image combining unit 109 combines the fast reverse reproduction moving image after the remaining moving image.
In S414, the marker management unit 110 embeds the RS marker 2106 in the start frame of the fast-rewinding video and embeds the RE marker 2107 in the end frame of the fast-backing video. This process is the same as S308 described above.

  In S415, the effect creating unit 108 creates a slow-playing moving image by duplicating the frames of the moving image received in S412 in a predetermined number of frames in the order of the time axis. The effect creating unit 108 transmits the created slow playback video to the video combining unit 109, and the video combining unit 109 combines the slow playback video after the fast reverse playback video.

In S416, the marker management unit 110 embeds the SS marker 2108 in the start frame of the slow playback video among the combined videos, and embeds the SE marker 2109 in the end frame of the slow playback video. This process is the same as S310 described above.
In S417, the CPU 101 updates and displays the seek bar 2103 indicating the entire moving image and the slider 2104 indicating the position of the frame being displayed on the seek bar 2103. That is, the seek bar 2103 is updated and displayed according to the length of the entire moving image. Note that the CPU 101 displays the slider 2104 at a position indicating the same frame as the frame indicated by the slider 2104 before starting the reconstruction of the moving image. Therefore, the slider 2104 is positioned at the same position as the start position of the effect target portion designated by the user.

In S <b> 418, the CPU 101 inquires of the marker management unit 110 and acquires the positions of the S marker 2105, the RS marker 2106, the RE marker 2107, the SS marker 2108, and the SE marker 2109 from the marker management unit 110. The CPU 101 updates and displays the S marker 2105, the RS marker 2106, the RE marker 2107, the SS marker 2108, and the SE marker 2109 on the display unit 103 according to the acquired position.
As described above, by changing the position of the S marker 2105 and reconstructing the moving image, Original 2110, Rewind 2111, and Slow 2112 are reconfigured according to the position of the S marker 2105, and a new moving image is generated. The playback unit 107 displays the reconstructed video on the display unit 103 in response to a playback instruction via the user operation unit 102, so that the user can check whether the video is configured as desired. .

In step S419, the CPU 101 determines whether the user has instructed to save the reconstructed moving image via the operation unit 102. If the reconstructed moving image is not the desired one and the save is not instructed, the process returns to S406. Therefore, the user can reconstruct the moving image through the processing after S406 by changing the position of the S marker again. On the other hand, if storage is instructed, the process proceeds to S420.
In S420, the CPU 101 transmits the reconstructed moving image to the image holding unit 105, and updates and stores the read moving image file. Here, the CPU 101 stores the moving image by updating the original moving image file, but may be stored as a new file separately from the original moving image file.

  Thus, according to the present embodiment, the position of a partial section of the original moving image used for generating the moving image with the special effect is displayed so as to be identified to the user. Therefore, the user can easily specify which section of the original moving image has been used for the special effect. In addition, when the video does not have a desired special effect, a video including the original video and a video with a special effect using the changed section is generated according to a user's operation to change a partial section. Therefore, it is possible to easily edit a moving image with a special effect.

  Further, according to the present embodiment, the marker indicating at least the start point of the partial section is displayed on the seek bar indicating the entire moving image, and the user can perform an operation of moving the marker along the seek bar. In response to this operation, a moving image with a special effect is generated using a section starting from the frame corresponding to the marker. Therefore, the user can edit a moving image with a special effect using the original moving image with a relatively simple operation.

Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included.
In the above-described embodiment, the fast-reverse playback video and the slow playback video have been described as examples of the video with special effects. However, the present invention is not limited to this case. The moving image with the special effect may be a moving image with an effect using a partial section of the original moving image, and may be a moving image with any effect. For example, the moving image with the special effect may be a moving image that is played back at a different speed from the original moving image.

  In the above-described embodiment, as an example of a moving image, a moving image in which a fast-rewinding moving image and a slow-playing moving image are combined with an original moving image has been described. However, the present invention is not limited to this case. For example, it may be a moving image obtained by combining either the fast reverse moving image or the slow moving moving image with the original moving image. Further, it may be a moving image obtained by combining one moving image obtained by applying a special effect to the original moving image, or a moving image obtained by sequentially combining a plurality of moving images obtained by applying different special effects to the original moving image.

  Further, in the above-described embodiment, the case where the S marker is used as the identification display for identifying the position of the effect target part in the original moving image has been described. Any display may be used as long as it can be identified. For example, the position of the effect target portion may be identified by displaying the effect target portion from the start frame to the end frame in different colors on the seek bar. However, it is preferable that the display is an identification display that can identify at least the start point of the effect target portion in the original moving image.

  Further, in the above-described embodiment, the display of the seek bar and the marker group is updated (S417, S416) after generating the moving image including the original moving image and the moving image having the special effect using the changed section (S410 to S416). 418). However, the display of the seek bar and the marker group may be updated before reconstructing the moving image (generating a moving image with a special effect using the changed section). For example, when the position of the S marker is changed in S406 and S407, the display of the frame is updated in S408, the display of the seek bar and the marker group is updated, and then the change is made according to the instruction for reconstruction. You may reconfigure | reconstruct the moving image according to a subsequent area. In this case, since the reconstructed video has not been generated, the length of the section after the change and the type of special effect are combined with the length of the video with the special effect generated when reconstructed or the original video. In this case, the combined position, the length of the entire moving image, etc. are calculated. Then, the display of the seek bar and the marker group may be updated according to the calculation result.

  In the above-described embodiment, the case where the moving image processing apparatus 100 is applied to a digital video camera has been described. However, the present invention is not limited to this case, and any apparatus that can process moving images can be applied. That is, the present invention can also be applied to personal computers, smartphones, tablet terminals, and the like.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a recording medium, and one or more processors in the computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

  DESCRIPTION OF SYMBOLS 100: Movie processing device 101: CPU 102: Operation part 104: Imaging part 105: Image holding part 106: Storage part 107: Reproduction part 108: Effect production part 109: Movie coupling part 110: Marker management part

Claims (17)

A moving image processing apparatus that processes a moving image including a first moving image portion and a second moving image portion having a special effect applied to a partial section of the first moving image portion,
A display that controls to display a display item indicating a moving image including the first moving image portion and the second moving image portion, and an identification display item that allows the user to identify the position of the partial section in the first moving image portion. Control means;
Receiving means for receiving an instruction to change the partial section,
When the display control means receives an instruction to change the partial section, the display control means shows a moving image including the first moving image portion and a moving image generated by applying the special effect to the changed section. Thus, the display processing item is updated.   The moving image processing apparatus according to claim 1, further comprising a generating unit configured to generate a moving image in which the special effect is applied to the section after the change.   When receiving an instruction to change the partial section, the generation unit generates a moving image with the special effect applied to the changed section, and the display control unit updates the display item. The moving image processing apparatus according to claim 2, wherein the moving image processing apparatus is a moving image processing apparatus.   The display control means does not generate the moving image in which the special effect is applied to the changed section by the generating means, but the special effect is applied to the first moving image portion and the changed section. The moving image processing apparatus according to claim 2, wherein the display item is updated so as to indicate a moving image including the moving image subjected to the processing.   In response to receiving an instruction to save a moving image corresponding to the changed section, a moving image including the first moving image portion and a moving image in which the special effect is applied to the changed section is used as a recording medium. 5. The moving image processing apparatus according to claim 2, further comprising control means for controlling to record. The display item is a bar indicating the entire moving image including the first moving image portion and the second moving image portion,
The moving image according to any one of claims 1 to 5, wherein the identification display item is a marker indicating a starting point of the partial section, and the marker is movable along the bar. Processing equipment.   The display control means includes a moving image including the first moving image portion and a moving image in which the special effect is applied to a section starting from a position corresponding to the changed marker in accordance with the movement of the marker. The moving image processing apparatus according to claim 6, wherein the bar is updated to indicate The display control means includes
6. The moving image processing apparatus according to claim 2, wherein the display item is updated and displayed in correspondence with the moving image generated by the generating unit. The display control means includes
9. The moving image processing apparatus according to claim 1, wherein an interval corresponding to the second moving image portion is displayed for the display item in an identifiable manner. 9. The display control means includes
The moving image processing apparatus according to any one of claims 1 to 9, wherein a section corresponding to each of a plurality of moving images included in the second moving image portion is displayed for the display item so as to be identifiable. The generating means includes
6. The moving image processing apparatus according to claim 2, wherein a plurality of moving images having different special effects are generated by using the changed section of the first moving image portion. The generating means includes
At least one of a moving image that reversely reproduces the changed section of the first moving image portion and a moving image that reproduces the changed section of the first moving image portion at a speed different from that of the first moving image portion. The moving image processing apparatus according to claim 2, wherein a moving image including one is generated. The generating means includes
3. A plurality of moving images with different special effects are generated using the changed section, and a moving image in which the first moving image portion and the plurality of moving images are combined in order is generated. The moving image processing apparatus according to any one of 5, 11, and 12.   The operation for changing the partial section can be changed only within the section of the first moving image part, and has a restricting means for restricting the operation so that it cannot be changed outside the section of the first moving image part. 14. The moving image processing apparatus according to any one of 1 to 13. A moving image processing method for processing a moving image including a first moving image portion and a second moving image portion having a special effect applied to a partial section of the first moving image portion,
A display that controls to display a display item indicating a moving image including the first moving image portion and the second moving image portion, and an identification display item that allows the user to identify the position of the partial section in the first moving image portion. Control steps;
Receiving an instruction to change the partial section,
In the display control step, when an instruction to change the partial section is received, a moving image including the first moving image portion and a moving image generated by applying the special effect to the changed section is shown. As described above, the display item is updated.   The program for functioning a computer as each means of the moving image processing apparatus of any one of Claims 1 thru | or 14.   15. A computer-readable recording medium storing a program for causing a computer to function as each unit of the moving image processing apparatus according to claim 1.

Images