WO2015122627A1

WO2015122627A1 - Image editing method and apparatus therefor

Info

Publication number: WO2015122627A1
Application number: PCT/KR2015/000532
Authority: WO
Inventors: 정민; 곽별샘; 김동훈; 오주현
Original assignee: 주식회사 케이티
Priority date: 2014-02-14
Filing date: 2015-01-19
Publication date: 2015-08-20
Also published as: KR101528312B1

Abstract

The present invention relates to an image editing method for providing an image editing interface which a user can easily use, and an apparatus therefor. An image editing apparatus according to the present invention comprises: a display unit for displaying an image editing interface including an image to be edited and an editing tool; a position adjustment module for identifying an editing section, in which a special effect is synthesized, in the whole reproduction section of the image, selecting a predetermined number of scenes in which a special effect object is expressed in the editing section and displaying the selected scenes on the display unit, and, when the special effect object is moved by a user in the displayed scenes, reconfiguring the position of the special effect object in the scenes; and a special effect processing module for generating editing detail data in which a position of a special effect object in each scene is included.

Description

Image editing method and device therefor

The present invention relates to an image editing technology, and more particularly, to an image editing method and apparatus for providing an image editing interface that can be conveniently used by a user.

The present invention claims priority based on Korean Patent Application No. 10-2014-0017293, filed February 14, 2014, all the contents disclosed in the specification and drawings of the application are incorporated in this application.

As the demand and supply of imaging devices increases, most users own one or more portable devices capable of capturing and editing images. In particular, as smart phones equipped with image capturing and editing functions have exploded, users may take images using a smartphone and then edit the captured images. Korean Patent Publication No. 10-2006-0111116 discloses a method and system for providing a video data editing function to a mobile communication terminal.

However, the conventional video editing technology using a portable device provides only a uniform interface which does not consider user convenience at all. In particular, the conventional image editing technology mounted in a portable device provides only a simple editing technique such as brightness adjustment, size adjustment, simple synthesis of pre-registered images and captured images, and the like to the user. In addition, the conventional video editing technology mounted on a portable device requires a lot of resources of the portable device at the time of editing, without considering the processing performance of the portable device, thereby reducing the performance of the portable device. There is also a problem.

The present invention has been proposed to solve such a conventional problem, and an object thereof is to provide an image editing method and apparatus for providing an image editing interface so that a user can conveniently edit the image.

Another object of the present invention is to provide an image editing method for providing a user with an image editing result using a small resource, and an apparatus therefor.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

According to an aspect of the present invention, there is provided an image editing apparatus comprising: a display unit configured to display an image editing interface including an image to be edited and an editing tool; Check an editing section in which a special effect is synthesized among the entire playback sections of the video, select a predetermined number of scenes in which the special effect object is expressed, and display the selected number of scenes on the display unit, and the special effect object is selected from the displayed scenes. A position adjustment module which, when moved by the user, resets the position of the special effect object in the scene; And a special effect processing module for generating edit history data including the position of the special effect object for each scene.

In the video editing apparatus according to the second aspect of the present invention for achieving the above object, a video editing method for synthesizing a video with a special effect includes checking an editing section synthesized with a special effect among all playback sections of an image to be edited. step; Selecting and displaying a predetermined number of scenes in which the special effect object is expressed in the editing section; Resetting the position of the special effect object in the scene in which the special effect object is moved when the special effect object is moved by the user among the displayed special effect scenes; And generating editing history data including the location of the special effect object for each scene.

The present invention provides the user with an interface for reassigning the location of a special effect to each scene, and enables the special effect to be synthesized with the original image accurately at the user's intended location through the interface.

In addition, the present invention, when the control bar located in the timeline of the editing section is moved, by displaying the image synthesized with a special effect in a certain area on the screen corresponding to the position of the control bar to allow the user to immediately confirm the edit result In this case, the user's convenience can be improved.

In addition, the present invention saves the resources of the image editing apparatus generated when generating the preview image by displaying the preview image using the partial image expressing the special effect without using the entire graphic image to which the special effect object moves. There is also an advantage.

In addition, the present invention transmits the editing history data instead of the entire synthesized video to the server to perform the video synthesis based on the editing history data in the server, thereby minimizing the data traffic generated between the server and the video editing device, There is an advantage of reducing the load on the editing apparatus.

The following drawings attached to this specification are illustrative of the preferred embodiments of the present invention, and together with the specific details for carrying out the invention serve to further understand the technical spirit of the present invention, the present invention described in such drawings It should not be construed as limited to matters.

1 is a diagram illustrating a configuration of an image editing system according to an exemplary embodiment of the present invention.

2 is a diagram illustrating a configuration of an image editing apparatus according to an embodiment of the present invention.

3A and 3B are flowcharts illustrating a method of performing image editing through an image editing interface in an image editing apparatus according to an embodiment of the present invention.

4 is a diagram illustrating an image editing interface according to an embodiment of the present invention.

5 is a diagram illustrating a state where an expression position and a playback section for a special effect are designated in an image editing interface according to an embodiment of the present invention.

6 is a diagram illustrating a state in which a special effect adjustment icon is output in an image editing interface according to an embodiment of the present invention.

7 is a diagram illustrating an effect position adjustment interface according to an embodiment of the present invention.

8 is a diagram illustrating a state in which a special effect object is repositioned in the effect position adjusting interface according to an embodiment of the present invention.

9 is a diagram illustrating an image editing interface on which a preview image is output, according to an embodiment of the present invention.

10 is a flowchart illustrating a method of generating a preview image in an image editing apparatus according to an embodiment of the present invention.

11 is a flowchart illustrating a method of registering edit history data in a video editing system and providing a synthesized image to a communication device based on the registered edit history data according to an embodiment of the present invention.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

As shown in FIG. 1, an image editing system according to the present invention includes an image editing apparatus 100 and an image providing server 200. The image editing apparatus 100 and the image providing server 200 communicate with each other through a network 300. The network 300 includes a broadband wired communication network and a mobile communication network, which corresponds to well-known conventional techniques of the present invention, and thus detailed description thereof will be omitted.

The image providing server 200 stores a plurality of images, special effect data, and editing history data. The edit history data includes special effect identification information, location of a special effect object for each scene, composite data including a reproduction time of the special effect, and identification information of an original image. In addition, the image providing server 200 receives and stores edit history data of a specific image from the image editing apparatus 100. In this case, the image providing server 200 may receive and store the edited original image file from the image editing apparatus 100, and receive and store identification information (eg, a URL) of the original image file from the image editing apparatus 100. Can be. Meanwhile, when the video providing server 200 receives a specific video request from the video editing apparatus 100 or the other communication device 400, the video providing server 200 extracts the edit history data of the video, and requests the video and the special request based on the edit history data. After synthesizing the effect, the synthesized image is transmitted to the corresponding video editing apparatus 100 or the communication apparatus 400.

The image editing apparatus 100 provides a user with an image editing interface that allows the user to edit the image more conveniently. When the image is edited through the image editing interface, the image editing apparatus 100 generates the edit history data of the image, and edits the image. The history data is stored or transmitted to the image providing server 200. In particular, the video editing apparatus 100 receives, from the user, a repositioning signal for repositioning the display position of the special effect through the video editing interface, and generates composite data based on the repositioning signal. In addition, the image editing apparatus 100 may display the preview image by using a partial image expressing a special effect without using the entire graphic image constituting the animation of the object.

As shown in FIG. 2, the image editing apparatus 100 according to an exemplary embodiment of the present invention may include a display unit 110, a storage unit 120, a camera 130, a communication unit 140, and an editing interface providing unit ( 150).

The display unit 110 is a display means for displaying various information processed by the image editing apparatus 100, and may be used by liquid crystal display (LCD) technology, light emitting polymer display (LPD) technology, or light emitting diode (LED) technology. Can be. In addition, the display unit 110 may be a touch display such as a resistive type or an infrared type. When the display unit 110 is a touch display, an output interface and an input interface are provided to the user.

The storage unit 120 is a storage means for storing data necessary for image editing. The storage unit 120 stores an image file and stores various special effect data necessary for image synthesis. For example, the storage unit 120 may include data about a special effect that is moved in a predetermined direction while the light is flashing, data about a special effect that is reduced and disappear as the text is moved in a predetermined direction, and a special effect that disappears when the text is expanded in a predetermined direction. It stores data related to various special effects such as data about. In addition, the storage unit 120 stores edit history data including the synthesis data and the identification information of the original video. The composite data includes special effect identification information, positions of special effect objects for each scene, and playback time of the special effects. Preferably, the storage unit 120 stores the special effect data having a smaller size compared with the special effect data stored in the image providing server 200. That is, the storage unit 120 compares the audio and effect animation images included in each special effect data stored in the image providing server 200 and stores the low quality audio and effect animations. For example, when the image providing server 200 stores 30 frames per second special effect animation and 384 kbps audio data, the storage unit 120 of the image editing apparatus 100 may perform 4 frames per second special effect animation and 16 kbps unit. Audio data can be stored. More preferably, the storage unit 120 stores data in which the special effect object image and the voice are separated from the special effect animation image included in the special effect data. The storage unit 120 may include high speed random access memory, and may also include one or more magnetic disk storage devices, nonvolatile memory such as flash memory devices, or other nonvolatile semiconductor memory devices.

The camera 130 has a lens to capture a peripheral image through the lens.

The communication unit 140 performs a function of communicating with various servers, in particular, the image providing server 200 via the network 300.

The editing interface providing unit 150 generates a user interface related to image editing and displays the same on the display unit 110. In detail, when the user requests editing of a specific image, the editing interface providing unit 150 generates an image editing interface including the image and an editing tool for editing the image and outputs the image editing interface to the display unit 110. .

In addition, the editing interface providing unit 150 includes a special effect processing module 151, a position adjusting module 152, and a preview providing module 153.

The special effect processing module 151 generates a composite data according to the input information input by the user on the image editing interface. In detail, when a specific editing tool is selected on the image editing interface, the special effect processing module 151 extracts the object for the selected special effect from the storage 120 and outputs the object to the image editing interface, and the first of the special effect objects is displayed. The location is input from the user. In addition, the special effect processing module 151 receives information on the playback section in which the special effect is expressed from the entire playback section of the original video to be edited, and receives the playback section in which the special effect is displayed in the editing section. Confirm. On the other hand, the special effect processing module 151, after editing the image is finished, generates the edit history data including the synthesis data and the identification information of the original image and stores it in the storage unit 120. In addition, the special effect processing module 151 may transmit the edit history data to the image providing server 200 through the communication unit 140.

When the position adjustment signal of the special effect is input from the user, the position adjustment module 152 generates and outputs an effect position adjustment interface for adjusting the position of the special effect object in the editing section to the display unit 110. In detail, the position adjusting module 152 captures a predetermined number (eg, four) images among the images constituting the image of the editing section, and captures a special effect scene in which a special effect object appears on the captured image. The image is generated for each image and outputs to the display unit 110 an effect position adjusting interface including a plurality of special effect scenes thus generated. In this case, the position adjusting module 152 may divide the image of the editing section into a preset unit time, and capture each image from each of the divided images, and the scene change among the images constituting the image of the editing section. You can capture multiple, more severe images. In addition, the position adjusting module 152 checks the position of the special effect object expressed in each scene, and expresses the special effect object for each captured image at the identified position. Meanwhile, when the position adjustment of the user is completed through the effect position adjustment interface, the position adjustment module 152 checks the position information of the special effect object for each scene and transmits it to the special effect processing module 151.

The preview providing module 153 generates and provides a preview image synthesized with the special effect to the user. In detail, when the user clicks an endpoint control icon (see 26b of FIG. 5) indicating an end point of the editing section, the preview providing module 153 synthesizes a preview image in which an image corresponding to the special effect selected by the user and the editing section is synthesized. To generate and output to the display unit 110. At this time, the preview providing module 153 checks the playback time corresponding to the point corresponding to the endpoint control icon, and outputs a preview image or an image corresponding to the playback time to the display unit 110 among the synthesized whole images. . Preferably, the preview providing module 153 outputs the preview image on a sub screen having a predetermined size (see 28 of FIG. 9).

On the other hand, through the method described with reference to FIG. 10 to be described later, the preview providing module 153 does not use the entire graphic image to which the special effect object is moved in order to reduce the resources of the image editing apparatus 100 required when displaying the preview image. Instead, the preview image may be displayed on the display unit 110 using some images expressing a special effect.

3A and 3B, when an image to be edited is selected by the user, the editing interface providing unit 150 displays the video editing interface including the video and the editing tool on the display 110 (S301). . The image to be edited may be an image already stored in the storage 120, an image captured in real time through the camera 130, or an image received from the image providing server 200.

Referring to FIG. 4, the editing interface providing unit 150 includes a video selected by the user for editing, a timeline 22 representing a playback time of the video, a playback control bar 23, a playback button 21, and various special effects. The image editing interface including the

editing tools

24a, 24b, and 24c capable of synthesizing the same is displayed on the display unit 110. The playback control bar 23 is a graphic element representing a playback time point that is currently playing. When the user changes the position of the playback control bar 23 on the timeline 22, the playback control bar 23 is located. The video from the time of reproduction is output. Also, among the special effects tools of FIG. 4, the star-shaped special effects tool 24a is an editing tool used to synthesize a halo effect for emphasizing a specific object, that is, an effect of shining light at the position of the specific object. In addition, reference numeral 24b of FIG. 4 is a tool used to process computer graphics of a specific object, and reference numeral 24c is an editing tool used to synthesize text input by a user (or text registered in advance) with an image. Each special effect has a minimum duration (eg, 0.5 seconds) and also has a default duration (eg, 2 seconds). In addition, each special effect has an animation effect that moves in a constant direction.

Referring again to FIG. 3A, the image editing interface providing unit 150 receives selection information regarding any one of a plurality of editing tools listed in the image editing interface from the user (S303).

Then, the special effect processing module 151 checks the special effect output according to the editing tool selected by the user, extracts the object related to the special effect from the storage 120 and outputs the object to the image editing interface, and the special effect The first position at which the object is expressed is received from the user (S305).

In addition, the special effect processing module 151 receives information about a playback section in which the special effects are displayed from the user among the playback sections of the entire image, and confirms that the playback section in which the special effects are displayed is an editing section (S307). ). That is, the video editing interface providing unit 150 sets a playback section in which the special effects are expressed among the entire playback sections of the video as the edit section.

Referring to FIG. 5, in the video editing interface, the initial position of the special effect object 25 is set at the face of a person. In other words, the user may set the initial position of the special effect object in the editing section by moving the initial position at which the special effect object 25 is expressed by touching and dragging it to the face. The special effect of FIG. 5 illustrates the halo effect in which light shines. In addition, the video editing interface of FIG. 5 sets a playback section in which the special effect is synthesized with the original video according to a user's manipulation. In this case, the video editing interface may set a point at which video playback is paused, that is, a point where the playback control bar 23 is located as a start point at which a special effect appears, and also add a default playback time of the special effect at the start point. You can set the point you want to be the end point for the special effect to end. For example, the video editing interface providing unit 150 sets the edit section to 1 minute 00 seconds when the playback time at which the halo effect having a default playback time of 2 seconds starts is 1 minute 00 seconds in an image having a total playback time of 2 minutes. To 1 minute 02 seconds. In the video editing interface of FIG. 5, each of the start point control icon 26a and the end point control icon 26b located on the timeline 22 represents a start point and an end point at which a special effect is played, respectively, and the start point control icon 26a. The playback section corresponding to the timeline between and the endpoint control icon 26b becomes the edit section.

Meanwhile, when the position of the start point control icon 26a is changed by the user, the image editing interface providing unit 150 changes the start point position at which the special effect is displayed. That is, when the user changes the position of the starting point control icon 26a on the timeline 22 by dragging, the image editing interface providing unit 150 changes the point in time at which the special effect is expressed among the entire playback time of the image. do. In this case, the image editing interface providing unit 150 changes the position of the end point control icon 26b by the position where the start point control icon 26a is moved. That is, when the user changes the position of the start point control icon 26a on the timeline 21, the position of the end point control icon 26b is also changed by the position where the start point control icon 26a is changed.

Next, the special effect processing module 151 may receive a special effect adjustment signal from a user who wants to fine-tune the special effect (S309). Preferably, the special effect processing module 151 outputs a plurality of

icons

27a and 27b for controlling the special effect when the special effect object 25 is clicked on the edited video interface. When the adjustment icon 27a is clicked among the icons of the user, it may be recognized that a special effect adjustment signal is received from the user.

Referring to FIG. 6, when the special effect object 25 is clicked on the edited video interface, the special effect processing module 151 outputs a plurality of

icons

27a and 27b for controlling the special effect. The adjustment icon 27a is an icon used to finely adjust the position of the special effect object, and the trash can icon 27b is an icon used to remove the special effect. On the video editing interface of FIG. 6, when the adjustment icon 27a is clicked, the special effect processing module 151 recognizes that a special effect adjustment signal is received from the user.

Next, the special effect processing module 151 activates the position adjusting module 152 when a special effect adjusting signal is received from the user, and the position adjusting module 152 performs a predetermined number (eg, scenes) on the image of the editing section. Capture an image of (S311). At this time, the position adjustment module 152 may divide the image of the editing section by a predetermined unit time, and capture an image for each of the divided images. In addition, the position adjusting module 152 may capture a plurality of images having a large degree of scene change among the images constituting the image of the editing section. That is, among the images constituting the image belonging to the edit section of the position adjusting module 152, by comparing and analyzing each adjacent image according to time, a predetermined number of images having a large amount of change in the movement of the object may be captured in the edit section. have.

Next, the position adjustment module 152 checks the position of the special effect object in each of the captured images for each image (S313). At this time, the position adjustment module 152 expresses the special effect object in each captured image based on the initial position of the special effect object received from the user, the playing time of the editing section, and the movement direction and speed of the special effect object set as a default. You can check the location.

Subsequently, the position adjusting module 152 generates an image for each image capturing a special effect scene in which the special effect object is expressed at the identified special effect object position, and the effect position adjusting interface in which the generated plurality of special effect scenes are divided on the screen. Is output to the display unit 110 (S315). The special effect object for each scene is used as basic data to interpolate the special effect animation.

As illustrated in FIG. 7, the position adjusting module 152 may output an effect position adjusting interface including four special effect scenes to the display 110 based on the position of the image corresponding to the editing section and the position of the special effect object. Can be. In each special effect scene of FIG. 7, the number displayed in the upper left represents a playback order for the scene in the editing section. Referring to FIG. 7, some special effect objects are not synthesized as intended by the user, but are displayed at the wrong position. In other words, in the special effects scene having the

numbers

2, 3, and 4 in FIG. 7, the presentation position of the special effect object is not positioned at the position intended by the user, that is, at the face image border, but is located elsewhere. When the special effects (i.e., the halo effect) and the original image are synthesized in the state as shown in FIG. 7, the halo effect is only displayed on the face image border only at the first playback time, and the halo effect is unintended at the subsequent playback time. Will be. In other words, when a special effect is animated and composited into an image, the special effect is only displayed at the location intended by the user only near the first playback time. The effect is not expressed.

Next, the position adjusting module 152 receives a repositioning signal of the special effect for one or more of the special effect scenes included in the effect position adjusting interface (S317). That is, the position adjusting module 152 receives a movement signal of at least one special effect object from a plurality of special effect scenes included in the effect position adjusting interface. In this case, the position adjustment module 152 may receive a movement signal of the special effect object from the user through touch drag.

As shown in FIG. 8, the position of the special effect object according to FIG. 8 may be compared with that of the special effect object according to FIG. 7. That is, in the effect position adjustment interface of FIG. 8, it can be seen that the positions of the special effect objects in the special effect scenes corresponding to the second, third and fourth positions have been repositioned near the face borders according to the user's input signal. have. By adjusting the position of the special effect object, a situation in which the presentation position of the special effect object is inconsistent with the intention of the user is prevented. That is, the image editing apparatus 100 provides an effect position adjusting interface for precisely adjusting the special effects, and allows the display position of the special effect object to be adjusted by the user in each special effect scene through the effect position adjusting interface. .

Next, when receiving the position adjustment completion signal from the user, the position adjustment module 152 checks the position of the special effect object for each scene and transmits it to the special effect processing module 151 (S319). At this time, the position adjustment module 152 checks the playback time indicated by each scene and transmits it to the special effect processing module 151.

Then, the special effect processing module 151 generates the composite data including the reproduction time of each scene, the display position of the special effect object for each scene, the reproduction time of the special effect, and the special effect identification information (for example, a halo effect). (S321). On the other hand, the special effect processing module 151, in step S309, if a special effect adjustment signal is not received from the user, the composition including the initial position information of the special effect set by the user, the playback time of the special effect and the special effect identification information Generate data

In operation S323, the image editing interface providing unit 150 may select an endpoint control icon 26b corresponding to an end point of the editing section on the image editing interface. That is, the image editing interface providing unit 150 may receive a click signal of the endpoint control icon 26b corresponding to the end point of the editing section from the user who wants to check the composite image preview.

Then, the preview providing module 153 generates a preview image obtained by synthesizing the original image corresponding to the editing section and the special effect, and the partial image corresponding to the playback time point at which the endpoint control icon 26b is located among the generated preview images. (Or an image) is extracted and displayed in a predetermined area on the image editing interface, thereby providing a preview image synthesized to the user (S325). Preferably, the preview providing module 153 outputs the preview image on the sub screen. In addition, when the position of the endpoint control icon 26b is changed, the preview providing module 153 checks the playback time point corresponding to the changed position, and displays the preview image (or image) of the playback time point and the corresponding section on the sub screen. Display. At this time, the preview providing module 153 places a special effect object at a designated position for each scene based on the composite data generated in step S321, and animate each of the arranged special effect objects through an animation interpolation technique. And an original image are synthesized, and the synthesized image is displayed on the sub screen as a preview image.

As shown in FIG. 9, when the endpoint control icon 26b is selected in the image editing interface, the preview providing module 153 generates a preview image 28 synthesized with a special effect and outputs the preview image 28 to the sub screen of the image editing interface. do. Preferably, the preview providing module 153 checks a playback time corresponding to the position of the endpoint control icon 26b in the editing section, and outputs a part of the preview image corresponding to the playback time. In addition, when the position of the end point control icon 26b is moved to the left, the preview providing module 153 checks a playing time point at which the end point control icon 26b is located, and the partial image of the preview image corresponding to the playing time point. (Or partial video) is displayed. Accordingly, the user can check the edited image by moving the endpoint control icon 26b.

Next, when the special effect processing module 151 receives an edit end signal from the user (S327), the special effects processing module 151 generates the edit history data including the synthesis data generated in step S321 and identification information of the original video, and then stores the storage unit 120. Store in (S329). In addition, the special effect processing module 151 may transmit the edit history data stored in the storage 120 to the image providing server 200 to register the edit history data of the user in the image providing server 200. Preferably, the special effect processing module 151 transmits the original image itself to the image providing server 200 when the original image is an image stored solely in the storage unit 120 of the image editing apparatus 100, and thus the original image. Also register with the image providing server 200.

Meanwhile, the image editing apparatus 100 may display the preview image using some images expressing a special effect in order to reduce resources consumed when processing the preview image.

Referring to FIG. 10, the preview providing module 153 checks an image belonging to an editing section among all reproduction sections of the original video (S1001).

The preview providing module 153 checks the special effects set by the user in the editing section, and extracts the image and audio of the low quality special effect animation implementing the special effects from the storage 120 (S1003). That is, the preview providing module 153 extracts a special effect image having a low frame rate per second and audio having a low bit rate compared to the special effect animation and audio stored in the image providing server 200.

Next, the preview providing module 153 couples the special effect animation image and the audio to the image corresponding to the editing section (S1005). In other words, when the image corresponding to the editing section is reproduced, the preview providing module 153 displays the special effect animation image at the corresponding playback time and the special effect audio is mixed with the audio of the original image. And audio are combined with the video in the editing section. In this case, the preview providing module 153 may adjust the position of each image (ie, an object image) of the special effect animation based on the position of the special effect object for each scene recorded in the composite data.

On the other hand, since the number of extracted images is small compared to the number of images of the original image, a disconnection phenomenon of the special effect object image may occur. Accordingly, the preview providing module 153 sets an overlap scene transition effect between each special effect object, and smoothly connects images of each special effect object (S1009). That is, if the second special effect object image is displayed while the first special effect object image is displayed, the preview providing module 153 disappears from the screen while gradually fading the first special effect object image and the second special effect object image. The overlap transition effect is set between each special effect object so that the image of the first special effect object and the second special effect object are naturally transitioned while the image is gradually cleared while the image is blurred.

Subsequently, the preview providing module 153 displays on the display unit 110 a preview image displayed on the original image at each playback time of the special effect object.

Meanwhile, in the above-described embodiment, although the preview image is displayed on the sub screen, the preview image may be displayed on the full screen on the image editing apparatus 100.

In the description with reference to FIG. 11, portions overlapping with the description with reference to FIGS. 3 to 10 will be omitted or compressed and summarized.

Referring to FIG. 11, when the editing interface providing unit 150 of the video editing apparatus 100 receives a video to be edited from a user, the editing interface providing unit 150 displays the video editing interface including the video and the editing tool on the display 110. (S1101).

Next, the special effect processing module 151 receives the editing information such as the position of the special effect object, the playback section of the special effect, the special effect identification information, and the like from the user through the video editing interface (S1103). Generate synthetic data on the basis. In this case, the position adjusting module 152 may be reassigned the position of the special effect object from the user through the effect position adjusting interface. In addition, the preview providing module 153 may generate and display a preview image synthesized with a special effect.

Subsequently, when the user finishes editing the video, the special effect processing module 151 generates edit history data including the synthesis data and the identification information of the original video (S1105). The special effect processing module 151 transmits the generated edit history data to the image providing server 200 by using the communication unit 140 (S1107). In this case, the special effect processing module 151 may transmit the original image itself (that is, the original image file) to the image providing server 200.

Then, the image providing server 200 stores the edit history data received from the image editing apparatus 100 (S1109). In this case, when the image providing server 200 receives the image source file from the image editing apparatus 100, the image providing server 200 stores the image source file and the edit history data together.

Next, the image providing server 200 may receive an image request message for requesting the image from the communication device 400 (S1111). Then, the image providing server 200 extracts the edit history data of the image (S1113). In this case, the image providing server 200 receives image identification information from the communication device 400 and extracts editing history data including the image identification information.

Next, the image providing server 200 extracts an original image based on the image identification information, and combines the original image and a special effect based on the edit history data (S1115). In this case, the image providing server 200 selects a special effect image to be synthesized based on the special effect identification information recorded in the editing history data, and further, selects a special effect image from the original video based on the playback time of the special effect recorded in the editing history data. Check the playback point and end point indicated by the special effect. The image providing server 200 may further include a frame corresponding to each scene in the frame image of the original image belonging to the playback section (ie, the editing section) of the special effect based on the scene-specific special effect object position recorded in the editing history data. Check the image. The image providing server 200 arranges the special effect object at a designated position (that is, the special effect object position) in each of the checked frame images, and animates the special effect object through an animation interpolation technique. The image providing server 200 synthesizes the animated special effect object and the original image.

Next, the image providing server 200 transmits the synthesized image to the communication device 400 (S1117). Then, the communication device 400 confirms the video edited by the video editing apparatus 100 by outputting the video received from the video providing server 200 to the screen.

While this specification contains many features, such features should not be construed as limiting the scope of the invention or the claims. Also, the features described in the individual embodiments herein can be implemented in combination in a single embodiment. Conversely, various features described in a single embodiment herein can be implemented individually in various embodiments or in combination as appropriate.

Although the operations are described in a particular order in the drawings, they should not be understood as being performed in a particular order as shown, or in a sequence of successive orders, or all described actions being performed to obtain a desired result. . Multitasking and parallel processing may be advantageous in certain circumstances. In addition, it should be understood that the division of various system components in the above-described embodiments does not require such division in all embodiments. The program components and systems described above may generally be packaged in a single software product or multiple software products.

The method of the present invention as described above may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

Claims

A display unit configured to display an image editing interface including an image to be edited and an editing tool;

Check an editing section in which a special effect is synthesized among the entire playback sections of the video, select a predetermined number of scenes in which the special effect object is expressed, and display the selected number of scenes on the display unit, and the special effect object is selected from the displayed scenes. A position adjustment module which, when moved by the user, resets the position of the special effect object in the scene; And

And a special effect processing module configured to generate editing history data including positions of the special effect objects for each scene.
The method of claim 1,

The position adjustment module,

Capturing a plurality of images in the editing section, checking the position of the special effect object for each captured image, and then selecting a plurality of captured images in which the special effect object is expressed at the predetermined number of scenes as the predetermined number of scenes. Characterized in that the video editing device.
The method of claim 2,

The position adjustment module,

And dividing the image of the editing section by a predetermined unit time, and capturing an image from each of the divided images.
The method of claim 2,

The position adjustment module,

An image editing apparatus, characterized by capturing an image whose scene change degree exceeds a threshold value among images constituting an image of an editing section.
The method of claim 2,

The position adjustment module,

And a position at which the special effect is displayed in each captured image based on the initial position of the special effect object, the reproduction time of the editing section, and the moving direction and the moving speed of the special effect object.
The method of claim 1,

A storage unit which stores a low quality audio and special effect object image for implementing the special effect animation; And

And a preview providing module for extracting the low quality audio and special effect object image from the storage and displaying a preview image on which the low quality image and the audio are combined with the image of the editing section on the display unit. Video editing device.
The method of claim 6,

The storage unit stores a special effect object image in which a frame image per second falls below an animation reference value,

And the preview providing module sets a scene change effect between each special effect object image, and displays a preview image on which the scene change effect is set between the special effect object images on the display unit.
The method of claim 6,

The preview providing module,

When the control icon indicating the end of the editing section is clicked on the timeline, the control icon checks the playback time on the timeline and outputs a preview image corresponding to the playback time on the sub screen. Video editing device.
The method of claim 1,

The special effect processing module,

And store the edit history data or transmit the data to the external server.
In the image editing method for synthesizing the special effects and the image in the image editing apparatus,

Checking an editing section synthesized with a special effect among all reproduction sections of an image to be edited;

Selecting and displaying a predetermined number of scenes in which the special effect object is expressed in the editing section;

Resetting the position of the special effect object in the scene in which the special effect object is moved when the special effect object is moved by the user among the displayed special effect scenes; And

And generating editing history data including the location of the special effect object for each scene.
The method of claim 10,

The displaying step,

Capturing a plurality of images in the editing section, and checking a position of a special effect object for each captured image on the captured image; And

And selecting a plurality of captured images in which a special effect object is expressed at the identified special effect object position as the predetermined number of scenes.
The method of claim 11,

The displaying step,

And dividing a reproduction time of the editing section by a predetermined unit time, and capturing each image corresponding to a start point of each of the divided times.
The method of claim 11,

The displaying step,

An image editing method comprising capturing an image of which a scene change degree exceeds a threshold value among images constituting an image of an editing section.
The method of claim 11,

The displaying step,

And determining the position at which the special effect is expressed in each captured image based on the initial position of the special effect object, the reproduction time of the editing section, the moving direction and the moving speed of the special effect image.
The method of claim 10,

Storing a low quality audio and special effect object image for implementing the special effect animation; And

And extracting the low quality audio and special effect object image and displaying a preview image in which the low quality image and the audio are combined with the image of the editing section.
The method of claim 15,

The storing may include storing a special effect object image in which a frame image per second falls below an animation reference value,

The displaying of the preview image may include setting a transition effect between each special effect object image and displaying a preview image in which the transition effect is set between the special effect object images.
The method of claim 15,

Generating and displaying the preview image,

When the control icon indicating the end of the editing section is clicked on the timeline, the control icon checks the playback time on the timeline and outputs a preview image corresponding to the playback time on the sub screen. How to edit video.