KR101528312B1 - Method for editing video and apparatus therefor - Google Patents

Method for editing video and apparatus therefor Download PDF

Info

Publication number
KR101528312B1
KR101528312B1 KR1020140017293A KR20140017293A KR101528312B1 KR 101528312 B1 KR101528312 B1 KR 101528312B1 KR 1020140017293 A KR1020140017293 A KR 1020140017293A KR 20140017293 A KR20140017293 A KR 20140017293A KR 101528312 B1 KR101528312 B1 KR 101528312B1
Authority
KR
South Korea
Prior art keywords
image
special effect
editing
effect object
section
Prior art date
Application number
KR1020140017293A
Other languages
Korean (ko)
Inventor
정민
곽별샘
김동훈
오주현
Original Assignee
주식회사 케이티
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 케이티 filed Critical 주식회사 케이티
Priority to KR1020140017293A priority Critical patent/KR101528312B1/en
Priority to PCT/KR2015/000532 priority patent/WO2015122627A1/en
Application granted granted Critical
Publication of KR101528312B1 publication Critical patent/KR101528312B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H04N9/8211—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being a sound signal
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring

Abstract

The present invention relates to a method for editing an image and an apparatus therefor that can provide an image editing interface which can be used easily by a user, the editing apparatus according to the invention comprising: a display unit configured to display an image editing interface which includes an image to be edited and an editing tool; a position adjustment unit which checks an editing section where special effects are synthesized among the entire reproduction sections of the image, selects a particular number of scenes where special effect object is displayed in the editing section, displays the same in the display unit, and resets a position of the special effect object in a corresponding scene when special effect object in the displayed scenes is moved by a user; and a special effect processing module configured to generate editing details data which includes the position of the special effect object for each scene.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video editing method,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image editing technology, and more particularly, to an image editing method and apparatus for providing an image editing interface that a user can conveniently use.

As the demand and supply of imaging devices increases, most users have one or more portable devices that can capture and edit images. Particularly, since a smart phone equipped with a video shooting and editing function is explosively spread, users shoot images using a smart phone, and then edit the photographed images. The following patent document discloses a method and system for providing a video data editing function to a mobile communication terminal.

However, the conventional image editing technology using a portable device provides only a uniform interface that does not consider user convenience at all. In particular, the conventional image editing technology mounted on a portable device provides users with only a simple editing technique such as brightness adjustment, size adjustment, simple registration of previously registered images and shot images, and the like. In addition, the conventional image editing technology mounted on the portable device does not consider the processing performance of the portable device, and as the editing process proceeds, a lot of resources of the portable device are required at the time of editing, There is also a problem.

Korean Patent Publication No. 10-2006-0111116

It is an object of the present invention to provide an image editing method and an apparatus therefor that provide an image editing interface for a user to easily edit an image.

It is another object of the present invention to provide an image editing method and apparatus for providing an image editing result to a user using a small amount of resources.

Other objects and advantages of the present invention will become apparent from the following description, and it will be understood by those skilled in the art that the present invention is not limited thereto. It will also be readily apparent that the objects and advantages of the invention may be realized and attained by means of the instrumentalities and combinations particularly pointed out in the appended claims.

According to an aspect of the present invention, there is provided an image editing apparatus comprising: a display unit for displaying an image editing interface including an image to be edited and an editing tool; And a display unit for displaying a plurality of scenes for displaying a special effect object on the display unit, wherein the display unit displays a special effect object A position adjustment module which, when moved by the user, resets the position of the special effect object in the scene; And a special effect processing module for generating edit history data including a position of a scene-specific special effect object.

According to a second aspect of the present invention, there is provided an image editing method for synthesizing a special effect and an image in an image editing apparatus according to the second aspect of the present invention includes the steps of: step; Selecting and displaying a predetermined number of scenes in which the special effect objects are displayed in the editing section; Resetting a position of the special effect object in the scene in which the special effect object is moved when the special effect object is moved by the user among the displayed special effect scenes; And generating edit history data including the position of the special effect object for each scene.

The present invention provides an interface for re-specifying the position of a special effect on a scene-by-scene basis, so that the special effect can be synthesized with the original image precisely at a position intended by the user through the interface.

In addition, according to the present invention, when a control bar located on a timeline of an edit section moves, an image synthesized with a special effect corresponding to the position of the control bar is displayed in a predetermined area on the screen, , And the convenience of the user at the time of image editing is improved.

In addition, the present invention does not use the entire graphic image on which the special effect object moves but displays the preview image using some images expressing the special effect, thereby saving resources of the image editing apparatus generated at the time of generating the preview image There are also advantages.

In addition, according to the present invention, the editing history data is transmitted to the server instead of the entire synthesized image, and the server performs the image synthesis based on the editing history data, thereby minimizing data traffic generated between the server and the image editing apparatus, There is an advantage in reducing the load of the editing device.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments of the invention and, together with the description, serve to explain the principles of the invention. And shall not be construed as limited to such matters.
1 is a diagram illustrating a configuration of an image editing system according to an embodiment of the present invention.
2 is a diagram illustrating the configuration of an image editing apparatus according to an embodiment of the present invention.
3 is a flowchart illustrating a method of performing image editing through an image editing interface in an image editing apparatus according to an embodiment of the present invention.
4 is a diagram illustrating an image editing interface according to an embodiment of the present invention.
FIG. 5 is a view illustrating a state in which a display position and a playback interval of a special effect are designated in an image editing interface according to an exemplary embodiment of the present invention.
6 is a diagram illustrating a state in which a special effect adjustment icon is output in the image editing interface according to an embodiment of the present invention.
7 is a diagram illustrating an effect location adjustment interface, in accordance with an embodiment of the present invention.
8 is a diagram showing a state in which a special effect object is repositioned in an effect position adjustment interface according to an embodiment of the present invention.
9 is a diagram illustrating an image editing interface to which a preview image is output, according to an embodiment of the present invention.
10 is a flowchart illustrating a method of generating a preview image in an image editing apparatus according to an embodiment of the present invention.
11 is a flowchart illustrating a method of registering edit history data in an image editing system and providing a synthesized image based on the registered edit history data to a communication apparatus according to an embodiment of the present invention.

The foregoing and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings, in which: There will be. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a configuration of an image editing system according to an embodiment of the present invention.

As shown in FIG. 1, the image editing system according to the present invention includes an image editing apparatus 100 and an image providing server 200. The image editing apparatus 100 and the image providing server 200 communicate with each other through the network 300. The network 300 includes a broadband wired communication network and a mobile communication network, and corresponds to a well-known conventional technique of the present invention, and thus a detailed description thereof will be omitted.

The image providing server 200 stores a plurality of images, special effect data, and edit history data. The editing history data includes special effect identification information, a location of a special effect object for each scene, synthetic data including a reproduction time of the special effect, and identification information of the original image. Also, the image providing server 200 receives the edit history data of the specific image from the image editing apparatus 100 and stores the same. At this time, the image providing server 200 can receive and store the edited original image file from the image editing apparatus 100, and receive the identification information (e.g., URL) of the original image file from the image editing apparatus 100 and store . On the other hand, when the image providing server 200 receives a request for a specific image from the image editing apparatus 100 or another communication apparatus 400, the image providing server 200 extracts the edit history data of the image, And transmits the synthesized image to the corresponding image editing apparatus 100 or the communication apparatus 400. [0051]

The image editing apparatus 100 provides a user with an image editing interface that allows the user to edit the image more conveniently. When the image is edited through the image editing interface, the editing apparatus 100 generates editing history data of the image, And transmits the history data to the image providing server 200. In particular, the video editing apparatus 100 receives a position redesigning signal for redirecting the display position of the special effect from the user through the video editing interface, and generates the composite data based on the position redesigning signal. In addition, the image editing apparatus 100 may display a preview image using a part of the image expressing the special effect, instead of using the entire graphic image constituting the animation of the object.

2 is a diagram illustrating the configuration of an image editing apparatus according to an embodiment of the present invention.

2, the image editing apparatus 100 according to an embodiment of the present invention includes a display unit 110, a storage unit 120, a camera 130, a communication unit 140, 150).

The display unit 110 is a display unit for displaying various types of information processed by the image editing apparatus 100. The display unit 110 may be a liquid crystal display (LCD), a light emitting polymer display (LPD) . Also, the display unit 110 may be a touch display of a resistance type, an infrared type, or the like. When the display unit 110 is a touch display, the display unit 110 provides an output interface and an input interface to the user.

The storage unit 120 is a storage unit for storing data necessary for image editing. The storage unit 120 stores image files and stores various special effect data necessary for image synthesis. For example, the storage unit 120 stores data on special effects that light is moved in a certain direction while being shiny, data on special effects that disappear while the text is moved in a certain direction, special effects that disappear while the text is expanded in a certain direction And the like. In addition, the storage unit 120 stores edit history data including identification information of the composite data and the original image. The synthesis data includes special effect identification information, a position of a special effect object for each scene, and a reproduction time of the special effect. Preferably, the storage unit 120 stores special effect data having a smaller size compared to the special effect data stored in the image providing server 200. [ That is, the storage unit 120 compares audio and effect animation images included in each special effect data stored in the image providing server 200, and stores low-quality audio and effect animations. For example, when the image providing server 200 stores the special effect animation of 30 frames per second and the audio data of 384 kbps, the storage unit 120 of the image editing apparatus 100 displays the special effect animation of 4 frames per second, Of the audio data. More preferably, the storage unit 120 stores data in which the special effect object image and the voice are separated from the special effect animation image included in the special effect data. The storage unit 120 may include a high-speed random access memory, and may also include one or more magnetic disk storage devices, non-volatile memory such as a flash memory device, or other non-volatile semiconductor memory device.

The camera 130 is equipped with a lens to photograph the surrounding image through the lens.

The communication unit 140 performs a function of communicating with various servers, in particular, the image providing server 200 via the network 300.

The editing interface providing unit 150 generates a user interface related to image editing and displays the created user interface on the display unit 110. Specifically, when the user requests editing of a specific image, the editing interface providing unit 150 generates an image editing interface including the image and an editing tool capable of editing the image, and outputs the image editing interface to the display unit 110 .

In addition, the editing interface providing unit 150 includes a special effect processing module 151, a position adjusting module 152, and a preview providing module 153.

The special effect processing module 151 generates composite data according to the input information input by the user on the image editing interface. Specifically, when a specific editing tool is selected on the image editing interface, the special effect processing module 151 extracts an object for the selected special effect from the storage unit 120 and outputs the extracted object to the image editing interface, The location is input from the user. In addition, the special effect processing module 151 receives information on the reproduction section in which the special effect is displayed from the user among the entire reproduction sections of the original image to be edited, and outputs the reproduction section, . On the other hand, when the image editing is completed, the special effect processing module 151 generates edit history data including identification information of the composite image and the original image, and stores the edit history data in the storage unit 120. [ The special effect processing module 151 may transmit the editing history data to the image providing server 200 through the communication unit 140. [

When the position adjustment signal of the special effect is input from the user, the position adjustment module 152 generates an effect position adjustment interface capable of adjusting the position of the special effect object in the edit section, and outputs the effect position adjustment interface to the display section 110. Specifically, the position adjustment module 152 captures a predetermined number (for example, four) of the images constituting the image of the edit section, and displays a special effect scene in which the special effect object appears on the captured image, And outputs an effect position adjustment interface including a plurality of special effect scenes thus generated to the display unit 110. [ At this time, the position adjustment module 152 divides an image of the edit section into a predetermined unit time, and can capture each image in each of the divided images. Among the images constituting the image of the edit section, It is possible to capture multiple images with high degree of severity. In addition, the position adjustment module 152 confirms the position of the special effect object displayed in each scene, and displays the special effect object in the identified position for each captured image. On the other hand, when the position adjustment of the user is completed through the effect position adjustment interface, the position adjustment module 152 confirms the position information of the special effect object for each scene and transfers it to the special effect processing module 151.

The preview providing module 153 generates a preview image synthesized with the special effect and provides it to the user. Specifically, when the user clicks the end point control icon (refer to 26b in FIG. 5) indicating the end point of the edit section, the preview providing module 153 displays the preview image including the special effect selected by the user and the preview image And outputs it to the display unit 110. [ At this time, the preview providing module 153 confirms the reproduction time corresponding to the point corresponding to the end point control icon, and outputs a preview image or an image corresponding to the reproduction time from the synthesized whole image to the display unit 110 . Preferably, the preview providing module 153 outputs the preview image to a sub-screen having a predetermined size (see 28 in FIG. 9).

10, the preview providing module 153 uses the entire graphic image on which the special effect object is moved in order to reduce the resources of the image editing apparatus 100 required for displaying the preview image The preview image can be displayed on the display unit 110 by using some images expressing special effects.

3 is a flowchart illustrating a method of performing image editing through an image editing interface in an image editing apparatus according to an embodiment of the present invention.

3, when the user selects an image to be edited from the user, the editing interface providing unit 150 displays the image editing interface including the image and the editing tool on the display unit 110 (S301). The image to be edited may be an image already stored in the storage unit 120, an image captured in real time through the camera 130, or an image received from the image providing server 200.

4 is a diagram illustrating an image editing interface according to an embodiment of the present invention.

4, the editing interface providing unit 150 includes a video selected by a user for editing, a time line 22 indicating a playing time of the video, a playback control bar 23, a playback button 21, On the display unit 110, an image editing interface including editing tools 24a, 24b, When the user changes the position of the playback control bar 23 on the time line 22, the playback control bar 23 is positioned at a position where the playback control bar 23 is located An image from the reproduction time point is outputted. In addition, among the special effect tools of FIG. 4, the special effect tool 24a is an editing tool used for synthesizing a halo effect for emphasizing a specific object, that is, an effect of shining light at a specific object position. Reference numeral 24b in Fig. 4 is a tool used for processing a computer graphic of a specific object, and reference numeral 24c is an editing tool used in synthesizing a text (or a dictionary registered text) entered by a user with an image. Each of the special effects has a minimum playback time (e.g., 0.5 seconds) and also has a default playback time (e.g., 2 seconds). In addition, each special effect has an animation effect that is moved in a certain direction.

Referring again to FIG. 3, the image editing interface providing unit 150 receives selection information for a tool from a plurality of editing tools listed in the image editing interface (S303).

Then, the special effect processing module 151 confirms the special effect output by the user according to the selected editing tool, extracts the object related to the special effect from the storage unit 120, and outputs the extracted object to the image editing interface, The first position at which the object is displayed is input from the user (S305).

Then, the special effect processing module 151 receives information on the reproduction section in which the special effect is displayed from the user, and confirms that the reproduction section in which the special effect is expressed is the editing section in the reproduction section of the entire image (S307 ). That is, the video editing interface providing unit 150 sets, as an editing section, a playback section in which the special effect is displayed, from among the entire playback sections of the video.

FIG. 5 is a view illustrating a state in which a display position and a playback interval of a special effect are designated in an image editing interface according to an exemplary embodiment of the present invention.

Referring to FIG. 5, in the image editing interface, the initial position of the special effect object 25 is set in the face of a person. In other words, the user can set the initial position for the special effect object in the edit section by moving the initial position where the special effect object 25 is displayed through the touch dragging and placing it on the face. The special effect of FIG. 5 illustrates a halo effect in which the light shines. In addition, the image editing interface of FIG. 5 sets a reproduction section in which the special effect is synthesized with the original image according to a user's operation. At this time, the image editing interface can set the point where the reproduction of the image is temporarily stopped, that is, the point where the reproduction control bar 23 is located, as the starting point where the special effect appears, and the default reproduction time of the special effect is added You can set the point where you want the special effect to end. For example, in the video having the total reproduction time of 2 minutes, if the reproduction time at which the backlight effect having the default reproduction time of 2 seconds starts is 1 minute and 00 seconds, To 1 minute 02 seconds. 5, the start point control icon 26a and the end point control icon 26b located on the time line 22 respectively indicate the start point and the end point of the special effect, and the start point control icon 26a, And the end point control icon 26b is the edit section.

On the other hand, when the position of the start point control icon 26a is changed by the user, the image edit interface providing unit 150 changes the start point position where the special effect is displayed. That is, when the user changes the position of the start point control icon 26a on the time line 22 through dragging, the image edit interface providing unit 150 changes the time point at which the special effect is displayed, do. At this time, the image editing interface providing unit 150 changes the position of the end point control icon 26b by the moved position of the start point control icon 26a. That is, when the user changes the position of the start point control icon 26a on the time line 21, the position of the end point control icon 26b is also changed by the position of the start point control icon 26a.

Next, the special effect processing module 151 may receive the special effect adjustment signal from the user who desires to fine-tune the special effect (S309). Preferably, the special effect processing module 151 outputs a plurality of icons 27a, 27b capable of controlling the special effect when the special effect object 25 is clicked on the editing video interface, The user can recognize that the special effect adjustment signal is received from the user when the adjustment icon 27a is clicked.

6 is a diagram illustrating a state in which a special effect adjustment icon is output in the image editing interface according to an embodiment of the present invention.

Referring to FIG. 6, the special effect processing module 151 outputs a plurality of icons 27a and 27b capable of controlling the special effect when the special effect object 25 is clicked in the editing image interface. The adjustment icon 27a is an icon used for finely adjusting the position of the special effect object, and the trash can icon 27b is an icon used when removing the special effect. 6, the special effect processing module 151 recognizes that a special effect adjustment signal is received from the user when the adjustment icon 27a is clicked.

Next, the special effect processing module 151 activates the position adjustment module 152 when a special effect adjustment signal is received from the user, and the position adjustment module 152 sets a certain number (for example, a scene) (Step S311). At this time, the position adjustment module 152 may divide the video of the edit section by a preset unit time, and capture the image by the divided video. Also, the position adjustment module 152 can capture a plurality of images having a large degree of scene change from the images constituting the video of the edit section. That is, among the images constituting the image belonging to the editing section of the position adjustment module 152, each of the images adjacent to each other according to time is compared and analyzed to capture a certain number of images having a large amount of motion variation of the object have.

Next, the position adjustment module 152 checks the position where the special effect object in each of the captured images is displayed, for each image (S313). At this time, based on the initial position of the special effect object input from the user, the playback time of the edit section, the moving direction and the moving speed of the special effect object set as the default, the position adjustment module 152 displays the special effect object in each captured image Can be confirmed.

Subsequently, the position adjustment module 152 generates a special effect scene in which the special effect object is displayed at the identified special effect object position, for each captured image, and the generated plurality of special effect scenes are divided into an effect position adjustment interface To the display unit 110 (S315).

7 is a diagram illustrating an effect location adjustment interface, in accordance with an embodiment of the present invention.

7, the position adjustment module 152 outputs an effect position adjustment interface including four special effect scenes to the display unit 110, based on the position of the video and the special effect object corresponding to the edit section . In the special effect scene of FIG. 7, the numbers shown at the upper left indicate the reproduction order for the corresponding scene in the editing section. Referring to FIG. 7, some of the special effect objects are not synthesized as intended by the user, but displayed in the wrong position. In other words, in the special effect scene having the numbers 2, 3 and 4 in FIG. 7, the display position of the special effect object is not located at the position intended by the user, that is, at the face image frame, but at another position. When a special effect (i.e., a halo effect) and an original image are synthesized in a state as shown in FIG. 7, a halo effect is displayed only at the beginning of the first reproduction, and a halo effect is displayed at an unintended . In other words, when the special effect is animated and synthesized on the image, the special effect is displayed only in the vicinity of the first reproduction point, and in the reproduction interval other than the user's intended position, The effect is not displayed.

Next, the position adjustment module 152 receives the position redesignation signal of the special effect for at least one of the special effect scenes included in the effect position adjustment interface (S317). That is, the position adjustment module 152 receives a movement signal of one or more special effect objects from a user among a plurality of special effect scenes included in the effect position adjustment interface. At this time, the position adjustment module 152 can receive a movement signal of the special effect object from the user through touch drag or the like.

8 is a diagram showing a state in which a special effect object is repositioned in an effect position adjustment interface according to an embodiment of the present invention.

As shown in FIG. 8, the position of the special effect object according to FIG. 8 is compared with the position of the special effect object according to FIG. That is, in the effect position adjustment interface shown in FIG. 8, it can be seen that the position of the special effect object in the special effect scene corresponding to No. 2, No. 3 and No. 4 is redirected to the vicinity of the face frame in accordance with the input signal of the user have. By adjusting the position of the special effect object, it is prevented that the display position of the special effect object is inconsistent with the intention of the user. That is, the image editing apparatus 100 provides an effect position adjustment interface capable of precisely adjusting a special effect, and allows the user to adjust the display position of the special effect object in each special effect scene through the effect position adjustment interface .

Next, when the position adjustment module 152 receives the position adjustment completion signal from the user, the position adjustment module 152 confirms the position of the special effect object for each scene and transfers it to the special effect processing module 151 (S319). At this time, the position adjustment module 152 confirms the reproduction time indicated by each scene and transfers it to the special effect processing module 151.

Then, the special effect processing module 151 generates synthetic data including the reproduction time of each scene, the display position of the special effect object for each scene, the reproduction time of the special effect, and the special effect identification information (e.g., halo effect) (S321). On the other hand, if the special effect adjustment signal is not received from the user in step S309, the special effect processing module 151 performs a synthesis process including the initial position information of the special effect set by the user, the duration of the special effect, Generate data

On the other hand, the image editing interface provider 150 can select the end point control icon 26b corresponding to the end point of the editing section on the image editing interface from the user (S323). That is, the image editing interface providing unit 150 can receive a click signal of the end control icon 26b corresponding to the end point of the editing section from the user who wants to confirm the composite image preview.

Then, the preview providing module 153 generates a preview image in which the original image corresponding to the edit section is synthesized with the special effect, and displays a partial image corresponding to the reproduction time point where the end point control icon 26b is located (Or image), and displays it on a predetermined area on the image editing interface, thereby providing a preview image synthesized to the user (S325). Preferably, the preview providing module 153 outputs the preview image to the sub screen, and when the position of the end point control icon 26b is changed, the reproduction providing time corresponding to the changed position is confirmed, The preview image (or image) of the segment is displayed on the sub screen. At this time, the preview providing module 153 arranges the special effect objects at the designated positions in each scene based on the composite data generated in step S321, animates each of the special effect objects thus arranged by the animation interpolation technique, Synthesizes the effect and the original image, and displays the synthesized image as a preview image on the sub screen.

9 is a diagram illustrating an image editing interface to which a preview image is output, according to an embodiment of the present invention.

9, when the end point control icon 26b is selected in the image editing interface, the preview providing module 153 generates a preview image 28 in which a special effect is synthesized and outputs it to a sub screen of the image editing interface do. Preferably, the preview providing module 153 confirms the reproduction time point corresponding to the position of the end point control icon 26b in the editing section, and outputs a partial image of the preview image corresponding to the reproduction time point. In addition, when the position of the end point control icon 26b is shifted to the left, the preview providing module 153 checks the reproduction point where the end point control icon 26b is located, and displays a part of the corresponding preview image (Or some images). Accordingly, the user can confirm the edited image by moving the end point control icon 26b.

Next, the special effect processing module 151 receives the edit end signal from the user (S327), generates the edit history data including the composite data generated in the step S321 and the identification information of the original image, (S329). The special effect processing module 151 may transmit the edit history data stored in the storage unit 120 to the image providing server 200 and register the edit history data of the user in the image providing server 200. [ The special effect processing module 151 transmits the original image itself to the image providing server 200 when the original image is the image stored in the storage unit 120 of the image editing apparatus 100, And registers it together with the image providing server 200.

Meanwhile, the image editing apparatus 100 may display a preview image using some images expressing special effects, in order to reduce resources consumed when processing a preview image.

10 is a flowchart illustrating a method of generating a preview image in an image editing apparatus according to an embodiment of the present invention.

Referring to FIG. 10, the preview providing module 153 confirms an image belonging to an edit section among the entire playback sections of the original image (S1001).

The preview providing module 153 confirms the special effect set by the user in the edit section, and extracts the image and audio of the low-quality special effect animation implementing the special effect in the storage unit 120 (S1003). That is, the preview providing module 153 extracts a special effect image having a small number of frames per second and audio having a low bit rate in comparison with the special effect animation and audio stored in the image providing server 200.

Next, the preview providing module 153 combines the special effect animation image with the audio corresponding to the edit section (S1005). That is, when an image corresponding to the edit section is reproduced, the preview providing module 153 generates the special effect animation image so that the special effect animation image is displayed at the reproduction time point and the special effect audio is mixed with the audio of the original image. And audio with the video of the edit section. At this time, the preview providing module 153 can adjust the position of each image (i.e., object image) of the special effect animation based on the position of the special effect object for each scene recorded in the composite data.

On the other hand, since the number of the extracted images is smaller than the number of images of the original image, the special effect object image may be interrupted. Accordingly, the preview providing module 153 sets an overlap scene change effect between the special effect objects and smoothly connects the images of the special effect objects (S1009). That is, when the second special effect object image is displayed in a state in which the first special effect object image is displayed, the first special effect object image gradually disappears from the screen and the second special effect object image disappears, An overlap scene change effect is set between each special effect object so that the image of the first special effect object and the second special effect object are naturally switched on the screen as the image becomes blurred gradually and becomes clear.

Next, the preview providing module 153 displays a preview image on the display unit 110, in which each special effect object is displayed on the original image at the designated reproduction time (S1009).

In the above-described embodiment, the preview image is displayed on the sub-screen. However, the preview image may be displayed on the entire screen in the image editing apparatus 100. [

11 is a flowchart illustrating a method of registering edit history data in an image editing system and providing a synthesized image based on the registered edit history data to a communication apparatus according to an embodiment of the present invention.

In the description with reference to FIG. 11, the parts overlapping with the description with reference to FIG. 3 to FIG. 10 will be omitted or compressed and summarized.

11, when an image to be edited is selected by the user, the editing interface providing unit 150 of the image editing apparatus 100 displays the image editing interface including the image and the editing tool on the display unit 110 (S1101).

Next, the special effect processing module 151 receives editing information such as the position of the special effect object, the reproduction period of the special effect, and the special effect identification information from the user through the image editing interface (S1103) And generates synthesis data on the basis thereof. At this time, the position adjustment module 152 can receive the position of the special effect object from the user through the effect position adjustment interface. In addition, the preview providing module 153 may generate and display a preview image in which special effects are synthesized.

Then, when the user finishes editing the image, the special effect processing module 151 generates edit history data including identification information of the composite image and the original image (S1105). The special effect processing module 151 transmits the generated editing history data to the image providing server 200 using the communication unit 140 (S1107). At this time, the special effect processing module 151 can transmit the original image itself (i.e., the original image file) to the image providing server 200. [

Then, the image providing server 200 stores the edit history data received from the image editing apparatus 100 (S1109). At this time, when the image providing server 200 receives the image source file from the image editing apparatus 100, the image providing server 200 stores the image source file and the edit history data together.

Next, the image providing server 200 can receive a video request message requesting the video from the communication device 400 (S1111). Then, the image providing server 200 extracts the edit history data of the image (S1113). At this time, the image providing server 200 receives the image identification information from the communication device 400, and extracts the edit history data including the image identification information.

Next, the image providing server 200 extracts the original image based on the image identification information, and synthesizes the original image and the special effect on the basis of the edit history data (S1115). At this time, the image providing server 200 selects a special effect image to be synthesized based on the special effect identification information recorded in the edit history data, and selects the special effect image to be synthesized based on the reproduction time of the special effect recorded in the edit history data Identify the playback and ending points of the special effect. In addition, the image providing server 200 extracts, from the frame image of the original image belonging to the reproduction period of the special effect (i.e., the editing period) based on the position of the special effect object for each scene recorded in the editing history data, An image is confirmed, a special effect object is placed at a specified position (i.e., a special effect object position) in each of the frame images identified above, and the special effect object is animated through animation interpolation. Then, the image providing server 200 synthesizes the animated special effect object and the original image.

Next, the image providing server 200 transmits the synthesized image to the communication device 400 (S1117). Then, the communication device 400 outputs the image received from the image providing server 200 to the screen, thereby confirming the image edited by the image editing device 100.

While the specification contains many features, such features should not be construed as limiting the scope of the invention or the scope of the claims. In addition, the features described in the individual embodiments herein may be combined and implemented in a single embodiment. Conversely, various features described in the singular < Desc / Clms Page number 5 > embodiments herein may be implemented in various embodiments individually or in combination as appropriate.

Although the operations have been described in a particular order in the figures, it should be understood that such operations are performed in a particular order as shown, or that all described operations are performed to obtain a sequence of sequential orders, or a desired result . In certain circumstances, multitasking and parallel processing may be advantageous. It should also be understood that the division of various system components in the above embodiments does not require such distinction in all embodiments. The above-described program components and systems can generally be implemented as a single software product or as a package in multiple software products.

The method of the present invention as described above can be implemented by a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto optical disk, etc.). Such a process can be easily carried out by those skilled in the art and will not be described in detail.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings.

100: image editing apparatus 110: display unit
120: storage unit 130: camera
140: communication unit 150: edit interface providing unit
151: special effects processing module 152: position adjustment module
153: preview providing module 200: image providing server
300: network 400: communication device

Claims (17)

A display unit for displaying a video editing interface including a video to be edited and an editing tool;
An editing section in which special effects are synthesized among the entire reproduction sections of the image, a predetermined number of scenes in which the special effect objects are displayed in the editing section are selected and displayed on the display section,
A position adjustment module for resetting the position of the special effect object in the scene when the special effect object is moved by the user from among the displayed scenes; And
And a special effect processing module for generating edit history data including a position of a scene-specific special effect object,
Wherein the scene-specific effect object is based on a special effect animation interpolation. The method according to claim 1,
The position adjustment module includes:
A plurality of images are captured in the editing section, a position of the special effect object is checked for each captured image, and a plurality of captured images in which the special effect object is displayed at the identified special effect object position are selected as the predetermined number of scenes Features a video editing device. 3. The method of claim 2,
The position adjustment module includes:
Wherein the editing section divides an image of the editing section by a preset unit time, and captures an image in each of the divided images. 3. The method of claim 2,
The position adjustment module includes:
Wherein the image editing device captures an image whose degree of scene change exceeds a threshold value among images constituting an image of an editing section. 3. The method of claim 2,
The position adjustment module includes:
Wherein the position of the special effect in each captured image is identified based on the initial position of the special effect object, the playback time of the edit section, the moving direction of the special effect object, and the moving speed. 6. The method according to any one of claims 1 to 5,
A storage unit for storing low-quality audio and special effect object images for implementing special effect animation; And
And a preview providing module for extracting the low-quality audio and special effect object images from the storage unit and displaying a preview image in which the low-quality image and audio are combined with the image of the edit section on the display unit . The method according to claim 6,
Wherein the storage unit stores a special effect object image in which a frame image per second is less than an animation reference value,
Wherein the preview providing module sets a scene change effect between each special effect object image and displays a preview image set in the scene change effect between the special effect object images on the display unit. The method according to claim 6,
The preview providing module includes:
When the control icon indicating the end of the editing section is clicked on the time line, the control icon confirms the reproduction time at which the control icon is located on the time line, and the preview image corresponding to the reproduction time is output to the sub- Image editing device. 6. The method according to any one of claims 1 to 5,
The special effect processing module includes:
Wherein the editing history data is stored or transmitted to an external server. An image editing method for synthesizing a special effect and an image in an image editing apparatus,
Confirming an edit section to be synthesized with a special effect among the entire playback sections of the video to be edited;
Selecting and displaying a predetermined number of scenes in which the special effect objects are displayed in the editing section;
Resetting a position of the special effect object in the scene in which the special effect object is moved when the special effect object is moved by the user among the displayed special effect scenes; And
And generating edit history data including the position of the special effect object for each scene,
Wherein the scene-specific effect object is based on a special effect animation interpolation. 11. The method of claim 10,
Wherein the displaying comprises:
Capturing a plurality of images in the edit section and checking the position of the special effect object on the captured image for each captured image; And
And selecting a plurality of captured images in which the special effect object is displayed at the identified special effect object position as the predetermined number of scenes. 12. The method of claim 11,
Wherein the displaying comprises:
Wherein the editing section divides the reproduction time of the edit section by a predetermined unit time and captures each image corresponding to a start point of each divided time. 12. The method of claim 11,
Wherein the displaying comprises:
And capturing an image whose degree of scene change exceeds a threshold value among images constituting an image of an editing section. 12. The method of claim 11,
Wherein the displaying comprises:
Wherein the position of the special effect in each captured image is identified based on the initial position of the special effect object, the playing time of the editing section, the moving direction of the special effect image, and the moving speed. 15. The method according to any one of claims 10 to 14,
Storing low-quality audio and special effect object images implementing special effect animation; And
Extracting the low-quality audio and the special effect object image, and displaying the preview image in which the low-quality image and audio are combined with the image of the edit section. 16. The method of claim 15,
Wherein the storing step stores a special effect object image whose frame image per second is lower than the animation reference value,
Wherein the step of displaying the preview image sets a scene transition effect between each of the special effect object images and displays a preview image in which a scene transition effect is set between the special effect object images. 16. The method of claim 15,
Wherein the generating and displaying the preview image comprises:
When the control icon indicating the end of the editing section is clicked on the time line, the control icon confirms the reproduction time at which the control icon is located on the time line, and the preview image corresponding to the reproduction time is output to the sub- Image editing method.
KR1020140017293A 2014-02-14 2014-02-14 Method for editing video and apparatus therefor KR101528312B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020140017293A KR101528312B1 (en) 2014-02-14 2014-02-14 Method for editing video and apparatus therefor
PCT/KR2015/000532 WO2015122627A1 (en) 2014-02-14 2015-01-19 Image editing method and apparatus therefor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140017293A KR101528312B1 (en) 2014-02-14 2014-02-14 Method for editing video and apparatus therefor

Publications (1)

Publication Number Publication Date
KR101528312B1 true KR101528312B1 (en) 2015-06-11

Family

ID=53503311

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140017293A KR101528312B1 (en) 2014-02-14 2014-02-14 Method for editing video and apparatus therefor

Country Status (2)

Country Link
KR (1) KR101528312B1 (en)
WO (1) WO2015122627A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9773524B1 (en) 2016-06-03 2017-09-26 Maverick Co., Ltd. Video editing using mobile terminal and remote computer
US9852768B1 (en) 2016-06-03 2017-12-26 Maverick Co., Ltd. Video editing using mobile terminal and remote computer
CN107743212A (en) * 2017-09-28 2018-02-27 努比亚技术有限公司 A kind of method for processing video frequency, mobile terminal and computer-readable recording medium
KR20180029296A (en) * 2016-09-12 2018-03-21 이규상 Apparatus and method for providing correlated advertisements
WO2018072652A1 (en) * 2016-10-17 2018-04-26 腾讯科技（深圳）有限公司 Video processing method, video processing device, and storage medium
WO2022154439A1 (en) * 2021-01-12 2022-07-21 삼성전자 주식회사 Electronic device, method, and non-transitory storage medium for video editing
JP7307864B2 (en) 2020-06-10 2023-07-12 北京字節跳動網絡技術有限公司 Video processing method, apparatus, electronic equipment and computer readable storage medium
US11955141B2 (en) 2021-01-12 2024-04-09 Samsung Electronics Co., Ltd. Electronic device, method, and non-transitory storage medium for editing video

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111105344A (en) * 2018-10-26 2020-05-05 北京微播视界科技有限公司 Image processing method, image processing device, electronic equipment and computer readable storage medium
CN110290410B (en) * 2019-07-31 2021-10-29 合肥华米微电子有限公司 Image position adjusting method, device and system and adjusting information generating equipment
CN113018867A (en) * 2021-03-31 2021-06-25 苏州沁游网络科技有限公司 Special effect file generating and playing method, electronic equipment and storage medium
CN113262476B (en) * 2021-06-18 2023-04-18 腾讯科技（深圳）有限公司 Position adjusting method and device of operation control, terminal and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10322647A (en) * 1997-05-14 1998-12-04 Matsushita Electric Ind Co Ltd Moving picture editing system
JP2006140867A (en) * 2004-11-15 2006-06-01 Canopus Co Ltd Video editting apparatus and method thereof
KR20120050689A (en) * 2010-11-11 2012-05-21 주식회사 케이티 Method and apparatus for producing user creative contents

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10322647A (en) * 1997-05-14 1998-12-04 Matsushita Electric Ind Co Ltd Moving picture editing system
JP2006140867A (en) * 2004-11-15 2006-06-01 Canopus Co Ltd Video editting apparatus and method thereof
KR20120050689A (en) * 2010-11-11 2012-05-21 주식회사 케이티 Method and apparatus for producing user creative contents

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9773524B1 (en) 2016-06-03 2017-09-26 Maverick Co., Ltd. Video editing using mobile terminal and remote computer
US9852768B1 (en) 2016-06-03 2017-12-26 Maverick Co., Ltd. Video editing using mobile terminal and remote computer
KR20180029296A (en) * 2016-09-12 2018-03-21 이규상 Apparatus and method for providing correlated advertisements
KR102005429B1 (en) * 2016-09-12 2019-07-30 이규상 Apparatus and method for providing correlated advertisements
WO2018072652A1 (en) * 2016-10-17 2018-04-26 腾讯科技（深圳）有限公司 Video processing method, video processing device, and storage medium
US11012740B2 (en) 2016-10-17 2021-05-18 Tencent Technology (Shenzhen) Company Limited Method, device, and storage medium for displaying a dynamic special effect
US11412292B2 (en) 2016-10-17 2022-08-09 Tencent Technology (Shenzhen) Company Limited Video processing method, video processing device, and storage medium
CN107743212A (en) * 2017-09-28 2018-02-27 努比亚技术有限公司 A kind of method for processing video frequency, mobile terminal and computer-readable recording medium
JP7307864B2 (en) 2020-06-10 2023-07-12 北京字節跳動網絡技術有限公司 Video processing method, apparatus, electronic equipment and computer readable storage medium
WO2022154439A1 (en) * 2021-01-12 2022-07-21 삼성전자 주식회사 Electronic device, method, and non-transitory storage medium for video editing
US11955141B2 (en) 2021-01-12 2024-04-09 Samsung Electronics Co., Ltd. Electronic device, method, and non-transitory storage medium for editing video

Also Published As

Publication number Publication date
WO2015122627A1 (en) 2015-08-20

Similar Documents

Publication Publication Date Title
KR101528312B1 (en) Method for editing video and apparatus therefor
CN110543268B (en) Apparatus, method and graphical user interface for navigating media content
CN107810629B (en) Image processing apparatus, image processing method, and program
CN105190511B (en) Image processing method, image processing apparatus and image processing program
US9852768B1 (en) Video editing using mobile terminal and remote computer
KR20220130197A (en) Filming method, apparatus, electronic equipment and storage medium
US20170024110A1 (en) Video editing on mobile platform
JP2021530146A (en) Video recording methods, devices, terminal equipment and storage media
US20170068380A1 (en) Mobile terminal and method for controlling the same
WO2020107297A1 (en) Video clipping control method, terminal device, system
KR20100028344A (en) Method and apparatus for editing image of portable terminal
KR20140093557A (en) Method and apparatus for photographing of a portable terminal
US10048858B2 (en) Method and apparatus for swipe shift photo browsing
US8516395B2 (en) One-dimensional representation of a two-dimensional data structure
CA3001480C (en) Video-production system with dve feature
CN112866576B (en) Image preview method, storage medium and display device
US9773524B1 (en) Video editing using mobile terminal and remote computer
CN108200477B (en) Method, device and equipment for generating and playing video file
CN111064930B (en) Split screen display method, display terminal and storage device
CN104333699A (en) Synthetic method and device of user-defined photographing area
KR101557117B1 (en) Time line adjustment method for video edition and video editing apparatus
CN106954093B (en) Panoramic video processing method, device and system
CN112422812A (en) Image processing method, mobile terminal and storage medium
KR102138835B1 (en) Apparatus and method for providing information exposure protecting image
CN114125297A (en) Video shooting method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
GRNT Written decision to grant