WO2015020496A1

WO2015020496A1 - Device for providing user interface for video editing, and providing method thereof and recording medium

Info

Publication number: WO2015020496A1
Application number: PCT/KR2014/007411
Authority: WO
Inventors: 정재원; 김경중
Original assignee: 넥스트리밍(주)
Priority date: 2013-08-09
Filing date: 2014-08-08
Publication date: 2015-02-12
Also published as: KR101352713B1

Abstract

A device, method, and recording medium for providing a user interface for video editing are disclosed. According to the present invention, when a mobile device is turned upright in the vertical direction while video editing software executed in the mobile device is used in the horizontal direction, a graphical user interface for selecting a video clip and inserting the video clip into a timeline is rotated and then displayed on one side of a screen after the size thereof is dynamically adjusted, and a reference line, which corresponds to an object for visually displaying a timeline, is displayed on the other side of the screen in a form where the reference line extends along the horizontal axis while the vertical coordinate of the reference line increases or decreases with reference to one or more inflection points. Further, icons representing video clips on the timeline, respectively, are rearranged along the reference line.

Description

Apparatus for providing a user interface for video editing, a method of providing the same and a recording medium

The present invention relates to a graphical user interface of mobile video editing software.

Looking at the authoring process of a video, the editing process such as inserting or adding transition effects, subtitles, and sound effects between each clip is arranged by arranging a plurality of video clips to be edited from left to right along the timeline. After rendering, you get the final video file.

Due to the nature of such a video editing process, known software for editing a video generally has a similar user interface.

Many video editing software, including Adobe's Premiere and Apple's iMovie, split the screen up and down, using either space as the timeline.

Because many video clips must be listed in the timeline along the horizontal direction, video editing software typically ensures that the region extends as long as possible in the horizontal direction.

In particular, when two or more multiple monitors are used, the timeline can be displayed across two or more horizontally connected monitors, allowing intuitive editing with a large number of video clips arranged horizontally.

On the other hand, with the recent widespread use of smartphones around the world, the software technology field is undergoing major changes, especially in smartphones, and video editing software technology is no exception, and video editing software for mobile is being released one after another. .

However, mobile screens have a relatively small screen size and are often used in a vertical direction while holding them in one hand rather than in a horizontal direction like a PC monitor. It is not easy to place and edit multiple video clips.

In particular, when the mobile is used in the vertical direction, since the amount of information that can be displayed horizontally becomes more narrow, it is difficult to intuitively display a plurality of video clips on the timeline.

(Patent Literature 1) Literature 1. Korean Intellectual Property Office, Patent Publication No. 10-2009-0058305 "Video recording editing apparatus and method"

(Patent Document 2) Document 2. Korean Intellectual Property Office, Patent Registration No. 10-0860510 "Generating a slide show with visual effects inserted into a mobile device"

(Non-Patent Literature 1) Literature 3. Choi, Young-Young, Choi, Study on Mobile Video Editing Techniques in the Smartphone Market, Journal of the Korea Contents Association 10 (5) 115-123 1738-6764 KCI, 2010

The present invention has been developed to solve the problems of the prior art, even when using the mobile in the vertical direction in the vertical direction so that a large number of video clips can be displayed on the timeline enough to be edited with simple operation. We want to present the user interface of suitable video editing software.

In order to achieve the above object, an apparatus for providing a user interface for editing a video according to the present invention may be implemented in the form of a mobile device having a touch screen, and detects a landscape orientation event in the touch screen display direction. Direction detecting means; A clip for displaying a clip selection user interface for selecting and inserting at least a portion of a video file into a timeline on one side of the touch screen, and adding a video clip corresponding to at least a portion of the video file selected by the user on the timeline; Selecting user interface providing means; Reference line display means for displaying a reference line on the other side of the touch screen; And icon display means for displaying icons representing a video clip added to a timeline on one side of the touch screen along the reference line.

In this case, when the screen display direction of the touch screen changes from the horizontal direction to the vertical direction, the clip selection user interface providing means dynamically changes the size of the clip selection user interface and rotates the screen according to the vertical direction. On one side,

The reference line display means extends the reference line displayed in a straight line along the horizontal axis, and deforms the reference line on the other side of the screen based on one or more inflection points.

The icon display means determines a position where each icon is to be displayed based on the reference line according to the position on the timeline of the video clip indicated by each icon.

Meanwhile, as the user inputs a touch screen with respect to one or more icons displayed along a reference line while the screen display direction of the touch screen is changed in the vertical direction, the icon display means corresponds to the user's touch screen input. Reorder the icons along the baseline, but process the editing operation on the timeline for the movie clip represented by the icon.

On the other hand, in order to achieve the above object, a method of providing a user interface for editing a video according to the present invention comprises: a) a display direction detecting step of detecting whether the display direction of the display means is horizontal or vertical; b) a baseline display step of displaying a clip selection user interface for selecting at least a portion of a video file on one side of a screen of the display means and inserting the clip into a timeline, and displaying a baseline on the other side of the screen; c) a timeline insertion step of adding a video clip corresponding to at least a portion of a video file selected by a user on a timeline according to a user manipulation through the clip selection user interface; and d) displaying an icon representing a video clip inserted in the timeline along the reference line.

In this case, in step b), the reference line extends along the horizontal axis and has a shape in which the vertical axis coordinates increase or decrease based on one or more inflection points.

As the video clip is inserted in the timeline, in step d), the horizontal position and the vertical position on the screen where the icon is to be displayed are determined based on the position on the timeline of the video clip.

On the other hand, the present invention to achieve the above object is a) a display direction detection step of detecting whether the screen display direction of the display means is horizontal or vertical; b) vertically selecting a clip selection user interface for selecting at least a portion of a video file and inserting a video clip corresponding to at least a portion of the selected video file in the timeline as the screen display direction of the display means is changed from horizontal to vertical; A baseline display step of dynamically changing a form suitable for a mode to be displayed on a screen, extending along a horizontal axis on the other side of the screen, and deforming on the other side of the screen to increase or decrease the vertical coordinates based on one or more inflection points; c) a timeline insertion step of adding a video clip corresponding to at least a portion of a video file selected by a user on a timeline according to a user manipulation through the clip selection user interface; d) displaying an icon representing a video clip inserted in the timeline along the reference line; And e) rearranging icons along the baseline with icons representing movie clips in the timeline as the user adds more movie clips to the timeline, deletes existing movie clips, or changes positions on the timeline. A computer for executing a method including; may be implemented as a set of executable instructions and stored in a computer-readable recording medium.

According to the present invention, a user can edit a video through an intuitive user interface using a mobile having a relatively small screen size.

In particular, even when the mobile is standing vertically, it is possible to simply edit the video while visually seeing a plurality of video clips inserted in the timeline.

1 is a diagram illustrating a landscape mode GUI structure of mobile video editing software.

2 is a block diagram illustrating a configuration of an apparatus for providing a user interface for editing a video according to the present invention.

3 is a diagram illustrating a vertical mode GUI structure of mobile video editing software.

4 is a flowchart illustrating a method of providing a user interface for video editing according to the present invention in time series.

FIG. 5 is a view for explaining how an icon representing a movie clip is displayed along a baseline as a movie clip is added to a timeline by a user.

FIG. 6 is a view illustrating how the remaining icons are rearranged along the base line as one of the icons displayed along the base line is deleted.

FIG. 7 is a view for explaining how icons are rearranged as new icons are added between icons displayed along a reference line.

8 is a view for explaining a state of changing the position of some of the icons displayed along the reference line,

9 is a diagram illustrating an operation of moving a reference line and icons on a screen.

A mobile device having a touch screen, the mobile device comprising: direction detecting means for detecting a horizontal turning direction event of the display direction of the touch screen; A clip for displaying a clip selection user interface for selecting and inserting at least a portion of a video file into a timeline on one side of the touch screen, and adding a video clip corresponding to at least a portion of the video file selected by the user on the timeline; Selecting user interface providing means; Reference line display means for displaying a reference line on the other side of the touch screen; And icon display means for displaying icons representing a video clip added to a timeline on one side of the touch screen along the reference line.

When the screen display direction of the touch screen changes from the horizontal direction to the vertical direction, the clip selection user interface providing means dynamically changes the size of the clip selection user interface and rotates it in the vertical direction to one side of the screen. The reference line display means may be displayed on the other side of the screen by transforming the reference line, which is displayed in a straight line, along a horizontal axis to a shape in which the vertical axis coordinates increase or decrease based on one or more inflection points. Determine the position of each icon based on the reference line according to the position on the timeline of the movie clip that

As the screen display direction of the touch screen is changed in the vertical direction, as the user inputs a touch screen with respect to one or more icons displayed along a reference line, the icon display means corresponds to the user's touch screen input. Reorder along the baseline, but process the editing operation on the timeline for the movie clip represented by the icon.

A method executed in a video editing apparatus having display means, comprising: b) selecting at least a portion of a video file on one side of a screen of the display means and inserting it into a timeline as the screen display direction is changed from horizontal to vertical; A baseline display step of displaying a clip selection user interface and displaying a baseline on the other side of the screen; c) a timeline insertion step of adding a video clip corresponding to at least a portion of a video file selected by a user on a timeline according to a user manipulation through the clip selection user interface; and d) displaying an icon representing a video clip inserted in the timeline along the reference line.

In step b), the reference line extends along the horizontal axis and has a shape in which the vertical axis coordinates increase or decrease based on one or more inflection points,

a) a display direction detecting step of detecting whether the screen display direction of the display means is horizontal or vertical;

In the step b), as the screen display direction is changed from the horizontal direction to the vertical direction, the position and size of the existing clip selection user interface are changed and displayed on one side of the rotated clip selection user interface screen. The displayed reference line extends along the horizontal axis and is deformed and displayed on the other side of the screen so that the vertical axis coordinates increase or decrease based on one or more inflection points.

In step b), a reference line having a sinusoidal shape connecting the inflection points existing at predetermined distances in a horizontal direction is displayed.

In step d), at least one of the icons representing the video clip is displayed on the inflection point.

In the step c), as the user simultaneously selects any two frames among the plurality of frames displayed in the clip selection user interface and drags them in the direction of the reference line, the frames preceding the time in the selected two frames are set as starting positions. Insert a movie clip into the timeline with the last frame ending in chronological order.

After step d), as the user adds a video clip to the timeline, an icon representing the added video clip is further displayed along the reference line, but the icon on the far right of the icons previously displayed along the reference line. Realigning the icon to display at a position spaced a predetermined distance in the right direction from the; further comprising,

The icon representing the added video clip and the icon on the far right among the previously displayed icons are displayed to have different vertical coordinates.

After the step d), as the user selects and deletes any one of the plurality of icons, the icon rearranging step moves and displays the positions of all the icons displayed on the right side of the deleted icon by a predetermined distance to the left, respectively. Including,

In the step e), the icons moving along the reference line are displayed on the screen.

After the step d), as the user drags the selected video clip between the plurality of icons displayed along the reference line, an icon representing the dragged video clip is displayed along the reference line around the position where the drag ends. Reordering the icon to display by moving all the icons on the right of the point where the drag is terminated by a predetermined distance to the right;

In step e), each icon moved to the right displays an animation of moving along the reference line.

After the step d), e) when the user simultaneously selects any two icons among the icons previously displayed along the reference line and drags them in one direction of the reference line, between the two selected icons and the two icons. And rearranging icons to move relative positions of the icons along the reference line.

After the step d), if the user touches any two points of the icon or the space between the icons previously displayed along the reference line and drags it to one side of the reference line, the user is displayed on the reference line and the reference line. And rearranging icons to move and display all the icons simultaneously in the drag direction.

a) a display direction detecting step of detecting whether the screen display direction of the display means is horizontal or vertical; b) the screen selection direction of the display means is changed from landscape to portrait, so that at least a portion of the video file is selected and a clip selection user interface for inserting a video clip corresponding to at least a portion of the selected video file into the timeline is displayed. A baseline display step of dynamically changing from a mode to a portrait mode and displaying on the screen, extending along the horizontal axis on the other side of the screen, and deforming on the other side of the screen in a shape in which the vertical axis coordinates are increased or decreased based on one or more inflection points; c) a timeline insertion step of adding a video clip corresponding to at least a portion of a video file selected by a user on a timeline according to a user manipulation through the clip selection user interface; d) displaying an icon representing a video clip inserted in the timeline along the reference line; e) rearranging icons along the baseline of icons representing movie clips in the timeline as the user adds more movie clips to the timeline, deletes existing movie clips, or changes positions on the timeline; A computer readable recording medium having instructions executable by a computer for performing a method comprising a.

Hereinafter, with reference to the preferred embodiments of the present invention and the accompanying drawings will be described in detail, the same reference numerals in the drawings will be described on the assumption that the same components.

When any one element in the description or claims of the invention "includes" another element, unless otherwise stated, it is not limited to consisting only of that element, and other elements are not interpreted. It should be understood that it may include more.

Further, in the detailed description of the invention or in the claims, the elements designated as "~ means", "~ part", "~ module", and "~ block" mean a unit that processes at least one function or operation, Each of these may be implemented by software or hardware, or a combination thereof.

1 conceptually illustrates a landscape mode graphical user interface (GUI) of video editing software for mobile developed by the applicant.

The mobile 1 has a touch screen of generally limited size and resolution, ranging from a smart phone having a screen of about 3 inches to a tablet computer having a screen of about 10 inches.

On the other hand, since the mobile 1 uses the touch screen as the only input means, the software for the mobile 1 is operated by operations such as touch, multi-touch, drag or gesture using a finger, unlike software for a personal computer (PC). There is a need to provide this intuitive user interface.

The user interface of the video editing software for mobile shown in Fig. 1 is produced in this respect, and a clip selection user interface for selecting and adding a video clip to the timeline is displayed at the top of the screen.

The user can use the clip selection user interface to open a movie file stored locally on the mobile 1 and add it as a movie clip to the timeline, or select a part of the opened file to select a movie clip corresponding to the selected portion. Can be added to the timeline.

The user selects all or part of the video file and adds a video clip corresponding to the selected part to the timeline, and then renders the video clips arranged along the timeline to obtain a final result.

Meanwhile, as shown in FIG. 1, it can be seen that a reference line is displayed in a horizontal line at the bottom of the screen.

In addition, icons representing movie clips added to the timeline by the user are displayed along the reference line.

In this case, the icon is to represent each video clip on the timeline, and may be a thumbnail image of the corresponding video clip, or may be a simple icon having no other information.

The present invention presupposes the GUI environment for the video editor as shown in FIG.

In particular, the user can use the video editing software with a GUI configured for landscape orientation on the screen of the mobile 1, i.e., a landscape mode GUI, as shown in FIG. In the case of using it vertically, a GUI configured for the vertical direction-that is, a method for dynamically configuring and providing a GUI for portrait mode is presented.

Prior to the description of the present invention, terms used in the present invention are defined as follows.

The timeline literally means the time base. When authoring a video using video editing software, the user arranges a number of video clips along the timeline, sets effects on each of the arranged video clips, and then renders the resulting video file.

In other words, the timeline means a time position occupied by each video clip in the video file that is rendered as the final result. For example, the video clip may be used at a location on a timeline corresponding to a section “1 minute 10 seconds to 1 minute 30 seconds”.

Meanwhile, a video clip refers to a piece or a portion of a video that is split into pieces for authoring a video edit.

The user can insert a locally stored movie file as a whole into the timeline, or select a portion of the movie file to insert into the timeline, in which case they are part of the output of the final rendered movie file, arranged on the timeline. It may be referred to as a video clip in that it is configured.

Meanwhile, in the present invention, the baseline corresponds to a graphic object that visually displays such a timeline.

2 illustrates a configuration of an apparatus for providing a user interface for editing a video according to the present invention.

The apparatus 100 for providing a user interface for editing a video according to the present invention shown in FIG. 2 may be implemented in the form of a mobile 1 or in the form of software or firmware loaded and executed on the mobile 1. .

The apparatus 100 for providing a user interface for editing a video according to the present invention, when a user edits a video using the landscape mode GUI as shown in FIG. 1, FIG. 3 when the mobile 1 is set in the vertical direction. It provides a portrait mode GUI as shown.

3 is a diagram illustrating a portrait GUI structure of mobile video editing software.

In particular, Figure 3 (a) is a diagram illustrating a state in which the user interface of the video editing software is dynamically modified as the touch screen of the smartphone is switched from the horizontal direction to the vertical direction.

FIG. 3B illustrates an example in which a portrait mode user interface as shown in FIG. 3A is applied to a tablet computer.

As will be described later, the present invention is mainly described on the premise of dynamically reconfiguring the user interface when the smartphone is used in the horizontal direction and in the vertical direction. However, in the case of a tablet computer having a large screen size, the horizontal or vertical direction is used. Regardless, the user interface as shown in FIG. 3B may be maintained.

Meanwhile, as shown in FIG. 2, the apparatus 100 for providing a user interface for editing a video according to the present invention includes a direction detecting unit 110, a clip selecting user interface providing unit 120, and an icon display unit ( 130 and reference line display means 140.

The direction detecting unit 110 detects a horizontal and vertical direction change event of the screen display direction of the touch screen of the mobile 1.

In general, the mobile 1 includes a gyro sensor, and when the screen display direction is changed from landscape to portrait, or from portrait to landscape, the operating system detects this and notifies an event to the running app.

The direction detecting means 110 may be a part of the app that is preferably notified of the direction change event from the operating system. Or the operating system itself.

Meanwhile, the clip selection user interface providing means 120 selects at least a portion of the video file on one side of the touch screen, that is, the video file itself or a portion thereof, and displays a video clip corresponding to at least a portion of the selected video file. Displays the clip selection user interface for insertion into a.

The clip selection user interface opens a locally stored video file of the mobile 1 and selects it as a whole, or a portion of the opened video file, as shown at the top of FIG. 1 or at the top of FIG. Corresponds to the GUI (Graphic User Interface).

The reference line display unit 140 displays the reference line on the touch screen as shown in the bottom of FIG. 1 or the bottom of FIG. 3 (a), and the icon display unit 130 allows the user to select a video clip through a clip selection user interface. As the is inserted into the timeline, an icon representing the inserted video clip is displayed along the reference line.

When comparing the landscape mode GUI and the portrait mode GUI of the video editing software presented by the present applicant with reference to FIGS. 1 and 3 (a), in the case of the landscape mode GUI shown in FIG. The reference line having a straight line in the direction is displayed, and the icon display unit 130 may arrange the icons at predetermined intervals on a reference line or at a position spaced a predetermined distance below or above the reference line.

Each icon represents a video clip arranged in the timeline, and the icons displayed along the reference line in the horizontal direction indicate that a plurality of video clips are arranged along the timeline.

On the other hand, when the user raises the mobile 1 from the horizontal direction to the vertical direction, the apparatus 100 for providing a user interface for video editing according to the present invention 100 dynamically adjusts the vertical mode GUI as shown in FIG. Configure and display on the screen.

To this end, first, the direction detecting unit 110 recognizes the occurrence of a direction change event from the horizontal direction to the vertical direction of the touch screen screen from the measured value of the gyro sensor of the mobile 1.

Accordingly, the clip selection user interface providing means 120, the icon display means 130, and the baseline display means 140 dynamically reconfigure the user interface according to the switching of the screen display mode to the portrait mode as follows.

First, the clip selection user interface providing means 120 first reduces the width of the clip selection user interface and displays a clip selection user interface for portrait mode such as rotated in the vertical direction as shown in FIG. Mark on one side.

On the other hand, the reference line display means 140 displays the reference line modified to suit the portrait mode on the other side of the screen as the touch screen is erected in the vertical direction.

In this case, as shown in (a) of FIG. 3, a sinusoidal shape, that is, a reference line having a shape close to a sine curve may be displayed.

That is, in the horizontal mode of FIG. 1, the reference line is straight, but in the vertical mode of FIG. 3A, the shape changes to a sinusoidal curve.

By doing in this way, the length of the straight reference line of FIG. 1 and the length of the sinusoidal reference line of FIG. 3 (a) can be maintained so that there is no big difference substantially.

That is, although the horizontal and vertical lengths of the touch screen of the mobile 1 are different, the length of the reference line in the horizontal mode and the vertical mode may be kept constant.

The reference line is an object that visually displays the timeline, and thus the length of the timeline that can be displayed on one screen in the horizontal mode and the vertical mode can be maintained to be substantially the same.

On the other hand, Figure 3 (a) shows a reference line having the shape of a sinusoid, but not necessarily a straight line extending in the horizontal direction, as long as the object is a shape of the vertical axis is increased or decreased based on one or more inflection points necessarily of the sinusoid It may not be a shape.

For example, in the longitudinal mode, the reference line extends obliquely upward at a predetermined angle and then repeats to extend in a downward direction after the inflection point, or extends a certain length in the horizontal direction, and the angle is 90 degrees counterclockwise. By changing the direction in the vertical direction to further extend the predetermined length and again this time it may be repeated to extend the predetermined length in the horizontal direction by changing the angle of 90 degrees clockwise.

On the other hand, since the reference line of the type suitable for the portrait mode is no longer straight, it is necessary to arrange or rearrange the icons.

As shown in (a) of FIG. 3, as a reference line having a form suitable for the portrait mode is displayed on the screen, the icon display unit 130 displays icons representing video clips inserted in the timeline according to the reference line. .

That is, the position on the reference line corresponding to the position on the timeline of the video clip indicated by each icon may be determined and displayed on the position.

Preferably, each icon has a different ordinate value from the adjacent icon unlike the landscape mode.

At this time, it is not necessary to display the icons on the reference line as shown in (a) of FIG. 3, and to display the icons at a predetermined interval while maintaining the relative distance from the reference line, such as at a position spaced a predetermined distance up and down from the reference line. Can be.

Hereinafter, a method of providing a user interface for editing a video according to the present invention will be described with reference to FIGS. 3 and 4.

The method of providing a user interface for editing a video according to the present invention can be executed in the mobile 1.

As shown in FIG. 4, the method of providing a user interface for editing a video according to the present invention includes a display direction detecting step (a step), a baseline display step (b step), a timeline insertion step (c step), Icon display step (d step) and icon rearrangement step (e step).

First, in the display direction detection step, the mobile 1 detects whether the display means-that is, the screen display direction of the touch screen is horizontal or vertical (step a).

Preferably, a gyro sensor embedded in the mobile 1 is used to determine whether the mobile 1 is being used in the horizontal direction or in the vertical direction.

On the other hand, in the baseline display step, a clip selection user interface for selecting at least a portion of a video file on one side of the touch screen to insert a video clip corresponding to at least a portion of the selected video file into a timeline is displayed, and the baseline is displayed on the other side of the screen. (Step b).

In particular, as the user uses the mobile 1 in the landscape mode and stands in the vertical direction, the mobile 1 moves and displays the clip selection user interface configured for the portrait mode to one side of the screen.

In the horizontal mode, the reference line displayed in a straight line is displayed in a form suitable for the vertical mode as shown in FIG.

In the timeline insertion step, when the user selects a video clip and inserts it into the timeline while the clip selection user interface is displayed (step c).

Looking at the process in more detail, the user can open the video file stored locally through the clip selection user interface suitable for the vertical mode as shown in Fig. 3 (a) and drag the video file by dragging it in the direction of the baseline below the screen. Can be inserted into the timeline as a movie clip.

Alternatively, when the mobile 1 opens a locally stored video file and displays the frames of the video file on the screen, the user touches any two frames at the same time and drags them in the direction of the baseline, thereby chronologically among the two frames. This allows you to insert a movie clip into the timeline with the preceding frame as the start position and the later frame as the end position in chronological order.

The position on the timeline to insert the video clip may be determined from the position on the reference line where the drag ends.

When the video clip is added to the timeline through this process, in the icon display step, the mobile 1 displays the icon representing the video clip along the reference line (step d).

In this case, the icon does not necessarily need to be displayed so as to overlap the reference line, and may be displayed at a position spaced apart from the reference line by a predetermined distance.

In the icon display step, as the video clip to be added to the timeline is selected by the user, coordinates on the timeline to display the selected video clip are determined.

In this case, when the reference line is displayed in a straight line as shown in FIG. 1, it is sufficient to determine only the horizontal axis coordinates to be displayed on the timeline, but in the vertical mode as shown in FIG. Coordinates and vertical axis coordinates should be determined simultaneously.

To this end, first, when a user inserts a corresponding video clip into a timeline, the mobile 1 selects a position to display an icon representing the video clip based on a position on a reference line corresponding to a position on a timeline into which the video clip is inserted. Decide Then, the icon is displayed at the determined position.

The expression that determines the position to display the icon representing the movie clip based on the position on the reference line may not necessarily display the icon on the reference line, and at least displays the icon at a relative position within a predetermined distance from the position on the reference line. I mean.

Through this process, the user can freely arrange the video clip on the timeline with a simple operation in the vertical mode as shown in FIG.

Meanwhile, when a new video clip is further inserted into the timeline by the user, the mobile 1 may add the inserted video clip to the position immediately after the last video clip among the video clips previously added to the timeline. That is, if the user does not set or change the position on the timeline of the selected movie clip, it can be added to the end by default.

FIG. 5 illustrates a process in which a new icon is further displayed at the back of icons previously displayed along the reference line as the new video clip is inserted at the end of the timeline.

In this case, preferably, the icon newly displayed along the reference line has a different vertical coordinate from the previous icon.

Meanwhile, as the movie clip is added to the timeline in step d), after displaying the icon of the movie clip along the baseline, the user moves the position of the movie clip on the timeline or between the existing clips. When the operation is performed such as adding to or deleting a video clip that has already been added to the timeline, the mobile device 1 rearranges the icons displayed along the reference line through the icon rearrangement step (step e).

In the following, the process of repositioning icons along a baseline by the mobile 1 in a user's editing process for video clips added to a timeline will be described for each embodiment.

[First Embodiment]

The first embodiment is a process in which a plurality of icons displayed along a baseline are rearranged as the user deletes any one of a plurality of video clips added on the timeline through the GUI for portrait mode shown in FIG. Explain.

FIG. 6 is a diagram illustrating a state in which icons remaining along a reference line are rearranged as one of previously displayed icons is deleted.

After step d), if the user selects and deletes one of a plurality of icons displayed along the baseline,

The mobile 1 deletes the corresponding video clip on the timeline, and changes the positions of the icons displayed on the right side of the deleted icon to the positions where adjacent icons on the left side are displayed (step e).

That is, the icons on the left side of the deleted icon are left as they are, while the icons on the right side are moved left by one space. In this case, as shown in FIG. 6, the icons on the right side of which the position is changed may be displayed by processing an animation of moving the cells one by one to the left by riding a reference line having a sinusoidal shape.

By moving the icons one by one along the shape of the reference line, the user can feel that the sinusoidal reference line means the timeline.

On the other hand, the above description assumes that the timeline proceeds from the left side to the right side of the screen.

Second Embodiment

In the second embodiment, as the user selects a new video clip through the GUI for portrait mode shown in FIG. 3A and adds it between the video clips on the existing timeline, icons are rearranged along a baseline. Explain.

FIG. 7 is a view for explaining how icons are rearranged as icons are added between previously displayed icons.

After step d), as the user selects a video clip to insert in the timeline and drags it between a plurality of icons displayed along the baseline, the mobile 1 adjusts the position of the video clips on the timeline.

That is, the position on the timeline of the movie clips after the position at which the new movie clip is inserted is pushed back by the playing time of the newly inserted movie clip.

On the GUI as shown in FIG. 7, an icon representing the inserted video clip is newly displayed at the position where the video clip is inserted, and the icons on the right side of the inserted position are pushed to the right by one space (step e).

Preferably, the icons to the right of the inserted position are processed one by one by riding a sinusoidal reference line as shown in FIG. 7 so as to intuitively recognize that the reference line means a timeline.

Third Embodiment

According to the third embodiment, as the user simultaneously touches and then drags two or more of the plurality of icons arranged along the reference line through the portrait mode GUI shown in FIG. Explain the process of changing the location.

8 is a diagram illustrating an operation of changing a relative position of some of the previously displayed icons.

After step d), if the user touches any two (or more) simultaneously displayed along the reference line and then drags to one side of the reference line, the mobile 1 selects the two icons and the two selected ones. The relative positions of the icons between the two icons are moved along the reference line (step e).

That is, the positions of the icons are moved by the length dragged by the user.

Preferably, by displaying an animation in which icons move along the baseline as the user drags, the user can intuitively know that the baseline means the timeline.

Meanwhile, as the positions of the icons on the reference line are changed, the mobile 1 rearranges the positions on the timeline of the video clips represented by the icons so as to match the positions of the changed icons.

This allows the user to change the position of the video clips on the timeline by simply touching and then dragging two or more icons through the portrait mode GUI as shown in FIG. 8.

[Example 4]

In the fourth embodiment, a process of moving a reference line and icons on a screen is performed as a user simultaneously touches and drags a plurality of icons arranged along a reference line to one side of the screen through the GUI for portrait mode shown in FIG. Explain.

After the step d), when the user touches and drags any two points of the icon or the space between the icons previously displayed along the reference line to one side of the reference line, the mobile 1 connects to the reference line and the reference line. All displayed icons are simultaneously displayed in the dragging direction (step e).

Preferably, as the user touches and then touches the touch screen, the animation displayed on the reference line and the reference line is processed and displayed in one direction.

When the timeline is long enough to be displayed on the screen, the user can select or rotate an area to be edited on the timeline by simply dragging while viewing the portrait GUI as shown in FIG. 9.

Meanwhile, the method for providing a user interface for editing a video according to the present invention may be implemented in the form of software, which is a set of computer readable instructions, and may be recorded on a recording medium.

In this case, the recording medium may include all types of media that can be read by a computer, and examples thereof include DVD-ROM, CD-ROM, hard disk, USB memory, and flash memory.

On the other hand, the expression contained in the recording medium includes the case of being recorded on this type of recording medium, as well as the case provided through the communication line in the form of an intangible carrier wave (Carrier Wave).

Although the present invention has been described with reference to the accompanying drawings and the above embodiments, these are merely exemplary and will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. .

The present invention can be applied to the video editing technology field and the mobile software technology field.

Claims

In a mobile device having a touch screen,

Direction detecting means for detecting a horizontal turning event in the touch screen display direction;

A clip for displaying a clip selection user interface for selecting and inserting at least a portion of a video file into a timeline on one side of the touch screen, and adding a video clip corresponding to at least a portion of the video file selected by the user on the timeline; Selecting user interface providing means;

Reference line display means for displaying a reference line on the other side of the touch screen; And

And icon display means for displaying icons representing a video clip added to a timeline on one side of the touch screen along the reference line.

When the screen display direction of the touch screen changes from the horizontal direction to the vertical direction, the clip selection user interface providing means dynamically changes the size of the clip selection user interface and rotates it in the vertical direction to one side of the screen. The reference line display means may be displayed on the other side of the screen by transforming the reference line, which is displayed in a straight line, along a horizontal axis to a shape in which the vertical axis coordinates increase or decrease based on one or more inflection points. Determine the position of each icon based on the reference line according to the position on the timeline of the movie clip that

As the screen display direction of the touch screen is changed in the vertical direction, as the user inputs a touch screen with respect to one or more icons displayed along a reference line, the icon display means corresponds to the user's touch screen input. A device for providing a user interface for editing a video that is rearranged along a baseline but processes an editing operation on a timeline for a video clip represented by the icon.
In a method executed in a video editing apparatus having display means,

b) As the screen display direction is changed from landscape to portrait, a clip selection user interface for selecting at least a portion of the video file and inserting it into the timeline is displayed on one side of the screen of the display means, and the baseline is displayed on the other side of the screen. A baseline display step of displaying;

c) a timeline insertion step of adding a video clip corresponding to at least a portion of a video file selected by a user on a timeline according to a user manipulation through the clip selection user interface;

and d) displaying an icon representing a video clip inserted in the timeline along the reference line.

In step b), the reference line extends along the horizontal axis and has a shape in which the vertical axis coordinates increase or decrease based on one or more inflection points,

As the video clip is inserted in the timeline, in step d), the video editing is performed by determining the horizontal and vertical positions on the screen where the icon is to be displayed based on the reference line according to the position of the video clip. To provide a user interface.
The method of claim 2,

a) a display direction detecting step of detecting whether the screen display direction of the display means is horizontal or vertical;

In the step b), as the screen display direction is changed from the horizontal direction to the vertical direction, the position and size of the existing clip selection user interface are changed and displayed on one side of the rotated clip selection user interface screen. A method of providing a user interface for editing a video, which is displayed along a horizontal axis of the displayed reference line and is deformed on the other side of the screen in a shape in which the vertical axis coordinates increase or decrease based on one or more inflection points.
The method of claim 2,

In step b), a reference line having a sinusoidal shape connecting the inflection points existing at predetermined distances in a horizontal direction is displayed.

In the step d), at least one of the icon representing the video clip on the inflection point providing a user interface for video editing.
The method of claim 2,

In the step c), as the user simultaneously selects any two frames among the plurality of frames displayed in the clip selection user interface and drags them in the direction of the reference line, the frames preceding the time in the selected two frames are set as starting positions. And a method for providing a user interface for editing a video, which inserts a video clip whose end position is chronologically late in the timeline.
The method of claim 2,

After step d),

e) As the user adds a video clip to the timeline, an icon representing the added video clip is further displayed along the reference line, and a predetermined distance is directed to the right from the icon on the right side among the icons previously displayed along the reference line. Reordering the icon to display in the spaced position; further comprising,

A method for providing a user interface for editing a video for displaying the added video clip and the icon on the far right among the previously displayed icons having different vertical coordinates.
The method of claim 2,

After step d),

e) icon rearranging step of moving and displaying positions of all icons displayed on the right side of the deleted icon by a predetermined distance as the user selects and deletes any one of the plurality of icons;

A method of providing a user interface for editing a video for displaying an animation in which each icon moved a predetermined distance in the step e) moves along the reference line.
The method of claim 2,

After step d),

e) As the user drags the selected video clip between the plurality of icons displayed along the baseline, an icon representing the dragged video clip is displayed along the baseline around the position where the drag ends, and at the point where the drag ends. Icon rearranging step of displaying by moving all the icons on the right to the right by a predetermined distance;

The method of providing a user interface for video editing to display on the screen an animation in which each icon moved to the right in the step e) moves along the reference line.
The method of claim 2,

After step d),

e) When a user simultaneously selects any two icons among icons previously displayed along the reference line and drags them to one side of the reference line, the relative positions of the icons between the two selected icons and the two icons are displayed. Reordering the icon to move along the reference line; providing a user interface for editing a video.
The method of claim 2,

After step d),

e) When the user touches any two points among the icons or spaces between the icons previously displayed along the reference line and drags them to one side of the reference line, simultaneously dragging the icons displayed on the reference line and the reference line. Reordering the icon to move in the direction to display; providing a user interface for editing a video.
a) a display direction detecting step of detecting whether the screen display direction of the display means is horizontal or vertical;

b) the screen selection direction of the display means is changed from landscape to portrait, so that at least a portion of the video file is selected and a clip selection user interface for inserting a video clip corresponding to at least a portion of the selected video file into the timeline is displayed. A baseline display step of dynamically changing from a mode to a portrait mode and displaying on the screen, extending along the horizontal axis on the other side of the screen, and deforming on the other side of the screen in a shape in which the vertical axis coordinates are increased or decreased based on one or more inflection points;

c) a timeline insertion step of adding a video clip corresponding to at least a portion of a video file selected by a user on a timeline according to a user manipulation through the clip selection user interface;

d) displaying an icon representing a video clip inserted in the timeline along the reference line;

e) rearranging icons along the baseline of icons representing movie clips in the timeline as the user adds more movie clips to the timeline, deletes existing movie clips, or changes positions on the timeline; A computer-readable recording medium having computer-executable instructions for performing a method comprising a.