WO2015020497A1

WO2015020497A1 - Method for processing video editing user interface running on mobile device having touch screen, mobile device and recording medium

Info

Publication number: WO2015020497A1
Application number: PCT/KR2014/007412
Authority: WO
Inventors: 정춘선; 김경중; 김종득
Original assignee: 넥스트리밍(주)
Priority date: 2013-08-09
Filing date: 2014-08-08
Publication date: 2015-02-12
Also published as: KR101399234B1

Abstract

Disclosed is a method for processing a video editing user interface running on a mobile device having a touch screen. In accordance with the present invention, a frame is acquired at every predetermined frame acquisition interval from some sections of a video selected by a user and is then displayed in a first user interface region. Thereafter, when the user drags any two frames among a number of frames being displayed to a second user interface region on the other side of a screen, a video clip that corresponds to a section between the two selected frames is generated and is then inserted into a position on a timeline corresponding to the point at which the drag has terminated. Meanwhile, when the user simultaneously touches two points on the first user interface and then drags the two contact points away from or close to each other, the frame acquisition interval is dynamically reset, a frame is re-acquired from the video, and the above processes is then repeated.

Description

Method of processing video editing user interface running on mobile device with touch screen, mobile device and recording medium

The present invention relates to a Graphic User Interface (GUI) of video editing software executed on a mobile.

In the past, video editing required very professional skills and expensive equipment.

However, with the rapid development of computing technology and the emergence of various platforms that allow general users to create, distribute, or share their contents, general users have recently been able to easily shoot and edit videos.

As demand for video editing tools grew, a variety of authoring tools were produced and distributed, ranging from video editing packages for professionals to video editing software for light users with simple editing features.

1 is a view for explaining a general user interface of such a video editing software for a personal computer (PC).

In the meantime, in the video editing process, video files are loaded into a memory and a part of the video is selected to insert a video clip corresponding to the selected part in the timeline.

In this way, after inserting a plurality of video clips in the timeline, an appropriate effect or background sound is inserted, and subtitles are added.

Then, when rendering is performed to obtain the final result, the video editing software generates the final video edit result by rendering each video clip arranged in the timeline in chronological order.

Meanwhile, in order to edit a video smoothly, a user should select exactly as he wants from a video file and insert it into a timeline as a video clip. Known video editing software provides several user interfaces for this purpose.

These user interfaces are implemented to allow the user to accurately select the portion to be edited from the video file and easily select the desired length.

For example, as shown in FIG. 1, a part of the video file may be selected by loading a video file into a memory and then setting a start position and an end position in seconds.

In addition, an instance corresponding to the selected portion may be created and inserted into an appropriate position of the timeline by dragging it with a mouse.

On the other hand, regardless of which user interface is provided in the video editing software due to the nature of the video editing process itself, since a large amount of information must be simultaneously displayed on the edit screen, it is helpful to use a high-resolution monitor as much as possible.

Sometimes you can connect two or more high-definition monitors and use them as dual monitors, displaying a lot of information for editing a video.

On the other hand, the hot topic in the recent software technology field can be said to be mobile computing using a smartphone.

Video editing software is no exception, and video editing software for smartphones running on smartphones is being developed and distributed one after another.

By the way, mobile devices such as smartphones or tablet computers have a rather small screen size of only 3 or 4 inches up to 10 inches, which is inherently disadvantageous for video editing. can do.

Accordingly, there is an urgent need to develop a user interface for video editing software optimized for mobile.

In particular, there is a need to display video data on a relatively small screen of a mobile device, and to select a portion of the video data at a desired position accurately.

However, in order to apply the user interface of the known video editing software for PC as it is, the size of the screen is small and the information that can be displayed is very limited, and since it is necessary to operate by touching the touch screen using a finger rather than a mouse. There is a problem that detailed operation is difficult.

(Patent Literature 1) Literature 1. Korean Intellectual Property Office, Patent Publication No. 10-2009-0058305 "Video recording editing apparatus and method"

(Patent Document 2) Document 2. Korean Intellectual Property Office, Patent Registration No. 10-0860510 "Generating a slide show with visual effects inserted into a mobile device"

(Non-Patent Literature 1) Literature 3. Choi, Young-Young, Choi, Study on Mobile Video Editing Techniques in the Smartphone Market, Journal of the Korea Contents Association 10 (5) 115-123 1738-6764 KCI, 2010

The present invention was developed to solve the problems of the prior art as described above, a mobile video editing software for selecting a portion of the video to create a video clip and insert it on the timeline with only simple and intuitive operation. The purpose is to present a user interface.

Another object of the present invention is to display a plurality of frames to visually know the contents of the video on a relatively narrow screen, and to generate a video clip by selecting some of them, but it is simple and An intuitive operation is to provide a user interface for dynamically adjusting the time interval of frames.

In order to achieve the above object, an apparatus for providing a video editing user interface according to the present invention includes: user interface processing means for displaying a first user interface on one side of a touch screen and a second user interface on the other side of the screen;

Frame acquiring means for acquiring frames to be displayed on the first user interface using a predetermined frame acquiring interval from the moving image data selected by the user;

Frame interval adjusting means for setting a frame acquisition interval by a user operation; And

And rendering means for generating a moving picture file including the moving picture clips by rendering moving picture clips arranged in a second user interface.

In this case, the user interface processing means displays the frames acquired by the frame obtaining means on the first user interface, and the user touches and drags any two frames displayed on the first user interface in the direction of the second user interface. Accordingly, a video clip is generated from the position of the video corresponding to the frame leading in time order among the two selected frames to the position of the video corresponding to the later frame.

And, the icons representing this are arranged in the second user interface, that is, the timeline.

Meanwhile, the frame interval adjusting means changes the frame acquisition interval in real time as the user touches any two points on the first user interface and then narrows or increases the distance between the two contact points while maintaining the contact state.

The frame acquiring means re-acquires frames by using the frame acquiring interval changed from the video data when the frame acquiring interval is changed in real time.

The user interface processing means then updates the obtained frames by displaying them on the first user interface.

Meanwhile, in order to achieve the above object, a method for providing a video editing user interface according to the present invention includes: a) acquiring a frame at a predetermined frame acquisition interval from a portion of video data;

b) displaying at least a portion of the obtained plurality of frames on a first user interface region shown on one side of a screen of the touch screen;

c) Any two frames among the plurality of frames displayed in the chronological order by the user are selected and dragged toward the second user interface region on the other side of the touch screen, so that the video corresponding to the frames preceding the chronological order among the two selected frames is displayed. Create a movie clip with the location as the starting point, but with the ending point as the location of the movie corresponding to the later frames in chronological order, and place the created movie clip at the location on the timeline that corresponds to the location where the dragging of the second user interface area ends. Inserting;

d) changing the frame acquisition interval in real time as the user narrows or increases the distance between the two contact points while simultaneously touching the first user interface area and maintains the contact state, and branches to step a); And

e) rendering the video clips arranged in the timeline according to the timeline order.

According to the present invention, with a plurality of frames obtained from a video displayed in chronological order on one side of the screen, the user touches any two of them and then drags the two selected frames simply by dragging in the direction of the timeline. You can easily create a series of edits by creating a movie clip with start and end points and inserting the created movie clip into the timeline.

In addition, it is possible to change the interval of acquiring frames from the video by simultaneously touching any two points within the touch screen area where a plurality of frames are displayed and then opening or closing the gap therebetween. When a plurality of newly acquired frames are displayed again on one side of the screen, a video clip can be selected and created exactly as desired and desired length by selecting and dragging two random frames among them.

1 is a view for explaining the user interface configuration of the conventional video editing software,

2 is a diagram illustrating a user interface of mobile video editing software according to the present invention.

3 is a view for explaining the configuration of a video editing user interface providing apparatus using a touch screen gesture input according to the present invention;

4 is a diagram illustrating a process of generating a video clip and inserting it into a timeline through a touch screen gesture input.

5 is a flowchart illustrating a method of providing a video editing user interface using a touch screen gesture input in a time series.

6 is a diagram illustrating a process of adjusting a frame interval in real time through a touch screen gesture input.

A mobile device having a touch screen, comprising: user interface processing means for displaying a first user interface on one side of a touch screen and a second user interface on the other side of the screen; Frame acquiring means for acquiring frames to be displayed on the first user interface using a predetermined frame acquiring interval from the moving image data selected by the user; Frame interval adjusting means for setting a frame acquisition interval by a user operation; And rendering means for generating a video file including the video clips by rendering the video clips arranged in a second user interface.

The user interface processing means displays the frames acquired by the frame acquiring means on a first user interface, and as the user touches and drags any two frames displayed on the first user interface toward the second user interface, Among the two selected frames, a video clip is generated from the position of the video corresponding to the frame leading in chronological order to the position of the video corresponding to the later frame, and the icons representing the same are arranged in the second user interface. The user touches any two points on the first user interface and then changes the frame acquisition interval in real time as the interval between the two contact points is narrowed or increased while maintaining the contact state, and the frame acquiring means obtains the frame acquisition interval. In the real-time change of the frame, the frames are re-obtained using the changed frame acquisition interval from the video data, and the user interface processing means displays the updated frames on the first user interface and updates the frames.

A video editing user interface processing method executed in a mobile device having a touch screen, comprising: a) a frame obtaining step of obtaining a frame at predetermined frame acquisition intervals from the moving image data; b) displaying at least a portion of the obtained plurality of frames in chronological order along one side of the screen of the touch screen; c) As a user selects any two frames among the plurality of frames displayed in the chronological order, the position of the video corresponding to the preceding frame in chronological order among the selected two frames is a starting point, and the video corresponding to the later frames in chronological order. A clip selecting step of generating a moving clip having the position of the end point; And d) an acquisition interval adjusting step of changing the frame acquisition interval in real time by the mobile as the user touches two points on the touch screen at the same time and then maintains the contact state and decreases or increases the interval between the two contact points. Including,

In step d), as the frame acquisition interval is changed in real time, the frame is acquired again according to the changed frame acquisition interval, and at least some of the plurality of acquired frames are updated in real time by displaying in chronological order along one side of the screen. It is characterized by.

In the step c), as the user touches any two frames and then drags them to the other side of the screen, the mobile inserts the generated video clip at the timeline position corresponding to the coordinate where the drag ends. .

After the step d), e) further comprises a rendering step of rendering the video clips inserted in the timeline in the timeline order.

In step d), if the user touches any two points on the touch screen area where the plurality of frames are displayed and drags the two contact points apart, the frame acquisition interval is widened.

When the two contact points are dragged to be narrowed, the frame acquisition interval is narrowed and then branched to the frame acquisition step.

In step d), when the user drags the two contact points apart from each other, the newly acquired frames are displayed in both directions about a frame adjacent to the center coordinates of the first contact point of the two contact points.

In step d), as the user drags the two contact points apart from each other, an animation is displayed in which the frames move away in both directions about a center coordinate of the first contact point of the two contact points, and then the newly acquired frames are displayed. Characterized in that.

In step d), when the user drags so that the distance between the two contact points becomes narrow, the newly acquired frames are displayed in both directions about a frame adjacent to the center coordinates of the last contact positions of the two contact points.

In step d), as the user drags the gap between the two contact points to be narrowed, an animation is displayed in which the frames on both sides move closer in the direction of the center coordinate of the last contact point of the two contact points, and then newly acquired frames are displayed. It is characterized by displaying.

A computer-readable recording medium having a program code, comprising: a) obtaining a frame at predetermined frame acquisition intervals from a partial section of moving image data; b) displaying at least a portion of the obtained plurality of frames on a first user interface region shown on one side of a screen of the touch screen; c) Any two frames among the frames displayed in the first user interface area are selected by the user and dragged toward the second user interface area on the other side of the touch screen, corresponding to the frames preceding the time in the selected two frames. Creates a movie clip with the start point of the movie as the starting point and the ending point of the movie corresponding to the late frames in chronological order, and the generated movie clip on the timeline corresponding to the position where the dragging of the second user interface area ends. Inserting in position; And d) changing the frame acquisition interval in real time as the user narrows or increases the distance between the two contact points while simultaneously touching the first user interface area and maintains a contact state, and branches to step a). Characterized in that it comprises a.

Hereinafter, with reference to the preferred embodiments of the present invention and the accompanying drawings will be described in detail, the same reference numerals in the drawings will be described on the assumption that the same components.

When any one element in the description or claims of the invention "includes" another element, unless otherwise stated, it is not limited to consisting only of that element, and other elements are not interpreted. It should be understood that it may include more.

Further, in the detailed description of the invention or in the claims, the elements designated as "~ means", "~ part", "~ module", and "~ block" mean a unit that processes at least one function or operation, Each of these may be implemented by software or hardware, or a combination thereof.

Before describing the configuration of the present invention in earnest, terms used in the present invention are defined as follows.

The timeline literally means the time base. When authoring a video using video editing software, the user arranges a number of video clips along the timeline, sets effects on each of the arranged video clips, and then renders the resulting video file.

In other words, the timeline means a time position occupied by each video clip in the video file that is rendered as the final result. For example, the video clip may be used at a location on a timeline corresponding to a section “1 minute 10 seconds to 1 minute 30 seconds”.

Meanwhile, a video clip refers to a piece or a portion of a video that is split into pieces for authoring a video edit.

The user can insert a locally stored movie file as a whole into the timeline, or select a portion of the movie file to insert into the timeline, in which case they are part of the output of the final rendered movie file, arranged on the timeline. It may be referred to as a video clip in that it is configured.

As shown in FIG. 2, the first user interface 11 is displayed at the top of the screen.

The first user interface 11 displays various scenes of the video in time series.

The first user interface 11 displays a plurality of frames in chronological order. Each frame visually displays the scenes of the video.

The user may generate a video clip by selecting a desired portion of the entire video through the first user interface 11.

On the other hand, it can be seen that the second user interface 12 is displayed at the bottom of the screen.

The second user interface 12 visually represents the timeline.

The user can place multiple movie clips at appropriate locations on the second user interface 12.

In the lower part of FIG. 2, a second user interface 12 having a shape extended to the left and right is shown, and an icon of a video clip is displayed thereon.

In the lower part of FIG. 2, four rectangles written as "1", "2", "3", and "4" can be seen, respectively, and represent each movie clip generated and disposed on the second user interface 12. Corresponds to the icon.

The position at which the icon of the movie clip is displayed corresponds to the position on the timeline of the movie to be edited.

The present invention presupposes the user interface configuration of the video editing software for mobile as shown in FIG.

In particular, on the premise of a user interface of mobile video editing software having such a configuration, a user interface is further proposed to generate a video clip by accurately selecting a part of the video by simple operation.

Apparatus for providing a video editing user interface using a touch screen gesture input according to the present invention (hereinafter referred to as "video editing user interface providing apparatus") is to provide such a user interface, which is software executed in the mobile 1, It may be implemented in the form of firmware.

3 is a view for explaining the configuration of a video editing user interface providing apparatus according to the present invention.

As shown in FIG. 3, the apparatus 100 for providing a video editing user interface according to the present invention includes a user interface processing unit 110, a frame obtaining unit 120, a frame interval adjusting unit 130, and a rendering unit ( 140).

As illustrated in FIG. 2, the user interface processing unit 110 displays a first user interface 11 displaying a plurality of frames obtained from a video in chronological order and a second user interface 12 corresponding to a timeline. Mark each on.

On the other hand, when the user selects a video file stored locally on the mobile 1, or shoots a video using the camera module built in the mobile 1, the frame obtaining means 120 is a predetermined from such video data. A plurality of frames are obtained using the frame acquisition interval.

For example, if the frame acquisition interval is set to "10 seconds", the frame obtaining unit 120 may obtain a plurality of frames by decoding the video and generating a still image at 10 second intervals. Alternatively, the nearest key frame may be obtained every 10 seconds.

The frame acquisition interval is not necessarily limited to the time interval, but may be set as, for example, "every fifth keyframe". In such a case, the frame acquiring means 120 may acquire one for every five key frames.

On the other hand, the frames may be preferably obtained in the form of thumbnails (Thumbnail).

The user interface processing means 110 displays the plurality of frames thus obtained on the first user interface 11 in chronological order.

Referring to the example of the first user interface 11 shown at the top of FIG. 2, thumbnails of frames may be displayed in chronological order from left to right.

That is, the scenes of the partial sections of the video are displayed in chronological order through the first user interface 11.

The user may check various scenes of the video at a glance through the first user interface 11.

In this state, by simultaneously touching any two of the plurality of frames displayed on the first user interface 11 and dragging them toward the second user interface 12, the creation of the movie clip and the movie clip to the timeline In addition, two editing operations can be performed simply.

As shown in FIG. 4A, the user touches any two of the frames shown in the first user interface 11, and then drags to a specific position of the second user interface 12 and then touches. Releasing the finger from the touch screen screen, the user interface processing means 110 moves a video clip corresponding to a position corresponding to a later frame from a position corresponding to a frame preceding the time frame among the two frames. Create

Then, the generated video clip is inserted at a position on the timeline corresponding to the coordinate on the second user interface 12 where the user lifts a finger and displays an icon of the video clip.

It can be seen at the bottom of FIG. 4B that a rectangle written as “1” is displayed on the second user interface 12, which corresponds to an icon of an inserted video clip.

In this case, the frame touched and dragged by the user is not necessarily included in the video clip, and according to an algorithm for extracting a part of the video, the video clip is based on a keyframe immediately before or after the frame touched and dragged by the user. You can also create

A detailed algorithm related to this has been disclosed through Korean Patent Application No. 10-2012-0124330 of the applicant, and is not dealt with in the present invention.

On the other hand, due to the limitation of the physical screen size of the first user interface 11, the number of frames that can be displayed on one screen is extremely limited, and the user can move back and forth the timeline itself of the second user interface 12. By dragging or dragging a separate progress bar not shown, frames corresponding to other scenes before and after may be rotated.

However, if the section of the video file to be selected as the video clip is rather long, the frames corresponding to the first scene and the last scene of the section desired by the user will not be simultaneously displayed on the first user interface 11.

In this case, the user may widen the time interval of the frames displayed on the first user interface 11 by touching and spreading any two points of the first user interface 11 to both sides.

Alternatively, the time interval of the frames displayed on the first user interface 11 may be narrowed by touching two points of the first user interface 11 and then narrowing them toward the center.

In this way, when the user touches any two points of the first user interface 11 and then expands or narrows the coordinates of the two contact points, that is, the two points at which the touch is made, the frame interval adjusting means 130 may obtain a frame acquisition interval. Changes dynamically.

Accordingly, the frame acquiring means 120 newly acquires frames from the video using the dynamically changed frame acquiring interval.

As the frames are newly acquired, the user interface processing means 110 updates the obtained new frames by displaying them on the first user interface 11.

Through this process, the user can create a video clip of the desired length from the video scene by the user through a simple operation process.

In addition, the generated video clip may be arranged on the timeline of the second user interface 12 with a simple operation.

By dragging a plurality of video clips arranged on the timeline, it is possible to simply change the relationship between the video clips and the position on the timeline.

On the other hand, after arranging video clips to be edited as described above and setting transition effects, background sounds, subtitles, etc., the user can obtain the final video edit result through a rendering process as in the conventional video editing software.

The rendering means 140 generates a video file which is the final edited product including the video clips by rendering the video clips arranged in the second user interface 12.

Various effects, background sounds, and subtitles are applied during the rendering process.

Hereinafter, a video editing user interface providing method using a touch screen gesture input according to the present invention will be described with reference to FIGS. 4 to 6.

FIG. 5 is a flowchart illustrating a method of providing a video editing user interface using a touch screen gesture input in time series, and FIG. 6 is a diagram illustrating a process of adjusting a frame interval in real time through a touch screen gesture input.

5 illustrates a process of providing a user interface as shown in FIGS. 4 and 6 by a mobile 1 having a touch screen while a video editing app is executed.

As shown in Fig. 5, the present invention provides a frame acquisition step (step a), a frame display step (b step), a clip selection step (c step), an acquisition interval adjustment step (d step), and a rendering step (e). Step).

In the frame acquiring step, as the user selects the video data, the mobile 1 acquires a frame at a predetermined frame acquisition interval from the video data (step a).

The frame is preferably obtained in the form of a thumbnail.

In this case, the frames may not necessarily be acquired at regular intervals with respect to the entire video data, and the frames may be acquired only as much as the portions to be displayed on the first user interface 11.

After acquiring the frame in this way, in the frame display step, at least a part of the obtained plurality of frames is displayed on the first user interface 11.

In this case, the display is preferably performed in one direction in the region of the first user interface 11 in chronological order.

For example, frames leading in chronological order may be displayed on the first user interface 11 as shown in FIG. 2.

In this case, the frames displayed on the first user interface 11 may be frames obtained from a portion of the video, and when a user wants to check a frame of another portion, the user manipulates the progress bar by dragging the progress bar. can do.

In this case, the mobile 1 may dynamically acquire and display the corresponding portion of the video on the first user interface 11.

Meanwhile, as the user selects any two frames while the plurality of frames are displayed on the first user interface 11 as described above, the clip selection step corresponds to the preceding frame in chronological order among the two frames selected by the user. A moving clip is created by using the position of the moving image as a starting point and using the ending position of the moving image corresponding to a late frame in chronological order.

In this case, it is referred to as the creation of a movie clip, but it does not necessarily mean creating an instance corresponding to a selected portion from the movie and storing it as independent data, and relates to the start position and end position of the selected region in the presence of the original movie data. You can also treat it as generating information.

Meanwhile, in order to generate a movie clip, the user selects one of the plurality of frames displayed on the first user interface 11 corresponding to the start point and the end point, respectively, and then selects the movie clip function by selecting a movie clip function. You can also create

However, the mobile 1 can display any two frames shown in the first user interface 11 as shown in FIG. 4 so that the video clip can be selected and created through a touch screen operation in a more intuitive and simple manner. Touch and then drag to the lower second user interface 12 to create a video clip, and automatically place the created video clip on the timeline.

Specifically, as the user's dragging operation on the two frames leaves the area of the first user interface 11, the mobile 1 creates a video clip corresponding to the section between the two frames, and the user's dragging. When is terminated on the second user interface 12, the video clip is inserted on the timeline corresponding to the position on the second user interface 12 where the drag is terminated.

A four-step editing process by selecting the start position of the movie clip / then the end position of the movie clip / by pressing the Create button of the movie clip / and dragging the created movie clip onto the timeline This is completed by the drag operation after only one multi-touch.

However, in order for this process to be completed by one touch screen operation, the frames corresponding to the start position and the end position that the user wants to select in the first user interface 11 should be simultaneously displayed.

However, due to the limited size of the first user interface 11, it is difficult to display a large number of frames simultaneously.

In particular, it may be difficult to include both the frame corresponding to the time position and the frame corresponding to the end position on the first user interface 11 because the time difference between the start position and the end position to be selected is large.

In this case, the user touches two points on the first user interface 11 with two fingers, for example, a thumb and an index finger, and then drags the fingers apart.

For example, as shown in (a) of FIG. 6, two adjacent frames may be simultaneously touched and then dragged left and right in a feeling of spreading the distance between the two frames.

FIG. 6A illustrates a case in which the user touches two points on the first user interface 11 and then performs a control operation of widening the distance between the two contact points.

If there is such a user's operation, the mobile 1 widens the frame acquisition interval in real time in the acquisition interval adjustment step (d step).

On the other hand, when a change event of the frame acquisition interval occurs, the mobile 1 branches to step a).

Then, the frame is acquired again according to the frame acquisition interval changed in step a).

In step b), the newly acquired frames are updated by displaying them on the first user interface 11.

Since the frame acquisition interval is wider, the time interval of the frames simultaneously displayed on the first user interface 11 is wider.

Nevertheless, if the desired frames are not all displayed on the first user interface 11, the user can repeatedly perform the same operation.

In this case, preferably, the physical interval between the frames as the user moves the finger apart to intuitively know that the time interval between the frames (that is, the time interval at which two frames are played in the video) has become wider. (I.e., the distance between frames on the screen) is animated to move away from each other.

In this case, when the user touches the first user interface area 11, the center coordinates of two touch points, that is, when the user touches the touch screen with two fingers attached, the frames are left and right centered on the coordinates between the two fingers. You can display away animations.

Thereafter, newly acquired frames may be displayed on the first user interface 11.

In this case, when the user touches the touch screen while attaching two fingers, the newly acquired frames around the frame are displayed while the frame adjacent to the coordinate between the two fingers is displayed on the first user interface 11 as possible. Display.

The reverse is also possible.

When the frames of the frames displayed on the first user interface 11 are too wide and the desired frames are omitted, the user may narrow the time intervals of the frames to manipulate the frames to appear on the first user interface 11.

To this end, the user may touch the two points on the first user interface 11 with two fingers apart and then drag them in such a way as to pinch them.

6B illustrates a case in which the user touches two points on the first user interface 11 and then performs a control operation of narrowing the distance between the two contact points.

If there is such a user's operation, the mobile 1 narrows the frame acquisition interval in real time in the acquisition interval adjustment step (d step).

Accordingly, a change event of the frame acquisition interval occurs, and the mobile 1 branches to step a).

The frame is reacquired according to the frame acquisition interval changed in step a), and the control unit proceeds to step b) to update the newly acquired frames by displaying them on the first user interface 11.

In this case, the time interval between the frames is not narrow, so that the user can intuitively know that the physical intervals between the frames are closer to each other during the user's finger-drag dragging operation.

At this time, when the user finishes the drag operation in the first user interface area 11 and releases the touch-that is, when the finger is lifted off the touch screen, the animations are gathered around the coordinates corresponding to the middle of the two touch points. I can display it.

In this case, when the user releases the touch, the newly acquired frames are displayed around the corresponding frame while keeping adjacent frames as possible in the intermediate coordinates of the two contact points.

Through this process, if a plurality of movie clips are arranged on the second user interface 12-that is, the user, the user performs editing such as setting transition effects or inserting a background sound and then rendering functions for obtaining the final result. Run

Accordingly, in the rendering step, the mobile 1 generates the final video edit result by rendering the video clips arranged in the second user interface 12 in the timeline order.

As the video editing result is generated, the mobile 1 may store it locally or automatically upload it to a social network service or cloud through a network according to a user's selection or setting.

As described above, each step of the method of providing a user interface for the mobile 1 to dynamically widen or narrow the time interval of frames for selecting a movie clip is a software that is a set of computer readable instructions. It can be implemented in the form of and recorded on the recording medium.

In this case, the recording medium may include all types of media that can be read by a computer, and examples thereof include DVD-ROM, CD-ROM, hard disk, USB memory, and flash memory.

On the other hand, the expression contained in the recording medium includes the case of being recorded on this type of recording medium, as well as the case provided through the communication line in the form of an intangible carrier wave (Carrier Wave).

On the other hand, the expression "mobile" in the above, but a smart phone and a tablet computer as an example, but not limited to any means equipped with a touch screen, a portable electronic device running video editing software. In other words, a well-known type such as a mobile communication terminal or a PDA may be a new type of device satisfying the above condition.

Although the present invention has been described with reference to the accompanying drawings and the above embodiments, these are merely exemplary and will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. .

The present invention can be applied to the mobile user interface technology.

Claims

In a mobile device having a touch screen,

User interface processing means for displaying a first user interface on one side of the touch screen screen and a second user interface on the other side of the screen;

Frame acquiring means for acquiring frames to be displayed on the first user interface using a predetermined frame acquiring interval from the moving image data selected by the user;

Frame interval adjusting means for setting a frame acquisition interval by a user operation; And

Rendering means for generating a video file comprising the video clips by rendering the video clips arranged in a second user interface;

The user interface processing means displays the frames acquired by the frame acquiring means on a first user interface, and as the user touches and drags any two frames displayed on the first user interface toward the second user interface, Create a video clip from the position of the movie corresponding to the frame leading in time chronologically to the position of the movie corresponding to the later frame among the two selected frames, arrange the icons representing the same in the second user interface,

The frame interval adjusting means changes the frame acquisition interval in real time as the user touches any two points on the first user interface and then reduces or increases the distance between the two contact points while maintaining the contact state.

The frame acquiring means re-acquires frames by using the frame acquiring interval changed from the video data when the frame acquiring interval is changed in real time.

The user interface processing means has a video editing user interface which displays and updates the obtained frames on the first user interface again.
In the video editing user interface processing method executed in a mobile device having a touch screen,

a) a frame obtaining step of obtaining a frame at predetermined frame acquisition intervals from the moving image data;

b) displaying at least a portion of the obtained plurality of frames in chronological order along one side of the screen of the touch screen;

c) As a user selects any two frames among the plurality of frames displayed in the chronological order, the position of the video corresponding to the preceding frame in chronological order among the selected two frames is a starting point, and the video corresponding to the later frames in chronological order. A clip selecting step of generating a moving clip having the position of the end point; And

d) an acquisition interval adjusting step of changing the frame acquisition interval in real time by the mobile as the user narrows or increases the interval between the two touch points while simultaneously touching two points on the touch screen while maintaining a contact state; But

In step d), as the frame acquisition interval is changed in real time, the frame is acquired again according to the changed frame acquisition interval, and at least some of the plurality of acquired frames are updated in real time by displaying in chronological order along one side of the screen. A video editing user interface processing method executed in a mobile device having a touch screen.
The method of claim 2,

In step c), as the user touches any two frames and then drags to the other side of the screen, the mobile has a touch screen for inserting the generated video clip at the timeline position corresponding to the coordinate where the drag ends. How to handle video editing user interface running on mobile device.
The method of claim 3, wherein

After step d),

e) a rendering step of rendering the video clips inserted in the timeline according to the timeline order. The video editing user interface processing method executed in a mobile device having a touch screen.
The method of claim 2,

In step d), if the user touches any two points on the touch screen area where the plurality of frames are displayed and drags the two contact points apart, the frame acquisition interval is widened.

And dragging such that the two contact points are narrowed to narrow the frame acquisition interval and then branch to a frame acquisition step.
The method of claim 5,

In step d), when the user drags the two contact points apart from each other, the mobile screen having the touch screen displaying newly acquired frames in both directions about a frame adjacent to the center coordinates of the first contact point of the two contact points. How to handle video editing user interface running on device.
The method of claim 6,

In step d), as the user drags the two contact points apart from each other, an animation is displayed in which the frames move away in both directions about a center coordinate of the first contact point of the two contact points, and then the newly acquired frames are displayed. A video editing user interface processing method executed in a mobile device having a touch screen.
The method of claim 5,

In the step d), when the user drags so that the distance between the two contact point is narrowed, the mobile having a touch screen displaying the newly acquired frames in both directions about the frame adjacent to the center coordinate of the last contact position of the two contact points How to handle video editing user interface running on device.
The method of claim 8,

In step d), as the user drags the gap between the two contact points to be narrowed, an animation is displayed in which the frames on both sides move closer in the direction of the center coordinate of the last contact point of the two contact points, and then newly acquired frames are displayed. A video editing user interface processing method executed in a mobile device having a touch screen to display.
A computer-readable recording medium having program code,

a) obtaining a frame at every predetermined frame acquisition interval from a partial section of the moving picture data;

b) displaying at least a portion of the obtained plurality of frames on a first user interface region shown on one side of a screen of the touch screen;

c) Any two frames among the frames displayed in the first user interface area are selected by the user and dragged toward the second user interface area on the other side of the touch screen, corresponding to the frames preceding the time in the selected two frames. Creates a movie clip with the start point of the movie as the starting point and the ending point of the movie corresponding to the late frames in chronological order, and the generated movie clip on the timeline corresponding to the position where the dragging of the second user interface area ends. Inserting in position; And

d) changing the frame acquisition interval in real time as the user narrows or increases the distance between the two contact points while simultaneously touching the first user interface area and maintains the contact state, and branches to step a); A computer-readable recording medium having program code for performing a video editing user interface processing method of a mobile device.