KR101352737B1 - Method of setting up effect on mobile movie authoring tool using effect configuring data and computer-readable meduim carring effect configuring data - Google Patents

Abstract

A data structure for effect settings of a video editing tool is disclosed. The data structure for effect settings of a video editing tool according to the present invention comprises: a type code for defining a range in which a texture code, an animated value code, and a drawing function are applied; the texture code for defining an object for which effects are rendered; the animated value code for defining a value varying according to the change of time during the effect rendering; and the drawing function for defining types and methods of effects, wherein the texture code sequentially includes a texture start tag, texture ID, property directives, a value, and a texture end tag, the animated value code sequentially includes an animated value start tag, animated value ID, one or more key frame values, and an animated value end tag, and the drawing function receives the pointer of the texture ID or the animated value ID as parameter. On the other end, the animated value code may additionally include a timing function tag for adjusting rate at which a key frame value varies from a start value to an end value by a cubic Bezier function, and parameters corresponding to the coordinates of two control points.

Description

TECHNICAL SETTING METHOD AND METHOD OF SETTING UP EFFECT ON MOBILE MOVIE AUTHORING TOOL USING EFFECT CONFIGURING DATA AND COMPUTER-READABLE MEDUIM CARRING EFFECT CONFIGURING DATA}

The present invention belongs to the field of mobile video editing software technology.

With the rapid development of computing hardware technology and the reorganization of the production and distribution structure of multimedia contents, users have recently been able to easily shoot and edit video.
In order to edit a video, video editing software is usually used. FIG. 1 illustrates a general user interface of such a video editing software for a personal computer (PC).
In the general video editing process, the user selects one of the locally stored files into the memory through a file selection window as shown on the left side of the screen of FIG. 1, and then selects a part of the video to correspond to the selected part. You will insert a movie clip into the timeline.
The timeline refers to a time sequence in which the edited result of the video is rendered, and is usually displayed on one side of the screen so as to visually know the direction of time.
The user arranges the clips in the desired position on the timeline.
A clip refers to a part of a movie temporarily created for editing.
After inserting a number of movie clips in the timeline like this, you can add subtitles, add special effects, or set a certain effect at the position where one clip ends and another clip starts. do.
These effects are commonly referred to as effects.
Then, when rendering is performed to obtain the final result, the video editing software generates the final video editing result by rendering each video clip arranged in the timeline in chronological order but rendering various effects set by the user.
As such, the process of editing a video includes arranging positions of a plurality of clips arranged in a timeline and setting various effects for each clip or between two or more clips. To ensure this, a large number of clips arranged on the timeline must be able to be displayed on one screen, and a large enough screen and an optimized user interface should be provided to allow for the fine selection and setting of effects.
Meanwhile, as smartphones are rapidly spreading worldwide, video editing software using mobiles is being released.
By the way, mobile devices such as smartphones or tablet computers only have slightly smaller screens, ranging from 3 to 4 inches up to 10 inches in size, so that a lot of information must be displayed on one screen. This is a very adverse environment inherently in editing.
2 illustrates a graphical user interface (GUI) of video editing software executed on a mobile developed by the applicant.
A user uses mobile to run video editing software and then create a new project. A project generally refers to an environment for editing a video.
As such, when a new project is started, the mobile displays a GUI of the video editing tool as shown in FIG. 1.
The video editing software for mobile as illustrated in FIG. 2 also includes a selection window and a timeline for selecting a video clip as in the PC environment as shown in FIG.
The user loads a locally stored video through the video clip selection window, selects all or part of the video, and drags the video to the timeline to arrange the video on the timeline.
On the other hand, after arranging the clips as described above, subtitles are added or various effects are set to one or more clips.
The process of obtaining the final video editing result by rendering is the same as the video editing software of the known PC environment.
However, complicated operations such as accurately selecting a specific section of a clip desired by the user using a narrow screen size of the mobile 1, selecting a desired effect in the selected section, and then setting various settings of the effect are not easy. .
Thus, unlike video editing software running in a PC environment, it is a very simple operation to simply select a "template of predefined effects" supported by video editing software for mobile 1 and select one or two clips to apply it. It is desirable to be able to finish the editing process by itself.
However, it is difficult for a video editing software developer for mobile 1 to supply an unlimited number of "templates of well-defined effects" to suit the tastes of many mobile 1 users.
Therefore, there is a need to create an environment so that end users or third party developers can simply and well define the template of the effect.

Document 1. Korea Patent Office, Registration No. 10-0386779 "Video Production and Playback System and Method in Wireless Internet Environment" Document 2. Korean Patent Office, Registration No. 10-0710674 "Video encoding method of a mobile terminal and a mobile terminal performing the method" Document 3. Korea Patent Office, Patent Publication No. 10-2006-0134557 "Video effect processing method and apparatus for mobile communication terminal" Document 4. Korea Patent Office, Patent Publication No. 10-2010-0070942 "storyboard based video production system" Document 5. Korean Intellectual Property Office, Korean Patent Publication No. 10-2009-0078198 "A system and method for processing video additional information based on script" Document 6. Korean Patent Office, Registered Patent No. 10-0771264 "Recording medium including a script file, reproducing apparatus and method thereof"

The present invention was developed to solve the above problems of the prior art, and proposes a structure of an effect template that can be installed and used easily in a mobile video editing software.
Furthermore, the mobile 1, which executes the video editing software, proposes a method of setting an effect using the structure of an effect template having such a structure.

In order to achieve the above object, the data structure for setting the effect of the video editing tool according to the present invention,
A type code defining a range to which the texture code, animated value code, and drawing function are applied;
Texture code defining what the effect is rendered to;

An animated value code that defines a value that changes over time when the effect is rendered;
Contains drawing functions that define the type and method of effects.
At this time, the texture code is a texture start tag; Texture ID; Attribute directive; value; And a texture end tag.
Meanwhile, the animated value tag may include an animated value start tag; Animated value ID; One or more keyframe value values; And an animated value end tag;
The drawing function receives a pointer to the texture ID or animated value ID as a function parameter.
On the other hand, the property directive of the texture code is one of video, image, and text.
When an attribute directive indicates a video, a pointer variable pointing to the clip that the user has dynamically selected for the texture ID is assigned that value.
When the attribute directive indicates an image, a pointer variable indicating an image file name or a user dynamically selected image is assigned to the texture ID as the value.
When an attribute directive indicates text, a pointer variable indicating text or text dynamically input by a user is assigned to the texture ID.
Meanwhile, if two texture IDs are included, each property directive is a video, and the drawing function receives a pointer to the two texture IDs.
The drawing function sets a transition effect applied between the start position of the clip by the texture ID having the second value and the end position of the clip on the timeline of the video editing tool indicated by the texture ID having the first value.
Meanwhile, when two key frame value values are included and the drawing function receives a pointer of the corresponding animated value ID,
The drawing function sets an effect such that the animated value ID changes from a state having a previous value among two key frame value values to a state having a later value as time passes.
A timing function tag may be further defined after the animated value start tag and before the animated value end tag, defining a Bezier function for adjusting a change rate of a value assigned to the animated value ID.
In this case, the timing function tag has four parameters corresponding to the coordinates of the control point of the Bezier function for adjusting the rate of change of the animated value.
The first parameter is the x coordinate of the first control point,
The second parameter is the y coordinate of the first control point,
The third parameter is the x coordinate of the second control point,
The fourth parameter points to the y coordinate of the second control point, respectively.

According to this invention,
Mobile end users or third-party developers of mobile video editing software will be able to set up templates for effects clearly and simply.
In particular, according to the structure of the plug-in provided by the present invention without the hassle of coding complex loops, it is possible to define an effect in which a visual change occurs over time by simply setting an animated value. .
In addition, by simply inputting the parameters of the timing function according to the structure of the plug-in provided by the present invention, it is possible to define a template of the effect so that the effect can be smoothly rendered without being interrupted during rendering of the effect.
Furthermore, the templates of the effects defined as described above can be easily distributed in the form of plug-ins of mobile video editing software, and mobile users can freely use them when editing videos by simply searching for and downloading the plug-ins necessary for them. do.

1 is a diagram illustrating a GUI of video editing software for a PC according to the prior art,
2 is a screen example illustrating a GUI of a video editing tool for mobile.
FIG. 3 is a diagram illustrating a relationship of uploading or downloading a plug-in for setting an effect to a theme server using mobile.
4 is a view for explaining the structure of the plug-in,
5 is a diagram conceptually illustrating that a plug-in is applied between a project, a clip, or two clips.
6 is a view for explaining an example of a cube Bezier function for implementing a timing function,
7 is a flowchart for explaining an effect setting method using a data structure for effect setting according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT Hereinafter, the present invention will be described in detail with reference to preferred embodiments of the present invention and the accompanying drawings, wherein like reference numerals refer to like elements.
It is to be understood that when an element is referred to as being "comprising" another element in the description of the invention or in the claims, it is not to be construed as being limited to only that element, And the like.
Also, in the description of the invention or the claims, the components named as "means", "parts", "modules", "blocks" refer to units that process at least one function or operation, Each of which may be implemented by software or hardware, or a combination thereof.
3 is a diagram illustrating a relationship of uploading or downloading a plug-in for setting an effect to a theme server using a mobile.
The theme server 2 provides a list of plug-ins for setting effects to the mobile 1 connected via a network, and as the user of the mobile 1 selects one of them, the user can download the plug-in selected by the user. To help.
On the other hand, the user of the mobile 1 selects the plug-in necessary for the user while looking at the list of plug-ins provided from the theme server 2.

The list of plug-ins preferably includes thumbnails and brief descriptions indicating the rendering result of the effect by each plug-in, and the user installs on his mobile 1 by selecting and downloading the ones he needs.
Then, the clips are arranged on the timeline while the video editing software is executed using the mobile 1, and an appropriate one is selected from previously downloaded and installed plug-ins to set the effects provided by the plug-in.
On the other hand, Figure 3 is shown to download the plug-in from the theme server 2, in addition to the case of downloading and installing via the "market" for Android OS, "app store" for IOS, etc. are not excluded.
On the other hand, the user of the other mobile (1) can also directly define the plug-in and upload it to the theme server (2).

Third-party developers (3) can also define and upload plug-ins for video editing software for mobile (1) to theme server (2).
In the present invention, each plug-in 100 corresponds to a predefined effect template.
An effect means various effects that can be applied to an arbitrary clip or a section between two adjacent clips. Clip effects that can be rendered and displayed in a clip, such as subtitles, titles, or drawing shapes, and the next clip after one of the clips is finished It contains a transition effect that is set in the interval between beginnings to allow two clips to follow naturally.
Known transition effects include fade in, fade out, climb down, and zoom in from the center.
A template means data in which elements for effect setting are predefined.
Meanwhile, the plug-in 100 may be a theme that is a combination of clip effects and transition effects applied to the entire project.
These plug-ins 100 have one plug-in 100 defining one clip effect or transition effect, or theme.
In the case of applying a clip effect, the user selects a plug-in corresponding to a clip effect from among a plurality of plug-ins installed in a predetermined path of the mobile video editing software, and then selects among the plurality of clips arranged in the timeline. Simply select the clip you want to apply the clip effect to and apply the effect defined by the clip effect to the selected clip.
In the case of transition effects, you can switch between two clips simply by selecting a plug-in corresponding to the transition effect from among a number of pre-installed plug-ins, and then simply selecting two adjacent clips from among the multiple clips arranged in the timeline. You can easily set the effect when
On the other hand, in the case of the theme, it is possible to apply clip effects and transition effects to the entire project by simply selecting a plug-in corresponding to a theme among a plurality of pre-installed plug-ins.
Plug-ins 100 corresponding to transition effects, clip effects, and themes are preferably stored in a sub path of the installation path of the video editing software of the mobile 1, but may be stored in different paths.
On the other hand, they may be stored with different file extensions, respectively, and may be stored together with resources such as an image used by the plug-in 100.
4 illustrates the structure of such a plug-in.
As shown in FIG. 4, the plug-in 100 includes a type code 110, a texture code 120, an animated value code 130, and a drawing function 140.
All code begins with a start tag and ends with an end tag. The end tag may be replaced with an end slash.
Preferably, the plug-in 100 includes a type code 110, a texture code 120, an animated value code 130, and a drawing function 140 in order as shown in FIG. 4.
That is, the plug-in 100 may be in the form of a file having codes as shown in FIG. 4. Preferably, these codes may be in the form of a file that is encrypted and stored without being compiled in a binary form.
The mobile 1 decodes the plug-in 100, but dynamically interprets the codes included in the plug-in 100 so that the effect defined by the plug-in 100 is arranged in the project or the timeline of the project. To the clip.
The type code 110 defines the range to which the plug-in 110 applies.
The type code 110 may have a value corresponding to any one of a theme, a transition effect, and a clip effect.
5 is a diagram conceptually illustrating the application of a plug-in between a project, a clip or two clips.
When the value of the type code 110 is a theme, the remaining texture code 120, the animated value code 130, and the drawing function 140 included in the plug-in 110 are applied to the entire project.
5A illustrates a case where an effect is applied to the entire project.
The theme may include two or more texture codes 120, animated value codes 130, and drawing functions 140.
Meanwhile, when the value of the type code 110 is a transition effect, the codes of the plug-in 110 are applied to a transition between two adjacent ones selected by the user among a plurality of clips arranged in the timeline of the project.
5B illustrates a case where an effect is applied between two adjacent clips.
If the value of the type code 110 is a clip effect, it is applied to any one or more selected by the user among a plurality of clips arranged in the timeline of the project.
5C illustrates a case where an effect is applied between two adjacent clips.
This typecode 110 is preferably located at the front of the plug-in 100.
When plug-in 100 is a clip effect or transition effect It may consist of a root element such as <Effect />.
On the other hand, when the plug-in 100 is a theme, the type code 110 is It has a root element, such as <Theme />, under which a number of Can have an <Effect /> element.
Meanwhile, the texture code 120 defines a target to which the effect is to be rendered.
This texture code includes a texture start tag 121 as shown in FIG. 4; Texture ID 122; Attribute directive 123; Texture attribute value 124; And texture end tag 125 in sequence.
As shown in FIG. 4,
It can be seen that the texture code 120 is displayed, such as <Texture id = "video_out" video = "1"/>.
At this time, the texture start tag 121 <texutre
The texture ID 122 is id = "video_out",
The attribute directive 123 is video, and the texture attribute value 124 is "1".
The texture end tag 125 corresponds to />. The texture end tag </ texture> is the principle, but it can be replaced with an ending slash as above.
The texture start tag 121 corresponds to a tag indicating that the texture code starts.
The texture ID 122 corresponds to a name of an object to be called by the drawing function 140 and may be arbitrarily determined.
The attribute directive 123 has one of video, src, and text.
video means the type of texture ID defined just before is video.
As such, when the attribute directive 123 is a video, the texture ID 122 may be used as a variable indicating a clip.
For example, In the example of <Texture id = "video_out" video = "1"/>,
As the user executes the video editing software of the mobile 1 to select any clip on the timeline, a value or pointer pointing to the clip may be assigned to video_out.
The type or meaning of the value that the texture attribute value 124 may have depends on the texture attribute directive 123.
For example, in the case of a transition effect, if the attribute directive 123 is video, the attribute value "1" is an outgoing clip to which the transition effect is applied, and the attribute value "2" is a clip after the transition effect is applied. (Incoming Clip).
As shown in FIG. 4,
<Texture id = "video_out" video = "1"/>
Two texture codes 120 are shown in sequence, such as <Texture id = "video_in" video = "2"/>.
Both texture ID 122 of "video_out" and "video_in" have the attribute directive 123 as video, and have texture values of "1" and "2", respectively.
That is, if the plug-in 100 including the texture code 120 according to the example of FIG. 4 defines a transition effect, "video_out" and "video_in" are respectively adjacent to the preceding clip to which the transition effect is applied. Instruct each clip.
On the other hand, when the attribute directive 123 is src, it means that the type of the texture ID 122 defined immediately before is an image.
for example, <Texture id = "snowflake" src = "snowflake.png"/>
In texture code 120, such as
The texture attribute directive 123 is src,
The texture attribute value 124 is "snowflake.png". That is, the name of the file can be directly input as an attribute value.
That is, when the texture attribute directive 123 indicates an image, a name and / or a path of an image file may be assigned to the texture ID 122 as its value.
On the other hand, when the attribute directive 123 is text, it means that the type of the texture ID 122 defined immediately before is text.
for example,
<Texture id = "title_text"
text = "% 1"
typeface = "asset: knewave.ttf"
textsize = "80"
fillcolor = "# FFFFFF"
fill />
In texture code 120, such as texture ID 122 is " title_text "
The texture attribute directive 123 is text, and the texture attribute value 124 is "% 1".
Attribute directives such as typeface, textsize, fillcolor, etc. that are displayed after the texture attribute value 124 are used to define the font, font size, color, etc. of the title type "title_text", and may be used or omitted as necessary. It may be.
That is, when the texture attribute directive 123 indicates text, a pointer variable indicating the text itself or the text dynamically input by the user with respect to the texture ID 122 may be allocated as the value.
On the other hand, according to the structure of the texture code 120 as described above, the type of the variable is defined first, and then does not assign a value to the variable.
That is, by defining the texture ID 122 first, and then describing the texture attribute indicator 123, the type of the texture ID 122 is defined later. Then, the texture attribute value 124 is described in succession. This makes the code very short and improves readability.
On the other hand, the animated value code 130 defines a value that changes with the change of time at the time of rendering the effect.
The animated value code 130 has an animated value start tag 131 and an animated value end tag 135, between which an animated value ID 132, a keyframe value 133, and a timing function tag. Has 134.
4,
<AnimatedValue id = "fade_in">
<KeyFrame value = "0"/>
<KeyFrame value = "1"/>

* </ AnimatedValue>
An animated value code 130 is shown.
At this time, the animated value start tag 131 is "<AnimatedValue",
The animated value ID 132 is "fade_in".
Then, after the animated value ID 132, two key frame tags " It can be seen that each of <KeyFrame "is defined as value =" 0 "and value =" 1 ".
That is, a keyframe value 133 having a value of "0" and a keyframe value 133 having a value of "1" are assigned to "fade_in".
And animated value end tag 135 "</AnimatedValue>".
The animated value start tag 131 indicates the start of the animated value code 130.
Immediately thereafter, you define an animated value ID (132) with id = "fade_in">,
Two key frame values 133 are assigned to the corresponding animated value IDs 132.
The key frame value 133 may be one or more.
The manner in which the key frame value 133 is called by the drawing function 140 and the configuration of adjusting the change rate of the frame value 133 value by the timing function 134 correspond to the characteristic configurations of the present invention. The drawing function 140 will be described and then described again.
The drawing function 140 defines the type and method of the effect.
The drawing function 140 corresponds to a function for setting various effects that may be applied to a clip, two adjacent clips, or the entire project in the video editing software, and various functions for setting the effect may be used.
For example, various functions, such as drawing a figure on the screen, defining a transition effect between clips, or processing an effect in which a title is displayed, may be defined through the drawing function 140.
The drawing function 140 corresponds to various screen processing functions according to the known art.
Multiple drawing functions 140 may be used, and each function may have a different name and parameters.
In this case, an important point is in the manner in which the drawing function 140 calls the texture ID 122 and the animated value ID 132 to process them.
As shown in FIG. 4, it can be seen that the following two drawing functions 140 are shown.
at first,
<rect bounds = "-1 1 1 -1" texture = "@ video_out"/>
to be.
"<rect"is a drawing function that draws a rectangle on the screen.
At this time, the first parameter has two coordinate values (-1,1) and (1, -1), and the second parameter has a value of "@video_out".
"video_out" is a texture ID 122 that indicates an outgoing clip as described above, and is called with @.
That is, the drawing function 140 may receive a pointer of the texture ID 122 as a parameter of the function.
The animated value ID 132 can also be pointed with @ in the same way.
That is, the drawing function 140 corresponds to a code for drawing a rectangle passing (-1,1) and (1, -1) to the clip in front of two adjacent clips to which the transition effect is applied.
On the other hand, as shown in Figure 4,
<style alpha = "@ fade">
<rect bounds = "-1 1 1 -1" texture = "@ video_in"/>
</ style>
A drawing function 140 is shown.
"<style alpha "is a function that sets the alpha value.
And it has "@fade_in" as a parameter.
"fade_in" corresponds to the animated value ID 132 mentioned above, and is similarly called with @.
And, <style alpha = "@ fade_in"> between </ style>
<rect bounds = "-1 1 1 -1" texture = "@ video_in"/> You are calling the <rect "function again.
second The <rect function draws a rectangle passing (-1, 1) and (1, -1) on the screen to the beginning of the incoming clip video_in.
It is important to note that "fade_in" is an animated value.
Looking back at the animated value code 130 of FIG.
<AnimatedValue id = "fade_in">
<KeyFrame value = "0"/>
<KeyFrame value = "1"/>
</ AnimatedValue>
Same as
This means that the start value of the animated value ID 132 "fade_in" is "0" and the end value is "1".
Then, the drawing function 140 calling the animated value ID 132 "fade_in" may draw an effect such as drawing a rectangle for a predetermined time (in the example, from the end point of the outgoing clip to the start point of the incoming clip). In processing, the value of the animated value ID 132 "fade_in" starts at "0" at the start of the effect and gradually increases to the value of "fade_in" of the animated value ID 132 at the end of the effect. Is to process the effect while changing to.
Drawing function 140 shown in FIG.
From the end of the outgoing clip to the start of the incoming clip, draw a rectangle with an RGB color value of (1, 0, 0) that fills the screen, gradually changing the alpha value from 0 to 1. Processes the effect that fades in.
That is, the code illustrated in FIG. 4 actually corresponds to a loop represented by the following pseudo-code.
{initial value of t = end of outgoing clip;
initial value of fade_in = 0;
while t = | start of incoming clip
{draw rectangle using alpha value = fade_in;
t = t + 1;
fade_in = fade_in + increment;}
end;}
In this case, since the time required for fade_in to be 0 to 1 and the time required from the end point of the outgoing clip to the start point of the incoming clip must be matched, more complicated coding is required to actually implement this.
However, simply defining the attributes and values of the texture ID 122 and the animated value ID 132 in a form suitable for the type and type of the effect can omit coding of such a complex loop and simply express them.
In detail about the animated value code 130,
The number of keyframe values 133 assigned to the animated value ID 132 depends on the drawing function 140 that calls them, or whether the plug-in 100 is a clip effect, transition effect, or theme. The form may vary.
In the example of FIG. 4, two key frame values 133 are assigned, the former being used as a start value and the latter being used as an end value. However, depending on the drawing function 140, one keyframe value 133 may be allocated.
In some cases, two or more values may be simultaneously assigned to one keyframe value 133.
<AnimatedValue id = "box_color">
<KeyFrame value = "1.0 0.0 0.0"/>
<KeyFrame value = "0.5 1.0 1.0"/>
</ AnimatedValue>
Assuming an animated value code 130 such as
"box_color" is the starting value of three values: 1.0, 0.0, 0.0,
The end value may have three values, 0.5, 1.0, and 1.0.
That is, in this case, "box_color" becomes a variable of the one-dimensional matrix structure having three items.
On the other hand, to improve readability,
.r = [0]
.g = [1]
.b = [2]
Predefined as
<Rect bounds = "-0.5 -0.5 0.5 0.5" color = "@ box_color.g @ box_color.r @ box_color.b"/>
It may be called through the drawing function 140 as shown.
Meanwhile, the animated value code 130 may further include a timing function tag 134.
For example, when processing a fade in effect through the drawing function 140 as shown in FIG. 4, if the value of the animated value ID "fade_in" varies linearly from 0 to 1 (Linear Interpolation), The problem is that the beginning and the end are not smooth and feel awkward.
The timing function tag 134 adjusts the rate of change of the value assigned to the animated value ID 132 by using a cubic bezier function to solve the problem of the linear interpolation.
The timing function tag 134 is located after the animated value start tag 131 and before the animated value end tag 135.
In other words, the important point is that the timing function tag 134 is not defined through the drawing function 140 but is part of an attribute of the animated value ID 132.
This structure also allows the user to simply set the rate of change of the keyframe value 133 assigned to the animated value ID 132 without coding a separate complex loop.
The timing function tag 134 may be, for example <TimingFunction /> or Can be expressed through tags such as <Const />.
On the other hand, this timing function tag 134 preferably has a parameter consisting of four consecutive numbers.
In this case, the four consecutive parameters represent the coordinates of the control point of the Bezier function for adjusting the change rate of the keyframe value 133 assigned to the animated value ID 132.
The first parameter, the first parameter, is the x coordinate of the first control point, the second, the second parameter, the y coordinate of the first control point, the third, the third parameter, the x coordinate of the second control point, and the last, fourth parameter, the second. Points to the y coordinate of the control point, respectively.
For example, if the parameter is 0.25 0.10 0.25 1.00, a Bezier curve with two control points (0.25, 0.10) and (0.25, 1.00) can be drawn.
At this time, the start point of the Bezier curve is (0,0) and the end point is (1,1).
FIG. 6 is a view for explaining an example of a cube Bezier function for implementing a timing function. FIG. 6 (a) shows a Bezier curve in the case of 0.25 0.10 0.25 1.00.
The x-axis is time-varying, and the y-axis is the keyframe value 133 value assigned to the animated value ID 132.
In other words, the value of the key frame value 133 gradually increases at the start and gradually increases at the end.
The beginning and end of the animation will slowly start and end.
6B shows a Bezier curve when four parameters are 0.42 0.00 1.00 1.00.
In this case, the animation starts slowly, but ends linearly.
FIG. 6C shows a Bezier curve when four parameters are 0.00 0.00 0.58 1.00.
In this case, the animation starts linearly, but slowly ends.
FIG. 6D shows a Bezier curve when four parameters are 0.00 0.00 1.00 1.00.
In this case, the animation starts linearly and ends linearly.
The keyframe value 133 increases linearly and uniformly.
Meanwhile, the coordinate system conversion code 150 may be further included before calling the drawing function 140.
The coordinate system conversion code 150 has a projection code 151, an aspect ratio extension code 152, and an origin movement code 153.
The coordinate system conversion code 150 is, for example, as follows.
<projection type = "perspective" aspect = "1.777777" fov = "45" near = "0.01" far = "60000">
<translate offset = "-640 -360 -870">
<-drawing function 140->
</ translate>
</ projection>
The projection code 151 projects the coordinate system into a three-dimensional coordinate system having a z axis.
At this time, the angle from the viewpoint (Veiwpoint) can be set.
The aspect ratio extension code 152 extends the coordinate system to fit the aspect ratio defined by the number of pixels in the aspect of the display on which the video editing tool is displayed.
remind <projection type = "perspective" aspect = "1.777777" fov = "45" near = "0.01" far = "60000"> In code (151, 152),
Project in a 3D coordinate system like <projection type = "perspective"
By setting fov = "45", the angle at the view point is 45 degrees.

* Then, by setting aspect = "1.777777", the one-to-one ratio coordinate system is extended to the mobile aspect ratio 1.77777. As a result, each pixel may have a square shape, and shape distortion due to an aspect ratio may be removed when rendering the effect by the drawing function 140.
<translate offset = "-640 -360 -870"> The code 153 moves the origin of the screen center to one end of the 720p coordinate system. And, moving by 870 in the z-axis is to prevent the object of the z = 0 plane is not displayed in the field of view.
On the other hand, after the projection code 151, the aspect ratio extension code 152 and the origin movement code 153, Call the drawing function 140 in the <-drawing function 140-> section.
after, </ translate> tag to end the homing code (153), The projection code 151 and the aspect ratio extension code 152 are terminated through the </ projection> tag.
The coordinate system conversion code 150 is not necessarily included in the plug-in 100, such as the type code 110, the texture code 120, the animated value code 130, and the drawing function 140.
By including the drawing function 140 before the call, the distortion of the object due to the screen aspect ratio during rendering of various drawing functions (eg, screen rotation) may be prevented.
Therefore, even when the 3D effect is not used, it is preferable to include the coordinate system transformation code 150 before the drawing function 140 is called.
Hereinafter, a process of setting an effect on the video editing software by the mobile 1 using the plug-in 100 having the above structure will be described with reference to FIG. 7.
7 is a flowchart for explaining an effect setting method using a data structure for effect setting according to the present invention.
The mobile 1 user downloads and installs a plurality of plug-ins 100 via the theme server 2 or the "market" for the Android OS or the "app store" for IOS and the like on the path of the video editing software.
Alternatively, the plug-in 100 may be directly installed according to the data structure of the plug-in 100 proposed by the present invention.
On the other hand, the mobile 1 user executes video editing software and then opens an existing project or starts a new project to arrange a plurality of clips in the timeline.
Accordingly, the mobile 1 processes the clip selected by the user to be arranged in the timeline (step a).
On the other hand, as the user selects any one of the plurality of plug-ins 100 previously installed in the mobile 1 on the GUI as shown in FIG.
Read the type code 110 from the selected plug-in 100, and if the plug-in is applied to the entire project according to the type code 110 (if the type code 110 points to a theme), Determine if it is applied (if type code 110 points to a clip effect) or if it is applied to transitions between clips (if type code 110 points to a transition effect) (step b).
Thereafter, the mobile 1 reads the texture code 120 from the plug-in 100.
When the mobile 1 first finds the texture start tag 121, the mobile 1 first recognizes the texture ID 122 immediately after the texture start tag 121.
Assigning the texture attribute value 124 to the type corresponding to the texture attribute directive 123 immediately after the texture ID 122 (step c);
If the texture attribute value 124 is described as a constant value in the texture code 120, a variable of a type corresponding to the texture attribute directive 123 is dynamically generated, and the variable corresponding to the texture ID 122 may be dynamically generated. The constant value can be assigned.
Or, if it is described as a variable value, according to the user's selection in the execution process of the video editing software, the value corresponding to the user's selection in the texture ID 122-the value is of course by the texture attribute directive 123 It must match the type that is defined. -Allocate
Subsequently, when the mobile 1 discovers the animated value code 130 from the plug-in 100, for the animated value ID 132 immediately after the animated value start tag 131,
Attribute values by the key frame value 133 and the timing function tag 134 are assigned.
In this case, when there are two key frame values 133, the first of them is assigned as a start value and a second as an end value when the animated value ID 132 is called by the drawing function 140 (step d). ).
On the other hand, if the mobile 1 finds the drawing function 140 that receives the pointer of the texture ID 122 or the animated value ID 132 as a parameter, it renders the effect by the drawing function 140 (step e). ).
At this time, according to the type code 110, it is determined whether to apply the effect to the entire project, to which clip selected by the user, or to a transition between two adjacent clips selected by the user, and accordingly Render effects in the entire project, in one clip, or in transitions between clips.
Meanwhile, when the mobile 1 processes the transition effect in detail, in the step c, the texture attribute values 124 of the video type are respectively assigned to the two texture IDs 122, and in the e step, the two texture IDs are assigned. When rendering the drawing function 140 that receives a pointer to the texture ID 122 as a parameter,
The mobile 1 uses the clip having the texture attribute value 124 of "1" as an outgoing clip and the clip having the texture attribute value 124 of "2" as an incoming clip to the drawing function 140. By rendering an effect, you handle the transition between two adjacent clips.
Meanwhile, when the mobile 1 processes the animation using the animated value code 130 in detail, two key frame values 133 are assigned to one animated value ID 132 in step d. When rendering the drawing function 140 receives the pointer of the animated value ID 132 as a parameter in step e,
The mobile 1 sets the first key frame value 133 to a value assigned to the animated value ID 132 at the start of the rendering function 140,
The second key frame value 133 is a value assigned to the animated value ID 132 at the end of rendering of the drawing function 140, and thus the key frame value 133 is set at a starting value. Render the animation effect by processing it to change gradually to the end value.
On the other hand, if the timing function tag 134 is found after the animated value start tag 131 and before the animated value end tag 135, the mobile 1 renders the drawing function 140 in step e. According to the parameter of the timing function tag 134, the speed at which the value assigned to the animated value ID 132 changes is adjusted.
The timing function tag 134 preferably has four consecutive numerical parameters, wherein the mobile 1 has a starting point of (0, 0) and an ending point of (1, 1). The two control points are defined to draw a cubic Bezier function, thereby controlling the rate at which the value assigned to the animated value ID 132 changes.
The first parameter of the timing function tag 134 is the x coordinate of the first control point, the second parameter is the y coordinate of the first control point, the third parameter is the x coordinate of the second control point, and the fourth parameter is y of the second control point. You can define cubic Bezier functions using coordinates.
The rate of change of the value assigned to the animated value ID 132 may be set by using the x-axis of the cubic Bezier function defined above as the time and the y-axis as the animated value.
On the other hand, the effect setting method using the data structure for setting the effect of the video editing tool executed on the mobile 1 as described above is implemented in the form of a computer-in particular, a software that is a set of instructions that can be read by the mobile (1) And recorded on the recording medium.
In this case, the recording medium may include any type of medium readable by a computer, such as DVD-ROM, CD-ROM, hard disk, USB memory, and flash memory.
On the other hand, the expression to be recorded on the recording medium includes not only the case of being recorded on the recording medium of this type but also the case of being provided through a communication line in the form of an intangible carrier wave (Carrier Wave).
On the other hand, although the expression "mobile" is used in the above, if the user has a relatively small screen and has a means for editing a video by executing a video editing software while being carried by a user, the definition of "mobile" referred to in the present invention is defined. It should be understood as satisfying.
That is, in addition to a smart phone or a tablet computer equipped with IOS or Android OS, an equivalent thereof may be included in the mobile.
While the present invention has been described with reference to the accompanying drawings and embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. .

The present invention can be applied to the video editing tool technology.
In particular, it can be applied to the field of mobile video editing tool technology.

1: Mobile
2: theme server
3: Third Party Developer
100: plug-in
110: type code
120: texture code
121: texture start tag
122: Texture ID
123: texture attribute directive
124 texture value
125: texture end tag
130: animated value code
131: animated value start tag
132: animated value ID
133: keyframe value
134: Timing Function Tag
135: animated value end tag
140: drawing function
150: coordinate system conversion code
151: projection code
152: aspect ratio extension code
153: homing code

Claims (15)

In the data structure for setting the effects of the video editing tool,
Texture code defining what the effect is rendered to;
An animated value code defining a value that changes with time as the effect renders;
Include drawing functions that define the type and method of the effect,
The texture code includes a texture start tag; Texture ID; Attribute directive; value; And a texture end tag;
The animated value tag includes an animated value start tag; Animated value ID; One or more keyframe value values; And an animated value end tag;
The drawing function is a computer-readable recording medium having effect setting data of a video editing tool that receives a pointer of the texture ID or an animated value ID as a parameter of a function. The method of claim 1,
And a type code defining a range to which the texture code, animated value code, and drawing function are applied.
The type code is applied to the entire project; Apply to any one or more of a number of clips arranged in the timeline of the project; Or apply to transitions between two adjacent ones of a plurality of clips arranged in a timeline of a project; A computer-readable recording medium having effect setting data of a video editing tool having a value corresponding to any one of them. 3. The method of claim 2,
The type code, the texture code, the animated value code and the drawing function are computer readable with effect setting data of the video editing tool included in the order of the type code, the texture code, the animated value code and the drawing function. Record carrier. The method of claim 1,
The attribute directive of the texture code is any one of video, image, text,
If the attribute directive points to video, a pointer variable pointing to the clip that the user has dynamically selected is assigned as the value of the texture ID,
If the attribute directive points to an image, then the name of the image file or a pointer variable pointing to the image dynamically selected by the user is assigned as the value of the texture ID,
A computer-readable recording medium having effect setting data of a video editing tool, when a property directive indicates text, a pointer variable pointing to text or text dynamically input by a user is assigned as the value of the texture ID. The method of claim 1,
If two texture IDs are included, each attribute directive is a video, and the drawing function receives a pointer to the two texture IDs as parameters.
The drawing function is a code for setting a transition effect applied between the start position of the clip by the texture ID having the second value and the end position of the clip on the timeline of the video editing tool indicated by the texture ID having the first value. A computer-readable recording medium having the effect setting data of the video editing tool. The method of claim 1,
If two key frame value values are included and the drawing function receives a pointer to the animated value ID as a parameter,
The drawing function is a code for setting an effect such that the animated value ID changes from a state having a value in front of two key frame value values to a state having a later value as time passes. A computer readable recording medium having configuration data. The method of claim 1,
And a timing function tag defining a Bezier function for controlling a change rate of a value assigned to the animated value ID after the animated value start tag and before the animated value end tag. A computer readable recording medium having configuration data. The method of claim 7, wherein
The timing function tag has four parameters corresponding to the coordinates of the control point of the Bezier function for adjusting the rate of change of the animated value.
The first parameter is the x coordinate of the first control point,
The second parameter is the y coordinate of the first control point,
The third parameter is the x coordinate of the second control point,
A computer-readable recording medium having effect setting data of a motion picture editing tool, each indicating a fourth parameter of the y coordinate of the second control point. The method of claim 1,
Further comprising a coordinate system conversion code before the drawing function,
The coordinate system conversion code includes a projection code for converting the coordinate system into a three-dimensional coordinate system having a z-axis;
An aspect ratio extension code for extending a coordinate system to an aspect ratio defined by an aspect ratio pixel number of a display on which a video editing tool is displayed;
And a homing code for moving the origin to a predetermined position of the converted three-dimensional coordinate system. The computer-readable recording medium having the effect setting data of the video editing tool. In a method executed in a video editing device having display means,
a) arranging a plurality of clips in a timeline in a project selected by the user;
b) reading a script included in the selected plug-in file as one plug-in is selected by the user;
c) if a texture start tag is found from the script, assigning a value to the texture ID immediately after the texture start tag to a type corresponding to an attribute directive immediately after the texture ID;
d) If an animated value start tag is found from the script, the keyframe value value included before the animated value end tag is assigned to the animated value ID immediately after the animated value start tag, but the key frame value value In both cases, assigning a previous key frame value as a start value and a later key frame value as an end value;
e) if it finds a drawing function that receives a pointer of the texture ID or animated value ID as a parameter from the script, rendering an effect by the drawing function; setting an effect using effect setting data of a video editing tool Way. 11. The method of claim 10,
In step b),
As a plug-in is selected by a user, a script included in the selected plug-in file is read out, and the script is applied to the entire project, to a clip, or to a transition between clips. Determine if this applies,
In the step e)
In rendering the effect by the drawing function, depending on whether the selected plug-in is applied to the entire project, to a clip, or to a transition between clips, the entire project, any one clip, or between clips How to set the effect using the effect setting data of the video editing tool to render the transition. 11. The method of claim 10,
In step c), if a value of a video type is assigned to each of two texture IDs,
In the step e), in rendering a drawing function that receives the pointers of the two texture IDs as parameters,
Rendering an effect by the drawing function between the end position of the clip on the timeline indicated by the texture ID with the first value and the start position of the clip on the timeline indicated by the texture ID with the second value How to set the effect using the effect setting data of the movie editing tool. 11. The method of claim 10,
In step d), if the key frame value is two,
In the step e), in rendering a drawing function that receives a pointer of the animated value ID as a parameter,
The animated value at the start of rendering of the drawing function is set as the starting value, and the animated value at the end of rendering of the drawing function is set as the ending value. An effect setting method using the effect setting data of the video editing tool to process a value value is changed from the start value to the end value. The method of claim 13,
In step d), if the timing function tag is found after the animated value start tag and before the animated value end tag from the script,
In the step e)
In the rendering of the drawing function, an effect setting method using the effect setting data of the video editing tool that adjusts the speed at which the value of the animated value changes from the start value to the end value by the timing function tag. 15. The method of claim 14,
In step e), the first parameter of the timing function tag is the x coordinate of the first control point, the second parameter is the y coordinate of the first control point, the third parameter is the x coordinate of the second control point, and the fourth parameter is the second control point. The effect of the video editing tool, which sets the rate of change of the animated value by using a cubic Bezier function defined as the y coordinate of, by setting one axis of the cubic bezier function as the animated value and the other axis as the animated value. How to set the effect using the setting data.

Images