KR102241572B1 - System and method for generating video content using dynamic template - Google Patents

Abstract

Disclosed is a system and method for automatically producing a video using a dynamic template. The automatic video production system according to the present invention includes: a storage unit for storing meta information on a template used for automatic video production; A template generation unit that generates meta information including definitions of a template, a plurality of scenes that may be included in the template, and one or more source spaces included in each scene, and stores the meta information in the storage unit; A template selection unit that analyzes the properties of source files and compares them with the requirements of each template defined by meta information, and selects a template to be used to create a video from source files; A template modifying unit for dynamically modifying a template by applying at least one of copying, deleting, and changing an arrangement order of scenes included in the template according to the number of source files; And a moving picture generator that determines a source file to enter the source space included in each scene of the modified template according to the properties of the source files and inserts each source file into a corresponding source space.

Description

Automatic video production system and method using dynamic template {System and method for generating video content using dynamic template}

The present invention relates to a technology for automatically generating a video from a plurality of photo files. More specifically, a template is selected by analyzing photo files, and the template is dynamically modified according to the number or attribute of photo files to create an optimal video. It is about an automatic video production system and method that automatically generates.

With the transition to the digital age, digital multimedia contents are rapidly spreading, and as a result, digital multimedia contents are growing as an independent medium. In addition, as communication environments such as the Internet, broadband transmission network, and mobile communication network become easier to transmit and share content, numerous users create multimedia content every day, and SNS (Social Network Service), for example, Facebook, Twitter ( Twitter) and other network communities are used to share the content.

In addition, users can freely take pictures using a camera mounted on a smartphone, and thus, numerous pictures exist in a smartphone album or a computer. In recent years, the use of a service that creates a video using these digital photo files is increasing.

In the case of offline video production companies, the user selects a topic and provides digital photo files as a source to create a video. For example, if you give photos of a baby for the first birthday party and ask to create a video for the first birthday party, an employee of a video production company looks at the photos and manually arranges them to create a slideshow-type video album.

Recently, there are a number of online services that use these photos to create videos to commemorate travel, weddings, and first birthday parties. When a user connects to an online service and selects an appropriate template that suits the mood of his or her photo, the video is created using the template.

In such a video production service, it is inconvenient because the user has to review each template and select the desired template, and the number of photos required for each template is determined. If the source file for filling the template is insufficiently uploaded or too many are uploaded, a video is created by leaving a part of the template blank or discarding the remaining photos, so it is not possible to provide content that satisfies the user.

The present invention is to solve the problems of the prior art as described above, in the case of creating a video with photos uploaded or input by a user using a template, a video automatically capable of automatically creating an optimal result without additional input from the user It is to provide a manufacturing system and method.

In addition, the present invention is to prevent awkwardness after dynamically modifying the template to fit even if the user uploads less or more than the number of source files required to fill the template, without discarding some photos or leaving the template blank. It is to provide a video automatic production system and method that makes a video.

In order to achieve the above object, an automatic video production system using a dynamic template according to an embodiment of the present invention includes: a storage unit for storing meta information on a template used for automatic video production; A template generation unit that generates meta information including definitions of the template, a plurality of scenes that may be included in the template, and one or more source spaces included in each scene, and stores the meta information in the storage unit; A template selection unit that analyzes properties of source files and compares them with requirements of each template defined by the meta information, and selects a template to be used to generate a video from the source files; A template modifying unit for dynamically modifying the selected template by applying at least one of copying, deleting, and changing an arrangement order of scenes included in the selected template according to the number of source files; And a moving picture generation unit that determines a source file to be entered into a source space included in each scene of the modified template according to the properties of the source files, and inserts each source file into a corresponding source space according to the determination. have.

The template generator may define a story theme of the template, the number and order of scenes to be included, and a role of each scene and a requirement of a source space to generate meta information.

The template correction unit may delete or duplicate at least one scene included in the template and adjust the order of the scenes according to the number of the source files.

The template correction unit may determine whether to delete or duplicate a corresponding scene and whether to change the order according to role information of each scene included in the template.

The video generator may insert an effect and background music selected according to a story theme of the selected template into the video.

According to an embodiment of the present invention, a method of receiving a plurality of source files including an image from a user terminal and automatically producing a video using the received source files includes, a computer, a template used for automatic video production, the Generating template meta information including definitions of a plurality of scenes that may be included in the template and one or more source spaces included in each scene; Analyzing attributes of the source files and comparing them with requirements defined for each template to select a template; Dynamically modifying the selected template by applying at least one of copying, deleting, and changing an arrangement order of scenes included in the selected template according to the number of source files; And determining a source file to be entered into a source space included in each scene of the modified template according to the properties of the source files, and inserting each source file into a corresponding source space according to the determination to generate a moving picture. can do.

According to the present invention, when a video is produced from photos uploaded or input by a user using a template, an optimal result can be automatically created without additional input from the user.

In addition, according to the present invention, even when the user uploads less or more than the number of source files necessary to fill the template, some photos are not discarded or the template is not left blank, and the template is dynamically modified and then awkward. You can automatically create a video so that it doesn't.

1 is a diagram for explaining the configuration of an automatic video production system using a dynamic template according to an embodiment of the present invention.
2 and 3 are diagrams for explaining the configuration of a template according to an embodiment of the present invention.
4 is a flowchart illustrating a method of generating a template according to an embodiment of the present invention.
5 is a flowchart illustrating a method of automatically producing a video using a dynamic template according to an embodiment of the present invention.

The terms used in the present specification will be briefly described, and the present invention will be described in detail.

Terms used in the present invention have selected general terms that are currently widely used as possible while taking functions of the present invention into consideration, but this may vary according to the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. In addition, terms such as "...means", "...units", and "modules" described in the specification mean units that process at least one function or operation, which are implemented in hardware or software, or are implemented in hardware and software. It can be implemented by a combination of.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

1 is a diagram for explaining the configuration of an automatic video production system using a dynamic template according to an embodiment of the present invention.

Referring to FIG. 1, the automatic video production system functionally includes a control unit 100 including a template generation unit 101, a template selection unit 102, a template modification unit 103, and a video generation unit 104, and a template It includes a storage unit 110 that generates a template such as meta information, a source file, and a video file, and stores various data necessary to automatically generate a video. The automatic video production system receives a plurality of source files 120 and automatically generates and outputs a video 130 configured by including the corresponding source files 120. The source file 120 includes a plurality of image files including photographs or graphic data. Also, depending on the embodiment, an audio file such as music may be further included.

The automatic video production system creates a plurality of templates, which can be predefined to cover different story topics, video categories, and video lengths. The template is a video template created by a planner with a story, and effects and/or background music may be inserted in the middle.

The storage unit 110 includes a template meta information storage unit 111 for storing meta information on a template used for automatic video production. In addition, a source file storage unit 112 for storing a source file 120 uploaded or input from a user terminal (not shown), and a video storing a video 130 automatically generated using a source file and a template It may further include a storage unit 113.

2 and 3 are diagrams for explaining the configuration of a template according to an embodiment of the present invention.

Referring to FIG. 2, the template 200 according to the present invention may include one or more scenes 210. In the present invention, instead of making a video template as a whole, it is defined as a configuration that divides and combines multiple scenes, so that the template can be flexibly and dynamically modified when creating a video.

Referring to FIG. 3, the scene 300 according to the present invention may include one or more source spaces 310. In each scene 300, a place where each source file will be placed is set. For example, when defining a 21-second video scene, if there are 7 photos and 3 seconds are allocated for each photo, the location where the source file will be placed is predefined every 3 seconds.

The template generation unit 101 receives an input from an administrator or a template definition file, and generates meta information including definitions for a template, a plurality of scenes that may be included in the template, and one or more source spaces included in each scene. It is stored in the storage unit 111. The template meta information storage unit 111 stores metadata defining various templates with various subjects, and when a source file is input, the template selection unit 102 of the automatic video production system selects one of the templates.

The template selection unit 102 analyzes the properties of the source files 120 and compares them with the requirements of each template defined by meta information, and selects a template to be used to generate a video.

The template modifying unit 103 may dynamically modify the template selected above according to the number of source files.

The video generation unit 104 determines a source file to be entered into a source space included in each scene of the modified template, and inserts each source file into a corresponding source space to generate a video.

4 is a flowchart illustrating a method of generating a template according to an embodiment of the present invention.

The meta-information generated by the template creation unit 101 may include a story subject of the template, a category, the number and order of scenes to be included, and a definition of the role of each scene and requirements of the source space.

4, in step S41, a subject of a template is defined. For example, a template that includes story topics that users are interested in, such as growth album, graduation album, first birthday party, family trip, European travel, wedding story, restaurant promotion video, beauty salon promotion video, cafe promotion video, etc., is defined in the title. If there are multiple story topics, templates can be classified and managed by category.

In step S42, a plurality of scenes to be included in the template are defined. Each scene in the template has a role in the story. For example, you can define one or more scenes for each of the roles intro, progression, culmination, and ending within a template. In addition, it is possible to define whether the scenes serving each role can be duplicated, deleted, and ordered. In addition, it is possible to define the relationship between scenes before and after.

In step S43, one or more source spaces are defined for each scene. For each scene to play a specific role, the sources that will enter the scene must also meet the requirements.

For example, in a template with a story theme of'Growth Album', the first picture in the scene that plays the role of'introduction' can be set as a picture of a child, and the second picture is a picture of a child and an object. As another example, you could define the requirements in more detail for each source, such as the first picture with a child on the right, an adult on the left, and the second picture with a picture of a child playing with a rattle.

In other words, it is possible to define the source spaces by setting the requirements that can be determined for the sources of each scene. The determination of these requirements could be performed by an object recognition algorithm or an AI (Artificial Intelligence) module.

In addition, it is possible to define the time allocated for each source space. For example, a different time or the same time can be allocated by setting 4 seconds for each source file in Scene 1 and 3.5 seconds for each source file in Scene 2.

In step S44, template meta information including object information and requirements for the template, scene, and source space defined above is stored in the storage unit 110. Meta information may be stored in a database that is easy to search, but is not limited thereto, and may be stored using other types of information systems.

5 is a flowchart illustrating a method of automatically producing a video using a dynamic template according to an embodiment of the present invention.

Referring to FIG. 5, in step S51, a video production request is received together with a plurality of source files. The plurality of source files may be files including images such as photo files and graphic files.

In step S52, the source files are analyzed and one of the templates defined as template meta information is selected. By analyzing the source file to determine the type and composition of the subject, comparing the result of the decision to the requirements for the source spaces of each template, and selecting the template with the highest percentage that meets the requirements, the source files can be used as much as possible. You can choose a matching template.

For example, a user uploaded 100 photos, how many photos of an adult man on the left and a child on the right, how many photos with a child in the middle and an adult on the left and right, and how many photos with 3 people standing The sum that meets the requirements defined in the template'Growth Album' is the most when it is determined whether there are, and how many photos are there with objects and children, and the results are compared with the requirements of the source spaces defined in each scene of the template. If it's large, you can choose that template. When a number of templates are defined under the same subject, you can choose the one that meets the most requirements from among these templates.

In step S53, the template is dynamically modified according to the source file by dynamically modifying the scene and/or the source space defined in the template according to the number of source files and the properties of the template.

For example, if the number of source files uploaded by the user is different from the standard for the quantity of source spaces defined for the template selected above, a video is generated after modifying a predefined template.

A template that requires 100 photos is selected, but the processing is a problem when the user provides only 95 photo files or 120 photos. In the prior art, when a user uploads 120 pages, the template is repeated from start to finish, and then starting from the beginning, as many as 20 images are created and cut off, resulting in a result that the story structure is not smooth and messy. did.

In the case of the present invention, a video may be generated after dynamically modifying a scene according to two embodiments as described later.

In the first embodiment, the template may be modified by duplicating or deleting at least one scene included in the template or changing the arrangement order of the scenes.

When defining a template, in addition to the basic scene order, the order of the scenes that can be replaced is set in various versions, and when the number of pictures to be input does not meet the standard, another version of the scene order is arranged.

For example, the criterion is defined by 100 photos, scene sequence 1-2-3-4-5-6-7,

If there are 100-110 photos, the scene sequence is 1-2-3-4-3-5-6-7,

If there are 110-120 photos, the scene sequence is 1-2-3-4-3-4-5-6-7,

If there are 90-100 photos, the scene order is 1-2-4-5-6-7,

If you have 80-90 photos, you can preset them to be revised in the scene order 1-3-5-6-7.

Looking at the above example, it can be seen that it is defined in a manner of creating and inserting one more instance at a predetermined position in a predetermined scene list, or deleting a predetermined scene.

As a result, when creating a video using the modified template, if there are too many input photos, it is possible to add photos that are left in the newly duplicated and added scene. It is desirable to flexibly define the source space from the beginning so that a scene that can be duplicated and added in this way can be made even if the picture is insufficient.

When one scene is deleted because a picture is insufficient, a scene in which the picture(s) remaining when the corresponding scene is deleted may be set. In addition, when two scenes are deleted due to insufficient photos, a scene in which the remaining photo(s) will be entered may be set. When n scenes are deleted in this order, a scene in which the remaining photo(s) will be entered may be set. Also, even when there are insufficient photos, a scene in which the source space is flexibly defined so that even if the photos are insufficient can be set in advance.

In the second embodiment, role information of each scene included in the template is defined as metadata, it is determined whether the scene can be duplicated or deleted according to the role, and adjustment of the arrangement order of the scene can also be determined in consideration of the role of the scene. .

For example, among a plurality of scenes, a scene with an introductory role may be placed at the front, a scene serving as an ending is placed at the end, and an introductory and ending scene may not be deleted. In addition, for the rest of the scenes, you can set a precedence relationship, such as which scene comes before which scene or which scene comes after which scene. In addition, a scene can be duplicated or deleted, or a scene can have a minimum number of photos and a maximum number of photos can be set in advance, and the template can be modified accordingly.

In step S54, a video is produced by putting source files in the modified template as described above. In addition, effects and background music set in advance according to the story theme of the template may be inserted into the video.

According to the dynamically modified template, it is possible to create a video by placing the source files in the source space so that there are no shortages or leftovers. If there are still photos, temporarily allocate all the photos to the scene of the template before modification, select a scene that is suitable for the remaining photos, and duplicate it, and then duplicate the duplicated scene according to the order information (precedence relationship) between the scenes. After putting it in position, it puts the remaining photos in the duplicated scene and creates a video. If there are not enough photos, the photos are temporarily distributed to the scenes of the template before modification, and deleted scenes are selected and deleted, and the photos are distributed to the remaining scenes. As a result, a video according to the modified template may be generated.

As described above, according to the present invention, as long as the user provides photo files, the automatic video production server analyzes the photos to determine the subject and selects the appropriate template, as well as the template dynamically considering the number of insufficient or remaining photos. You can create and provide a video modified with. Users can download and enjoy the provided video or upload it on social media to share with other users.

On the other hand, after the video is completed, if the user desires to reduce the total playback time of the video, the entire deleteable scene can be lifted by referring to the template meta information, and the video can be regenerated and provided. In other words, rather than creating a new video after deleting some of the input pictures from the number of pictures, the entire scene that can be reduced in the story is deleted from the already created video.

On the other hand, if the user wants to increase the video playback time, a predetermined scene that can be duplicated is duplicated according to the time requested for extension, and the duplicated scene is inserted in an appropriate position on the template. Then, after calculating the number of photos required to put in the inserted scene and requesting it from the user, if the user uploads more photos, these photos can be placed in the duplicate scene and a new video can be created and provided.

The method according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

100: control unit
101: template generation unit
102: template selection section
103: Template revision
104: video generation unit
110: storage unit
111: template meta information
112: source file
113: video
120: input source file
130: output video

Claims (11)

A storage unit for storing meta information on a template used for automatic video production;
A template generation unit that generates meta information including definitions of the template, a plurality of scenes that may be included in the template, and one or more source spaces included in each scene, and stores the meta information in the storage unit;
A template selection unit that analyzes properties of source files and compares them with requirements of each template defined by the meta information, and selects a template to be used to generate a video from the source files;
A template modifying unit for dynamically modifying the selected template by applying at least one of copying, deleting, and changing an arrangement order of scenes included in the selected template according to the number of source files; And
Including; a moving picture generation unit for determining a source file to enter the source space included in each scene of the modified template according to the properties of the source files and inserting each source file into a corresponding source space according to the determination,
The template includes the plurality of scenes, and each of the plurality of scenes includes a plurality of source spaces, so that the video can be produced in response to the number of the source files dynamically,
When the number of source files and the number of source spaces of scenes included in the selected template do not match, the scenes included in the template and the scenes included in the scenes corresponding to the number of source files and the properties of the source files After modifying the number of source spaces, the system for generating a video by placing the source files in the modified source spaces to generate a video. The method of claim 1,
The template generation unit defines the story theme of the template, the number and order of scenes included, and the role of each scene and the requirements of the source space, and generates meta information as meta information. Production system. The method of claim 2,
The template correction unit, according to the number of the source files, delete or duplicate at least one scene included in the template and adjust the order of the scenes, automatic video production system using a dynamic template. The method of claim 2,
The template correction unit, characterized in that to determine whether to delete or duplicate the scene, and whether to change the order according to the role information of each scene included in the template, automatic video production system using a dynamic template. The method of claim 2,
The video generation unit, characterized in that for inserting the selected effect and background music in the video according to the story theme of the selected template, automatic video production system using a dynamic template. In a method of receiving a plurality of source files including an image from a user terminal and automatically producing a video using the received source files, the computer,
Generating template meta information including definitions of a template used for automatic video production, a plurality of scenes that may be included in the template, and one or more source spaces included in each scene and storing the template meta information in a storage unit;
Analyzing properties of the source files and comparing them with requirements defined for each template stored in the storage unit to select a template;
Dynamically modifying the selected template by applying at least one of copying, deleting, and changing an arrangement order of scenes included in the selected template according to the number of source files; And
Determining a source file to enter the source space included in each scene of the modified template according to the properties of the source files and inserting each source file into a corresponding source space according to the determination to generate a video; and ,
The template includes the plurality of scenes, each of the plurality of scenes includes a plurality of source spaces, so that the video can be produced dynamically in response to the number of the source files,
In the step of dynamically modifying the selected template, if the number of source files and the number of source spaces of scenes included in the selected template do not match, the number of source files and the properties of the source files Modifying the number of scenes included in the template and source spaces included in the scenes,
In the step of generating the moving picture, the method for automatically producing a moving picture using a dynamic template, characterized in that generating a moving picture by arranging the source files in the modified source spaces. The method of claim 6,
The template meta information, characterized in that it includes information defined on the story theme of the template, the number and order of scenes included, and the role of each scene and requirements of the source space, automatic production of a video using a dynamic template Way. The method of claim 7,
The template modification step comprises: deleting or duplicating at least one scene included in the template and adjusting the order of the scenes according to the number of the source files; How to make. The method of claim 7,
The template modification step includes determining whether to delete or duplicate a corresponding scene and whether to change the order according to the role information of each scene included in the template; characterized in that it includes, automatic video production method using a dynamic template . The method of claim 7,
The video generation step includes: inserting an effect and background music selected according to a story theme of the selected template into the video. A computer program recorded on a recording medium to perform an automatic video production method using the dynamic template of any one of claims 6 to 10.

Images