WO2016059450A1

WO2016059450A1 - Method for video templates validation, method for video files generation and server for video files generation

Info

Publication number: WO2016059450A1
Application number: PCT/IB2014/065317
Authority: WO
Inventors: Michał PRZYMUSIŃSKI
Original assignee: Innovative Solutions Sp. Z O.O.
Priority date: 2014-10-14
Filing date: 2014-10-14
Publication date: 2016-04-21

Abstract

Template validation is initiated by searching for all scenes within the template being validated and registering them, as well as searching for the master scene. Next the temporal relations between all registered scenes are analysed and are browsed for all variables which are then registered. Next the variability ranges of all registered variables are analysed and the checksum of the template is checked against the registered number of variables. Finally the check file external in relation to the template being validated is created. This file contains the list of registered scenes with their temporal relations and their allowable variation ranges, as well as the list of variables registered for each scene with respective variation ranges. Generating video files consists in using a video template and its assigned external check file generated during the above validation. The server used to generate the finished files contains a module executing the above mentioned video template validation and creating the mentioned check file external in relation to the validated template, as well as a module to create a control file on the basis of the check file data, which contains selected variable values and temporal relation of scenes.

Description

Method for video templates validation, method for video files generation and server for video files generation

Technical Field

The invention relates to method of validation of video templates allowing to generate (render) finished video files in the required format and resolution, to method of their generation by means of such template and to server utilised for executing said method.

Background Art

Video files to be played on the screen of an electronic device can be generated in any selected format and resolution during rendering and on the basis of so called "video template" and respective multimedia resources. The generation of a video file containing a high resolution video in this mode requires significant computing power. Thus a temporary lease of highly efficient rendering servers is utilised more and more frequently and their prices are acceptable even for private persons. Because such server carries out the rendering automatically, using it by persons lacking the relevant experience with video files poses a risk of using their computing power to generate a video file of unacceptable quality or contents. Such risk increases as the number of templates offered by independent vendors in various, frequently not popular formats increases as well; this also applies to using such templates to generate series of video files which differ in details only.

An exemplary video file generating system was disclosed in the publication of patent application US2012/0284625A1 , according to which a single video file is used to generate customised files on a mass scale. However, this publication does not cover any teaching of using templates others than strictly dedicated for this purpose. Disclosure of Invention

The aim of the invention is to establish an easy method of validation of video templates from various vendors and simplify the automated generation of appropriate video files in various output formats on the basis of such templates.

Method for video templates validation according to the invention refers to a video template which contains at least one scene with at least one variable and a checksum representing the sum of variables in all scenes of the template. This method is characterised in that it involves step of searching in the template being validated for all scenes and registering them as well as searching for the master scene within all registered scenes, step of analysis and registering of temporal relations among all registered scenes, step of searching for all variables within all registered scenes and registering them, analysis for variation ranges of registered variables, step of checking whether the template's checksum is consistent with the registered number of variables and step of external creation on the basis of template of the check file being validated. The check file contains a list of registered scenes with their temporal relations and their allowable variability ranges, as well as the list of variables registered for each scene with respective variability ranges.

In one of embodiments of the video template validation according to the invention additionally a "COPYRIGHT" information is searched within the template and if such information is found, it will be contained within the check file being created. In another embodiment of the video template validation according to the invention the check file is generated in XML format.

Method for video file generation according to the invention uses a video template and relevant multimedia resources. It comprises a step allowing the operator to define the final type of the video file and a step of automated rendering the finished file by a rendering module to which the multimedia resources and the video template containing information on the final video file being generated are sent. This method is characterised in that a video template with an external check file assigned to it is used. Such file contains a list of scenes contained within the template with their temporal relations and their allowable variability ranges, as well as the list of variables in each scene with respective variability ranges. Information on the final video file to be generated is external in relation to the control file template containing the selected variable values and temporal relations of the scenes. The control file is created within the final video file definition process on the basis of allowable variability ranges of data from the check file.

In one of embodiments of the method for video file generation according to the invention the check file in XML format is used.

In another embodiment of the method for video file generation according to the invention the control file is generated by means of an on-screen interface allowing the operator to select the required temporal relations between scenes, determine the values of variables in the scenes, preview the video material relevant to the selection made and accept it.

Server for generating finished video files according to the invention contains a rendering module using the multimedia resources and the video templates with information on the final video file to be generated. This server is characterised in that it comprises a validation module of a selected video template which creates an external check file for the template. The check file generated by this module contains a list of scenes found in the template with their temporal relations and their allowable variability ranges, as well as the list of variables from each scene with respective variability ranges. The server according to the invention also includes a module to create the control file on the basis of the check file generated by the server. The above mentioned control file contains selected values of variables and temporal relations of the scenes.

In one of embodiments of the server according to the invention it contains an onscreen interface allowing the operator to select required temporal relations between the scenes and the values of variables in the scenes, preview the video material relevant to the selection made and accept it.

Complementing the video templates by an additional check file containing a set of metadata allows to generate a video file in any output format. Using universal XML format for the check file allows to use the video template not only in rendering systems, but also in other systems for automated data processing and sharing. Moreover the additional XML check file provides functionalities which are currently not available in output formats of video files, such as interaction with the viewer. After the validation according to the invention is carried out, the video template and the complementary check file created in the process is given a standard format which fact opens broad market for individual creators of such templates, as the templates prepared by them will be able to be used by any rendering services vendor or virtual shop operator.

Mode for Carrying out Invention

Below the principles of the video template validation as per the invention are described. The computer system executing such validation is provided with video templates which can be prepared by independent authors in the form of a digital file. On the first stage a special program searches for all audiovisual scenes in this file. While a template may contain many such scenes, one of them must be the "master scene" containing appropriate complete scenes within the audiovisual sequences planned by the author of the template. Some of the scenes within the template are complete and may contain other complete scenes; other scenes are partial scenes comprising graphical layers which cannot be used on a stand-alone basis, as they are used for example to execute one visual effect which will never appear alone. The sequence is a set of several scenes planned by the author. The next step is to analyse the sequence of scenes and place them on the timeline. Simultaneous placement of the scenes in the form of layers on the timeline for a given sequence, but on different layers, relates to their alternativity, that is a case in which the viewer can select one scene while viewing by means of an audiovisual project template. Such possibility is referred to as "interactivity of sequence of scenes" which is not available in the current video creation programs. After all the scenes are analysed and the analysis' results are registered, the system searches for variables in each scene. The variables are defined as objects which can be altered within a project by the template user, such as text strings, bitmaps, vector graphics, features such as colours, transparency, hyperlinks (including target address and a clickable field) and embedded interactive elements (for example video, audio, Flash or JavaScript). After all the variables are registered, the system analyses their possible variation ranges.

Each complete scene contains the checksum indicating the number of variables contained within, while the master scene contains the checksum of the number of complete sequences used in the template. Thus the system checks whether the checksum written by the author in the template is consistent with the checksum computed on the basis of scenes and variables found by the system. Finally the system recognises the "COPYRIGHT" information (related to copyright) written in the template in a predefined manner and the template version.

All the above data are used to validate the video template and create the external MMXD (Multimedia Extension Data) check file which contains the list of registered scenes and their related temporal relations, allowable variability ranges and the list of variables registered for each scene, together with their allowable variability ranges. The MMXD file will not be created if the template contains less than one scene, each scene contains less than one variable, the template is saved in a format not compatible with the validation system, the template does not include copyright mark in any compatible format, the number of scenes is not consistent with the checksum saved in the sequence master file or the number of variables is not consistent with the checksum written in each scene or component sequence. The validated template and its relevant MMXD file can be used in a virtual video template shop as a standardised product.

Operation of the template validation system will be described in detail on the basis of a simple video template presented below and saved in popular After Effects CS6 format. The template comprises three scenes. One of the scenes is a main scene (<mainScene>) in which two sequences (<scene>) are nested. The main scene will last for 10 seconds at the rate of 25 frames per second (fps) and is natively prepared in the resolution of 1920x1080 pixels in 16 bit colour. The template foresees looping the scene after 10 seconds (<looped> = 10) and playing it indefinitely (<loopCount> = 0). The main scene consists of eight variables (<controlSum>). The <vars> section contains text, graphical and video variables; the text has the maximum length (<length>), selectable font options (<fontOption>), as well as the minimum and the maximum font size. In the main scene, in the <interactive> part, one scene can be selected which will be linked to by (<scene1 > or <scene2>). <scene1 > and <scene2> are inside <mainScene> which means that it is possible to access them from <mainScene> (nesting allows to create non-linear structures). <scene1 > has the resolution of UHD 3840x2160, has six variables and is looped in the 30th second. The <interactive> component is empty as this scene does not have interactive functions and when looped lasts indefinitely. The <scene1 > uses three graphical elements: the logo, the CEO photo and the background, as well as one video. <scene2> is similar to <scene1 >, but contains one additional variable, as there are two photos of products presented in the film being prepared instead of the CEO photo. This scene ends the sequence, as it is not interactive. At the beginning of the template file the parameters necessary for rendering the final sequence, that is a type of program in which the author has prepared the template (AE— AfterEffects), its version and plugins necessary to expand the rendering program graphical capabilities.

The above video template was validated automatically. After opening it, the system found three scenes (<mainScene>, <scene1 > and <scene2>), and according to their placement on the timeline the <scene1 > and <scene2> are subordinate to <mainScene>. Next the system recognised the technical parameters of all scenes on the basis of which the sections <requirements>, <renderer> and <rendererVersion> were rendered in the check file (MMXD). In each scene the text variables and their additional parameters (fonts and their minimum and maximum sizes) were recognised. Similarly, the interactive elements which allow the viewer to navigate the video presentation to <scene1 > and <scene2> and particular graphical/video elements with their path in media folder. Each of the recognition phases of information contained within the template ends with comparison of the number of variables in scene with the checksum in the template. Summary analysis of the above mentioned template was displayed to the operator who could correct it manually before they are approved and the system automatically generates the MMXD file in the XML format. Listing of this file is presented below:

<!-- Generated by MMXD validator v. 0.941 ->

<templateCopyright>Lev Tolstoy</templateCopyright>

<authorEmail>levt@gmail.com</authorEmail>

<plugin> <manufacturer>HitFilm</manufacturer>

<name>3D Extrusion</name>

</plugin>

<manufacturer>HitFilm</manufacturer>

<name>Bleach Bypass</name>

</plugin>

</plugins>

</requirements>

<conf>

</conf>

<vars>

<text>

<text>About Us</text>

<option>Arial</option> <option>Verdana</option> <option>Open Sans</option>

</fontOption>

<size>

</size>

</header>

<text>© by MyLargeCompany</text>

<option>Arial</option> <option>Verdana</option> <option>Open Sans</option>

</fontOption>

<size>

</size>

</footer>

</text>

<text>About Us</text>

<option>Arial</option>

<option>Verdana</option> <option>Open Sans</option> </fontOption>

<size>

</size>

<image>./img/button-about-us.jpg</image>

</select>

<text>Our Services </text>

<option>Arial</option>

<option>Verdana</option> <option>Open Sans</option>

</fontOption>

<size>

</size>

<link>scene2</link>

<image>./img/button-our-services.jpg</image>

</select>

</interactive>

<background>./img/back-main-scene.jpg</background> <images>

</images>

</graphics>

<video>./mov/video-main-scene.mov</video>

</videos>

</vars>

<scene>

<name>scene1 </name>

<conf>

</conf>

<vars>

<text>

<text>About Us</text>

<option>Arial</option> <option>Verdana</option> <option>Open Sans</option>

</fontOption>

<size>

</size>

</header>

<text>© by MyLargeCompany</text>

<option>Arial</option> <option>Verdana</option> <option>Open Sans</option>

</fontOption>

<size>

</size>

</footer>

</text>

</interactive>

</graphics>

<video>./mov/video001.mov</video>

</videos>

</vars>

</scene>

<scene>

<name>scene2</name>

<conf>

</conf>

<vars>

<text>

<text>Our Products</text>

<option>Arial</option> <option>Verdana</option> <option>Open Sans</option> </fontOption>

<size>

</size>

</header>

<option>Arial</option>

<option>Verdana</option>

</fontOption>

<size>

</size>

</footer>

</text>

</interactive>

<image>./img/product-001.jpg</image>

<image>./img/product-002.jpg</image>

</images>

</graphics>

<video>

<source>./mov/product-video-001.mov</source>

</video>

</videos>

</vars>

</scene>

</mainScene>

</scenes>

The above MMXD file contains only some of the available variables which will be described in more details below.

The text variable (<text>) defines the wording of the inscription, the font size, the type and where the text is to be placed. Each parameter of this variable has a determined range within which it can be changed; the font type is selected from a predetermined font list or from all fonts available in the system.

The variable <time> determines how long the scene lasts (its length) and can have the variability range determined for each scene.

The four variables presented below can have several alternative values foreseen to be selected by the user among those available in the template. Among these variables some predetermined relations can be defined; for example, if the video file No. 1 is assigned to the variable <video>, only the image 2, 3 or 4 will be selectable for the variable <image>. On the other hand, if the video file No. 2 is assigned to the same variable <video>, the variable <image> could represent only image No. 1 .

Apart from the possibility of assigning a determined video file, the video type variable (<video>) can define the minimum and the maximum field dimensions on the screen in which a file will be played. The lower range for these dimensions arises from the minimum acceptable video quality and the higher - from the system's capability limit or the highest quality determined by the user (size, the exceeding of which is not useful due to the planned final resolution).

The photo/bitmap image type variable (<image>) defines the displayed image file and minimum and maximum dimensions in the same manner as the <video> variable.

The vector image type variable (<vector>) allows to assign one of vector images available in the template.

The audio type variable (<audio>) represents an audio file selected from the files available in the template.

The <audio placeholder variable allows to add an own audio file and determine the maximum playing time.

The <layer visibility> variable determines the visibility of a given layer. For example, if this variable is set to (1 ), the layer is constantly visible, setting it to (0, 1 ) allows for the full visibility of a layer or zero visibility and setting it to (0,0.5, 1 ) allows for three variants: the layer can be invisible, semi-transparent (50% transparency) and fully visible.

The layer can also be used as a filter (<layer visibility>) and can have setting modification ranges determined (or lack thereof). This variable can have alternative presets assigned (for example presetl corresponds to the brightness of 75%, the contrast of 45%, red colour +10% saturation, preset2 corresponds to the brightness of 50%, contrast of 75%, red colour -10% saturation or preset3: filter off).

The variables <in> and <out> determine the loop start and their values are linked to temporal ranges (for example <in>00:00:40:00-00:00:50:00</in>, <out>00:01 :30:15-00:02:00:20</out>) which determine a part of a scene to be looped. The loop can have the value of "0" (infinite loop for which the value of the variable <loopCount> equals zero) or any positive total value determining the number of loops.

Nesting the scenes determines the allowable sequence of scenes played; one nested scene means that one particular scene will appear after a given scene, thus more than one nested scene of this type means that one of several scenes will appear after a given scene (in the above example two scenes are nested). The variable <link button> determines the address referencing to another scene, a website URL or any file in the internet (such as PDF) and makes an interactive function available. This variable contains a parameter to determine a graphical element used for a button (both raster and vector) and the number of text characters which can be displayed on this button.

The variable <audio button> allows to turn on and mute sound (<sound on> <sound off>) and determines which audio file from the previous variables will react on this button.

In the exemplary method of video file generation the user selects a video template in a virtual shop by means of a computer interface via a web browser. To facilitate the selection, a preview of video sequences containing exemplary variables, such as text and graphics can be used, while maintaining the main elements of a template such as graphics, font, colours and other elements constituting a coherent composition unchanged. The selection of a template from the shop causes a file to be opened by reading it from a disk resource, decompressing and loading it to the server's operating memory and then displaying the title scene in the web browser's window. The user can preview other scenes and modify their contents. The subtitles, that is their contents, on-screen position and font size, can be modified within the range imposed by a given template. Colours can also be modified. The template allows presets (proposed sets of colours, fonts and layouts of selected graphical elements - images, videos and audio elements) to be used. A video template can use so called masks, that is predetermined shapes in which graphic elements, images or videos are to be displayed. The user can select the mask's parameters, its contents, object's transparency and - in case of video files - length. The user can also determine the order of scenes or sequences. Moreover hyperlinks and selection fields are available to control the scene preview (stopping, playing, skipping to the end), as well as to select the next scene if allowed by the template. An exemplary template edit interface allows the user to:

- edit the order of the scenes or sequences between them, thus a framework of a video presentation can be created on the screen; scenes within such framework are presented as rectangles containing their respective visualisations, sequences are represented as rectangles which include several scenes (also represented by rectangles) and the relations between scenes and sequences are shown by lines.

- edit the scenes in the form of a standard timeline with video, audio, graphic and interaction layers;

- edit the components - sliding, cropping, scaling, turning and other methods of text, image and video manipulation typical for graphic editing software.

After the template is edited, the user saves the control file which describes the modification introduced in a given template. Such control file must always function with the original template and linked multimedia resources, as it cannot be used on a stand-alone basis.

The template edit module sends the template file and the control file to the video file rendering server which creates all sequences selected by the user from the template. The rendering farm queues the rendering tasks and creates files according to the order of sending. These files are rendered in the quality determined by the user. It is possible to generate very high quality files (FullHD or 4K) if the variables used are described by vector image files or bitmaps in appropriate quality. The rendered files are saved on a disk resource in a cloud which handles Content Delivery Network (CDN). The user can download finished files on his/her local hard disk to play them offline or to process them further. The user can also publish these files in an interactive video player which allows to view video presentations in a non-linear manner.

Claims

1. A method for validation of a video template which contains at least one scene with at least one variable and a checksum representing the sum of variables in all scenes of the template, characterised in that it comprises the following steps: a) step of searching in the template being validated for all scenes and their registration and searching for the master scene within all registered scenes, b) step of analysing and registering of temporal relations between all registered scenes,

c) step of searching for all variables within each registered scene and registering them,

d) step of analysing the variability ranges of the registered variables,

e) step of checking whether the template's checksum is consistent with the registered number of variables,

f) step of creating a check file, external in relation to the template being validated, containing the list of registered scenes with their temporal relations and their allowable variation ranges, as well as the list of variables registered for each scene with respective variation ranges.

2. The method for template validation according to Claim 1 , characterised in that additionally a "COPYRIGHT" information is searched within the template and if such information is found, it will be contained within the check file being created.

3. The method for template validation according to Claim 1 or 2, characterised in that the check file is generated in XML format.

4. A method for video file generation utilising a video template and multimedia resources linked to it, comprising the step allowing the operator to define the final form of the video file being generated and a step of automated rendering of the finished video file by means of a rendering module to which multimedia resources are sent and a video template containing the information on the final form of the video file being generated, characterised in that the video template with complementary external check file containing a list of scenes included in the template and their temporal relations and allowable variability ranges of these relations and a list of variables of each scene with their allowable variability ranges is used, while the information on the final video file being generated has the form of a control file external in relation to the template which contains selected variable values and temporal relations of scenes and the control file is generated on the stage of defining the final form of the video file being generated on the basis of allowable data variability ranges from the check file.

5. The method for file generation according to the Claim 4, characterised in that the check file is generated in XML format.

6. The method for file generation according to Claim 4 or 5, characterised in that the control file is generated by means of an on-screen interface allowing the operator to select the required temporal relations between scenes, determine the values of variables in the scenes, preview the video material relevant to the selection made and accept it.

7. A server for generating finished video files containing a rendering module utilising multimedia resources and a video templates with information on the final video file to be generated, characterised in that it additionally contains:

a) a module for validation the selected video template creating a check file external in relation to the template, which contains a list of scenes found in the template with their temporal relations and their allowable variation ranges, as well as the list of variables from each scene with their allowable variation ranges, b) a module for creation a control file containing the selected variable values and temporal relations of scenes on the basis of data from the check file.

8. The server according to Claim 7, characterised in that the module for creation a control file contains an on-screen interface allowing the operator to select the required temporal relations between the scenes and the values of variables in the scenes, preview the video material relevant to the selection made and accept it.