WO2016128984A1

WO2016128984A1 - Customized, personalized, template based online video editing

Info

Publication number: WO2016128984A1
Application number: PCT/IL2016/050175
Authority: WO
Inventors: Yoni SONNENSCHEIN; Elazar NAAMAN
Original assignee: Moviemation Ltd.
Priority date: 2015-02-15
Filing date: 2016-02-15
Publication date: 2016-08-18
Also published as: WO2016128984A9

Abstract

A high quality video editing platform and service for the unprofessional user for producing customized, personalized, self-prepared video based on existing video template library. The platform and service enable adjusting fixed template, length video and place holder amount changes according to user preferences and requirements. The platform and service also provide personalized capabilities in video editing either according to user instructions or by self-learning or automated process based on personal material that the user uploads. Further, automatically produced video based on personal material retrieved from any online and offline available sources (e.g., databases, user input, social network, personal computer etc.) and selected video template(s) is provided by the platform and service.

Description

Customized, Personalized, Template Based Online Video

Editing

Technical Field

The present invention pertains to editing video movies. More particularly, the present invention pertains to cloud-based platform and method for customizing, personalizing and adjusting structured video templates according to user requirements.

Background

Online video editing is usually performed with media layer combination technology. After a user uploads images and video clips, a currently offered video editing platform generates a presentation of all files uploaded, combines them together with transition sections and implements filters and video or animation effects to produce a professionally looking movie. The insertion/addition of the transition sections is made with

mathematical algorithm not integrated into the professional video editing software used. Such technology is of limited use in the professional video editing industry, in which advanced software tools are implemented, providing various ways for professional quality video editing.

There is, therefore, a need to provide a high quality video editing platform and service for the unprofessional user for producing customized, personalized, self-prepared video based on existing video template library

It is yet another objective of the present invention that the platform and service enable adjusting fixed template, length video and place holder amount changes according to user requirements

Still another objective of the present invention is that the platform and service of the present invention provide personalized capabilities in video editing either according to user instructions or by self-learning or automated process based on personal material that the user uploads.

Still another objective of the present invention is that the platform and service of the present invention automatically produce video based on personal material retrieved from any online and offline available sources (e.g., databases, user input, social network, personal computer etc.) and selected video template(s).

Still another objective of the present invention is that the platform and service enable attaching block video movies, e.g. different video templates, to each other.

This and other objectives and embodiments of the present invention shall become apparent as the description proceeds. Summary

In one aspect, the present invention, also referred to as MovieMation™, is a cloud-based SaaS (Software as a Service) platform that provides online interface for video editing to a user. User activities in online mode are received at the server end, where they are translated to professional video editing by performing advanced manipulation on photos, videos, texts and sound and incorporating them in exclusively video format entitled to MovieMation™. There are mainly two ways for rendering a final video:

1. Interacting with the SDK (Software Development Kit) of professional video editing software programs, e.g. Adobe After Effect, or by template analysis with externally provided and developed tools by MovieMation™. The analysis produces metadata on the templates that enable rendering the video with external video encoder of

MovieMation™.

2. Linking with SDK of professional video editing software with dedicated plugin. The video is then rendered within the editing software itself. The platform of the present invention provides customized and personalized capabilities that enable creating and editing feature and time-length video based on preset video templates stored in the platform library and user's videos and photos. This way, a user is provided the benefits of a professionally edited and scripted video template library together with the capability of adapting any selected video to his request.

Accordingly, in one embodiment, the platform of the present invention provides simplicity of service to end-users through user-friendly interface, yet capable of producing professionally looking video using professional video editing software supported by and running on strong server system. Most video editing tools are freely provided alongside certain other premium tools for higher product quality.

In still another embodiment, the platform offers guidance and support throughout the creation and editing of a video. Specifically and in line with the customization and personalization of preset video templates, a user is guided throughout a structured script particular for the video selected. This helps him in composing a thought-through, professional look and feel video.

In still another embodiment, the platform is available through internet connection without any add-ons and accessible through any browser and OS (Operating System). The platform is also compatible with all types of devices with sufficient computation capabilities and internet access. This includes but not limited to, smartphones, tablets, i- pads, laptops, home computers, all with wire or wireless communication as the case may be.

Accessibility advantage provided by the platform arises from the load distribution between lightweight user graphic interface on the user end and software processing based on strong server support. Further, users enjoy the benefit of professionally designed preset video templates and guided scripting in the editing process together with introducing their personal requirements. The platform, therefore, interfaces between layman users and highly professional video designs made by video designers worldwide.

Other benefits of the platform and service of the present invention include but are not limited to:

• Optimization of video template selection using preliminary questionnaire aimed at advising users on the template best suitable for their needs;

• Script structuring accompanying users throughout the creation and editing process of their video;

· Video features modification on top of introduction of personal content, including limitless amount of content introduced and varying video time length;

• Adjusting any particular video to multiple users, e.g., personal greeting, graphics, in a fast responsive user-friendly interface;

• Automatic video editing based on personal material retrieved from different sources such as social networks, personal computer, including functionalities such as image and face recognition applied to personal photos and video;

• Real-time video editing introducing updated personal items into the video retrieved from particular webpage;

• Saving a re-editing process with automatic editing;

· Automatic and recurring editing of personalized and customized video based on

newly uploaded data retrieved from accessible sources, e.g. user posts and pages on social networks.

In view of the above and in one embodiment, the SaaS platform of the present invention provides a library of ready-made video adaptable to integrate with user personal content uploaded at the user end. In still another embodiment, the platform enables customizing basic and advanced features of any one of the video according to user preferences. In still another embodiment, the platform is configured to customize presentation of user content in any type of video based on characteristic analysis of user uploaded content and graphical parameters considered for most suitable presentation. For example, the color of user logo may be adapted to background color provided by the video selected. In another example, the platform may adjust the length of time of the video to the amount of content uploaded. Accordingly, the video attribute values are dynamically adjustable to user requirements. Thus, for example, the time length of a video for displaying a photo album is extendable according to the number of photos introduced without compromising the integrity of the theme of the video template, maintaining the photo display smooth and continuous throughout. The platform of the present invention, therefore, provides flexible video editing based on preset video. In view of the above, in one aspect, the platform of the present invention enables modifying any of the video templates according to parameter values that a user enters when editing a video. In particular, the platform optimizes any modification by analyzing the template layers while considering different attributes as required for retaining the integrity of theme of the video template and professional look and feel video. Such attributes are selected from, but not limited to, background colors, transition sections and effects that are dynamically modified when processing user editing actions.

In view of the above the platform has the following three main capabilities:

1. Cutting and cropping - The platform is configured to remove parts and sections from template for maximum match to volume of personal material a user uploads and insert transition sections adjusted to any particular selected template to provide continuous video stream. While adjusting a template, the platform is also configured to maintain or introduce video elements in a more complex template, e.g. varying camera angle, advanced filters and so on.

2. Inserting - The platform is also configured to add parts and sections to the template for maximum match to volume of personal material a user uploads without compromising the integrity of the template theme. For example, the platform will duplicate and/or replicate relevant parts and sections of a template to comfortably match a volume of image, text and video items a user uploads for continuous and aesthetic presentation while retaining the template integrity of theme. Extending - The platform is also configured to extend sections selected in a template for maximum match to volume of personal material a user uploads. For example, the platform is configured to extend relevant parts and sections of a template for video items longer than what the template can contain or when extending presentation of sequence of items, e.g. texts, images, is desired, while keeping the template itself uniform and retaining the integrity of its theme. The action of extending a template comprises adjusting backgrounds and filters and extending other elements such as text and image items. In one particular embodiment, the platform is configured to analyze the soundtrack of the original template and adjust it to the modified template for maximum match with user uploaded material and continuous and uniform presentation when activating each one of the capabilities detailed above. The adjusted soundtrack is made while retaining the integrity of theme of the template.

In another aspect in line with the flexible and adaptable characteristics of the platform, the present invention provides Cloud On Demand approach, which is suitable for assessing the amount of computation and storage resources required for any particular personalized and customized video at the server end. Accordingly, the platform is configured to analyze different features related to the user-selected video. Such features may be the required time length, the length of media parts the user uploads and so on.

In still another aspect, the personalizing capability of the platform is also expressed in automation mechanism for automatic editing of video based on user history of actions and selections. Thus, in one embodiment, the platform learns and stores user decisions, selections and preferences and applies them to recurring or new video editing work received from the user end. The automation mechanism, therefore, comprises identification module that analyzes user requests and automatically adapts preset elements and attributes of any selected video template to user-identified characteristics. In still another aspect, the platform comprises pre- and post- editing manipulation module for advanced video editing, including text, pictures, audio and video all of which are not enabled in any professional video editing software. Such module is configured to edit video elements and integrate them within the video in a transparent fashion, not noticeable to the user.

The following is a mockup interface that exemplifies the capabilities of the present invention in editing and personalizing a video. The specific topic is a personal blessing exchange between couples. The sender enters a title, his/her name, her/his couple name and one or two blessings (optionally character number limited). Then the sender enters photo sequence or video and personalizes the appearance of the textual blessing and video within the limitations of the video attributes, including the length of time of the video.

Couples Blessing Video Clip

Title

Your name Your couple name

Blessing A 200 characters

Blessing B 200 characters

Upload photos/images/video

Photos, text, video, icon, color scheme selection, images, animation, cartoons and other options are made available to the sender for customizing and personalizing the video. Such options are made available in other video templates depending also on the topic of the template itself. In still another embodiment, the platform displays the edited video on its landing page to the user, enabling post-editing functionalities of the video such as video quality enhancement, video download and logo clipping.

The following relates to the accompanying Figures without departing from the spirit and scope of the invention as detailed above.

Brief Description of the Drawings

Figs. 1-10 are screenshots of the user interface of the present invention on which a user inputs personal details, uploads personal material, and displayed with instructions and options to select a video template and edit, customize and personalize it.

Fig. 11 is a list of main actions on the platform servers' end, according to user editing, customization and personalization actions on a selected video template.

Fig. 12 schematically illustrates the server end of the platform of the present invention.

Detailed Description of the Drawings

The following describes the Figures listed above in more detail. Fig. 1 shows the homepage screen of the user interface for accessing the platform including video preview and main setting menus, e.g. movie, logo, color etc. The platform supports all types of "After Effect" templates such as slideshows, whiteboard animation, infographics (information graphics), animation packages etc., all allowing a user to introduce custom animation and graphics adapted to his needs into a selected video.

Fig. 2 is a screenshot interface for customizing appearance of user logo. Placeholders guide the user to introduce the personalized logo. Color matching between logo and background is shown in Fig. 3, where the default background can be selectively cut and replaced with color-adjusted background automatically according to software programmed design rules. Further color customization is shown in Fig. 4, where the platform generates a color scheme or theme by applying the dominant colors of the logo to the video. Manual customization, however, is also made available to the user in any case he wishes to make further adjustment or alteration to the color scheme suggested by the video editing software.

The intuitive step-by-step guiding interface that the platform displays to the user is shown in Figs. 5A and 5B. Structured scripting is realized by responding to user actions in editing the video, holding on and displaying proper placeholders instructing the user to upload personal material or introduce text or design choice.

Further personalization capabilities are listed and exemplified in the screenshots in Figs. 6A-6B. Automatic language detection and corresponding video adjustments are made available to the user. Thus, language display attributes may be adjusted to any selected font type, size and match to any one of the platform templates, particularly a specific elected template. Further, the platform also facilitates communication with various information sources and devices for uploading personal material and introducing it to any elected template. Another way of importing personal material is exemplified in Fig. 7 by inserting the location of such material. The platform then accesses the proper url, retrieves the files of the video, image, photo and/or audio and introduces them to the requested location in the video template according to user instructions. Further, Fig. 9 exemplifies that the platform also enables importing screenshot of any website or webpage by accessing their url and introducing them into the video template. The examples shown in Figs. 7 and 9, illustrate enhanced customization and personalization capabilities of the platform practically allowing the user to use a framework that is both structured but widely flexible to adapt to any uploaded content. URL access is also enabled by the platform to locate geographical places and introduce aerial or any other views into the selected video template as exemplified in Fig. 10. That is, the platform is configured to interface with various web applications, retrieve graphical, visual, audible, textual and any other data from them and upload and adjust it to any particular video template of its template library. Further, personalization of video template is made available through the platform interface that receives user personal data and customizes the template accordingly as shown in Fig. 8. Fig. 11 lists a number of the platform functionalities exemplifying its flexibility within a structured framework. Thus, video editing is accelerated with a plurality of

simultaneously operating servers, and video template, although already designed, is flexible enough to receive as many types of user personal data as the user wishes, while still maintaining the video main theme. Further adjustments that the platform enables are addition of subtitles, and automatic face recognition. As listed in Fig. 11, the platform automation capabilities also include template editing (116) based on retrieval of personal material from online and offline sources, applying identification and analysis functionalities for appropriately selecting and uploading the right material (111, 112, 113). This also relieves some of the video editing workload from a user and can be carried out by an array of servers (110) for reducing time of rendering to only a few minutes. Further, the platform enables post-editing option of already personalized video and maintaining it in several versions for the user's choice (114). Recurring automatic editing is also made available by the platform, where the user wishes to update the video based, for example, on material newly uploaded to a social network (115). In addition, the platform is also configured to integrate API (Application Programming Interface) (117) for future development of editing toolkit offered to the user.

Fig. 12 is a schematic illustration of the platform server end. Workflow normally starts by receiving and transmitting user commands and uploaded information such as video, audio, pictures and text. Blob Store (Binary Large OBject) (121) receives the uploaded information from Cloud-based CDN (Content Delivery/Distribution Network) (120) that transmits it to cloud DB server (122). Sorted items are sent for editing to sound, video and text engines (124, 125, 126, 127), received and communicated (123) to the render engines (128) for introducing them into the selected video. After Effect Video templates/template's metadata are called upon request of a user and transmitted through a second Blob store (130). An array of after effect's/MovieMation's render engines accelerates the editing process by the software installed on a multi-tenant server (129) configured for simultaneous video editing for a plurality of users.

Video templates may be retrieved as prepared templates from the video editing software, which is made accessible to the editing platform or the metadata are provided to the system for accessing externally available templates on cloud-based database (131).

Although selected embodiments of the present invention have been shown and described, it is to be understood the present invention is not limited to the described embodiments. Instead, it is to be appreciated that changes may be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and the equivalents thereof.

Claims

A system for online video editing comprising:

server system comprising;

video template library, each video template in said library comprising preset theme and attributes;

video editing software configured for editing, customizing and personalizing video template selected from said video library;

data relay and sorting server system configured for communicating data and user editing instructions to said software and transmitting interface graphics for video editing to user interface;

and

user graphic interface configured for communicating with said server system, displaying selected video template from said video library and menus and graphic tools to a user for customizing and personalizing said video according to user input, wherein said system is configured to adjust values of any one of said selected video template attributes according to user request or personal material said user uploads, wherein adjusting said values retains integrity of said theme of said selected video template.

The system of claim 1 , configured for modifying any one of said video templates according to parameter values received with said editing instructions.

The system of claim 2, configured for optimizing any modification by analyzing layers of any one of said templates while considering different attributes as required for retaining said integrity of theme of said video template and professional look and feel video.

4. The system of claim 3, wherein said attributes are selected from background colors, transition sections and effects that are dynamically modified when processing user editing actions.

5. The system of claim 1, wherein said modifying comprises cutting and cropping, inserting and extending parts and sections of said video template according to volume of said personal material while retaining said template uniform and continuous.

6. The system of claim 5, further configured to analyze soundtrack of said template and adjust it to modified template for maximum match with user uploaded material and continuous and uniform presentation.

7. The system of claim 1, wherein one of said attributes is time length of said selected video template.

8. The system of claim 1, further configured for automated recurring video editing, comprising data retrieval from online and offline databases and updating edited video with newly uploaded data.

9. The system of claim 1, wherein said data comprises video, picture, graphic and text items.

10. The system of claim 1, further configured for introducing customized and

personalized animation into selected video template.

11. The system of claim 1, further configured for adjusting color scheme according to user preferences or design rules embedded in said video editing software.

12. The system of claim 11, wherein said adjusting of color scheme is automatically applied by said video editing software.

13. The system of claim 11, wherein said color scheme is adjusted to user logo.

14. A method for online customized and personalized video editing comprising:

displaying video template list on a user graphic interface;

- enabling a user to select video template independently or upon recommendation after receiving said user response to preliminary questionnaire;

providing said user with graphic tools and functionalities for uploading personal material and customized graphics;

uploading said selected video template from video template library at a server system;

receiving user editing instructions and personal material at said server system; editing said selected video template with a video editing software at said server system;

adjusting attribute values of said selected video template according to said graphic instructions and personal material, while maintaining integrity of theme of said selected video template;

rendering edited, customized and personalized video and storing in database of said server system; and

displaying said edited, customized and personalized video on said user graphic interface and enabling download thereof to user data storage device.

15. The method of claim 14, wherein said method comprises modifying any one of said video templates according to parameter values received with said editing instructions.

16. The method of claim 15, wherein said modifying comprises optimizing any

modification by analyzing layers of any one of said templates while considering different attributes as required for retaining said integrity of theme of said video template and professional look and feel video.

17. The method of claim 16, wherein said attributes are selected from background colors, transition sections and effects that are dynamically modified when processing user editing actions.

18. The method of claim 14, wherein said modifying comprises cutting and cropping, inserting and extending parts and sections of said video template according to volume of said personal material while retaining said template uniform and continuous.

19. The method of claim 18, further comprising analyzing soundtrack of said template and adjust it to modified template for maximum match with user uploaded material and continuous and uniform presentation.

20. The method of claim 14, wherein one of said attributes is time length of said video template.

21. The method of claim 14, wherein said graphic tools are selected from color scheme and animation.

22. The method of claim 14, wherein said personal material comprises video, picture, graphic and text items.

23. The method of claim 14, further comprising:

retrieving personal material from user online and offline sources; and

editing said video template;

24. The method of claim 23, wherein said editing is automated recurring editing.

25. The method of claim 14, wherein said rendering is done by interacting with SDK of professional video editing software program or by template analysis with externally provided and developed tools, wherein said analysis produces metadata on said templates, said analysis enabling rendering said video with external video encoder.

26. The method of claim 14, wherein said rendering is done by linking with SDK of professional video editing software with dedicated plugin, wherein said video is rendered within said video editing software.