WO2016155505A1

WO2016155505A1 - 3d animation editing method based on mobile terminal

Info

Publication number: WO2016155505A1
Application number: PCT/CN2016/076587
Authority: WO
Inventors: 陈军宏
Original assignee: 厦门幻世网络科技有限公司
Priority date: 2015-03-27
Filing date: 2016-03-17
Publication date: 2016-10-06
Also published as: CN104732593B; CN104732593A

Abstract

A 3D animation editing method based on a mobile terminal, comprising: selecting a 3D animation material (101); processing input 3D animation editing information, the 3D animation editing information comprising text addition information and/or image editing information and/or voice processing information (102); running a 3D animation recording program, and acquiring current 3D rendering image data, currently played audio data and current recording data (103); according to the 3D animation editing information, performing rendering fusion processing on the image data and processing the audio data, and generating an image code and an audio code from processing results respectively (104); and generating corresponding videos according to the image code and the audio code (105). The method enables a user to make a 3D animation-based individualised video via a mobile terminal and to share the video to other application platforms.

Description

A 3D animation editing method based on mobile terminal

Technical field

The invention relates to a method for editing 3D animation, in particular to a 3D animation editing method based on a mobile terminal, which can make a 3D animation into a video format for sharing to other application platforms.

Background technique

As more and more animations use 3D to vividly display the content of the animation, when users enjoy 3D animation, they will inevitably have the idea of editing a 3D animation by themselves while admiring the animation effect.

In the prior art, there are many animations presented in 3D form, but adding elements such as sounds or characters to these animations generally needs to be added by professional equipment or professionals, and can only be viewed and enjoyed by ordinary users, but cannot Edit 3D animations in a simple and convenient way, adding the elements you want to add to the animation. On the other hand, current 3D animations are restrictive in communication and can only be played on specific platforms, and their propagation has limitations.

Summary of the invention

The object of the present invention is to overcome the deficiencies of the prior art and provide a 3D animation editing method based on a mobile terminal, which can conveniently perform 3D animation editing on a mobile terminal, add elements that it wants to add in the animation, and convert In the video format, it can be played on various communication platforms.

The technical solution adopted by the present invention to solve the technical problem thereof is: a 3D animation editing method based on a mobile terminal, comprising the following steps:

Select 3D animation material;

Processing the input 3D animation editing information including text addition information and/or image editing information and/or voice processing information;

Running a 3D animation recording program to obtain current 3D rendered image data, currently playing audio data, and current recording data;

Rendering and blending image data according to 3D animation editing information and rendering and blending the audio data, And the processed result respectively generates image coding and audio coding;

The corresponding video is generated by image encoding and audio encoding.

Further, the method further includes the following steps:

Processing the input 3D animated video editing information, the 3D animated video editing information including text adding information and/or voice processing information;

Running a 3D animation video recording program to obtain current 3D video image data, currently playing audio data, and current recording data;

Performing a rendering fusion process on the image data according to the 3D animation video editing information and performing a rendering fusion process on the audio data, and respectively generating the image encoding and the audio encoding according to the processed result;

The corresponding video is generated by image encoding and audio encoding.

The selected 3D animation material includes: capturing 3D animation material from a storage area of the mobile terminal or acquiring 3D animation material through a remote network or directly pushing the system to obtain 3D animation material.

The running 3D animation recording program screens each frame of the 3D animation to form a frame image, and encodes and generates a video according to the order in which each frame image is captured.

The text addition information includes the content added by the text, the time when the text appears, and the manner in which the text appears.

The rendering fusion processing of the audio data includes processing of background music and/or processing of recorded information.

The rendering and fusing processing on the audio data includes the following steps:

Input sound data;

Noise reduction, echo cancellation, automatic gain processing;

Stylized processing;

Output audio data.

The rendering and fusing processing on the audio data includes processing the recorded information, and the processing of the recorded information includes the following steps:

Comparing the waveform of the obtained sound waveform information with the standard sound waveform;

The animation having the corresponding lip shape in the 3D animation material is retrieved according to the comparison result, and is applied to the character model of the 3D animation material in the rendering fusion processing on the image data.

The rendering and blending processing of the image data according to the 3D animation editing information includes adding text to the input text adding information and/or performing animation effect addition and/or image filter processing and/or 3D according to the editing elements generated by the image editing information. Character replacement.

The processing of adding text to the input text adding information includes the following steps:

Enter a text stream;

Generate a stream of text images;

The fusion processing is rendered in the corresponding image data according to the selected text display mode.

The image filter processing includes the following steps:

Get image data;

Stylize image data;

Generate stylized images.

The 3D character replacement includes the following steps:

Choose a person;

Get the character;

Replace the original character in the 3D animation material with the selected character.

The rendering and processing of the image data according to the 3D animation editing information and the processing of the audio data further include a process of automatically parsing the input text content and the recorded audio content and matching the corresponding image position.

The beneficial effects of the invention are:

1, can provide users with rich 3D animation material and editing functions;

2, can achieve the editing of 3D animation on the mobile terminal;

3. Ability to share edited 3D animations to other application platforms.

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments; however, a mobile terminal-based 3D animation editing method of the present invention is not limited to the embodiment.

DRAWINGS

1 is a flow chart of Embodiment 1 of the present invention;

2 is a flow chart of Embodiment 2 of the present invention.

detailed description

Embodiment 1

Referring to FIG. 1 , a mobile terminal-based 3D animation editing method of the present invention includes:

Selecting 3D animation material; as shown in block 101 of Figure 1;

The selected 3D animation material includes: capturing 3D animation material from a storage area of the mobile terminal or acquiring 3D animation material through a remote network or directly pushing the system to obtain a 3D animation material;

3D animation material In the selected number, the user can select a 3D animation material or several 3D animation materials, and the number of selected 3D animation materials is not limited; when the selected 3D animation material quantity is greater than 1, The user can decide the sorting of the 3D animation material by himself, or sort the animation according to the order in which the user selects the 3D animation material;

After the user selects the 3D animation material, the selected 3D animation material can be previewed in the preview window;

The content of the animation options provided in the storage area of the mobile terminal is a 3D animation, most of which is an animation containing a 3D dynamic portrait, which may be a character image created by the user using his own image, or may be a user. Characters created using other images;

The input 3D animation editing information is processed, and the 3D animation editing information includes text adding information and/or image editing information and/or voice processing information; as shown in block 102 in FIG. 1; in this step, it may be Text input information input, image editing information input, and voice processing information input; also one of them, or a combination of two; for example, text addition information and image editing information, image editing information, and voice processing information, etc. ;

The text addition information input includes the content added by the text, the time when the text appears, and the manner in which the text appears; the editing information input includes the content of the editing element, the time when the editing element appears, and the manner in which the editing element appears, and the editing element may be an animation effect addition. It can also be a picture filter, or it can be a 3D character replacement, etc.

Before the 3D animation recording, the user can trigger the text input command to input the text, and the input text can be displayed in the animation, and the display effect, display time and display mode of the text can be freely selected by the user;

Run 3D animation recording program to get current 3D rendered image data, currently playing audio data and current recording Tone data; as shown in block 103 of Figure 1;

During the recording of 3D animation, the user triggers a voice input command to perform voice input or simultaneously plays audio during the process of recording a 3D animation, that is, in the recording process of the 3D animation, there is a sound other than the sound of the 3D animation itself. At the same time as the sound is emitted, the 3D animation contains 3D dynamic portraits. The 3D portrait's mouth shape can be changed according to the user's input voice condition. At this time, the 3D animation after recording becomes a 3D portrait mouth type user input. The video of the audio change; for example, a volume value is preset, and when the sound input by the user is larger than this value, the mouth shape of the 3D portrait changes greatly, and if the sound input by the user is smaller than this value, the mouth of the 3D portrait The type of change is small, and these changes will be reflected in the video after the recording is completed;

During the video recording process, the user can also select audio effects (such as male, female, old, young, cartoon, etc.), whether to turn on the sound of the 3D animation, whether to add a filter effect, and which one to add. Filter effects, adding background music, etc.

Performing image fusion processing and processing of the audio data according to the 3D animation editing information, and respectively generating image encoding and audio encoding as shown in block 104 of FIG. 1;

The process includes:

The fusion of text and video: the way the text is displayed (including the display effect, display time, etc.) can be selected by the user at the time of the above editing, or by automatically parsing the content of the text during the rendering integration process in this step. Video integration during recording; in the process of automatic parsing, the system analyzes the text content, and automatically matches the text and animation by comparing and analyzing the content of each frame of the video;

The fusion of sound and animation: (1) The time when the sound appears: During the process of rendering the animation, the time of the sound may appear according to the time previously input by the user, or may be automatically performed according to the content of the audio and the video recorded in the editing. Matching, the time when the audio appears is better integrated with the dynamic content in the video, and the better-performing video is generated; (2) the way the sound appears: in the process of fusion processing, the filter pair can also be used according to the user's choice. The sound input by the user performs various kinds of sound processing;

The corresponding video is generated by image encoding and audio encoding; as shown in block 105 of FIG.

Input sound data;

Noise reduction, echo cancellation, automatic gain processing;

Stylized processing;

Output audio data.

Enter a text stream;

Generate a stream of text images;

The image filter processing includes the following steps:

Get image data;

Stylize image data;

Generate stylized images.

The 3D character replacement includes the following steps:

Choose a person;

Get the character;

Performing a rendering fusion process on the image data according to the 3D animation editing information and processing the audio data, and further The process of automatically parsing the input text content and the recorded audio content to match the corresponding image position.

The 3D animation editing method based on the mobile terminal of the present invention is to edit the 3D animation in the process of converting the 3D animation format into a video, that is, the calculation unit of the mobile terminal performs the 3D animation recording, and the conversion manner thereof Each frame of the 3D animation is screened to form a frame image, and encoded in the order in which each frame is captured to generate a video.

Embodiment 2

Referring to FIG. 1 and FIG. 2, a 3D animation editing method based on a mobile terminal of the present invention includes the following steps:

Select 3D animation material;

The input 3D animation editing information is processed, and the 3D animation editing information includes text adding information and/or image editing information and/or voice processing information; in this embodiment, there is no editing information input in the step;

Running the 3D animation recording program to obtain the current 3D rendered image data, the currently played audio data, and the current recorded data; since there is no voice processing information input in the previous step, there is no current recorded data in this step;

The image data is subjected to rendering fusion processing and audio data processing according to the 3D animation editing information, and the processed result respectively generates image encoding and audio encoding; since there is no editing information input in the previous step, the step is only for the original 3D animation. The material is transformed into a video;

Generating a corresponding video by image encoding and audio encoding;

Since the foregoing steps are not edited in the process of converting a 3D animation format into a video, in the process of rendering and blending image data and processing the audio data, there is no need for text and video rendering fusion and sound and animation. Rendering fusion.

This embodiment further includes:

Processing the input 3D animated video editing information, the 3D animated video editing information including text adding information and/or voice processing information; as shown in block 201 of FIG. 2;

Running a 3D animation video recording program, acquiring current 3D video image data, currently playing audio data, and current recording data; as shown in block 202 of FIG. 2;

Performing rendering fusion processing on the image data according to the 3D animation video editing information and performing rendering fusion processing on the audio data, and respectively generating image encoding and audio encoding according to the processing result; as shown in block 203 in FIG. 2;

The corresponding video is generated by image encoding and audio encoding; as shown in block 204 of FIG.

Among them, the processing of the audio information only includes the processing of the background music and/or the processing of the recorded information, and the lip shape change in the 3D animation cannot be processed.

The processing of image data also includes only text addition.

In processing the image data and processing the audio data, a process of automatically parsing the input text content and the recorded audio content and matching the corresponding image position is also included.

The editing of the above 3D animation is performed after conversion to video, so only text can be added and background music added and/or recorded information can be added, and the effect of 3D animation cannot be edited.

Embodiment 3

Referring to FIG. 1 and FIG. 2, a 3D animation editing method based on a mobile terminal of the present invention includes editing a 3D animation in a process of converting to a video as in the first embodiment, and as in the second embodiment. The 3D animation is converted to a video for editing.

The foregoing embodiment is only used to further describe a mobile terminal-based 3D animation editing method of the present invention, but the present invention is not limited to the embodiment, and any simple modification or equivalent to the above embodiment according to the technical essence of the present invention is provided. Variations and modifications are within the scope of protection of the technical solutions of the present invention.

Claims

A 3D animation editing method based on a mobile terminal, comprising the following steps:

Select 3D animation material;

Processing the input 3D animation editing information including text addition information and/or image editing information and/or voice processing information;

Running a 3D animation recording program to obtain current 3D rendered image data, currently playing audio data, and current recording data;

Performing a rendering fusion process on the image data according to the 3D animation editing information and performing a rendering fusion process on the audio data, and respectively generating the image encoding and the audio encoding according to the processed result;

The corresponding video is generated by image encoding and audio encoding.
The mobile terminal-based 3D animation editing method according to claim 1, further comprising the following steps:

Processing the input 3D animated video editing information, the 3D animated video editing information including text adding information and/or voice processing information;

Running a 3D animation video recording program to obtain current 3D video image data, currently playing audio data, and current recording data;

Performing a rendering fusion process on the image data according to the 3D animation video editing information and performing a rendering fusion process on the audio data, and respectively generating the image encoding and the audio encoding according to the processed result;

The corresponding video is generated by image encoding and audio encoding.
The mobile terminal-based 3D animation editing method according to claim 1, wherein the selected 3D animation material comprises: capturing 3D animation material from a storage area of the mobile terminal or acquiring 3D animation material through a remote network or utilizing The system directly pushes the way to get 3D animation material.
The mobile terminal-based 3D animation editing method according to claim 1, wherein the running 3D animation recording program is to take a frame of each frame of the 3D animation to form a frame image, and intercept each frame image. The order is encoded to generate the video.
The mobile terminal-based 3D animation editing method according to claim 1 or 2, wherein: The text addition information includes the content added by the text, the time when the text appears, and the way the text appears.
The mobile terminal-based 3D animation editing method according to claim 1 or 2, wherein the performing rendering fusion processing on the audio data comprises processing the background music and/or processing the recorded information.
The mobile terminal-based 3D animation editing method according to claim 6, wherein the performing rendering fusion processing on the audio data comprises the following steps:

Input sound data;

Noise reduction, echo cancellation, automatic gain processing;

Stylized processing;

Output audio data.
The method for editing a 3D animation based on a mobile terminal according to claim 1, wherein the rendering and fusing processing of the audio data comprises processing the recorded information, and the processing of the recorded information comprises the following steps:

Comparing the waveform of the obtained sound waveform information with the standard sound waveform;

The animation having the corresponding lip shape in the 3D animation material is retrieved according to the comparison result, and is applied to the character model of the 3D animation material in the rendering fusion processing on the image data.
The mobile terminal-based 3D animation editing method according to claim 1, wherein the rendering and fusing processing of the image data according to the 3D animation editing information comprises text adding and/or editing according to the input text adding information. The edit elements generated by the information are animated and/or image filter processed and/or 3D character replaced.
The mobile terminal-based 3D animation editing method according to claim 9, wherein the processing of adding text to the input text adding information comprises the following steps:

Enter a text stream;

Generate a stream of text images;

The fusion processing is rendered in the corresponding image data according to the selected text display mode.
The mobile terminal-based 3D animation editing method according to claim 9, wherein the image filter processing comprises the following steps:

Get image data;

Stylize image data;

Generate stylized images.
The mobile terminal-based 3D animation editing method according to claim 9, wherein the 3D character replacement comprises the following steps:

Choose a person;

Get the character;

Replace the original character in the 3D animation material with the selected character.
The mobile terminal-based 3D animation editing method according to claim 1, wherein the image data is subjected to rendering fusion processing and audio data processing according to the 3D animation editing information, and further includes inputting text content and recording. The audio content is automatically parsed and matched to the corresponding image location.