WO2018024179A1

WO2018024179A1 - Video processing method, server, terminal, and computer storage medium

Info

Publication number: WO2018024179A1
Application number: PCT/CN2017/095338
Authority: WO
Inventors: 王颖琦
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2016-08-04
Filing date: 2017-07-31
Publication date: 2018-02-08
Also published as: CN106060655B; CN106060655A

Abstract

Disclosed in the present invention are a video processing method, a terminal, and a computer storage medium. The method comprises: receiving first data sent by a terminal; parsing the first data, and extracting first subdata and second subdata from the first data, the first subdata being used for representing a special effect rendering parameter, and the second subdata being used for representing original video data; and according to the first subdata and the second subdata, rendering to generate target video data; and sending the target video data to the terminal, so that the terminal displays the target video data.

Description

Video processing method, server and terminal, computer storage medium

Cross-reference to related applications

The present application is filed on the basis of the Chinese Patent Application Serial No. No. No. No. No. No. No. No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No

Technical field

The present invention relates to video processing technologies, and in particular, to a video processing method, a server and a terminal, and a computer storage medium.

Background technique

Share photos, text, short videos, etc. when sharing via the Internet. Among them, the short video has been enthusiastically sought after because of its simple operation and wide entertainment. The most important application of short video is its special effects, which makes ordinary boring videos more magical and dramatic. For example: add magic effects to short videos.

In order to meet the entertainment and diversity of different groups of people, it is necessary to create a variety of special effects and template materials. However, due to the limitations of the terminal, such as the storage capacity of the mobile phone and the processing chip, accessing the template material through the terminal and rendering the effect locally may result in very slow video processing, affecting the real-time performance of video sharing, and failing to create a variety of special effects. effect.

Summary of the invention

To solve the above technical problem, an embodiment of the present invention provides a video processing method, a server, a terminal, and a computer storage medium.

The video processing method provided by the embodiment of the present invention is applied to a server, and includes:

Receiving first data sent by the terminal;

Parsing the first data, extracting first sub data and second sub data from the first data, the first sub data is used to represent a special effect rendering parameter, and the second sub data is used to represent Raw video data;

Generating target video data according to the first sub data and the second sub data;

Sending the target video data to the terminal.

A video processing method according to another embodiment of the present invention is applied to a terminal, including:

Collect raw video data and get special effect rendering parameters;

Decoding a first sub-data for characterizing the effect rendering parameter and a second sub-data for characterizing the original video data in the first data;

Sending the first data to a server;

Receiving target video data generated by the server according to the first data rendering;

Displaying the target video data.

The server provided by the embodiment of the present invention includes:

a receiving part, configured to receive first data sent by the terminal;

The parsing portion is configured to parse the first data, and extract the first sub data and the second sub data from the first data, where the first sub data is used to represent the special effect rendering parameter, and the second Subdata is used to characterize the original video data;

a rendering part, configured to generate target video data according to the first sub data and the second sub data;

And a sending part, configured to send the target video data to the terminal.

The terminal provided by the embodiment of the present invention includes:

The acquisition part is configured to collect original video data;

Get part, configured to get the effect rendering parameters;

An encapsulation portion configured to be used to characterize the first sub-data of the effect rendering parameter, and a second sub-data for characterizing the original video data is encapsulated in the first data;

a sending part, configured to send the first data to a server;

a receiving part, configured to receive target video data generated by the server according to the first data rendering;

a display portion configured to display the target video data.

The computer storage medium provided by the embodiment of the present invention, wherein computer executable instructions are stored, and the computer executable instructions are used to execute any of the video processing methods described above.

In the technical solution of the embodiment of the present invention, the terminal collects the original video data, and obtains the input special effect rendering parameter; the first sub data used to represent the special effect rendering parameter, and the second used to represent the original video data The sub-data package is sent to the server in the first data. The server receives the first data sent by the terminal, parses the first data, and extracts the first sub data and the second sub data from the first data, where the first sub data is used to represent the special effect rendering parameter. The second sub-data is used to represent the original video data; the target video data is generated according to the first sub-data and the second sub-data; and the target video data is sent to the terminal for the terminal Displaying the target video data. In this way, the terminal handles the processing process with higher complexity to the server, and the rendering processing speed is greatly improved, thereby creating a variety of special effects to meet the user's needs, and in addition, because the rendering processing speed is improved, Video sharing enables real-time performance.

DRAWINGS

1 is a schematic diagram of hardware entities of each party performing information interaction in an embodiment of the present invention;

2 is a schematic flowchart 1 of a video processing method according to an embodiment of the present invention;

3 is a second schematic flowchart of a video processing method according to an embodiment of the present invention;

4 is a schematic diagram of a combination of special effects structures according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a combined rendering of a CPU and a GPU according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of a network interaction architecture of a terminal server according to an embodiment of the present invention; FIG.

FIG. 7 is a schematic flowchart 3 of a video processing method according to an embodiment of the present invention;

FIG. 8 is a flowchart of generating a target video data according to an embodiment of the present invention;

FIG. 9 is a first schematic structural diagram of a server according to an embodiment of the present invention; FIG.

FIG. 10 is a first schematic structural diagram of a terminal according to an embodiment of the present invention; FIG.

11 is a second schematic structural diagram of a server according to an embodiment of the present invention;

FIG. 12 is a second schematic structural diagram of a terminal according to an embodiment of the present invention.

detailed description

The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

There are a variety of video resources displayed in Internet video websites or video applications (APP, Application). Among them, short videos have received high attention due to their high immediacy, sharing and entertainment. Here, short video refers to a video with a short video length, such as a video with a length of a few seconds to a few minutes. The biggest feature of short video is the integration of special effects in the actual shooting or production of the video. For example, incorporating a movie's background into a short video makes the characters in the video the protagonists in the movie. For another example, the effect of magic is incorporated into the short video, so that the characters in the video have super powers. When adding a special effect in a short video, the video picture needs to be re-rendered. If the video picture is rendered locally in the terminal, the rendering speed is slow due to the limitation of the terminal processing capability. In order to overcome the shortage of the terminal hardware resources, Embodiments of the present invention provide a scheme for rendering short video based on a server.

FIG. 1 is a schematic diagram of hardware entities of each party performing information interaction according to an embodiment of the present invention. FIG. 1 includes: a terminal 11 and a server 12. The terminal 11 performs information interaction with the server 12 through a wired network or a wireless network. The device referred to by the terminal 11 includes a mobile phone, a desktop computer, a PC, an all-in-one, and the like. In one example, the terminal 11 sends the video data to be rendered (also referred to as special effects) to the server 12, and the video data is rendered by the server 12, and then the server will render The dyed video data is sent to the terminal 11 for display.

The above-mentioned example of FIG. 1 is only a system architecture example for implementing the embodiment of the present invention. The embodiment of the present invention is not limited to the system structure described in FIG. 1 above, and various embodiments of the present invention are proposed based on the system architecture.

2 is a schematic flowchart of a video processing method according to an embodiment of the present invention. The video processing method in this example is applied to a server side. As shown in FIG. 2, the video processing method includes the following steps:

Step 201: Receive first data sent by the terminal.

In the embodiment of the present invention, the terminal may be a mobile phone, a tablet computer, a notebook computer, or the like.

In an embodiment, the terminal is installed with a short video type APP, and the short video type APP can call the camera of the terminal to collect a short time video through the camera; in another embodiment, the terminal is installed with a web browser. Log in to the short video website through a web browser, and the short video website can call the camera of the terminal to collect the video with shorter time through the camera.

In the above scheme, a short-time video is referred to as a short video, such as a 10-second video, a 60-second video, and the like. Users can add special effects to this short video. To do this, the terminal needs to first send the video data and the effect rendering parameters for adding effects to the server.

In another embodiment, the terminal has a video editing class APP, and the video editing class APP can intercept a small piece of video from the video file. Here, the short video is called short video. Users can add special effects to this short video. To do this, the terminal needs to first send the video data and the effect rendering parameters for adding effects to the server.

In the embodiment of the present invention, after receiving the rendering request sent by the terminal, the server determines that the original video data in the terminal needs to be rendered by the effect. After receiving the rendering request, the server continues to receive the first data sent by the terminal. Here, the first data carries the following information: special effect rendering parameters, original video data.

In an embodiment of the invention, the communication between the server and the terminal is based on Hypertext Transfer Protocol (HTTP). Based on this, the format of the first data is an HTTP packet. Here, the communication protocol between the server and the terminal can be adaptively adjusted as the network develops, for example, the server and the terminal communicate via HTTP 2.0.

Step 202: Parsing the first data, extracting first sub data and second sub data from the first data, where the first sub data is used to represent a special effect rendering parameter, and the second sub data Used to characterize raw video data.

In the embodiment of the present invention, the format of the first data is an HTTP data packet, and the first data is parsed to obtain a header portion and a packet portion of the first data; wherein the packet header is divided into an HTTP header (Header), The body part is the HTTP body. A first sub-data is extracted in the header portion, and a second sub-data is extracted in the packet portion.

In the embodiment of the present invention, the first sub-data is used to represent the special effect rendering parameter. In an embodiment, the special effect rendering parameter refers to the special effect identifier, and the special effect identifier can be uniquely determined by the special effect identifier. Each special effect corresponds to a special effect identifier. When the user selects an effect to be added in the terminal, the special effect identifier corresponding to the special effect is encapsulated in the first data and sent to the server. After the server obtains the special effect identifier, it determines the special effect to be added according to the correspondence between the special effect identifier and the special effect content. In another embodiment, the special effect rendering parameter refers to a specific special effect content, for example, the user wants to design the special effect content by himself, and can design the personalized special effect content through the special effect design material (such as text, picture, line, etc.), and then Send the special effects content to the server, and the server directly adds personalized effects based on the special effects content.

In the embodiment of the present invention, the second sub data is used to represent the original video data. Here, the original video data refers to the video data before the special effect is obtained. After the video data is collected by the terminal, the video data is encapsulated into the first data and sent to the server. In an embodiment, the format of the original video data is mp4 format, and the format of the original video data may also be other video formats, for example, MPEG (Moving Picture Experts Group) format, window. Media Video (WMV, Windows Media Video) format, Real Media Variable Bit Rate (RMVB) format, and so on.

Step 203: Render and generate target video data according to the first sub data and the second sub data.

Specifically, as shown in FIG. 8, the rendering generation process of the target video data includes the following steps:

Step 2031: Find a special effect template file corresponding to the special effect rendering parameter, and divide the original video data into a plurality of original video sub data.

In the embodiment of the present invention, the server parses the first sub-data to obtain a special effect rendering parameter. The server then looks up the effect template file corresponding to the effect rendering parameters. Here, the effect template file is stored on the server side. Since the server side has a large amount of storage resources, a variety of special effect templates can be stored on the server side, and each effect template is implemented by a special effect template file in the special effect template file. It includes a series of special effects commands and special effects parameters that are needed to display the effect. Referring to FIG. 4, the rendering of the effect includes two categories, the first type is video rendering, the second type is text rendering, and for video rendering, including: affine transformation, mirror flip, alpha gradient, and the like. For text rendering, including: translation transformation, bloom transformation, fuzzy transformation, rotation transformation, and so on. Different texts can be rendered for different texts.

In the embodiment of the present invention, the server parses the second sub-data to obtain original video data. Then, the server divides the original video data into a plurality of original video sub-data. As shown in FIG. 5, it is assumed that the original video data includes 12 frames, which are 01 frames, 02 frames, 03 frames, and 04 frames. , 05 frames, 06 frames, 07 frames, 08 frames, 09 frames, 10 frames, 11 frames, and 12 frames. The 12 frames of data are arranged in chronological order, and the 12 frames of video data are divided into 4 original video sub-data, and each original video sub-data includes 3 frames. The first original video sub-data includes 01 frames, 02 frames, and 03 frames; the second original video sub-data includes 04 frames, 05 frames, and 06 frames; and the third original video sub-data includes 07 frames, 08 frames, and 09 frames. . The fourth original video subdata includes 10 frames, 11 frames, and 12 frames.

Step 2032: Perform parallel rendering on the special effect template file and the plurality of original video sub-data to generate a plurality of target video sub-data; and combine the plurality of target video sub-data into target video data.

Since the central processing unit (CPU) and the graphics processing unit (GPU) in the server have multiple cores, the effect template file and the plurality of original video sub-data can be rendered in parallel by the multi-core CPU and the multi-core GPU. Generating a plurality of target video subdata; then, combining the plurality of target video subdata into the target video data. Referring to FIG. 5, the four original video sub-data are distributed to four cores (CPU1, CPU2, CPU3, and CPU4, respectively) for parallel processing. For each core of the CPU, a set of GPUs may be correspondingly, for example, CPU1 corresponds to GPU01-GPU12, and video data is rendered in parallel by pixels through GPU01-GPU12. The four sets of GPUs finally render 4 target video sub-data, and then combine the 4 target video sub-data to obtain the target video data. In the embodiment of the present invention, the parallel computing capability of the processor can greatly improve the speed of the effect rendering, and bring the user a super real-time rendering, previewing and sharing experience.

Step 204: Send the target video data to the terminal, so that the terminal displays the target video data.

In the embodiment of the present invention, the server sends the target video data to the terminal by means of HTTP, so that the terminal displays the target video data. In an embodiment, the target video data is encoded by the server into a file in the mp4 format, and the target video data in the mp4 format is sent to the terminal for display. The format of the target video data may also be other video formats, for example: MPEG format, WMV format, RMVB format, and the like. In an application, the terminal can play a variety of video formats, including: mp4 format, MPEG format, WMV format, RMVB format, the format of the target video data may be the same as the format of the original video data, or may be different, the user may pre- Set the format of the target video data so that the server encodes the target video data according to the format set.

The technical solution of the embodiment of the invention solves the problem that the special effect rendering is slow due to limitation of hardware resources, and realizes ultra-real-time rendering, previewing and sharing of short video files. You don't have to download a lot of effects templates to your local storage, saving storage resources. In addition, the use of local chips is reduced, allowing complex renderings to be submitted to the server for processing, making the user's video editing experience smoother, more convenient, and faster to share.

FIG. 3 is a schematic flowchart of a video processing method according to an embodiment of the present invention. The video processing method in this example is applied to a terminal. As shown in FIG. 3, the video processing method includes the following steps:

Step 301: Acquire original video data, and obtain input effect rendering parameters.

In an embodiment, the short video type APP can call the camera of the terminal, so that the short time video is collected by the camera; in another embodiment, the terminal is installed with a web browser, and the short video is registered through the web browser. The website, through the short video website, can call the camera of the terminal to collect the video with shorter time through the camera.

In the embodiment of the present invention, the video file acquired by the terminal generally includes video data and audio data. Here, the video data and the audio data in the video file are separated to obtain original video data as well as original audio data.

In the embodiment of the present invention, the original video data obtained after the separation needs to be converted into a video format that can be rendered by the server. In an implementation manner, the mp4 format is a standard cell for performing rendering processing. Therefore, the original video data obtained after the separation needs to be converted into the mp4 format, and the video format that can be rendered can also be other video formats, such as MPEG format, WMV format, RMVB format, and the like.

In the embodiment of the present invention, the special effect rendering parameter refers to the special effect identifier, and the special effect identifier can uniquely determine the special effect that needs to be added. Each special effect corresponds to a special effect identifier. When the user selects an effect to be added in the terminal, the special effect identifier corresponding to the special effect is encapsulated in the first data and sent to the server.

In the embodiment of the present invention, the terminal may also have a rich personalized rendering function. Specifically, the user may design a personalized special effect content, and then send the special effect content to the server, and the server directly adds a personalized special effect according to the special effect content.

Step 302: Encapsulate the first sub data for characterizing the special effect rendering parameter and the second sub data for characterizing the original video data in the first data.

In the embodiment of the present invention, the communication between the server and the terminal is based on HTTP. Based on this, the format of the first data is an HTTP data packet.

In the embodiment of the present invention, the first sub-data for characterizing the special effect rendering parameter and the second sub-data for characterizing the original video data are encapsulated in the first data, including: The first sub-data of the effect rendering parameter is encapsulated in a header portion of the first data, and the second sub-data for characterizing the original video data is encapsulated in a body portion of the first data. The packet header is divided into an HTTP header, and the packet body is an HTTP body.

Step 303: Send the first data to a server.

In the embodiment of the present invention, the terminal sends the first data to the server through HTTP POST, and the server receives the first data sent by the terminal through HTTP GET.

Then, the server generates target video data according to the first data rendering. Specifically, the server parses the first sub data to obtain special effect rendering parameters. The server then looks up the effect template file corresponding to the effect rendering parameters. Here, the effect template file is stored in the service. On the server side, because the server side has a large amount of storage resources, a variety of special effects templates can be stored on the server side. Each effect template is implemented by a special effect template file, and the special effect template file includes the need to display the special effect. A series of special effects commands and special effects parameters. The server parses the second sub-data to obtain the original video data. Then, the server divides the original video data into a plurality of original video sub-data, and the multi-core CPU and the multi-core GPU can perform parallel rendering on the special effect template file and the multiple original video sub-data to generate multiple targets. Video subdata; then, combining the plurality of target video subdata into target video data.

Step 304: Receive target video data generated by the server according to the first data rendering, and display the target video data.

In the embodiment of the present invention, the terminal receives the target video data generated by the server according to the first data rendering based on HTTP. Here, the target video data is in the mp4 format. Therefore, the target video data may be directly displayed and displayed. The video that came out is the video after adding the effect.

In the embodiment of the present invention, when the target video data is displayed, the original audio data is played.

The technical solution of the embodiment of the present invention may also adopt a mode in which a local (referring to a terminal) and a server are combined. If the computational complexity is high, the server mode is adopted, and if the computational complexity is low, the local mode is adopted. This can meet the needs of users and provide more novel effects. In addition, the local can use a one-button plus special effects mode of operation, making ordinary user operations very convenient, and all rendering processing is operated by the server. All processing details are masked to the user so that the user feels it is handled locally. The server's ultra-fast second-level rendering time and smaller second-level transmission delays make the user experience smooth. Referring to FIG. 6, the server is connected to each terminal according to the principle of nearest allocation, so that the short video is faster in transmission speed, and the long-connected HTTP communication mechanism can improve the speed at which the user can change the preview effect of different special effects modes.

FIG. 7 is a schematic flowchart 3 of a video processing method according to an embodiment of the present invention. As shown in FIG. 7, the video processing method includes the following steps:

Step 701: The terminal collects original video data; converts the original video data into an mp4 file.

Step 702: The terminal acquires a special effect rendering parameter input by the user, and converts the special effect rendering parameter into a json file.

Here, the json file refers to a file in the form of a JavaScript object notation (JSON, JavaScript Object Notation) format, which is a lightweight data exchange format that stores and represents data in a text format that is completely independent of the programming language. The JSON format is easy to read and write, and it is also easy to parse and generate by machine, so it can effectively improve network transmission efficiency.

Step 703: The terminal encapsulates the mp4 file and the json file into an HTTP data packet.

Step 704: The terminal sends a rendering request to the server, and sends the HTTP data packet to the server.

Step 705: The server receives the rendering request sent by the terminal and the HTTP data packet.

Step 706: The server reads the HTTP packet into the memory.

Step 707: The server parses the HTTP data packet in the memory, and separates the mp4 file and the json file. The mp4 file is fragmented to obtain a plurality of fragment files.

Step 708: The server parses the special effect rendering parameter in the json file; and reads the corresponding special effect template from the special effect template library according to the special effect rendering parameter.

Step 709: The server parses the special effect commands and parameters in the special effect template.

Step 710: The server sequentially renders the effects in the json file in parallel through the CPU and the GPU.

Here, there are many types of special effects, including special effects including subtitle effects and video effects. For subtitle effects, the subtitle effect number in the json file is parsed, and the subtitle related json file is read through the subtitle effect number; through the GPU and the CPU. Parallel rendering of subtitle effects, storing the rendered subtitle file into a buffer; for video effects, parsing the video effect number in the json file, reading the video related json file through the video effect number; passing the GPU and The CPU renders the video effects in parallel and stores the rendered video files in a buffer. Finally, the subtitles and videos in the two buffers are cached together in other buffers to get the final special effect file.

Step 711: The server encodes the effect data in the buffer to the 264 stream.

Step 712: The server stores 264 streams into each fragment file.

Step 713: The server merges all the fragment files into an mp4 file.

Step 714: The terminal receives the mp4 file sent by the server.

Step 715: The terminal reads the video data from the mp4 file.

Here, the terminal can also read audio data from the mp4 file.

Step 716: Parse the video data into the buffer.

Step 717: The terminal displays the video data to the user through the display interface.

In the technical solution of the embodiment of the present invention, the special effect template is not downloaded to the local, saving storage resources, and the server directly obtaining the special effect template can speed up the rendering progress; since the rendering process is performed by the server side, it can span multiple terminal devices. It is more versatile and more convenient to maintain; it can also back up the user's data files on the server side, which is convenient for users to operate and lose in the future; the hardware configuration requirements of the terminal are low, and the ordinary smartphone can operate.

FIG. 9 is a schematic structural diagram of a server according to an embodiment of the present invention. As shown in FIG. 9, the server includes:

The receiving part 901 is configured to receive the first data sent by the terminal;

The parsing part 902 is configured to parse the first data, and extract the first sub data and the second sub data from the first data, where the first sub data is used to represent the special effect rendering parameter, where The two sub-data is used to represent the original video data;

The rendering part 903 is configured to generate target video data according to the first sub data and the second sub data.

The transmitting portion 904 is configured to send the target video data to the terminal.

The server further includes:

The storage part 905 is configured to store the special effect template file;

The rendering portion 903 includes:

The finding subsection 9031 is configured to find a special effect template file corresponding to the special effect rendering parameter;

Segmenting subsection 9032, configured to split the original video data into a plurality of original video subdata;

The parallel rendering sub-portion 9033 is configured to perform parallel rendering on the special effect template file and the plurality of original video sub-data to generate a plurality of target video sub-data;

The merging sub-portion 9034 is configured to merge the plurality of target video sub-data into target video data.

The parsing part 902 includes:

The obtaining sub-portion 9021 is configured to parse the first data to obtain a header portion and a packet portion of the first data;

The extracting subsection 9022 is configured to extract the first subdata in the header portion and extract the second subdata in the encapsulation portion.

Those skilled in the art should understand that the implementation functions of the various parts in the server shown in FIG. 9 can be understood by referring to the related description of the foregoing video processing method.

As shown in FIG. 11, in an actual application, the parsing portion 902 and the rendering portion 903 can be implemented by the processor 1101 located on the server. The receiving portion 901 and the transmitting portion 904 described above may be implemented by an external communication interface 1102 located on a server. The above storage portion 905 can be implemented by the memory 1103 located on the server.

The processor 1101, the external communication interface 1102, and the memory 1103 on the server can interact through the system bus 1104.

In the above solution, the processor 1101 may be a general purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The processor 1101 can implement or perform the methods, steps, and flowcharts disclosed in the embodiments of the present invention. A general purpose processor can be a microprocessor or any conventional processor or the like. The steps of the method disclosed in the embodiment of the present invention may be directly implemented as a hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor.

In the above scheme, the memory 1103 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof. The non-volatile memory may be a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), or an Erasable Programmable Read (EPROM). Only Memory), Electrically Erasable Programmable Read-Only Memory (EEPROM), Ferromagnetic Random Access Memory (FRAM), Flash Memory, Magnetic Surface Memory , CD-ROM, or Compact Disc Read-Only Memory (CD-ROM); the magnetic surface memory can be a disk storage or a tape storage. The volatile memory can be a random access memory (RAM) that acts as an external cache. By way of example and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access (SSRAM). DRAM (Dynamic Random Access Memory), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), enhancement Synchronous Dynamic Random Access Memory (ESDRAM), synchronously connected dynamic random access memory (SLDRAM, SyncLink Dynamic) Random Access Memory), Direct RAM Bus Random Access Memory (DRRAM). The memory 1101 described in the embodiments of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.

The external communication interface 1102 can enable the server to access a wireless network based on a communication protocol, such as WiFi, 2G or 3G, 4G, the Internet, or a combination thereof.

FIG. 10 is a schematic structural diagram of a terminal according to an embodiment of the present invention. As shown in FIG. 10, the terminal includes:

The collecting part 1001 is configured to collect original video data;

The obtaining part 1002 is configured to obtain a special effect rendering parameter;

The encapsulating portion 1003 is configured to encapsulate the first sub data for characterizing the special effect rendering parameter and the second sub data for characterizing the original video data in the first data;

The sending part 1004 is configured to send the first data to the server;

The receiving part 1005 is configured to receive target video data generated by the server according to the first data rendering;

The display portion 1006 is configured to display the target video data.

The collecting portion 1001 is further configured to separate video data and audio data in the video file to obtain original video data and original audio data.

The terminal further includes:

The audio playing portion 1007 is configured to play the original audio data when the display portion displays the target video data.

Those skilled in the art should understand that the implementation functions of the various parts in the terminal shown in FIG. 10 can be understood by referring to the related description of the foregoing video processing method.

As shown in FIG. 12, in practical applications, the above-described acquisition portion 1001 can be implemented by a camera 1201 located on the terminal. The acquisition portion 1002 described above can be implemented by the input device 1202 located on the terminal. The encapsulating portion 1003 and the audio playing portion 1007 may be implemented by the processor 1203 located on the terminal. achieve. The transmitting portion 1004 and the receiving portion 1005 described above may be implemented by an external communication interface 1204 located on a server. The display portion 1006 described above can be implemented by the display 1205 located on the server.

The camera 1201, the input device 1202, the processor 1203, the external communication interface 1204, and the display 1205 on the terminal can interact through the system bus 1206.

In the above solution, the processor 1203 may be a general purpose processor, a DSP, or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, or the like.

The external communication interface 1204 enables the server to access a wireless network based on a communication protocol, such as WiFi, 2G or 3G, 4G, the Internet, or a combination thereof.

Input device 1202 can be a keyboard, mouse, trackball, click wheel, button, button, and the like.

Display 1205 can be a cathode ray tube (CRT) display, a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a thin film transistor (TFT) display, a plasma display, and the like.

The technical solutions described in the embodiments of the present invention can be arbitrarily combined without conflict.

The integrated modules described in the embodiments of the present invention may also be stored in a computer readable storage medium if they are implemented in the form of software functional modules and sold or used as separate products. Based on such understanding, those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media containing computer usable program code, including but not limited to a USB flash drive, a mobile hard drive, a read only memory ( ROM, Read-Only Memory), Random Access Memory (RAM), disk storage, CD-ROM, optical storage, and the like.

The present application is described in terms of flowcharts and/or block diagrams of methods, apparatuses (systems), and computer program products according to embodiments of the present application. It should be understood that the flow chart can be implemented by computer program instructions And/or a combination of the processes and/or blocks in the block diagrams, and the flowcharts and/or blocks in the flowcharts. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

While the preferred embodiment of the present application has been described, those skilled in the art can make further changes and modifications to these embodiments once they are aware of the basic inventive concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

Correspondingly, an embodiment of the present invention further provides a computer storage medium, wherein a computer program is stored, and the computer program is used to execute the above video processing method in the embodiment of the present invention.

The description contains many specific implementation details, which are not to be construed as limiting the scope of the claims, but rather the description of the features of the particular embodiments. Particular features described in the specification before and after the independent embodiments can also be implemented in a combination of a single embodiment. Conversely, each of the individual contexts described in the context of a single embodiment Features can also be implemented separately in various embodiments or in any suitable sub-combination. Moreover, although features may be described above as even in the particular combination, even as originally claimed, in some cases one or more of the required combinations can be removed from the combination and the required combination It can be a sub-binding or a sub-combination variant.

Similarly, although the operations are depicted in a particular order in the figures, this should not be construed as requiring that the operations are performed in the particular order shown, or in a sequential order, or all of the operations illustrated are performed to achieve the desired. result. Multitasking and parallel processing can be advantageous in certain circumstances. Furthermore, the separation of various system components in the above-described embodiments should not be understood as requiring that the separation be implemented in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or Packaged into multiple software products.

Thus, specific embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions defined in the claims can be performed in a different order and still achieve the desired results. Moreover, the processes depicted in the figures are not necessarily in the particular order shown, or in a sequential order to achieve the desired results. In particular embodiments, multitasking or parallel processing can be used.

Industrial applicability

In the technical solution of the embodiment of the present invention, the terminal sends the first sub-data for characterizing the special effect rendering parameter, and the second sub-data for characterizing the original video data is encapsulated in the first data and sent to the server. The server parses the first data, and generates and generates target video data according to the first sub data and the second sub data, and sends the target video data to the terminal, where the terminal is configured by the terminal The target video data is displayed. In this way, the terminal handles the processing process with higher complexity to the server, and the rendering processing speed is greatly improved, thereby creating a variety of special effects to meet the needs of users.

Claims

A video processing method, the method comprising:

Receiving first data sent by the terminal;

Parsing the first data, extracting first sub data and second sub data from the first data, the first sub data is used to represent a special effect rendering parameter, and the second sub data is used to represent Raw video data;

Generating target video data according to the first sub data and the second sub data;

Sending the target video data to the terminal.
The video processing method according to claim 1, wherein the generating the target video data according to the first sub data and the second sub data comprises:

Finding a special effect template file corresponding to the special effect rendering parameter, and dividing the original video data into a plurality of original video sub-data;

Performing parallel rendering on the special effect template file and the plurality of original video sub-data to generate a plurality of target video sub-data;

Combining the plurality of target video subdata into target video data.
The video processing method according to claim 1 or 2, wherein the parsing the first data and extracting the first sub data and the second sub data from the first data comprises:

Parsing the first data to obtain a header portion and a packet portion of the first data;

A first sub-data is extracted in the header portion, and a second sub-data is extracted in the packet portion.
A video processing method, the method comprising:

Collect raw video data and get special effect rendering parameters;

a first sub-data to be used to characterize the effect rendering parameters, and to characterize the original The second sub-data of the initial video data is encapsulated in the first data;

Sending the first data to a server;

Receiving target video data generated by the server according to the first data rendering;

Displaying the target video data.
The video processing method according to claim 4, wherein the collecting the original video data comprises:

The video data and the audio data in the video file are separated to obtain original video data as well as original audio data.
The video processing method according to claim 5, wherein the method further comprises:

When the target video data is displayed, the original audio data is played.
A server, the server comprising:

a receiving part, configured to receive first data sent by the terminal;

The parsing portion is configured to parse the first data, and extract the first sub data and the second sub data from the first data, where the first sub data is used to represent the special effect rendering parameter, and the second Subdata is used to characterize the original video data;

a rendering part, configured to generate target video data according to the first sub data and the second sub data;

And a sending part, configured to send the target video data to the terminal.
The server of claim 7, wherein the server further comprises:

a storage portion configured to store a special effect template file;

The rendering portion includes:

Finding a subsection configured to find a special effect template file corresponding to the effect rendering parameter;

Segmenting the subsection, configured to split the original video data into a plurality of original video sub-numbers according to;

And the parallel rendering sub-section is configured to perform parallel rendering on the special effect template file and the plurality of original video sub-data to generate a plurality of target video sub-data;

The merging subsection is configured to merge the plurality of target video subdata into the target video data.
The server according to claim 7 or 8, wherein the parsing portion comprises:

Obtaining a sub-portion configured to parse the first data to obtain a header portion and a packet portion of the first data;

Extracting a sub-portion configured to extract a first sub-data in the header portion and extract a second sub-data in the encapsulation portion.
A terminal, the terminal comprising:

The acquisition part is configured to collect original video data;

Get part, configured to get the effect rendering parameters;

An encapsulating portion configured to encapsulate a first sub-data for characterizing the effect rendering parameter and a second sub-data for characterizing the original video data in the first data;

a sending part, configured to send the first data to a server;

a receiving part, configured to receive target video data generated by the server according to the first data rendering;

a display portion configured to display the target video data.
The terminal according to claim 10, wherein said collecting portion is further configured to separate video data and audio data in the video file to obtain original video data and original audio data.
The terminal of claim 11, wherein the terminal further comprises:

And an audio playing portion configured to play the original audio data when the display portion displays the target video data.
A computer storage medium having stored therein computer executable instructions for performing the video processing method of any one of claims 1 to 3.
A computer storage medium having stored therein computer executable instructions for performing the video processing method of any one of claims 4 to 6.