CN113207037B - Template clipping method, device, terminal, system and medium for panoramic video animation - Google Patents
Template clipping method, device, terminal, system and medium for panoramic video animation Download PDFInfo
- Publication number
- CN113207037B CN113207037B CN202110351842.1A CN202110351842A CN113207037B CN 113207037 B CN113207037 B CN 113207037B CN 202110351842 A CN202110351842 A CN 202110351842A CN 113207037 B CN113207037 B CN 113207037B
- Authority
- CN
- China
- Prior art keywords
- animation
- panoramic video
- rendering
- template
- animation data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000009877 rendering Methods 0.000 claims abstract description 103
- 230000007704 transition Effects 0.000 claims description 27
- 238000004364 calculation method Methods 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 14
- 230000006870 function Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G06T15/205—Image-based rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Geometry (AREA)
- Computer Graphics (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention is suitable for the technical field of video processing, and provides a template clipping method, a device, a terminal, a system and a storage medium of panoramic video animation, wherein the method comprises the following steps: the method comprises the steps of configuring an animation template file of a panoramic video to be played, analyzing the animation template file to obtain an animation data sequence, obtaining animation data of a current decoding time stamp based on the animation data sequence, calculating rendering parameters of a current rendering model according to the obtained animation data, and rendering a panoramic video frame attached to the rendering model according to the rendering parameters, so that the time for editing the animation of the same or different panoramic videos on different terminals is saved by sharing the animation template file, or the time for editing the different panoramic videos by using the same animation data on the same terminal is saved, and further the user experience is improved.
Description
Technical Field
The invention belongs to the technical field of video processing, and particularly relates to a template clipping method, device, terminal, system and storage medium for panoramic video animation.
Background
When a panoramic video is played, 360-degree picture content cannot be completely displayed on a playing device at one time, and a user needs to select an observation angle suitable for the user as an observer in front of the playing device, wherein the observation angle is a playing angle of a current video frame. The dotting editing mainly refers to adding key frames on a time axis of the panoramic video, setting a playing view angle of each key frame and the like.
In the prior art, when the same panoramic video needs to be played by using the same animation logic in different terminal devices, or different panoramic videos need to be played according to the same animation logic, a user needs to edit the animation again, so that the editing time is long, and further the user experience is reduced.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a template clipping method, device, terminal, system, and storage medium for panoramic video animation.
In one aspect, an embodiment of the present invention provides a template clipping method for a panoramic video animation, where the method includes the following steps:
configuring an animation template file of a panoramic video to be played;
analyzing the animation template file to obtain an animation data sequence;
acquiring animation data of a current decoding time stamp based on the animation data sequence;
calculating rendering parameters of the current rendering model according to the acquired animation data;
rendering the panoramic video frame attached to the rendering model according to the rendering parameters.
Preferably, the animation data sequence includes parameters of each key frame and animation interpolation types between adjacent key frames, and the step of calculating rendering parameters of the current rendering model according to the acquired animation data includes:
if the current decoding timestamp corresponds to the parameter of the key frame, calculating the rendering parameter of the current rendering model according to the parameter of the key frame corresponding to the current decoding timestamp;
and if the current decoding time stamp corresponds to the animation interpolation type, performing interpolation calculation according to the animation interpolation type corresponding to the current decoding time stamp, and calculating the rendering parameters of the current rendering model according to the interpolation calculation result.
Preferably, the parameters of the key frame include a timestamp, a view orientation, and a zoom level of the key frame, or the parameters of the key frame include a timestamp of the key frame, and a relative change amount of the view orientation and the zoom level of the key frame with respect to a reference key frame.
Preferably, the animation interpolation type includes one or a combination of the following:
linear, slow-in fast-out, fast-in slow-out, slow-first-slow-then-fast-second-slow.
Preferably, the panoramic video to be played comprises a first panoramic video and a second panoramic video, the animation data sequence further comprises transition animation data, the transition animation data comprises animation interpolation types between a first transition key frame and a second transition key frame, the first transition key frame is the last key frame of the first panoramic video, and the second transition key frame is the first key frame of the second panoramic video.
In another aspect, an embodiment of the present invention provides a template clipping method for a panoramic video animation, including the following steps:
the first terminal generates an animation template file according to dotting editing operation data of a user;
the second terminal clips the panoramic video based on the animation template file and using the method as described above.
In another aspect, an embodiment of the present invention provides a template clipping apparatus for a panoramic video animation, where the apparatus includes:
the template configuration module is used for configuring an animation template file of the panoramic video to be played;
the template analysis module is used for analyzing the animation template file to obtain an animation data sequence;
the animation data acquisition module is used for acquiring animation data of the current decoding time stamp based on the animation data sequence;
the rendering parameter calculation module is used for calculating rendering parameters of the current rendering model according to the acquired animation data; and
and the rendering module is used for rendering the panoramic video frame attached to the rendering model according to the rendering parameters.
In another aspect, an embodiment of the present invention provides a terminal, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method when executing the computer program.
In another aspect, an embodiment of the present invention provides a template clipping system for a panoramic video animation, including a first terminal and a second terminal, where the first terminal is configured to generate an animation template file according to dotting editing operation data of a user, and the second terminal is the terminal described above.
In another aspect, an embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program implements the steps of the method described above.
According to the method and the device, the animation template file of the panoramic video to be played is configured, the animation template file is analyzed to obtain the animation data sequence, the animation data of the current decoding time stamp is obtained based on the animation data sequence, the rendering parameters of the current rendering model are calculated according to the obtained animation data, and the panoramic video frames attached to the rendering model are rendered according to the rendering parameters, so that the time for editing the animation on the same or different panoramic videos on different terminals is saved by sharing the animation template file, or the time for editing the different panoramic videos by using the same animation data on the same terminal is saved, and further the user experience is improved.
Drawings
FIG. 1 is a flowchart of an implementation of a template clipping method for a panoramic video animation according to an embodiment of the present invention;
FIG. 2 is a flowchart of an implementation of a template clipping method for a panoramic video animation according to a second embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a template clipping apparatus for panoramic video animation according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a terminal according to a fourth embodiment of the present invention; and
fig. 5 is a schematic structural diagram of a template clipping system for panoramic video animation according to a fifth embodiment of the present invention;
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The following detailed description of specific implementations of the present invention is provided in conjunction with specific embodiments:
the first embodiment is as follows:
fig. 1 shows an implementation flow of a template clipping method for a panoramic video animation according to an embodiment of the present invention, and for convenience of description, only the parts related to the embodiment of the present invention are shown, which is detailed as follows:
in step S101, an animation template file of a panoramic video to be played is configured.
The embodiment of the invention is suitable for terminal equipment, the terminal equipment comprises but is not limited to various personal computers, notebook computers, smart phones, cameras, tablet computers and portable wearable equipment, and the terminal equipment can realize the method by installing corresponding panoramic video processing software or plug-ins.
In the embodiment of the present invention, the animation template file may be generated by a terminal executing the method, or may be generated by a terminal other than the terminal executing the method, and for convenience of description, the terminal generating the animation template file is defined as a first terminal, and the terminal executing the method is defined as a second terminal, where the second terminal and the first terminal may be the same terminal. When the first terminal generates an animation template file, specifically, the first terminal may detect a dotting editing operation of a user, obtain an animation data sequence according to the obtained dotting editing operation data, and generate an animation template file according to the animation data sequence when a template file generation request is received, where the animation template file may be stored in a json (JavaScript Object Notation) format or the like.
Preferably, the animation data sequence includes a parameter of each key frame and an animation interpolation type between adjacent key frames, in other words, each set of animation data is a parameter of a certain key frame or an animation interpolation type between two adjacent key frames, so that a rendering model is rendered subsequently according to the animation data sequence, and the panoramic video can be automatically clipped on the second terminal according to an animation template file edited in the first terminal. In a specific implementation, in the process of detecting dotting editing operation of a user, a first terminal can obtain a parameter type and a parameter value of a key frame input by the user after receiving a key frame setting request; the animation interpolation type input by the user may be acquired after receiving a transitional animation effect (transitional animation special effect) setting request.
Further preferably, the parameters of the key frame include a timestamp, a view angle orientation and a zoom degree of the key frame, and since the parameters of the key frame are absolute values, the parameters can be directly applied to post-rendering, and automatic rendering from panoramic video to flat video based on a view angle change dimension can be achieved. Still preferably, the parameters of the key frame include a timestamp of the key frame, and relative amounts of change of the perspective orientation and the zoom degree of the key frame with respect to the reference key frame, and the parameters of the key frame are relative values, so that the richness of animation editing is increased. The reference key frame may be a previous key frame of the key frame, or may be any key frame specified by the user, for example, a first key frame. Still further, the parameters of the key frame may also include transparency.
By way of example, the parameters of a key frame in an animation data sequence are defined as follows:
wherein, the timeRatio is normalized data of the timestamp, namely the total duration of the timestamp/video of a certain frame;
id is the mark name of the key frame, and each key frame has the mark name thereof;
camera-fov is a field angle set for a projection matrix in an OpenGL (Open Graphics Library) rendering model, and the size of the field angle can affect the scaling degree of a picture;
the camera-distance is the distance from a rendering model camera to the center of a rendering model in the OpenGL rendering model, and the size of the camera-distance can also influence the scaling degree of a picture;
entry-yaw is the yaw angle of the rendering model, the value of which controls the direction of the panoramic video display;
the entry-pitch is the pitch angle of the rendering model, and the value controls the display direction of the panoramic video;
entry-roll is the roll angle of the rendering model, the value of which controls the direction of the panoramic video display.
The view angle orientation may specifically include a yaw angle, a pitch angle, and a roll angle, and the zoom degree may specifically include a view angle and/or a distance from a center of a rendering model camera to a center of a rendering model.
Preferably, the animation interpolation type includes one or more combinations of linear, slow-in and fast-out, fast-in and slow-out, and slow-then-fast-then-slow, so as to further increase the richness of animation editing, and of course, other animation interpolation types may be provided, and the present application is not limited specifically.
The panoramic video to be played may only include one panoramic video, or may include a plurality of panoramic videos, and preferably, the panoramic video to be played includes a first panoramic video and a second panoramic video, the animation data sequence further includes transition animation data, the transition animation data includes an animation interpolation type between a first transition key frame and a second transition key frame, the first transition key frame is a last key frame of the first panoramic video, and the second transition key frame is a first key frame of the second panoramic video, so as to implement transition rendering of the plurality of panoramic videos. The transition animation data may be understood as animation data at a transition stage from the first panoramic video to the second panoramic video, where the animation interpolation type between the first transition key frame and the second transition key frame may also be one or a combination of linear, slow-in and fast-out, fast-in and slow-then-slow, and the transition animation data may further include parameters of m key frames that are consecutive before the first transition key frame, parameters of n key frames that are consecutive after the second transition key frame, and an animation interpolation type between adjacent key frames, so as to implement smooth transition from the first panoramic video to the second panoramic video. The numerical values of m and n can be determined by a user in the dotting editing process, and the numerical values of m and n are not specifically limited in the application.
After the first terminal generates the animation template file, when the second terminal receives an animation template configuration request for the panoramic video to be played, the animation template file generated by the first terminal is configured.
In step S102, the animation template file is parsed to obtain an animation data sequence.
In the embodiment of the present invention, the second terminal parses the animation template file to obtain the animation data sequence.
In step S103, animation data of the current decoding time stamp is acquired based on the animation data sequence.
In the embodiment of the invention, in the process of decoding the panoramic video to be played by the second terminal, the animation data of the current decoding time stamp is acquired according to the animation data sequence, and if the animation data sequence comprises the parameters of each key frame and the animation interpolation type between adjacent key frames, the animation data corresponding to the current decoding time stamp can be the parameters of the key frames or the animation interpolation type.
In step S104, a rendering parameter of the current rendering model is calculated from the acquired animation data.
In the embodiment of the present invention, preferably, if the current decoding timestamp corresponds to a parameter of the key frame, the rendering parameter of the current rendering model is calculated according to the parameter of the key frame corresponding to the current decoding timestamp, and if the current decoding timestamp corresponds to the interpolation type, the interpolation calculation is performed according to the animation interpolation type corresponding to the current decoding timestamp, and the rendering parameter of the current rendering model is calculated according to the interpolation calculation result. Among them, the rendering parameters may include pitch (pitch angle), yaw (yaw angle), roll (roll angle), fov (field angle), distance (distance), and the like of the rendering model camera.
When the rendering parameter of the current rendering model is calculated according to the parameter of the key frame corresponding to the current decoding timestamp, if the parameter of the key frame includes the relative variation of the view direction and the zoom degree of the key frame with respect to the reference key frame, that is, the parameter of the key frame is a relative value, the rendering parameter of the current rendering model may be calculated according to the parameter of the reference key frame and the parameter of the key frame.
When interpolation calculation is carried out according to the animation interpolation type corresponding to the current decoding time stamp, if the parameters of the key frame comprise the view angle orientation and the zoom degree, namely the parameters of the key frame are absolute values, the corresponding animation interpolation function can be obtained according to the animation interpolation type corresponding to the current decoding time stamp, and interpolation calculation is carried out according to the current decoding time stamp, the parameters of the previous key frame of the current decoding time stamp and the parameters of the next key frame of the current decoding time stamp by using the obtained animation interpolation function; if the parameters of the key frame include the relative variation of the view direction and the zoom degree of the key frame with respect to the reference key frame, that is, the parameters of the key frame are relative values, interpolation calculation can be performed according to the current timestamp, the parameters of the reference key frame, the parameters of the previous key frame of the current decoding timestamp, and the parameters of the next key frame of the current decoding timestamp, and by using the obtained animation interpolation function.
In step S105, the panoramic video frame attached to the rendering model is rendered according to the calculated rendering parameters.
In the embodiment of the invention, after the rendering parameters of the rendering model of the current decoding timestamp are calculated, the panoramic video frame which corresponds to the decoding timestamp and is attached to the rendering model is rendered according to the calculated rendering parameters. Further, whether the panoramic video frame corresponding to the current decoding timestamp is the last frame or not is judged, if yes, the clipping is determined to be completed, otherwise, the step S103 is skipped, and therefore the automatic clipping and playing of the panoramic video are achieved.
It should be noted here that, usually, in a certain period before rendering a panoramic video frame that corresponds to a decoding timestamp and is attached to a rendering model, the calculation of a corresponding rendering parameter has been completed, and the rendering parameter of each calculated decoding timestamp is usually cached in a terminal.
In the embodiment of the invention, the animation template file of the panoramic video to be played is configured, the animation template file is analyzed to obtain the animation data sequence, the animation data of the current decoding time stamp is obtained based on the animation data sequence, the rendering parameters of the current rendering model are calculated according to the obtained animation data, and the panoramic video frames attached to the rendering model are rendered according to the rendering parameters, so that the time for editing the animation of the same or different panoramic videos on different terminals is saved by sharing the animation template file, or the time for editing the different panoramic videos by using the same animation data on the same terminal is saved, and further the user experience is improved.
Example two:
fig. 2 shows an implementation flow of a template clipping method for a panoramic video animation according to a second embodiment of the present invention, and for convenience of description, only the relevant portions of the embodiment of the present invention are shown, which is detailed as follows:
in step S201, the first terminal generates an animation template file according to the dotting editing operation data of the user.
In the embodiment of the present invention, reference may be made to the description related to the first embodiment in the step S201, which is not described herein again.
In step S202, the second terminal configures the animation template file and clips the panoramic video according to the configured animation template file.
In the embodiment of the present invention, when the second terminal configures the animation template file and clips the panoramic video according to the configured animation template file, the panoramic video may be clipped according to steps S101 and S105 described in the first embodiment.
In the embodiment of the invention, the first terminal generates the animation template file according to the dotting editing operation data of the user, the second terminal configures the animation template file and clips the panoramic video according to the configured animation template file, so that the animation editing operation is performed on the first terminal once, the panoramic video editing method can be applied to any panoramic video or the second terminal, the animation editing operation time is saved, and the user experience is improved.
Example three:
fig. 3 shows a structure of a template clipping apparatus for panoramic video animation according to a third embodiment of the present invention, and for convenience of illustration, only the parts related to the third embodiment of the present invention are shown, which includes:
the template configuration module 31 is used for configuring an animation template file of the panoramic video to be played;
the template analysis module 32 is used for analyzing the animation template file to obtain an animation data sequence;
an animation data acquisition module 33, configured to acquire animation data of the current decoding timestamp based on the animation data sequence;
a rendering parameter calculation module 34, configured to calculate a rendering parameter of the current rendering model according to the acquired animation data; and
and the rendering module 35 is configured to render the panoramic video frame attached to the rendering model according to the rendering parameters.
Preferably, the animation data sequence includes parameters of each key frame and animation interpolation types between adjacent key frames, and the rendering parameter calculation module 34 further includes:
the first parameter calculation module is used for calculating rendering parameters of the current rendering model according to the parameters of the key frame corresponding to the current decoding timestamp if the current decoding timestamp corresponds to the parameters of the key frame; and
the second parameter calculation module is used for performing interpolation calculation according to the animation interpolation type corresponding to the current decoding timestamp and calculating the rendering parameters of the current rendering model according to the interpolation calculation result if the current decoding timestamp corresponds to the animation interpolation type;
preferably, the template clipping apparatus for panoramic video animation further comprises:
and the template generating module is used for generating an animation template file according to the dotting editing operation data of the user.
In the embodiment of the present invention, each module of the template clipping apparatus for panoramic video animation may be implemented by a corresponding hardware or software module, and each module may be an independent software or hardware module, or may be integrated into a software or hardware module, which is not limited herein. For specific implementation of each module of the template clipping apparatus for panoramic video animation, reference may be made to the description of the foregoing method embodiment, and details are not repeated here.
Example four:
fig. 4 shows a structure of a terminal according to a fifth embodiment of the present invention, and for convenience of description, only a portion related to the fifth embodiment of the present invention is shown.
The terminal 4 of an embodiment of the present invention comprises a processor 40, a memory 41 and a computer program 42 stored in the memory 41 and operable on the processor 40. The processor 40, when executing the computer program 42, implements the steps in the above-described method embodiments, such as the steps S101 to S105 shown in fig. 1. Alternatively, the processor 40, when executing the computer program 42, implements the functions of the modules in the above-described device embodiments, such as the functions of the modules 31 to 35 shown in fig. 3.
In the embodiment of the invention, the animation template file of the panoramic video to be played is configured, the animation template file is analyzed to obtain the animation data sequence, the animation data of the current decoding time stamp is obtained based on the animation data sequence, the rendering parameters of the current rendering model are calculated according to the obtained animation data, and the panoramic video frames attached to the rendering model are rendered according to the rendering parameters, so that the time for editing the animation of the same or different panoramic videos on different terminals is saved by sharing the animation template file, or the time for editing the different panoramic videos by using the same animation data on the same terminal is saved, and further the user experience is improved.
Example five:
fig. 5 illustrates the structure of a template clipping system for panoramic video animation according to a fifth embodiment of the present invention, and for convenience of illustration, only the parts related to the embodiment of the present invention are shown.
The template clipping system 5 of the panoramic video animation according to the embodiment of the present invention includes a first terminal 51 and a second terminal 52, where the first terminal 51 is configured to generate an animation template file according to dotting editing operation data of a user, and the second terminal 52 is a terminal as described in the fourth embodiment.
In the embodiment of the invention, the first terminal generates the animation template file according to the dotting editing operation data of the user, the second terminal configures the animation template file and clips the panoramic video according to the configured animation template file, so that the method can be applied to any panoramic video or the second terminal only by carrying out animation editing operation on the first terminal once, the animation editing operation time is saved, and the user experience is further improved.
Example six:
in an embodiment of the present invention, a computer-readable storage medium is provided, which stores a computer program that, when executed by a processor, implements the steps in the above-described method embodiment, for example, steps S101 to S105 shown in fig. 1. Alternatively, the computer program, when executed by a processor, implements the functionality of the modules in the apparatus embodiments described above, such as the functionality of modules 31 to 35 shown in fig. 3.
In the embodiment of the invention, the animation template file of the panoramic video to be played is configured, the animation template file is analyzed to obtain the animation data sequence, the animation data of the current decoding time stamp is obtained based on the animation data sequence, the rendering parameters of the current rendering model are calculated according to the obtained animation data, and the panoramic video frames attached to the rendering model are rendered according to the rendering parameters, so that the time for editing the animation of the same or different panoramic videos on different terminals is saved by sharing the animation template file, or the time for editing the different panoramic videos by using the same animation data on the same terminal is saved, and further the user experience is improved.
The computer readable storage medium of the embodiments of the present invention may include any entity or device capable of carrying computer program code, a recording medium, such as a ROM/RAM, a magnetic disk, an optical disk, a flash memory, or the like.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (10)
1. A method for template clipping of a panoramic video animation, the method comprising:
configuring an animation template file of a panoramic video to be played, wherein the animation template file is obtained in the following way: detecting dotting editing operation of a user, obtaining an animation data sequence according to the obtained dotting editing operation data, and generating an animation template file according to the animation data sequence when a template file generation request is received;
analyzing the animation template file to obtain an animation data sequence;
acquiring animation data of a current decoding time stamp based on the animation data sequence;
calculating rendering parameters of the current rendering model according to the acquired animation data;
rendering the panoramic video frame attached to the rendering model according to the rendering parameters.
2. The template clipping method of panoramic video animation according to claim 1, wherein the animation data sequence includes parameters of each key frame and animation interpolation types between adjacent key frames, and the step of calculating rendering parameters of the current rendering model according to the acquired animation data comprises:
if the current decoding timestamp corresponds to the parameter of the key frame, calculating the rendering parameter of the current rendering model according to the parameter of the key frame corresponding to the current decoding timestamp;
and if the current decoding time stamp corresponds to the animation interpolation type, performing interpolation calculation according to the animation interpolation type corresponding to the current decoding time stamp, and calculating the rendering parameters of the current rendering model according to the interpolation calculation result.
3. The template clipping method of panoramic video animation according to claim 2, wherein the parameters of the key frames include time stamps, view orientation and zoom degrees of the key frames, or the parameters of the key frames include time stamps of the key frames and relative changes of view orientation and zoom degrees of the key frames with respect to a reference key frame.
4. The template clipping method of panoramic video animation of claim 2, wherein the animation interpolation type includes one or a combination of the following:
linear, slow-in fast-out, fast-in slow-out, slow-first-slow-then-fast-second-slow.
5. The method of template clipping of panoramic video animation according to claim 2, wherein the panoramic video to be played comprises a first panoramic video and a second panoramic video, the sequence of animation data further comprises transition animation data, the transition animation data comprising a type of animation interpolation between a first transition key frame and a second transition key frame, the first transition key frame being a last key frame of the first panoramic video, the second transition key frame being a first key frame of the second panoramic video.
6. A method for template clipping of a panoramic video animation, the method comprising:
the method comprises the steps that a first terminal detects dotting editing operation of a user, an animation data sequence is obtained according to the obtained dotting editing operation data of the user, and when a template file generation request is received, an animation template file is generated according to the animation data sequence;
the second terminal clips the panoramic video based on the animation template file and using the method of any of claims 1-5.
7. An apparatus for template clipping of a panoramic video animation, the apparatus comprising:
the template configuration module is used for configuring an animation template file of the panoramic video to be played, and the animation template file is obtained in the following mode: detecting dotting editing operation of a user, obtaining an animation data sequence according to the obtained dotting editing operation data, and generating an animation template file according to the animation data sequence when a template file generation request is received;
the template analysis module is used for analyzing the animation template file to obtain an animation data sequence;
the animation data acquisition module is used for acquiring animation data of the current decoding time stamp based on the animation data sequence;
the rendering parameter calculation module is used for calculating rendering parameters of the current rendering model according to the acquired animation data; and
and the rendering module is used for rendering the panoramic video frame attached to the rendering model according to the rendering parameters.
8. A terminal comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 5 when executing the computer program.
9. A template clipping system for panoramic video animation is characterized by comprising a first terminal and a second terminal, wherein the first terminal is used for detecting dotting editing operation of a user, obtaining an animation data sequence according to the obtained dotting editing operation data of the user, and generating an animation template file according to the animation data sequence when a template file generation request is received, and the second terminal is the terminal according to claim 8.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110351842.1A CN113207037B (en) | 2021-03-31 | 2021-03-31 | Template clipping method, device, terminal, system and medium for panoramic video animation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110351842.1A CN113207037B (en) | 2021-03-31 | 2021-03-31 | Template clipping method, device, terminal, system and medium for panoramic video animation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113207037A CN113207037A (en) | 2021-08-03 |
| CN113207037B true CN113207037B (en) | 2023-04-07 |
Family
ID=77025975
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110351842.1A Active CN113207037B (en) | 2021-03-31 | 2021-03-31 | Template clipping method, device, terminal, system and medium for panoramic video animation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113207037B (en) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6079297B2 (en) * | 2013-02-26 | 2017-02-15 | 株式会社リコー | Editing apparatus, editing method, and editing program |
| CN107071557A (en) * | 2017-04-27 | 2017-08-18 | 中兴通讯股份有限公司 | A kind of method and apparatus for playing video |
| CN107330960A (en) * | 2017-06-28 | 2017-11-07 | 北京疯景科技有限公司 | Generation, the method and device for playing image |
| CN108010112B (en) * | 2017-11-28 | 2023-08-22 | 腾讯数码（天津）有限公司 | Animation processing method, device and storage medium |
-
2021
- 2021-03-31 CN CN202110351842.1A patent/CN113207037B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113207037A (en) | 2021-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108010112B (en) | Animation processing method, device and storage medium | |
| CN109389661B (en) | Animation file conversion method and device | |
| CN106507200B (en) | Video playing content insertion method and system | |
| CN114331820A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN113778419B (en) | Method and device for generating multimedia data, readable medium and electronic equipment | |
| CN109658485B (en) | Webpage animation drawing method, device, computer equipment and storage medium | |
| CN111163358A (en) | GIF image generation method, device, server and storage medium | |
| CN113115106A (en) | Automatic clipping method, device, terminal and storage medium of panoramic video | |
| CN111464760A (en) | Dynamic image generation method and device and terminal equipment | |
| CN115170709A (en) | Dynamic image editing method and device and electronic equipment | |
| CN111757177B (en) | Video clipping method and device | |
| CN113207037B (en) | Template clipping method, device, terminal, system and medium for panoramic video animation | |
| CN113034582A (en) | Pose optimization device and method, electronic device and computer readable storage medium | |
| CN117576388A (en) | Image processing method and device, storage medium and electronic equipment | |
| CN112906553A (en) | Image processing method, apparatus, device and medium | |
| CN113938750A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN116847147A (en) | Special effect video determining method and device, electronic equipment and storage medium | |
| CN111311712B (en) | Video frame processing method and device | |
| CN114357554A (en) | Model rendering method, rendering device, terminal, server and storage medium | |
| CN113379768A (en) | Image processing method, image processing device, storage medium and computer equipment | |
| CN116309964A (en) | Video generation method, device, equipment and storage medium | |
| CN110597579A (en) | Android system-based custom control generation method, apparatus, device and medium | |
| CN115174993B (en) | Method, apparatus, device and storage medium for video production | |
| CN113114955B (en) | Video generation method and device and electronic equipment | |
| CN110221873B (en) | Method for improving full-screen animation loading performance based on programming language and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |