WO2021026785A1

WO2021026785A1 - Video processing method and apparatus, and storage medium

Info

Publication number: WO2021026785A1
Application number: PCT/CN2019/100452
Authority: WO
Inventors: 李菊梅; 蒋松艳
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2019-08-13
Filing date: 2019-08-13
Publication date: 2021-02-18
Also published as: CN112154670A

Abstract

Provided are a video processing method and apparatus, and a storage medium. The method comprises: acquiring video speed regulation information, wherein the video speed regulation information comprises: a frame position of a speed regulation initial frame in an original video, a frame position of a speed regulation end frame in the original video, an initial speed corresponding to the speed regulation initial frame, and a target speed corresponding to the speed regulation end frame; determining, according to the video speed regulation information, a corresponding frame position, in the original video, of each frame in a target video, wherein the target video is a video obtained after the original video is subjected to speed regulation; and acquiring the target video according to the corresponding frame position, in the original video, of each frame in the target video. The target video after speed regulation processing can be stably acquired by means of acquiring video speed regulation information, and playing speeds corresponding to each frame or every several frames in the target video are different, so that variable speed regulation is realized, the display effect of a video is enhanced, and personalized requirements of a user for video speed regulation are met.

Description

Video processing method, device and storage medium

Technical field

The present invention relates to the field of image processing technology, and in particular to a video processing method, device and storage medium.

Background technique

In the field of video editing, it is often necessary to adjust the speed of the video to obtain slow motion or fast motion playback effects. The video speed adjustment method in the prior art is often a single speed adjustment for the entire video, that is, the entire video is edited and played at 2x speed or 0.5x speed, which cannot meet the individual needs of users.

Summary of the invention

The embodiments of the present invention provide a video processing method, device, and storage medium, which are used to solve the problem in the prior art that only a single speed adjustment can be performed for the entire video and cannot meet the individual needs of users.

The first aspect of the embodiments of the present invention is to provide a video processing method, including:

Acquire video speed adjustment information, the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and the initial speed corresponding to the speed adjustment initial frame, the The target speed corresponding to the end frame of speed adjustment;

Determining, according to the video speed adjustment information, a frame position corresponding to each frame in the target video in the original video, wherein the target video is a video obtained by adjusting the speed of the original video;

Obtain the target video according to the corresponding frame position of each frame in the target video in the original video.

The second aspect of the present invention is to provide a video processing device, including:

Memory, used to store computer programs;

The processor is configured to run a computer program stored in the memory to achieve: acquiring video speed adjustment information, the video speed adjustment information including: the frame position of the speed adjustment initial frame in the original video, and the speed adjustment end frame of the original video Frame position, and the initial speed corresponding to the initial frame of speed adjustment, and the target speed corresponding to the end frame of speed adjustment; determine the corresponding frame of each frame in the target video in the original video according to the video speed adjustment information Position, wherein the target video is a video obtained by adjusting the speed of the original video; the target video is acquired according to the frame position of each frame in the target video corresponding to the original video.

The third aspect of the present invention is to provide a computer-readable storage medium, the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, the program instructions are used in the first aspect The video processing method described.

In the video processing method provided in this embodiment, the video speed adjustment information is obtained, and the corresponding frame position of each frame in the target video in the original video is determined according to the video speed adjustment information, and then according to the target video Each frame in the original video corresponds to the position of the frame in the original video, so as to obtain the target video after the speed adjustment process, which can realize the variable speed adjustment of the video, improve the display effect of the target video, and meet the user's need for video speed adjustment. Individual needs.

The fourth aspect of the present invention is to provide a video processing method, including:

Determining, according to the video speed adjustment information, a speed adjustment parameter corresponding to the target video after the speed adjustment of the original video, the speed adjustment parameter including a speed adjustment start time, an original time length, and a target time length after speed adjustment;

Obtain the target video according to the speed adjustment parameter.

The fifth aspect of the present invention is to provide a video processing device, including:

Memory, used to store computer programs;

The processor is configured to run a computer program stored in the memory to achieve: acquiring video speed adjustment information, the video speed adjustment information including: the frame position of the speed adjustment initial frame in the original video, and the speed adjustment end frame of the original video Frame position, and the initial speed corresponding to the initial frame of speed adjustment, and the target speed corresponding to the end frame of speed adjustment; determine the speed adjustment parameter corresponding to the target video after the original video speed adjustment according to the video speed adjustment information, The speed adjustment parameter includes a speed adjustment start time, an original time length, and a target time length after speed adjustment; and the target video is acquired according to the speed adjustment parameter.

The sixth aspect of the present invention is to provide a computer-readable storage medium, the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, and the program instructions are used in the fourth aspect. The video processing method described.

The video processing method provided in this embodiment obtains video speed adjustment information, determines the speed adjustment parameter corresponding to the target video after the original video speed adjustment according to the video speed adjustment information, and obtains all speed adjustment parameters according to the speed adjustment parameter. According to the target video, the variable speed adjustment of the video can be realized, the display effect of the target video is improved, and the individual needs of users for video speed adjustment can be met.

Description of the drawings

The drawings described here are used to provide a further understanding of the application and constitute a part of the application. The exemplary embodiments and descriptions of the application are used to explain the application and do not constitute an improper limitation of the application. In the attached picture:

FIG. 1 is a schematic flowchart of a video processing method provided by an embodiment of the present invention;

2 is a schematic flowchart of determining the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information according to an embodiment of the present invention;

Figure 3 is an embodiment of the present invention for determining the corresponding frame position of each frame in the target video in the original video according to the original frame position corresponding to the part of the video frame, the adjusted frame position and the playback speed Flow chart one;

4 is a schematic flow chart of determining the original frame position, the adjusted frame position, and the playback speed corresponding to some video frames in the original video according to the video speed adjustment information according to an embodiment of the present invention;

FIG. 5 is a schematic diagram 1 of the process of obtaining the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed according to an embodiment of the present invention;

6 is a second schematic diagram of the process of obtaining the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed according to an embodiment of the present invention;

FIG. 7 is an embodiment of the present invention to determine the original frame position and speed adjustment corresponding to the speed adjustment intermediate frame at least partly according to the original frame position corresponding to the speed adjustment initial frame, the speed adjustment frame position and the playback speed Schematic diagram of the flow of post frame position and playback speed;

FIG. 8 is an embodiment of the present invention for determining the corresponding frame position of each frame in the target video in the original video according to the original frame position corresponding to the partial video frame, the adjusted frame position, and the playback speed. Flow chart two;

FIG. 9 is a schematic flowchart of another video processing method provided by an embodiment of the present invention;

FIG. 10 is a schematic flowchart of determining the speed adjustment parameter corresponding to the target video after the original video speed adjustment according to the video speed adjustment information according to an embodiment of the present invention;

11 is a schematic diagram of a scene of a video processing method provided by an application embodiment of the present invention;

FIG. 12 is a schematic structural diagram of a video processing apparatus provided by an embodiment of the present invention;

FIG. 13 is a schematic structural diagram of a video processing apparatus provided by an embodiment of the present invention.

detailed description

In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of the present invention. The terms used in the description of the present invention herein are only for the purpose of describing specific embodiments, and are not intended to limit the present invention.

In the field of video editing, it is often necessary to adjust the video speed to obtain slow motion or fast-motion playback effects. However, the video speed adjustment method in the prior art is often a single speed adjustment for the entire video, that is, the entire The video is edited and played at 2x speed or 0.5x speed, which cannot meet the individual needs of users. Based on this, the embodiments of the present invention provide a video processing method, device, and storage medium, which are used to solve the problem that the prior art can only perform a single speed adjustment for the entire video, and cannot meet the individual needs of users. .

The video processing method provided by the embodiment of the present invention can be used to process aerial video. For example, the user can remotely control the unmanned aerial vehicle through the control terminal to shoot the target scene while the unmanned aerial vehicle is hovering or moving. The video captured by the unmanned aerial vehicle can be transmitted to the control terminal through the wireless communication link, and further , The control terminal is equipped with an application program (APP) that can edit the video. The APP can adjust the speed of the aerial video taken by the unmanned aerial vehicle. For example, the user can select the frame position of the speed adjustment initial frame and the frame position of the speed adjustment end frame, and the initial speed corresponding to the speed adjustment initial frame and the target speed corresponding to the speed adjustment end frame. For example, the speed adjustment initial frame may be the 60th frame of the original aerial video, and the speed adjustment end frame may be the 600th frame of the original aerial video. The initial speed may be 1x speed, and the target speed may be 2x speed. The video processing method provided by the embodiment of the present invention can obtain a speed-regulated target video whose playback speed gradually changes from 1x speed to 2x speed. Different from the prior art in which the entire video is played at twice the speed, the embodiment of the present invention can realize the variable speed adjustment of the video, improve the display effect of the target video, and meet the individual needs of users for video speed adjustment.

Hereinafter, some embodiments of the present invention will be described in detail with reference to the accompanying drawings. Provided that there is no conflict between the various embodiments, the following embodiments and the features in the embodiments can be combined with each other.

FIG. 1 is a schematic flowchart of a video processing method provided by an embodiment of the present invention; referring to FIG. 1, this embodiment provides a video processing method. The execution body of the method is a video processing device, which can be It is conceivable that the processing device can be implemented as software, or a combination of software and hardware. Specifically, the method may include:

S1: Obtain video speed adjustment information. The video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and the initial speed and speed adjustment end frame corresponding to the speed adjustment initial frame The corresponding target speed.

Wherein, the video speed adjustment information may be speed adjustment information for all original videos, or may also be speed adjustment information for part of the original videos. For example, when the video speed adjustment information is the speed adjustment information for all original videos, the speed adjustment initial frame in the video speed adjustment information is the first frame in the original video, and the speed adjustment end frame is the original video Last frame; when the video speed control information is for part of the original video speed control information, the speed control initial frame in the video speed control information can be the first frame in the original video, and the speed control end frame can be the middle of the original video Frame; or, the speed adjustment initial frame in the video speed adjustment information is the first intermediate frame in the original video, and the speed adjustment end frame can be the second intermediate frame or the last frame in the original video, where the second intermediate frame corresponds The frame position of is greater than the frame position corresponding to the first intermediate frame.

In addition, this embodiment does not limit the specific acquisition method of video speed adjustment information. Those skilled in the art can set it according to specific application requirements and design requirements. For example, the user can input video adjustment parameters for the original video and adjust the parameters according to the video. The video speed adjustment information can be determined; or, the user can perform an operation on the original video input, and determine the frame position of the speed adjustment initial frame in the original video and the frame position of the speed adjustment end frame in the original video according to the performed operation; After obtaining the frame positions of the speed adjustment initial frame and the speed adjustment end frame in the original video, you can configure the speed of the speed adjustment initial frame and the speed adjustment end frame to obtain the initial speed and speed adjustment corresponding to the speed adjustment initial frame The target speed corresponding to the end frame. Of course, those skilled in the art can also use other methods to obtain the video speed adjustment information, as long as the accuracy and reliability of the acquisition of the video speed adjustment information can be ensured, which will not be repeated here.

S2: Determine the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information, where the target video is a video after speed adjustment of the original video.

After obtaining the video speed adjustment information, the video speed adjustment information can be analyzed and processed, so that the frame position of each frame in the target video corresponding to the original video can be obtained. For example: in the original video, the frame position of the speed adjustment initial frame is 60 frames, the frame position of the speed adjustment end frame is 70 frames, the initial speed corresponding to the speed adjustment initial frame is 1x speed, and the target speed corresponding to the speed adjustment end frame is 2x speed; taking the 67th frame in the target video as an example, through the analysis and processing of the above video speed adjustment information, it can be determined that the 67th frame in the target video corresponds to the 69th frame in the original video, that is, the frame in the target video The 67th frame corresponds to the 69th frame in the original video.

Of course, those skilled in the art can also use other methods to determine the corresponding frame position of each frame in the target video in the original video, as long as it can ensure that each frame in the target video corresponds to the frame position in the original video. It is sufficient to determine the accuracy and reliability, and will not be repeated here.

S3: Obtain the target video according to the corresponding frame position of each frame in the target video in the original video.

After obtaining the corresponding frame position of each frame in the target video in the original video, the corresponding frame can be obtained through the corresponding frame position of each frame in the target video in the original video, and all the obtained frames constitute In addition to the target video, further, the target video can be displayed.

In the video processing method provided in this embodiment, by acquiring video speed adjustment information, the corresponding frame position of each frame in the target video in the original video is determined according to the video speed adjustment information, and then according to the position of each frame in the target video in the original video. The corresponding frame position in the video, so as to obtain the target video after the speed adjustment process. Among them, each frame or every few frames in the target video corresponds to a different playback speed, thus realizing the variable speed adjustment of the video and improving The display effect of the target video meets the individual needs of users for video speed adjustment.

Fig. 2 is a schematic flow chart of determining the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information provided by an embodiment of the present invention; on the basis of the above embodiment, continue to refer to Fig. 2. In this embodiment, determining the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information may include:

S21: According to the video speed adjustment information, determine the original frame position, the speed adjusted frame position and the playback speed corresponding to some video frames in the original video. Some video frames include the speed adjustment initial frame, the speed adjustment initial frame and the speed adjustment end The speed-adjusted intermediate frame between frames.

Among them, for the speed adjustment initial frame and the speed adjustment end frame, the initial speed corresponding to the speed adjustment initial frame and the target speed corresponding to the speed adjustment end frame may be the same or different. At this time, part of the video frames in the original video can also include several speed-adjusting intermediate frames between the speed-adjusting initial frame and the speed-adjusting end frame; for the speed-adjusting intermediate frame, the initial speed corresponding to the initial frame When the target speed corresponding to the speed adjustment end frame is the same, the speeds of several speed adjustment intermediate frames may be the same as or different from the initial speeds corresponding to the speed adjustment initial frame. For example: the initial speed corresponding to the existing speed adjustment initial frame and the target speed corresponding to the speed adjustment end frame are both 1x speed. An achievable way is to set several adjustments between the speed adjustment initial frame and the speed adjustment end frame. The speed of the speed intermediate frame is different from the initial speed, and changes gradually; for example, the playback speed of the initial frame, several intermediate frames, and the end frame of the speed adjustment are: 1x speed, 1.2x speed, 1.4x speed, 1.5x speed, 1.3 times speed, 1.1 times speed, 1 times speed, that is, the speed of some intermediate frames of speed adjustment gradually increases first and then gradually decreases.

When the initial speed corresponding to the speed adjustment initial frame is different from the target speed corresponding to the speed adjustment end frame, for example, the initial speed corresponding to the speed adjustment initial frame is 1x speed, and the end speed corresponding to the speed adjustment end frame is 2x speed. At this time, The speed of several speed-adjusting intermediate frames can be greater than the initial speed and lower than the ending speed, for example: 1.2 times, 1.4 times, 1.5 times, 1.8 times, 1.9 times, that is, the speeds of several speed-adjusting intermediate frames are gradually increasing.

In addition, in order to accurately determine the corresponding frame position of each frame in the target video in the original video, the video speed adjustment information can be analyzed and processed first, so that the original frames corresponding to some video frames in the original video can be obtained The position, the position of the frame after the speed adjustment, and the playback speed. This part of the video frame may include: the speed adjustment initial frame, and one or more speed adjustment intermediate frames between the speed adjustment initial frame and the speed adjustment end frame. Specifically, referring to FIG. 4, in this embodiment, according to the video speed adjustment information, determining the original frame position, the adjusted frame position, and the playback speed corresponding to some video frames in the original video may include:

S211: Acquire the original frame position, the adjusted speed frame position, and the playback speed corresponding to the speed adjusted initial frame.

Among them, when obtaining the original frame position corresponding to the speed adjustment initial frame, the frame position after the speed adjustment, and the playback speed, referring to Figure 5, a method can realize the acquisition of the original frame position and speed adjustment corresponding to the speed adjustment initial frame. The following frame position and playback speed methods include:

2111: Determine the original frame position corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video.

Specifically, the frame position of the speed-adjusted initial frame in the original video is directly determined as the original frame position corresponding to the speed-adjusted initial frame.

2112: Determine the frame position after the speed adjustment corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video and the initial speed corresponding to the speed adjustment initial frame.

Among them, after obtaining the frame position of the speed-adjusted initial frame in the original video (the original frame position corresponding to the speed-adjusted initial frame), the adjustment can be determined according to the frame position of the speed-adjusted initial frame and the initial speed corresponding to the speed-adjusted initial frame. The speed-adjusted frame position corresponding to the speed initial frame, specifically, the ratio of the frame position of the speed-adjusted initial frame to the initial speed corresponding to the speed-adjusted initial frame in the original video can be obtained, and the ratio is determined as the speed-adjusted initial frame. The corresponding frame position after speed adjustment.

For example: the frame position of the speed-adjusted initial frame in the original video is 60 frames, and the initial speed corresponding to the speed-adjusted initial frame is 1x speed, then it can be determined that the speed-adjusted frame position corresponding to the speed-adjusted initial frame is 60 frames/ 1=60 frames; in the original video, the frame position of the speed-adjusted initial frame is 60 frames, and the initial speed corresponding to the speed-adjusted initial frame is 2 times the speed, then the speed-adjusted frame position corresponding to the speed-adjusted initial frame can be determined to be 60 Frame/2 = 30 frames; in the original video, the frame position of the initial frame of the speed adjustment is 60 frames, and the initial speed corresponding to the initial frame of the speed adjustment is 0.5 times the speed, then the frame position after the speed adjustment corresponding to the initial frame of the speed adjustment can be determined It is 60 frames/0.5=120 frames.

2113: Determine the playback speed corresponding to the initial frame of the adjustable speed according to the initial speed corresponding to the initial frame of the adjustable speed.

Wherein, the initial speed corresponding to the speed-adjusting initial frame may be a preset default speed, or may also be a playback speed designated or configured by the user. After the initial speed corresponding to the initial frame of the speed adjustment is obtained, the initial speed corresponding to the initial frame of the speed adjustment can be directly determined as the playback speed corresponding to the initial frame of the speed adjustment.

When the speeds of the video frames before the speed-adjusted initial frame are all the initial speeds corresponding to the speed-adjusted initial frame, the above method can be used to determine the speed-adjusted frame position of the initial speed-adjusted frame. For example, when the total length of the original video is 90 frames, the frame position of the speed adjustment initial frame is 60 frames, and the frame position of the speed adjustment end frame is 70 frames, the original video is divided into 3 videos by the video speed adjustment information Segments: the first video segment: 1-59 frames, the second video segment: 60-70 frames, and the second video segment: 71-90 frames. For the first video segment above, when the initial speed corresponding to the 60th frame is 2x speed, and the playback speed corresponding to frames 1-59 is the same as the initial speed corresponding to the 60th frame, then, because the first segment The playback speed corresponding to each frame in the video is also 2x speed, then the above method can be used to determine the speed-adjusted frame position of the speed-adjusted initial frame, that is, the speed-adjusted frame position corresponding to the speed-adjusted initial frame can be 60/2 = 30 frames.

However, when the speed of the video frame before the initial frame of the speed adjustment is the playback speed of the first frame in the original video, for example, the initial speed corresponding to the 60th frame is 2x speed, and the playback corresponding to frames 1-59 The speed is the playback speed of the first frame, that is, when the speed is 1x, then the position of the adjusted frame corresponding to the initial frame of the speed adjustment is related to the playback speed of the first frame. With reference to Figure 6, the following methods can be used to determine the position of the frame after the speed adjustment of the initial frame.

2114: Determine the original frame position corresponding to the speed-adjusted initial frame according to the frame position of the speed-adjusted initial frame in the original video.

2115: Determine the adjusted frame position corresponding to the adjusted initial frame according to the frame position of the adjusted initial frame in the original video and the playback speed of the first frame in the original video.

For example: the frame position of the speed-adjusted initial frame in the original video is 60 frames, and the playback speed of the first frame is 1x speed, then it can be determined that the speed-adjusted frame position corresponding to the speed-adjusted initial frame is 60 frames/1=60 Frame; in the original video, the frame position of the initial frame of the speed adjustment is 60 frames, and the playback speed of the first frame is 2 times the speed, then the adjusted frame position corresponding to the initial frame of the speed adjustment can be determined as 60 frames/2=30 frames ; In the original video, the frame position of the speed-adjusted initial frame is 60 frames, and the playback speed of the first frame is 0.5 times the speed, then it can be determined that the speed-adjusted frame position corresponding to the speed-adjusted initial frame is 60 frames/0.5=120 frames.

2116: According to the initial speed corresponding to the initial frame of speed adjustment, determine the playback speed corresponding to the initial frame of speed adjustment.

It should be noted that the order of execution between step S2111 and steps S2112 and S2113 in this embodiment is not limited to the order shown by the serial number, that is, steps S2112 and S2113 can also be performed before step S2111, or step S2112 , S2113 can also be executed simultaneously with step S2111. Similarly, the order of execution between step S2114 and steps S2115 and S2116 is not limited to the order shown by the serial number. That is, steps S2115 and S2116 can also be executed before step S2114, or steps S2115 and S2116 can also be executed before step S2114. Simultaneous execution.

S212: Determine the original frame position, the speed-adjusted frame position, and the playing speed corresponding to the speed-adjusted intermediate frame at least partly according to the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed.

After obtaining the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed, the adjustment can be determined based at least in part on the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed. The original frame position corresponding to the speed intermediate frame, the frame position after speed adjustment, and the playback speed. It should be noted that the above "determine the original frame position corresponding to the speed-adjusted intermediate frame, the position of the speed-adjusted frame, and the playback speed according to the original frame position corresponding to the speed-adjusted initial frame, the frame position after the speed-adjustment, and the playback speed at least in part. "Speed" means that the original frame position corresponding to the first speed-adjusted intermediate frame adjacent to the speed-adjusted initial frame can be determined according to the original frame position corresponding to the speed-adjusted initial frame, the post-speed-adjusted frame position, and the playback speed. Frame position and playback speed; and the original frame positions corresponding to other speed-adjusted intermediate frames after the first speed-adjusted intermediate frame, the frame position after speed-adjustment, and the playback speed can be based on the original frame of the first speed-adjusted intermediate frame The position, frame position and playback speed after speed adjustment are determined.

Specifically, referring to FIG. 7, in this embodiment, the original frame position corresponding to the speed-adjusted intermediate frame is determined at least partly based on the original frame position corresponding to the speed-adjusted initial frame, the post-speed-adjusted frame position, and the playback speed. The frame position and playback speed after speed adjustment can include:

S2121: Determine the frame position of the frame to be processed in the original video at least partially according to the original frame position and the playback speed corresponding to the speed-regulated initial frame.

Among them, the frame to be processed is located between the speed adjustment initial frame and the speed adjustment end frame; after obtaining the original frame position and playback speed corresponding to the speed adjustment initial frame, the original frame position and the playback speed corresponding to the speed adjustment initial frame can be at least partially The playback speed determines the frame position of the frame to be processed in the original video. It should be noted that the above “determine the frame position of the frame to be processed in the original video based at least in part on the original frame position and playback speed corresponding to the speed-regulated initial frame” means that the original frame position and the playback speed corresponding to the speed-regulated initial frame The playback speed determines the frame position corresponding to the first frame to be processed adjacent to the initial frame to be processed; and the frame positions corresponding to other frames to be processed after the first frame to be processed can be based on the first frame to be processed The original frame position and playback speed are determined.

For example: the original frame position corresponding to the speed adjustment initial frame is org_pos0, and the playback speed is speed, and then the first frame adjacent to the speed adjustment initial frame to be processed can be determined according to the original frame position and playback speed corresponding to the speed adjustment initial frame The frame position corresponding to the frame: org_pos1=org_pos0+speed, and then the frame position org_pos2=org_pos1+speed1 corresponding to the second adjacent frame to be processed can be determined according to the frame position org_pos1 corresponding to the first frame to be processed and the playback speed speed1, By analogy, the frame positions of multiple frames to be processed in the original video can be obtained.

It should be noted that when the sum value of org_pos+speed is not an integer, the sum value can be rounded, and the rounding method can be rounding down, rounding up, or using other rounding algorithms. More preferably, the sum value can be rounded down, so that the frame positions of multiple frames to be processed can be obtained.

S2122: Determine the interpolation speed of the frame to be processed according to the frame position of the frame to be processed in the original video, the frame position of the initial frame of speed adjustment in the original video, the frame position of the end frame of speed adjustment in the original video, and the initial speed and target speed.

After obtaining the frame position of the frame to be processed, the frame position of the frame to be processed in the original video, the frame position of the initial frame of the speed adjustment in the original video, the frame position of the end frame of the speed adjustment in the original video, as well as the initial speed and target The speed is analyzed and processed, so that the interpolation speed of the frame to be processed can be determined. For example: in the original video, the frame position of the initial frame of speed adjustment is 60 frames, the frame position of the end frame of speed adjustment is 70 frames, the initial speed is 1x speed, the target speed is 2x speed, and the frame position of the frame to be processed is 65 frames When, you can use the formula:

That is, the interpolation speed of frame 65 is

Double speed. Similarly, when the frame position of the frame to be processed is frame 67, the interpolation speed of the 67th frame can be obtained according to the above formula as

Double speed.

S2123: When the interpolation speed of the frame to be processed meets the preset condition, the frame to be processed is used as the speed adjustment intermediate frame, and the original frame position, the frame position after speed adjustment, and the playback speed corresponding to the frame to be processed are obtained; otherwise, Pending frames are discarded.

After the interpolation speed of the frame to be processed is obtained, the interpolation speed of the frame to be processed can be analyzed and identified to determine whether the interpolation speed of the frame to be processed meets preset conditions, where the preset conditions include: the interpolation speed of the frame to be processed and The difference in the playback speed corresponding to the previous frame of the frame to be processed is greater than or equal to the preset threshold; the preset threshold here can be set arbitrarily according to different application scenarios and application requirements, for example: when the initial speed is greater than the target speed, the preset threshold Set the threshold as the first preset threshold, that is, the first preset threshold is the minimum adjustment granularity used to implement slow adjustment of the video; when the initial speed is less than the target speed, the preset threshold is different from the first preset The second preset threshold of the threshold is set, that is, the second preset threshold is the minimum adjustment granularity used to realize rapid adjustment of the video.

Normally, when adjusting the speed of the original video, slow adjustment and fast adjustment can be included. For example: for slow speed adjustment (speed<1.0), you can set a speed adjustment interval every 0.25, such as: 0%-25%, 25%-50%, 50%-75%, 75%-100%; for fast speed Adjust (speed>1.0), you can adjust the interval every 1.0, such as: 100%~200%, 200%~300%...700%~800%. For each of the above intervals, each adjustment interval can be further refined by 8 particles, that is, for a slow video, the smallest particle is 1/32, and the smallest particle for slow adjustment of the original video is the first preview. Set a threshold; for fast videos, the smallest particle is 1/8, and the smallest particle for fast adjustment of the original video is the second preset threshold.

It is conceivable that the specific granularity of slow adjustment and fast adjustment of the original video is not limited to the above examples. Those skilled in the art can also adjust the information of slow adjustment and fast adjustment arbitrarily according to specific application requirements and design requirements. ; Among them, taking into account the equipment's processing performance of video information, the highest speed of fast adjustment can be 8 times.

The result of analyzing and identifying the interpolation speed of the frame to be processed is: when the interpolation speed of the frame to be processed does not meet the preset condition, that is, the difference between the interpolation speed of the frame to be processed and the playback speed corresponding to the previous frame of the frame to be processed If the value is less than the preset threshold, the frame to be processed is discarded, that is, the original frame position, the frame position after speed adjustment, and the playback speed corresponding to the frame to be processed are not calculated.

The result of analyzing and identifying the interpolation speed of the frame to be processed is: when the interpolation speed of the frame to be processed meets the preset condition, that is, the difference between the interpolation speed of the frame to be processed and the playback speed corresponding to the previous frame of the frame to be processed If it is greater than or equal to the preset threshold, the frame to be processed can be used as the speed adjustment intermediate frame, and the original frame position corresponding to the frame to be processed, the frame position after speed adjustment, and the playback speed can be obtained. It should be noted that the frame to be processed corresponds to The playback speed of can be determined according to the interpolation speed of the frame to be processed and a preset threshold. Specifically, according to the interpolation speed and the preset threshold, the following formula can be used to determine the playback speed corresponding to the video frame:

Among them, V is the playback speed corresponding to the video frame, V _p is the interpolation speed, λ is the preset threshold, and "round()" is the rounding function. For example, when the preset threshold is 1/32 of the first preset threshold, then determine the playback speed corresponding to the video frame:

When the preset threshold is 1/8 of the second preset threshold, then the playback speed corresponding to the video frame is determined:

Through the above method, the speed-adjusting intermediate frame whose interpolation speed meets the preset conditions can be accurately and quickly identified, and the original frame position, the speed-adjusted frame position and the playback speed corresponding to the speed-adjusting intermediate frame can be determined according to the interpolation speed. It is thought that the speed adjustment intermediate frame refers to at least a part of the video frame between the speed adjustment initial frame and the speed adjustment end frame. The speed adjustment intermediate frame is a part of the part of the video frame. Therefore, the The accuracy and reliability of obtaining the corresponding original frame position, frame position after speed adjustment, and playback speed.

S22: Determine the corresponding frame position of each frame in the target video in the original video according to the original frame position, the speed-adjusted frame position, and the playback speed corresponding to some video frames.

After obtaining the original frame position, the adjusted frame position and the playback speed corresponding to some video frames, the original frame position, the adjusted frame position and the playback speed corresponding to the partial video frame can be analyzed and processed to determine The corresponding frame position of each frame in the target video in the original video. Specifically, referring to Fig. 3, an achievable way is based on the original frame position corresponding to some video frames, the frame position after speed adjustment and Play speed, determine the corresponding frame position of each frame in the target video in the original video, including:

S221: Associatively store the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to each video frame in the partial video frames to obtain an association relationship set.

After obtaining the original frame position, the adjusted frame position, and the playback speed of each video frame in some video frames, the original frame position, the adjusted frame position and the playback speed of each video frame can be changed By performing associative storage, an association relationship set can be obtained, and the association relationship set includes an association relationship corresponding to each video frame in the partial video frames.

S222: Determine the frame position corresponding to each frame in the target video in the original video according to the association relationship set.

After the association relationship set is obtained, the frame position corresponding to each frame in the target video in the original video can be determined according to the association relationship set. Specifically, in the association relationship set, the first association relationship and the second association relationship corresponding to the position of the video frame may be determined. The first association relationship is adjacent to the second association relationship, and each frame in the target video is The corresponding frame position is greater than or equal to the first speed-adjusted frame position corresponding to the first association relationship, and smaller than the second speed-adjusted frame position corresponding to the second association relationship; then, the first association relationship is used to determine the target video The corresponding frame position of each frame in the original video.

For example: for a video length of 90 frames, the frame position of the initial frame of speed adjustment is 60 frames, the frame position of the end frame of speed adjustment is 70 frames, the initial speed corresponding to the initial frame of speed adjustment is 1x speed, and the end frame of speed adjustment corresponds to The target speed is 2 times speed. For the above-mentioned video information, an association relationship set can be obtained. The association relationship set includes the original frame position corresponding to each video frame, the association relationship between the frame position after speed adjustment and the playback speed (original frame Position, frame position after speed adjustment, playback speed), for example, the association relationship includes: (60,60,1), (62,62,1.25), (64.5,64,1.375), (65.875,65,1.5), (67.375,66,1.75), (69.125,67,1.875), (71,68,2).

When playing the target video, get the frame position corresponding to the current playing frame. Assuming that the frame position of the playing frame is the 63rd frame, according to all the association relationships in the above-established association relationship set, it can be based on the frame to be played in the target video Analyze and compare the frame position with all speed-adjusted frame positions in the association relationship, so that the first association relationship and the second association relationship corresponding to this playback frame can be found, that is, the 63 frames are in the first association relationship (62 /62/1.25) and the second association relationship (64.5/64/1.375) frames), and then obtain the three values (org_pos/speed_pos/speed) stored in association in the first association relationship, where org_pos is 62, The speed_pos is 62, and the speed is 1.25. Then, use the formula org_pos+(pos-speed_pos)*speed to obtain the original position of the current playback frame in the video, that is, the original frame position corresponding to the current 63 frames of playback is: 62+ (63-62)*1.25=63.25, which is 63 frames after rounding down.

According to the association relationship set, determine the corresponding frame position of each frame in the target video in the original video, which effectively ensures the accuracy and reliability of the determination of the corresponding frame position of each frame in the target video in the original video, and then can be based on this The frame position plays the target video.

In addition, referring to Figure 8, another achievable way is to determine that each frame of the target video is in the original video according to the original frame position corresponding to some video frames, the frame position after speed adjustment, and the playback speed. The corresponding frame positions include:

S223: Acquire a frame interval corresponding to each frame in the target video, and the interval start frame and the interval end frame of the frame interval are two adjacent frames in the partial video frames.

S224: Determine that each frame in the target video corresponds to the original video according to the frame position of each frame in the target video, the original frame position corresponding to the start frame of the interval, the frame position after speed adjustment, and the playback speed The frame position.

Specifically, when the target video is played, the frame position corresponding to the currently played frame in the target video can be obtained, and the frame interval corresponding to the currently played frame can be determined by the frame position. For example: when the frame position corresponding to the current playback frame is frame 67, the frame interval corresponding to the 67 frame can be obtained as (66, 68), where 66 is the interval start frame and 68 is the interval end frame ; Then, you can get the original frame position (67.375), the frame position (66) and the playback speed (1.75) corresponding to the start frame (66 frames) of the interval, according to each frame of the target video in the target video The frame position 67 in the frame, the original frame position 67.375 corresponding to the start frame of the interval, the frame position 66 after the speed adjustment and the playback speed 1.75, determine the current playback frame 67 in the target video, and the corresponding frame position in the original video is 69 frames Specifically, the original position of the current playing frame in the video can be obtained according to org_pos+(pos-speed_pos)*speed, that is, the corresponding frame position of the current playing frame 67 in the original video is: 67.375+(67-66) *1.75=69.125, it is 69 frames after rounding down to determine and decode the 69th frame of the original video.

By obtaining the frame interval corresponding to each frame in the target video, and then according to the frame position of each frame in the target video in the target video, the original frame position corresponding to the start frame of the interval, the frame position after speed adjustment, and the playback speed, Determine the corresponding frame position of each frame in the target video in the original video, effectively ensuring the accuracy and reliability of the determination of the corresponding frame position of each frame in the target video in the original video, and then the target video can be determined according to the frame position To play.

On the basis of the above embodiment, in order to be able to quickly and accurately determine the original frame position, the adjusted frame position and the playback speed of some video frames in the original video, when the adjusted initial frame is not the first frame of the original video At this time, some of the video frames may also include the first frame, and the first frame is the first video frame in the original video. Furthermore, determining the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to some video frames in the original video in this embodiment further includes:

S213: Determine the original frame position, the speed-adjusted frame position, and the playback speed corresponding to the first frame.

Among them, the first frame in the original video will also be the first frame in the target video after the speed adjustment, that is, the original frame position and the speed adjustment frame position corresponding to the first frame can be directly obtained, for example, the first frame The corresponding original frame position and the frame position after speed adjustment are all 0, and the playback speed corresponding to the first frame can be a preset default speed, a configured speed or a user-specified playback speed.

Further, when the speed adjustment end frame is the last frame of the original video, part of the video frame also includes the speed adjustment end frame; at this time, in this example, determine the original frame position and speed adjustment corresponding to some video frames in the original video. Back frame position and playback speed, including:

S214: Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the end frame of the speed adjustment.

Wherein, when the speed adjustment end frame is the last frame of the original video, the original frame position corresponding to the speed adjustment end frame can be determined according to the video length. For example, the original frame position corresponding to the speed adjustment end frame is 70. The playback speed corresponding to the last frame may be the target speed that the speed adjustment end frame needs to achieve, or it may be other speeds that are default or pre-configured. For example, when determining the frame position after the speed adjustment corresponding to the last frame, the total length of the original video, the original frame position corresponding to the frame before the last frame, the frame position after speed adjustment, and the playback speed can be obtained, and then according to the original The total length of the video, the original frame position corresponding to the frame before the last frame, the frame position after speed adjustment, and the playback speed determine the frame position after speed adjustment corresponding to the last frame. Specifically, the following formula can be used to determine the frame position after the speed adjustment corresponding to the last frame:

speed_pos_end=speed_pos+(length-org_pos)/speed;

Among them, speed_pos_end is the speed-adjusted frame position corresponding to the last frame, speed_pos is the speed-adjusted frame position corresponding to the frame before the last frame, length is the total length of the original video, and org_pos is the frame before the last frame. The original frame position, speed is the playback speed corresponding to one frame after the end frame of the speed adjustment.

For example, the original video has a total of 70 frames, the initial frame of the speed adjustment is the 60th frame in the original video, and the end frame of the speed adjustment is the 70th frame in the original video. The frame before the last frame corresponds to (original frame position, Frame position after speed adjustment, playback speed) is (69.125,67,1.875), length=70, then speed_pos+(length-org_pos)/speed=67+(70-69.125)/1.875=67.46 (approximately), then record the last End point (70/67.46/1.875).

Further, when the speed adjustment end frame is not the last frame of the original video, some video frames also include a frame after the speed adjustment end frame and the last frame in the original video; wherein, the frame after the speed adjustment end frame can be Adjacent or not adjacent to the end frame of the speed control. At this time, determine the original frame position, the frame position after speed adjustment, and the playback speed corresponding to some video frames in the original video, including:

S215: Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to a frame after the speed adjustment end frame.

Since some video frames include a frame after the end frame of the speed adjustment, it is necessary to determine the original frame position, the position of the frame after the speed adjustment, and the playback speed corresponding to the frame after the end frame of the speed adjustment. Specifically, in the process of obtaining the above-mentioned association relationship set, it can be judged in real time whether the original frame position of the current frame in the association relationship set exceeds the frame position corresponding to the end frame of the speed adjustment, and the original frame position of the current frame is greater than the speed adjustment When the frame position corresponding to the end frame is determined, the current frame can be determined as the frame after the speed adjustment end frame, where the frame position of the frame after the speed adjustment end frame in the original video is based on the last frame of the speed adjustment intermediate frame The original frame position corresponding to a frame and the playback speed are determined, for example: the original frame position of the current frame = the original frame position corresponding to the last frame of the speed-adjusting intermediate frame + the playback speed. For example, the original video has a total of 90 frames, the initial frame of the speed adjustment is the 60th frame in the original video, the end frame of the speed adjustment is the 70th frame in the original video, and the last frame of the intermediate frame of the speed adjustment corresponds to the (original frame position) , The frame position after the speed adjustment, the playback speed) is (69.125, 67, 1.875), then the original frame position of the frame after the speed adjustment end frame = the original frame position corresponding to the last frame of the speed adjustment intermediate frame + the playback speed = 69.125+1.875=71.

Further, the target speed corresponding to the speed adjustment end frame may be determined as the playback speed corresponding to a frame after the speed adjustment end frame. Then, the post-speed-adjustment position of the frame after the speed-adjustment end frame can be determined according to the post-speed-adjustment frame position of the last frame in the intermediate frame of the speed adjustment, that is, speed_posi+1=speed_posi+1, where speed_posi+1 is The speed-adjusted position of the frame after the end of speed frame, speed_posi is the speed-adjusted frame position of the last frame of the speed-adjusted intermediate frame. In this way, a frame (71, 68, 2) after the frame where the speed adjustment ends is recorded.

S216: Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the last frame.

Specifically, when determining the original frame position corresponding to the last frame, the original frame position corresponding to the last frame may be determined according to the video length, for example, the original frame position corresponding to the last frame is 90. The playback speed corresponding to the last frame may be the target speed that the speed adjustment end frame needs to achieve, or it may be other speeds that are default or pre-configured. When determining the frame position after the speed adjustment corresponding to the last frame, the total length of the original video, the original frame position corresponding to the frame after the speed adjustment end frame, the frame position after speed adjustment and the playback speed can be obtained, and then according to the original video The total length, the original frame position corresponding to the frame after the speed adjustment end frame, the adjusted frame position and the playback speed determine the adjusted frame position corresponding to the last frame. Specifically, the following formula can be used to determine the frame position after the speed adjustment corresponding to the last frame:

speed_pos_end=speed_pos+(length-org_pos)/speed;

Among them, speed_pos_end is the speed-adjusted frame position corresponding to the last frame, speed_pos is the speed-adjusted frame position corresponding to a frame after the speed adjustment end frame, length is the total length of the original video, and org_pos is one frame after the speed adjustment end frame. The position of the original frame corresponding to the frame, and speed is the playback speed corresponding to one frame after the end frame of the speed adjustment.

For example, the original video has a total of 90 frames, the initial frame of the speed adjustment is the 60th frame in the original video, the end frame of the speed adjustment is the 70th frame in the original video, and the frame after the end of the speed adjustment corresponds to the (original frame position) , The frame position after speed adjustment, the playback speed) is (71,68,2), then speed_pos_end=speed_pos+(length-org_pos)/speed=68+(90-71)/2=77.5, record the last frame (90, 77.5, 2).

Determine the original frame position, the adjusted frame position and the playback speed of the original video by the above method, which effectively guarantees the acquisition of the original frame position, the adjusted frame position and the playback speed of the partial video frame The accuracy and reliability of data processing, and, it is conceivable that, because the original frame position of some video frames, the frame position after speed adjustment and the playback speed are calculated and stored, the speed and quality of data processing are effectively improved, and the data is reduced. Processing the data resources that need to be occupied, and also reduces the storage area occupied.

FIG. 9 is a schematic flowchart of another video processing method provided by an embodiment of the present invention; referring to FIG. 9, this embodiment provides another video processing method, and the execution subject of the method is a video processing device , The processing device may be implemented as software or a combination of software and hardware. It should be noted that the application environment of the video processing method provided in this embodiment is different from the application environment of the video processing method corresponding to FIG. 1, and the application environment of the video processing method corresponding to FIG. The constituted application environment, the application environment of the video processing method provided in this embodiment may include an application environment constituted based on the IOS system.

Specifically, the method may include:

S101: Obtain video speed adjustment information. The video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and the initial speed and speed adjustment end frame corresponding to the speed adjustment initial frame The corresponding target speed.

Among them, the specific implementation manner and implementation effect of step S101 in this embodiment are similar to the specific implementation manner and implementation effect of step S1 in the foregoing embodiment. For details, please refer to the foregoing statement content, which is not repeated here.

S102: Determine the speed adjustment parameter corresponding to the target video after the speed adjustment of the original video according to the video speed adjustment information, where the speed adjustment parameter includes the speed adjustment start time, the original time length, and the target time length after the speed adjustment.

After the video speed adjustment information is obtained, the video speed adjustment information can be analyzed and processed, so that the speed adjustment parameters corresponding to the target video after the original video speed adjustment can be obtained. Specifically, referring to FIG. 10, this embodiment The speed adjustment parameter corresponding to the target video after the speed adjustment of the original video is determined according to the video speed adjustment information may include:

S1021: According to the video speed adjustment information, determine the original frame position, the speed adjusted frame position, and the playback speed of some video frames in the original video. Some video frames include the speed adjustment initial frame and the speed adjustment initial frame and the speed adjustment end frame Adjust the speed between intermediate frames.

Among them, the specific implementation manner and implementation effect of step S1021 in this embodiment are similar to the specific implementation manner and implementation effect of step S21 in the foregoing embodiment. For details, reference may be made to the foregoing statements, and details are not repeated here.

S1022: Associatively store the original frame position, the speed-adjusted frame position, and the playback speed corresponding to each video frame in the partial video frames to obtain an association relationship set.

Among them, the specific implementation manner and implementation effect of step S1022 in this embodiment are similar to the specific implementation manner and implementation effect of step S221 in the foregoing embodiment. For details, please refer to the foregoing statement content, which will not be repeated here.

S1023: Determine the speed adjustment parameter corresponding to the target video after the speed adjustment of the original video according to the association relationship set.

After obtaining the association relationship set, the preset processing algorithm can be used to analyze and process the association relationship set, so that the speed adjustment parameter corresponding to the target video after the original video speed adjustment can be determined. The speed adjustment parameter includes the speed adjustment start time , Original duration and target duration after speed adjustment.

Take (org_pos, speed_pos, speed) as an example to represent the above association relationship, where org_pos is the original frame position, speed_pos is the frame position after speed adjustment, and speed is the playback speed. Take the two adjacent groups (org_pos1, speed_pos1, speed1) (org_pos2, speed_pos2, speed2). According to the starting frame position org_pos1, the speed adjustment start time can be obtained, and the original time length can be obtained according to the difference between org_pos2 and org_pos1. According to the difference between org_pos2 and org_pos1 The ratio of the difference to speed1 can get the target time after speed adjustment. In this way, a set of corresponding speed control parameters can be obtained for each adjacent two sets of association relationships.

S103: Obtain the target video according to the speed adjustment parameter.

After the speed adjustment parameters are obtained, the target video can be obtained according to the speed adjustment parameters, thereby achieving stable and effective playback of the target video after the speed adjustment processing.

The embodiment of the present invention is equivalent to dividing the entire video into multiple video segments, and each video segment corresponds to a different playback speed, thereby realizing variable speed regulation of the video as a whole.

The video processing method provided in this embodiment obtains video speed adjustment information, determines the speed adjustment parameter corresponding to the target video after the original video speed adjustment according to the video speed adjustment information, and obtains the target video according to the speed adjustment parameter, thereby realizing the speed change Speed adjustment improves the display effect of the target video and meets the individual needs of users for video speed adjustment.

For specific applications, referring to FIG. 11, this application embodiment provides a video processing method. The execution body of the method is a video processing device. When the processing device executes the video processing method, it may include a video processing method. The process of acquisition and video processing, specifically:

step0: Get the video data to be processed.

Specifically, the video data of the target object can be acquired through the camera on the drone. Alternatively, an airship/unmanned vehicle and a camera can be used to obtain the video data for the target object; or the remote control car and a 360° camera can be used to obtain the video data for the target object; or the camera linkage technology can be used to obtain the video data. To the video data for the target object.

step2: The processing device that transmits the video data to, and the processing device processes the video data.

Among them, the processing device may be a mobile phone, a tablet computer, a desktop computer, etc., a terminal device that can process video data. After the processing device obtains the video data, the video data can be processed. Specifically, the video data can be adjusted slowly or quickly; among them, for the slow adjustment (speed <1.0), an interval of 0.25, such as 0 %～25%, 25%～50%, 50%～75%, 75%～100%; for fast adjustment (speed>1.0), every 1.0 interval, such as 100%～200%, 200%～300%. ..... 700%～800%. Furthermore, for each interval, 8 particles can be further refined, that is, for slow videos, the smallest particle is 1/32, and for fast videos, the smallest particle is 1/8. For ease of understanding, take the original video with a length of 90 frames, the initial frame of speed adjustment A point is the 60th frame, the speed is 1x speed, the end frame of speed adjustment B is the 70th frame, and the speed is 2x speed as an example. For ease of description, define the following parameters: org_pos(i) is the corresponding original frame position of the i-th frame, speed_pos(i) is the frame position of the i-th frame after speed adjustment, org_speed is the interpolation speed obtained by linear interpolation, slow Speed adjustment: speed=round(org_speed*32)/32, fast adjustment, speed=round(org_speed*8)/8, where round is the rounding function.

Specifically, the method includes the following steps:

step2.1: Through linear interpolation, the interpolation speed of each frame from frame 60 to frame 70 can be 1, 1.1, 1.2, 1.3, 1.4, 1.5, 1.6, 1.7, 1.8, 1.9, 2. This step is optional, and the interpolation speed of the speed-adjusting intermediate frame can also be obtained in the subsequent steps.

step2.2: For the 60th frame, the original video frame position org_pos=60 and the interpolation speed org_speed=1. At this time, assuming that the speed from the 1st to 59th frames is the same as the 60th frame, both are 1x speed, and then we can get The frame position after speed adjustment speed_pos=org_pos/org_speed=60/1=60, speed=org_speed=1, org_pos, speed_pos, and speed can be obtained at this time. In order to reduce the progress loss in the intermediate calculation process, speed_pos can be Double type, rounding calculation is not done during the intermediate calculation. The above parameters are stored in association, that is, the association relationship (60, 60, 1) is obtained, and the next processing point is org_pos(60)+speed(60)=60+1=61.

step2.3: For the 61st frame, the original video frame position org_pos(61)=org_pos(60)+speed=60+1=61, interpolation speed org_speed=1.1, speed_pos(61)=speed_pos(60)+1=60 +1=61, get the difference between the interpolation speed and speed(60) as 0.1, compare 0.1 with 1/8 of the smallest particle for quick adjustment of the video, 0.1 is less than 1/8, so this frame is not (61 frames) for associated storage, and the next processing point is org_pos(61)+speed(60)=61+1=62.

step2.4: For the 62nd frame, the original video frame position org_pos(62)=org_pos(61)+speed=61+1=62, the interpolation speed org_speed=1.2, get the interpolation speed and the last stored speed speed(60 The difference between) is 1.2-1=0.2. Compare 0.2 with 1/8 of the smallest particle for fast adjustment of the video, 0.2 is greater than 1/8, because the user-adjustable speed must be within the above-mentioned pre-planned fine If it is not on the particle, the speed needs to be attributed to the nearest particle speed. Therefore, according to the formula speed(62)=round(org_speed*8)/8=1.25, speed_pos(62)=speed_pos(61) +1=62, store (62, 62, 1.25) associative, and enter the next processing point is org_pos(62)+speed(62)=62+1.25=63.25.

step2.5: For the 63rd frame (63.25 rounded down), the original video frame position org_pos(63)=org_pos(62)+speed(62)=63.25, interpolation speed org_speed=1.3, speed_pos=62+1=63 , The difference between the obtained interpolation speed and the last stored speed speed(62) is 0.05, which is less than 1/8, so this frame is not stored associative, and the next processing point is org_pos(63)+ speed(62)=63.25+1.25=64.5.

Among them, when the next processing point is 63.25 frames, since there is no 63.25 frame, the above processing points are rounded. In order to ensure the quality and efficiency of data processing, the above processing points can be rounded down. 63 frames to be processed can be obtained. At this time, the obtained 63 frames are the video frames skipped by the previous calculation.

step2.6: For the 64th frame (64.5 rounded down), the original video frame position org_pos(64)=org_pos(63)+speed(62)=63.25+1.25=64.5, interpolation speed org_speed=1.4, get the interpolation value The difference between the speed and the last stored speed speed(62) is 0.15, 0.15 is greater than 1/8, according to the formula speed(64)=round(org_speed*8)/8=1.375, speed_pos=63+1= 64. Associative storage (64.5, 64, 1.375), and entering the next processing point is org_pos(64)+speed(64)=64.5+1.375=65.875.

step2.7: For the 65th frame (65.875 rounded down), the original video frame position org_pos(65)=org_pos(64)+speed(64)=64.5+1.375=65.875, interpolation speed org_speed=1.5, get the interpolation value The difference between the speed and the last stored speed speed(64) is 0.125, 0.125=1/8, then according to the formula speed=round(org_speed*8)/8=1.5, speed_pos=64+1=65, associated Store (65.875,65,1.5), and enter the next processing point is org_pos(65)+speed(65)=65.875+1.5=67.375.

step2.8: For the 67th frame (67.375 rounded down), the original video frame position org_pos(67)=org_pos(65)+speed(65)=65.875+1.5=67.375, interpolation speed org_speed=1.7, get the interpolation value The difference between the speed and the last stored speed speed(65) is 0.2. If 0.2 is greater than 1/8, then according to the formula speed=round(org_speed*8)/8=1.75, speed_pos=65+1=66, the association Store (67.375,66,1.75) and enter the next processing point is org_pos(67)+speed(67)=67.375+1.75=69.125.

step2.10: For the 69th frame (69.125 rounded down), the original video frame position org_pos(69)=org_pos(67)+speed(67)=67.375+1.75=69.125, interpolation speed org_speed=1.9, get the interpolation value The difference between the speed and the last stored speed speed(67) is 0.15, 0.15 is greater than 1/8, then according to the formula speed=round(org_speed*8)/8=1.875, speed_pos=66+1=67, associated Store (69.125, 67, 1.875) and enter the next processing point is org_pos(69)+speed(69)=69.125+1.875=71.

step2.11: For the 71st frame, the original video frame position org_pos(71)=org_pos(69)+speed(69)=69.125+1.875=71, the original video frame position corresponding to this frame exceeds point B, at this time, It can be determined that org_speed=2, speed_pos=67+1=68, and associated storage (71, 68, 2).

step2.12: For the last frame in the original video, the frame position after the speed adjustment corresponding to the last frame can be calculated using the formula speed_pos(71)+(length-org_pos(71))/speed(71), thus It is possible to obtain speed_pos=68+(90-71)/2=77.5, so the association relationship of the last frame recorded is (90, 77.5, 2).

It should be noted that if the original video has only 70 frames, that is, point B of the end frame of speed adjustment at this time is the last frame of the original video. At this time, the original video frame position org_pos=org_pos+speed=69.125+1.875= 71. When point B is exceeded, the three values of the last storage point are (69.125, 67, 1.875), and the number of frames of the entire video is length=70. At this time, use the following formula speed_pos+(length-org_pos)/speed= 67+(70-69.125)/1.875=67.46 (approximately), then record the final end point value (70, 67.46, 1.875).

step 2.13: In addition, for the first frame in the original video, the association relationship of the first frame can be recorded as (0, 0, 1).

The arrays stored so far are (0,0,1); (60,60,1); (62,62,1.25); (64.5,64,1.375); (65.875,65,1.5); (67.375,66, 1.75); (69.125,67,1.875); (71,68,2); (90,77.5,2).

Among them, from the above recorded array data, it can be seen that for multiple video frames in the video, the playback speed is different, which can increase the playback effect of the video. For example, the playback effect of the video can be gradually accelerated or changed gradually. Slow, or make the playback effect of the video gradually speed up first, then gradually slow down, etc., so that the playback effect of the video has been greatly improved and improved to meet the individual needs of users.

In addition, no matter what type and length of video, using the processing method in this application embodiment, only 96 associated storage values need to be stored at most, and which video needs to be displayed after any video acceleration can be calculated. frame. For example, for the original video whose speed adjustment initial frame to speed adjustment end frame is from 60 to 600 frames, and accelerated from speed 1 to 2, only 7 to 8 associated storage values need to be recorded. In this way, the quality and efficiency of array acquisition are effectively improved, the complexity and difficulty of calculating data in order to acquire the array are reduced, and the storage space required by the array is reduced.

Further, after obtaining the above-mentioned array, the following steps may also be included:

step2.14: When playing the video, when the application system of the processing device is the Android system, the time stamp of the currently played frame can be obtained, and then the time stamp is sent to the decoder, so that the corresponding display can be obtained frame.

For example: you can get the current playback frame pos (assuming that the 63rd frame is played, that is, when the 63rd frame in the target video after speed adjustment is played), according to the array established above, find the position of the speed-adjusted frame where the playback frame is located Interval (combined with the above example, 63 is between 62 (62/62/1.25) and 64 (64.5/64/1.375) frames), and take out the three values (org_pos/speed_pos/speed) at the beginning of the interval, and combine the above The example is 62/62/1.25. According to the formula org_pos+(pos-speed_pos)*speed, the original position of the current playing frame in the video can be obtained, that is, the original video frame position corresponding to 63 frames is 62+(63-62)* 1.25=63.25, after rounding down 63.25, the original video frame position is obtained as 63 frames, and the 63rd frame image in the original video is decoded.

For another example, the current playback frame is 67, 67 is between 66 (67.375, 66, 1.75) and 68 (71, 68, 2). Therefore, according to the formula org_pos+(pos-speed_pos)*speed, the current playback frame is obtained The original position in the video is 67.375+(67-66)*1.75=69.125, which is 69 frames after rounding down, and the 69th frame image in the original video is decoded.

For another example, the current playback frame is 70 frames, 70 is between 68 (71, 68, 2) and 77.5 (90, 77.5, 2). Therefore, according to the formula org_pos+(pos-speed_pos)*speed, the current playback frame is obtained The original position in the video is 71+(70-68)*2=75, and the 75th frame image in the original video is decoded.

For another example, the current playback frame is 4 frames, and 4 is between (0,0,1) and (60,60,1). Therefore, according to the formula org_pos+(pos-speed_pos)*speed to obtain the current playback frame in the video The original position of 0+(4-0)*1=4, decode the 4th frame of the original video.

step2.15: When playing the video, when the application system of the processing device is the ios system, you can calculate the start time of each interval, the original duration and the target after the speed adjustment according to the interval of the recording array. Time length, the speed adjustment start time, original time length, and target time length after speed adjustment are sent to the corresponding interface as speed adjustment parameters, and then the decoder can automatically return to what is needed after speed adjustment according to the received speed adjustment parameters Video frame.

FIG. 12 is a schematic structural diagram of a video processing apparatus provided by an embodiment of the present invention; the video processing apparatus may include: one or more first processors 21 and one or more first memories 22. Wherein, the first memory 22 is used to store a program for executing the video processing method provided in the embodiments shown in FIG. 1 to FIG. 8 and FIG. 11. The first processor 21 is configured to execute a program stored in the first memory 22. specific,

The program includes one or more computer instructions, where one or more computer instructions can implement the following steps when executed by the first processor 21:

It is used to run the computer program stored in the first memory 22 to achieve: obtain video speed adjustment information, the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and The initial speed corresponding to the initial frame of the speed adjustment and the target speed corresponding to the end frame of the speed adjustment; determine the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information, where the target video is to adjust the original video Speeded up video; Obtain the target video according to the corresponding frame position of each frame in the target video in the original video.

Wherein, the structure of the video processing apparatus may further include a first communication interface 23 for the electronic device to communicate with other devices or a communication network.

Further, the first processor 21 is further configured to: according to the video speed adjustment information, determine the original frame position, the speed adjusted frame position, and the playback speed corresponding to some video frames in the original video, and some video frames include the speed adjustment initial Frame, the intermediate frame between the initial frame and the end frame; according to the original frame position corresponding to the part of the video frame, the frame position after the speed adjustment and the playback speed, it is determined that each frame in the target video is in the original The corresponding frame position in the video.

Further, the first processor 21 is further configured to: associate and store the original frame position, the frame position after speed adjustment, and the playback speed corresponding to each video frame in the partial video frames to obtain an association relationship set; Set, determine the corresponding frame position of each frame in the target video in the original video.

Further, the first processor 21 is further configured to: obtain the original frame position corresponding to the speed-adjusted initial frame, the post-speed-adjusted frame position, and the playback speed; at least partly according to the original frame position and the speed-adjusted initial frame. Determine the position of the frame after speed adjustment and the playback speed, determine the original frame position corresponding to the middle frame of speed adjustment, the position of the frame after speed adjustment, and the playback speed.

Further, the first processor 21 is further configured to: determine the original frame position corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video; and according to the frame position and adjustment of the speed adjustment initial frame in the original video The initial speed corresponding to the speed initial frame is determined to determine the position of the adjusted frame corresponding to the initial frame of speed adjustment; the playback speed corresponding to the initial frame of speed adjustment is determined according to the initial speed corresponding to the initial frame of speed adjustment.

Further, the first processor 21 is further configured to: determine the original frame position corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video; according to the frame position of the speed adjustment initial frame in the original video and the original video The playback speed of the first frame in the middle, determine the frame position after the speed adjustment corresponding to the initial frame of the speed adjustment; determine the playback speed corresponding to the initial frame of the speed adjustment according to the initial speed corresponding to the speed adjustment initial frame.

Further, the first processor 21 is further configured to: determine the frame position of the frame to be processed in the original video at least in part according to the original frame position and the playback speed corresponding to the initial frame of the speed adjustment; according to the frame of the frame to be processed in the original video The position, the frame position of the initial frame of the speed adjustment in the original video, the frame position of the end frame of the speed adjustment in the original video, as well as the initial speed and target speed, determine the interpolation speed of the frame to be processed; when the interpolation speed of the frame to be processed meets the preset conditions When the frame is adjusted, the frame to be processed is used as an intermediate frame for speed adjustment, and the original frame position, the frame position after speed adjustment, and the playback speed corresponding to the frame to be processed are obtained; otherwise, the frame to be processed is discarded.

The preset condition includes: the difference between the interpolation speed of the frame to be processed and the playback speed corresponding to the previous frame of the frame to be processed is greater than or equal to a preset threshold. The playback speed of the frame to be processed is determined according to the interpolation speed of the frame to be processed and a preset threshold.

Further, when the initial speed is greater than the target speed, the preset threshold is a first preset threshold, and when the initial speed is less than the target speed, the preset threshold is a second preset threshold different from the first preset threshold.

Further, when the speed-adjusted initial frame is not the first frame of the original video, some of the video frames also include the first frame; the first processor 21 is further configured to: determine the original frame position corresponding to the first frame and the speed-adjusted frame Position and playback speed.

Further, when the speed adjustment end frame is the last frame of the original video, some of the video frames also include the speed adjustment end frame; the first processor 21 is also used for determining the original frame position corresponding to the speed adjustment end frame, and the speed adjustment Post frame position and playback speed.

Further, when the speed adjustment end frame is not the last frame of the original video, some video frames also include a frame after the speed adjustment end frame and the last frame in the original video; the first processor 21 is further configured to: determine The position of the original frame, the position of the frame after the speed adjustment, and the playback speed of the frame after the end of the speed adjustment frame; the original frame position, the position of the frame after the speed adjustment, and the playback speed corresponding to the last frame are determined.

Wherein, the frame position of a frame in the original video after the speed adjustment end frame is determined according to the original frame position and the playback speed corresponding to the last frame of the speed adjustment intermediate frame.

Further, the first processor 21 is further configured to: obtain the frame interval corresponding to each frame in the target video, the interval start frame and the interval end frame of the frame interval are two adjacent frames in the partial video frame; The frame position of each frame in the video in the target video, the original frame position corresponding to the start frame of the interval, the frame position after speed adjustment, and the playback speed are determined to determine the corresponding frame position of each frame in the target video in the original video.

The device shown in FIG. 12 can execute the methods of the embodiments shown in FIG. 1 to FIG. 8 and FIG. 11. For parts that are not described in detail in this embodiment, please refer to the related descriptions of the embodiments shown in FIG. 1 to FIG. 8 and FIG. 11. For the implementation process and technical effects of this technical solution, please refer to the description in the embodiments shown in FIG. 1 to FIG. 8 and FIG. 11, and will not be repeated here.

In addition, an embodiment of the present invention provides a computer-readable storage medium. The storage medium is a computer-readable storage medium. The computer-readable storage medium stores program instructions. 11 video processing methods.

FIG. 13 is a schematic structural diagram of a video processing apparatus provided by an embodiment of the present invention; the video processing apparatus may include: one or more second processors 41 and one or more second memories 42. Wherein, the second memory 42 is used to store a program for executing the video processing method provided in the embodiment shown in FIG. 9-11. The first processor 41 is configured to execute a program stored in the second memory 42. specific,

The program includes one or more computer instructions, and when one or more computer instructions are executed by the second processor 41, the following steps can be implemented:

It is used to run the computer program stored in the second memory 42 to achieve: obtain video speed adjustment information, the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and The initial speed corresponding to the initial frame of the speed adjustment and the target speed corresponding to the end frame of the speed adjustment; the speed adjustment parameters corresponding to the target video after the original video speed adjustment are determined according to the video speed adjustment information. The speed adjustment parameters include the speed adjustment start time and original duration And the target duration after speed adjustment; according to the speed adjustment parameters, the target video is obtained.

Wherein, the structure of the video processing apparatus may further include a second communication interface 43 for the electronic device to communicate with other devices or a communication network.

Further, the second processor 41 is further configured to: according to the video speed adjustment information, determine the original frame position, the speed adjusted frame position, and the playback speed corresponding to some video frames in the original video, and some video frames include the speed adjustment initial frame And the speed adjustment intermediate frame located between the speed adjustment initial frame and the speed adjustment end frame; the original frame position, the speed adjustment frame position and the playback speed corresponding to each video frame in the partial video frame are associated and stored to obtain the association Relationship set: According to the association relationship set, determine the speed adjustment parameter corresponding to the target video after the original video speed adjustment.

The device shown in FIG. 13 can execute the method of the embodiment shown in FIG. 9-11. For parts that are not described in detail in this embodiment, please refer to the related description of the embodiment shown in FIG. 9-11. For the implementation process and technical effects of this technical solution, please refer to the description in the embodiment shown in FIG. 9 to FIG. 11, which will not be repeated here.

In addition, an embodiment of the present invention provides a computer-readable storage medium, the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, and the program instructions are used to implement the video shown in FIGS. 9-11.的处理方法。 Treatment methods.

The technical solutions and technical features in each of the above embodiments can be singly or combined in case of conflict with the present invention. As long as they do not exceed the cognitive scope of those skilled in the art, they all belong to the equivalent embodiments within the protection scope of this application. .

In the several embodiments provided by the present invention, it should be understood that the disclosed video processing device and method can be implemented in other ways. For example, the embodiments of the remote control device described above are merely illustrative. For example, the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components. Can be combined or integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, remote control devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present invention essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer processor (processor) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage media include: U disk, mobile hard disk, Read-Only Memory (ROM), Random Access Memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes.

The above are only the embodiments of the present invention, and do not limit the scope of the present invention. Any equivalent structure or equivalent process transformation made by using the content of the description and drawings of the present invention, or directly or indirectly applied to other related technologies In the same way, all fields are included in the scope of patent protection of the present invention.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: It is still possible to modify the technical solutions described in the foregoing embodiments, or equivalently replace some or all of the technical features; these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present invention range.

Claims

A video processing method, characterized by comprising:

Acquire video speed adjustment information, the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and the initial speed corresponding to the speed adjustment initial frame, the The target speed corresponding to the end frame of speed adjustment;

Determining, according to the video speed adjustment information, a frame position corresponding to each frame in the target video in the original video, wherein the target video is a video obtained by adjusting the speed of the original video;

Obtain the target video according to the corresponding frame position of each frame in the target video in the original video.
The method according to claim 1, wherein the determining the corresponding frame position of each frame in the target video in the original video according to the video speed adjustment information comprises:

According to the video speed adjustment information, determine the original frame position, the speed-adjusted frame position and the playback speed corresponding to some video frames in the original video. The part of the video frame includes the speed-adjusted initial frame and is located in the speed-adjusted frame. An intermediate frame for speed adjustment between the initial frame and the end frame for speed adjustment;

Determine the frame position corresponding to each frame in the target video in the original video according to the original frame position, the adjusted frame position and the playback speed corresponding to the partial video frames.
The method according to claim 2, wherein the determining that each frame of the target video is in the original video according to the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the partial video frames Corresponding frame positions in, including:

Storing the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to each video frame in the partial video frames in association to obtain an association relationship set;

According to the set of association relations, the frame position corresponding to each frame in the target video in the original video is determined.
The method according to claim 2 or 3, wherein the determining the original frame position, the adjusted frame position and the playback speed corresponding to some video frames in the original video according to the video speed adjustment information, include:

Get the original frame position corresponding to the initial frame of speed adjustment, the position of the frame after speed adjustment, and the playback speed;

Determine the original frame position, the adjusted frame position, and the playing speed corresponding to the adjusted intermediate frame at least partly according to the original frame position corresponding to the adjusted initial frame, the adjusted frame position, and the playing speed.
The method according to claim 4, wherein the obtaining the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the initial frame of the speed adjustment includes:

Determine the original frame position corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video;

Determine the speed-adjusted frame position corresponding to the speed-adjusted initial frame according to the frame position of the speed-adjusted initial frame in the original video and the initial speed corresponding to the speed-adjusted initial frame;

Determine the playback speed corresponding to the speed-adjusted initial frame according to the initial speed corresponding to the speed-adjusted initial frame.
The method according to claim 4, wherein the obtaining the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the initial frame of speed adjustment includes:

Determine the original frame position corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video;

Determine the speed-adjusted frame position corresponding to the speed-adjusted initial frame according to the frame position of the speed-adjusted initial frame in the original video and the playback speed of the first frame in the original video;

Determine the playback speed corresponding to the speed-adjusted initial frame according to the initial speed corresponding to the speed-adjusted initial frame.
The method according to claim 4, wherein the original frame corresponding to the speed-adjusting intermediate frame is determined at least partly based on the original frame position corresponding to the speed-adjusting initial frame, the frame position after the speed-adjusting, and the playback speed. Position, frame position after speed adjustment and playback speed, including:

Determine the frame position of the frame to be processed in the original video at least partly according to the original frame position and the playback speed corresponding to the speed-regulated initial frame;

Determine the frame to be processed according to the frame position of the frame to be processed in the original video, the frame position of the initial frame of speed adjustment in the original video, the frame position of the end frame of speed adjustment in the original video, and the initial speed and the target speed. The interpolation speed;

When the interpolation speed of the frame to be processed satisfies a preset condition, use the frame to be processed as an intermediate frame for speed adjustment, and obtain the original frame position, the frame position after speed adjustment, and the playback speed corresponding to the frame to be processed; Otherwise, the frame to be processed is discarded.
The method according to claim 7, wherein the preset condition comprises:

The difference between the interpolation speed of the frame to be processed and the playback speed corresponding to the previous frame of the frame to be processed is greater than or equal to a preset threshold.
The method according to claim 8, wherein the playback speed of the frame to be processed is determined according to the interpolation speed of the frame to be processed and the preset threshold.
The method according to claim 7 or 8, wherein when the initial speed is greater than the target speed, the preset threshold is a first preset threshold, and when the initial speed is less than the target speed , The preset threshold value is a second preset threshold value different from the first preset threshold value.
The method according to claim 4, wherein when the speed adjustment initial frame is not the first frame of the original video, the partial video frame further includes the first frame;

The determining the original frame position, the speed-adjusted frame position, and the playback speed corresponding to some video frames in the original video further includes:

Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the first frame.
The method according to claim 4, wherein when the speed adjustment end frame is the last frame of the original video, the partial video frame further comprises the speed adjustment end frame;

The determining the original frame position, the frame position after speed adjustment, and the playback speed corresponding to some video frames in the original video further includes:

Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the speed adjustment end frame.
The method according to claim 12, wherein when the speed adjustment end frame is not the last frame of the original video, the partial video frame further includes the speed adjustment end frame in the original video The next frame and the last frame;

The determining the original frame position, the frame position after speed adjustment, and the playback speed corresponding to some video frames in the original video further includes:

Determining the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to a frame after the speed adjustment end frame;

Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the last frame.
The method according to claim 13, wherein the frame position in the original video of the frame after the speed adjustment end frame is based on the original frame corresponding to the last frame of the speed adjustment intermediate frame. Frame position and playback speed are determined.
The method according to claim 2 or 3, characterized in that, according to the original frame position corresponding to the part of the video frame, the frame position after speed adjustment, and the playback speed, it is determined that each frame in the target video is The corresponding frame position in the original video, including:

Acquiring a frame interval corresponding to each frame in the target video, where the interval start frame and the interval end frame of the frame interval are two adjacent frames in the partial video frames;

According to the frame position of each frame in the target video in the target video, the original frame position corresponding to the start frame of the interval, the frame position after speed adjustment, and the playback speed, it is determined that each frame in the target video is The corresponding frame position in the original video.
A video processing method, characterized by comprising:

Acquire video speed adjustment information, the video speed adjustment information includes: the frame position of the speed adjustment initial frame in the original video, the frame position of the speed adjustment end frame in the original video, and the initial speed corresponding to the speed adjustment initial frame, the The target speed corresponding to the end frame of speed adjustment;

Determining, according to the video speed adjustment information, a speed adjustment parameter corresponding to the target video after the speed adjustment of the original video, the speed adjustment parameter including a speed adjustment start time, an original time length, and a target time length after speed adjustment;

Obtain the target video according to the speed adjustment parameter.
The method according to claim 16, wherein the determining the speed adjustment parameter corresponding to the target video after the speed adjustment of the original video according to the video speed adjustment information comprises:

According to the video speed adjustment information, determine the original frame position, the speed-adjusted frame position, and the playback speed corresponding to some video frames in the original video. The part of the video frame includes the speed-adjusted initial frame and the initial frame and the speed-adjusted initial frame. The speed control intermediate frame between the speed control end frames;

Associatively storing the original frame position, the speed-adjusted frame position, and the playback speed corresponding to each video frame in the partial video frames to obtain an association relationship set;

According to the set of association relations, a speed adjustment parameter corresponding to the target video after the speed adjustment of the original video is determined.
A video processing device, characterized in that it comprises:

Memory, used to store computer programs;

The processor is configured to run a computer program stored in the memory to achieve: acquiring video speed adjustment information, the video speed adjustment information including: the frame position of the speed adjustment initial frame in the original video, and the speed adjustment end frame of the original video Frame position, and the initial speed corresponding to the initial frame of speed adjustment, and the target speed corresponding to the end frame of speed adjustment; determine the corresponding frame of each frame in the target video in the original video according to the video speed adjustment information Position, wherein the target video is a video obtained by adjusting the speed of the original video; the target video is acquired according to the frame position of each frame in the target video corresponding to the original video.
The device according to claim 18, wherein the processor is further configured to:

According to the video speed adjustment information, determine the original frame position, the speed-adjusted frame position and the playback speed corresponding to some video frames in the original video. The part of the video frame includes the speed-adjusted initial frame and is located in the speed-adjusted frame. An intermediate frame for speed adjustment between the initial frame and the end frame for speed adjustment;

Determine the frame position corresponding to each frame in the target video in the original video according to the original frame position, the adjusted frame position and the playback speed corresponding to the partial video frames.
The device according to claim 19, wherein the processor is further configured to:

Storing the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to each video frame in the partial video frames in association to obtain an association relationship set;

According to the set of association relations, the frame position corresponding to each frame in the target video in the original video is determined.
The device according to claim 19 or 20, wherein the processor is further configured to:

Get the original frame position corresponding to the initial frame of speed adjustment, the position of the frame after speed adjustment, and the playback speed;

Determine the original frame position, the adjusted frame position, and the playing speed corresponding to the adjusted intermediate frame at least partly according to the original frame position corresponding to the adjusted initial frame, the adjusted frame position, and the playing speed.
The device according to claim 21, wherein the processor is further configured to:

Determine the original frame position corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video;

Determine the speed-adjusted frame position corresponding to the speed-adjusted initial frame according to the frame position of the speed-adjusted initial frame in the original video and the initial speed corresponding to the speed-adjusted initial frame;

Determine the playback speed corresponding to the speed-adjusted initial frame according to the initial speed corresponding to the speed-adjusted initial frame.
The device according to claim 21, wherein the processor is further configured to:

Determine the original frame position corresponding to the speed adjustment initial frame according to the frame position of the speed adjustment initial frame in the original video;

Determine the speed-adjusted frame position corresponding to the speed-adjusted initial frame according to the frame position of the speed-adjusted initial frame in the original video and the playback speed of the first frame in the original video;

Determine the playback speed corresponding to the speed-adjusted initial frame according to the initial speed corresponding to the speed-adjusted initial frame.
The device according to claim 21, wherein the processor is further configured to:

Determine the frame position of the frame to be processed in the original video at least partly according to the original frame position and the playback speed corresponding to the speed-regulated initial frame;

Determine the frame to be processed according to the frame position of the frame to be processed in the original video, the frame position of the initial frame of speed adjustment in the original video, the frame position of the end frame of speed adjustment in the original video, as well as the initial speed and the target speed The interpolation speed;

When the interpolation speed of the frame to be processed satisfies a preset condition, use the frame to be processed as an intermediate frame for speed adjustment, and obtain the original frame position, the frame position after speed adjustment, and the playback speed corresponding to the frame to be processed; Otherwise, the frame to be processed is discarded.
The device according to claim 24, wherein the preset condition comprises:

The difference between the interpolation speed of the frame to be processed and the playback speed corresponding to the previous frame of the frame to be processed is greater than or equal to a preset threshold.
The device according to claim 25, wherein the playback speed of the frame to be processed is determined according to the interpolation speed of the frame to be processed and the preset threshold.
The device according to claim 25 or 26, wherein when the initial speed is greater than the target speed, the preset threshold is a first preset threshold, and when the initial speed is less than the target speed , The preset threshold value is a second preset threshold value different from the first preset threshold value.
The device according to claim 21, wherein when the speed-adjusted initial frame is not the first frame of the original video, the partial video frame further includes the first frame;

The processor is further configured to determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the first frame.
The device according to claim 21, wherein when the speed adjustment end frame is the last frame of the original video, the partial video frame further comprises the speed adjustment end frame;

The processor is further configured to determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the speed adjustment end frame.
The apparatus according to claim 29, wherein when the speed adjustment end frame is not the last frame of the original video, the partial video frame further includes the original video at the speed adjustment end frame The next frame and the last frame; the processor is further configured to:

Determining the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to a frame after the speed adjustment end frame;

Determine the original frame position, the frame position after the speed adjustment, and the playback speed corresponding to the last frame.
The device according to claim 30, wherein the frame position in the original video of the frame after the speed adjustment end frame is based on the original video corresponding to the last frame of the speed adjustment intermediate frame. Frame position and playback speed are determined.
The device according to claim 19 or 20, wherein the processor is further used for:

Acquiring a frame interval corresponding to each frame in the target video, where the interval start frame and the interval end frame of the frame interval are two adjacent frames in the partial video frames;

According to the frame position of each frame in the target video in the target video, the original frame position corresponding to the start frame of the interval, the frame position after speed adjustment, and the playback speed, it is determined that each frame in the target video is The corresponding frame position in the original video.
A video processing device, characterized in that it comprises:

Memory, used to store computer programs;

The processor is configured to run a computer program stored in the memory to achieve: acquiring video speed adjustment information, the video speed adjustment information including: the frame position of the speed adjustment initial frame in the original video, and the speed adjustment end frame of the original video Frame position, and the initial speed corresponding to the initial frame of speed adjustment, and the target speed corresponding to the end frame of speed adjustment; determine the speed adjustment parameter corresponding to the target video after the original video speed adjustment according to the video speed adjustment information, The speed adjustment parameter includes a speed adjustment start time, an original time length, and a target time length after speed adjustment; and the target video is acquired according to the speed adjustment parameter.
The device according to claim 33, wherein the processor is further configured to:

According to the video speed adjustment information, determine the original frame position, the speed-adjusted frame position, and the playback speed corresponding to some video frames in the original video. The part of the video frame includes the speed-adjusted initial frame and the initial frame and the speed-adjusted initial frame. The speed control intermediate frame between the speed control end frames;

Associatively storing the original frame position, the speed-adjusted frame position, and the playback speed corresponding to each video frame in the partial video frames to obtain an association relationship set;

According to the set of association relations, a speed adjustment parameter corresponding to the target video after the speed adjustment of the original video is determined.
A computer-readable storage medium, wherein the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, and the program instructions are used to implement any one of claims 1-15 The video processing method described in item.
A computer-readable storage medium, wherein the storage medium is a computer-readable storage medium, the computer-readable storage medium stores program instructions, and the program instructions are used to implement any one of claims 16-17 The video processing method described in item.