CN111050203A

CN111050203A - Video processing method and device, video processing equipment and storage medium

Info

Publication number: CN111050203A
Application number: CN201911243534.6A
Authority: CN
Inventors: 马学跃
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-12-06
Filing date: 2019-12-06
Publication date: 2020-04-21
Anticipated expiration: 2039-12-06
Also published as: CN111050203B

Abstract

The application discloses a video processing method and device, video processing equipment and a storage medium, and belongs to the technical field of video processing. The method comprises the following steps: receiving a trigger operation of adding an identifier to a video special effect of a video to be processed; according to the triggering of the triggering operation, special effect indication information is displayed in a target progress interval of a progress indication area of the video to be processed, wherein the special effect indication information is used for indicating that video special effects are added to a video clip corresponding to the target progress interval. Therefore, the target progress interval needing to be added with the video special effect is automatically positioned through the equipment, the operation of manual positioning of a user is omitted, a quick and convenient video special effect making mode is provided for the user, the user operation is simplified, and the video editing efficiency is improved.

Description

Video processing method and device, video processing equipment and storage medium

Technical Field

The present application relates to the field of video processing technologies, and in particular, to a video processing method and apparatus, a video processing device, and a storage medium.

Background

With the development of the mobile internet, people also tend to watch online videos or download videos on terminal devices such as computers, mobile phones or tablet computers. For videos in a network, for example, for videos in a short video application, a user (i.e., a video provider) typically uploads the videos to the network after performing a certain processing, where the processing of the videos may typically include video cropping, adding music, adding special effects of the videos, and the like.

In the process of adding the video special effect, a user needs to position a video clip to which the video special effect needs to be added, and generally, the video clip to which the video special effect needs to be added is selected by dragging a progress bar. However, since the area of the progress bar is small, the operation of dragging the progress bar by the user is inconvenient, and the progress bar may need to be dragged repeatedly to achieve accurate positioning, which is troublesome to operate, and especially, is more difficult for novice users.

Therefore, how to simplify the complexity of the operation of adding video special effects is a problem to be considered.

Disclosure of Invention

The embodiment of the application provides a video processing method and device, video processing equipment and a storage medium, which are used for providing a quick and convenient video special effect making mode and improving video editing efficiency.

In one aspect, a video processing method is provided, and the method includes:

receiving a trigger operation of adding an identifier to a video special effect of a video to be processed;

displaying special effect indication information in a target progress interval of a progress indication area of the video to be processed according to the triggering of the triggering operation; the special effect indication information is used for indicating that a video special effect is added to the video clip corresponding to the target progress interval.

In one aspect, a video processing apparatus is provided, the apparatus comprising:

the receiving module is used for receiving the trigger operation of adding the identification to the video special effect of the video to be processed;

the display module is used for displaying special effect indication information in a target progress interval of a progress indication area of the video to be processed according to the trigger of the trigger operation; the special effect indication information is used for indicating that a video special effect is added to the video clip corresponding to the target progress interval.

In one possible implementation, the display module is configured to:

displaying a video special effect adding interface according to the triggering of the triggering operation, wherein the video special effect adding interface comprises the progress indication area and a video special effect display area;

the receiving module is further configured to:

receiving a first selection operation aiming at a target video special effect in the video special effect showing area; and responding to the first selection operation;

the apparatus also includes an add special effects module to:

and adding the target video special effect to the video clip corresponding to the target progress interval.

In a possible implementation manner, the target progress interval is displayed in the progress indication area, and the receiving module is further configured to:

receiving a second selection operation aiming at the target progress interval, and determining the target progress interval needing to add the video special effect according to the second selection operation;

the add special effect module is used for:

and responding to the first selection operation, and adding the target video special effect to the video clip corresponding to the target progress interval selected according to the second selection operation.

In one possible implementation manner, the apparatus further includes a determining module and an adding special effect module, wherein:

the determining module is used for determining a target video special effect according to the trigger of the trigger operation and a preset matching strategy;

and the special effect adding module is used for adding the target video special effect to the video clip corresponding to the target progress interval.

In a possible implementation manner, the target progress interval is determined according to audio rhythm information of the video to be processed, where the audio rhythm information is used to represent an audio amplitude of a background audio of the video to be processed.

In one possible implementation manner, the receiving module is further configured to:

receiving an adding operation of adding an audio identifier for an original video;

the apparatus further comprises a synthesis module to:

and responding to the adding operation, and synthesizing the original video and the audio file corresponding to the background audio to obtain the video to be processed comprising the background audio.

In one possible implementation, the add special effects module is configured to:

when the target video special effect to be added is one and the target progress intervals are multiple, adding the target video special effect to the video clips corresponding to the target progress intervals meeting the preset conditions in the multiple target progress intervals; alternatively, the first and second electrodes may be,

when the number of the target video special effects to be added is multiple and the number of the target progress intervals is multiple, sequentially adding the target video special effects to the video clips respectively corresponding to the multiple target progress intervals according to a preset adding sequence; alternatively, the first and second electrodes may be,

when the number of target videos to be added is especially multiple and the target progress interval is one, adding part or all of the target video special effects to the video clip corresponding to the target progress.

according to the selection sequence of a plurality of target video special effects selected by a user, sequentially adding corresponding target video special effects to video clips corresponding to a plurality of target progress intervals respectively; alternatively, the first and second electrodes may be,

and sequentially adding corresponding target video special effects to the video clips respectively corresponding to the target progress intervals according to the sequence of the video special effect utilization rate from high to low.

In one possible implementation, the display module is configured to:

the target progress interval and a non-target progress interval are displayed in a distinguishing mode, wherein the non-target progress interval is an area except the target progress interval in the progress indication area; alternatively, the first and second electrodes may be,

and displaying each group of target progress intervals grouped according to a preset grouping strategy in a distinguishing manner.

after the display module displays special effect indication information in a target progress interval of a progress indication area of the video to be processed, receiving deletion operation aiming at first special effect indication information in the special effect indication information;

the apparatus further comprises a deletion module to:

and responding to the deleting operation, deleting the first special effect indication information, and canceling the video special effect added to the first video clip corresponding to the first special effect indication information.

after the display module displays special effect indication information in a target progress interval of a progress indication area of the video to be processed, receiving adjustment operation aiming at second special effect indication information in the special effect indication information;

the apparatus further comprises an adjustment module configured to:

responding to the adjustment operation, and adjusting the range of the target progress interval indicated by the second special-effect indication information; and controlling the video clips corresponding to the target progress interval after the range is adjusted to add the same video special effect.

after the display module displays special effect indication information in a target progress interval of a progress indication area of the video to be processed, receiving special effect exchange operation;

the apparatus also includes a switch special effects module to:

and responding to the special effect exchanging operation, exchanging third special effect indication information and fourth special effect indication information in the special effect indication information, and exchanging two video special effects added to two video clips corresponding to the third special effect indication information and the fourth special effect indication information.

In one aspect, a video processing device is provided, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the video processing method includes the steps described in the above possible implementation manners.

In one aspect, a storage medium is provided, which stores computer-executable instructions for causing a computer to perform the steps included in the video processing method described in the above-mentioned various possible implementations.

In one aspect, a computer program product containing instructions is provided, which when run on a computer causes the computer to perform the steps included in the video processing method described in the various possible implementations described above.

In the embodiment of the application, when a video special effect needs to be added to a certain video, the device can automatically determine the target progress interval in which the video special effect needs to be added, and a user does not need to drag the progress bar to manually position the target progress interval in which the video special effect needs to be added as in the related art, so that the positioning efficiency of the target progress interval is improved, the manual operation of the user in the video editing process is simplified, a video editing mode capable of being quickly started is provided for the user, and the video editing efficiency is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

FIG. 1 is a schematic diagram of a video add special effects interface;

FIG. 2 is a diagram illustrating adding video effects in the related art;

FIG. 3 is a schematic diagram of an application scenario in which the present application is applied;

FIG. 4 is a schematic diagram of an application scenario in which the present application is applied;

FIG. 5 is a flow chart of a video processing method in an embodiment of the present application;

fig. 6 is a schematic diagram of a trigger operation performed on a video special effect addition identifier in an embodiment of the present application;

FIG. 7 is a schematic diagram of a progress indication area and a progress interval in an embodiment of the present application;

fig. 8a is a schematic diagram illustrating display of special effect indication information according to a user's trigger operation in an embodiment of the present application;

fig. 8b is another schematic diagram illustrating displaying special effect indication information according to a user's trigger operation in the embodiment of the present application;

fig. 8c is another schematic diagram illustrating displaying special effect indication information according to a user's trigger operation in the embodiment of the present application;

fig. 9 is another flowchart of a video processing method in the embodiment of the present application;

fig. 10 is a schematic diagram illustrating a determination of a target progress interval according to audio rhythm information in an embodiment of the present application;

fig. 11 is a schematic diagram illustrating a video special effect adding interface displayed according to a trigger operation in an embodiment of the present application;

FIG. 12a is a diagram illustrating a user manually selecting a target video effect according to an embodiment of the present application;

FIG. 12b is a diagram illustrating a user manually selecting a target video effect according to an embodiment of the present application;

FIG. 13 is a diagram illustrating a user manually matching a target progress interval with a video special effect in an embodiment of the present application;

fig. 14 is a schematic diagram of deleting special effect indication information in an embodiment of the present application;

fig. 15 is a schematic diagram of a progress interval corresponding to adjustment special effect indication information in an embodiment of the present application;

fig. 16 is a schematic diagram illustrating a video special effect corresponding to two progress intervals in an embodiment of the present application;

FIG. 17a is a block diagram of a video processing apparatus according to an embodiment of the present application;

FIG. 17b is a block diagram of another structure of a video processing apparatus in the embodiment of the present application;

fig. 18 is a schematic structural diagram of a video processing apparatus in an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions in the embodiments of the present application will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by one of ordinary skill in the art from the embodiments given herein without making any creative effort, shall fall within the scope of the claimed protection. In the present application, the embodiments and features of the embodiments may be arbitrarily combined with each other without conflict. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.

The terms "first" and "second" in the description and claims of the present application and the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the term "comprises" and any variations thereof, which are intended to cover non-exclusive protection. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus. The "plurality" in the present application may mean at least two, for example, two, three or more, and the embodiments of the present application are not limited.

In addition, the term "and/or" herein is only one kind of association relationship describing an associated object, and means that there may be three kinds of relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in this document generally indicates that the preceding and following related objects are in an "or" relationship unless otherwise specified.

Some technical terms referred to herein are explained below to facilitate understanding by those skilled in the art.

1. The progress indication area is used for indicating the progress of the video, generally speaking, the progress indication area can indicate the progress of the video in a progress bar mode, the progress indication area is an area where the progress bar is located, and a user can adjust the progress of the video in a mode of dragging the progress bar or selecting a position on the progress bar; or the video progress can be directly indicated in a progress value manner, then the region displaying the progress value is a progress indication region, and the user can adjust the video progress in a manner of adjusting the progress value or directly inputting the progress value. Of course, the video progress may also be indicated in other possible manners, which is not limited in this application.

2. The progress interval refers to an interval formed between one video progress and another video progress, and when the interval corresponds to the progress bar, one progress interval corresponds to a part of the progress bar between one position and another position on the progress bar. For example, if one video schedule is the 8 th second and the other video schedule is the 25 th second, the interval between the 8 th second and the 25 th second forms a schedule interval, which may correspond to the portion of the schedule bar between the 8 th second corresponding position and the 258 th second corresponding position on the schedule bar.

3. An audio rhythm point, also called a rhythm point or a drum point, refers to a time or a duration corresponding to an audio amplitude greater than a certain value in an audio file.

4. Short videos, i.e. short-film videos, are a way of internet content transmission, and are typically video transmission contents transmitted on new internet media for a short period of time (e.g. 15 seconds or 30 seconds, etc.), which are suitable for being viewed in a mobile state and a short leisure state and are pushed at high frequency. The content of the short video covers the topics of skill sharing, budding doll recording, makeup and beauty, humorous work, exercise slimming, fashion trend, budding pet recording, social hotspot, food recommendation and the like.

The technical solution of the present application is described below.

As described above, in the process of adding a video special effect by a user, when a video clip to which the video special effect is to be added is positioned, the user needs to drag the progress bar repeatedly to position the video clip more accurately, and because the display area of the progress indication area is small, the positioning accuracy and the accuracy of the progress interval to which the video special effect is to be added by dragging the progress bar are low, and especially for novice users, the operation is more difficult.

Referring to the video special effect adding interface shown in fig. 1, the video special effect adding interface includes a progress indication area and a video special effect display area, when a user needs to add a video special effect to a video, as shown in fig. 2, the user selects a progress interval to which the video special effect needs to be added by dragging a progress bar corresponding to the progress indication area backwards and forwards in a two-way manner, since the area occupied by the progress indication area is small, the user may need to drag the progress bar repeatedly for more accurate positioning of the progress interval, the operation is troublesome, and even if the user drags the precision bar repeatedly for multiple times for repeated positioning, the accuracy of the progress interval manually positioned by the user is low, and the operation requirement for adding the video special effect may not be well satisfied, especially for a novice user who uses the function less (for example, called a "whitish" user), the fast positioning is more troublesome to realize, a user needs to spend a long time to complete the addition of one video special effect, the operations are required to be repeated when the video special effect is added once, and multiple times or multiple video special effects are required to be added in one video to meet different video effects, so that the user operation is more troublesome, the operation efficiency of adding the video special effects is lower, and the user experience is poorer.

Another way of adding video special effects in the related art is to drag the progress bar to position a starting point of adding the video special effects, the progress bar may also need to be dragged repeatedly in order to realize accurate positioning, after the starting point is positioned, the video special effects added according to needs can be lengthened, the video special effects of how long progress are expected to be added from the starting point, the video special effects are lengthened according to how long time, the video special effects are loosened until the video special effects are required to be added, so that the video special effects are added once, and if the video special effects are required to be added for many times, the adding process needs to be repeated for many times. In the method, a user is also required to manually position a starting point of a progress interval in which the video special effect needs to be added, and the video special effect can be added only by pressing the video special effect for a long time, so that the method is inconvenient and intelligent, and the efficiency of adding the video special effect is low.

By analyzing the process of adding the video special effect in the related technology, the inventor of the application finds that the main reason that the video special effect adding efficiency is low is that a user needs to spend more time to manually position a progress interval to which the video special effect needs to be added, and repeated positioning due to misoperation in the positioning process is another important reason that the adding efficiency is low. In addition, no matter what manual positioning mode is adopted, the operation of the user is troublesome, the operation is inconvenient, the intelligence is low, especially for a new user, due to the lack of experience of the positioning operation, the video editing function of adding the video special effect by the user can be seriously influenced, the use experience of the user is poor, and the product popularization is not facilitated.

In view of the above analysis, the inventors of the present application considered that in order to improve the efficiency of adding a video special effect, it is necessary to optimize in terms of locating a progress section (for example, referred to as a target progress section) in which the video special effect needs to be added. Based on this, in the method, when a video special effect needs to be added to a certain video, a target progress interval to which the video special effect needs to be added can be automatically positioned by equipment, and by means of intelligent automatic positioning of the equipment, the manual positioning operation of a user can be omitted by means of automatic positioning of the target progress interval by the equipment, so that the time spent by the user for manually positioning the target progress interval is greatly reduced, the positioning efficiency is improved, and the adding efficiency for adding the video special effect is further improved as a whole. Moreover, by reducing the manual positioning operation of the user, an operation mode of conveniently and quickly adding a video special effect can be provided for the small white user, so that the user can quickly make the video special effect, the operation experience of the user is improved, the use viscosity of the user can be further enhanced, more small white users can be attracted to use the method to edit videos, the product popularization is facilitated, and the use rate of products is improved.

In a specific implementation manner of the embodiment of the present application, the device may automatically position a target progress interval to which a video special effect needs to be added according to audio rhythm information of background music of a video, for example, automatically position each audio rhythm point (also referred to as a drum point) of the background music as the target progress interval, that is, realize corresponding positioning of the target progress interval in an audio stepping mode, so that a video special effect may be added to each video clip corresponding to the audio drum point. In practical use, the video special effect is generally added at a plot transition or a position with a special sound effect in a video, so as to achieve the purpose of improving the video effect, therefore, in the embodiment of the present application, the video special effect can be added at a rhythm point with a large audio amplitude, for example, by combining with the audio rhythm information of the background music of the video, so that the audio-visual comprehensive effect of the resonance of the video picture and the background music can be realized, the video special effect can be automatically added according to the change of the music rhythm, so that the edited video can provide visual and auditory enhancement feelings for a viewer, so that the video atmosphere can be well rendered, the video editing effect can be improved, and the video quality can be improved.

It should be noted that, in addition to the above-mentioned audio rhythm information based on the background audio, the manner of automatically positioning the target progress interval in the embodiment of the present application may also adopt other manners, for example, a video special effect may be added at a position of a scene transition, for example, a video special effect may be added at a predetermined playing progress of the video (for example, a special effect is added every 5 seconds), and the like, which is not limited by the embodiment of the present application.

In order to better understand the technical solution provided by the embodiment of the present application, some brief descriptions are provided below for application scenarios to which the technical solution provided by the embodiment of the present application is applicable, and it should be noted that the application scenarios described below are only used for illustrating the embodiment of the present application and are not limited. In specific implementation, the technical scheme provided by the embodiment of the application can be flexibly applied according to actual needs.

The video processing method provided by the embodiment of the application can be applied to application scenes in which videos need to be edited, and particularly can be applied to application scenes in which video special effects need to be added to the videos. For example, after a user shoots a video, editing operations such as adding a video special effect to the shot video through a video editing function provided by the terminal device are performed, and the obtained edited video can be stored in the local terminal device, or can be uploaded to a cloud server for storage, or can be published to a social platform or a video promotion platform, and the like.

Referring to fig. 3, fig. 3 is an application scenario to which the embodiment of the present application is applied, where the application scenario includes a terminal device 310 and a server 320, an application providing a video editing function is installed in the terminal device 310, and the application is, for example, a video application, a short video application, or video editing software, specifically, the video editing function provided by the terminal device 310 supports adding a video special effect, the server 320 is a background server providing service support for the application installed in the terminal device 310, and a communication connection is established between the terminal device 310 and the server 320 through a wired network or a wireless network. The user 1 may add a video special effect to the video by using the terminal device 310 by using the video processing method provided in the embodiment of the present application, so as to obtain the video to which the video special effect is added, and further, the video to which the video special effect is added may be stored locally in the terminal device 310, or may be uploaded to the server 320, and may be stored in the cloud of the server 320 or published to the social platform or the video promotion platform. In addition, the terminal device 310 may also request the video from the server 320 for playing.

Referring to fig. 4 again, the application scenario shown in fig. 4 is a short video sharing scenario, and the application scenario includes a terminal device 401, a terminal device 411, a terminal device 412, a terminal device 413, and a server 421. The same short video application is installed in the terminal device 401, the terminal device 411, the terminal device 412 and the terminal device 413, each terminal device in fig. 4 establishes a communication connection with the server 421 through a wired network or a wireless network, and the server 421 is configured to provide background service and support for the short video application. The user 2 adds a video special effect to the short video through the terminal device 401 by using the video processing method provided by the embodiment of the present application, and may also perform other editing operations such as music addition, cutting, filter addition, and the like, and upload the short video obtained after editing to the server 421, and the server 421 may distribute the short video uploaded by the terminal device 401 to the video sharing platform, so that the terminal device 411, the terminal device 412, and the terminal device 413 may all obtain the short video published by the terminal device 401 to view, thereby implementing social sharing of the short video.

In the above example, the terminal device 401 serves as a short video publisher, and the

terminal devices

411, 412, and 413 serve as short video viewers, and similarly, the

terminal devices

411, 412, and 413 may also serve as short video publishers to publish short videos after editing the short videos by using the video processing method provided in the embodiment of the present application, and the terminal device 401 may also serve as a short video viewer to obtain the short videos published by the

terminal devices

411, 412, and 413 from the server 421 to play the short videos for the user 2 to watch. That is, any one of the terminal devices in fig. 4 may be a short video publisher or a short video viewer, and has both network identities.

Each server in the application scenarios in fig. 3 and fig. 4 may be an independent physical server, or may be a server cluster formed by a plurality of physical servers, and may be a cloud server providing basic cloud computing services such as a cloud service, a cloud database, a cloud storage, and a Content Delivery Network (CDN). Each of the terminal devices in fig. 3 and 4 may be, but is not limited to, a smart phone, a tablet computer, a Personal Digital Assistant (PDA), a notebook computer, a Personal computer, and the like.

To further illustrate the technical solutions provided by the embodiments of the present application, the following detailed description is made with reference to the accompanying drawings and the detailed description. Although the embodiments of the present application provide the method operation steps as shown in the following embodiments or figures, more or less operation steps may be included in the method based on the conventional or non-inventive labor. In steps where no necessary causal relationship exists logically, the order of execution of the steps is not limited to that provided by the embodiments of the present application. The method can be executed in sequence or in parallel according to the method shown in the embodiment or the figure when the method is executed in an actual processing procedure or a device.

The embodiment of the present application provides a video processing method, which may be executed by a device with a video editing function, for example, by any terminal device in fig. 3 or fig. 4. The video processing method provided by the embodiment of the application is shown in fig. 5, and the flowchart shown in fig. 5 is described as follows.

Step 501: and receiving trigger operation of adding identification for the video special effect of the video to be processed.

In the embodiment of the application, a video needing to be added with a video special effect is called a to-be-processed video, when a user wants to add the video special effect to the to-be-processed video, a specific triggering operation can be performed on a video special effect adding identifier corresponding to the to-be-processed video, wherein the video special effect adding identifier is an indicating mark used for indicating that the video special effect is added, and after the user performs the specific triggering operation on the video special effect adding identifier, the device can be triggered to add the video special effect to the to-be-processed video. For example, as shown in fig. 6, a user may perform a touch operation on an icon corresponding to a "special effect" displayed in the interface, that is, a trigger operation performed on the video special effect addition identifier, and after detecting the trigger operation, the device may perform a process of adding the video special effect.

Step 502: according to the triggering of the triggering operation, special effect indication information is displayed in a target progress interval in a progress indication area of the video to be processed, and the special effect indication information is used for indicating that video special effects are added to a video clip corresponding to the target progress interval.

Wherein, the progress indication area of the video to be processed is used to indicate the playing progress of the video to be processed, as shown in fig. 7, a thumbnail sequence of a plurality of video frames included in the video to be processed is displayed in the progress indication area, the thumbnail sequence may include thumbnails of all video frames of the video to be processed, or only thumbnails of part of video frames in the video to be processed, when only thumbnails of part of video frames in the video to be processed are included, the part of video frames can substantially completely represent the whole video content of the video to be processed, a thumbnail of each video frame in the thumbnail sequence corresponds to one video progress of the video to be processed, a time interval between thumbnails of any two video frames may be understood as one progress interval, that is, a progress interval in this embodiment may be understood as a playing time interval of the video, the interval length of the progress interval is the playing time length, for example, 2 seconds or 4 seconds, and the video segment that is played correspondingly within the playing time length can be understood as the video segment corresponding to the progress interval. In addition, in some cases, the progress interval may also be a play time, and the interval length of the progress interval at this time may be understood as 0.

In the embodiment of the application, after the device detects the triggering operation of triggering the addition of the video special effect performed by the user, the progress interval (namely the target progress interval) in which the video special effect needs to be added can be automatically determined, the video special effect is added to the determined target progress interval, and then the result of adding the video special effect is presented to the user. Referring to fig. 8a, 8b, and 8c, taking fig. 8a as an example, after the user performs the trigger operation of adding the special effect identifier to the video as shown in the left diagram of fig. 8a, the device may be triggered to jump to the interface as shown in the right diagram of fig. 8a, a plurality of pieces of special effect indication information, that is, special effect indication information 1, special effect indication information 2, and special effect indication information 3, are displayed in the progress indication area of the interface, and these three pieces of special effect indication information respectively indicate that the video special effect is added to the video clip corresponding to the target progress interval in the progress indication area. The special effect indication information may be a rectangular area as shown in fig. 8a, and an area covered by the rectangular area in the progress indication area, that is, an area that can be understood as a target progress section corresponding to the special effect indication information. Therefore, through the indication of the special effect information indication information, the user can clearly know which video clips of the video to be processed are added with the video special effects, and meanwhile, the user can clearly know whether the video special effects are added successfully or not, so that a better prompt effect is achieved. Or, the special effect indication information may also be displayed in other manners, and the embodiment of the present application is not limited.

When there are multiple special effect indication information, the display effect of each special effect indication information may be the same, as shown in fig. 8 a; alternatively, the special effect indication information may be displayed in a differentiated manner, for example, a plurality of pieces of special effect indication information to which the same video special effect is added may be displayed with the same display effect, for example, the display effect of the special effect indication information 2 and the special effect indication information 3 shown in the right diagram of fig. 8b is the same, and the special effect indication information 1 is another display effect, i.e. indicating that the video effects added at the video slice corresponding to the effect indication information 2 and the effect indication information 3 are the same, the video effect added at the video slice corresponding to the effect indication information 1 is another, namely, the special effect indication information corresponding to the same video special effect can adopt the same display effect, and the special effect indication information corresponding to different video special effects can be displayed in a distinguishing way, namely, different display effects are adopted, so that a better prompt effect can be achieved for a user. As another example, as shown in fig. 8c, the display effect of the three special effect indication information is different, which may indicate that the three video special effects are added at different positions.

Fig. 8a, 8b, and 8c further include an "automatic matching effect" identifier and a corresponding switch identifier, where the "automatic matching effect" corresponds to an "automatic matching effect function," which is a function of supporting the device to automatically locate a target progress interval to which a video needs to be added, and a user may select whether to turn on the function according to an actual requirement of the user, for example, for a small white user, it is relatively troublesome to make a video special effect by using a method in the related art, and then may select to turn on the "automatic matching effect function," so that the device may be used to automatically locate the target progress interval and automatically add the video special effect, thereby quickly completing the making of the video special effect; for example, for a high-level user who frequently performs video editing, the automatic matching effect function can be selected to be turned off, so that the video editing can be performed manually, and the high editing requirement of the high-level user can be met as much as possible. Through the setting of the switch identification of the 'automatic matching effect', a special effect making mode corresponding to adaptation can be provided for different users, so that the differentiated use requirements of different users are met, and the use experience of the users is improved.

Of course, the displayed "automatic matching effect" identifier and the corresponding switch identifier may not be displayed in the interface, for example, the setting may be set in the background or displayed on other interfaces, and the user may pre-select to turn on or turn off the function according to the actual editing requirement of the user, which is not limited in the embodiment of the present application.

The embodiment of the application provides a method for automatically positioning a video clip to which a video special effect needs to be added by equipment when the video special effect is edited, namely, a target progress interval is automatically positioned, the video special effect can be automatically added, manual positioning operation of a user in a mode of repeatedly dragging a progress bar is omitted as required in the related art, time spent by the user in manually positioning the target progress interval is greatly reduced, positioning efficiency is improved, and adding efficiency of adding the video special effect is further improved on the whole. Therefore, through reducing the manual positioning operation of the user, the operation mode of conveniently and quickly adding the video special effect can be provided for the small and white user, so that the user can quickly make the video special effect, and the operation experience of the user is improved. In addition, according to the embodiment of the application, through the function selection of the open 'automatic matching effect', the differentiated actual editing requirements of different users can be met, and the user experience is further improved.

The above describes that the target progress interval of the video clip needs to be added is automatically located by the device, and for the automatic locating manner, for example, the locating can be automatically matched according to the audio rhythm information of the background music, or the locating can be automatically matched according to the video content included in the video itself, and so on. Because a user generally adds a music special effect when editing a video at present, an application scene for realizing automatic matching and positioning according to the audio rhythm information of background music of the video is explained, in the application scene, the video special effect is dynamically and correspondingly added according to the rhythm change of the background audio, the video special effect is not added only by the subjective feeling of the user in the related technology, and the resonance of the picture special effect and the music rhythm of the video can be realized, so that the edited video can provide visual and auditory enhanced feeling for a viewer, the video atmosphere can be well rendered, the video editing effect is improved, and the video quality is improved.

The following describes a scheme for automatically adding a special effect according to the audio rhythm information of the background audio of the video to be processed with reference to fig. 9, and of course, the embodiment portion of fig. 9 except for positioning the target progress interval according to the background audio may be directly applied to a scene in which the target progress interval is automatically positioned according to other basis (e.g., the video content itself). Fig. 9 shows another flowchart of a video processing method according to an embodiment of the present application, and the flowchart of fig. 9 is described as follows.

Step 901: and receiving trigger operation of adding identification for the video special effect of the video to be processed.

Referring to the schematic of the user's trigger operation for adding an identifier to a video special effect shown in fig. 6, the implementation of step 901 may refer to the foregoing embodiment of step 501 in fig. 5, and the description is not repeated here.

Step 902: and judging whether the automatic matching effect function is started or not.

As mentioned above, the "automatic matching effect function" refers to a function of supporting the device to automatically locate the target progress interval to which the video needs to be added, and the "automatic matching effect function" supports the user to manually turn on and off, so as to provide different operation modes for the user to automatically and manually locate the target progress interval.

When the "automatic matching effect function" is determined to be turned on, the video clip added with the video special effect can be automatically positioned by adopting rhythm change information of background music in the embodiment of the application, which is described in detail later; when the "automatic matching effect function" is not started, the user may start the function first and then add a video special effect by using the video processing method in the embodiment of the present application, or the user may edit a video by using a video special effect adding method in the related art without starting the function.

After the above-mentioned trigger operation is detected when the "automatic matching effect function" is in the on state, under the trigger of the trigger operation, a target progress interval to which a video special effect needs to be added may be located according to the background music of the video to be processed, as shown in steps 903 to 904 in fig. 9; and, based on the trigger of the trigger operation, the addable video effect may be determined, for example, the determined addable video effect may be referred to as a target video effect, and the manner of determining the target video effect may include two manners, namely, manual selection by a user (described in steps 905 to 906 in fig. 9) and automatic adaptation by a device (described in step 907 in fig. 9), which will be described in detail below.

A first part: and determining a target progress interval.

For example, the target progress interval is automatically determined by the device according to the audio rhythm information of the background music.

Step 903: and acquiring audio rhythm information corresponding to the background audio of the video to be processed.

Step 904: and determining a target progress interval for adding a video special effect in the video to be processed according to the audio rhythm information.

The audio rhythm information of the video, specifically, the audio rhythm information of the background audio of the video, the audio rhythm information may be used to represent the audio amplitude of the background audio of the video, the audio rhythm information is, for example, an audio amplitude curve, also referred to as an audio rhythm curve, on the basis of presetting a preset amplitude threshold value, a rhythm point with audio amplitude larger than the preset amplitude threshold value, also called a drum point, and then the selected drum points are used for positioning a target progress interval needing to add a video special effect in the video to be processed, the rhythm point of which the audio amplitude is greater than a preset amplitude threshold value indicates the video playing time with larger audio amplitude, if the video special effect is added at the corresponding playing time, the combination of the video special effect and the audio rhythm can be obviously realized, so that the audio-visual experience of the resonance of the picture special effect and the music rhythm is achieved.

For example, as shown in fig. 10, three drum points, namely a drum point 1, a drum point 2, and a drum point 3, are screened out from an audio rhythm curve corresponding to a background audio of a video to be processed by a predetermined amplitude threshold, and correspondingly, three progress intervals, corresponding to the drum points 1, 2, and 3 in a progress indication area, are determined as target progress intervals, which need to add a video special effect in the embodiment of the present application, such as the target progress interval 1, the target progress interval 2, and the target progress interval 3 shown in fig. 10.

In fig. 10, the audio amplitude is used as a filtering condition to determine a rhythm point (i.e., a drum point), in a specific implementation process, for example, a variation trend of the audio amplitude may also be used as the filtering condition, for example, when it is detected that the audio amplitude continuously increases or continuously decreases within a certain time period, a rhythm point may be correspondingly determined, for example, when an abrupt change amplitude of the audio amplitude reaches a predetermined abrupt change amplitude, a rhythm point may be correspondingly located, and so on.

It should be noted that different predetermined amplitude thresholds may be set for different types of background music, for example, for a rock-and-roll type of background music, the predetermined amplitude threshold may be set to be larger, and for a slow type of light music background music, the predetermined amplitude threshold may be set to be smaller, in other words, the predetermined true amplitude threshold may be adaptively adjusted according to the music style type of the background audio, so as to be able to select a suitable number (not too many) of drum points.

As described above, in the related art, when a video special effect is added, a user needs to repeatedly drag a progress bar in a progress indication area to position a progress interval to which the video special effect needs to be added, the operation is troublesome, the positioning accuracy is low, the user may frequently perform a misoperation, the interval positioning needs to be completed in a long time, and particularly for a small and white user, the operation is more inconvenient, which may affect the use experience of the user on the video editing function, i.e., the video special effect function. In view of this, the embodiment of the present application automatically locates the target progress interval to which the video special effect needs to be added by using the audio rhythm information of the background audio of the video to be processed, and then adds the video special effect to the video clip corresponding to the target progress interval, so that the time spent on adding the video special effect can be shortened to a greater extent by omitting the location operation of manually locating the target progress interval by the user, the efficiency of adding the video special effect is improved, the video editing efficiency is integrally improved, the troublesome operation of the user is omitted, a fast and convenient video editing mode is provided for the user, the user can rapidly make the video special effect, and the user experience is improved.

The target progress interval is positioned through the audio rhythm information of the background music, the video special effect is dynamically added according to the rhythm change, the video special effect is not added through the subjective feeling of the user in the related technology, the resonance of the video picture special effect and the music rhythm can be realized, the edited video can provide visual and auditory enhanced feeling for the viewer, the video atmosphere can be well rendered, the video editing effect is improved, and the video quality is improved. Meanwhile, the video special effect which is successfully added is clearly indicated through the special effect indication information, so that a user can timely know the video special effect adding result, the equipment prompting performance is enhanced, and the user use experience is also improved.

After the device automatically determines the target progress interval needing to be added with the video special effect, the determined target progress interval can be marked and displayed in the progress indication area, and through the marking effect, a user can visually check which target progress interval is automatically positioned by the device, so that the prompting effect is enhanced. Referring to fig. 11, the right diagram of fig. 11 shows three target progress intervals automatically determined by the device, namely, a target progress interval 1, a target progress interval 2, and a target progress interval 3, which are represented by three black rectangular areas in the indication progress area in fig. 11.

Wherein, a target progress interval corresponds with an audio rhythm point (also called drum point) in the background music, when a plurality of target progress intervals are displayed in the progress indication area, each target progress interval can be displayed with the same display effect, but the display effect of the target progress interval needs to be displayed differently from the non-target progress interval in the progress indication area, so that the user can visually check the position of each target progress interval in the whole progress indication area, and the prompt is enhanced. And, can be according to presetting grouping strategy with a plurality of target progress intervals and grouping, for example, with the audio amplitude in the corresponding grouping of target progress interval of different within ranges, perhaps can be greater than the audio amplitude and divide into a set with the similar target progress interval of duration of predetermined audio amplitude, etc. and then can show each group target progress interval difference after grouping to realize the differentiation suggestion to the target progress interval of different groups, be convenient for the user to look over and know each group target progress interval, reinforcing suggestion effect.

It should be noted that, for the background audio of the video to be processed, the video to be processed may be synthesized through a video editing function of adding music before performing the operation of adding the special effect of the video, for example, before adding the special effect of the video, a user may perform a specific adding operation on a "music" icon as in the left diagram of fig. 6 to trigger music synthesis, the user may select an audio to be synthesized with the original video according to the viewing and listening requirement of the user or according to the recommendation of the system, and the device synthesizes the original video and the audio file corresponding to the audio selected by the user in response to the adding operation to obtain the video to be processed including the background audio, that is, the synthesized video may be understood as the video to be processed in the embodiment of the present application, and the video to be processed at this time includes the synthesized audio file.

A second part: and determining the special effect of the target video.

Specifically, the method comprises two modes of manual selection of a user and automatic matching of equipment.

1. The user manually selects the mode, which is described in detail in steps 905-906 below.

Step 905: and displaying a video special effect adding interface.

After the user performs the trigger operation for the video special effect addition identifier, the device may display a video special effect addition interface according to the trigger operation, where the video special effect addition interface includes a progress indication area and a video special effect display area, and meanwhile, a plurality of target progress intervals determined according to the foregoing combination with the background audio are displayed in the progress indication area, as shown in the right diagram in fig. 11.

Step 906: and receiving a first selection operation aiming at the target video special effect in the video special effect display area, and responding to the first selection operation to select the target video special effect.

The user can select the video special effects which the user wants to add from the video special effect display area, and can select one or more video special effects. For example, as shown in the left diagram in fig. 12a, the user performs a first selection operation on the video effect "color-changing", and after the device detects the first selection operation, the "color-changing" video effect selected by the user may be determined to be the target video effect; for example, as shown in the left diagram in fig. 13, the user selects the video special effect of "waveform" (the gesture of the user is indicated by a dotted line), and then selects the video special effect of "color-changing" (that is, the user selects two video special effects), and by manually selecting the target video special effect, the selected target video special effect can meet the special effect requirement of the user as much as possible, so that the use experience of the user is enhanced.

In the method of manually selecting a target video special effect by a user, as shown in fig. 12a, when the user selects a video special effect, the video special effect of the "color-changing" selected by the user may be added to the video segments corresponding to all target progress intervals, and at this time, the display effects of the special effect indication information shown in fig. 12a are the same; as shown in fig. 12b, when a user selects multiple (for example, two) video effects, the multiple video effects selected by the user may be sequentially added to the video segments corresponding to the target progress intervals, for example, the "waveform" video effect selected by the user first is allocated to two target progress intervals with a shorter duration, and the "color-changing" video effect selected by the user later is allocated to a target progress interval with a longer duration, as shown in the right diagram of fig. 12 b.

In the process of manually adding a target video special effect by a user, the user can manually select the target video special effect to be added, and simultaneously can select a target progress interval to be added with the video special effect from a plurality of target progress intervals automatically positioned by equipment, and manually select the corresponding video special effect for each target progress interval, for example, as shown in the left diagram of fig. 13, the user firstly performs a first selection operation of clicking to select the "colorful" video special effect, and then performs a second selection operation of clicking to select the target progress interval (for example, the target progress interval 1) to which the "colorful" video special effect needs to be added, and further, adds the "colorful" video to the video clip corresponding to the target progress interval 1, as shown in the right diagram of fig. 13, wherein the progress indication area at this time includes a mark of the target progress interval, the method and the device have the advantages that the method and the device also comprise special effect indication information, so that a user can add the video special effect which is considered to be adaptive to each target progress interval according to the actual use requirement of the user, the flexibility of adding the video special effect is improved, the user can add the video special effect through simple corresponding selection operation, and the method and the device are easy to operate even for small and plain users.

2. The automatic matching method of the device is described in detail in step 907 below.

Step 907: and determining the target video special effect according to a preset matching strategy.

Compared with the mode that the user manually selects the target video special effect, the embodiment of the application also provides an automatic determining mode that the equipment automatically adapts to the target video special effect, the automatic matching mode has higher efficiency compared with the mode that the user manually selects, and the target video special effect recommended by the system is possibly different from the conventional subjective selection of the user, so that the diversity and the flexibility of the target video special effect selection can be improved to a certain extent, certain recommendation surprise can be brought to the user, the use preference of the user is explored and developed, and the use experience of the user is improved.

In the implementation process, the following automatic matching modes are included but not limited.

In the method 1, the added special effect statistical information associated with the background audio is obtained, and the added special effect statistical information is used for indicating the associated video special effect used by the published video including the background audio, so that the target video special effect can be determined from the associated video special effect.

Taking a short video platform as an example, a plurality of users may add background music to a video that needs to be published, and further add a video special effect to the video to which the background music is added, for example, add the video special effect by using the video processing method in the embodiment of the present application, or add the video special effect by using a method in the related art, and further publish the video to which the video special effect is added to the platform. The platform can count videos published by each user, specifically, can count the corresponding relationship between background music of each published video and video special effects correspondingly added, and further obtain the above added special effect statistical information. For example, in the embodiment of the present application, if the background music of the video to be processed is song 123, then the video special effects that the background music is adopted by the published video of song 123 may be retrieved from the added special effect statistical information, these associated video special effects are collectively referred to as associated video special effects, and then the target video special effect is further selected from the associated video special effects, for example, one or several video special effects with higher usage frequency are selected as the target video special effect, or one or more video special effects with higher usage frequency in the recent period may be selected as the target video special effect, and so on, thereby completing the selection of the target video special effect.

Therefore, the target video special effects are automatically matched according to the special effect use conditions of most users of the platform, so that the selected target video special effects can generally meet the watching requirements of the public, if the target video special effects are adopted for carrying out special effect production, the watching requirements of the users can be met as much as possible, in addition, after the videos added with the target video special effects are published to the platform, the watching preferences of other viewers can be met as much as possible, the retention probability of the published videos can be reserved as much as possible, and the click rate and the watching depth can be improved.

And 2, selecting a video special effect with high historical use frequency of the current user as the target video special effect.

That is, the historical usage record of the video special effect used by the user can be referred to, and because the high usage frequency indicates that the user likes and prefers himself, the automatic matching mode can meet the actual adding preference of the user as much as possible.

And 3, selecting the most popular video special effect in the last period of time on the video publishing platform as the target video special effect.

The mode 3 is similar to the mode 1, and the special effect adaptation is automatically performed for the current user by referring to the overall use condition of other users, so that the use requirements of the public users can be generally met.

After the target progress interval in which the video special effect needs to be added is determined through the first part and the target video special effect which can be added is determined through the second part, the operation of adding the video special effect can be performed, namely, step 908 in fig. 9 is executed.

Step 908: and adding a target video special effect to the video clip corresponding to the target progress interval.

The method for adding the video special effect to the video clip can be implemented according to an adding method in the related art, and the embodiment of the application is not limited. Specifically, in the embodiment of the present application, there may be a plurality of situations according to different numbers of the target video special effect and the target progress interval, which are exemplified below.

For example, when the number of the target video special effects that can be added is 1 and the number of the target progress intervals is multiple, the same 1 video special effect may be added to the video clips corresponding to all the target progress intervals, and the display effect of each piece of special effect indication information obtained at this time may be the same;

for example, when the number of the target video special effects that can be added is 1 and the number of the target progress intervals is multiple, a target progress interval that meets the preset condition may be selected from all the target progress intervals, and then the same 1 video special effect may be added to the video clips corresponding to the target progress intervals that meet the preset condition. For example, a target progress interval having a duration corresponding to the progress interval greater than a predetermined duration (e.g., 2 seconds) may be selected to add a video special effect, or a target progress interval having a maximum audio amplitude may be selected from a plurality of adjacent target progress intervals having smaller interval intervals to add a video special effect, and so on.

For example, when there are a plurality of target video special effects that can be added and a plurality of target progress intervals, the plurality of target video special effects may be sequentially added to the video clips corresponding to the plurality of target progress intervals in the preset addition order. In one possible implementation, for example, as shown in fig. 12b, according to a selection sequence in which a user selects a plurality of target video special effects, corresponding target video special effects are sequentially added to video clips corresponding to a plurality of target progress intervals, a "waveform" special effect selected by the user first is added to a group of a first target progress interval and a second target progress interval, and a "color illusion" special effect selected by the user later is added to a group of a third target progress interval.

The selection sequence of each target video special effect selected by the user indicates the priority of the user on the target video special effects to a certain extent, so that the video special effects preferentially selected by the user can be preferentially added by sequencing and adding as much as possible; in another possible implementation manner, corresponding target video effects can be added to the video clips respectively corresponding to the multiple target progress intervals in sequence from high to low according to the video effect utilization rate, so that the video effects preferred by the public or the users can be ensured to be preferentially added and displayed.

For example, when the number of the addable target video special effects is multiple and the number of the target progress intervals is 1, the multiple target video special effects may be all added to the video clip corresponding to the target progress interval, or the video playing time corresponding to the target progress interval may be judged first, if the determined video playing time is long, all the selected target video special effects may be added to the video clip, if the determined video playing time is short, in order to avoid unclear video pictures due to the multiple video special effects in a short time, one or a part of the target video special effects may be selected to be added, so as to avoid the influence of the video special effects which are intensively added in a short time on the watching of the original video content as much as possible, and ensure the video editing quality.

In practice, this will not be described much, including but not limited to the cases listed above.

Step 909: and obtaining the video added with the target video special effect.

After the operation of adding the video effect in step 908, the video to which the target video effect is added is obtained.

Step 910: and displaying special effect indication information in the target progress interval.

As shown in fig. 8a, 8b, and 8c, through the indication of the special effect indication information, the user can definitely add the video special effect in the corresponding target progress interval, so that a certain prompt effect is provided for the user, the user can visually check the result of whether the video special effect is successfully added, and the prompt effect is enhanced.

Step 911: and obtaining updated special effect indication information according to the preset operation aiming at the target special effect indication information.

After the special effect indication information is displayed, if the user is not satisfied with the current automatic matching special effect, the embodiment of the application also provides an adjustable mechanism for the user to modify manually.

For example, as shown in the left diagram of fig. 14, a user may perform a deletion operation on a first special effect indication information of the plurality of special effect indication information, where the deletion operation is, for example, an operation of pressing the special effect indication information for a long time or pressing the special effect indication information again, or may call up an edit option menu for the special effect indication information first, and select a deletion option from the edit option menu, and through the deletion operation, the first special effect indication information may be deleted, as shown in the right diagram of fig. 14, the third special effect indication information does not exist, and when the special effect indication information is deleted, the deleted special effect information may indicate that the corresponding target progress interval corresponds to a video revocation special effect added to the video clip, that is, the special effect indication information may be deleted simultaneously corresponding to the target video special effect that has been added. Therefore, the user can delete the automatic adding effect of the video special effect of the system so as to meet the special effect making requirement of the user as much as possible.

For example, as shown in the left diagram in fig. 15, the user may perform an adjustment operation on the second special effect indication information in the plurality of special effect indication information, where the left diagram in fig. 15 is an example of an operation of expanding a section range of a target progress interval corresponding to the special effect indication information, and the device may respond to the adjustment operation to adjust the section range of the target progress interval indicated by the special effect indication information, as shown in the right diagram in fig. 15, and at the same time, may control video clips corresponding to the target progress interval after the adjustment range to add the same video special effect, for example, video special effects added before the section range adjustment is performed in the target progress interval. Therefore, after the system automatically adds the special effects, the user can adjust the length of the video clip corresponding to each video special effect according to the actual requirement of the user so as to meet the special effect making requirement of the user as much as possible.

For example, as shown in the left diagram in fig. 16, a user may perform a special effect exchange operation, for example, a special effect exchange operation for the third special effect indication information and the fourth special effect indication information, for example, a slide gesture operation for sliding from the third special effect indication information to the fourth special effect indication information, and in response to the special effect exchange operation, the device exchanges the third special effect indication information and the fourth special effect indication information and exchanges two video special effects added to two video clips corresponding to the third special effect indication information and the fourth special effect indication information, so that special effect exchange of the two video clips can be quickly achieved through the special effect exchange operation, so that the video special effects are quickly edited at the second time, and a special effect production requirement of the user is met as much as possible.

The deleting operation, the adjusting operation, and the special effect exchanging operation may be understood as predetermined operations in step 911, the first special effect indication information, the second special effect indication information, the third special effect indication information, and the fourth special effect indication information may be understood as target special effect indication information in step 911, the first special effect indication information, the second special effect indication information, the third special effect indication information, and the fourth special effect indication information may be any one of all the special effect indication information, and the device may obtain updated special effect indication information in response to the predetermined operations.

Step 912: and obtaining the video added with the video special effect according to the updated special effect indication information.

For example, the updated special effect indication information may be deleted, exchanged, and adjusted in range, or other updating operations may be performed, and since a corresponding operation is performed on the correspondingly added video special effect when a predetermined operation is performed on the special effect indication information, a video to which the video special effect is added may be obtained according to the updated special effect indication information, so as to implement secondary manual editing of the video special effect.

The embodiment of the application provides a mode of need adding the video clip of video special effect by equipment self intelligence location, so, when carrying out video editing, the user need not to drag the progress bar again and carries out manual positioning, has simplified video editing's operation complexity, more does benefit to the user and adopts such video editing mode to edit the video, improves video editing efficiency.

Furthermore, by combining the audio rhythm information of the background music of the video, for example, a video special effect can be added at a rhythm point with larger audio amplitude, so that the audio-visual comprehensive effect of the resonance of the video picture and the background music can be realized, the video special effect can be automatically added according to the change of the music rhythm, the video edited in this way can provide visual and auditory enhanced feelings for a viewer, the video atmosphere can be well rendered, the video editing effect is improved, and the video quality is improved.

Based on the same inventive concept, the embodiments of the present application provide a video processing apparatus, which may be a hardware structure, a software module, or a hardware structure plus a software module. The video processing apparatus is, for example, any one of the terminal devices in fig. 3 or fig. 4 described above, or may be a functional apparatus provided in any one of the terminal devices in fig. 3 or fig. 4. Referring to fig. 17a, the video processing apparatus in the embodiment of the present application includes a receiving module 1701 and a display module 1702, wherein:

a receiving module 1701, configured to receive a trigger operation for adding an identifier to a video special effect of a video to be processed;

a display module 1702, configured to display special-effect indication information in a target progress interval of a progress indication area of a video to be processed according to the trigger of the trigger operation; the special effect indication information is used for indicating that video special effects are added to the video clips corresponding to the target progress intervals.

In a possible implementation manner, the display module 1702 is configured to display a video special effect adding interface according to the trigger of the trigger operation, where the video special effect adding interface includes a progress indication area and a video special effect display area; the receiving module 1701 is further configured to receive a first selection operation for a target video effect in the video effect presentation area; and responding to the first selection operation;

referring to fig. 17a, the video processing apparatus in the embodiment of the present application further includes an add special effect module 1703, configured to add a target video special effect to a video segment corresponding to the target progress interval.

In a possible implementation manner, the target progress interval is displayed in the progress indication area, and the receiving module 1701 is further configured to receive a second selection operation for the target progress interval and determine, according to the second selection operation, the target progress interval to which the video special effect needs to be added;

and an add special effect module 1703, configured to respond to the first selection operation and add a target video special effect to the video segment corresponding to the target progress interval selected according to the second selection operation.

In a possible implementation manner, please refer to fig. 17b, the video processing apparatus in the embodiment of the present application further includes a determining module 1704, wherein:

a determining module 1704, configured to determine a target video special effect according to a preset matching policy according to triggering of a triggering operation;

and an add special effect module 1703, configured to add a target video special effect to the video segment corresponding to the target progress interval.

In one possible implementation, the target progress interval is determined according to audio rhythm information of the video to be processed, and the audio rhythm information is used for representing audio amplitude of background audio of the video to be processed.

In one possible implementation, the receiving module 1701 is further configured to receive an add operation for adding an audio identification for the original video;

referring to fig. 17b, the video processing apparatus in the embodiment of the present application further includes a synthesizing module 1705, configured to synthesize an audio file corresponding to the original video and the background audio in response to the adding operation, so as to obtain a to-be-processed video including the background audio.

In one possible implementation, the add special effects module 1703 is configured to:

In one possible implementation, the display module 1702 is configured to:

the target progress interval and the non-target progress interval are displayed in a distinguishing mode, wherein the non-target progress interval is an area excluding the target progress interval in the progress indication area; alternatively, the first and second electrodes may be,

In one possible implementation, the receiving module 1701 is further configured to:

after the display module 1702 displays the special effect indication information in the target progress interval of the progress indication area of the video to be processed, receiving a deletion operation for first special effect indication information in the special effect indication information;

as shown in fig. 17b, the video processing apparatus in this embodiment of the application further includes a deleting module 1706, configured to, in response to a deleting operation, delete the first special effect indication information, and cancel the video special effect added to the first video segment corresponding to the first special effect indication information.

In a possible implementation, the receiving module 1701 is further configured to receive an adjustment operation for second special effect indication information in the special effect indication information after the display module 1702 displays the special effect indication information in a target progress interval of a progress indication region of the video to be processed;

as shown in fig. 17b, the video processing apparatus in the embodiment of the present application further includes an adjusting module 1707, configured to adjust a range of the target progress interval indicated by the second special effect indication information in response to an adjusting operation; and controlling the video clips corresponding to the target progress interval after the range is adjusted to add the same video special effect.

In a possible implementation, the receiving module 1701 is further configured to receive a special effect exchanging operation after the display module 1702 displays the special effect indication information in the target progress interval of the progress indication area of the video to be processed;

as shown in fig. 17b, the video processing apparatus in this embodiment of the application further includes an exchange special effect module 1708, configured to respond to a special effect exchange operation, exchange third special effect indication information and fourth special effect indication information in the special effect indication information, and exchange two video special effects added to two video clips corresponding to the third special effect indication information and the fourth special effect indication information.

All relevant contents of each step involved in the embodiments of the video processing method can be cited to the functional description of the functional module corresponding to the video processing apparatus in the embodiments of the present application, and are not described herein again.

The division of the modules in the embodiments of the present application is schematic, and only one logical function division is provided, and in actual implementation, there may be another division manner, and in addition, each functional module in each embodiment of the present application may be integrated in one processor, may also exist alone physically, or may also be integrated in one module by two or more modules. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.

Based on the same inventive concept, the embodiment of the present application further provides a video processing device, which is, for example, any one of the terminal devices in fig. 3 or fig. 4. Referring to fig. 18, the video processing apparatus in this embodiment of the present application includes at least one processor 1801 and a memory 1802 connected to the at least one processor 1801, and a specific connection medium between the processor 1801 and the memory 1802 is not limited in this embodiment of the present application, for example, the processor 1801 and the memory 1802 may be connected by a bus, and the bus may be divided into an address bus, a data bus, a control bus, and the like.

In this embodiment, the memory 1802 stores instructions executable by the at least one processor 1801, and the at least one processor 1801 may execute the steps included in the foregoing video processing method by executing the instructions stored in the memory 1802.

The Processor 1801 may be a general-purpose Processor, such as a Central Processing Unit (CPU), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component, and may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present Application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in a processor.

Memory 1802, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. The Memory may include at least one type of storage medium, and may include, for example, a flash Memory, a hard disk, a multimedia card, a card-type Memory, a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Programmable Read Only Memory (PROM), a Read Only Memory (ROM), a charged Erasable Programmable Read Only Memory (EEPROM), a magnetic Memory, a magnetic disk, an optical disk, and so on. The memory 1802 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to such. The memory 1802 of the embodiments of the present application may also be circuitry or any other device capable of performing a storage function for storing program instructions and/or data.

The processor 1801 is a control center of the video processing apparatus, and may be connected to various parts of the entire video processing apparatus through various interfaces and lines, and perform overall monitoring of the video processing apparatus by executing or executing instructions stored in the memory 1802 and calling data stored in the memory 1802, and various functions and processing data of the video processing apparatus. Optionally, the processor 1801 may include one or more processing units, and the processor 1801 may integrate an application processor and a modem processor, where the application processor mainly handles an operating system, a user interface, application programs, and the like, and the modem processor mainly handles wireless communication. It is to be appreciated that the modem processor described above may not be integrated into the processor 1801. In some embodiments, the processor 1801 and the memory 1802 may be implemented on the same chip, or in some embodiments, they may be implemented separately on separate chips.

Further, the video processing apparatus in this embodiment may further include an input unit 1803, a display unit 1804, a radio frequency unit 1805, an audio circuit 1806, a speaker 1807, a microphone 1808, a wireless fidelity (WiFi) module 1809, a bluetooth module 1810, a power supply 1811, an external interface 1812, a headphone jack 1813, and other components. It will be understood by those skilled in the art that fig. 18 is merely an example of a video processing device and does not constitute a limitation of a video processing device, which may include more or fewer components than those shown, or some components may be combined, or different components.

The input unit 1803 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the video playback device. For example, the input unit 1803 may include a touch screen 1814 and other input devices 1815. The touch screen 1814 may collect touch operations by a user (e.g., operations by the user on or near the touch screen 1814 using any suitable object such as a finger, a joint, a stylus, etc.), that is, the touch screen 1814 may be used to detect touch pressure and touch input position and touch input area, and drive the corresponding connection device according to a preset program. The touch screen 1814 can detect a touch operation of the touch screen 1814 by a user, convert the touch operation into a touch signal and send the touch signal to the processor 1801, or interpret that touch information of the touch operation is sent to the processor 1801, and can receive and execute a command sent by the processor 1801. The touch information may include at least one of pressure magnitude information and pressure duration information. The touch screen 1814 may provide an input interface and an output interface between the video playback device and a user. In addition, the touch screen 1814 may be implemented using various types, such as resistive, capacitive, infrared, and surface acoustic wave. The input unit 1803 may include other input devices 1815 in addition to the touch screen 1814. For example, other input devices 1815 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 1804 may be used to display information input by or provided to a user and various menus of the video playback device. Further, the touch screen 1814 can cover the display unit 1804, and when the touch screen 1814 detects a touch operation on or near the touch screen, the touch screen is transmitted to the processor 1801 to determine pressure information of the touch operation. In this embodiment, the touch screen 1814 and the display unit 1804 may be integrated into a single component to implement the input, output and display functions of the video playback device. For convenience of description, the embodiment of the present application is schematically illustrated by taking the touch screen 1814 as an example of the functional set of the touch screen 1814 and the display unit 1804, but in some embodiments, the touch screen 1814 and the display unit 1804 may be taken as two separate components.

When the display unit 1804 and the touch panel are superimposed on each other in layers to form the touch screen 1814, the display unit 1804 can function as an input device and an output device, and when functioning as an output device, can be used to display images, for example, to enable playing of various videos. The Display unit 1804 may include at least one of a Liquid Crystal Display (LCD), a Thin Film Transistor Liquid Crystal Display (TFT-LCD), an Organic Light Emitting Diode (OLED) Display, an Active Matrix Organic Light Emitting Diode (AMOLED) Display, an In-plane switching (IPS) Display, a flexible Display, a 3D Display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and the video processing apparatus may include two or more display units (or other display devices) according to a particular desired embodiment, for example, the video processing apparatus may include an external display unit (not shown in fig. 18) and an internal display unit (not shown in fig. 18).

The rf unit 1805 may be used for receiving and transmitting information or signals during a call. Typically, the radio frequency circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the radio frequency unit 1805 may also communicate with network devices and other devices through wireless communication.

Audio circuitry 1806, speaker 1807, microphone 1808 may provide an audio interface between a user and a video playback device. The audio circuit 1806 may transmit the electrical signal converted from the received audio data to the speaker 1807, and the electrical signal is converted into a sound signal by the speaker 1807 and output. On the other hand, the microphone 1808 converts the collected sound signals into electrical signals, which are received by the audio circuit 1806 and converted into audio data, which are then processed by the audio data output processor 1801 and then transmitted to another electronic device via the rf unit 1805, or output to the memory 1802 for further processing, and the audio circuit may also include a headphone jack 1813 for providing a connection interface between the audio circuit and a headphone.

WiFi belongs to short distance wireless transmission technology, and the video processing device can help the user send and receive e-mail, browse web page and access streaming media etc. through WiFi module 1809, which provides wireless broadband internet access for the user. Although fig. 18 shows the WiFi module 1809, it is understood that it does not belong to the essential constitution of the video processing device, and may be omitted entirely as needed within the scope not changing the essence of the invention.

Bluetooth is a short-range wireless communication technology. By using the bluetooth technology, the communication between mobile communication video playing devices such as a palm computer, a notebook computer, a mobile phone and the like can be effectively simplified, the communication between the devices and the Internet (Internet) can also be successfully simplified, the video processing device enables the data transmission between the video processing device and the Internet to be more rapid and efficient through the bluetooth module 1810, and a road is widened for wireless communication. Bluetooth technology is an open solution that enables wireless transmission of voice and data. Although fig. 18 shows the bluetooth module 1810, it is understood that it does not belong to the essential constitution of the video processing apparatus and may be omitted entirely as needed within the scope not changing the essence of the invention.

The video processing device may also include a power supply 1811 (such as a battery) for receiving external power or powering various components within the video processing device. Preferably, the power supply 1811 may be logically connected to the processor 1801 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

The video processing device may further include an external interface 1812, where the external interface 1812 may include a standard microsub interface, may also include a multi-pin connector, and may be used to connect the video processing device to communicate with other devices, and may also be used to connect a charger to charge the video processing device.

Although not shown, the video processing apparatus in the embodiment of the present application may further include a camera, a flash, and other possible functional modules, which are not described herein again.

Based on the same inventive concept, the present application also provides a storage medium, which may be a computer-readable storage medium, and the storage medium stores computer instructions, which, when executed on a computer, cause the computer to perform the steps of the video processing method as described above.

Based on the same inventive concept, the embodiment of the present application further provides a chip system, where the chip system includes a processor and may further include a memory, and is used to implement the steps of the video processing method as described above. The chip system may be formed by a chip, and may also include a chip and other discrete devices.

In some possible implementations, the aspects of the video processing method provided in the embodiments of the present application may also be implemented in the form of a program product, which includes program code for causing a computer to perform the steps of the video processing method according to the various exemplary implementations of the present application described above when the program product runs on the computer.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims

1. A method of video processing, the method comprising:

2. The method of claim 1, wherein displaying special effect indication information in a target progress interval of a progress indication area of the video to be processed according to the trigger of the trigger operation comprises:

receiving a first selection operation aiming at a target video special effect in the video special effect showing area;

responding to the first selection operation, adding the target video special effect to the video clip corresponding to the target progress interval, and displaying the special effect indication information in the target progress interval.

3. The method of claim 2, wherein the target progress interval is displayed in the progress indication area, the method further comprising:

responding to the first selection operation, and adding the target video special effect to the video clip corresponding to the target progress interval, wherein the method comprises the following steps:

4. The method of claim 1, wherein displaying special effect indication information in a target progress interval of a progress indication area of the video to be processed according to the trigger of the trigger operation comprises:

determining a target video special effect according to a preset matching strategy according to the triggering of the triggering operation;

and adding the target video special effect to the video clip corresponding to the target progress interval, and displaying the special effect indication information in the target progress interval.

5. The method of claim 1, wherein the target progress interval is determined according to audio tempo information of the video to be processed, the audio tempo information being used to characterize audio amplitude of background audio of the video to be processed.

6. The method of claim 5, wherein prior to receiving a trigger operation to add an identification to a video special effect for a video to be processed, the method further comprises:

receiving an adding operation of adding a sound effect identifier for an original video;

7. The method of any of claims 1-6, further comprising:

when the number of the target videos to be added is especially multiple and the target progress interval is one, adding a part of or all of the target video special effects to the video clip corresponding to the target progress.

8. The method of claim 7, wherein sequentially adding the target video special effects to the video clips respectively corresponding to the plurality of target progress intervals according to a preset adding order comprises:

9. The method according to any one of claims 1 to 6, wherein before displaying the special effect indication information in the target progress interval of the progress indication area of the video to be processed, the method further comprises:

10. The method according to any one of claims 1 to 6, wherein after the special effect indication information is displayed in the target progress interval of the progress indication area of the video to be processed, the method further comprises:

receiving a deleting operation aiming at first special effect indication information in the special effect indication information;

11. The method according to any one of claims 1 to 6, wherein after the special effect indication information is displayed in the target progress interval of the progress indication area of the video to be processed, the method further comprises:

receiving an adjustment operation for second special effect indication information in the special effect indication information;

responding to the adjustment operation, and adjusting the range of the target progress interval indicated by the second special-effect indication information;

and controlling the video clips corresponding to the target progress interval after the adjustment range to add the same video special effect.

12. The method according to any one of claims 1 to 6, wherein after the special effect indication information is displayed in the target progress interval of the progress indication area of the video to be processed, the method further comprises:

receiving special effect exchange operation;

13. A video processing apparatus, characterized in that the apparatus comprises:

14. A video processing device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps comprised by the method according to any one of claims 1 to 12 when executing the computer program.

15. A storage medium storing computer-executable instructions for causing a computer to perform the steps comprising the method of any one of claims 1-12.