WO2022252916A1 - 特效配置文件的生成方法、装置、设备及介质 - Google Patents
特效配置文件的生成方法、装置、设备及介质 Download PDFInfo
- Publication number
- WO2022252916A1 WO2022252916A1 PCT/CN2022/091385 CN2022091385W WO2022252916A1 WO 2022252916 A1 WO2022252916 A1 WO 2022252916A1 CN 2022091385 W CN2022091385 W CN 2022091385W WO 2022252916 A1 WO2022252916 A1 WO 2022252916A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- music
- track
- background music
- special effect
- editing
- Prior art date
Links
- 230000000694 effects Effects 0.000 title claims abstract description 254
- 238000000034 method Methods 0.000 title claims abstract description 84
- 239000000463 material Substances 0.000 claims abstract description 274
- 230000004044 response Effects 0.000 claims abstract description 75
- 238000004590 computer program Methods 0.000 claims description 22
- 230000008569 process Effects 0.000 claims description 22
- 238000003860 storage Methods 0.000 claims description 20
- 238000005562 fading Methods 0.000 claims description 11
- 238000009877 rendering Methods 0.000 claims description 8
- 238000012217 deletion Methods 0.000 claims description 6
- 230000037430 deletion Effects 0.000 claims description 6
- 238000004519 manufacturing process Methods 0.000 abstract description 10
- 239000010410 layer Substances 0.000 description 94
- 230000006870 function Effects 0.000 description 24
- 238000010586 diagram Methods 0.000 description 19
- 238000004891 communication Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000004904 shortening Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 239000006071 cream Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 239000002346 layers by function Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0486—Drag-and-drop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B27/036—Insert-editing
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/34—Indicating arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/27—Server based end-user applications
- H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
- H04N21/2743—Video hosting of uploaded data from client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
- H04N21/8113—Monomedia components thereof involving special audio data, e.g. different tracks for different languages comprising music, e.g. song in MP3 format
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
Definitions
- the present disclosure relates to the field of computer technology, and in particular to a method, device, device and medium for generating an audio configuration file.
- An embodiment of the present disclosure provides a method for generating a special effect configuration file.
- the method includes: in response to an editing trigger operation on the background music, displaying a track list on the background music editing interface, wherein the track list Including the first track of the background music and the second track of the music-related material; in response to the editing operation of the first track in the editing interface of the background music, adjusting the playing time period of the background music, and /or, in response to the editing operation on the second track in the editing interface of the background music, adjust the associated time period corresponding to the music-related material in the background music; and in response to the generation of a special effect configuration file An instruction to generate a special effect configuration file including the background music and the music-related material according to the first track and the second track; wherein, the special effect configuration file is used to carry out the original video in the process of shooting the video Special effect configuration, so that the background music and the music-related material are added to the original video to generate a target video for shooting output; during the display process of the target video,
- An embodiment of the present disclosure also provides an apparatus for generating a special effect configuration file, the apparatus comprising: an editing trigger module, configured to display a track list in an editing interface of the background music in response to an editing trigger operation on the background music, Wherein, the track list includes the first track of the background music and the second track of the music-related material; the editing module is used to respond to the editing operation of the first track in the editing interface of the background music , adjust the playing time period of the background music, and/or, in response to the editing operation on the second track in the editing interface of the background music, adjust the corresponding time period of the music-related material in the background music an associated time period; and a file generation module, configured to generate a special effect configuration file including the background music and the music-associated material according to the first track and the second track in response to a generation instruction of the special effect configuration file; wherein , the special effects configuration file is used to configure special effects on the original video during the video shooting process, so that the background music and the music-related material are added to the original video to generate
- An embodiment of the present disclosure also provides an electronic device, which includes: a processor; and a memory for storing instructions executable by the processor; The above executable instructions are executed, and the instructions are executed to implement the method for generating a special effect configuration file as provided in the embodiment of the present disclosure.
- the embodiment of the present disclosure also provides a computer-readable storage medium, the storage medium stores a computer program, and the computer program is used to execute the method for generating a special effect configuration file as provided in the embodiment of the present disclosure.
- An embodiment of the present disclosure also provides a computer program, including: instructions, which when executed by a processor cause the processor to execute the method for generating a special effect configuration file as provided in the embodiment of the present disclosure.
- An embodiment of the present disclosure further provides a computer program product, including instructions, which, when executed by a processor, cause the processor to execute the method for generating a special effect configuration file as provided in the embodiment of the present disclosure.
- FIG. 1 is a schematic flowchart of a method for generating a special effect configuration file provided by an embodiment of the present disclosure
- FIG. 2 is a schematic flowchart of another method for generating a special effect configuration file provided by an embodiment of the present disclosure
- FIG. 3 is a schematic diagram of a first editing interface provided by an embodiment of the present disclosure.
- FIG. 4 is a schematic diagram of a second editing interface provided by an embodiment of the present disclosure.
- FIG. 5 is a schematic diagram of a third editing interface provided by an embodiment of the present disclosure.
- FIG. 6 is a schematic diagram of a fourth editing interface provided by an embodiment of the present disclosure.
- FIG. 7 is a schematic diagram of a fifth editing interface provided by an embodiment of the present disclosure.
- FIG. 8 is a schematic structural diagram of a device for generating a special effect configuration file provided by an embodiment of the present disclosure
- FIG. 9 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.
- the term “comprise” and its variations are open-ended, ie “including but not limited to”.
- the term “based on” is “based at least in part on”.
- the term “one embodiment” means “at least one embodiment”; the term “another embodiment” means “at least one further embodiment”; the term “some embodiments” means “at least some embodiments.” Relevant definitions of other terms will be given in the description below.
- the inventors of the present disclosure found that, in related technologies, the generation of special effect configuration files corresponding to adding background music is relatively complicated, takes a long time, and has low efficiency.
- an embodiment of the present disclosure provides a method for generating a special effect configuration file, so as to shorten production time.
- Fig. 1 is a schematic flowchart of a method for generating a special effect configuration file provided by an embodiment of the present disclosure.
- the method can be executed by a device for generating a special effect configuration file, wherein the device can be implemented by software and/or hardware, and generally can be integrated in an electronic in the device.
- the method includes step 101 to step 103 .
- Step 101 in response to an edit trigger operation on the background music, display a track list in the background music editing interface, wherein the track list includes the first track of the background music and the second track of the music-related material.
- the method for generating a special effect configuration file in the embodiment of the present disclosure can be implemented by a special effect configuration file creation tool in the terminal, and the creation tool is used to implement editing, adjustment, and generation of a special effect configuration file.
- the special effect configuration file can be a configuration file used to realize special effect functions, for example, it can realize various types of interaction functions between the user and the terminal, and the special effect configuration file can be configured in various types of applications in the form of plug-ins or components. limit.
- the edit trigger operation refers to a trigger operation for implementing background music editing, and the edit trigger operation may have various specific forms, which may be selected according to actual conditions.
- the editing interface of the background music can be an interface for editing the relevant information of the background music, which can include a track list, and the tracks included in the track list are arranged in order, and the specific arrangement direction is not limited, and can be arranged horizontally or vertically .
- the length of the first track in the track list corresponds to the playing time period of the background music
- the length of the second track corresponds to the time period associated with the music-related material
- the number of the music-related material is one or more.
- the first track of the background music also known as the audio track
- Music-related materials can be special effect materials that are displayed during background music playback.
- music-related materials can include makeup, filters, etc.
- the number of music-related materials is not limited, and can be set according to actual conditions.
- the second track of the music-related material can be used to represent the associated time period of the music-related material in the background music through the track length. Since the number of the music-related material can be one or more, the number of the second track can also be one or more indivual.
- the terminal when the user needs to make a special effect configuration file, the terminal can start the special effect configuration file creation tool and monitor the user's operation. After receiving the user's editing trigger operation on the background music, the terminal can display the background music Editing interface, and display the track list including the first track and the second track in the editing interface of the above-mentioned background music. In the editing interface of the current background music, the length of each track can be the same or different.
- Step 102 in response to the editing operation of the first track in the background music editing interface, adjust the playing time period of the background music, and/or, in response to the editing operation of the second track in the background music editing interface, adjust The associated time period corresponding to the music-related material in the background music.
- the playing time period of the background music may be a time period determined from the complete playing time period of the currently selected background music.
- the associated time period corresponding to the music-related material in the background music may be a time period corresponding to the display time of the music-related material in the playing time period of the background music, and the duration of the associated time period is less than or equal to the playing time period of the background music, for example
- the associated time period may be the initial 10 seconds of the playing time period of the background music.
- adjusting the playing time period of the background music in response to the editing operation of the first track in the editing interface of the background music may include: responding to the track adjustment of the first track in the editing interface of the background music
- the first drag operation of the block adjusts the length of the first track according to the drag position of the first drag operation, wherein the adjusted length of the first track is corresponding to the position where the track adjustment block is dragged by the first drag operation length; and adjust the playing time period of the background music according to the adjusted length of the first track.
- the above-mentioned track adjustment block can be a movable boundary block set on both sides of the track, which is used to represent the start boundary and the end boundary of the track, and the length of the track is represented by the length between the two track adjustment blocks.
- the length of the first track can be adjusted according to the drag position of the first drag operation, and then along with the The length of a track is adjusted, and the playing time of the background music is adjusted accordingly.
- the original playing time period of the background music is 10 minutes
- the length of the first track is adjusted to half, the playing time is reduced to 5 minutes, and the specific starting time is the same as the starting boundary where the track adjustment block is located. correspond.
- adjusting the associated time period corresponding to the music-related material in the background music includes: responding to the editing operation of the second track in the editing interface of the background music
- the second drag operation of the track adjustment block of the second track adjusts the length of the second track according to the drag position of the second drag operation, wherein the adjusted length of the second track is that the track adjustment block is dragged by the second drag operation The length corresponding to the position to be reached; and adjust the associated time period corresponding to the music associated material in the background music according to the adjusted length of the second track.
- the aforementioned adjustment of the lengths of the first track and the second track by dragging the track adjustment block is only an example, and not an exclusive limitation.
- the adjustment of the length of the track can also be realized by performing a click operation on the track.
- the adjustment of the track length in the editing interface of the background music can quickly realize the adjustment of the playing time period of the background music and/or the corresponding time period of the music-related material in the background music, which improves the editing efficiency and saves edit time.
- Step 103 In response to the instruction for generating the special effect configuration file, generate a special effect configuration file including background music and music-related materials according to the first track and the second track.
- an instruction to generate a special effect configuration file can be received, and according to the edited and/or adjusted first track and second Tracks, using the packaging function of the special effect configuration file production tool, can package the background music corresponding to the first track and the music-related materials corresponding to the second track to generate a special effect configuration file and publish it.
- the special effect configuration file can realize the included background music The function that has been set up with the music-associated material.
- the special effects configuration file is used to configure the special effects of the original video during the process of shooting the video, so that background music and music-related materials are added to the original video to generate the target video of the shooting output; during the display process of the target video, The background music is played according to the playing time period, and the music-related material is rendered and displayed when the background music is played to the associated time period of the music-related material.
- the original video refers to the video without background music and music-related materials added
- the target video refers to the video with background music and music-related materials added.
- the video in the embodiments of the present disclosure may be a video obtained by combining static images and/or dynamic images, or may be a video obtained by shooting with a video shooting device, and is not specifically limited.
- the special effect configuration file can be configured in an application. When the user activates the function corresponding to the special effect configuration file, the original video can be configured with special effects during the shooting process to add background music and music-related material generation on the original video.
- the target video is output, and during the display of the target video, the background music can be played according to the edited playback time period, and the music-related material can be rendered and displayed when the background music is played to the associated time period of the music-related material.
- the solution for generating the special effect configuration file responds to the editing trigger operation of the background music, and displays a track list in the editing interface of the background music, wherein the track list includes the first track of the background music and music-related materials in response to the editing operation of the first track in the background music editing interface, adjust the playing time period of the background music, and/or, in response to the editing operation of the second track in the background music editing interface , adjust the associated time period corresponding to the music-related material in the background music; in response to the generation instruction of the special effect configuration file, generate a special effect configuration file including the background music and the music-related material according to the first track and the second track; wherein, the special effect configuration file It is used to configure special effects on the original video during the shooting process, so that background music and music-related materials are added to the original video to generate the target video for shooting output; during the display process of the target video, the background music is played according to the playing time segment, and render and display the music-related material when the background music is played to
- the triggering operation for editing the background music may include: when an adding operation to the background music is detected, or a selection operation of the music layer corresponding to the background music is detected in the layer list, then the background music is received. Editing of music triggers actions.
- different layers in the layer list are used to indicate different special effect materials, the rendering hierarchy order of the special effect materials of each layer in the layer list is the same as that of each layer in the layer list, and the music layer is in the layer The sort position in the list is first.
- the layer may be a functional layer provided in the above-mentioned production tool of the special effect configuration file for managing and editing the special effect material.
- the layer list may include at least one layer, and one layer is used to indicate a special effect material, that is, there is a one-to-one correspondence between the special effect material and the layer.
- the special effect material refers to the minimum element preset in the above-mentioned special effect configuration file creation tool for forming the special effect configuration file, and different special effect materials have different functions.
- the embodiment of the present disclosure is not limited to specific special effect materials.
- the special effect materials may include at least one of the background music, makeup, filters, special effects, stickers, text, and the like.
- a special effect configuration file may be composed of one special effect material or a combination of multiple special effect materials, without limitation.
- the music layer refers to the layer used to manage and edit the background music in the special effect material.
- the background music when receiving the user's adding operation to the background music on the home page of the authoring tool, specifically, receiving a trigger operation on the button representing the background music on the home page, it can be determined that the Edits to background music trigger actions.
- the background music has been added and the layer list already includes a music layer, when a selection operation of the music layer in the layer list by the user is received, it may be determined that an edit trigger operation on the background music is received.
- multiple trigger entries for editing the background music in the special effect material can be set, which improves the flexibility and efficiency of editing the background music, thereby saving time and improving the production experience.
- the method for generating the special effect configuration file may further include: displaying the special effect identification of the music-related material at the position corresponding to the associated time period of the music-related material on the first track of the background music in the editing interface of the background music .
- the position corresponding to the associated time period of the music-related material can be determined according to the actual situation, and can be the position of any time point of the associated time period on the first track, including the start time point and end time point of the associated time period Or the position of any intermediate time point on the first track.
- the special effect mark refers to a prompt mark representing the music-related material, which can remind the user of the music-related material of the current background music.
- the special effect mark corresponding to different music-related materials can be different, and the expression form of the special effect mark is not limited. For example, a circle can be used. The shape is used as a special effect mark, and the fill color or size of the circle corresponding to different music-related materials is different.
- the special effect identification of the target music-related material can be displayed at the position corresponding to the associated time period of the music-related material on the first track of the background music editing interface .
- the second track of the music-related material may be hidden or displayed.
- the prompt logo of the music-related material associated with the background music can be displayed on the track of the background music, so that the user can quickly understand the special effect material following the current background music, and based on the prompt logo, the corresponding second music can be hidden or displayed. track, making the editing of music-related materials more efficient, and further improving the editing efficiency.
- the associated time period of the initial state of the music-related material is the time period corresponding to the play count, and the length of the second track of the music-related material is only Shortening is supported.
- the number of times of playing refers to one of the display states of the music-related material, and the number of times of playing can be set when the music-related material is a dynamic image.
- the associated time period of the initial state of the music-related material is the time period of the number of plays, that is, the length of the second track of the music-related material in the initial state is the number of times played The length corresponding to the duration of .
- the associated time period of the music-related material does not support lengthening, but only supports reduction, that is, the length of the second track of the music-related material only supports shortening. In the above solution, only shortening is supported for the music-related material that already has a fixed playing time period, so as to avoid the influence of the material on other display states when the material is displayed in association with background music.
- the music-related material is a special effect material for which no trigger event is set among other special effect materials except background music, and the trigger event is one of the display states corresponding to the special effect material.
- the music-related materials are special effect materials that do not set trigger events in other special effect materials except background music, and trigger events It is one of the display states corresponding to the special effect material, and the trigger event may include at least one of an appearance action, an disappearance action, and an initial state.
- the display state of the special effect material refers to the state of the special effect material when it is rendered and displayed, and may include size, display position, display style, etc.
- the method for generating a special effect configuration file may further include: displaying the music in the editing interface of the background music in response to the trigger operation of the music-associated button in the editing interface of any special effect material except the background music an editing component; and in response to a trigger operation on the music editing component, perform an editing operation corresponding to the music editing component on the background music, the editing operation including at least one of volume adjustment, fading effect setting, deletion operation and replacement operation.
- any special effect material other than the background music may be a music-related material, or may not be a music-related material.
- the music-associated button may be a function button used to trigger editing and set background music in the editing interface of the special effect material, and the music-associated button may be included in the editing interface of other special effect materials except the background music.
- the background music editing interface may also include one or more music editing components pre-set for the background music, and each music editing component corresponds to a different playing state.
- the music editing component can include adding music components, volume components, fading components, deleting components and replacing components, etc.
- adding music components can also set a variety of function buttons from different sources, which are used to add backgrounds from different sources Music, for example, can include function buttons from three sources: link download, music extracted from video, and local music. Delete component and replace component can delete and replace the added background music respectively.
- the volume component is used for editing the volume of the background music
- the fading component is used for adjusting the fading effect of the background music.
- the method for generating the special effect configuration file may further include: performing a playback control operation on the background music in response to a trigger operation on the playback control button of the background music, where the playback control operation is a playback operation or a pause operation.
- the play control button can be a function button set for the background music, and the play control button can be set in the music layer in the above layer list, or other positions related to the background music, the details are not limited.
- the background music After receiving the user's trigger operation on the playback control button of the background music, the background music can be played or paused, that is, when the background music is playing, the background music can be paused; and when the background music is not playing , you can play the background music.
- the background music after the background music is added, the background music can be played and paused, which helps the user to preview the playback effect of the background music, and further improves the user's creative experience.
- the method for generating the special effect configuration file may further include: in response to selecting the first layer in the layer list, displaying the first special effect indicated by the first layer on the editing interface of the special effect material material, and in response to the editing operation on the first special effect material on the editing interface, adjust the state of the first special effect material according to the editing operation.
- adjusting the state of the first special effect material according to the editing operation includes: responding to a trigger operation on an editing component corresponding to the first special effect material on the editing interface , to adjust the state corresponding to the editing component of the first special effect material, and the number of the editing component is at least one.
- the editing components corresponding to each special effect material provided in the editing interface of the special effect material can realize the adjustment of the state of the special effect material, and the user can edit and set each special effect material quickly and conveniently, which shortens the creation time and improves efficiency and creative experience.
- the method for generating the special effect configuration file may further include: in response to the sorting adjustment operation on the layer list, adjusting the sorting of each layer in the layer list according to the sorting adjustment operation.
- the sorting of the second layer is adjusted according to the dragging position of the dragging operation, wherein the adjusted sorting position of the second layer is that the second layer is at The drag position to be dragged in the layer list.
- each special effect material is implemented in the form of layers, which constitutes a layer list, and the position order of each layer in the layer list corresponds to the rendering hierarchy order of the special effect materials, so that users can adjust the order of layers Quickly adjust the rendering layer order of special effect materials, which improves the adjustment efficiency.
- FIG. 2 is a schematic flowchart of another method for generating a special effect configuration file provided by an embodiment of the present disclosure. On the basis of the above embodiments, this embodiment further optimizes the above method for generating a special effect configuration file. As shown in FIG. 2 , the method includes step 201 to step 206 .
- Step 201 displaying a track list in an editing interface of background music in response to an editing trigger operation on background music.
- the track list includes the first track of the background music and the second track of the music related material.
- the length of the first track in the track list corresponds to the playing time period of the background music
- the length of the second track corresponds to the associated time period of the music-related materials
- the number of music-related materials is one or more.
- the triggering operation for editing background music may include: when an operation for adding background music is detected, or an operation for selecting a music layer corresponding to background music in the layer list is received, the background music is received. Editing of music triggers actions.
- different layers in the layer list are used to indicate different special effect materials, the rendering hierarchy order of the special effect materials of each layer in the layer list is the same as that of each layer in the layer list, and the music layer is in the layer The sort position in the list is first.
- FIG. 3 is a schematic diagram of a first editing interface provided by an embodiment of the present disclosure.
- an editing interface 10 for background music is shown.
- the editing interface 10 includes display areas 11 , 12 and 13 .
- a track list is displayed in the display area 12, and the track list includes a first track 121 of background music and an area 122 including a plurality of second tracks.
- Different second tracks indicate different music-related materials, for example, the three second tracks in the figure, the corresponding music-related materials from top to bottom are stickers, text and filters "fresh and natural". Different secondary tracks can have different fill colors.
- the second track status corresponding to the sticker in the picture is selected.
- each track corresponds to the time period
- the length of the first track corresponds to the playing time period
- the length of the second track corresponds to the associated time period of the music-related material in the background music.
- a plurality of function buttons are displayed in the display area 13 of the editing interface 10 , including a layer button, a scale setting button and a refresh button in the figure, and the figure is only an example.
- FIG. 4 is a schematic diagram of a second editing interface provided by an embodiment of the present disclosure.
- an editing interface 20 of an initial state of the special effect material creation tool is shown.
- Display areas 21 and 22 are shown in the editing interface 20 .
- a plurality of special effect materials can be displayed in the display area 22, such as makeup, filters, stickers, text, special effects, and audio as shown in the figure.
- the background music editing interface 40 shown in FIG. 6 can be displayed.
- An image in the video can be displayed in the display area 21 .
- FIG. 5 is a schematic diagram of a third editing interface provided by an embodiment of the present disclosure.
- a kind of editing interface 30 of special effect material except background music is shown.
- the editing interface 30 displays a layer list 32 .
- Layer list 32 shows 4 vertically sorted layers, and the corresponding special effect materials are background music, stickers, makeup and filter "cream".
- the sticker layer is displayed prominently, and the editing component corresponding to the sticker is displayed in the display area 31 .
- FIG. 5 also shows a transparency adjustment slider.
- the current value displayed on the interface of the transparency adjustment slider is 37.
- FIG. 6 is a schematic diagram of a fourth editing interface provided by an embodiment of the present disclosure.
- the editing interface 40 of the background music when the background music is added for the first time is shown.
- the editing interface 40 of the background music can display the added music component.
- the different function keys of multiple sources can also be set in this add music component, be used for adding background music from different sources, as shown in Figure 6, can include the function keys of link downloading, extracting music and local music three sources in the video. The key to extract music in the video in the picture is triggered.
- the editing interface 50 of the background music as shown in FIG. 7 can be displayed.
- FIG. 7 is a schematic diagram of a fifth editing interface provided by an embodiment of the present disclosure.
- a background music editing interface 50 for editing background music added for the first time or added in history is shown.
- the selection operation on the music layer is detected, and the editing of the background music can also be triggered, and then the display shown in Figure 7
- the editing interface 50 of the background music is shown.
- step 201 After step 201, step 202, step 203 and/or step 204-step 205 may be performed.
- Step 202 in response to the editing operation on the first track in the background music editing interface, adjust the playing time period of the background music.
- adjusting the playing time period of the background music in response to the editing operation of the first track in the editing interface of the background music may include: responding to the track adjustment of the first track in the editing interface of the background music
- the first drag operation of the block adjusts the length of the first track according to the drag position of the first drag operation, wherein the adjusted length of the first track is corresponding to the position where the track adjustment block is dragged by the first drag operation Length; adjust the playing time period of the background music according to the adjusted length of the first track.
- Step 203 in response to the editing operation on the second track in the editing interface of the background music, adjust the associated time period corresponding to the music-related material in the background music.
- adjusting the associated time period corresponding to the music-related material in the background music may include: responding to the editing operation in the editing interface of the background music
- the second drag operation of the track adjustment block of the second track adjusts the length of the second track according to the drag position of the second drag operation, wherein the adjusted length of the second track is that the track adjustment block is operated by the second drag operation
- the length corresponding to the dragged position adjust the associated time period of the music associated material in the background music according to the adjusted length of the second track.
- the user can lengthen or shorten the length of the first track 121, thereby realizing the adjustment of the playing time period of the background music. Adjust; and/or, the user can realize the elongation or shortening of the length of the second track by dragging the track adjustment block of any second track in the editing interface 10, and then realize the music related material in the background The adjustment of the corresponding associated time period in the music.
- the second track of the sticker is selected, and the length of the track can be adjusted by adjusting the track adjustment blocks on the left and right sides of the track. The longest length of each second track is the same as that of the first track.
- the area 122 including multiple second tracks can be hidden or displayed.
- the track control button 123 can be triggered to hide the area 122;
- the area 122 can be displayed by triggering the track control button 123 .
- the method for generating the special effect configuration file in the embodiment of the present disclosure may further include: displaying the music association at the position corresponding to the association time period of the music association material on the first track of the background music in the editing interface of the background music The special effect ID of the material.
- the first track 511 is displayed in the display area 51 of the editing interface 50, and the special effect identification of the four music-related materials currently associated with the background music is shown on the first track 511, as shown in the figure.
- the four circles, respectively 1, 2, 3 and 4 represent different music-related materials through numbers.
- the special effect logo in the figure is only an example, and different music-related materials can also be distinguished by filling colors, shapes, and other methods.
- the associated time period of the initial state of the music-related material is the time period corresponding to the play count, and the length of the second track of the music-related material can only be shortened .
- the music-related material is a special effect material for which no trigger event is set among other special effect materials except background music, and the trigger event is one of the display states corresponding to the special effect material.
- Step 204 in response to the trigger operation of the music-associated button in the editing interface of any special effect material except the background music, displaying the music editing component in the editing interface of the background music.
- the user can trigger the editing operation of the background music by triggering the music-associated button “follow music” in the display area 31, and then the background music editing interface 50 shown in FIG. 7 can be displayed.
- multiple editing components are also displayed in the display area 31 , such as adding stickers, transparency, adding animation, adding triggers and copying, etc. in the figure. Users can adjust the status of stickers by triggering operations on the edit component of stickers.
- the style of the sticker changes with editing, and the sticker can also include function buttons around the sticker, such as the delete button in the upper left corner of the sticker in the figure, the mirror image button in the lower left corner of the sticker, and the refresh button in the lower right corner of the sticker Keys, etc., are examples only.
- a layer button 331 is displayed in the display area 33 of the editing interface 30 , and the user can display or hide the layer list by triggering the layer button 331 .
- other function buttons are also displayed in the display area 33 , such as the scale setting button and the refresh button in the figure, and the figure is only an example.
- Step 205 in response to the trigger operation on the music editing component, perform an editing operation corresponding to the music editing component on the background music.
- the editing operation includes at least one of volume adjustment, fading effect setting, deletion operation and replacement operation.
- volume editing components are displayed in the display area 51 of the editing interface 50 , including the volume component, fading component, deleting component and replacing component in the figure.
- the user can respectively realize the editing of the playing status such as adjusting the volume of the background music, setting the fading effect, deleting and replacing.
- Step 206 In response to the instruction for generating the special effect configuration file, generate a special effect configuration file including background music and music-related materials according to the first track and the second track.
- Step 206 can be executed after step 202 , step 203 or step 205 .
- the special effects configuration file is used to configure the special effects of the original video during the process of shooting the video, so that background music and music-related materials are added to the original video to generate the target video of the shooting output; during the display process of the target video, The background music is played according to the playing time period, and the music-related material is rendered and displayed when the background music is played to the associated time period of the music-related material.
- the method for generating a special effect configuration file in the embodiment of the present disclosure may further include: performing a playback control operation on the background music in response to a trigger operation on the playback control button of the background music, where the playback control operation is a playback operation or a pause operation .
- the playback control operation is a playback operation or a pause operation .
- This solution can optimize the creation experience of special effect configuration files.
- it is convenient to manage creative materials, reduce the cost of understanding, shorten the creation time, and stimulate the output of special effect configuration files to a certain extent.
- it can enrich the ability of authoring tools to produce special effect configuration files that can add background music.
- the solution for generating the special effect configuration file responds to the editing trigger operation of the background music, and displays a track list in the editing interface of the background music, wherein the track list includes the first track of the background music and music-related materials in response to the editing operation of the first track in the background music editing interface, adjust the playing time period of the background music, and/or, in response to the editing operation of the second track in the background music editing interface , adjust the associated time period corresponding to the music-related material in the background music; in response to the generation instruction of the special effect configuration file, generate a special effect configuration file including the background music and the music-related material according to the first track and the second track; wherein, the special effect configuration file It is used to configure special effects on the original video during the shooting process, so that background music and music-related materials are added to the original video to generate the target video for shooting output; during the display process of the target video, the background music is played according to the playing time segment, and render and display the music-related material when the background music is played to
- FIG. 8 is a schematic structural diagram of an apparatus for generating a special effect configuration file provided by an embodiment of the present disclosure.
- the apparatus may be implemented by software and/or hardware, and may generally be integrated into an electronic device.
- the device includes: an editing trigger module 301 , an editing module 302 and a file generating module 303 .
- the editing trigger module 301 is configured to display a track list in the editing interface of the background music in response to an editing trigger operation on the background music, wherein the track list includes the first track of the background music and music related materials of the second track.
- the editing module 302 is configured to adjust the playing time period of the background music in response to the editing operation of the first track in the editing interface of the background music, and/or, in response to the editing of the background music
- the editing operation on the second track in the interface adjusts the associated time period corresponding to the music-related material in the background music.
- the file generation module 303 is configured to generate a special effect configuration file including the background music and the music-related material according to the first track and the second track in response to a generation instruction of the special effect configuration file.
- the special effect configuration file is used to configure special effects on the original video during the process of shooting the video, so that the background music and the music-related material are added to the original video to generate a target video for shooting output;
- the background music is played according to the playing time period, and the music-related material is rendered and displayed when the background music is played to a time period associated with the music-related material.
- the length of the first track in the track list corresponds to the playing time period of the background music
- the length of the second track corresponds to the associated time period of the music-related material
- the music-related The number of materials is one or more.
- the editing module 302 is specifically configured to: respond to a first drag operation on the track adjustment block of the first track in the editing interface of the background music, according to the first drag operation dragging the position to adjust the length of the first track, wherein the adjusted length of the first track is the length corresponding to the position where the track adjustment block is dragged by the first drag operation; and according to the first track
- the adjusted length of a track adjusts the playing time period of the background music.
- the editing module 302 is specifically configured to: respond to a second drag operation on the track adjustment block of the second track in the background music editing interface, according to the second drag operation dragging the position to adjust the length of the second track, wherein the adjusted length of the second track is the length corresponding to the position where the track adjustment block is dragged by the second drag operation; and according to the second track
- the adjusted length of the two tracks adjusts the corresponding associated time period of the music-related material in the background music.
- the device further includes an identification module, configured to: on the first track of the background music in the editing interface of the background music, display the location corresponding to the associated time period of the music-related material.
- the special effect identifier of the music-related material is configured to: on the first track of the background music in the editing interface of the background music, display the location corresponding to the associated time period of the music-related material. The special effect identifier of the music-related material.
- the associated time period of the initial state of the music-related material is the time period corresponding to the play count, and the music-related material’s
- the length of the second track only supports shortening.
- the music-related material is a special effect material for which a trigger event is not set among other special effect materials except the background music, and the trigger event is one of the display states corresponding to the special effect material.
- the editing trigger module is specifically configured to: when an operation of adding the background music is detected, or an operation of selecting a music layer corresponding to the background music in the layer list is received, the The edit trigger operation of the background music described above.
- different layers in the layer list are used to indicate different special effect materials, and the rendering hierarchy order of the special effect materials of each layer in the layer list is the same as Similarly, the sorting position of the music layer in the layer list is first.
- an editing component module configured to: respond to the trigger operation of the music-associated button in the editing interface of any special effect material other than the background music, in the editing interface of the background music displaying a music editing component; and in response to a trigger operation on the music editing component, performing editing operations corresponding to the music editing component on the background music, the editing operations including volume adjustment, fading effect setting, and deletion operations and at least one of replace operations.
- the device further includes a playback control module, configured to: perform a playback control operation on the background music in response to a trigger operation on the playback control button of the background music, and the playback control operation is a playback operation or Suspend operation.
- a playback control module configured to: perform a playback control operation on the background music in response to a trigger operation on the playback control button of the background music, and the playback control operation is a playback operation or Suspend operation.
- An embodiment of the present disclosure further provides a computer program product, including a computer program/instruction, and when the computer program/instruction is executed by a processor, the method for generating a special effect configuration file provided in any embodiment of the present disclosure is implemented.
- FIG. 9 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Referring to FIG. 9 in detail below, it shows a schematic structural diagram of an electronic device 400 suitable for implementing an embodiment of the present disclosure.
- the electronic device 400 in the embodiment of the present disclosure may include, but is not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), vehicle-mounted terminals ( Mobile terminals such as car navigation terminals) and stationary terminals such as digital TVs, desktop computers and the like.
- the electronic device shown in FIG. 9 is only an example, and should not limit the functions and application scope of the embodiments of the present disclosure.
- an electronic device 400 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 401, which may be randomly accessed according to a program stored in a read-only memory (ROM) 402 or loaded from a storage device 408.
- a processing device such as a central processing unit, a graphics processing unit, etc.
- RAM read-only memory
- various appropriate actions and processes are executed by programs in the memory (RAM) 403 .
- RAM 403 In the RAM 403, various programs and data necessary for the operation of the electronic device 400 are also stored.
- the processing device 401, the ROM 402, and the RAM 403 are connected to each other through a bus 404.
- An input/output (I/O) interface 405 is also connected to bus 404 .
- the following devices can be connected to the I/O interface 405: input devices 406 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speaker, vibration an output device 407 such as a computer; a storage device 408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 409.
- the communication means 409 may allow the electronic device 400 to perform wireless or wired communication with other devices to exchange data. While FIG. 9 shows electronic device 400 having various means, it is to be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.
- embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, where the computer program includes program code for executing the method shown in the flowchart.
- the computer program may be downloaded and installed from a network via communication means 409, or from storage means 408, or from ROM 402.
- the processing device 401 When the computer program is executed by the processing device 401, the above-mentioned functions defined in the method for generating a special effect configuration file in the embodiment of the present disclosure are executed.
- the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two.
- a computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
- a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
- a computer-readable signal medium may include a data signal in baseband or propagated as part of a carrier wave carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
- a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device .
- Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
- the client and the server can communicate using any currently known or future network protocols such as HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), and can communicate with digital data in any form or medium
- HTTP HyperText Transfer Protocol
- the communication eg, communication network
- Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network of.
- the above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being incorporated into the electronic device.
- the above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device: in response to an editing trigger operation on the background music, on the editing interface of the background music A track list is displayed in , wherein the track list includes the first track of the background music and the second track of the music-related material; in response to an editing operation on the first track in the editing interface of the background music , adjust the playing time period of the background music, and/or, in response to the editing operation on the second track in the editing interface of the background music, adjust the corresponding time period of the music-related material in the background music Associated time period; in response to the generation instruction of the special effect configuration file, a special effect configuration file including the background music and the music-related material is generated according to the first track and the second track; wherein, the special effect configuration file uses In the process of shooting a video, the original video is configured with special effects, so that the background music and the music-related material are added on the original video to
- Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, or combinations thereof, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages - such as the "C" language or similar programming languages.
- the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).
- LAN local area network
- WAN wide area network
- Internet service provider such as AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
- each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions.
- the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved.
- each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.
- the units involved in the embodiments described in the present disclosure may be implemented by software or by hardware. Wherein, the name of a unit does not constitute a limitation of the unit itself under certain circumstances.
- FPGAs Field Programmable Gate Arrays
- ASICs Application Specific Integrated Circuits
- ASSPs Application Specific Standard Products
- SOCs System on Chips
- CPLD Complex Programmable Logical device
- a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device.
- a machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
- a machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing.
- machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
- RAM random access memory
- ROM read only memory
- EPROM or flash memory erasable programmable read only memory
- CD-ROM compact disk read only memory
- magnetic storage or any suitable combination of the foregoing.
- the present disclosure provides a method for generating a special effect configuration file, including: displaying a track list in the editing interface of the background music in response to an editing trigger operation on the background music, wherein , the track list includes the first track of the background music and the second track of the music-related material; in response to an editing operation on the first track in the editing interface of the background music, adjust the background music and/or, in response to the editing operation on the second track in the editing interface of the background music, adjust the associated time period corresponding to the music-related material in the background music; and respond Based on the generation instruction of the special effect configuration file, a special effect configuration file including the background music and the music-related material is generated according to the first track and the second track; wherein, the special effect configuration file is used when shooting a video In the process, the original video is configured with special effects, so that the background music and the music-related material are added to the original video to generate a target video for shooting and output; during the display process of the target video, the
- the length of the first track in the track list corresponds to the playing time period of the background music
- the length of the second The length of the track corresponds to the associated time period of the music-related material
- the number of the music-related material is one or more.
- adjust the The playing time period in response to an editing operation on the first track in the editing interface of the background music, adjust the The playing time period includes: responding to the first drag operation on the track adjustment block of the first track in the editing interface of the background music, adjusting the second track according to the drag position of the first drag operation.
- the length of a track, wherein the adjusted length of the first track is the length corresponding to the position where the track adjustment block is dragged by the first drag operation; and adjusted according to the adjusted length of the first track The playing time period of the background music.
- the music-related material is adjusted in response to an editing operation on the second track in the editing interface of the background music
- the corresponding associated time period in the background music includes: responding to the second drag operation of the track adjustment block of the second track in the editing interface of the background music, according to the second drag operation
- the drag position adjusts the length of the second track, wherein the adjusted length of the second track is the length corresponding to the position where the track adjustment block is dragged by the second drag operation; and according to the The adjusted length of the second track adjusts the corresponding associated time period of the music-related material in the background music.
- the method for generating a special effect configuration file provided in the present disclosure further includes: on the first track of the background music in the editing interface of the background music, associate with the music The special effect identification of the music-related material is displayed at the position corresponding to the associated time period of the material.
- the association of the initial state of the music-related material is the time period corresponding to the playing times, and the length of the second track of the music-related material can only be shortened.
- the music-related material is a special effect material that does not set a trigger event among other special effect materials except the background music, so The above trigger event is one of the display states corresponding to the special effect material.
- the triggering operation for editing the background music includes: when an adding operation to the background music is detected, or in the layer list If the selection operation of the music layer corresponding to the background music is selected, an editing trigger operation of the background music is received.
- different layers in the layer list are used to indicate different special effect materials, and each layer in the layer list
- the rendering hierarchy order of the special effect material is the same as that of each layer in the layer list, and the sort position of the music layer in the layer list is the first.
- the method for generating a special effect configuration file further includes: responding to the music-associated key in the editing interface of any special effect material except the background music triggering an operation to display a music editing component in the editing interface of the background music; and in response to the triggering operation on the music editing component, performing an editing operation corresponding to the music editing component on the background music, the editing The operation includes at least one of volume adjustment, fading effect setting, deletion operation and replacement operation.
- the method for generating a special effect configuration file provided in the present disclosure further includes: performing a playback control operation on the background music in response to a trigger operation on the playback control button of the background music , the play control operation is a play operation or a pause operation.
- the present disclosure provides an apparatus for generating a special effect configuration file, including: an editing trigger module, configured to respond to an editing trigger operation on the background music, on the editing interface of the background music
- a track list is displayed in the track list, wherein the track list includes the first track of the background music and the second track of the music-related material
- the editing module is configured to respond to the editing of the second track in the editing interface of the background music
- the editing operation of a track adjusts the playing time period of the background music, and/or, in response to the editing operation of the second track in the editing interface of the background music, adjusting the music-related material in the Corresponding associated time periods in the background music
- a file generation module configured to generate a file including the background music and the music-associated material according to the first track and the second track in response to the generation instruction of the special effect configuration file Special effects configuration file; wherein, the special effects configuration file is used to configure special effects on the original video during the process of shooting the video, so that the background music and the
- the length of the first track in the track list corresponds to the playing time period of the background music
- the length of the second The length of the track corresponds to the associated time period of the music-related material
- the number of the music-related material is one or more.
- the editing module is specifically configured to: respond to the track of the first track in the editing interface of the background music Adjust the first drag operation of the block, adjust the length of the first track according to the drag position of the first drag operation, wherein the adjusted length of the first track is the track adjustment block by the the length corresponding to the position dragged by the first drag operation; and adjusting the playing time period of the background music according to the adjusted length of the first track.
- the editing module is specifically configured to: respond to the track of the second track in the editing interface of the background music Adjust the second drag operation of the block, adjust the length of the second track according to the drag position of the second drag operation, wherein the adjusted length of the second track is the track adjustment block by the the length corresponding to the position dragged by the second drag operation; and adjusting the associated time period corresponding to the music-related material in the background music according to the adjusted length of the second track.
- the device further includes an identification module configured to: On the track, the special effect identification of the music-related material is displayed at a position corresponding to the associated time period of the music-related material.
- the device for generating a special effect configuration file provided by the present disclosure, when the music-related material is a special effect material with a play count already set, the association of the initial state of the music-related material
- the time period is the time period corresponding to the playing times, and the length of the second track of the music-related material can only be shortened.
- the music-related material is a special effect material that does not set a trigger event among other special effect materials except the background music, so The above trigger event is one of the display states corresponding to the special effect material.
- the editing trigger module is specifically configured to: when an operation of adding the background music is detected, or in the layer list A selection operation on the music layer corresponding to the background music receives an editing trigger operation on the background music.
- the device for generating special effect configuration files provided in the present disclosure, different layers in the layer list are used to indicate different special effect materials, and each layer in the layer list
- the rendering hierarchy order of the special effect material is the same as that of each layer in the layer list, and the sort position of the music layer in the layer list is the first.
- the device for generating a special effect configuration file further includes an editing component module, configured to: respond to any special effect material except the background music
- a trigger operation on the music-associated button in the editing interface displays a music editing component in the editing interface of the background music;
- a corresponding editing operation the editing operation includes at least one of volume adjustment, fading effect setting, deletion operation and replacement operation.
- the device further includes a playback control module, configured to: respond to the trigger operation of the playback control button of the background music, A play control operation is performed on the background music, and the play control operation is a play operation or a pause operation.
- the present disclosure provides an electronic device, including: a processor; and a memory for storing instructions executable by the processor; The executable instruction is read in, and the instruction is executed to implement any method for generating a special effect configuration file as provided in the present disclosure.
- the present disclosure provides a computer-readable storage medium, the storage medium stores a computer program, and the computer program is used to execute any one of the special effects provided by the present disclosure How to generate configuration files.
- the present disclosure provides a computer program, including: instructions, which when executed by a processor cause the processor to perform any one of the special effects provided by the present disclosure How to generate configuration files.
- the present disclosure provides a computer program product comprising instructions which, when executed by a processor, cause the processor to perform any one of the special effects described in the present disclosure. How to generate configuration files.
Abstract
Description
Claims (16)
- 一种特效配置文件的生成方法,包括:响应于对背景音乐的编辑触发操作,在所述背景音乐的编辑界面中展示轨道列表,其中,所述轨道列表中包括所述背景音乐的第一轨道以及音乐关联素材的第二轨道;响应于在所述背景音乐的编辑界面中对所述第一轨道的编辑操作,调整所述背景音乐的播放时间段,和/或,响应于在所述背景音乐的编辑界面中对所述第二轨道的编辑操作,调整所述音乐关联素材在所述背景音乐中对应的关联时间段;和响应于特效配置文件的生成指令,按照所述第一轨道和所述第二轨道生成包括所述背景音乐和所述音乐关联素材的特效配置文件;其中,所述特效配置文件用于在拍摄视频的过程中对原始视频进行特效配置,以使得,在所述原始视频上添加所述背景音乐和所述音乐关联素材,生成拍摄输出的目标视频;在所述目标视频的展示过程中,所述背景音乐按照所述播放时间段进行播放,并在所述背景音乐播放至所述音乐关联素材的关联时间段时渲染展示所述音乐关联素材。
- 根据权利要求1所述的方法,其中,所述轨道列表中所述第一轨道的长度与所述背景音乐的播放时间段对应,所述第二轨道的长度与所述音乐关联素材的关联时间段对应,所述音乐关联素材的数量为一个或多个。
- 根据权利要求2所述的方法,其中,响应于在所述背景音乐的编辑界面中对所述第一轨道的编辑操作,调整所述背景音乐的播放时间段,包括:响应于在所述背景音乐的编辑界面中对所述第一轨道的轨道调整块的第一拖动操作,按照所述第一拖动操作的拖动位置调整所述第一轨道的长度,其中,所述第一轨道调整后的长度为所述轨道调整块被所述第一拖动操作拖到的位置对应的长度;和根据所述第一轨道调整后的长度调整所述背景音乐的播放时间段。
- 根据权利要求2所述的方法,其中,响应于在所述背景音乐的编辑界面中对所述第二轨道的编辑操作,调整所述音乐关联素材在所述背景音乐中对应的关联时间段,包括:响应于在所述背景音乐的编辑界面中对所述第二轨道的轨道调整块的第二拖动操作,按照所述第二拖动操作的拖动位置调整所述第二轨道的长度,其中,所述第二轨道调整后的长度为所述轨道调整块被所述第二拖动操作拖到的位置对应的长度;和根据所述第二轨道调整后的长度调整所述音乐关联素材在所述背景音乐中对应的关联时间段。
- 根据权利要求1所述的方法,还包括:在所述背景音乐的编辑界面的所述背景音乐的第一轨道上,与所述音乐关联素材的关联时间段对应的位置处展示所述音乐关联素材的特效标识。
- 根据权利要求1所述的方法,其中,当所述音乐关联素材为已经设置有播放次数的特效素材时,所述音乐关联素材的初始状态的关联时间段为所述播放次数对应的时间段,并且所述音乐关联素材的第二轨道的长度仅支持缩短。
- 根据权利要求1所述的方法,其中,所述音乐关联素材为除所述背景音乐之外的其他特效素材中未设置触发事件的特效素材,所述触发事件为特效素材对应的显示状态中的一种。
- 根据权利要求1所述的方法,其中,对背景音乐的编辑触发操作,包括:当检测到对所述背景音乐的添加操作,或者在图层列表中对所述背景音乐对应的音乐图层的选中操作,则接收到对所述背景音乐的编辑触发操作。
- 根据权利要求8所述的方法,其中,所述图层列表中不同的图层用于指示不同的特效素材,所述图层列表中各图层的特效素材的渲染层级顺序与所述图层列表中各图层的排序相同,所述音乐图层在所述图层列表中的排序位置为首位。
- 根据权利要求1所述的方法,还包括:响应于在除所述背景音乐之外的任意一个特效素材的编辑界面中对音乐关联按键的触发操作,在所述背景音乐的编辑界面中展示音乐编辑组件;和响应于对所述音乐编辑组件的触发操作,对所述背景音乐执行与所述音乐编辑组 件对应的编辑操作,所述编辑操作包括音量调整、淡化效果设置、删除操作和替换操作中的至少一个。
- 根据权利要求1所述的方法,还包括:响应于对所述背景音乐的播放控制按键的触发操作,对所述背景音乐执行播放控制操作,所述播放控制操作为播放操作或暂停操作。
- 一种特效配置文件的生成装置,包括:编辑触发模块,用于响应于对背景音乐的编辑触发操作,在所述背景音乐的编辑界面中展示轨道列表,其中,所述轨道列表中包括所述背景音乐的第一轨道以及音乐关联素材的第二轨道;编辑模块,用于响应于在所述背景音乐的编辑界面中对所述第一轨道的编辑操作,调整所述背景音乐的播放时间段,和/或,响应于在所述背景音乐的编辑界面中对所述第二轨道的编辑操作,调整所述音乐关联素材在所述背景音乐中对应的关联时间段;和文件生成模块,用于响应于特效配置文件的生成指令,按照所述第一轨道和所述第二轨道生成包括所述背景音乐和所述音乐关联素材的特效配置文件;其中,所述特效配置文件用于在拍摄视频的过程中对原始视频进行特效配置,以使得,在所述原始视频上添加所述背景音乐和所述音乐关联素材,生成拍摄输出的目标视频;在所述目标视频的展示过程中,所述背景音乐按照所述播放时间段进行播放,并在所述背景音乐播放至所述音乐关联素材的关联时间段时渲染展示所述音乐关联素材。
- 一种电子设备,包括:处理器;和用于存储所述处理器可执行指令的存储器;所述处理器,用于从所述存储器中读取所述可执行指令,并执行所述指令以实现所述权利要求1-11中任一所述的特效配置文件的生成方法。
- 一种计算机可读存储介质,所述存储介质存储有计算机程序,所述计算机程 序用于执行所述权利要求1-11中任一所述的特效配置文件的生成方法。
- 一种计算机程序,包括:指令,所述指令当由处理器执行时使所述处理器执行根据权利要求1-11中任一项所述的特效配置文件的生成方法。
- 一种计算机程序产品,包括指令,所述指令当由处理器执行时使所述处理器执行根据权利要求1-11中任一项所述的特效配置文件的生成方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP22814963.9A EP4336820A1 (en) | 2021-06-03 | 2022-05-07 | Method and apparatus for generating special effect configuration file, device and medium |
US18/526,647 US20240103711A1 (en) | 2021-06-03 | 2023-12-01 | Method and apparatus for generating effect configuration file, device and medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110621032.3 | 2021-06-03 | ||
CN202110621032.3A CN115442639B (zh) | 2021-06-03 | 2021-06-03 | 一种特效配置文件的生成方法、装置、设备及介质 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/526,647 Continuation US20240103711A1 (en) | 2021-06-03 | 2023-12-01 | Method and apparatus for generating effect configuration file, device and medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022252916A1 true WO2022252916A1 (zh) | 2022-12-08 |
Family
ID=84239940
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/091385 WO2022252916A1 (zh) | 2021-06-03 | 2022-05-07 | 特效配置文件的生成方法、装置、设备及介质 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20240103711A1 (zh) |
EP (1) | EP4336820A1 (zh) |
CN (1) | CN115442639B (zh) |
WO (1) | WO2022252916A1 (zh) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101840722A (zh) * | 2009-03-18 | 2010-09-22 | 美商原创分享控股集团有限公司 | 线上影音编辑处理方法、装置及系统 |
JP2011082689A (ja) * | 2009-10-05 | 2011-04-21 | Kawai Musical Instr Mfg Co Ltd | 動画作成装置、コンピュータプログラム及び記憶媒体 |
CN111277761A (zh) * | 2020-03-05 | 2020-06-12 | 北京达佳互联信息技术有限公司 | 视频拍摄方法、装置、系统、电子设备和存储介质 |
CN111835986A (zh) * | 2020-07-09 | 2020-10-27 | 腾讯科技(深圳)有限公司 | 视频编辑处理方法、装置及电子设备 |
CN112004031A (zh) * | 2020-07-31 | 2020-11-27 | 北京完美知识科技有限公司 | 视频生成方法、装置及设备 |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102572301B (zh) * | 2010-12-31 | 2016-08-24 | 新奥特(北京)视频技术有限公司 | 一种以桌面为中心的节目编辑系统 |
CA2970480A1 (en) * | 2014-10-22 | 2016-04-28 | Cser Ventures, LLC | System for generating an output file |
US10402062B2 (en) * | 2016-04-16 | 2019-09-03 | Apple Inc. | Organized timeline |
WO2019123213A1 (en) * | 2017-12-18 | 2019-06-27 | Koppasoft | Display rendering method and system |
CN108536790A (zh) * | 2018-03-30 | 2018-09-14 | 北京市商汤科技开发有限公司 | 声音特效程序文件包的生成及声音特效生成方法与装置 |
CN108958610A (zh) * | 2018-07-27 | 2018-12-07 | 北京微播视界科技有限公司 | 基于人脸的特效生成方法、装置和电子设备 |
JP2020178161A (ja) * | 2019-04-15 | 2020-10-29 | キヤノン株式会社 | 画像処理装置、画像処理方法、及びプログラム |
CN112822563A (zh) * | 2019-11-15 | 2021-05-18 | 北京字节跳动网络技术有限公司 | 生成视频的方法、装置、电子设备和计算机可读介质 |
US11875781B2 (en) * | 2020-08-31 | 2024-01-16 | Adobe Inc. | Audio-based media edit point selection |
CN112287128B (zh) * | 2020-10-23 | 2024-01-12 | 北京百度网讯科技有限公司 | 多媒体文件编辑方法、装置、电子设备和存储介质 |
-
2021
- 2021-06-03 CN CN202110621032.3A patent/CN115442639B/zh active Active
-
2022
- 2022-05-07 WO PCT/CN2022/091385 patent/WO2022252916A1/zh active Application Filing
- 2022-05-07 EP EP22814963.9A patent/EP4336820A1/en active Pending
-
2023
- 2023-12-01 US US18/526,647 patent/US20240103711A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101840722A (zh) * | 2009-03-18 | 2010-09-22 | 美商原创分享控股集团有限公司 | 线上影音编辑处理方法、装置及系统 |
JP2011082689A (ja) * | 2009-10-05 | 2011-04-21 | Kawai Musical Instr Mfg Co Ltd | 動画作成装置、コンピュータプログラム及び記憶媒体 |
CN111277761A (zh) * | 2020-03-05 | 2020-06-12 | 北京达佳互联信息技术有限公司 | 视频拍摄方法、装置、系统、电子设备和存储介质 |
CN111835986A (zh) * | 2020-07-09 | 2020-10-27 | 腾讯科技(深圳)有限公司 | 视频编辑处理方法、装置及电子设备 |
CN112004031A (zh) * | 2020-07-31 | 2020-11-27 | 北京完美知识科技有限公司 | 视频生成方法、装置及设备 |
Also Published As
Publication number | Publication date |
---|---|
US20240103711A1 (en) | 2024-03-28 |
CN115442639B (zh) | 2024-01-16 |
EP4336820A1 (en) | 2024-03-13 |
CN115442639A (zh) | 2022-12-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7387891B2 (ja) | 動画ファイルの生成方法、装置、端末及び記憶媒体 | |
WO2022048478A1 (zh) | 多媒体数据的处理方法、生成方法及相关设备 | |
CN112911379B (zh) | 视频生成方法、装置、电子设备和存储介质 | |
CN113365134B (zh) | 音频分享方法、装置、设备及介质 | |
WO2022228118A1 (zh) | 互动内容生成方法、装置、存储介质及电子设备 | |
CN111970571B (zh) | 视频制作方法、装置、设备及存储介质 | |
EP4343514A1 (en) | Display method and apparatus, and device and storage medium | |
WO2020220773A1 (zh) | 图片预览信息的显示方法、装置、电子设备及计算机可读存储介质 | |
JP7293338B2 (ja) | ビデオ処理方法、装置、デバイスおよびコンピュータプログラム | |
CN113806306B (zh) | 媒体文件处理方法、装置、设备、可读存储介质及产品 | |
WO2023051293A1 (zh) | 一种音频处理方法、装置、电子设备和存储介质 | |
CN112000267A (zh) | 信息显示方法、装置、设备及存储介质 | |
CN114584716A (zh) | 图片处理方法、装置、设备及存储介质 | |
JP2023525091A (ja) | 画像特殊効果の設定方法、画像識別方法、装置および電子機器 | |
WO2024037491A1 (zh) | 媒体内容处理方法、装置、设备及存储介质 | |
WO2022228362A1 (zh) | 一种特效配置文件的生成方法、装置、设备及介质 | |
WO2022252916A1 (zh) | 特效配置文件的生成方法、装置、设备及介质 | |
CN115309317A (zh) | 媒体内容获取方法、装置、设备、可读存储介质及产品 | |
WO2024046484A1 (zh) | 视频生成方法、装置、设备、存储介质和程序产品 | |
WO2023109813A1 (zh) | 视频生成方法、装置、电子设备和存储介质 | |
JP7277635B2 (ja) | イメージに対する音声合成に基づいて映像コンテンツを生成する方法およびシステム | |
WO2024082948A1 (zh) | 多媒体数据处理方法、装置、设备及介质 | |
CN116366918A (zh) | 媒体内容生成方法、装置、设备、可读存储介质及产品 | |
CN117059121A (zh) | 音频处理方法、装置、设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22814963 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023574511 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022814963 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2022814963 Country of ref document: EP Effective date: 20231204 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |