WO2026026950A1 - 媒体编辑方法、装置、设备和存储介质 - Google Patents

媒体编辑方法、装置、设备和存储介质

Info

Publication number
WO2026026950A1
WO2026026950A1 PCT/CN2025/112128 CN2025112128W WO2026026950A1 WO 2026026950 A1 WO2026026950 A1 WO 2026026950A1 CN 2025112128 W CN2025112128 W CN 2025112128W WO 2026026950 A1 WO2026026950 A1 WO 2026026950A1
Authority
WO
WIPO (PCT)
Prior art keywords
music
media content
target
electronic device
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2025/112128
Other languages
English (en)
French (fr)
Inventor
刘烨
王晓婵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Publication of WO2026026950A1 publication Critical patent/WO2026026950A1/zh
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • H04N21/8113—Monomedia components thereof involving special audio data, e.g. different tracks for different languages comprising music, e.g. song in MP3 format
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G10H1/0025—Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/005—Non-interactive screen display of musical or status data
    • G10H2220/011—Lyrics displays, e.g. for karaoke applications

Definitions

  • the exemplary embodiments disclosed herein generally relate to the field of computers, and more particularly to media editing methods, apparatus, devices, and computer-readable storage media.
  • a media editing method includes: presenting a music generation entry point in a creation interface; presenting a music configuration window in response to selection of the music generation entry point; generating target music based on a music generation request obtained via the music configuration window; and associating the target music with media content associated with the creation interface.
  • an apparatus for media editing includes: a presentation module configured to present a music generation entry point in a creation interface; a processing module configured to present a music configuration window in response to a selection of the music generation entry point; a generation module configured to generate target music based on a music generation request obtained via the music configuration window; and an association module configured to associate the target music with media content associated with the creation interface.
  • an electronic device in a third aspect of this disclosure, includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.
  • a computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.
  • a computer program product includes computer-executable instructions that, when executed by a processor, implement the method of the first aspect.
  • Figure 6 shows a schematic structural block diagram of an example device for media editing according to some embodiments of the present disclosure.
  • the term “comprising” and similar terms should be understood as open-ended inclusion, i.e., “including but not limited to”.
  • the term “based on” should be understood as “at least partially based on”.
  • the term “one embodiment” or “the embodiment” should be understood as “at least one embodiment”.
  • the term “some embodiments” should be understood as “at least some embodiments”.
  • Other explicit and implicit definitions may also be included below.
  • the terms “first”, “second”, etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.
  • the embodiments of this disclosure may involve user data, data acquisition, and/or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and/or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.
  • any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon.
  • a user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.
  • Embodiments of this disclosure propose a media editing scheme.
  • a music generation entry point can be presented in the creation interface;
  • a music configuration window can be presented in response to the selection of the music generation entry point;
  • a target music can be generated based on a music generation request obtained through the music configuration window; and the target music can be associated with media content associated with the creation interface.
  • embodiments of this disclosure can provide an entry point for generating music content within the creation interface, and obtain a music generation request through the music configuration window corresponding to the entry point, thereby generating target music based on the music generation request.
  • the target music can be associated with media content associated with the creation interface. Therefore, embodiments of this disclosure can provide users with the ability to generate music based on configuration operations, meeting users' needs for configuring music and improving the user experience.
  • Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented.
  • the example environment 100 may include an electronic device 110.
  • electronic device 110 may run an application 120 that supports user interface interaction.
  • Application 120 may be any suitable type of application for user interface interaction, and examples may include, but are not limited to, video applications, social applications, or other suitable applications.
  • User 140 may interact with application 120 via electronic device 110 and/or its attached devices.
  • electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.
  • electronic device 110 communicates with server 130 to provide services to application 120.
  • Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR/AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio/video players, digital cameras/camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof.
  • electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).
  • Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms.
  • Server 130 may include, for example, computing systems/servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc.
  • Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.
  • a communication connection can be established between server 130 and electronic device 110.
  • This communication connection can be established via wired or wireless means.
  • the communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect.
  • server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.
  • FIGS 2A to 2E illustrate example interfaces 200A to 200E according to some embodiments of the present disclosure. Interfaces 200A to 200E may be provided, for example, by the electronic device 110 shown in Figure 1.
  • the electronic device 110 may present a shooting interface 200A.
  • the electronic device 110 may provide a shooting control 206 in the shooting interface 200A.
  • the electronic device 110 may acquire media content captured by the user based on the shooting control 206.
  • the electronic device may also provide an input control 207 in the shooting interface 200A to acquire media content uploaded by the user (e.g., media content previously captured by the user or stored media content).
  • the electronic device 110 may present media content captured by the user or media content input by the user in the creation interface 200A.
  • the media content may include video content, text and image content, or music content, etc.
  • the electronic device 110 may present a creation interface associated with the acquired media content. For example, after capturing a video via the shooting control 206, the electronic device 110 may present an editing interface (i.e., a creation interface) for the captured media content. As another example, after uploading media content via the input control 207, the electronic device 110 may present an editing interface (i.e., a creation interface) for the uploaded media content.
  • a creation interface i.e., a creation interface
  • the electronic device 110 may also provide a creation interface even without acquiring media content.
  • the electronic device 110 may receive a trigger on the music control 205 in the shooting interface shown in FIG2A and display the creation interface accordingly.
  • Figure 2B illustrates a creation interface 200B according to some embodiments of the present disclosure.
  • a creation interface 200B may be triggered by the selection of the music control 205 in the editing interface after media content has been acquired, or the creation interface 200B may be triggered by the selection of the music control 200 in the shooting interface 200A without any media content being acquired.
  • the electronic device 110 may present a music generation entry 210 in the creation interface 200B.
  • the electronic device 110 may also present preset music content in the creation interface 200B.
  • the electronic device 110 may present a music configuration window in response to receiving a trigger on the music generation entry 210.
  • the electronic device 110 may present a music configuration window 215 in the authoring interface 200C.
  • the electronic device 110 may obtain a music generation request in the music configuration window 215.
  • the music generation request may indicate a music parameter based on at least one music parameter.
  • the electronic device 110 may present multiple candidate music parameters 220 in the music configuration window.
  • the plurality of candidate music parameters 220 may include a plurality of preset parameter contents.
  • the contents of the plurality of preset parameters can be determined by those skilled in the art, and this disclosure does not limit the specific contents of the preset parameters.
  • the music generation request may indicate at least one music parameter associated with the media content.
  • multiple music candidate parameters may include candidate parameter content determined based on media content obtained from the creation interface 200C.
  • the electronic device 110 may receive selection of at least one music parameter from a plurality of candidate music parameters to determine at least one music parameter indicated by the music generation request.
  • multiple candidate music parameters indicate at least one attribute of the target music to be generated.
  • at least one attribute of the target music to be generated may include lyrics, musical style, melody, cover image description information, or related descriptive information. It should be noted that this is merely illustrative, and any attribute content associated with the target music can be included.
  • multiple candidate music parameters may be descriptive text. For example, candidate music parameters including the text "waves" may indicate that one or more of the lyrics, musical style, melody, cover image, etc., of the target music to be generated are associated with waves. For example, candidate music parameters including the text "jazz" may indicate that the musical style and melody of the target music to be generated are associated with "jazz.”
  • the process of determining multiple candidate music parameters based on media content may include: a first model generating descriptive information about the media content based on image content, text content, or audio content associated with the media content.
  • the first model may be implemented as an analytical model capable of analyzing media content.
  • the analysis model can generate descriptive information corresponding to the image, text, or audio content of media content. For instance, when media content contains images of ocean waves, the analysis model can generate descriptive information associated with the waves; or, when media content contains text about snow-capped mountains, the analysis model can generate descriptive information containing the snow-capped mountains. As another example, when media content contains audio content with dialogue, the analysis model can generate descriptive information associated with the dialogue.
  • the process of determining multiple candidate music parameters based on media content may further include: determining multiple candidate music parameters based on descriptive information.
  • the second model can determine multiple candidate music parameters based on descriptive information.
  • the second model can be implemented as a generative model capable of generating candidate music parameters based on descriptive information.
  • a generative model can determine multiple candidate music parameters based on descriptive information. For instance, if the descriptive information includes text related to "waves," the generative model can generate candidate music parameters containing the text "waves"; or, if the descriptive information includes text related to "jazz,” the generative model can generate candidate music parameters containing the text "jazz.”
  • the electronic device 110 may provide production controls 225 in a music configuration window 215. Further, the electronic device 110 may, in response to receiving a trigger (e.g., a click operation) on the production controls 225, present a production process for generating the target music.
  • a trigger e.g., a click operation
  • the third model can generate target music based on at least one music parameter indicated by the music generation request.
  • the third model can generate partial content (e.g., lyrics, arrangement, cover image, etc.) of the target music associated with at least one music parameter, and generate the target music based on this partial content.
  • the third model generates target music based on at least one music parameter.
  • the target music may directly contain the corresponding content of the at least one music parameter; or, the target music may contain content associated with the at least one music parameter.
  • the at least one music parameter includes the text "waves”
  • the lyrics of the target music generated by the third model may include, for example, "waves" or related terms such as "summer,” "seagull,” or “soothing mood.”
  • the third model can be multiple pre-defined models, each capable of generating lyrics, music arrangement, cover art, etc., or it can be a single, unified model.
  • this disclosure is not intended to limit the specific content or training process of the third model.
  • the music generation request may also indicate a prompt obtained via the music configuration window 215.
  • the electronic device 110 may also provide input controls (not shown) in the music configuration window 215. Further, the electronic device 110 may obtain prompts (e.g., prompt text, such as "jazz style") entered by the user in natural language based on the input controls.
  • prompts e.g., prompt text, such as "jazz style
  • the third model can also generate target music based on prompts.
  • FIGS 3A to 3C illustrate example interfaces 300A to 300C according to further embodiments of the present disclosure.
  • Interfaces 300A to 300C may, for example, be provided by the electronic device 110 shown in Figure 1.
  • the electronic device 110 may present a music configuration window 305 in the authoring interface 300A.
  • the electronic device 110 may obtain a music generation request in the music configuration window 305.
  • the music generation request may be based on audio content acquired via the music configuration window 315.
  • the electronic device 110 may provide a voice control 310 in the music configuration window 315 to obtain music content input by the user.
  • the electronic device 110 may, in response to receiving a first operation (e.g., a long press) of the user on the voice control 310 in the authoring interface 300B, invoke the recording component to obtain the voice content input by the user (e.g., record the audio content of the user humming).
  • a first operation e.g., a long press
  • the recording component e.g., record the audio content of the user humming
  • the electronic device 110 may, in response to receiving a first operation (e.g., release operation) from the user in the authoring interface 300C to end the first operation on the voice control 310, determine the voice content input by the user (i.e., the audio content from the start of the first operation to the end of the recording) as the audio content indicated by the music generation request.
  • a first operation e.g., release operation
  • the voice content input by the user i.e., the audio content from the start of the first operation to the end of the recording
  • the third model may also generate target music based on audio content acquired via the music configuration window 305.
  • the electronic device 110 may present the production process of generating target music based on a music generation request (e.g., preset music production animation effects) in the music configuration window 215.
  • a music generation request e.g., preset music production animation effects
  • the electronic device 110 may present a display interface 200E of the target music in response to the completion of target music production.
  • the electronic device 110 may provide a playback control 230 in the display interface 200E.
  • the electronic device 110 may use the playback control 230 to play the target music.
  • the electronic device 110 associates target music with media content associated with the creation interface.
  • the media content associated with the creation interface may include: media content associated with the creation interface before the target music is generated, or media content captured by the shooting component or uploaded by the user after the target music is generated.
  • associating target music with media content associated with the creation interface may include capturing the media content via a shooting component associated with the creation interface. Further, the target music may be associated with the captured media content.
  • the electronic device 110 may set the target music as background music for the media content. As an example, the electronic device 110 may provide a usage control 240 in the display interface 200E. As an example, the electronic device 110 may set the target music as background music for the media content in response to receiving a trigger (e.g., a click operation) on the usage control 240.
  • a trigger e.g., a click operation
  • the electronic device 110 may present media content containing target music in an editing interface 400A.
  • the electronic device 110 may provide an indicator element 405 in the editing interface 400A to indicate that the media content uses the target music as background music.
  • the electronic device 110 may update media content based on the target music.
  • updating media content based on target music may include: updating the background music of the media content to the target music, and displaying corresponding lyrics based on the playback progress of the target music while the media content is played using a player.
  • updating media content based on target music may also include adjusting the media content based on the target music. For example, adjusting or modifying the displayed content, audio content, or duration of the media content.
  • the electronic device 110 may release the target work in response to a release request for the target music.
  • electronic device 110 may update media content based on target music.
  • electronic device 110 may provide a music generation control 245 in display interface 200E. Further, electronic device 110 may publish the target work in response to receiving a trigger on the music generation control 245.
  • the electronic device 110 may also display a cover image 425 of the target music in a preview interface 400B.
  • the cover image 425 is generated based on the media content.
  • the cover image may also be generated based on at least one music parameter.
  • the electronic device 110 may provide a set of preset music parameters 415 in the preview interface 400B. Further, the electronic device 110 may update the target music based on the selection of a target music parameter from the set of preset music parameters. As an example, as shown in FIG4B, the set of preset music parameters 415 may be associated with multiple musical styles. Further, the electronic device 110 may adjust the theme (or style, genre, etc.) of the target music to folk based on the selection of a target music parameter (e.g., folk) from the set of preset music parameters 415, using a third model. As an example, the set of preset music parameters 415 may also be associated with descriptive information such as lyrics, cover image, and arrangement. The descriptive information may be, for example, short text. The electronic device 110 may use a third model to update the target music based on the selected descriptive information.
  • a target music parameter e.g., folk
  • the electronic device 110 may, in response to receiving a publishing request, present a playback interface 400C of the target work.
  • the electronic device 110 may provide a playback container 410 for the target music within the playback interface 400C for playing the target music.
  • the electronic device 110 may use the playback container 410 to play the target music and present the cover art and lyrics of the target music.
  • the electronic device 110 may present corresponding lyrics based on the playback progress of the target music.
  • the electronic device 110 may display identification information 420 in the playback interface 400C to indicate that the music content played in the playback interface 400C is target music generated based on media content.
  • the identification information 420 may be, for example, "XX Music”.
  • embodiments of this disclosure can generate music content based on at least one of the following: media content captured or selected by the user, prompts entered by the user, and/or hummed audio content, and preset parameters, thereby improving the quality of the generated music content.
  • embodiments of this disclosure provide users with a means to generate music content, meeting their needs for music content generation and improving the quality of published media content and user experience.
  • FIG. 5 shows a flowchart of an example process 500 for message processing according to some embodiments of the present disclosure.
  • Process 500 can be implemented at electronic device 110.
  • Process 500 will now be described with reference to Figure 1.
  • the electronic device 110 presents the music generation entry in the creation interface.
  • electronic device 110 presents a music configuration window in response to the selection of the music generation entry.
  • electronic device 110 generates target music based on a music generation request obtained via the music configuration window.
  • frame 540 electronic device 110 associates the target music with media content associated with the creation interface.
  • the music generation request indicates at least one music parameter associated with the media content.
  • process 500 further includes: presenting a plurality of candidate music parameters in a music configuration window, the plurality of candidate music parameters being determined based on media content; and receiving a selection of at least one of the plurality of candidate music parameters.
  • multiple candidate music parameters are determined by the following process: generating descriptive information of the media content based on image content, text content, or audio content associated with the media content; and determining multiple candidate music parameters based on the descriptive information.
  • multiple candidate music parameters indicate at least one attribute of the target music to be generated.
  • the music generation request also indicates at least one of the following: audio content acquired via the music configuration window; or a prompt obtained via the music configuration window.
  • process 500 further includes: presenting a preview interface of the target music, the preview interface including preview controls for the target music.
  • the preview interface also displays the cover art of the target music, which is generated based on the media content.
  • process 500 further includes: displaying a set of preset music parameters in a preview interface; and updating the target music based on the selection of a target music parameter from the set of preset music parameters.
  • associating target music with media content associated with the creation interface includes: setting the target music as background music for the media content; or updating the media content based on the target music.
  • process 500 further includes: publishing the target work in response to a publishing request for the target music, wherein the playback page of the target work provides a playback container for the target music.
  • process 500 further includes: presenting a creation interface in response to a preset operation received on the shooting interface of the media content; or presenting a creation interface in response to receiving an editing request for the media content.
  • associating target music with media content associated with the creation interface includes: capturing media content via a shooting component associated with the creation interface; and associating the target music with the captured media content.
  • FIG6 shows a schematic structural block diagram of an example apparatus 600 for message processing according to certain embodiments of this disclosure.
  • Apparatus 600 may be implemented as or included in electronic device 110.
  • the various modules/components in apparatus 600 may be implemented by hardware, software, firmware, or any combination thereof.
  • the device 600 includes a presentation module 610 configured to present a music generation entry in the creation interface; a processing module 620 configured to present a music configuration window in response to the selection of the music generation entry; a generation module 630 configured to generate target music based on the music generation request obtained through the music configuration window; and an association module 640 configured to associate the target music with media content associated with the creation interface.
  • the music generation request indicates at least one music parameter associated with the media content.
  • the apparatus 600 further includes a determining module configured to: present a plurality of candidate music parameters in a music configuration window, the plurality of candidate music parameters being determined based on media content; and receive a selection of at least one of the plurality of candidate music parameters.
  • multiple candidate music parameters are determined by the following process: generating descriptive information of the media content based on image content, text content, or audio content associated with the media content; and determining multiple candidate music parameters based on the descriptive information.
  • multiple candidate music parameters indicate at least one attribute of the target music to be generated.
  • the music generation request also indicates at least one of the following: audio content acquired via the music configuration window; or a prompt obtained via the music configuration window.
  • the device 600 further includes a preview module configured to present a preview interface of the target music, the preview interface including preview controls for the target music.
  • the preview interface also displays the cover art of the target music, which is generated based on the media content.
  • the device 600 further includes a parameter module configured to: display a set of preset music parameters in a preview interface; and update the target music based on the selection of a target music parameter from the set of preset music parameters.
  • the association module 640 is further configured to: set the target music as the background music of the media content; or update the media content based on the target music.
  • the device 600 further includes a publishing module configured to: publish the target work in response to a publishing request for the target music, wherein the playback page of the target work provides a playback container for the target music.
  • the device 600 further includes a creation module, which is configured to: present a creation interface in response to a preset operation received on the shooting interface of the media content; or present a creation interface in response to receiving an editing request for the media content.
  • a creation module which is configured to: present a creation interface in response to a preset operation received on the shooting interface of the media content; or present a creation interface in response to receiving an editing request for the media content.
  • the association module 640 is further configured to: capture media content via a shooting component associated with the creation interface; and associate target music with the captured media content.
  • Figure 7 shows a block diagram of an electronic device 700 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 700 shown in Figure 7 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device 700 shown in Figure 7 can be used to implement the electronic device 110 of Figure 1.
  • the electronic device 700 is in the form of a general-purpose electronic device.
  • Components of the electronic device 700 may include, but are not limited to, one or more processing units or processors 710, memory 720, storage devices 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760.
  • the processor 710 may be a physical or virtual processor and is capable of performing various processes according to the programs stored in the memory 720. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 700.
  • Electronic device 700 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 700, including but not limited to volatile and non-volatile media, removable and non-removable media.
  • Memory 720 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof.
  • Storage device 730 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and/or data and can be accessed within electronic device 700.
  • Electronic device 700 may further include additional removable/non-removable, volatile/non-volatile storage media.
  • disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided.
  • each drive may be connected to a bus (not shown) via one or more data media interfaces.
  • Memory 720 may include computer program product 725 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.
  • the communication unit 740 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 700 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 700 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.
  • PCs network personal computers
  • Input device 750 can be one or more input devices, such as a mouse, keyboard, trackball, etc.
  • Output device 760 can be one or more output devices, such as a monitor, speaker, printer, etc.
  • Electronic device 700 can also communicate with one or more external devices (not shown) via communication unit 740 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 700, or with any device that enables electronic device 700 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input/output (I/O) interface (not shown).
  • I/O input/output
  • a computer-readable storage medium that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above.
  • a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.
  • These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions/actions specified in one or more blocks of the flowchart and/or block diagram.
  • These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and/or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions/actions specified in one or more blocks of the flowchart and/or block diagram.
  • Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions/actions specified in one or more boxes of a flowchart and/or block diagram.
  • each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function.
  • the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved.
  • each block in the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开的实施例涉及媒体编辑方法、装置、设备和存储介质。在此提出的方法包括：在创作界面中呈现音乐生成入口；响应于对音乐生成入口的选择，呈现音乐配置窗口；基于经由音乐配置窗口获取的音乐生成请求，生成目标音乐；以及将目标音乐关联至与创作界面相关联的媒体内容。

Description

媒体编辑方法、装置、设备和存储介质
本申请要求2024年08月02日递交的、标题为“媒体编辑方法、装置、设备和存储介质”、申请号为202411061103.9的中国发明专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本公开的示例实施例总体涉及计算机领域，特别地涉及媒体编辑方法、装置、设备和计算机可读存储介质。
背景技术
近年来，随着互联网的快速发展，越来越多的用户在网络平台中编辑和发布作品。例如，用户可以在网络平台中对待发布的媒体内容进行配乐。
发明内容
在本公开的第一方面，提供了一种媒体编辑方法。该方法包括：在创作界面中呈现音乐生成入口；响应于对音乐生成入口的选择，呈现音乐配置窗口；基于经由音乐配置窗口获取的音乐生成请求，生成目标音乐；以及将目标音乐关联至与创作界面相关联的媒体内容。
在本公开的第二方面，提供了一种用于媒体编辑的装置。该装置包括：呈现模块，被配置为创作界面中呈现音乐生成入口；处理模块，被配置为响应于对所述音乐生成入口的选择，呈现音乐配置窗口；生成模块，被配置为基于经由音乐配置窗口获取的音乐生成请求，生成目标音乐；以及关联模块，被配置为将目标音乐关联至与创作界面相关联的媒体内容。
在本公开的第三方面，提供了一种电子设备。该设备包括至少一个处理器；以及至少一个存储器，至少一个存储器被耦合到至少一个处理器并且存储用于由至少一个处理器执行的指令。指令在由至少一个处理器执行时使设备执行第一方面的方法。
在本公开的第四方面，提供了一种计算机可读存储介质。该计算机可读存储介质上存储有计算机可执行指令，计算机可执行指令可由处理器执行以实现第一方面的方法。
在本公开的第五方面，提供了一种计算机程序产品。该计算机程序产品包括计算机可执行指令，计算机可执行指令在被处理器执行时实现第一方面的方法。
应当理解，本内容部分中所描述的内容并非旨在限定本公开的实施例的关键特征或重要特征，也不用于限制本公开的范围。本公开的其它特征将通过以下的描述而变得容易理解。
附图说明
结合附图并参考以下详细说明，本公开各实施例的上述和其他特征、优点及方面将变得更加明显。在附图中，相同或相似的附图标记表示相同或相似的元素，其中：
图1示出了其中可以实施根据本公开的实施例的示例环境的示意图；
图2A至图2E示出了根据本公开的一些实施例的示例界面；
图3A至图3C示出了根据本公开的又一些实施例的示例界面；
图4A至图4C示出了根据本公开的又一些实施例的示例界面；
图5示出了根据本公开的一些实施例的媒体编辑的示例过程的流程图；
图6示出了根据本公开的一些实施例的用于媒体编辑的示例装置的示意性结构框图；以及
图7示出了能够实施本公开的多个实施例的电子设备的框图。
具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中示出了本公开的某些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反，提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
需要注意的是，本文中所提供的任何节/子节的标题并不是限制性的。本文通篇描述了各种实施例，并且任何类型的实施例都可以包括在任何节/子节下。此外，在任一节/子节中描述的实施例可以以任何方式与同一节/子节和/或不同节/子节中描述的任何其他实施例相结合。
在本公开的实施例的描述中，术语“包括”及其类似用语应当理解为开放性包含，即“包括但不限于”。术语“基于”应当理解为“至少部分地基于”。术语“一个实施例”或“该实施例”应当理解为“至少一个实施例”。术语“一些实施例”应当理解为“至少一些实施例”。下文还可能包括其他明确的和隐含的定义。术语“第一”、“第二”等可以指代不同的或相同的对象。下文还可能包括其他明确的和隐含的定义。
本公开的实施例中可能涉及用户的数据、数据的获取和/或使用等。这些方面均遵循相应的法律法规及相关规定。在本公开的实施例中，所有数据的采集、获取、处理、加工、转发、使用等，都是在用户知晓并且确认的前提下进行的。相应地，在实现本公开的各实施例时，均应根据相关法律法规通过适当的方式，将可能所涉及的数据或信息的类型、使用范围、使用场景等告知用户并获得用户的授权。具体的告知和/或授权方式可以根据实际情况和应用场景而变化，本公开的范围在此方面不受限制。
本说明书及实施例中方案，如涉及个人信息处理，则均会在具备合法性基础(例如征得个人信息主体同意，或者为履行合同所必需等)的前提下进行处理，且仅会在规定或者约定的范围内进行处理。用户拒绝处理基本功能所需必要信息以外的个人信息，不会影响用户使用基本功能。
如上文所提及的，近年来，随着互联网的快速发展，越来越多的用户在网络平台中编辑和发布作品。例如，用户可以在网络平台中对待发布的媒体内容进行配乐。相关技术中，用户在网络平台中进行配乐时，只能选择现有的音乐内容，不能在网络平台中创建音乐。
本公开的实施例提出了一种媒体编辑的方案。根据该方案，可以在创作界面中呈现音乐生成入口；响应于对音乐生成入口的选择，呈现音乐配置窗口；基于经由音乐配置窗口获取的音乐生成请求，生成目标音乐；以及将目标音乐关联至与创作界面相关联的媒体内容。
以此方式，本公开的实施例能够在创作界面中提供生成音乐内容的入口，以及经由入口对应的音乐配置窗口获取音乐生成请求，从而基于音乐生成请求生成目标音乐。进一步地，可以将目标音乐关联至与创作界面相关联的媒体内容。因此，本公开的实施例能够为用户提供基于配置操作生成音乐的能力，满足了用户配置音乐的需求，以及提高了用户体验。
以下进一步结合附图来详细描述该方案的各种示例实现。
示例环境
图1示出了本公开的实施例能够在其中实现的示例环境100的示意图。如图1所示，示例环境100可以包括电子设备110。
在该示例环境100中，电子设备110可以运行有支持界面交互的应用120。应用120可以是用于界面交互的任何适当类型应用，其示例可以包括但不限于：视频应用、社交应用或其它适当的应用。用户140可以经由电子设备110和/或其附接设备来与应用120进行交互。
在图1的环境100中，如果应用120处于活动状态，电子设备110可以通过应用120呈现用于支持界面交互的界面150。
在一些实施例中，电子设备110与服务器130通信，以实现对应用120的服务的供应。电子设备110可以是任意类型的移动终端、固定终端或便携式终端，包括移动手机、台式计算机、膝上型计算机、笔记本计算机、上网本计算机、平板计算机、媒体计算机、多媒体平板、掌上电脑、便携式游戏终端、VR/AR设备、个人通信系统(Personal Communication System，PCS)设备、个人导航设备、个人数字助理(Personal Digital Assistant，PDA)、音频/视频播放器、数码相机/摄像机、定位设备、电视接收器、无线电广播接收器、电子书设备、游戏设备或者前述各项的任意组合，包括这些设备的配件和外设或者其任意组合。在一些实施例中，电子设备110也能够支持任意类型的针对用户的接口(诸如“可佩戴”电路等)。
服务器130可以是独立的物理服务器，也可以是多个物理服务器构成的服务器集群或者分布式系统，还可以是提供云服务、云数据库、云计算、云函数、云存储、网络服务、云通信、中间件服务、域名服务、安全服务、内容分发网络、以及大数据和人工智能平台等基础云计算服务的云服务器。服务器130例如可以包括计算系统/服务器，诸如大型机、边缘计算节点、云环境中的计算设备，等等。服务器130可以为电子设备110中支持界面交互的应用120提供后台服务。
服务器130与电子设备110之间可以建立有通信连接。通信连接可以通过有线方式或无线方式建立。通信连接可以包括但不限于蓝牙连接、移动网络连接、通用串行总线(Universal Serial Bus，USB)连接、无线保真(Wireless Fidelity，WiFi)连接等，本公开的实施例在此方面不受限制。在本公开的实施例中，服务器130与电子设备110可以通过二者之间的通信连接实现信令交互。
应当理解，仅出于示例性的目的描述环境100中各个元素的结构和功能，而不暗示对于本公开的范围的任何限制。
以下将继续参考附图描述本公开的一些示例实施例。
示例交互
图2A至图2E示出了根据本公开的一些实施例的示例界面200A至界面200E。界面200A至界面200E例如可以由图1所示的电子设备110所提供。
在一些实施例中，如图2A所示，电子设备110可以呈现拍摄界面200A。作为示例，电子设备110可以在拍摄界面200A中提供拍摄控件206。进一步地，电子设备110可以基于拍摄控件206获取用户拍摄的媒体内容。作为示例，电子设备还可以在拍摄界面200A中提供输入控件207，以便基于输入控件207获取用户上传的媒体内容(例如，用户先前拍摄完成的媒体内容或存储的媒体内容)。进一步地，电子设备110可以在创作界面200A中呈现用户拍摄的媒体内容或用户输入的媒体内容。作为示例，媒体内容可以包括视频内容、图文内容或音乐内容等。
在一些实施例中，响应于获取到媒体内容，电子设备110可以呈现与所获取到的媒体内容相关联的创作界面。例如，在经由拍摄控件206完成拍摄后，电子设备110可以呈现所拍摄的媒体内容的编辑界面(即，创作界面)。作为另一示例，在经由输入控件207完成媒体内容的上传后，电子设备110可以呈现针对所上传的媒体内容的编辑界面(即，创作界面)。
在一些实施例中，电子设备110例如还可以在未获取到媒体内容的情况下提供创作界面。作为示例，电子设备110可以接收对如图2A所示的拍摄界面中的音乐控件205的触发，并相应地显示创作界面。
图2B示出了根据本公开的一些实施例的创作界面200B。这样的创作界面200B可以是在获取到媒体内容后对编辑界面中的音乐控件205的选择所触发显示，或者，创作界面200B也可以是在未获取到任何媒体内容的情况下对拍摄界面200A中的音乐控件200的选择所触发显示。
在一些实施例中，如图2B所示，电子设备110可以在创作界面200B中呈现音乐生成入口210。作为示例，电子设备110还可以在创作界面200B中呈现预设音乐内容。进一步地，电子设备110可以响应于接收到对音乐生成入口210的触发，呈现音乐配置窗口。
在一些实施例中，如图2C所示，电子设备110可以在创作界面200C中呈现音乐配置窗口215。电子设备110可以在音乐配置窗口215中获取音乐生成请求。音乐生成请求可以指示基于至少一项音乐参数。
在一些实施例中，继续参考图2C，电子设备110可以在音乐配置窗口中呈现多项候选音乐参数220。
在一些实施例中，多项候选音乐参数220可以包括多项预设参数内容。作为示例，多项预设参数内容可以由相关技术人员自行确定，本公开对预设参数的具体内容不做限制。
在一些实施例中，当创作界面关联于媒体内容时，音乐生成请求可以指示与媒体内容相关联的至少一项音乐参数。
在一些实施例中，继续参考图2C，多项音乐候选参数可以包括基于从创作界面200C中获取的媒体内容所确定的候选参数内容。
在一些实施例中，电子设备110可以接收对多项候选音乐参数中的至少一项音乐参数的选择，以确定音乐生成请求所指示的至少一项音乐参数。
在一些实施例中，多项候选音乐参数指示待生成的目标音乐的至少一项属性。作为示例，待生成的目标音乐的至少一项属性可以包括歌词内容、音乐风格、音乐旋律、封面图像描述信息或相关的描述信息等。应当注意，这里仅做示例性说明，凡是关联于目标音乐的属性内容都可以包括在内。作为示例，多项候选音乐参数例如可以为描述文本。例如，候选音乐参数包括“海浪”文本，可以指示待生成的目标音乐的歌词内容、音乐风格、音乐旋律、封面图像等中的一项或多项关联于海浪。例如，候选音乐参数包括“爵士乐”文本，可以指示待生成的目标音乐的音乐风格和音乐旋律关联于“爵士乐”。
在一些实施例中，多项候选音乐参数基于媒体内容被确定的过程可以包括：第一模型基于与媒体内容相关联的图像内容、文本内容或音频内容，生成媒体内容的描述信息。作为示例，第一模型可以实现为具备分析媒体内容能力的分析模型。
作为示例，分析模型可以基于媒体内容的图像内容、文本内容或音频内容来生成图像内容、文本内容或音频内容对应的描述信息。例如，当媒体内容中包含海浪场景的图像内容时，分析模型可以生成关联于海浪的描述信息；或者，当媒体内容中包含雪山的文字，则分析模型可以生成包含雪山的描述信息。再例如，当媒体内容中包含带有对话的音频内容，分析模型可以生成关联于对话的描述信息。
在一些实施例中，多项候选音乐参数基于媒体内容被确定的过程还可以包括：基于描述信息，确定多项候选音乐参数。
在一些实施例中，第二模型可以基于描述信息确定多项候选音乐参数。作为示例，第二模型可以实现为具备基于描述信息生成候选音乐参数能力的生成式模型。
作为示例，生成式模型可以基于描述信息确定多项候选音乐参数。例如，描述信息包括关联于“海浪”的文字内容，生成式模型可以生成包含“海浪”文本的候选音乐参数；或者，描述信息包括关联于“爵士乐”的文字内容，生成式模型可以生成包含“爵士乐”文本的候选音乐参数。
本公开不旨在对第一模型和第二模型的具体内容和训练过程做限制。
在一些实施例中，继续参考图2C，电子设备110可以在音乐配置窗口215中提供制作控件225。进一步地，电子设备110可以响应于接收到对制作控件225的触发(例如，点击操作)，呈现生成目标音乐的制作过程。
在一些实施例中，第三模型可以基于音乐生成请求所指示的至少一项音乐参数生成目标音乐。作为示例，第三模型可以基于至少一项音乐参数，生成与至少一项音乐参数相关联的目标音乐的部分内容(例如，歌词内容、编曲、封面图像等)，并基于目标音乐的部分内容生成目标音乐。作为示例，第三模型基于至少一项音乐参数生成目标音乐。目标音乐中可以直接包含至少一项音乐参数的对应内容；或者，目标音乐中可以包含与至少一项音乐参数相关联的内容。作为示例，至少一项音乐参数包括“海浪”文本，第三模型生成的目标音乐的歌词内容例如可以包括“海浪”或者可以包括关联于海浪的“夏天”、“海燕”或“舒缓的心情”等。
作为示例，第三模型可以是分别具备生成歌词内容、编曲、封面图像等能力的多个预设模型，也可以是一体化的大模型。作为示例，本公开不旨在对第三模型的具体内容和训练过程做限制。
在一些实施例中，继续参考图2C，音乐生成请求还可以指示经由音乐配置窗口215获取的提示项。作为示例，电子设备110还可以在音乐配置窗口215中提供输入控件(图中未示出)。进一步地，电子设备110可以基于输入控件获取用户通过自然语言输入的提示项(例如，提示文本，如“爵士乐风格”等)。
在一些实施例中，第三模型还可以基于提示项生成目标音乐。
图3A至图3C示出了根据本公开的又一些实施例的示例界面300A至300C。界面300A至界面300C例如可以由图1所示的电子设备110所提供。
在一些实施例中，如图3A所示，电子设备110可以在创作界面300A中呈现音乐配置窗口305。电子设备110可以在音乐配置窗口305中获取音乐生成请求。
在一些实施例中，继续参考图3A，音乐生成请求可以指示基于经由音乐配置窗口315所采集的音频内容。作为示例，电子设备110可以在音乐配置窗口315中提供语音控件310，以获取用户输入的音乐内容。
在一些实施例中，如图3B所示，电子设备110可以响应于在创作界面300B中接收到用户对语音控件310的第一操作(例如，长按操作)，调取录音组件获取用户输入的语音内容(例如，录制用户哼唱的音频内容)。
在一些实施例中，如图3C所示，电子设备110可以响应于在创作界面300C中接收到用户结束对语音控件310的第一操作(例如，松开操作)，确定用户输入的语音内容(即，从第一操作开始到结束录制的音频内容)，以作为音乐生成请求所指示的音频内容。
在一些实施例中，第三模型还可以基于经由音乐配置窗口305所采集的音频内容生成目标音乐。
在一些实施例中，如图2D所示，电子设备110可以在音乐配置窗口215中呈现基于音乐生成请求生成目标音乐的制作过程(例如，预设的音乐制作的动画效果)。
在一些实施例中，如图2E所示，电子设备110可以响应于目标音乐制作完成，呈现目标音乐的显示界面200E。电子设备110可以在显示界面200E中提供播放控件230。作为示例，电子设备110可以利用播放控件230可以播放目标音乐。
在一些实施例中，继续参考图2E，电子设备110还可以在显示界面200E显示目标音乐的封面图像235。作为示例，封面图235像基于媒体内容所生成。作为示例，封面图像也可以基于至少一项音乐参数所生成。
在一些实施例中，继续参考图2E，电子设备110将目标音乐关联至与创作界面相关联的媒体内容。作为示例，与创作界面相关联的媒体内容可以包括：在目标音乐被生成之前关联于创作界面的媒体内容，或，在目标音乐被生成之后，基于拍摄组件拍摄得到或用户上传的媒体内容。
在一些实施例中，将目标音乐关联至与创作界面相关联的媒体内容可以包括：经由与创作界面相关联的拍摄组件来拍摄媒体内容。进一步地，可以将目标音乐关联至所拍摄的媒体内容。在一些实施例中，继续参考图2E，电子设备110可以将目标音乐设置为媒体内容的背景音乐。作为示例，电子设备110可以在显示界面200E中提供使用控件240。作为示例，电子设备110可以响应于接收到对使用控件240的触发(例如，点击操作)，将目标音乐设置为媒体内容的背景音乐。
图4A至图4C示出了根据本公开的又一些实施例的示例界面400A至400C。界面400A至界面400C例如可以由图1所示的电子设备110所提供。
在一些实施例中，如图4A所示，电子设备110可以在编辑界面400A中呈现包含目标音乐的媒体内容。作为示例，电子设备110可以在编辑界面400A中提供指示元素405，以指示媒体内容使用目标音乐作为背景音乐。
在一些实施例中，电子设备110可以基于目标音乐更新媒体内容。
在一些实施例中，基于目标音乐，更新媒体内容可以包括：更新媒体内容的背景音乐为目标音乐，并且，在利用播放器播放媒体内容的过程中可以基于目标音乐的播放进度呈现对应的歌词内容。作为示例，基于目标音乐，更新媒体内容还可以包括，基于目标音乐，调整媒体内容。例如，调整修改媒体内容的显示内容、音频内容或时长等。
在一些实施例中，电子设备110可以响应于针对目标音乐的发布请求，发布目标作品。
在一些实施例中，继续参考图2E，电子设备110可以基于目标音乐，更新媒体内容。作为示例，电子设备110可以在显示界面200E中提供生成音乐控件245。进一步地，电子设备110可以响应于接收到对生成音乐控件245的触发，发布目标作品。
在一些实施例中，如图4B所示，电子设备110可以响应于接收到对生成音乐控件245的触发，呈现目标音乐的预览界面400B。电子设备110可以在目标作品的预览界面400B中提供目标音乐的预览控件410，以播放目标音乐。
在一些实施例中，继续参考图4B，电子设备110还可以在预览界面400B中显示目标音乐的封面图像425。作为示例，封面图像425基于媒体内容所生成。作为示例，封面图像也可以基于至少一项音乐参数所生成。
在一些实施例中，继续参考图4B，电子设备110可以在预览界面400B中提供一组预设音乐参数415。进一步地，电子设备110可以基于对一组预设音乐参数中的目标音乐参数的选择，更新目标音乐。作为示例，如图4B所示，一组预设音乐参数415可以关联于多个曲风。进一步地，电子设备110可以基于对一组预设音乐参数415中的目标音乐参数(例如，民谣)的选择，利用第三模型将目标音乐的主题(或称为曲风、风格等)调整为民谣。作为示例，一组预设音乐参数415还可以关联于针对歌词内容、封面图像、编曲等描述信息。描述信息例如可以为短文本。电子设备110可以利用第三模型基于所选择的描述信息更新目标音乐。
在一些实施例中，如图4C所示，电子设备110可以响应于接收到发布请求，呈现目标作品的播放界面400C。电子设备110可以在目标作品的播放界面400C中提供目标音乐的播放容器410，以用于播放目标音乐。作为示例，电子设备110可以利用播放容器410播放目标音乐，并且呈现目标音乐的封面图像和歌词内容。作为示例，电子设备110可以基于目标音乐的播放进度，呈现对应的歌词内容。
在一些实施例中，继续参考图4C，电子设备110可以在播放界面400C中呈现标识信息420，以指示播放界面400C中播放的音乐内容为基于媒体内容生成的目标音乐。作为示例，标识信息420例如可以为“XX音乐”。
基于上文所描述的交互过程，本公开的实施例能够基于用户拍摄或选择的媒体内容、用户输入的提示项和/或哼唱的音频内容和预设参数中的至少一项，生成音乐内容，从而提高了所生成的音乐内容的质量。以此方式，本公开的实施例能够为用户提供生成音乐内容的途径，满足用户生成音乐内容的需求，提高了发布媒体内容的质量和用户体验。
示例过程
图5示出了根据本公开的一些实施例的消息处理的示例过程500的流程图。过程500可以被实现在电子设备110处。下面参考图1来描述过程500。
如图5所示，在框510，电子设备110在创作界面中呈现音乐生成入口。
在框520，电子设备110响应于对音乐生成入口的选择，呈现音乐配置窗口。
在框530，电子设备110基于经由音乐配置窗口获取的音乐生成请求，生成目标音乐。
在框540，电子设备110将目标音乐关联至与创作界面相关联的媒体内容。
在一些实施例中，音乐生成请求指示与媒体内容相关联的至少一项音乐参数。
在一些实施例中，过程500还包括：在音乐配置窗口呈现多项候选音乐参数，多项候选音乐参数基于媒体内容所确定；以及接收对多项候选音乐参数中的至少一项音乐参数的选择。
在一些实施例中，多项候选音乐参数是通过以下过程被确定：基于与媒体内容相关联的图像内容、文本内容或音频内容，生成媒体内容的描述信息；以及基于描述信息，确定多项候选音乐参数。
在一些实施例中，多项候选音乐参数指示待生成的目标音乐的至少一项属性。
在一些实施例中，音乐生成请求还指示以下至少一项：经由音乐配置窗口所采集的音频内容；或经由音乐配置窗口所获取的提示项。
在一些实施例中，过程500还包括：呈现目标音乐的预览界面，预览界面包括目标音乐的预览控件。
在一些实施例中，预览界面还显示目标音乐的封面图像，封面图像基于媒体内容所生成。
在一些实施例中，过程500还包括：在预览界面中显示一组预设音乐参数；以及基于对一组预设音乐参数中的目标音乐参数的选择，更新目标音乐。
在一些实施例中，将目标音乐关联至与创作界面相关联的媒体内容包括：将目标音乐设置为媒体内容的背景音乐；或基于目标音乐，更新媒体内容。
在一些实施例中，过程500还包括：响应于针对目标音乐的发布请求，发布目标作品，其中目标作品的播放页面提供目标音乐的播放容器。
在一些实施例中，过程500还包括：响应于在媒体内容的拍摄界面接收到的预设操作，呈现创作界面；或响应于接收到针对媒体内容的编辑请求，呈现创作界面。
在一些实施例中，将目标音乐关联至与创作界面相关联的媒体内容包括：经由与创作界面相关联的拍摄组件来拍摄媒体内容；以及将目标音乐关联至所拍摄的媒体内容。
示例装置和设备
本公开的实施例还提供了用于实现上述方法或过程的相应装置。图6示出了根据本公开的某些实施例的用于消息处理的示例装置600的示意性结构框图。装置600可以被实现为或者被包括在电子设备110中。装置600中的各个模块/组件可以由硬件、软件、固件或者它们的任意组合来实现。
如图6所示，装置600包括呈现模块610，被配置为在创作界面中呈现音乐生成入口；处理模块620，被配置为响应于对音乐生成入口的选择，呈现音乐配置窗口；生成模块630，被配置为：基于经由音乐配置窗口获取的音乐生成请求，生成目标音乐；以及关联模块640，被配置为将目标音乐关联至与创作界面相关联的媒体内容。
在一些实施例中，音乐生成请求指示与媒体内容相关联的至少一项音乐参数。
在一些实施例中，装置600还包括确定模块，确定模块被配置为：在音乐配置窗口呈现多项候选音乐参数，多项候选音乐参数基于媒体内容所确定；以及接收对多项候选音乐参数中的至少一项音乐参数的选择。
在一些实施例中，多项候选音乐参数是通过以下过程被确定：基于与媒体内容相关联的图像内容、文本内容或音频内容，生成媒体内容的描述信息；以及基于描述信息，确定多项候选音乐参数。
在一些实施例中，多项候选音乐参数指示待生成的目标音乐的至少一项属性。
在一些实施例中，音乐生成请求还指示以下至少一项：经由音乐配置窗口所采集的音频内容；或经由音乐配置窗口所获取的提示项。
在一些实施例中，装置600还包括预览模块，预览模块被配置为：呈现目标音乐的预览界面，预览界面包括目标音乐的预览控件。
在一些实施例中，预览界面还显示目标音乐的封面图像，封面图像基于媒体内容所生成。
在一些实施例中，装置600还包括参数模块，参数模块被配置为：在预览界面中显示一组预设音乐参数；以及基于对一组预设音乐参数中的目标音乐参数的选择，更新目标音乐。
在一些实施例中，关联模块640还被配置为：将目标音乐设置为媒体内容的背景音乐；或基于目标音乐，更新媒体内容。
在一些实施例中，装置600还包括发布模块，发布模块被配置为：响应于针对目标音乐的发布请求，发布目标作品，其中目标作品的播放页面提供目标音乐的播放容器。
在一些实施例中，装置600还包括创作模块，创作模块被配置为：响应于在媒体内容的拍摄界面接收到的预设操作，呈现创作界面；或响应于接收到针对媒体内容的编辑请求，呈现创作界面。
在一些实施例中，关联模块640还被配置为：经由与创作界面相关联的拍摄组件来拍摄媒体内容；以及将目标音乐关联至所拍摄的媒体内容。
图7示出了其中可以实施本公开的一个或多个实施例的电子设备700的框图。应当理解，图7所示出的电子设备700仅仅是示例性的，而不应当构成对本文所描述的实施例的功能和范围的任何限制。图7所示出的电子设备700可以用于实现图1的电子设备110。
如图7所示，电子设备700是通用电子设备的形式。电子设备700的组件可以包括但不限于一个或多个处理单元或处理器710、存储器720、存储设备730、一个或多个通信单元740、一个或多个输入设备750以及一个或多个输出设备760。处理器710可以是实际或虚拟处理器并且能够根据存储器720中存储的程序来执行各种处理。在多处理器系统中，多个处理器并行执行计算机可执行指令，以提高电子设备700的并行处理能力。
电子设备700通常包括多个计算机存储介质。这样的介质可以是电子设备700可访问的任何可以获取的介质，包括但不限于易失性和非易失性介质、可拆卸和不可拆卸介质。存储器720可以是易失性存储器(例如寄存器、高速缓存、随机访问存储器(RAM))、非易失性存储器(例如，只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、闪存)或它们的某种组合。存储设备730可以是可拆卸或不可拆卸的介质，并且可以包括机器可读介质，诸如闪存驱动、磁盘或者任何其他介质，其可以能够用于存储信息和/或数据并且可以在电子设备700内被访问。
电子设备700可以进一步包括另外的可拆卸/不可拆卸、易失性/非易失性存储介质。尽管未在图7中示出，可以提供用于从可拆卸、非易失性磁盘(例如“软盘”)进行读取或写入的磁盘驱动和用于从可拆卸、非易失性光盘进行读取或写入的光盘驱动。在这些情况中，每个驱动可以由一个或多个数据介质接口被连接至总线(未示出)。存储器720可以包括计算机程序产品725，其具有一个或多个程序模块，这些程序模块被配置为执行本公开的各种实施例的各种方法或动作。
通信单元740实现通过通信介质与其他电子设备进行通信。附加地，电子设备700的组件的功能可以以单个计算集群或多个计算机器来实现，这些计算机器能够通过通信连接进行通信。因此，电子设备700可以使用与一个或多个其他服务器、网络个人计算机(PC)或者另一个网络节点的逻辑连接来在联网环境中进行操作。
输入设备750可以是一个或多个输入设备，例如鼠标、键盘、追踪球等。输出设备760可以是一个或多个输出设备，例如显示器、扬声器、打印机等。电子设备700还可以根据需要通过通信单元740与一个或多个外部设备(未示出)进行通信，外部设备诸如存储设备、显示设备等，与一个或多个使得用户与电子设备700交互的设备进行通信，或者与使得电子设备700与一个或多个其他电子设备通信的任何设备(例如，网卡、调制解调器等)进行通信。这样的通信可以经由输入/输出(I/O)接口(未示出)来执行。
根据本公开的示例性实现方式，提供了一种计算机可读存储介质，其上存储有计算机可执行指令，其中计算机可执行指令被处理器执行以实现上文描述的方法。根据本公开的示例性实现方式，还提供了一种计算机程序产品，计算机程序产品被有形地存储在非瞬态计算机可读介质上并且包括计算机可执行指令，而计算机可执行指令被处理器执行以实现上文描述的方法。
这里参照根据本公开实现的方法、装置、设备和计算机程序产品的流程图和/或框图描述了本公开的各个方面。应当理解，流程图和/或框图的每个方框以及流程图和/或框图中各方框的组合，都可以由计算机可读程序指令实现。
这些计算机可读程序指令可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器，从而生产出一种机器，使得这些指令在通过计算机或其他可编程数据处理装置的处理器执行时，产生了实现流程图和/或框图中的一个或多个方框中规定的功能/动作的装置。也可以把这些计算机可读程序指令存储在计算机可读存储介质中，这些指令使得计算机、可编程数据处理装置和/或其他设备以特定方式工作，从而，存储有指令的计算机可读介质则包括一个制造品，其包括实现流程图和/或框图中的一个或多个方框中规定的功能/动作的各个方面的指令。
可以把计算机可读程序指令加载到计算机、其他可编程数据处理装置、或其他设备上，使得在计算机、其他可编程数据处理装置或其他设备上执行一系列操作步骤，以产生计算机实现的过程，从而使得在计算机、其他可编程数据处理装置、或其他设备上执行的指令实现流程图和/或框图中的一个或多个方框中规定的功能/动作。
附图中的流程图和框图显示了根据本公开的多个实现的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段或指令的一部分，模块、程序段或指令的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个连续的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或动作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
以上已经描述了本公开的各实现，上述说明是示例性的，并非穷尽性的，并且也不限于所公开的各实现。在不偏离所说明的各实现的范围和精神的情况下，对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择，旨在最好地解释各实现的原理、实际应用或对市场中的技术的改进，或者使本技术领域的其他普通技术人员能理解本文公开的各个实现方式。

Claims (17)

  1. 一种媒体编辑方法，包括：
    在创作界面中呈现音乐生成入口；
    响应于对所述音乐生成入口的选择，呈现音乐配置窗口；
    基于经由所述音乐配置窗口获取的音乐生成请求，生成目标音乐；以及
    将所述目标音乐关联至与所述创作界面相关联的媒体内容。
  2. 根据权利要求1所述的方法，其中所述音乐生成请求指示与所述媒体内容相关联的至少一项音乐参数。
  3. 根据权利要求2所述的方法，还包括：
    在所述音乐配置窗口呈现多项候选音乐参数，所述多项候选音乐参数基于所述媒体内容所确定；以及
    接收对所述多项候选音乐参数中的所述至少一项音乐参数的选择。
  4. 根据权利要求3所述的方法，其中所述多项候选音乐参数是通过以下过程被确定：
    基于与所述媒体内容相关联的图像内容、文本内容或音频内容，生成所述媒体内容的描述信息；以及
    基于所述描述信息，确定所述多项候选音乐参数。
  5. 根据权利要求3所述的方法，其中所述多项候选音乐参数指示待生成的所述目标音乐的至少一项属性。
  6. 根据权利要求1所述的方法，其中所述音乐生成请求还指示以下至少一项：
    经由所述音乐配置窗口所采集的音频内容；或
    经由所述音乐配置窗口所获取的提示项。
  7. 根据权利要求1所述的方法，还包括：
    呈现所述目标音乐的预览界面，所述预览界面包括所述目标音乐的预览控件。
  8. 根据权利要求7所述的方法，其中所述预览界面还显示所述目标音乐的封面图像，所述封面图像基于所述媒体内容所生成。
  9. 根据权利要求7所述的方法，还包括：
    在所述预览界面中显示一组预设音乐参数；以及
    基于对所述一组预设音乐参数中的目标音乐参数的选择，更新所述目标音乐。
  10. 根据权利要求1所述的方法，其中将所述目标音乐关联至与所述创作界面的相关联的媒体内容包括：
    将所述目标音乐设置为所述媒体内容的背景音乐；或
    基于所述目标音乐，更新所述媒体内容。
  11. 根据权利要求1所述的方法，还包括：
    响应于针对所述目标音乐的发布请求，发布目标作品，其中所述目标作品的播放页面提供所述目标音乐的播放容器。
  12. 根据权利要求1所述的方法，还包括：
    响应于在所述媒体内容的拍摄界面接收到的预设操作，呈现所述创作界面；或
    响应于接收到针对所述媒体内容的编辑请求，呈现所述创作界面。
  13. 根据权利要求1所述的方法，其中将所述目标音乐关联至与所述创作界面相关联的媒体内容包括：
    经由与所述创作界面相关联的拍摄组件来拍摄所述媒体内容；以及
    将所述目标音乐关联至所拍摄的所述媒体内容。
  14. 一种用于媒体编辑的装置，包括：
    呈现模块，被配置为在创作界面中呈现音乐生成入口；
    处理模块，被配置为响应于对所述音乐生成入口的选择，呈现音乐配置窗口；
    生成模块，被配置为基于经由所述音乐配置窗口获取的音乐生成请求，生成目标音乐；以及
    关联模块，被配置为将所述目标音乐关联至与所述创作界面相关联的媒体内容。
  15. 一种电子设备，包括：
    至少一个处理器；以及
    至少一个存储器，所述至少一个存储器被耦合到所述至少一个处理器并且存储用于由所述至少一个处理器执行的指令，所述指令在由所述至少一个处理器执行时使所述电子设备执行根据权利要求1至13中任一项所述的方法。
  16. 一种计算机可读存储介质，其上存储有计算机可执行指令，所述计算机可执行指令可由处理器执行以实现根据权利要求1至13中任一项所述的方法。
  17. 一种计算机程序产品，包括计算机可执行指令，其中所述计算机可执行指令在被处理器执行时实现根据权利要求1至13中任一项所述的方法。
PCT/CN2025/112128 2024-08-02 2025-08-01 媒体编辑方法、装置、设备和存储介质 Pending WO2026026950A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202411061103.9 2024-08-02
CN202411061103.9A CN121462847A (zh) 2024-08-02 2024-08-02 媒体编辑方法、装置、设备和存储介质

Publications (1)

Publication Number Publication Date
WO2026026950A1 true WO2026026950A1 (zh) 2026-02-05

Family

ID=98576150

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2025/112128 Pending WO2026026950A1 (zh) 2024-08-02 2025-08-01 媒体编辑方法、装置、设备和存储介质

Country Status (2)

Country Link
CN (1) CN121462847A (zh)
WO (1) WO2026026950A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180268792A1 (en) * 2014-08-22 2018-09-20 Zya, Inc. System and method for automatically generating musical output
CN116403549A (zh) * 2023-05-17 2023-07-07 北京字跳网络技术有限公司 音乐生成方法、装置、电子设备及存储介质
CN116935817A (zh) * 2022-04-01 2023-10-24 腾讯科技（深圳）有限公司 音乐编辑方法、装置、电子设备和计算机可读存储介质
CN117012170A (zh) * 2022-04-29 2023-11-07 脸萌有限公司 一种音乐生成方法、装置、系统及存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180268792A1 (en) * 2014-08-22 2018-09-20 Zya, Inc. System and method for automatically generating musical output
CN116935817A (zh) * 2022-04-01 2023-10-24 腾讯科技（深圳）有限公司 音乐编辑方法、装置、电子设备和计算机可读存储介质
CN117012170A (zh) * 2022-04-29 2023-11-07 脸萌有限公司 一种音乐生成方法、装置、系统及存储介质
CN116403549A (zh) * 2023-05-17 2023-07-07 北京字跳网络技术有限公司 音乐生成方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN121462847A (zh) 2026-02-03

Similar Documents

Publication Publication Date Title
WO2025168004A1 (zh) 创建虚拟对象的方法、装置、设备和存储介质
WO2025168002A1 (zh) 发布虚拟对象的方法、装置、设备和存储介质
WO2025251807A1 (zh) 生成音乐的方法、装置、设备和存储介质
WO2025157280A1 (zh) 交互方法、装置、设备和存储介质
WO2026012476A1 (zh) 用于直播的方法、装置、设备和存储介质
WO2025256646A1 (zh) 信息展示方法、装置、设备和存储介质
WO2025146141A1 (zh) 表情交互的方法、装置、设备和存储介质
CN118172443A (zh) 特效编辑的方法、装置、设备和存储介质
WO2025261520A1 (zh) 交互方法、装置、设备和存储介质
WO2026007522A1 (zh) 生成媒体内容的方法、装置、设备和存储介质
WO2026046035A1 (zh) 配置虚拟对象的方法、装置、设备和存储介质
WO2025195387A1 (zh) 发布作品和查看作品的方法、装置、设备和存储介质
WO2026012482A1 (zh) 消息交互的方法、装置、设备和存储介质
WO2025081899A1 (zh) 一种交互方法、装置、设备和存储介质
WO2026026950A1 (zh) 媒体编辑方法、装置、设备和存储介质
CN118550625A (zh) 生成媒体内容方法、装置、设备和存储介质
CN118778844A (zh) 发布内容的方法、装置、设备和存储介质
WO2026020490A1 (zh) 一种生成媒体内容的方法、装置、设备和存储介质
WO2025209495A1 (zh) 创建虚拟对象的方法、装置、设备和存储介质
WO2026012153A1 (zh) 生成媒体内容的方法、装置、设备和存储介质
WO2026020462A1 (zh) 一种生成媒体内容的方法、装置、设备和存储介质
WO2026051893A1 (zh) 内容查询方法、装置、设备和存储介质
WO2026002244A1 (zh) 交互方法、装置、设备和存储介质
WO2026012290A1 (zh) 创建应用的方法、装置、设备和存储介质
WO2025077302A1 (zh) 处理请求的方法、装置、设备和存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 25847401

Country of ref document: EP

Kind code of ref document: A1