WO2020259130A1

WO2020259130A1 - Selected clip processing method and device, electronic equipment and readable medium

Info

Publication number: WO2020259130A1
Application number: PCT/CN2020/091071
Authority: WO
Inventors: 何尧
Original assignee: 北京字节跳动网络技术有限公司
Priority date: 2019-06-27
Filing date: 2020-05-19
Publication date: 2020-12-30
Also published as: CN110312162A

Abstract

The present embodiment discloses a selected clip processing method and device, an electronic equipment and a readable medium. The selected clip processing method comprises: generating, according to the audio content and image content of a recorded target song, an audio/video file of the target song; when a storage event is detected, storing the audio/video file and determining a clip of a preset duration as a selected clip; and when a release event is detected, adding the selected clip into a video list interface for display.

Description

Selected fragment processing method, device, electronic equipment and readable medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office with an application number of 201910569485.9 on June 27, 2019. The entire content of this application is incorporated into this application by reference.

Technical field

The embodiments of the present disclosure relate to the field of Internet technology, for example, to a method, device, electronic device, and readable medium for processing selected fragments.

Background technique

In K song applications, users can watch audio and video released by other users, or select their favorite songs to record audio and video and publish them.

The user can enter the name of the favorite song in the search box, and then click any K song option in the search results to enter the singing interface of the song to record the song. And usually, after the song is recorded, the user can choose to record the video image, and then can generate and save the audio and video based on the audio and video images of the recorded song, and directly save the saved after the user’s release instruction is detected The audio and video of is posted on the video list interface for other users to watch.

However, when the audio and video released by the user are long, it is inconvenient for users who watch the audio and video to quickly capture the key points, and emotional phenomena are prone to appear, which is not good for user experience.

Summary of the invention

The embodiments of the present disclosure provide a selected fragment processing method, device, electronic device, and readable medium, which help users quickly capture key points, thereby improving user experience.

The embodiment of the present disclosure provides a selected fragment processing method, which includes:

According to the recorded audio content and image content of the target song, generate the audio and video of the target song;

In the case of detecting a saving event, saving the audio and video, and determining a segment with a preset duration from the audio and video as a selected segment;

In the case that a publishing event is detected, the selected segment is added to the video list interface for display.

The embodiment of the present disclosure also provides a selected fragment processing device, which includes:

The audio and video generation module is set to generate the audio and video of the target song based on the recorded audio content and image content of the target song;

The selected segment generating module is configured to save the audio and video when a saving event is detected, and determine a segment with a preset duration from the audio and video as the selected segment;

A display module is added, which is set to add the selected fragments to the video list interface for display when a publishing event is detected.

An embodiment of the present disclosure also provides an electronic device, which includes:

One or more processors;

Memory, set to store one or more programs;

When the one or more programs are executed by the one or more processors, the one or more processors implement the selected segment processing method according to any embodiment of the present disclosure.

The embodiment of the present disclosure provides a readable medium on which a computer program is stored. When the computer program is executed by a processor, the selected fragment processing method as described in any embodiment of the present disclosure is implemented.

Description of the drawings

FIG. 1 shows a flowchart of a method for processing selected fragments according to an embodiment of the present disclosure;

Fig. 2 shows a flowchart of another selected fragment processing method provided by an embodiment of the present disclosure;

Fig. 3 shows a flowchart of another selected fragment processing method provided by an embodiment of the present disclosure;

Fig. 4 shows a flowchart of another selected fragment processing method provided by an embodiment of the present disclosure;

FIG. 5 shows a schematic structural diagram of a selected fragment processing apparatus provided by an embodiment of the present disclosure;

Fig. 6 shows a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.

Detailed ways

The embodiments of the present disclosure will be described below with reference to the drawings. Although some embodiments of the present disclosure are shown in the drawings, the present disclosure may be implemented in various forms, and should not be construed as being limited to the embodiments set forth herein.

The multiple steps described in the method embodiments of the present disclosure may be executed in a different order, and/or executed in parallel. Furthermore, method implementations may include additional steps and/or omit to perform the illustrated steps. The scope of the present disclosure is not limited in this respect. In the following multiple embodiments, each embodiment provides optional features and examples at the same time. Multiple features recorded in the embodiments can be combined to form multiple alternative solutions. Each numbered embodiment should not be combined Only regarded as a technical solution.

The term "including" and its variations as used herein are open-ended includes, that is, "including but not limited to". The term "based on" is "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments." Related definitions of other terms will be given in the following description.

The concepts of “first” and “second” mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units relationship.

The modifications of "a" and "a plurality of" mentioned in the present disclosure are illustrative and not restrictive. Unless otherwise clearly indicated in the context, they should be understood as "one or more".

Figure 1 shows a flow chart of a method for processing selected fragments provided by an embodiment of the present disclosure. The display of audio and video in the video list interface is not convenient for users to quickly capture the key points, which in turn leads to poor user experience. The method may be executed by the selected segment processing apparatus or electronic device provided in the embodiments of the present disclosure, and the apparatus may be implemented by software and/or hardware. Optionally, the so-called electronic device may be a server device that carries the function of processing selected fragments, or a terminal device that configures the K song application provided by the server.

Optionally, as shown in FIG. 1, the selected fragment processing method provided in the embodiment of the present disclosure includes S110 to S130.

S110: Generate audio and video of the target song according to the recorded audio content and image content of the target song.

In this embodiment, the target song refers to the audio and/or image song selected by the user to be recorded. Optionally, you can use any of the following methods to record the audio content and image content of the target song: 1) First record the audio content in the singing interface of the target song, and then use the recorded audio content as the original sound of the video. In the interface, record the image content; 2) In the audio and video synchronization recording interface, record the audio content and image content of the target song at the same time; 3) First record the audio content in the singing interface of the target song, and then you can use the preset library (such as local In the gallery or cloud gallery), obtain the video file selected by the user and filter out the sound in the obtained video file to obtain the image content; 4) First record the audio content in the singing interface of the target song, and then Obtain the photographed picture file selected by the user from a preset gallery (such as a local gallery or a cloud gallery), and filter out the sound in the obtained picture file to obtain image content, etc.

In an embodiment, after the audio content and image content of the target song are recorded, the audio content can be added to the image content to generate the audio and video of the target song; it can also be the resolution, drawing, and image content of the image content. Filters and other processing, volume adjustment, playback style and other processing on the audio content, and then based on the processed audio content and image content, the audio and video of the target song is generated. In addition, it is also possible to generate audio and video of the target song according to the audio content and image content of the target song in other implementation manners, which is not limited in this embodiment. In an embodiment, the audio and video generated at this time is a complete audio and video that has not undergone processing such as intercepting segments.

S120: If a save event is detected, save the audio and video, and determine a segment of a preset duration from the audio and video as a selected segment.

In this embodiment, the save event may be triggered by the user manually or by voice, etc., and is used to request the server or the K song application provided by the server to save the audio and video events. For example, the save event may be triggered by the user manually clicking the save button in the currently displayed interface of the K song application provided by the server, where the currently displayed interface may be a preview interface of audio and video.

In one embodiment, the preset duration is a preset total playback duration of the selected segment, which can be modified according to the total playback duration of audio and video in actual situations and actual needs. In one embodiment, the preset duration may be a set ratio of the total playback duration of the audio and video. For example, if the total playback duration of the audio and video is 90s and the set ratio is 1/6, the preset duration is 15s.

In one embodiment, a segment with a preset duration can be randomly selected from the audio and video as the selected segment. For example, the first 15s segment in the audio and video can be selected as the selected segment by default; or it can be based on the feature information of lyrics in the audio and video. , Image feature information, etc. Select a segment of preset duration from the audio and video as the selected segment.

Exemplarily, determining a clip with a preset duration from the audio and video, as a selected clip, can also be: selecting a clip with a preset duration from the audio and video, and adjusting the resolution and playback speed of the selected clip to the setting Set the value to generate a selected segment. Or: generate selected fragments by interacting with users such as visualization or question and answer. For example, the selected segment can be generated by interacting with the user in the selected segment production interface provided.

Take the server as the execution subject as an example. After the server generates the audio and video of the target song, it can send the generated audio and video to the user's karaoke application that records the audio content of the target song, so that the karaoke application displays the audio on the audio and video preview interface. Video; at this time, if the user is satisfied with the displayed audio and video, he can click the save button in the preview interface to save, and the server can detect the save event through the K song application, save the audio and video locally, and A segment of preset duration is determined from the audio and video as a selected segment. In one embodiment, after generating the selected segment, the server may also display the generated selected segment to the user in a preview form through the user's K song application.

In addition, in order to meet the different needs of users, exemplarily, before determining a segment of preset duration from the audio and video, it can also include a backup of the audio and video before it is used as a selected segment, so that subsequent users can not only watch the fine Select the clip, you can also watch the complete audio and video.

S130: If a publishing event is detected, the selected segment is added to the video list interface for display.

In this embodiment, the publishing event may be triggered by the user manually or by voice, etc., and is used to request the server or the K song application provided by the server to publish selected clips or audio and video events. The video list interface is used to display a list interface of selected segments of each user's audio and video.

Optionally, the K song application provided by the server and the server have different ways of adding the selected clips to the video list interface for display after detecting the publishing event. For example, for the server, if the user's K song application that records the audio content of the target song detects a release event, the selected segment can be added to the video list interface, and then the server can control the multiple items managed by the server. A K song application shows a video list interface for adding selected clips to users corresponding to multiple K song applications. In one embodiment, the server may add the selected clips to the video list interface, and determine the loading information of the video list interface including the selected clips; according to the loading information, load the video list interface including the selected clips and display the Featured clips, that is, the server can send the loading information to multiple K song applications managed by it, so that multiple K song applications can load the video list interface including the selected clips according to the loading information and correspond to them User impressions. Among them, the loading information can be a link address, or data information of a selected fragment.

For the K song application provided by the server, if a release event is detected, the selected segment of the target song can be sent to the server to request the server to add the selected segment to the video list interface and feedback loading includes The related information of the video list interface of the selected segment, and then the K song application can load and display the video list interface including the selected segment according to the relevant information; at the same time, the server can also load the video including the selected segment The relevant information of the list interface is sent to the K song application of other users managed by the server, so that other users can watch the content published by the user. The relevant information for loading the video list interface including the selected fragments may be the loading information of the video list interface including the selected fragments determined by the server.

Since the user may have a need to watch complete audio and video in actual scenes, optionally, an interface for entering audio and video is embedded in the selected fragments in this implementation. In an embodiment, the interface may be embodied in the form of a physical button or a floating ball.

For example, in the process of playing selected clips, when it is detected that the user clicks on the physical button of the audio and video, the complete viewing interface of the audio and video can be shown to the user, so that the user can watch the complete audio and video in the complete viewing interface. In one embodiment, if the server detects through a K song application that the user using the K song application clicks on the physical button of the audio and video, it can send the link address or storage address of the pre-saved audio and video to the K song application, so that the K song application jumps to the complete viewing interface of the audio and video according to the obtained address and loads the audio and video for display, so that the user can watch the complete audio and video in the complete viewing interface of the audio and video . If a K song application detects that the user using the K song application clicks on the physical button of the audio and video, it can send a full version viewing request including the selected segment information to the server to request the server to obtain the selected segment information The complete audio and video of the selected segment and feedback, and then the K song application can obtain the complete audio and video feedback from the server and display it to the user, or the K song application can be based on the complete audio and video feedback from the server The address jumps to the complete viewing interface of the audio and video and loads the audio and video for display.

In this embodiment, by displaying selected clips in the video list interface, it can not only help users quickly capture the key points, increase the user’s interest in watching, and improve user experience; it can also increase the loading speed of the interface and reduce electronic The operating power consumption of the equipment, etc. In addition, by embedding a complete audio and video interface in the selected clips, it can meet the needs of users who want to watch complete audio and video.

In the technical solution provided by the embodiments of the present disclosure, if a save event is detected, while saving the audio and video of the target song generated based on the recorded audio content and image content of the target song, a segment of preset duration is determined from the audio and video, As a featured clip; if a publishing event is detected later, the generated featured clip can be added to the video list interface for display. By displaying selected clips in the video list interface, this solution not only helps users quickly capture the key points and enhances user experience; it also improves the loading speed of the interface and reduces the operating power consumption of electronic devices.

FIG. 2 shows a flowchart of another selected fragment processing method provided by an embodiment of the present disclosure. This embodiment is described on the basis of multiple alternative solutions provided in the above embodiment. This embodiment is different from the above embodiment. In the multiple steps provided, it is introduced how to process the audio and video according to preset fragment processing rules to generate selected fragments.

Optionally, as shown in FIG. 2, the selected segment processing method in this embodiment may include S210 to S250.

S210: Generate audio and video of the target song based on the recorded audio content and image content of the target song.

S220: If the save event is detected, save the audio and video, and use the time when the first lyrics are sung in the audio and video or the time when the climax segment is entered as the start time of the selected segment.

In this embodiment, if a save event is detected, the generated audio and video can be saved, and the first song in the audio and video can be determined based on the feature information of the lyrics in the audio and video (for example, it can include the start position and end position of the lyrics) The time of the lyrics of the sentence is used as the start time of the selected segment; or the time of entering the climax segment, that is, the time of entering the first lyrics of the climax segment, can be determined as the start time of the selected segment.

In addition, according to the image feature information in the audio and video, such as the mouth feature information, the time when the video frame of the open mouth image is first detected in the audio and video can be determined as the start time of the selected segment.

S230: Determine the end time of the selected segment according to the start time and the preset duration.

In one embodiment, the preset duration may be added to the start time to determine the end time of the selected segment. For example, if the start time is 0:0:5, and the preset duration is 15s, it can be determined that the end time of the selected segment is 0:0:20.

S240. Use the segments between the start time and the end time in the audio and video as selected segments.

In an embodiment, after the start time and end time of the selected segment are determined, the segment between the start time and the end time may be intercepted from the audio and video as the selected segment. Alternatively, it is also possible to first intercept the segment between the start time and the end time from the audio and video, and then perform processing such as drawing paper on the intercepted segment to generate a selected segment.

S250: If a publishing event is detected, the selected segment is added to the video list interface for display.

The technical solution provided by the embodiments of the present disclosure provides a way to determine the start time and end time of the selected segment based on the feature information of the lyrics, and then generate the selected segment based on the audio and video and the determined start time and end time; And if a publishing event is detected later, the generated selected fragments can be added to the video list interface for display. By displaying selected clips in the video list interface, this solution not only helps users quickly capture the key points and enhances user experience; it also improves the loading speed of the interface and reduces the operating power consumption of electronic devices.

FIG. 3 shows a flowchart of another selected fragment processing method provided by an embodiment of the present disclosure. This embodiment is described on the basis of multiple alternative solutions provided by the foregoing embodiment. This embodiment is different from the foregoing embodiment. In the multiple steps provided, it is introduced how to process the audio and video according to preset fragment processing rules to generate selected fragments.

Optionally, as shown in FIG. 3, the selected segment processing method in this embodiment may include S310 to S350.

S310: Generate audio and video of the target song according to the recorded audio content and image content of the target song.

S320: If the save event is detected, save the audio and video, and select a segment of the first preset duration from the audio and video as the first segment.

In this embodiment, the first preset duration is a preset total playback duration of the first segment. Optionally, the first preset duration is less than the preset duration. In one embodiment, it may be a set ratio of the preset duration, for example, it may be 2/3 of the preset duration.

In an embodiment, if a saving event is detected, the generated audio and video can be saved, and a segment of the first preset duration can be randomly selected from the audio and video as the first segment. For example, the first segment with the first preset duration in the audio and video can be taken as the first segment by default, or a segment with the first preset duration can be selected from the audio and video as the first segment based on the lyrics feature information and image feature information in the audio and video. A fragment.

S330. Obtain a segment with a second preset duration as a second segment.

In this embodiment, the first preset duration is greater than the second preset duration, and the second segment may be an introduction segment for introducing the content of the first segment. In an embodiment, the second segment may be used to introduce the user who sang the song in the first segment this time, or to introduce the star who actually sang the song in the first segment. In addition, the second segment may be a brief introduction segment, which is used to introduce the actual singing content of the first segment, etc.

Optionally, obtain a second preset duration segment. As the second segment, any of the following methods can be adopted: 1) Obtain a segment associated with the first segment from a preset gallery (such as a local gallery or a cloud gallery) (For example, a relevant segment of a star who actually sang the song in the first segment can be obtained from a preset gallery), and then a segment of the second preset duration is intercepted from the obtained segment and used as the second segment. 2) A segment associated with the first segment uploaded by the user in real time can be acquired, and then a segment of the second preset duration can be intercepted from the acquired segment as the second segment. 3) The pictures taken by the user in real time can be acquired, and then the same accompaniment sounds as in the first segment can be acquired, and then a segment of the second preset duration can be generated as the second segment based on the pictures and accompaniment sounds taken in real time.

S340. Perform splicing processing on the first segment and the second segment to generate a selected segment.

Optionally, the second segment can be placed before the first segment for splicing, and the pitch of the spliced place can be adjusted, so that it can smoothly transition from the first segment to the second segment, thereby generating a selected segment. In addition, if the second segment is a brief introduction segment, it can also be placed after the first segment for splicing to generate a selected segment.

In an embodiment, this embodiment can generate selected segments based on complete audio and video and other acquired audio and video segments, which increases the flexibility of generating selected segments.

S350: If a publishing event is detected, add the selected segment to the video list interface for display.

The technical solution provided by the embodiment of the present disclosure can generate a selected segment by splicing the acquired second segment and the first segment intercepted from the audio and video; afterwards, if a publishing event is detected, the generated The selected clips are added to the video list interface for display. By displaying selected clips in the video list interface, this solution not only helps users quickly capture the key points and enhances user experience; it also improves the loading speed of the interface and reduces the operating power consumption of electronic devices. In addition, this solution provides a way to generate selected segments based on complete audio and video and other acquired audio and video segments, which increases the flexibility of the way to generate selected segments.

FIG. 4 shows a flowchart of another selected fragment processing method provided by an embodiment of the present disclosure. This embodiment is described on the basis of multiple alternative solutions provided by the foregoing embodiment. This embodiment is different from the foregoing embodiment. In the multiple steps provided, it is introduced how to process the audio and video according to preset fragment processing rules to generate selected fragments.

Optionally, as shown in FIG. 4, the selected segment processing method in this embodiment may include S410 to S450.

S410: Generate audio and video of the target song according to the recorded audio content and image content of the target song.

S420: If a save event is detected, save the audio and video, and show the user a selection segment production interface.

In this embodiment, the selected segment production interface is a visual interface, which is a bridge for the server or the K song application provided by the server to interact with the user to generate the selected segment.

In one embodiment, if a save event is detected, the generated audio and video can be saved, and the selected segment production interface can be shown to the user.

S430. Determine the start time and end time of the preset duration as the start time and end time of the selected segment according to the user's operation on the selected segment production interface.

Optionally, the selected segment production interface can include a preview window of audio and video, audio and video progress bar, start cursor and end cursor that can be moved on the progress bar, reverberation mode adjustment options, resolution adjustment options, and volume Adjustment options, filter options, and mapping options, etc.

In one embodiment, the user can click on the audio and video preview window in the selected segment production interface, and can adjust the start cursor and end cursor in the audio and video according to the audio and video played in real time, and can also display the audio and video according to actual needs. A clip is added with drawings, etc.; and then the K song application provided by the server or the server can adjust the start cursor and end cursor in the audio and video on the selected clip production interface to determine the start of the preset duration Time and end time, and use the preset start time and end time as the start time and end time of the selected clip.

In addition, in one embodiment, if it is detected that the user is in the process of adjusting the start cursor and end cursor in the audio and video, and the segment between the start cursor and the end cursor is longer than the preset time, the voice Or text and other forms to remind the user that the total playback time of the selected segment cannot exceed the preset duration such as 15s. At the same time, after the user adjusts the start cursor, the position where the end cursor can be adjusted can be dynamically displayed, so as to increase the interest of the user during the operation.

At the same time, if it is detected that the segment duration between the start cursor and the end cursor in the audio and video adjusted multiple times by the user is less than the preset duration, the preset duration can be automatically modified according to the user's operation to meet the user's requirements. demand.

S440. Use the segments between the start time and the end time in the audio and video as selected segments.

In an embodiment, after the start time and end time of the selected segment are determined, the segment between the start time and the end time may be intercepted from the audio and video as the selected segment. Or, if the user adds a drawing operation to the segment between the start time and the end time, you can also first intercept the segment between the start time and the end time from the audio and video, and then map the intercepted segment Paper and other processing to generate selected fragments.

S450: If a publishing event is detected, add the selected segment to the video list interface for display.

The technical solution provided by the embodiments of the present disclosure shows the user a selected segment production interface, and determines the start time and end time of the preset duration as the start time of the selected segment according to the user's operation on the selected production interface And the end time, and then generate a selected segment; if a publishing event is detected later, the generated selected segment can be added to the video list interface for display. By displaying selected clips in the video list interface, this solution not only helps users quickly capture the key points and enhances user experience; it also improves the loading speed of the interface and reduces the operating power consumption of electronic devices. In addition, this solution provides a way to generate selected fragments based on visualization, so that the generated selected fragments are more in line with the needs of users.

FIG. 5 shows a schematic structural diagram of a selected segment processing device provided by an embodiment of the present disclosure. The embodiment of the present disclosure may be applicable to how to generate and display the selected segment in the video list interface, so as to solve the problem that related technologies directly integrate the complete The display of audio and video in the video list interface is not convenient for the user to quickly capture the key points, which leads to a poor user experience. The device can be implemented by software and/or hardware, and can be configured on an electronic device. Optionally, the so-called electronic device may be a server device that carries the function of processing selected fragments, or a terminal device that configures the K song application provided by the server. As shown in FIG. 5, the selected segment processing device in the embodiment of the present disclosure includes: an audio and video generation module 510, a selected segment generation module 520, and an add display module 530.

The audio and video generation module 510 is configured to generate the audio and video of the target song according to the recorded audio content and image content of the target song;

The selected segment generating module 520 is configured to save the audio and video if a saving event is detected, and determine a segment with a preset duration from the audio and video as the selected segment;

The display adding module 530 is configured to add the selected segment to the video list interface for display if a publishing event is detected.

Exemplarily, the selected fragment generation module 520 is set to:

The time of singing the first lyrics in the audio and video, or the time of entering the climax segment as the start time of the selected segment;

Determine the end time of the selected segment according to the start time and preset duration;

The segments between the start time and the end time in the audio and video are regarded as selected segments.

Exemplarily, the selected fragment generation module 520 is still set to:

Select a segment of the first preset duration from the audio and video as the first segment;

Acquiring a segment with a second preset duration as the second segment; wherein the first preset duration is greater than the second preset duration;

The splicing process is performed on the first segment and the second segment to generate a selected segment.

Exemplarily, the second segment is an introduction segment, which is used to introduce the content of the first segment.

Exemplarily, the selected fragment generation module 520 is also set to:

Show users the interface for making selected clips;

According to the user's operation on the selection segment production interface, determine the start time and end time of the preset duration as the start time and end time of the selection segment;

Exemplarily, in this embodiment, an interface for entering audio and video is embedded in the selected segment, and the interface is embodied in the form of a physical button or a floating ball.

Exemplarily, the adding display module 530 is set to:

Add selected clips to the video list interface, and determine the loading information of the video list interface including the selected clips;

According to the loading information, load the video list interface including the selected segments and display the selected segments.

For technical details of the selected fragment processing device provided by the embodiment of the present disclosure that are not described in the embodiment of the present disclosure, please refer to the foregoing embodiment, and the embodiment of the present disclosure has the same beneficial effects as the foregoing embodiment.

Referring to FIG. 6, FIG. 6 shows a schematic structural diagram of an electronic device 600 suitable for implementing the embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, for example, mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (Personal Digital Assistant, PDA), tablet computers (Portable Android Device, PAD), and portable multimedia players (Personal Multimedia). Player, PMP), mobile terminals such as in-vehicle terminals (for example, in-vehicle navigation terminals), and fixed terminals such as digital televisions (television, TV), desktop computers, etc. Optionally, the so-called electronic device in this embodiment may be a server device that carries the function of processing selected fragments, or a terminal device that configures a K song application provided by the server. The electronic device shown in FIG. 6 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.

As shown in FIG. 6, the electronic device 600 may include a processing device (such as a central processing unit, a graphics processor, etc.) 601. The processing device 601 may be based on a program stored in a read-only memory (Read-only Memory, ROM) 602 or from a storage device. The device 608 loads a program in a random access memory (Random Access Memory, RAM) 603 to perform various appropriate actions and processes. The RAM 603 also stores various programs and data required for the operation of the electronic device 600. The processing device 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input/output (Input/Output, I/O) interface 605 is also connected to the bus 604.

In an embodiment, the following devices can be connected to the I/O interface 605: including input devices 606 such as touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (Liquid Crystal Display, LCD), speaker, vibrator, etc. output device 607; storage device 608 including, for example, magnetic tape, hard disk, etc.; and communication device 609. The communication device 609 may allow the electronic device 600 to perform wireless or wired communication with other devices to exchange data. Although FIG. 6 shows an electronic device 600 with multiple devices, it is not required to implement or have all the illustrated devices, and may alternatively implement or have more or fewer devices.

According to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, the embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

In an embodiment, the aforementioned computer-readable medium of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. The computer-readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the above. Computer-readable storage media may include: electrical connections with one or more wires, portable computer disks, hard disks, RAM, ROM, Erasable Programmable Read-Only Memory (EPROM) or flash memory, optical fiber , Portable Compact Disc Read-Only Memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium. The computer-readable signal medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device . The program code contained on the computer-readable medium can be transmitted by any suitable medium, including: wire, optical cable, radio frequency (RF), etc., or any suitable combination of the above.

The above-mentioned computer-readable medium may be included in the above-mentioned terminal or server; or it may exist alone without being installed in the server.

The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the terminal or server, the server is caused to generate the audio and video of the target song according to the recorded audio content and image content of the target song ; If a save event is detected, the audio and video will be saved, and the audio and video will be processed according to the preset segment processing rules to generate a selected segment; if a publishing event is detected, the selected segment will be added to the video list interface for display .

The computer program code used to perform the operations of the present disclosure may be written in one or more programming languages or a combination thereof. The above-mentioned programming languages include object-oriented programming languages—such as Java, Smalltalk, C++, and also conventional Procedural programming language-such as "C" language or similar programming language. The program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network-including Local Area Network (LAN) or Wide Area Network (WAN)-or it can be connected to an external computer ( For example, use an Internet service provider to connect via the Internet).

The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions, and operations of the system, method, and computer program product according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logical function Executable instructions. In some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown in succession can actually be executed substantially in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved. Each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by dedicated hardware Realized in combination with computer instructions.

The units described in the embodiments of the present disclosure can be implemented in software or hardware. Among them, the name of the unit in one case does not constitute a limitation on the unit itself.

The functions described hereinabove may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), and application specific standard products (Application Specific Standard Parts, ASSP), System-on-a-Chip (SOC), Complex Programmable Logic Device (CPLD), etc.

In the context of the present disclosure, a machine-readable medium may be a tangible medium, and the machine-readable medium may contain or store a program for use by the instruction execution system, apparatus, or device or in combination with the instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. Machine-readable storage media include electrical connections based on one or more lines, portable computer disks, hard disks, RAM, ROM, EPROM or flash memory, optical fibers, CD-ROMs, optical storage devices, magnetic storage devices, or the foregoing Any suitable combination.

Claims

A method for processing selected fragments, including:

According to the recorded audio content and image content of the target song, generate the audio and video of the target song;

In the case of detecting a saving event, saving the audio and video, and determining a segment with a preset duration from the audio and video as a selected segment;

In the case that a publishing event is detected, the selected segment is added to the video list interface for display.
The method according to claim 1, wherein the determining a segment of a preset duration from the audio and video as a selected segment comprises:

Taking the time of singing the first lyrics in the audio and video or the time of entering the climax segment as the start time of the selected segment;

Determine the end time of the selected segment according to the start time and the preset duration;

The segment between the start time and the end time in the audio and video is taken as the selected segment.
The method according to claim 1, wherein the determining a segment of a preset duration from the audio and video as a selected segment comprises:

Selecting a segment with a first preset duration from the audio and video as the first segment;

Acquiring a segment of a second preset duration as a second segment; wherein the first preset duration is greater than the second preset duration;

The splicing process is performed on the first segment and the second segment to generate the selected segment.
The method according to claim 3, wherein the second segment is an introduction segment for introducing the content of the first segment.
The method according to claim 1, wherein the determining a segment of a preset duration from the audio and video as the selected segment comprises:

Show users the interface for making selected clips;

Determining the start time and end time of the preset duration as the start time and end time of the selected segment according to the user's operation on the selected segment production interface;

The segment between the start time and the end time in the audio and video is taken as the selected segment.
The method according to claim 1, wherein an interface for entering the audio and video is embedded in the selected segment, and the interface is embodied in the form of a physical button or a floating ball.
The method according to claim 1, wherein the adding the selected segment to the video list interface for display comprises:

Adding the selected segment to the video list interface, and determining loading information of the video list interface including the selected segment;

According to the loading information, load the video list interface including the selected segment and display the selected segment.
A selected fragment processing device, including:

The audio and video generation module is configured to generate the audio and video of the target song according to the recorded audio content and image content of the target song;

The selected segment generating module is configured to save the audio and video when a saving event is detected, and determine a segment with a preset duration from the audio and video as the selected segment;

A display module is added, which is set to add the selected fragments to the video list interface for display when a publishing event is detected.
An electronic device including:

One or more processors;

Memory, set to store one or more programs;

The one or more programs are executed by the one or more processors, so that the one or more processors implement the selected fragment processing method according to any one of claims 1-7.
A readable medium having a computer program stored on the readable medium, and when the computer program is executed by a processor, the selected segment processing method according to any one of claims 1-7 is realized.