WO2014190786A1

WO2014190786A1 - Asynchronous chorus method and device

Info

Publication number: WO2014190786A1
Application number: PCT/CN2014/072300
Authority: WO
Inventors: 张鹏飞; 杨振宇; 张啸; 林形省
Original assignee: 小米科技有限责任公司
Priority date: 2013-05-30
Filing date: 2014-02-20
Publication date: 2014-12-04
Also published as: EP3007163B1; CN103295568A; KR101686632B1; CN103295568B; JP6085036B2; KR20150079763A; BR112015015358B1; RU2635835C2; MX2015007251A; MX361534B; JP2016504618A; RU2015121498A; EP3007163A4; EP3007163A1; BR112015015358A2

Abstract

An asynchronous chorus method and device, which are used for solving the problems of a poor chorus effect, a complex processing process and high costs. The method comprises: after receiving an audio file uploaded by a terminal which requests the use of a first obbligato file to participate in a chorus, marking a part in the audio file, which has a mixed sound and is not marked, as a part which has already been chorused (101); and determining the marked audio file as a second obbligato file (102). Therefore, chorists can sing their own parts at different times and different places, which will not lead to a poor chorus effect due to crowding or that the sound has a difference in volume and distance. In addition, when singing the parts of their own, each user can sing many times or separately process the part sung thereby, without influencing the parts sung by other users, therefore it will not lead to the situation where the whole song has to be sung again because of the poor performance of one user.

Description

The present invention is based on the Chinese Patent Application No. 201310210338.5, filed on Jan. Application as a reference. Technical field

The embodiments of the present disclosure relate to the field of network technologies, and in particular, to an asynchronous chorus method and apparatus. Background technique

With the rapid development of intelligent mobile terminals, they have more and more functions. At present, the mobile terminal has a social karaoke application, and the application has built-in reverberation and echo effects, which can modify the user's voice. In addition to providing accompaniment, the app also provides the lyrics corresponding to the accompaniment. It can be displayed synchronously when K songs, and can be accurate to each word like KTV. In addition, the app also provides interesting intelligent scoring function, and the score is obtained. Can be shared with friends.

At present, when a κ song is played on a mobile terminal, a single κ song is generally used, and after being sung, it is submitted to the server for saving and display, and the rest of the users who use the application can play the song and make an evaluation. If you want more people to sing, you need more users to sing at the same mobile terminal at the same time. After singing, submit it to the server for saving.

However, when the above method is chorus, multiple users are required to sing at the same mobile terminal at the same time, and after the sing is finished, they are submitted to the server for processing, and the vocalization of the user may have a difference in size and distance, which leads to a chorus effect. Poor; and, if there is a user who performs poorly during the chorus, the song may be re-chosed, and the server has to re-process the songs of the chorus, which is cumbersome and costly. Summary of the invention

The embodiment of the present disclosure provides an asynchronous chorus method and device to solve the problem that the chorus effect is poor, the processing process is cumbersome, and the cost is high.

According to a first aspect of the embodiments of the present disclosure, an embodiment of the present disclosure discloses an asynchronous chorus method, the method comprising: after receiving an audio file uploaded by a terminal requesting to use a first accompaniment file to participate in a chorus, marking the audio file has The part that is mixed and not marked is part of the chorus;

The annotated audio file is determined as a second accompaniment file; wherein the audio file is formed by encoding, by the terminal participating in the chorus using the first accompaniment file, the acquired audio information and the downloaded first accompaniment file.

Optionally, the method further comprises: transmitting the second accompaniment file to a terminal requesting to participate in the chorus using the second accompaniment file.

Optionally, the part of the audio file that has a mixed sound and is not labeled is used as a part of the chorus, and includes:

Obtaining an audio information location in the audio file; Parsing a portion of the audio information position having a sound, the portion of the sound being encoded by the collected audio information and the first accompaniment file;

The portion of the audio file that has a mix and is not labeled is labeled as part of the chorus.

Changing a color of the display text corresponding to the portion of the audio file that has a mix and is not labeled;

and / or,

A portion of the audio file that has a mix and is not labeled is marked with a text in the name of the audio file. Optionally, after receiving the audio file uploaded by the terminal that requests to use the first accompaniment file to participate in the chorus, the method further includes:

Receiving the volume information of the collected audio information in the audio file uploaded by the terminal participating in the chorus using the first accompaniment file;

The volume information is sent to a terminal requesting to participate in the chorus using the second accompaniment file, prompting the user to perform the chorus using the volume.

Optionally, the method further includes:

Marking the paragraph for the chorus of the initial accompaniment file, and sending the annotated initial accompaniment file to the terminal requesting to participate in the chorus using the initial accompaniment file;

The initial accompaniment file after the annotation includes at least one paragraph.

Optionally, the paragraph for chorus marking the initial accompaniment file includes:

Reading a time interval between each of the two characters in the initial accompaniment file;

Comparing the time interval with a preset threshold;

When the time interval between two words is greater than the preset threshold, a paragraph end is marked between the two words.

According to a second aspect of an embodiment of the present disclosure, the present disclosure also discloses another asynchronous chorus method, the method comprising: collecting audio information, and encoding the audio information with a first accompaniment file downloaded from a server to form an audio Document

The portion of the audio file that has a mix and is not labeled is marked as part of the chorus, and the annotated audio file is uploaded to the server.

Obtaining an audio information location in the audio file;

And analyzing a portion of the audio information position having a sound, the portion of the sound being encoded by the collected audio information and the first accompaniment file;

Optionally, the part of the audio file that has a mixed sound and is not labeled is used as a part of the chorus, and the package Includes:

and / or,

A portion of the audio file that has a mix and is not labeled is marked with a text in the name of the audio file. Optionally, after the uploading the annotated audio file to the server, the method further includes:

Recording volume information of the collected audio information in the audio file, and uploading the volume information to the service

TO

According to a third aspect of the embodiments of the present disclosure, the present disclosure also discloses an asynchronous chorus device, characterized in that the device comprises:

a first labeling module, configured to: after receiving an audio file uploaded by a terminal that requests to use the first accompaniment file to participate in the chorus, labeling the portion of the audio file that has a mixed sound and is not marked as a part of the chorus;

a determining module, configured to determine the annotated audio file as a second accompaniment file; wherein the audio file is used by the terminal that requests to use the first accompaniment file to participate in the chorus to perform the collected audio information and the downloaded first accompaniment file The code is formed.

Optionally, the device further includes:

And a first sending module, configured to send the second accompaniment file to a terminal that requests to participate in the chorus using the second accompaniment file.

Optionally, the first labeling module includes:

a first obtaining submodule, configured to acquire an audio information location in the audio file;

a first analysis submodule, configured to analyze a portion of the audio information location having a sound, the portion of the sound being encoded by the collected audio information and the first accompaniment file;

The first mix labeling sub-module is used to mark a part of the audio file that has a mix and is not labeled as a part of the chorus.

Optionally, the first mixing annotation sub-module includes:

a first change subunit, configured to change a color of the display text corresponding to the portion of the audio file that has a mix and is not labeled;

and / or,

a first labeling subunit for labeling, in the name of the audio file, a portion of the audio file that has a mix and is not labeled.

Optionally, the device further includes:

a receiving module, configured to: after receiving an audio file uploaded by a terminal that requests to use the first accompaniment file to participate in the chorus, receive the volume information of the collected audio information in the audio file that is requested by the terminal participating in the chorus using the first accompaniment file;

And a second sending module, configured to send the volume information to a terminal that requests to use the second accompaniment file to participate in the chorus, and prompt the user to perform the chorus by using the volume. Optionally, the device further includes:

a second labeling module, for marking a paragraph of the initial accompaniment file for chorus;

a third sending module, configured to send an initial accompaniment file marked by the second labeling module to a terminal requesting to participate in chorus using the initial accompaniment file;

Optionally, the second labeling module includes:

a reading submodule, configured to read a time interval between each two characters in the initial accompaniment file;

a comparison submodule, configured to compare the time interval with a preset threshold;

The text labeling sub-module is configured to mark the end of a paragraph between the two characters when the time interval between the two characters is greater than the preset threshold.

According to a fourth aspect of the embodiments of the present disclosure, the present disclosure further discloses another asynchronous chorus device, characterized in that the device comprises:

An encoding module, configured to collect audio information, and encode the audio information with a first accompaniment file downloaded from a server to form an audio file;

The third labeling module is configured to mark the portion of the audio file that has a mix and is not labeled as a part of the chorus, and upload the marked audio file to the server.

Optionally, the third labeling module includes:

a third obtaining submodule, configured to acquire an audio information location in the audio file;

a third analysis submodule, configured to analyze a portion of the audio information location having a sound, the portion of the sound being encoded by the collected audio information and the first accompaniment file;

A third mixing annotation sub-module for labeling a portion of the audio file that has a mix and is not labeled as a portion of the chorus.

Optionally, the third mixing annotation sub-module includes:

a third change subunit, configured to change a color of the display text corresponding to the portion of the audio file that has a mix and is not labeled;

and / or,

And a third labeling subunit, configured to mark, in the name of the audio file, a portion of the audio file that has a mix and is not labeled.

Optionally, the device further includes:

The record uploading module is configured to: after uploading the annotated audio file to the server, record volume information of the collected audio information in the audio file, and upload the volume information to the server.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

In the asynchronous chorus method proposed in the embodiment of the present disclosure, after receiving the audio file uploaded by the terminal requesting to use the first accompaniment file to participate in the chorus, the part of the audio file having the mixed sound and not marked is used as the part of the chorus; The annotated audio file is determined to be a second accompaniment file; wherein the audio file is for requesting to use the first accompaniment file The chorus terminal encodes the collected audio information with the downloaded first accompaniment file. When a user chorus, the user's terminal can download the audio files of other users' chorus as the accompaniment files of their own chorus, so that the chorus can sing their own parts at different times and in different places without being crowded or sounded by people. There are differences in size and distance, which leads to poor chorus effect. In addition, each user can sing multiple times or sing part of their own singing while singing their own parts, without affecting the parts sung by other users, so This can lead to a re-singing of the entire song due to a poor user performance.

The above general description and the following detailed description are intended to be illustrative and not restrictive. DRAWINGS

The accompanying drawings, which are incorporated in the specification of FIG

1 is a flowchart of an asynchronous chorus method according to an exemplary embodiment;

2 is a flowchart of an asynchronous chorus method according to an exemplary embodiment 2;

3 is a flowchart of an asynchronous chorus method according to an exemplary embodiment 3;

4 is a flowchart of an asynchronous chorus method according to an exemplary embodiment 4;

FIG. 5 is a schematic diagram of an annotated initial accompaniment file according to an exemplary embodiment 5; FIG.

6 is a structural block diagram of an asynchronous chorus device according to an exemplary embodiment 6;

7 is a structural block diagram of an asynchronous chorus device according to an exemplary embodiment 7;

FIG. 8 is a structural block diagram of an asynchronous chorus apparatus according to an exemplary embodiment 8; FIG.

FIG. 9 is a structural block diagram of an asynchronous chorus apparatus according to an exemplary embodiment 9. detailed description

The above described objects, features and advantages of the present invention will become more apparent from the aspects of the appended claims.

In the asynchronous chorus method and apparatus proposed by the present invention, the chorus can sing its own parts at different times and in different places without being cumbersome due to crowded people or differences in size and distance of the sound, and each The user can process the part he sings separately without affecting the part that other users sing.

Embodiment 1:

At present, when chorus is performed, multiple users are required to sing at the same mobile terminal at the same time, and after the sing is finished, they are submitted to the server for processing, and the vocalization of the user may have a difference in size and distance, resulting in poor chorus effect; Moreover, if there is a user who performs poorly during the chorus, the song may be re-chosed, and the server needs to re-process the song of the chorus. The process is cumbersome and costly.

In view of the above problems, the embodiment of the present disclosure proposes an asynchronous chorus method, which can solve the above problem. Referring to FIG. 1 , a flowchart of an asynchronous chorus method according to Embodiment 1 of the present disclosure is shown. Includes:

In step 101, after receiving the audio file requested by the terminal participating in the chorus using the first accompaniment file, the portion of the audio file having the mixed sound and not marked is used as the chorus portion.

In the embodiment of the present disclosure, when a plurality of users are chorus, they may be performed by using different terminals. The terminal provided by the embodiment of the present disclosure may be a smart phone, a tablet, or the like.

When the user who requests the terminal using the first accompaniment file to participate in the chorus performs the chorus, the first accompaniment file may be downloaded from the server first, and then the terminal that uses the first accompaniment file to participate in the chorus collects the audio information of the user, and may collect the audio information. The audio information is encoded with the first accompaniment file downloaded by the terminal requesting the accompaniment using the first accompaniment file to form an audio file corresponding to the terminal requesting to participate in the chorus using the first accompaniment file, and uploaded to the server.

After receiving the audio file uploaded by the terminal using the first accompaniment file to participate in the chorus, the server may mark the portion of the audio file that has a mix and is not marked as a part of the chorus. The audio file is a terminal that requests to use the first accompaniment file to participate in the chorus to encode the collected audio information and the downloaded first accompaniment file.

In step 102, the annotated accompaniment file is determined as the second accompaniment file.

After the audio file uploaded by the terminal requesting the accompaniment using the first accompaniment file is marked, the labeled accompaniment file may be determined as the second accompaniment file. When the user who requests the terminal participating in the chorus using the second accompaniment file participates in the chorus, the second accompaniment file described above can be downloaded from the server, and the second accompaniment file can be directly used to participate in the chorus.

The specific process for each of the above steps will be discussed in detail in the second embodiment below.

In the embodiment of the present disclosure, when a user choruses, the user's terminal can download the audio files of other users' chorus as the accompaniment files of their own chorus, so that the chorus can sing their own parts at different times and in different places without Due to the crowded people or the difference in size and distance between the sounds, the chorus effect is poor. In addition, each user can sing multiple times or sing the part they sing separately without affecting other users while singing their own parts. The part of the singer, therefore, does not lead to the re-singing of the entire song due to a poor performance of one user.

Embodiment 2:

In the following, the asynchronous chorus method of the first embodiment is described in detail through the second embodiment of the present disclosure.

Referring to FIG. 2, a flowchart of an asynchronous chorus method according to Embodiment 2 of the present disclosure is shown, which may include:

In step 201, the paragraph for the chorus of the initial accompaniment file is marked, and the annotated initial accompaniment file is sent to the terminal requesting to participate in the chorus using the initial accompaniment file.

In an embodiment of the present disclosure, the initial accompaniment file may be annotated first, and the annotated initial accompaniment file may be sent to a terminal requesting to participate in the chorus using the initial accompaniment file. The labeled initial accompaniment file may include at least one paragraph.

In one embodiment, the initial accompaniment file can be automatically annotated with a read time interval. Therefore The above process for marking the passage of the initial accompaniment file for chorus may include:

Al, reading the time interval between each two words in the initial accompaniment file;

A2, comparing the above time interval with a preset threshold;

A3, when the time interval between two words is greater than the preset threshold, mark the end of a paragraph between two words.

The annotation proposed in the embodiment of the present disclosure may be marked with a special symbol (for example, a dot) between two characters. At this time, the two characters exist in two paragraphs in the accompaniment file, and the special symbol can be used as a The mark at the end of the paragraph; or distinguish between male and female singers, between the two words marked "male:" or "female:", at this time, the two words exist in the two paragraphs in the accompaniment file, the mark "male: "Or" female: "Can be used as a mark for the end of a paragraph.

Of course, the initial accompaniment file may be labeled in other manners, for example, by using different color labels, etc., and the embodiment of the present disclosure does not limit this.

For example, with the above description of "male:" or "female:", the following lyrics can be marked as follows: "Female: Clear my heart

Longing for a true affection

I used to hurt my heart for love.

Why is sweet dreams easy to wake up?

Male: You have a gentle eye.

You have a compassionate mind

Please let me close if you like

I think you will understand my heart."

By labeling the accompaniment file by judging the time interval between each two characters, the labeling can be made more accurate. For the specific value of the above-mentioned preset threshold value, those skilled in the art can set according to actual experience.

Of course, the embodiment of the present disclosure may also mark the initial accompaniment file in other manners, for example, according to the pitch of the accompaniment, and the like, which is not limited by the embodiment of the present disclosure.

In step 202, after receiving the audio file requested by the terminal participating in the chorus using the first accompaniment file, the part of the audio file having the mixed sound and not marked is used as the part of the chorus.

In the embodiment of the present disclosure, for a song, chorus can be performed by multiple users through different terminals. When the user who requests the terminal participating in the chorus is chorus, the terminal requesting to participate in the chorus can collect the audio information of the user, and then encode the audio information with the accompaniment file downloaded by the terminal participating in the chorus to form an audio file, and finally can The encoded audio file is uploaded to the server.

In the embodiment of the present disclosure, after receiving the audio file uploaded by the terminal requesting to participate in the chorus, the server may mark the portion of the audio file that has a mix and is not marked as a part of the chorus.

The process of the above-mentioned labeled audio file having a mixed and unlabeled portion as a part of the chorus may include: bl, obtaining an audio information position in the audio file; Hi, analyzing the portion of the audio information position that has a mix, and the portion of the mix is formed by encoding the collected audio information with the first accompaniment file;

B3, label the portion of the audio file that has a mix and is not labeled as part of the chorus.

In the embodiment of the present disclosure, the portion of the audio file that has a mix and is not labeled may be marked in the following manner:

Changing the color of the display text corresponding to the portion of the audio file that has a mix and is not labeled (for example, the color of the display text corresponding to the portion of the audio file that is not mixed is black, then the audio file may have a mix and is not The color of the displayed text corresponding to the marked part is marked in red); or the text in the audio file is marked with a portion of the audio file that has a mix and is not marked (for example, the text in the name of the audio file can be used to indicate Which part I sang). Of course, the above two types of labeling may be performed on the portion of the audio file that has been mixed and not labeled. The embodiment of the present disclosure does not limit this.

In the embodiment of the present disclosure, the portion of the audio file that has a mix and is not labeled may be marked as a part of the chorus in other manners, for example, the text corresponding to the part with the mix and not marked is bolded, and the like. The embodiment of the present disclosure does not limit this.

In step 203, the annotated audio file is determined as the second accompaniment file.

After the audio file is marked, the labeled audio file can be determined as the second accompaniment file, and the user requesting the terminal participating in the chorus using the second accompaniment file can sing according to the second accompaniment file.

In step 204, the second accompaniment file is sent to the terminal requesting to participate in the chorus using the second accompaniment file. When the terminal requesting the chorus using the second accompaniment file requests the chorus, the server may transmit the determined second accompaniment file to the terminal requesting to participate in the chorus using the second accompaniment file. Since different paragraphs are marked in the initial accompaniment file, the user who requests the terminal to participate in the chorus using the second accompaniment file can chorus the paragraph corresponding to itself according to the label in the initial accompaniment file, and is marked in the second accompaniment file downloaded. The chorus part is chorus.

After requesting the terminal that participates in the chorus using the second accompaniment file to collect the audio information of the user, the collected audio information may be encoded with the second accompaniment file, an audio file is generated, and the audio file is uploaded to the server, and then the audio file is uploaded to the server. The audio file uploaded by the terminal participating in the chorus is requested to be marked with the second accompaniment file, and the above process is repeated.

In step 205, volume information belonging to the collected audio information among the audio files requested by the terminal participating in the chorus using the first accompaniment file is received.

In order to further improve the effect of the chorus, a volume reminder may also be adopted in the embodiment of the present disclosure. When a user of a terminal requesting participation in the chorus is chorusing, the terminal can record the volume information of the collected audio information, and then upload the volume information of the collected audio information to the server.

Therefore, in the embodiment of the present disclosure, after receiving the audio file uploaded by the terminal requesting to use the first accompaniment file to participate in the chorus, the audio information uploaded by the terminal requesting to use the first accompaniment file to participate in the chorus may be received. Volume information. In step 206, the volume information is sent to the terminal requesting to participate in the chorus using the second accompaniment file, prompting the user to perform the chorus with the volume.

After receiving the volume information uploaded by the terminal requesting to participate in the chorus using the first accompaniment file, the server may send the volume information to the terminal requesting to use the second accompaniment file to participate in the chorus, so that the user of the terminal can be prompted to perform the chorus using the above volume.

Since there is a volume prompt, the user who requests the terminal participating in the chorus using the second accompaniment file can adjust the chorus volume of the user who uses the first accompaniment file to participate in the chorus terminal as requested, thereby further enhancing the effect of the chorus.

The above steps 205-206 may also be performed before step 203, or step 203 and step 205 may be performed side by side, step 204 and step 206 may be performed side by side, and so on, the specific sequence of the above steps is not used in the embodiment of the present disclosure. limit.

In the asynchronous chorus method proposed by the embodiment of the present disclosure, the chorus can sing its own parts at different times and in different places, without causing poor chorus effect due to crowdedness of the people or the difference in size and distance of the sound, and each The user can separately process the part that he sings without affecting the part that other users sing; in addition, the embodiment of the present disclosure can also record the volume information of the user chorus of the terminal requesting to participate in the chorus, and prompt the next request to participate. The user of the chorus terminal uses the volume to perform the chorus, thereby further enhancing the effect of the chorus.

The first embodiment and the second embodiment are mainly introduced from the server side to the asynchronous chorus method. The following describes the third embodiment and the fourth embodiment from the terminal side.

Embodiment 3:

Referring to FIG. 4, a flowchart of an asynchronous chorus method according to Embodiment 3 of the present disclosure is shown, which may include:

In step 301, audio information is collected, and the audio information is encoded with the first accompaniment file downloaded from the server to form an audio file.

When the terminal requesting to use the first accompaniment file to participate in the chorus requests to participate in the chorus, the first accompaniment file may first be downloaded from the server, and then when the user performs the chorus, the terminal may collect the audio information of the user, and then download the audio information with the slave server. The first accompaniment file is encoded to form an audio file.

In step 302, the portion of the audio file that has a mix and is not labeled is part of the chorus, and the annotated audio file is uploaded to the server.

After encoding the audio file, the terminal may mark the portion of the audio file that has a mix and is not labeled as a chorus portion, and upload the marked audio file to the server.

After receiving the annotated audio file, the server may use the labeled audio file as the second accompaniment file, and the terminal requesting to use the second accompaniment file to participate in the chorus may download the second accompaniment file from the server and directly use the second accompaniment. The document participates in the chorus.

The specific process for each of the above steps will be discussed in detail in Example 4 below.

In the embodiment of the present disclosure, when a user choruses, the user's terminal can download audio files sung by other users. The piece is used as an accompaniment file of its own chorus, so that the chorus can sing his own parts at different times and in different places, without causing poor chorus effect due to crowded people or differences in size and distance.

Embodiment 4:

Hereinafter, the asynchronous chorus method of the above-described third embodiment will be described in detail through Embodiment 4 of the present disclosure.

Referring to FIG. 4, a flowchart of an asynchronous chorus method according to Embodiment 4 of the present disclosure is shown, which may include:

In step 401, audio information is collected, and the audio information is encoded with the first accompaniment file downloaded from the server to form an audio file.

The terminal requesting to participate in the chorus using the first accompaniment file can collect the audio information of the chorus user, and then encode the audio information with the first accompaniment file downloaded from the server to form an audio file.

In step 402, the portion of the audio file that has a mix and is not labeled is part of the chorus, and the annotated audio file is uploaded to the server.

In the embodiment of the present disclosure, the foregoing labeling process may be implemented by requesting a terminal participating in the chorus. The process of having the mixed and unlabeled portion of the annotated audio file as the chorus portion may include:

Cl, obtain the location of the audio information in the audio file;

C2, analyzing a portion of the audio information position having a sound, and the portion of the sound is formed by encoding the collected audio information and the first accompaniment file;

C3, the portion of the audio file that has a mix and is not labeled as part of the chorus.

In the embodiment of the present disclosure, the portion of the audio file that is mixed and unlabeled in the above-mentioned c3 may be implemented as the part of the chorus in the following manner:

Change the color of the display text corresponding to the portion of the audio file that has a mix and is not labeled; or, in the name of the audio file, mark the portion of the audio file that has a mix and is not labeled.

Of course, the implementation of the present disclosure can also perform the above two annotations on portions of the audio file that have a mix and are not labeled.

In step 403, the volume information belonging to the collected audio information in the audio file is recorded, and the volume information is uploaded to the server.

In order to further improve the effect of the chorus, a volume reminder may also be adopted in the embodiment of the present disclosure. When the user who requests the terminal participating in the chorus using the first accompaniment file is chorus, the terminal can record the volume information of the collected audio information, and then upload the volume information of the collected audio information to the server.

After receiving the above-mentioned audio file and volume information uploaded by the terminal that uses the first accompaniment file to participate in the chorus, the server may use the above-mentioned labeled audio file as the second accompaniment file, and the user who requests the terminal using the second accompaniment file is participating. When chorusing, the second accompaniment file can be directly downloaded from the server for chorus, and the above volume information can be acquired at the same time to prompt the user to use the volume for chorus.

The above various processes in the embodiments of the present disclosure are not limited to the execution of the terminal requesting to participate in the chorus using the first accompaniment file, and any one terminal can be executed. In the embodiment of the present disclosure, the volume information of the user chorus of the terminal requesting the chorus may be recorded, and the user of the terminal requesting the chorus is prompted to perform the chorus by using the volume, thereby further improving the effect of the chorus.

Embodiment 5:

Next, the above asynchronous chorus method will be introduced through a public example.

First, the initial accompaniment file is marked by the server, and the initial accompaniment file after labeling is shown in FIG. 5. As can be seen from FIG. 5, the initial accompaniment file after the annotation may include three parts A, B, and C. The three terminals may sing the three parts separately. For example, the user A's terminal may sing the label A. In part, the part marked B is sung by the terminal of the user B, and the part marked C is sung by the terminal of the user C. The specific process for labeling is described in the description of the server side below.

The asynchronous chorus method proposed by the embodiment of the present disclosure will be described below for the terminal side and the server side, respectively. Terminal side:

1. User A's terminal downloads and plays the initial accompaniment file marked above from the server, and user A sings the part marked with A. The terminal of user A collects the audio information of user A, and records the volume information of the audio information of user A. The terminal of user A encodes the collected audio information and the initial accompaniment file to generate a song XI (ie, an audio file), and passes The terminal of the user A uploads the song XI and the volume information of the above user A to the server.

2. The user B's terminal downloads and plays the song XI from the server, uses it as a accompaniment, and prompts the user B to sing according to the volume information of the user A (for example, prompting in a waveform form), and the user B continues to sing. Mark the part of B. The terminal of the user B collects the audio information of the user B, and records the volume information of the audio information of the user B. The terminal of the user B encodes the collected audio information and the song XI to generate a song X2, and the song is sent through the terminal of the user B. The volume information of X2 and the above user B is uploaded to the server.

3. The terminal of the user C downloads and plays the song X2 from the server, uses it as an accompaniment, and prompts the volume of the user C to sing according to the volume information of the user B, and the user C continues to sing the part marked with C. The terminal of the user C collects the audio information of the user C, and records the volume information of the audio information of the user C. The terminal of the user C encodes the collected audio information and the song X2 to generate a song X3, and the song is played through the terminal of the user C. The volume information of X3 and the above user C is uploaded to the server, thereby completing the entire song.

Server side:

It mainly includes the following two parts:

1. Mark the initial accompaniment file, that is, mark the different parts of the initial accompaniment file.

For example, you can manually label the initial accompaniment file, or follow the interval between the lyrics in the song. Of course, the initial accompaniment file may be labeled in other ways, which is not limited by the embodiment of the present disclosure. For the specific process of the labeling, reference may be made to the related description of the second embodiment, and the embodiments of the present disclosure are not discussed in detail herein.

In the embodiment of the present disclosure, the initial file may be marked as three parts, as shown in FIG. 3, that is, labeled as part A, part B, and part C.

Second, processing the song uploaded by the terminal (ie audio file) i. When receiving the song uploaded by the terminal, determining the sung part of the song according to the audio information location of the song. For example, the portion of the song that has a mix can be analyzed. For a specific process, refer to the related description of the second embodiment.

Ii, further annotating the uploaded song according to the annotation of the initial accompaniment file and the sung part determined in the received uploaded song.

Taking the song XI as an example, the lyrics of the part A that has been sung can be marked with different colors, or the part A of the song XI is marked, and the color of the lyrics and the name of the song can be marked at the same time.

Iii. Send the marked song and the volume information uploaded by the current terminal to the next requested terminal.

In the embodiment of the present disclosure, the foregoing labeling process is implemented by a server. It should be noted that the labeling process may also be implemented by a terminal, which is not limited by the embodiment of the disclosure.

Embodiments of the present disclosure have the following beneficial effects:

(1) The chorus can sing his own parts at different times and in different places.

(2) Each user can sing multiple times or sing their own voice separately when they sing their own parts, without affecting other users (for example, reverb or other sound effects can be provided, the part that the user sings himself There are special effects while the other users' sounds are unchanged).

(3) There will be no chorus effect due to crowding.

For the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present disclosure is not limited by the described action sequence, because according to the present disclosure, These steps can be performed in other orders or simultaneously. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the present disclosure.

Example 6:

Referring to FIG. 6, a structural block diagram of an asynchronous chorus device according to Embodiment 6 of the present disclosure is shown. The device may be a server-side device that interacts with the terminal side.

The above device may include:

The first labeling module 601 is configured to: after receiving the audio file uploaded by the terminal requesting to participate in the chorus, label the portion of the audio file that has a mix and is not marked as a part of the chorus;

The determining module 602 is configured to determine the annotated audio file as the second accompaniment file.

The audio file is formed by encoding the collected audio information and the downloaded first accompaniment file for the terminal requesting to use the first accompaniment file to participate in the chorus.

Example 7: Referring to FIG. 7, a structural block diagram of an asynchronous chorus device according to Embodiment 7 of the present disclosure is shown. The device may be a server-side device that interacts with the terminal side.

The device can include:

a second labeling module 701, configured to mark a paragraph of the initial accompaniment file for chorus;

The second labeling module 701 can include:

The reading sub-module 7011 is configured to read a time interval between each two characters in the initial accompaniment file; the comparison sub-module 7012 is configured to compare the time interval with a preset threshold;

The text labeling sub-module 7013 is configured to mark the end of a paragraph between two characters when the time interval between the two characters is greater than a preset threshold.

a third sending module 702, configured to send an initial accompaniment file marked by the second labeling module to a terminal that requests to use the initial accompaniment file to participate in the chorus;

The first labeling module 703 is configured to: after receiving the audio file uploaded by the terminal that requests to use the first accompaniment file to participate in the chorus, mark the portion of the audio file that has a mixed sound and is not labeled as a part of the chorus;

The first labeling module 703 can include:

a first obtaining submodule 7031, configured to acquire an audio information location in the audio file;

a first analysis sub-module 7032, configured to analyze a portion of the audio information location having a sound, and the portion of the sound is encoded by the collected audio information and the first accompaniment file;

The first mix labeling sub-module 7033 is used to mark the portion of the audio file that has a mix and is not labeled as a part of the chorus.

The first mix labeling sub-module 7033 can include:

a first change subunit, configured to change a color of a display text corresponding to a portion of the audio file that has a mix and is not labeled;

and / or,

The first labeling subunit is used to mark, in the name of the audio file, the portion of the audio file that has a mix and is not marked.

a determining module 704, configured to determine the annotated audio file as a second accompaniment file;

The first sending module 705 is configured to send the second accompaniment file to the end of the request to use the second accompaniment file to participate in the chorus

3⁄4 ;

The receiving module 706 is configured to: after receiving the audio file uploaded by the terminal that requests to use the first accompaniment file to participate in the chorus, receive the volume information of the audio information that is requested to be collected by the terminal that participates in the chorus using the first accompaniment file;

a second sending module 707, configured to send the volume information to the terminal that requests to use the second accompaniment file to participate in the chorus, Prompt the user to use the volume for chorus.

In the asynchronous chorus device proposed in the embodiment of the present disclosure, the chorus can sing its own parts at different times and in different places without being cumbersome due to crowded people or the difference in size and distance of the sound, and each The user can separately process the part that he sings without affecting the part that other users sing; in addition, the embodiment of the present disclosure can also record the volume information of the user chorus of the terminal requesting to participate in the chorus, and prompt the next request to participate. The user of the chorus terminal uses the volume to perform the chorus, thereby further enhancing the effect of the chorus.

Example 8:

Referring to FIG. 8, a structural block diagram of an asynchronous chorus device according to Embodiment 8 of the present disclosure is shown. The device may be a device on the terminal side, which interacts with the server side.

The above device may include:

The encoding module 801 is configured to collect audio information, and encode the audio information with the first accompaniment file downloaded from the server to form an audio file;

The third labeling module 802 is configured to label the portion of the audio file that has a mix and is not labeled as a part of the chorus, and upload the marked audio file to the server.

In the embodiment of the present disclosure, when a user choruses, the user's terminal can download the audio files of other users' chorus as the accompaniment files of their own chorus, so that the chorus can sing their own parts at different times and in different places without The chorus effect is poor due to crowded people or differences in size and distance.

Example 9:

Referring to FIG. 9, a block diagram of a structure of an asynchronous chorus device according to Embodiment 9 of the present disclosure is shown. The device may be a device on the terminal side, which interacts with the server side.

The above device may include:

The encoding module 901 is configured to collect audio information, and encode the audio information with the first accompaniment file downloaded from the server to form an audio file;

a third labeling module 902, configured to mark a portion of the audio file that has a mix and is not labeled as a part of the chorus, and upload the marked audio file to the server;

The third annotation module 902 can include:

a third obtaining sub-module 9021, configured to acquire an audio information location in the audio file;

a third analysis sub-module 9022, configured to analyze a portion of the audio information location having a sound, and the portion of the sound is encoded by the collected audio information and the first accompaniment file;

The third mix labeling sub-module 9023 is used to mark the portion of the audio file that has a mix and is not labeled as a part of the chorus.

The third mix labeling sub-module 9023 can include:

and / or, A third labeling sub-unit for labeling, in the name of the audio file, a portion of the audio file that has a mix and is not labeled.

The record uploading module 903 is configured to upload the annotated audio file to the server, record the volume information of the collected audio information in the audio file, and upload the volume information to the server.

The asynchronous chorus device proposed in the embodiment of the present disclosure can record the volume information of the user chorus of the terminal requesting the chorus, and prompts the user of the terminal requesting the chorus to use the volume to perform the chorus, thereby further improving the effect of the chorus. .

For the above various device embodiments, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiments.

The various embodiments in the present specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments can be referred to each other.

It will be readily apparent to those skilled in the art that any combination of the above embodiments is possible, and any combination between the above embodiments is an embodiment of the present invention, but due to space limitations, the present specification is hereby Not detailed one by one.

The invention may be described in the general context of computer-executable instructions executed by a computer, such as a program module. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules can be located in both local and remote computer storage media including storage devices.

Finally, it should also be noted that in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities. There is any such actual relationship or order between operations. Furthermore, the terms "comprising," "comprising," or "include" or "include" are intended to include a non-exclusive inclusion, such that a process, method, item, Other elements, or elements that are inherent to such a process, method, commodity, or equipment. In the absence of more restrictions, the elements defined by the statement "including one..." do not exclude the existence of additional identical elements in the process, method, commodity, or device that includes the element.

The above is a detailed description of an asynchronous chorus method and apparatus provided by the present invention. The principles and embodiments of the present invention are described herein by using specific examples. The description of the above embodiments is only for helping to understand the present invention. The method and its core idea; at the same time, those skilled in the art, according to the idea of the present invention, there will be changes in the specific embodiments and application scope. In summary, the content of the present specification should not be construed as being limit.

Claims

Rights request

1. An asynchronous chorus method, characterized in that the method includes:

After receiving the audio file uploaded by the terminal that requests to use the first accompaniment file to participate in the chorus, mark the part of the audio file that has mixing and is not marked as the part that has been chorused;

The marked audio file is determined as the second accompaniment file; wherein the audio file is formed by encoding the collected audio information and the downloaded first accompaniment file by the terminal requesting to use the first accompaniment file to participate in the chorus.

2. The method according to claim 1, further comprising: sending the second accompaniment file to a terminal requesting to use the second accompaniment file to participate in chorus.

3. The method according to claim 1, characterized in that, marking the portion of the audio file that has mixing and is not marked as a chorused portion includes:

Obtain the location of the audio information in the audio file;

Analyze the part with mixing in the audio information position, the part with mixing is formed by encoding the collected audio information and the first accompaniment file;

Mark the portion of the audio file that has a mix and is not marked as a chorused portion.

4. The method according to claim 3, characterized in that, marking the portion of the audio file that has mixing and is not marked as a chorused portion includes:

Change the color of the displayed text corresponding to the mixed and unmarked portion of the audio file; and/or,

In the name of the audio file, text is used to mark the unmarked portion of the audio file that contains mixing.

5. The method according to claim 1 or 3, characterized in that, after receiving the audio file uploaded by the terminal requesting to use the first accompaniment file to participate in the chorus, the method further includes:

Receive the volume information belonging to the collected audio information in the audio file uploaded by the terminal requesting to use the first accompaniment file to participate in the chorus;

The volume information is sent to the terminal requesting to use the second accompaniment file to participate in chorus, prompting the user to use the volume to perform chorus.

6. The method according to claim 1, characterized in that, the method further includes:

Mark the section of the initial accompaniment file used for chorus, and send the marked initial accompaniment file to the terminal that requests to use the initial accompaniment file to participate in chorus;

Wherein, the annotated initial accompaniment file includes at least one paragraph.

7. The method according to claim 6, characterized in that the marking of the paragraphs used for chorus in the initial accompaniment file includes:

Read the time interval between every two words in the initial accompaniment file;

Compare the time interval with a preset threshold;

When the time interval between two words is greater than the preset threshold, the end of a paragraph is marked between the two words.

8. An asynchronous chorus method, characterized in that the method includes:

Collect audio information, and encode the audio information and the first accompaniment file downloaded from the server to form an audio file;

Mark the mixed and unmarked portion of the audio file as the chorused portion, and upload the marked audio file to the server.

9. The method according to claim 8, characterized in that, marking the portion of the audio file that has mixing and is not marked as a chorused portion includes:

Obtain the location of the audio information in the audio file;

10. The method according to claim 9, characterized in that: marking the portion of the audio file that has mixing and is not marked as a chorused portion includes:

11. The method according to claim 8 or 9, characterized in that, after uploading the annotated audio file to the server, it further includes:

Record the volume information belonging to the collected audio information in the audio file, and upload the volume information to the server.

12. An asynchronous chorus device, characterized in that the device includes:

The first marking module is configured to, after receiving the audio file uploaded by the terminal that requests to use the first accompaniment file to participate in the chorus, mark the portion of the audio file that has mixing and has not been marked as the chorused portion;

Determining module, used to determine the marked audio file as the second accompaniment file; wherein, the audio file is the collected audio information and the downloaded first accompaniment file of the terminal requesting to use the first accompaniment file to participate in the chorus. Code formation.

13. The device according to claim 12, characterized in that, the device further includes:

A first sending module, configured to send the second accompaniment file to a terminal that requests to use the second accompaniment file to participate in chorus.

14. The device according to claim 12, characterized in that, the first annotation module includes: a first acquisition sub-module, used to acquire the audio information position in the audio file;

The first analysis sub-module is used to analyze the part with mixing in the audio information position. The mixing part is formed by encoding the collected audio information and the first accompaniment file;

The first mixing labeling sub-module is used to label the portion of the audio file that has mixing and has not been labeled as a chorused portion.

15. The device according to claim 14, characterized in that, the first mixing labeling sub-module includes: a first changing sub-unit, used to change the corresponding parts of the audio file that have mixing and are not labeled. The color of the displayed text;

and / or,

The first labeling subunit is used to label the unlabeled portion of the audio file that has mixing in text in the name of the audio file.

16. The device according to claim 12 or 14, characterized in that the device further includes:

A receiving module, configured to receive the volume information belonging to the collected audio information in the audio file uploaded by the terminal requesting to use the first accompaniment file to participate in the chorus after receiving the audio file uploaded by the terminal requesting to use the first accompaniment file to participate in the chorus;

The second sending module is configured to send the volume information to a terminal that requests to use the second accompaniment file to participate in chorus, and prompt the user to use the volume to perform chorus.

17. The device according to claim 12, characterized in that, the device further includes:

The second annotation module is used to annotate the chorus sections of the initial accompaniment file;

The third sending module is used to send the initial accompaniment file marked by the second annotation module to the terminal that requests to use the initial accompaniment file to participate in chorus;

18. The device according to claim 17, characterized in that, the second annotation module includes: a reading sub-module, used to read the time interval between every two words in the initial accompaniment file;

A comparison submodule, used to compare the time interval with a preset threshold;

The text marking submodule is used to mark the end of a paragraph between the two words when the time interval between the two words is greater than the preset threshold.

19. An asynchronous chorus device, characterized in that the device includes:

An encoding module, used to collect audio information, and encode the audio information and the first accompaniment file downloaded from the server to form an audio file;

The third marking module is used to mark the mixed and unmarked portion of the audio file as the chorused portion, and upload the marked audio file to the server.

20. The device according to claim 19, characterized in that the third annotation module includes: a third acquisition sub-module, used to acquire the audio information position in the audio file;

The third analysis sub-module is used to analyze the part with mixing in the audio information position. The mixing part is formed by encoding the collected audio information and the first accompaniment file;

The third mixing labeling submodule is used to mark the mixed and unlabeled portion of the audio file as a chorused portion.

21. The device according to claim 20, characterized in that, the third mixing labeling sub-module includes: a third changing sub-unit, used to change the corresponding parts of the audio file that have mixing and are not labeled. display text The color of the words;

and / or,

The third labeling subunit is used to label the unlabeled portion of the audio file that has mixing in text in the name of the audio file.

22. The device according to claim 19 or 20, characterized in that, the device further includes: a recording and uploading module, used to record the collected audio in the audio file after uploading the annotated audio file to the server. the volume information of the message, and uploads the volume information to the server.