WO2017101260A1

WO2017101260A1 - Method, device, and storage medium for audio switching

Info

Publication number: WO2017101260A1
Application number: PCT/CN2016/084260
Authority: WO
Inventors: 冯穗豫
Original assignee: 广州酷狗计算机科技有限公司
Priority date: 2015-12-15
Filing date: 2016-06-01
Publication date: 2017-06-22
Also published as: CN106887244A; CN106887244B

Abstract

Provided in the embodiments of the present invention are a method, a device, and a storage medium for audio switching. The method comprises: acquiring an audio file, the audio file being composed by splicing of a first audio clip and a second audio clip; when an audio clip switching operation is detected during the playback of the first audio clip, acquiring a current played length of the first audio clip, the current played length being the distance from the current playing position to the starting position of the audio file; and playing, in response to the audio clip switching operation, the audio from a target position of the audio file, the target position being a playing position on the second audio clip that the current played length of the first audio clip corresponds to.

Description

Audio switching method, device and storage medium

The present application claims priority to Chinese Patent Application No. 201510934171.6, entitled "Audio Switching Method and Apparatus", filed on Dec. 15, 2015, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present invention relates to the field of Internet technologies, and in particular, to an audio switching method, apparatus, and storage medium.

Background technique

With the improvement of living standards, K songs have become more and more popular in people's lives, and more and more users choose to use K songs through terminal applications, so that they can enjoy the fun of K songs without leaving home. During the singing process, the user generally chooses to play the song accompaniment. However, when there is a song passage that the user does not sing, the user needs to switch the song accompaniment to the original song of the song.

In order to switch between song accompaniment and song original sing, two separate audio files, accompaniment files and original vocal files, including song accompaniment and song vocals, and both audios are required. The file is decoded. When the user's switching operation is detected, the current playback position of the accompaniment file is jumped to the same playback position as the original singer file to ensure the continuity of the playback.

Summary of the invention

Embodiments of the present invention provide an audio switching method, apparatus, and storage medium.

An audio switching method method provided by an embodiment of the present invention includes:

Acquiring an audio file, the audio file being composed of a first audio segment and a second audio segment;

And detecting an audio segment switching operation in the process of playing the first audio segment, and acquiring a current playing length of the first audio segment, where the current playing length is a distance from a starting position of the audio file of the current playing position;

Playing in a target position of the audio file in response to the audio segment switching operation, the target location being a broadcast on a second audio segment corresponding to a current play length of the first audio segment Put the position.

An audio switching device provided by an embodiment of the present invention includes: a processor and a storage medium storing an operation instruction, when the operation instruction in the storage medium is executed, the processor executed performs the following steps:

In response to the audio segment switching operation, playing from a target location of the audio file, the target location being a playback location on a second audio segment corresponding to a current playback length of the first audio segment.

A non-transitory computer readable storage medium is provided with computer executable instructions. When the executable instructions are run in a computer, the following steps are performed:

By providing an audio file spliced by the first audio segment and the second audio segment, and when an audio switching operation is detected, a playback progress jump is performed inside the same audio file, so that the terminal can use only one audio file. Realizing the switching between the first audio segment and the second audio segment, so that it is not necessary to decode two audio files at the same time, and the decoder does not need to support the decoding capability of multi-channel and multi-audio streams, so it is suitable for all applications. Matching.

DRAWINGS

FIG. 1 is a flowchart of an audio switching method according to an exemplary embodiment;

FIG. 2 is a flowchart of an audio switching method according to an exemplary embodiment;

FIG. 3 is a schematic diagram of an audio play interface, according to an exemplary embodiment; FIG.

FIG. 4 is a block diagram of an audio switching device 500 according to an exemplary embodiment;

FIG. 5 is a block diagram of an audio switching device 600 according to an exemplary embodiment;

FIG. 6 is a schematic structural diagram of a terminal 700 according to an exemplary embodiment.

detailed description

The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

FIG. 1 is a flowchart of an audio switching method according to an exemplary embodiment. The method may be applied to a mobile phone, a personal computer, a tablet computer, etc., as shown in FIG. 1 , the audio switching method includes steps 101 to 103.

In step 101, the terminal acquires an audio file, which is composed of a first audio segment and a second audio segment.

In step 102, when the audio switching operation is detected in the process of playing the first audio segment, the terminal acquires the current playing length of the first audio segment, and the playing length is the distance of the current playing position from the starting position of the audio file.

In step 103, the terminal performs playback from the target location of the audio file in response to the audio segment switching operation, the target location being a playback position on the second audio segment corresponding to the current playback length of the first audio segment.

In summary, the audio switching method provided by this embodiment provides an audio file formed by splicing a first audio segment and a second audio segment, and plays inside the same audio file when an audio switching operation is detected. The jump of the progress enables the terminal to switch between the first audio segment and the second audio segment using only one audio file, so that it is not necessary to decode two audio files at the same time, and the decoder does not need to support multiple channels and multiple The decoding capability of the audio stream is therefore adaptable to all applications.

In a possible implementation manner, the first audio segment and the second audio segment are the same length;

When the first audio segment is located before the second audio segment, the distance of the target location from the start position of the audio file is the sum of the length of the first audio segment and the current playing length of the first audio segment;

When the first audio segment is located behind the second audio segment, the target position is away from the audio file start bit The set distance is the difference between the length of the second audio segment and the current playback length of the first audio segment.

In a possible implementation, before the acquiring the audio file, the audio switching method further includes:

Obtaining the first audio segment and the second audio segment;

Aligning the first audio segment and the second audio segment to synchronize the first audio segment with the second audio segment;

The first audio segment and the second audio segment are spliced.

In a possible implementation manner, when the lengths of the first audio segment and the second audio segment are not integer multiples of the preset length, the audio switching method further includes:

The length of the first audio segment or the length of the second audio segment is trimmed to an integer multiple of the preset length.

In a possible implementation, trimming the length of the first audio segment or the second audio segment to an integer multiple of the preset length includes:

Obtaining the number of sampling points of the first audio segment and the second audio segment;

Calculating the number of extended sampling points of the first audio segment or the second audio segment according to the expansion formula, the expansion formula is:

L _f =N×Int((L _o +N-1)/N)

Wherein, L _{f is} the number of the extended sampling points, L _o is the number of sampling points of the first audio segment or the second audio segment, N is the preset length, and Int is a rounding operation;

The first mute segment is spliced at the end of the first audio segment and the second audio segment to expand the number of sampling points of the first audio segment and the second audio segment to the number of the extended sampling points.

In a possible implementation, before the length of the first audio segment and the second audio segment are trimmed to a multiple of the preset length, the audio switching method further includes:

Detecting whether the lengths of the first audio segment and the second audio segment are equal;

If the lengths of the first audio segment and the second audio segment are not equal, obtaining a length difference, where the length difference is a difference in length between the first audio segment and the second audio segment;

The second mute segment is spliced to the shorter end of the audio file in the first audio segment and the second audio segment, the length of the second mute segment being the length difference.

In a possible implementation, after the acquiring the first audio segment and the second audio segment, the audio switching method further includes:

Detecting whether the tail mute segment of the first audio segment and the second audio segment exceeds a preset threshold, respectively;

If the preset threshold is exceeded, the trailing mute segments of the first audio segment and the second audio segment are cut.

In a possible implementation, after the audio file is obtained, the audio switching method further includes:

The length of the trimmed first audio segment is added to the label of the audio file.

In a possible implementation, the audio switching method further includes: before the playing the audio file according to the user's play selection operation, the audio switching method further includes:

Obtaining the length of the first audio segment from the label of the audio file;

or,

Obtaining, in the audio database, a length of the first audio segment, where the audio database is used to store the audio file and the corresponding first audio segment length;

or,

Get the total length of the audio file;

The length of the accompaniment audio segment is obtained, and the length of the first audio segment is one-half of the total length of the audio file.

In a possible implementation, after the playing the audio file, the audio switching method further includes:

When playing the audio file, detecting whether the play length is equal to the length of the first audio segment;

If the play length is equal to the length of the first audio segment, the playback of the audio file is stopped.

In any of the foregoing optional embodiments, any combination of the embodiments may be used to form an optional embodiment of the present invention, and details are not described herein again.

In all the above optional embodiments, the first audio segment may be an accompaniment audio segment of a song, and the second audio segment may be an original audio segment of the song; or the first audio segment may be the original of a song. The audio clip is sung, and the second audio clip can be an accompaniment audio clip of the song.

FIG. 2 is a flowchart of an audio switching method according to an exemplary embodiment. The method may be applied to a server, and may also be applied to a terminal such as a mobile phone, a personal computer, a tablet computer, and the like, and may also be applied to a server and a terminal. In this embodiment, the switching between the accompaniment and the original vocal in the K song scene is taken as an example. The audio switching method is described. As shown in FIG. 2, the audio switching method includes steps 201 to 210.

In step 201, an accompaniment audio file and an original singer audio file are acquired.

It should be noted that the accompaniment audio file and the original singer audio file may be stereo audio files, and the accompaniment audio file may be an audio file including only song accompaniment, and the original vocal audio file may include song accompaniment and song vocal singing. The audio file, and the accompaniment audio file has a corresponding relationship with the original vocal audio file. For example, if the accompaniment audio file is the "song A" accompaniment audio, the original vocal audio file should be the "song A" original singer audio. .

In addition, since the audio file of the PCM (Pulse Code Modulation) format facilitates subsequent operations of complementing, cutting, splicing, etc., the format of the accompaniment audio file and the original singer audio file may be in the PCM format, if the above accompaniment audio When the format of the file and the original singer audio file is WMA (Windows Media Audio, Microsoft Multimedia Audio) format, AAC (Advanced Audio Coding) format and other audio formats, it can be converted into PCM format to facilitate subsequent For example, the format of the accompaniment audio file and the original singer audio file may be other formats that are convenient to complete, cut, splicing, etc., and the invention is not specifically limited.

The accompaniment audio file and the original singer audio file acquired in step 201 may have silent segments at the head or the tail of the file, and these silent segments do not contribute to operations such as splicing of subsequent accompaniment audio files and original singer audio files, and are too long. The mute segment may increase the size of the accompaniment audio file and the original singer audio file, thereby causing waste of the storage space. Therefore, in an embodiment of the present invention, after the step 201, the audio switching method may further include the following steps: respectively detecting the Whether the accompaniment audio file and the head mute segment and the tail mute segment of the original audio file exceed a preset threshold; if the preset threshold is exceeded, the accompaniment audio file and the head mute segment of the original audio file are cut and Mute the tail.

It should be noted that the preset threshold may be set according to an actual application, and the specific content of the preset threshold is not limited in the present invention.

In step 202, the accompaniment audio file and the original vocal audio file are aligned to synchronize the accompaniment audio file with the original vocal audio file.

Although the accompaniment audio file obtained in step 201 has a corresponding relationship with the original singer audio file, the accompaniment audio file and the original singer audio file are not necessarily synchronized, that is, the accompaniment audio file may be compared with the original vocal The audio file is advanced or behind. For example, in the playback position at the same distance from the beginning of the file, the accompaniment audio file may play to the accompaniment corresponding to “segment a”, while the original audio file is played to “segment b”, accompaniment audio. If the file and the original vocal audio file are out of sync, the switching position will be wrong when the subsequent accompaniment and the original singer are switched, and the continuity of the playback cannot be guaranteed.

In order to solve this problem, step 202 is performed, that is, the accompaniment audio file and the original singer audio file are aligned. In specific implementation, the PCM cross-correlation or the like can be used to determine whether the accompaniment audio file and the original singer audio file are synchronized, if the accompaniment If the audio file and the original audio file are out of sync, you can align the accompaniment audio file and the original vocal audio file by adding a mute clip at the beginning of the file. For example, if the accompaniment audio file is 30ms earlier than the original audio file, you can add a length of 30ms. The mute clip is to the beginning of the accompaniment file, thereby aligning the accompaniment audio file with the original singer audio file.

It should be noted that the accompaniment audio file and the original singer audio file acquired in step 201 may be mutually synchronized audio files, and in this case, step 202 is not required to be performed.

In step 203, the number of sample points of the accompaniment audio file and the original vocal audio file are respectively acquired.

When the format of the accompaniment audio file and the original singer audio file are both PCM format, although the PCM format is convenient for cutting, filling, splicing, etc., the audio size of the format is often large, so When the network is transmitted, a large bandwidth is required, and a large storage space is required. Therefore, after the audio file is obtained through the subsequent splicing process, the audio file may be encoded in a certain encoding manner to reduce the audio file size.

In the encoding process, the number of sampling points included in the next frame data of different encoding modes is different. For example, in the AAC encoding format, one frame of data includes 1024 sampling points, in this case, if the audio file is accompaniment The number of sampling points is not a multiple of 1024. In the subsequent splicing process, the last frame of data needs to be filled with the front sampling point of the original singer audio file, which causes the application to be carried during the subsequent accompaniment and original singer switching process. Come to complex calculation logic.

Therefore, in order to avoid this, the lengths of the accompaniment audio file and the original singer audio file may be trimmed to a multiple of a preset length, which is determined by the encoding mode. For the AAC encoding mode, the preset length is 1024, before trimming the length, first obtaining the number of sampling points after the accompaniment audio file and the original singer audio file are aligned, that is, performing step 203, which needs to be explained here and below. The length is the number of sampling points of the audio file, which will not be described in detail in the following description.

In step 204, the accompaniment audio file and the number of extended sampling points of the original audio file are separately calculated according to the expansion formula.

The expansion formula is:

L _f =N×Int((L _o +N-1)/N)

Where L _{f is} the number of extended sampling points, L _o is the number of sampling points of the accompaniment audio file or the original singer audio file, N is the preset length, and Int is a rounding operation.

The number of the extended sampling points is a multiple of the preset length. For example, when the encoding mode is AAC, the length of the accompaniment audio file is 15013213 sampling points, which is not a multiple of 1024, and the expansion formula can be used to calculate the need thereof. The number of sample points expanded to a multiple of 1024 is calculated, and the number of extended sample points of the accompaniment audio file is calculated to be 15013888.

In step 205, the first mute segment is spliced at the tail of the accompaniment audio file and the original singer audio file to expand the number of sampling points of the accompaniment audio file and the original singer audio file to the number of the extended sampling points, thereby obtaining Trim the accompaniment audio file and trim the original vocal audio file.

As an example, the original length of the accompaniment audio file is 15013213 sample points, which needs to be expanded to 15013888 sample points. Therefore, the first mute segment needs to be spliced at the end of the accompaniment audio file, and the length of the first mute segment is The difference between 15013888 and 15013213 is 675 sample points.

Of course, the lengths of the accompaniment audio file and the original singer audio file acquired in step 201 may have been a multiple of the preset length, and in this case, steps 203 to 205 may not be performed.

In order to simplify the calculation logic of the application during the subsequent accompaniment and the original singer switching, the length of the accompaniment audio file and the original singer audio file may be the same, so in an embodiment of the present invention, before step 203, the above audio switching method The method may further include: detecting whether the length of the accompaniment audio file and the original singer audio file are equal; if the accompaniment audio file and the vocal audio file are not equal in length, acquiring a length difference, the length difference is The accompaniment audio file and the original singer audio file have a difference in length; the second mute segment is spliced to the accompaniment audio file and the shorter length of the audio file in the original singer audio file, and the length of the second mute segment is an accompaniment audio file The difference between the original and the original audio file length.

For example, the length of the accompaniment audio file is 1899456 sample points, and the length of the original audio file is 1899654 sample points, the length of the accompaniment audio file and the original singer audio file are inconsistent. It can be calculated that the length of the original audio file and the length of the accompaniment audio file are 198 sample points. Therefore, the second mute segment can be stitched to the tail of the shorter length accompaniment audio file, and the length of the second mute segment is 198. Sample points.

In step 206, the trimmed accompaniment audio file and the trimmed original singer audio file are spliced to obtain an audio file.

In order to make the calculation of the switching position accurate when the terminal performs the accompaniment and the original singing by using the audio file, the terminal needs to know the length of the accompaniment audio segment in the audio file, and therefore, in one embodiment of the present invention, after step 206 The audio switching method may further include: adding the length of the trimmed accompaniment audio file to the label of the audio file, the label may be ID3v2, APE TAG, CueSheet, MP4Chapters, etc., and the specific form of the label does not be used in the present invention. For example, the content of the label may be <ACCOMPANY-DURATION>=<15013888>. Similarly, the content of the above label is not specifically limited in the present invention.

In addition, in another embodiment of the present invention, after step 206, the length of the trimmed accompaniment audio file may also be added to an audio database for storing the audio file and the corresponding accompaniment audio segment length. When the terminal obtains an audio file from the audio database, the length of the trimmed accompaniment audio file can be obtained at the same time.

It should be noted that the foregoing steps 201 to 206 may be performed by the server, and the terminal may acquire the audio file by sending an audio acquisition request to the server. In some cases, the foregoing steps 201 to 206 may also be performed by the terminal, that is, the terminal is Before the audio file is played, the audio file is first created, and the present invention is not limited thereto.

It should be noted that, in a specific audio switching process, the server or the terminal may have created the audio file, and therefore, in the specific audio switching process, the contents of steps 201 to 206 may not be performed.

In step 207, the terminal audio file is composed of splicing of the accompaniment audio segment and the original singer audio segment.

For example, the terminal may provide a K song interface, and the K song interface may provide a plurality of audios, and when detecting a triggering operation on a certain audio playing option, send an audio file obtaining request to the server, where the audio file obtaining request carries the audio The identifier of the file, and the server returns the audio file according to the identifier of the audio file.

The audio file may be stored in the terminal, and when the terminal detects the triggering operation of the play option of the audio file, and obtains a storage address corresponding to the identifier of the audio file, the terminal may obtain the audio locally according to the storage address. The file, the method for obtaining an audio file in the present invention is not specifically limited.

When acquiring the audio file, the terminal also needs to obtain the length of the accompaniment audio segment in the audio file to facilitate the switching between the accompaniment and the original vocal. In the specific implementation, there are three methods for obtaining the length of the accompaniment audio segment.

In the first method, the length of the accompaniment audio segment is obtained from the label of the audio file.

After the audio file is obtained by splicing, the length of the accompaniment audio segment can be added to the label of the audio file. Correspondingly, the terminal can read the label of the audio file to obtain the length of the accompaniment audio segment.

The second method, when acquiring the audio file, acquires the length of the accompaniment audio segment from the audio database, and the audio database is used to store the audio file and the corresponding accompaniment audio segment length.

After the audio file is obtained by splicing, the length of the accompaniment audio segment can be added to the audio database, and when the terminal obtains the audio file from the audio database, the length of the accompaniment audio segment can be simultaneously acquired.

A third method is to obtain a total length of the audio file, and the length of the accompaniment audio segment is one-half of the total length of the audio file.

Before splicing the accompaniment audio file and the original singer audio file, the length of the accompaniment audio file and the original singer audio file can be made consistent by splicing the second mute segment. Therefore, in the spliced audio file, the length of the accompaniment audio segment is The length of the original singer audio clip is the same, that is, one-half of the total length of the entire audio file, that is, the length of the accompaniment audio clip can be obtained by acquiring the total length of the audio file. However, it should be noted that the total length of the audio file may be changed after being decoded by some decoders of the terminal. In this case, the third method cannot be used to obtain the length of the accompaniment audio segment.

In step 208, the terminal plays the audio file according to the user's play selection operation.

After the terminal detects the triggering operation of the playing option of the audio file, an audio playing interface may be provided. As shown in FIG. 4, the original playing option and the playing accompaniment option may be provided in the audio playing interface, when the playing is detected. After the trigger operation of the original sing option, the original singer audio segment is played, when it is detected The accompaniment audio clip is played after the trigger operation of the Style option is played.

It should be noted that when the user starts to select to play the accompaniment audio segment, at this time, the terminal is not sure whether the user needs to play the original vocal audio segment. Therefore, in order to save terminal resources, only the accompaniment audio segment can be decoded.

In step 209, if an audio switching operation is detected during the playing, the terminal acquires the playing length of the currently played audio segment, and the playing length is the distance of the current playing position from the starting position of the audio file.

The above audio switching operation may be divided into a first audio switching operation and an second audio switching operation, and the first audio switching operation may be an operation of switching from the accompaniment to the original singing, and the second audio switching operation may be switching from the original singing to the accompaniment. Operation. For example, when the terminal currently plays the song accompaniment, the audio play interface shown in FIG. 4 can provide the switch original singer option. When the trigger operation of the switch original sing option is detected, the terminal detects the first audio switch. Operation, when the terminal currently plays the original song of the song, the audio playing interface may provide a switching accompaniment option, and when the triggering operation of the switching accompaniment option is detected, that is, the terminal detects the second audio switching operation.

In step 210, the terminal plays from a target location of the audio file, the target location being a playback location on another audio segment corresponding to the playback length of the currently played audio segment.

When the audio switching operation is the first audio switching operation, the terminal continues to play from the first target position of the audio file, and the distance of the first target position from the start position of the audio file is the length of the accompaniment audio segment and the The sum of the playback lengths.

For example, the length of the accompaniment audio segment is 15132 sample points, and the playback length is 151 sample points, and the distance of the first target position from the start position of the audio file is 15132+151=15283 sample points. Obviously, when the above audio switching operation is the first audio switching operation, the playing length must not be greater than the length of the accompaniment audio segment.

When the audio switching operation is the second audio switching operation, the playing is continued from the second target position of the audio file, and the distance of the second target position from the starting position of the audio file is the playing length and the accompaniment audio segment. The difference in length.

For example, the length of the accompaniment audio segment is 15132 sample points, and the playback length is 15283 sample points, and the distance of the second target position from the start position of the audio file is 15283-15132=151 sample points. Obviously, when the above audio switching operation is the second audio switching operation, the playing length is one. It is greater than the length of the accompaniment audio segment, and the playback length must be less than the total length of the audio file.

When the terminal plays the accompaniment audio segment, after the accompaniment audio segment is played, the original singer audio segment after the accompaniment audio segment is not allowed to continue playing, that is, the terminal needs to stop playing the audio file at this time, therefore, In an embodiment of the present invention, the audio switching method further includes: when the terminal plays the audio file, detecting whether the playing length is equal to the length of the accompaniment audio segment, if the playing length is equal to the length of the accompaniment audio segment , then stop playing the audio file.

In summary, the audio switching method provided by the embodiment provides an audio file formed by splicing an accompaniment audio segment and an original singer audio segment, and when an audio switching operation is detected, playing progress in the same audio file. The jump enables the terminal to switch between the accompaniment and the original singer using only one audio file, so that it is not necessary to decode two audio files at the same time, and the decoder does not need to support the decoding capability of multi-channel and multi-audio streams. Therefore, it is suitable for all applications. Further, the present embodiment aligns the accompaniment audio file and the original singer audio file so that the target position of the audio file jump is more accurately calculated when the audio switching operation is detected, by making the accompaniment The length of the audio file and the original audio file are the same, which simplifies the calculation logic of the application during the audio switching process. By cutting the accompaniment audio file and the tail mute segment of the original audio file, the audio file size is reduced, and the network resource is saved. And storage space.

FIG. 4 is a block diagram of an audio switching device 500, which may be applied to a mobile phone, a personal computer, a tablet, etc., according to an exemplary embodiment. Referring to FIG. 4, the apparatus includes an audio file acquisition module 501, a play module 502, and a play length acquisition module 503.

The audio file obtaining module 501 is configured to acquire an audio file, where the audio file is composed of a first audio segment and a second audio segment.

In an embodiment of the present disclosure, the audio file obtaining module 501 is further configured to:

Obtaining a length of the first audio segment or a length of the second audio segment from a label of the audio file;

or,

When the audio file obtaining module 501 acquires the audio file, the length of the first audio segment or the length of the second audio segment is obtained from the audio database, and the audio database is used to store the audio file and the corresponding first and second audios. Fragment length

or,

Get the total length of the audio file;

The length of the audio file is obtained, wherein the first audio segment and the second audio segment are the same length.

The playing module 502 is configured to play the first audio segment according to the user's play selection operation.

The play length obtaining module 503 is configured to obtain a current playing length of the first audio segment if the audio switching operation is detected during the playing of the playing module 502, where the playing length is a distance from the current playback position to the start position of the audio file.

The playing module 502 is further configured to play the target position of the audio file acquired by the audio file acquiring module 501, where the target position is a playing position on the second audio segment corresponding to the current playing length of the first audio segment.

In an embodiment of the invention, the first audio segment and the second audio segment are the same length, and the playing module 502 is configured to:

When the first audio segment is located before the second audio segment, playing back from the first target position of the audio file in response to the audio switching operation, the distance of the first target location from the start position of the audio file is the first audio segment The sum of the length and the current play length;

or,

When the first audio segment is located behind the second audio segment, playing in a second target position of the audio file in response to the audio switching operation, the distance of the second target position from the start position of the audio file is the second audio segment The difference between the length and the current playback length.

Referring to FIG. 5, in another embodiment of the present invention, another audio switching device 600 is further provided. The device is based on the structure of the embodiment shown in FIG. 4, and further includes a file obtaining module 504, an alignment module 505, and a trimming module 506. The splicing module 507, the first detecting module 508, the cutting module 509, the adding module 510, the second detecting module 511, and the stopping module 512.

The file obtaining module 504 is configured to acquire the first audio segment and the second audio segment.

The aligning module 505 is configured to align the first audio segment and the second audio segment acquired by the file obtaining module 504 to synchronize the first audio segment and the second audio segment.

The trimming module 506 is configured to trim the lengths of the first audio segment and the second audio segment acquired by the file obtaining module 504 to an integer multiple of a preset length to obtain a trimmed first audio segment and a trimmed second audio segment.

In one embodiment of the invention, the trim module 506 is used to:

L _f =N×Int((L _o +N-1)/N)

The splicing module 507 is configured to splicing the trimmed first audio file obtained by the trimming module and trimming the second audio file to obtain an audio file.

The first detecting module 508 is configured to detect whether the lengths of the first audio file and the second audio file acquired by the file obtaining module 504 are equal.

If the lengths of the first audio segment and the second audio segment are different, the file obtaining module 504 is further configured to obtain a length difference between the first audio segment and the second audio segment.

The splicing module 507 is further configured to splicing the second mute segment to the tail of the shorter length audio file in the first audio segment and the second audio segment, the length of the second mute segment being the length difference.

The first detecting module 508 is further configured to detect whether the length of the tail mute segment of the first audio segment and the second audio segment exceeds a preset threshold, respectively.

When the length of the first audio segment or the second audio segment tail mute segment exceeds a preset threshold, the clipping module 509 is configured to cut the tail mute segment of the first audio segment or the second audio segment.

The adding module 510 is configured to add the length of the first audio segment or the length of the second audio segment to the label of the audio file.

The second detecting module 511 is configured to detect, when the playing module plays the audio file, whether the playing length is equal to the length of the first audio segment.

The stopping module 512 is configured to stop playing the audio file if the playing length is equal to the length of the first audio segment.

In summary, the audio switching device provided by this embodiment is provided by the first audio segment and the first An audio file in which two audio segments are spliced, and when an audio switching operation is detected, a playback progress jump is performed inside the same audio file, so that the terminal can implement the first audio segment and the second audio by using only one audio file. Switching between segments eliminates the need to decode two audio files at the same time, and does not require the decoder to support the decoding capabilities of multi-channel and multi-audio streams, so it is adaptable to all applications. Further, the present embodiment aligns the first audio segment and the second audio segment such that the target position of the audio file jump is more accurately calculated when the audio switching operation is detected, by making the first audio segment and the second audio segment the same length It simplifies the calculation logic of the application during the audio switching process, and reduces the audio file size by cutting the first audio segment and the tail mute segment of the second audio segment, thereby saving network resources and storage space.

It should be noted that, when performing the audio switching service, the audio switching device provided by the foregoing embodiment is only illustrated by the division of the foregoing functional modules. In actual applications, the function distribution may be completed by different functional modules as needed. The internal structure of the device is divided into different functional modules to perform all or part of the functions described above. In addition, the audio switching device and the audio switching method are provided in the same embodiment, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.

This embodiment provides a terminal as shown in FIG. 6. The terminal can be used to perform the audio switching method provided in the foregoing embodiments.

The terminal 700 may include an RF (Radio Frequency) circuit 710, a memory 720 including one or more computer readable storage media, an input unit 730, a display unit 740, a sensor 750, an audio circuit 760, and a WiFi (Wireless Fidelity, wireless). The fidelity module 770 includes a processor 780 having one or more processing cores, and a power supply 790 and the like. It will be understood by those skilled in the art that the terminal structure shown in FIG. 7 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements.

The RF circuit 710 can be used for transmitting and receiving information or during a call, and receiving and transmitting the signal. Specifically, after receiving the downlink information of the base station, the downlink information is processed by one or more processors 780. In addition, the data related to the uplink is sent to the base station. . Generally, the RF circuit 710 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier). , duplexer, etc. In addition, RF circuitry 710 can also communicate with the network and other devices via wireless communication. The wireless communication can be used Any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access) WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.

The memory 720 can be used to store software programs and modules, and the processor 780 executes various functional applications and data processing by running software programs and modules stored in the memory 720. The memory 720 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the terminal 700 (such as audio data, phone book, etc.) and the like. Moreover, memory 720 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 720 can also include a memory controller to provide access to memory 720 by processor 780 and input unit 730.

The input unit 730 can be configured to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls. In particular, input unit 730 can include touch-sensitive surface 731 as well as other input devices 732. Touch-sensitive surface 731, also referred to as a touch display or trackpad, can collect touch operations on or near the user (eg, the user uses a finger, stylus, etc., any suitable object or accessory on touch-sensitive surface 731 or The operation near the touch-sensitive surface 731) and driving the corresponding connecting device according to a preset program. Alternatively, the touch-sensitive surface 731 can include two portions of a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 780 is provided and can receive commands from the processor 780 and execute them. In addition, the touch-sensitive surface 731 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface 731, the input unit 730 can also include other input devices 732. In particular, other input devices 732 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

Display unit 740 can be used to display information entered by the user or information provided to the user and various graphical user interfaces of terminal 700, which can be constructed from graphics, text, icons, video, and any combination thereof. The display unit 740 can include a display panel 741. Alternatively, the display panel 741 can be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface 731 can cover the display panel 741, and when the touch-sensitive surface 731 detects a touch operation thereon or nearby, it is transmitted to the processor 780 to determine the type of touch event, and then the processor 780 according to the touch event The type provides a corresponding visual output on display panel 741. Although in FIG. 7, touch-sensitive surface 731 and display panel 741 are implemented as two separate components to implement input and input functions, in some embodiments, touch-sensitive surface 731 can be integrated with display panel 741 for input. And output function.

Terminal 700 can also include at least one type of sensor 750, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 741 according to the brightness of the ambient light, and the proximity sensor may close the display panel 741 when the terminal 700 moves to the ear. / or backlight. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the terminal 700 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.

An audio circuit 760, a speaker 761, and a microphone 762 can provide an audio interface between the user and the terminal 700. The audio circuit 760 can transmit the converted electrical data of the received audio data to the speaker 761 for conversion to the sound signal output by the speaker 761; on the other hand, the microphone 762 converts the collected sound signal into an electrical signal by the audio circuit 760. After receiving, it is converted into audio data, and then processed by the audio data output processor 780, transmitted to the terminal, for example, via the RF circuit 710, or the audio data is output to the memory 720 for further processing. The audio circuit 760 may also include an earbud jack to provide communication of the peripheral earphones with the terminal 700.

WiFi is a short-range wireless transmission technology, and the terminal 700 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 770, which provides wireless broadband Internet access for users. Although FIG. 7 shows the WiFi module 770, it can be understood that it does not belong to The necessary configuration of the terminal 700 can be omitted as long as it does not change the essence of the invention as needed.

Processor 780 is the control center of terminal 700, which connects various portions of the entire handset using various interfaces and lines, by running or executing software programs and/or modules stored in memory 720, and recalling data stored in memory 720, The various functions and processing data of the terminal 700 are performed to perform overall monitoring of the mobile phone. Optionally, the processor 780 may include one or more processing cores; preferably, the processor 780 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like. The modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 780.

The terminal 700 also includes a power source 790 (such as a battery) for powering various components. Preferably, the power source can be logically coupled to the processor 780 through a power management system to manage functions such as charging, discharging, and power management through the power management system. Power supply 790 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

Although not shown, the terminal 700 may further include a camera, a Bluetooth module, and the like, and details are not described herein again. Specifically, in this embodiment, the display unit of the terminal is a touch screen display, the terminal further includes a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be processed by one or more Execution. The one or more programs include instructions for performing the following operations:

Obtaining an audio file, the audio file being composed of a first audio segment and a second audio segment;

The audio segment switching operation is detected during the playing of the first audio segment, and the current playing length of the first audio segment is obtained, and the current playing length is the distance of the current playing position from the starting position of the audio file;

In response to the audio segment switching operation, the playback is performed from a target location of the audio file, the target location being a playback location on the second audio segment corresponding to the current playback length of the first audio segment.

A person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium. The storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalents, improvements, etc., which are within the spirit and scope of the present invention, should be included in the protection of the present invention. Within the scope.

Claims

An audio switching method includes:

Acquiring an audio file, the audio file being composed of a first audio segment and a second audio segment;

And detecting an audio segment switching operation in the process of playing the first audio segment, acquiring a current playing length of the first audio segment, where the current playing length is a distance from a starting position of the audio file of the current playing position;

In response to the audio segment switching operation, playing from a target location of the audio file, the target location being a playback location on a second audio segment corresponding to a current playback length of the first audio segment.
The method of claim 1, the first audio segment and the second audio segment are the same length,

When the first audio segment is located before the second audio segment, the distance of the target location from the start position of the audio file is the length of the first audio segment and the current playback length of the first audio segment. Sum;

When the first audio segment is located behind the second audio segment, the distance of the target location from the start position of the audio file is the length of the second audio segment and the current playback length of the first audio segment. Difference.
The method of claim 2, before the obtaining the audio file, further comprising:

Obtaining the first audio segment and the second audio segment;

Aligning the first audio segment and the second audio segment to synchronize the first audio segment and the second audio segment;

The first audio segment and the second audio segment are spliced.
The method according to claim 3, when the length of the first audio segment or the length of the second audio segment is not an integer multiple of a preset length, the method further includes:

The length of the first audio segment or the length of the second audio segment is trimmed to an integer multiple of the preset length.
The method according to claim 4, trimming the length of the first audio segment or the second audio segment to an integer multiple of the preset length:

Obtaining a number of sampling points of the first audio segment or the second audio segment;

Calculating the number of extended sampling points of the first audio segment or the second audio segment according to an expansion formula, where the expansion formula is:

L f = N × Int (( L o + N-1) / N)

Wherein, L f is the expansion of the number of sampling points, L o is a fragment of the first audio or the second audio segment number of sampling points, N is the length of the preset, Int is the integer operation;

And splicing the first mute segment at the tail of the first audio segment and the second audio segment to expand the number of sampling points of the first audio segment and the second audio segment to the number of the extended sampling points.
The method of claim 3, before trimming the length of the first audio segment and the second audio segment to an integer multiple of the preset length, further comprising:

Detecting whether the lengths of the first audio segment and the second audio segment are equal;

Obtaining a difference in length between the first audio segment and the second audio segment if the lengths of the first audio segment and the second audio segment are not equal;

Splicing a second mute segment to a shorter length of the audio segment in the first audio segment and the second audio segment, the second mute segment having a length of the first audio segment and the second audio The difference in length of the segment.
The method of claim 3 further comprising:

Detecting respectively whether the length of the tail mute segment of the first audio segment and the second audio segment exceeds a preset threshold;

If the length of the tail mute segment of the first audio segment or the second audio segment exceeds the preset threshold, cutting the tail segment of the first audio segment or the second audio segment.
The method according to any one of claims 1 to 7, wherein the first audio segment is a An accompaniment audio segment of the song, the second audio segment being an original singer audio segment of the song; or

The first audio segment is an original singer audio segment of a song, and the second audio segment is an accompaniment audio segment of the song.
An audio switching device includes: a processor and a storage medium storing an operation instruction, when the operation instruction in the storage medium is executed, the processor performs the following steps:

Acquiring an audio file, the audio file being composed of a first audio segment and a second audio segment;

And detecting an audio segment switching operation in the process of playing the first audio segment, acquiring a current playing length of the first audio segment, where the current playing length is a distance from a starting position of the audio file of the current playing position;

In response to the audio segment switching operation, playing from a target location of the audio file, the target location being a playback location on a second audio segment corresponding to a current playback length of the first audio segment.
The apparatus of claim 9, the first audio segment and the second audio segment are the same length,

When the first audio segment is located before the second audio segment, the distance of the target location from the start position of the audio file is the length of the first audio segment and the current playback length of the first audio segment. Sum;

When the first audio segment is located behind the second audio segment, the distance of the target location from the start position of the audio file is the length of the second audio segment and the current playback length of the first audio segment. Difference.
The apparatus of claim 9 wherein said processor further executes:

Obtaining the first audio segment and the second audio segment;

Aligning the first audio segment and the second audio segment to synchronize the first audio segment and the second audio segment;

The first audio segment and the second audio segment are spliced.
The apparatus of claim 11 wherein said processor further executes:

The length of the first audio segment or the length of the second audio segment is trimmed to an integer multiple of the preset length.
The apparatus according to claim 12, when said processor performs trimming of a length of said first audio segment or said second audio segment to an integer multiple of said preset length, performing:

Obtaining a number of sampling points of the first audio segment and the second audio segment;

Calculating the number of extended sampling points of the first audio segment or the second audio segment according to an expansion formula, where the expansion formula is:

L f =N×Int((L o +N-1)/N)

Wherein, L f is the number of the extended sampling points, L o is the number of sampling points of the first audio segment or the second audio segment, N is the preset length, and Int is a rounding operation;

And splicing the first mute segment at the tail of the first audio segment and the second audio segment to expand the number of sampling points of the first audio segment and the second audio segment to the number of the extended sampling points.
The apparatus of claim 11 wherein said processor further executes:

Detecting whether the lengths of the first audio segment and the second audio segment are equal;

Obtaining a difference in length between the first audio segment and the second audio segment if the lengths of the first audio segment and the second audio segment are not equal;

Splicing a second mute segment to a shorter length of the audio segment in the first audio segment and the second audio segment, the second mute segment having a length of the first audio segment and the second audio The difference in length of the segment.
The apparatus of claim 11 wherein said processor is further executing;

Detecting respectively whether the length of the tail mute segment of the first audio segment and the second audio segment exceeds a preset threshold;

If the length of the tail mute segment of the first audio segment or the second audio segment exceeds the preset threshold a value, then cutting the first audio segment or the tail mute segment of the second audio segment.
The apparatus according to any one of claims 9 to 15, wherein the first audio segment is an accompaniment audio segment of a song, and the second audio segment is an original vocal audio segment of the song; or

The first audio segment is an original singer audio segment of a song, and the second audio segment is an accompaniment audio segment of the song.
A non-transitory computer readable storage medium having computer executable instructions stored thereon. When the executable instructions are executed in a computer, the following steps are performed:

Acquiring an audio file, the audio file being composed of a first audio segment and a second audio segment;

And detecting an audio segment switching operation in the process of playing the first audio segment, acquiring a current playing length of the first audio segment, where the current playing length is a distance from a starting position of the audio file of the current playing position;

In response to the audio segment switching operation, playing from a target location of the audio file, the target location being a playback location on a second audio segment corresponding to a current playback length of the first audio segment.