CN109918038B

CN109918038B - Audio playing speed synchronization method and system

Info

Publication number: CN109918038B
Application number: CN201910032134.4A
Authority: CN
Inventors: 韦金材
Original assignee: Zhuhai Huilian Technology Co ltd
Current assignee: Zhuhai Huilian Technology Co ltd
Priority date: 2019-01-14
Filing date: 2019-01-14
Publication date: 2022-08-12
Anticipated expiration: 2039-01-14
Also published as: CN109918038A

Abstract

The invention relates to an audio playing speed synchronization method and system, which are used for realizing the following steps: the playing device receives audio data sent by the mobile terminal, and a certain amount of audio data is received by using a buffer area; dividing the buffer into a plurality of segments, each segment storing a corresponding audio data packet; playing the audio data in the buffer area, detecting the residual audio data packets in the buffer area after the preset time, and adjusting the playing speed according to the residual audio data packets; and circularly executing the detection of the rest audio data packets and adjusting the playing speed until the playing speed is synchronized with the sending speed of the mobile terminal. The invention has the beneficial effects that: the adjusting process is convergent, the influence on the tone quality is small, and frequent adjustment is not needed.

Description

Audio playing speed synchronization method and system

Technical Field

The invention relates to an audio playing speed synchronization method and system, and belongs to the field of computers.

Background

In audio application products, audio data sent by a mobile phone or a computer is usually received through bluetooth or USB, and the data is buffered and played. The handset transmits at its own frequency and the audio processor plays at its frequency, which may be biased because the two are not a common clock source. When the sending speed of the mobile phone is higher than the playing speed of the audio processor, more and more data are accumulated in the buffer area after the mobile phone is played for a long time, so that the data cannot be stored; when the speed of the mobile phone is slower than the playing speed of the audio processor, the data in the buffer area is less and less after the mobile phone is played for a long time, so that no data is played. Both of these conditions cause the sound to be intermittent.

The current solution is to dynamically fine-tune the play speed of the audio processor to ensure that the data in the buffer will not accumulate to full or empty.

Referring to fig. 1, taking the maximum allowable error as ± 1% as an example, when the data amount reaches the maximum threshold, it is described that the data sent by the mobile phone is faster than the data played by the audio processor, and the playing speed is adjusted to the standard speed (1+ 1%), and then the data amount is gradually decreased, and when the data amount is decreased to the minimum threshold, it is described that the data sent by the mobile phone is slower than the data played by the audio processor, the playing speed is adjusted to the standard speed (1-1%). The repeated adjustment ensures that the buffer has data to be played all the time. However, in such a scheme, the adjustment process is not converged, and the playing speed is always changed, which affects the audio index.

Disclosure of Invention

The invention provides an audio playing speed synchronization method and system, which enable the playing speed to approach the data sending speed of a mobile phone, enable the adjustment result to be convergent and maximally reduce the influence of adjustment on the tone quality.

The technical scheme of the invention comprises an audio playing speed synchronization method, which is characterized by comprising the following steps: s10, the playing device receives the audio data sent by the mobile terminal, and uses the buffer area to receive a certain amount of audio data; s20, dividing the buffer into a plurality of segments, wherein each segment stores a corresponding audio data packet; s30, playing the audio data in the buffer area, detecting the residual audio data packets in the buffer area after the preset time, and adjusting the playing speed according to the residual audio data packets; s40, the step S30 of detecting the remaining audio data packets and adjusting the playing speed is executed in a loop until the playing speed is synchronized with the sending speed of the mobile terminal.

According to the audio playing speed synchronization method, S10 specifically includes: the playing device sends and receives audio data with the mobile terminal through a Bluetooth or USB data connecting line. The playing device sends and receives audio data with the mobile terminal through a Bluetooth or USB data connecting line.

According to the audio playing speed synchronization method, S20 specifically includes: the buffer area is divided into 8 segments, each segment corresponds to the audio data of one packet sent by the mobile terminal, and the initial threshold T0, the minimum threshold T1 and the maximum threshold T2 of the data volume of the buffer area are set in a self-defining mode.

According to the audio playing speed synchronization method, S30 specifically includes: s31, playing the audio data accumulated in the buffer after the data amount reaches the initial threshold, where the playing speed of the audio processor is F = F, where F is the theoretical playing speed and F is the current playing speed; s32, the remaining amount of audio data in the buffer is detected every time one packet is played. If the residual audio data volume is smaller than the minimum threshold, increasing the playing speed of the audio processor according to the F and the maximum speed error, and adjusting the data volume to return to the initial threshold; if the residual audio data volume is larger than the maximum threshold, the playing speed of the audio processor is reduced according to the F and the maximum speed error, and the data volume is adjusted to return to the initial threshold. S33, the corrected playing speed is calculated according to the last playing speed and the speed error, and the audio data is played at the speed.

According to the audio playing speed synchronization method, S32 specifically includes: after playing the m packets of data, if the remaining audio data amount is less than the minimum threshold, wherein the speed error α = (T0-T1)/m, the adjusted playing speed is F (1-e%); after playing the m packets of data, if the remaining audio data amount is greater than the maximum threshold, wherein the speed error α = (T0-T2)/m, the adjusted playing speed is F × (1+ e%); wherein, ± e% is the maximum playing speed error.

According to the audio playing speed synchronization method, S40 specifically includes: simultaneously calculating the corrected playing speed f = f (1-alpha), and playing the audio data at the speed; and repeating the step S32 to make the playing speed of the audio processor continuously approximate to the audio sending speed of the mobile terminal.

The technical solution of the present invention further includes an audio playing speed synchronization system for performing any of the above methods, wherein the system includes: the buffer module is used for receiving the audio data sent by the mobile terminal by using the playing device and receiving a certain amount of audio data by using the buffer area; a segmentation module for dividing the buffer into a plurality of segments, each segment storing a corresponding audio data packet; the adjusting module is used for playing the audio data in the buffer area, detecting the residual audio data packets in the buffer area after the preset time, and adjusting the playing speed according to the residual audio data packets; and the synchronization module is used for circularly executing the detection of the rest audio data packets by the adjustment module and adjusting the playing speed until the playing speed is synchronized with the sending speed of the mobile terminal.

The invention has the beneficial effects that: the adjusting process is convergent, the influence on the tone quality is small, and frequent adjustment is not needed.

Drawings

FIG. 1 is a schematic diagram of an embodiment according to the prior art;

FIG. 2 is a flow diagram of a method according to an embodiment of the invention;

FIG. 3 is a block diagram of a system according to an embodiment of the invention;

FIGS. 4a, 4b, and 4c are schematic diagrams of buffer variations according to embodiments of the present invention;

FIG. 5 is a schematic diagram of a prior art adjustment variation;

fig. 6 is a schematic diagram illustrating a modification according to an embodiment of the present invention.

Detailed Description

The technical solution of the present invention is applicable to audio playing speed synchronization of an audio playing device, and the concept, specific structure and technical effects of the present invention will be clearly and completely described below with reference to the embodiments and the accompanying drawings to fully understand the objects, solutions and effects of the present invention.

It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly fixed or connected to the other feature or indirectly fixed or connected to the other feature. Furthermore, the descriptions of upper, lower, left, right, etc. used in the present disclosure are only relative to the mutual positional relationship of the constituent parts of the present disclosure in the drawings. As used in this disclosure, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Furthermore, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the description herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any combination of one or more of the associated listed items.

It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element of the same type from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure. The use of any and all examples, or exemplary language ("e.g.," such as "or the like") provided herein, is intended merely to better illuminate embodiments of the invention and does not pose a limitation on the scope of the invention unless otherwise claimed.

Fig. 2 is a flow chart of a method according to an embodiment of the present invention. The method specifically comprises the following steps: s10, the playing device receives the audio data sent by the mobile terminal, and uses the buffer area to receive a certain amount of audio data; s20, dividing the buffer into a plurality of segments, wherein each segment stores a corresponding audio data packet; s30, playing the audio data in the buffer area, detecting the residual audio data packets in the buffer area after the preset time, and adjusting the playing speed according to the residual audio data packets; s40, the step S30 of detecting the remaining audio data packets and adjusting the playing speed is executed in a loop until the playing speed is synchronized with the sending speed of the mobile terminal.

FIG. 3 is a block diagram of a system according to an embodiment of the present invention. The method specifically comprises the following steps: the buffer module is used for receiving the audio data sent by the mobile terminal by using the playing device and receiving a certain amount of audio data by using the buffer area; a segmentation module for dividing the buffer into a plurality of segments, each segment storing a corresponding audio data packet; the adjusting module is used for playing the audio data in the buffer area, detecting the residual audio data packets in the buffer area after the preset time, and adjusting the playing speed according to the residual audio data packets; and the synchronization module is used for circularly executing the detection of the rest audio data packets by the adjustment module and adjusting the playing speed until the playing speed is synchronized with the sending speed of the mobile terminal.

Fig. 4a, 4b, and 4c are schematic diagrams of buffer variation according to an embodiment of the invention. The method comprises the following specific steps:

assuming that the theoretical playing speed is F, the maximum playing speed error is + -e%. The buffer area is divided into 8 sections, each section corresponds to the audio data of one packet sent by the mobile phone, and the theoretical playing time of each packet is T. Setting the initial playing threshold to be 4, adjusting the minimum data volume threshold to be 2, and adjusting the maximum threshold to be 6.

Step one, as shown in fig. 4a, the initial data amount is half of the size of the buffer: the first play accumulates 4 packets of data. The playback speed of the audio processor at this time is F = F.

Step two, as shown in fig. 4b and 4c, wherein fig. 4b shows that the data amount reaches the minimum threshold, and fig. 4c shows that the data amount reaches the maximum threshold.

When m packets of data are played, two situations may occur:

the first condition is as follows: as in fig. 4b, the amount of buffer data reaches a minimum threshold. The audio processor is shown to play faster than the handset transmit speed. The speed error is α = 2/m. The playback speed needs to be slowed down by F (1-e%) to bring the amount of data back to the initial threshold quickly.

Case two: as in fig. 4c, the buffer data size reaches the maximum threshold. It is shown that the audio processor is slower in playing speed than the handset sending speed. The speed error is α = -2/m. The playback speed needs to be adjusted fast, with speed F x (1+ e%), to bring the amount of data back to the initial threshold.

Step three:

after the second step, the data amount returns to the initial threshold. And calculating the corrected playing speed f = f (1-alpha), and playing at the speed. Because the calculation is error, the speed estimation at one time is not accurate enough, and the step two and the step three need to be repeated, so that the playing speed of the audio processor is continuously close to the speed of the mobile phone. The speed deviation will be small after several iterations, so that no adjustment is needed for a long period of time.

Fig. 5 is a schematic diagram of a prior art adjustment variation. When the data volume reaches the maximum threshold value, the data sent by the mobile phone is faster than the data played by the audio processor, the playing speed is adjusted to be fast, the data volume is slowly reduced, and when the data volume is reduced to the minimum threshold value, the data sent by the mobile phone is slower than the data played by the audio processor, the playing speed is adjusted to be slow. The repeated adjustment ensures that the buffer has data to be played all the time.

Fig. 6 is a schematic diagram illustrating a modification according to an embodiment of the present invention. The playing speed approaches to the data sending speed of the mobile phone, the adjusting result is converged, dynamic adjustment is not needed, and the influence of the adjustment on the tone quality is reduced to the maximum extent.

It should be recognized that embodiments of the present invention can be realized and implemented by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer readable memory. The methods may be implemented in a computer program using standard programming techniques, including a non-transitory computer-readable storage medium configured with the computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner, according to the methods and figures described in the detailed description. Each program may be implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.

Further, the operations of processes described herein can be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The processes described herein (or variations and/or combinations thereof) may be performed under the control of one or more computer systems configured with executable instructions, and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications) collectively executed on one or more processors, by hardware, or combinations thereof. The computer program includes a plurality of instructions executable by one or more processors.

Further, the method may be implemented in any type of computing platform operatively connected to a suitable interface, including but not limited to a personal computer, mini computer, mainframe, workstation, networked or distributed computing environment, separate or integrated computer platform, or in communication with a charged particle tool or other imaging device, and the like. Aspects of the invention may be embodied in machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optically read and/or write storage medium, RAM, ROM, or the like, such that it may be read by a programmable computer, which when read by the storage medium or device, is operative to configure and operate the computer to perform the procedures described herein. Further, the machine-readable code, or portions thereof, may be transmitted over a wired or wireless network. The invention described herein includes these and other different types of non-transitory computer-readable storage media when such media include instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor. The invention also includes the computer itself when programmed according to the methods and techniques described herein.

A computer program can be applied to input data to perform the functions described herein to transform the input data to generate output data that is stored to non-volatile memory. The output information may also be applied to one or more output devices, such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including particular visual depictions of physical and tangible objects produced on a display.

The above description is only a preferred embodiment of the present invention, and the present invention is not limited to the above embodiment, and any modifications, equivalent substitutions, improvements, etc. within the spirit and principle of the present invention should be included in the protection scope of the present invention as long as the technical effects of the present invention are achieved by the same means. The invention is capable of other modifications and variations in its technical solution and/or its implementation, within the scope of protection of the invention.

Claims

1. A method for synchronizing audio playback speed, the method comprising the steps of:

s10, the playing device receives the audio data sent by the mobile terminal, and a certain amount of audio data is received by using the buffer area;

s20, dividing the buffer into a plurality of segments, wherein each segment stores a corresponding audio data packet; the S20 specifically includes:

dividing a buffer area into 8 segments, wherein each segment corresponds to a mobile terminal to send audio data of one packet, and performing self-defining setting on an initial threshold T0, a minimum threshold T1 and a maximum threshold T2 of the data volume of the buffer area;

s30, playing the audio data in the buffer area, detecting the residual audio data packets in the buffer area after the preset time, and adjusting the playing speed according to the residual audio data packets; the S30 specifically includes: s31, playing the audio data accumulated in the buffer after the data amount reaches the initial threshold, where the playing speed of the audio processor is F = F, where F is the theoretical playing speed and F is the current playing speed; s32, detecting the residual audio data amount of the buffer area after each data packet is played, if the residual audio data amount is less than the minimum threshold, reducing the playing speed of the audio processor according to the error F and the maximum speed, and adjusting the data amount to the initial threshold; if the residual audio data volume is larger than the maximum threshold, increasing the playing speed of the audio processor according to the F and the maximum speed error, and adjusting the data volume to return to the initial threshold; s33, calculating the corrected playing speed according to the last playing speed and the speed error, and playing the audio data at the speed; the speed error represents the error of the audio processor processing the audio data and the audio data sent by the mobile phone, and the maximum speed error represents the maximum playing speed error of the audio processor processing the audio data and the audio data sent by the mobile phone;

and S40, circularly executing the step S30 to detect the rest audio data packets and adjust the playing speed until the playing speed is synchronized with the sending speed of the mobile terminal.

2. The audio playing speed synchronization method according to claim 1, wherein the S10 specifically includes:

the playing device sends and receives audio data with the mobile terminal through a Bluetooth or USB data connecting line.

3. The audio playing speed synchronization method according to claim 1, wherein the S32 specifically includes:

after playing the m packets of data, if the remaining audio data amount is less than the minimum threshold, wherein the speed error α = (T0-T1)/m, the adjusted playing speed is F (1-e%);

after playing the m packet data, if the remaining audio data amount is greater than the maximum threshold, wherein the speed error α = (T0-T2)/m, the adjusted playing speed is F × (1+ e%);

where ± e% is the maximum speed error.

4. The audio playing speed synchronization method according to claim 1, wherein the step S33 specifically includes:

simultaneously calculating the corrected playing speed f = f (1-alpha), and playing the audio data at the speed, wherein alpha is a speed error;

and repeating the step S32 to make the playing speed of the audio processor continuously approximate to the audio sending speed of the mobile terminal.

5. An audio playback speed synchronization system for performing the method of any of claims 1-4, the system comprising:

the buffer module is used for receiving the audio data sent by the mobile terminal by using the playing device and receiving a certain amount of audio data by using the buffer area;

a segmentation module for dividing the buffer into a plurality of segments, each segment storing a corresponding audio data packet;

the adjusting module is used for playing the audio data in the buffer area, detecting the residual audio data packets in the buffer area after the preset time, and adjusting the playing speed according to the residual audio data packets;

and the synchronization module is used for circularly executing the detection of the rest audio data packets by the adjustment module and adjusting the playing speed until the playing speed is synchronized with the sending speed of the mobile terminal.