CN116828585A

CN116828585A - Audio synchronous playing method and system, audio equipment and storage medium

Info

Publication number: CN116828585A
Application number: CN202310953885.6A
Authority: CN
Inventors: 杨磊; 童伟峰; 徐明亮; 陈俊
Original assignee: Heng Xuan Technology Beijing Co ltd
Current assignee: Heng Xuan Technology Beijing Co ltd
Priority date: 2023-07-31
Filing date: 2023-07-31
Publication date: 2023-09-29

Abstract

The application provides an audio synchronous playing method and system, audio equipment and a storage medium, and relates to the field of audio equipment. The audio synchronous playing method is applied to each audio device in the audio playing system; the audio playing system comprises at least two audio devices, and each audio device is connected with the same wireless access point; the audio synchronous playing method comprises the steps of receiving time stamps of connected wireless access points, wherein the time stamps received by all the audio equipment are consistent; adjusting the playing of the audio data based on the time stamp so that each audio device synchronously plays the respective audio data; wherein the time stamp is received different from the audio data or the time stamp is received through a different channel from the audio data. By the audio synchronous playing method, synchronous playing effects among different audio devices can be improved.

Description

Audio synchronous playing method and system, audio equipment and storage medium

Technical Field

The application relates to the field of audio equipment, in particular to an audio synchronous playing method and system, audio equipment and a storage medium.

Background

The audio device may play the audio data provided by the audio source device. Various wireless communication audio devices can be connected with audio source devices such as mobile phones and tablet computers in a wireless mode, and audio data sent by the audio source devices are received for playing. If there are multiple audio devices (e.g., left and right headphones in a wireless headset, each headphone is one audio device), then to improve the listening experience of the user, it is often required to play audio data synchronously between the audio devices.

In the conventional scheme, in order to realize synchronous play among a plurality of audio devices, each audio device may be connected to a sound source device and receive audio data. When audio data is transmitted, the audio source device generally transmits the audio data and clock information for clock synchronization to each audio device, so that each audio device can adjust its own clock according to the clock information, and unification of clocks among the audio devices is realized, so that each audio device can synchronously play the audio data.

However, in the conventional scheme, since the audio source device needs to transmit clock information and audio data, and the frequency band bandwidth of the audio source device transmitting data is limited, a part of the clock information or the audio data may be compressed when transmitting the audio data and the clock information, thereby possibly affecting the synchronization effect or the audio playing quality.

Disclosure of Invention

In view of the foregoing, the present application is directed to a method and a system for synchronously playing audio, an audio device and a storage medium, so as to improve the playing effect of each audio device when synchronously playing the audio device.

In a first aspect, an embodiment of the present application uses an audio synchronous playing method, which is applied to each audio device in an audio playing system; the audio playing system comprises at least two audio devices, and each audio device is connected with the same wireless access point; the method comprises the following steps: receiving a time stamp of the connected wireless access point, wherein the time stamp received by each audio device is consistent; adjusting the playing of the audio data based on the time stamp so that each audio device synchronously plays the respective audio data; wherein the time stamp is received different from the audio data or the time stamp is received through a different channel from the audio data.

In the embodiment of the application, the audio equipment can receive the time stamp of the wireless access point and adjust the playing of the audio data based on the time stamp of the wireless access point, so that the audio data can be synchronously played between different audio equipment based on the clock of the wireless access point. When the wireless access point transmits the time stamp, the time stamp and the audio data are transmitted in different time or channels, the time stamp does not occupy the bandwidth of the audio data, and the compression or discarding of the audio data and the time stamp is reduced, so that the transmission of the time stamp and the audio data for synchronization is not affected or is less affected, and the synchronization effect and the playing quality of the audio data can be better.

In an embodiment, the wireless access point is connected with the audio device through WiFi, and the wireless access point is configured to send a beacon frame to the audio device based on a WiFi protocol, where the beacon frame carries the timestamp.

The audio synchronization method provided by the application can be applied to the audio equipment based on WiFi communication so as to realize synchronous play among different audio equipment based on WiFi communication. In addition, the WiFi protocol prescribes that the wireless access point can periodically send the beacon frame to the connected equipment, and the beacon frame and the data frame are sent in different time or different channels, so that the time stamp can be transmitted in the beacon frame based on the WiFi, the signal frame of the transmission time stamp is not required to be additionally configured, and the difficulty in realizing the audio synchronization method is reduced.

In an embodiment, after the obtaining the timestamp of the wireless access point, the method further includes: updating a first count value of a counter based on the timestamp; wherein the counter is disposed within the audio device, the first count value being synchronized with a timestamp of the wireless access point; adjusting playing of the audio data based on the timestamp, comprising: and adjusting playing of the audio data based on the first count value.

In the embodiment of the application, the counter is arranged in the audio equipment, the time stamp is recorded according to the first count value of the counter, so that the counter is synchronous with the time stamp, and the recording of the first count value is less influenced by the program running of the audio equipment because the counter is hardware, so that the accuracy of the first count value can be improved, and the reliability of the audio equipment for adjusting the audio data playing according to the first count value to realize synchronous playing is improved.

In an embodiment, the updating the first count value of the counter based on the timestamp includes: gradually updating the first count value in a plurality of clock cycles until the first count value is matched with the timestamp, and finishing updating the first count value; the total duration of the plurality of clock cycles is less than the receive period of the timestamp.

In the embodiment of the application, the first count value is gradually updated in a plurality of self clock cycles smaller than the time stamp receiving period until the first count value is matched with the time stamp, so that the change of the first count value is smoother, meanwhile, because the playing of the audio data is adjusted according to the first count value, if the first count value is changed greatly, the playing adjustment of the audio data is also possibly changed greatly, so that partial audio data or abnormal playing speed can be lost, the playing quality of the audio data is influenced, and the playing adjustment of the audio data can be gradually performed by gradually updating the first count value, and the negative influence on the playing quality of the audio can be reduced by adjusting the playing of the audio data.

In one embodiment, after the updating of the first count value of the counter based on the timestamp, the method includes: determining the latest first count value based on the current first count value in the counter and a preset period nominal value; updating the latest first count value to a first count value in the counter; the period nominal value characterizes an accumulated value of the counter per clock period of the audio device.

In the embodiment of the application, the first count value is a record of the wireless access point timestamp by the audio equipment, the period nominal value characterizes the accumulated value of the counter in each clock period of the audio equipment, namely, the value of the counter is accumulated along with the clock period of the audio equipment when the timestamp is not received, so that the respective time accumulation of the counter and the wireless access point can be kept synchronous, the first count value is not only updated when the timestamp arrives, therefore, the audio equipment can keep synchronous with the wireless access point in each clock period when the timestamp is not received, and after the timestamp arrives, the counter can correct the first count value according to the timestamp, so that the audio data can be accurately synchronously played with the wireless access point between the audio equipment.

In one embodiment, the updating the first count value of the counter based on the timestamp includes: judging whether the time stamp sent by the wireless access point is received for the first time; if the timestamp sent by the wireless access point is not received for the first time, updating the first count value of the counter based on the timestamp, including: obtaining a correction period nominal value based on the corresponding relation between the timestamp and the first count value; determining a latest first count value based on a current first count value in the counter and the correction period nominal value; and updating the latest first count value to the first count value in the counter.

The clock frequencies of both the wireless access point and the audio device may deviate, which may be due to environmental factors such as temperature, circuit aging, etc. The period nominal value is a preset value in an ideal situation, when the clock frequency of the wireless access point or the audio equipment changes, if the first count value is still updated by the period nominal value, the deviation may be gradually increased, so that the playing of the audio equipment is not synchronous. In the embodiment of the application, the difference between the timestamp and the first count value is determined through the corresponding relation between the timestamp and the first count value, so that the correction period nominal value is obtained, and then the first count value is updated according to the correction nominal value, so that clocks between the audio equipment and the wireless access point can be matched, and each audio equipment can synchronously play audio.

In an embodiment, adjusting playing of the audio data based on the first count value includes: comparing the first count value with a preset count value; the preset count value characterizes the time of playing a preset number of the audio data by the audio equipment; and if the first count value is not matched with the preset count value, adjusting the playing speed of the audio data based on the difference value between the first count value and the preset count value.

In the embodiment of the application, the preset count value characterizes the time of playing the preset number of audio data by the audio equipment, if the preset count value is not matched with the first count value, the clock mismatch between the audio equipment and the wireless access point is characterized, which also means that the audio playing of different audio equipment is possibly asynchronous, so that the playing of the audio equipment can be adjusted to synchronize the different audio equipment. The synchronous playing includes clock synchronization and playing speed synchronization, the difference of audio data playing among different audio devices can be reduced by adjusting the playing speed more or less, clock synchronization is realized, and the playing speeds are matched after clock synchronization, so that each audio device can be synchronously played subsequently. In an embodiment, before comparing the first count value with a preset count value, the method further includes: controlling a trigger circuit to generate a trigger signal based on a preset clock signal in the audio equipment; the trigger circuit is arranged in the audio equipment; the trigger signal is used for indicating the first count value of the trigger time to be compared with the preset count value.

In the embodiment of the application, the trigger circuit is hardware, the normal operation of the trigger circuit is not influenced by the software of the audio equipment, and the trigger circuit has accurate trigger time, so that the trigger signal sent by the trigger circuit has higher reliability and accurate timing. After the trigger signal, the first count value in the trigger process is compared with the preset count value, and the higher the reliability of the trigger signal and the more accurate the timing are, the higher the accuracy of the first count value in the trigger comparison is, so that the accuracy of judging whether the synchronization is performed can be improved.

In an embodiment, adjusting the playing of the audio data based on the difference between the first count value and the preset count value includes: and adjusting a playing clock of the audio equipment based on the difference value, wherein the playing clock is used for controlling the time for playing the preset quantity of the audio data.

The playing speed can also be called as playing speed, and represents the number of the audio data played in unit time, so that in the embodiment of the application, the playing number of the audio data can be increased or reduced by adjusting the playing clock, thereby reducing the clock difference between different audio devices and realizing synchronous playing between different audio devices.

In an embodiment, a phase-locked loop is configured in the audio device, and the adjusting the playing clock of the audio device based on the difference value includes: inputting the difference value into a phase-locked loop to obtain an output clock of the phase-locked loop; the phase-locked loop is configured with a crystal clock, and the phase-locked loop is used for generating the output clock based on the difference value and the crystal clock; and updating the playing clock to the output clock of the phase-locked loop.

In the embodiment of the application, the crystal clock is arranged in the phase-locked loop, is a hardware clock and is not influenced by abnormal operation of audio equipment software, so that the phase-locked loop is used for determining the output clock based on the difference value and the crystal clock, and the output clock is determined to be a playing clock, thereby the playing clock has higher accuracy and the synchronization effect among all audio equipment is improved.

In an embodiment, a resampling module is disposed in the audio device, and the adjusting the playing of the audio data based on the difference between the first count value and the preset count value includes: and adjusting the resampling rate of audio data playing based on the difference value, wherein the resampling rate is used for representing the playing amount of the audio data in unit time, and the resampling module is used for determining the resampling rate.

The play speed characterizes the number of the played audio data in unit time, and in the embodiment of the application, the play number of the audio data in unit time can be reduced or increased by adjusting the resampling rate so as to realize the adjustment of the play speed, reduce the difference of the played audio data in number and realize the synchronization of the clock and the play speed.

In an embodiment, the adjusting the resampling rate of the audio data playing based on the difference value includes: determining a resampling ratio and/or a resampling weight; the resampling rate is related to a resampling ratio and a resampling weight; adjusting the resampling ratio and/or resampling weight based on the difference; wherein if the difference value characterizes that the first count value is larger than the preset count value, the resampling weight and/or the resampling ratio are reduced; and if the difference value represents that the first count value is smaller than the preset count value, increasing the resampling weight and/or the resampling ratio.

In the embodiment of the application, the resampling rate is determined based on the resampling rate and the resampling weight, so that the purpose of adjusting the audio playing speed can be realized by adjusting the resampling rate and the resampling weight, thereby realizing synchronous playing among audio devices. If the difference value of a certain audio device represents that the first count value is larger than the preset count value, the current playing speed or clock of the audio device is faster than other audio, and the playing speed can be reduced by reducing the resampling weight and/or the resampling weight so as to reduce the playing difference of the audio data between the audio device and other devices, so that synchronous playing is realized; otherwise, if the difference value of a certain audio device represents that the first count value is smaller than the preset count value, the current playing speed or clock of the audio device is represented to meet other audios, and the playing speed can be increased by reducing the resampling weight and/or the resampling ratio so as to reduce the difference of playing the audio data between the audio device and other devices, thereby realizing synchronous playing.

In an embodiment, before said adjusting the resampling ratio and/or the resampling weight based on the difference value, the method further comprises: and compensating the first count value based on the resampling weight to determine the difference value based on the compensated first count value.

In this embodiment, there is often a deviation between the time when the first count value of the counter is collected and the time when the audio data is actually played, and by compensating the first count value, the compensated first count value has higher accuracy, and the difference between the first count value and the audio playing time is reduced, so that the accuracy of the determined difference is improved, and the synchronization effect of the audio data playing after adjustment is further improved.

In a second aspect, the embodiment of the present application further provides an audio synchronous playing method, which is applied to each audio device in the audio playing system; the audio playing system comprises at least two audio devices, and each audio device is connected with the same sound source device based on a WiFi direct connection function in a WiFi protocol; the sound source device is configured as a GO device, each of the audio devices is configured as a GC device, the method comprising: receiving a time stamp of the connected sound source equipment and audio data sent by the sound source equipment, wherein the time stamps received by the audio equipment are consistent; the sound source device is configured to send out a beacon frame, and the beacon frame carries the timestamp; and adjusting the playing of the audio data based on the time stamp so that each audio device synchronously plays the respective audio data.

In the embodiment of the application, the audio device can be directly connected with the audio device through WiFi, and the audio device can be configured to send out the beacon frame so that the beacon frame carries the time stamp, and each audio device can realize the synchronization with the audio device according to the time stamp, and further each audio device can synchronously play the audio data. It should be noted that in this embodiment, the beacon frame and the timestamp thereon are not sent by the access point, but by the GO device (i.e., the audio source device). In the audio synchronous playing process, the first count value and the preset count value are used for adjusting the playing of the audio data based on the difference value between the first count value and the preset count value. However, the role of the wireless access point in the audio synchronized playback method of the first aspect is replaced by the GO device.

In a third aspect, an embodiment of the present application provides an audio apparatus, including: the wireless access module is used for being connected with the wireless access point to receive the time stamp transmitted by the wireless access point; or the wireless access module has the function of WiFi direct connection; and the processor is connected with the wireless access module and used for executing the audio synchronous playing method according to any one of the first aspect.

In an embodiment, the audio device further comprises a counter for updating a first count value of the counter based on the timestamp.

In an embodiment, the wireless access module is a WiFi module, and the WiFi module is configured to receive a beacon frame transmitted by the wireless access point or the GO device, where the beacon frame carries the timestamp.

In one embodiment, the audio device is a wireless headset.

In this embodiment, when a person uses headphones to listen to audio data, the headphones are usually placed on the ears, the ears can listen to the audio data faster, and when different wireless headphones are not synchronized with the audio data, the person can obviously feel the non-synchronization, so that the problem of the non-synchronization of the audio data playing among different wireless headphones can be effectively solved, and the effect of the synchronization playing of the audio data is improved by applying the audio synchronization playing method in the processor of the headphones.

In a fourth aspect, an embodiment of the present application provides a storage medium having stored therein instructions executable by one or more processors to implement the audio synchronized playback method according to any one of the first aspects.

In a fifth aspect, an embodiment of the present application provides an audio synchronous playing system, including: at least two audio devices according to any of the second aspects for playing audio data transmitted by a playback source device; and the wireless access point is in wireless communication connection with each audio device and is used for sending the time stamp to the audio device.

In an embodiment, the wireless access point is configured to send a beacon frame to the audio device based on WiFi, where the beacon frame carries the timestamp.

In an embodiment, the wireless access point is the sound source device.

In the embodiment of the application, the audio source equipment is configured as the wireless access point, and the audio source equipment sends the time stamp to the audio equipment through different channels or at different time, so that each audio equipment plays based on the time stamp of the audio source equipment, and audio data can be synchronously played among the audio equipment. In addition, the audio source equipment is configured as the wireless access point, other equipment does not need to be additionally arranged as the wireless access point, and the complexity of the audio synchronous playing system is reduced, so that the cost for realizing the audio synchronous playing can be reduced.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and should not be considered as limiting the scope, and other related drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a flowchart of an audio synchronous playing method according to an embodiment of the present application;

fig. 2 is a schematic diagram of an audio device according to an embodiment of the present application;

fig. 3 is a schematic diagram of an audio synchronous playing system according to an embodiment of the application.

Icon: an audio device 200; a wireless access module 210; a processor 220; an audio synchronized playback system 300; wireless access point 310.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application more apparent, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.

Firstly, the embodiment of the application provides an audio synchronous playing method, which can be applied to each audio device in an audio playing system.

The audio playing system comprises a sound source device and at least two audio devices. Audio devices include various types of devices capable of playing audio data, such as headphones, boxes, or speakers, among others. The audio source device may provide audio data to the audio device, e.g., the audio source device may be a cell phone, tablet computer, etc. The audio source device may provide various audio data such as a call, a voice, and music for the audio device, so that the audio device plays the audio data sent by the audio source device.

In the embodiment of the application, after the audio synchronous playing method is applied to each audio device, each audio device can synchronously play the audio data. For example, when the audio playback system includes a pair of wireless headphones (left headphone and right headphone), the audio synchronous playback method is applied to the left headphone and the right headphone, respectively, so that the left headphone and the right headphone play the same audio data transmitted by the sound source device.

Next, referring to fig. 1, fig. 1 is a flowchart of an audio synchronous playing method according to an embodiment of the present application, where the audio synchronous playing method includes:

s110, receiving the time stamp of the connected wireless access point.

In the embodiment of the application, the time stamps received by the audio devices are consistent, so that an implementation basis is provided for synchronous playing of the audio devices. In an embodiment of the present application, each audio device may be connected to the same wireless access point, and when each audio device is connected to the same wireless access point, the time stamp received by each audio device is consistent.

In an embodiment of the present application, each audio device is configured to connect with a wireless access point, which may be an access point of various types of wireless networks to provide a network for the audio device. Such as an access point for a WiFi network, a bluetooth access point, an access point for a cellular network, etc. The audio source device is connected with the wireless access point, and can transmit audio data to the audio device through a network provided by the wireless access point. In this embodiment, the wireless access point is configured to send a timestamp to the audio device, where the timestamp may be used to characterize clock information of the wireless access point, so that the audio device can adjust playing of audio data by itself after receiving the timestamp, so that the audio device can be matched with a clock of the wireless access point, and when different audio devices are matched with clocks of the wireless access point, playing synchronization is also implemented between the audio devices.

In some embodiments, the time stamp may also be used to characterize time information of any audio device connected to the wireless access point. The audio devices can send the own time information to the wireless access point through communication connection with the wireless access point, the wireless access point generates a time stamp according to the time information and sends the time stamp to each audio device, so that each audio device can adjust the playing of the audio data according to the time stamp.

Wherein, when the wireless access point sends the time stamp before the audio device, the time stamp is transmitted through a time or channel different from the audio data. For example, the wireless access point is configured to periodically transmit a time stamp to the audio device, and the audio device does not transmit audio data when transmitting the time stamp. Similarly, in some scenarios, if the wireless access point needs to send the audio data and the timestamp at the same time, the wireless access point may be configured to send the audio data and the timestamp through different channels, so that the timestamp and the audio data do not affect each other as much as possible in the transmission process, so as to reduce the occurrence of the situation that the timestamp or the audio data is compressed or discarded in the transmission process, so as to improve the integrity of the audio data and the timestamp, thereby improving the playing quality of the audio data and the synchronization effect of synchronization according to the timestamp.

In the above embodiments, the wireless access points may be the same wireless access point, and in other embodiments, the wireless access points to which each audio device accesses may be different wireless access points, where the time stamps between the different wireless access points should be consistent. For example, timestamp synchronization may be performed between wireless access points. For another example, each wireless access point belongs to the same network group and shares the same timestamp, for example, the WiFi network includes a router and a relay, different wireless access points may be the same router and the relay in the WiFi network, and the audio devices may be connected to the router and the relay respectively, where the timestamps sent by the router and the relay to different audio devices remain consistent, so that the different timestamps represent the timestamps of the same wireless access point. For example, the time stamps received by the respective audio devices may be made uniform by having the repeater receive the time stamp of the router and transmit the time stamp to the respective audio devices. In some embodiments, the clocks of the wireless access points in the wireless networking are synchronized, so that the time information represented by the time stamps sent by the wireless access points are the same, and the time stamps sent by different wireless access points with synchronized clocks can be understood as the same time stamp.

In this scenario, the reception of time stamps for the respective connected wireless access points by different audio devices may also be understood as receiving the same time stamp over different channels.

In some embodiments, if the wireless access point is an access point of a WiFi network, the wireless access point is connected to the audio device through WiFi, and the beacon frame sent by the wireless access point of the WiFi network may carry a time stamp.

The WiFi communication protocol defines that the wireless access point will periodically send a beacon frame to the connected device, and the beacon frame is sent separately from the data frame, in this embodiment, a timestamp may be configured in the beacon frame, so that the wireless access point sends the timestamp to the audio device through the beacon frame, and thus the audio device obtains the timestamp to perform synchronous playing of the audio data. The transmission principle between beacon frames and data frames may be defined with reference to the protocols of existing WiFi networks and will not be expanded here. When the audio device is connected to the wireless access point through WiFi, the receiving period of the timestamp may be a transmitting period of the beacon frame.

Further, in some embodiments, the wireless access point may be a sound source device.

Currently, some audio devices have a function of a wireless access point, for example, a mobile phone, a tablet computer, etc., may turn on a WiFi hotspot function, and provide a WiFi network to enable an audio device to be accessed, so in this embodiment, the wireless access point may be the audio device, and no device that enables the audio device to access a router, a repeater, etc. to transit is required. In this case, the wireless access point may be a soft access point.

When the audio source equipment is a wireless access point, the time stamp and the audio data can be transmitted through different time or channels, the time stamp does not occupy the frequency band bandwidth of the audio data, and the compression or discarding of the audio data and the time stamp is reduced, so that the transmission of the time stamp and the audio data for synchronization is not affected or is less affected, and the synchronization effect and the playing quality of the audio data can be better.

Some devices have WiFi Direct (WiFi Direct) functionality, which may enable the devices to connect directly without a wireless access point. In WiFi Direct, two types of devices are included, which are a GO (Group Owner) and a GC (Group Client), respectively, the GO may provide a function similar to a wireless access point, and the GC may be directly connected to the GO. The relevant content of WiFi Direct can refer to the prior art, and is not expanded here. The audio device may be a GC device, and may be further connected to the GO device through a WiFi direct function, where the audio device receives a beacon frame sent by the GO device, and the beacon frame may carry a timestamp. In the WiFi direct connection function, the audio source device transmits a beacon frame and audio data to the audio device at different times.

And S120, adjusting the playing of the audio data based on the time stamp so that each audio device synchronously plays the respective audio data.

In this embodiment, since the time stamps received by different audio devices represent the same time information, for example, the time stamps represent clock information of the same wireless access point or the same GO device, each audio device may adjust its own clock or adjust its own playing speed, so that its own clock for controlling audio data playing can be matched with the clock of the wireless access point, thereby realizing clock matching between different audio devices, and thus, each audio device can synchronously play audio data.

It should be noted that, the clock of the audio device controlling the audio data playing can be matched with the clock of the wireless access point, and is not limited to the clock of the audio device being equal to the clock of the wireless access point. In some embodiments, the clock of the audio device for playing audio data may be adjusted to correspond to the timestamp and then added with a preset value, so as to obtain an updated clock, that is, an updated clock=timestamp+preset value, where the preset values added by different audio devices are the same. It can be understood that the purpose of audio synchronous playing is to enable synchronous playing of the same audio data between different audio devices, and whether audio is synchronously played is irrelevant to the clock of the wireless access point, which is only the reference condition for audio synchronization.

Furthermore, in embodiments of the present application, each audio device may play the same or different audio data. It will be appreciated that the audio data sent by the audio source to the different audio devices may be the same or different. For example, the left earphone plays mainly the male part packet in the audio data, and the right earphone plays mainly the female part packet in the audio data, and at this time, the two played data have a difference. Synchronous playing means that audio playing time is matched, for example, if a certain sound source is 7 channels, 7 sampling points can be obtained at the moment corresponding to a certain time, and when playing, the 7 sampling point data are played simultaneously.

In the embodiment of the application, the same time stamp sent by the wireless access point or the GO device is received among the audio devices, so that the audio devices can take the same time stamp as a reference to adjust the playing of the audio data, thereby realizing the playing synchronization. The audio data and the time stamp are transmitted through different time or different channels, so that the possibility that the time stamp and the audio data are compressed or lost in the transmission process can be reduced, the integrity of the audio data and the time stamp is ensured, and the synchronous effect and the playing effect of synchronous audio playing are improved.

In addition, the audio playing among the audio devices is based on the clock of the wireless access point or the GO device, and compared with the current common mode of synchronously playing the audio devices according to the clock of the audio devices, the audio playing method provided by the embodiment of the application can remove the limitation of the clock of the audio devices on the audio devices, the audio devices can be asynchronous with the audio devices in frequency and phase, and the complexity and the implementation difficulty of synchronous playing of the audio devices are simplified.

The foregoing is only a part of embodiments provided by the present application, and next, an audio synchronous playing method provided by the present application will be described.

In one embodiment, a counter may be configured in the audio device, and for S110, the first count value of the counter may be updated based on the timestamp.

In this embodiment, the counter may be implemented as various hardware circuits capable of implementing a counting function, and the timestamp is recorded by using the hardware circuits, and since the operation of the hardware circuits is less affected by the operation of the audio device software, when the first counter of the counter records the timestamp, the recording of the first count value is less affected by the abnormal operation of the audio device software, so that the recording of the timestamp in the audio device can be made to have higher reliability by the first count value.

The first count value can be understood as a record of a time stamp in the audio device, a counter is arranged in the audio device, and the time stamp is recorded by the first count value, so that the audio device can know the clock condition of the wireless access point when the time stamp is not received, the audio device can control the playing of the audio data according to the first count value, and the audio playing is synchronous with other audio devices.

In different embodiments of the application, the counter may be updated based on the time stamp in different ways.

In an alternative embodiment, the first count value may be updated directly to the value corresponding to the timestamp. In other alternative embodiments, the first count value may be updated to a value corresponding to the timestamp plus a preset value, for example, the updated first count value=timestamp+preset value.

In an alternative embodiment of the present application, updating the first count value of the counter based on the timestamp includes: gradually updating the first count value in a plurality of clock cycles until the first count value is matched with the time stamp, and finishing updating the first count value; the total duration of the plurality of clock cycles is less than the receive period of the timestamp.

In the embodiment of the present application, the audio device and the wireless access point or the GO device are respectively different devices, and the respective clock period length, frequency, etc. may be different. The wireless access point or the GO device needs to send both a timestamp and audio data, the sending requirement of the audio data is greater than the sending requirement of the timestamp, the sending period of the timestamp is greater than the sending period of the audio data, correspondingly, the receiving and processing period of the audio data on the audio device is smaller than the receiving period of the timestamp, and then the audio device can automatically operate for a plurality of periods to receive the timestamp once, for example, the wireless access point sends the timestamp to the audio device once every 5000 clock periods of the wireless access point, and 10000 self clock periods that the audio device can operate receive the timestamp once, so that the update of the first count value does not need to be updated immediately. If the updated first count value of the audio device is too large, the audio device may compress and discard part of the audio data to affect the playing quality of the audio data, so in this embodiment, the audio device may update the part gradually in a plurality of clock cycles of the audio device, and update the part each time until the updated part matches with the timestamp. For example, the first count value is 1 less than the timestamp value, and may be divided into 5 updates, with the first count value incremented by 0.2 each clock cycle until it matches the timestamp. Thus, it is possible to reduce the occurrence of a problem of degradation in audio playback quality caused when audio data is played back in synchronization.

Further, when gradually updating the first count value, it should be noted that the total duration of the clock period used to update the first count value should be less than the reception period of the time stamp, to avoid the situation where the next time stamp comes without the previous first count value update being completed.

It should be noted that, in the case that the wireless access point or the GO device is synchronized with the audio device, the update frequency and amplitude of the first count value and the wireless access point should be the same. It will be appreciated that the time stamp may be received for a longer period of time during which the clock of the wireless access point is updated according to the clock period of the wireless access point itself, and in this embodiment of the present application, if the first count value is to be kept synchronized with the wireless access point, and if the time stamp is not received, the first count value is also to be updated.

The update frequency of the first count value may be related to the audio device's own clock period. For example, the wireless access point or the GO device transmits two adjacent time stamps, the time information carried by the time stamps is increased by 2, and the audio device receives the time stamps once every 10 clock cycles, the first count value should be increased by 2 every 10 clock cycles, or 0.2 every cycle.

Taking the example that the first count value is equal to the timestamp and is regarded as the matching of the first count value and the timestamp, the wireless access point or the GO device sends the time information corresponding to the timestamp for the first time to be 10, and the first count value corresponding to the audio device is 10 or updated to be 10, if the information carried by the timestamp sent by the wireless access point for the second time is 12, the first count value corresponding to the audio device at the moment should be 12.

If the first count value does not match the timestamp when the audio device receives the timestamp for the first time, the audio device needs to be updated, if the first count value is 9, the updated value should be increased in the subsequent 9 periods, if the updated value is originally updated by 0.2 each period, the updated value may need to be 0.3, 0.4, etc. until the updated value matches the timestamp, for example, 1 st to 5 th clock periods of the audio device after the timestamp is received for the first time, the time information corresponding to the wireless access point should be increased from 10 to 11, and the audio device may be increased from 9 to 11, thereby realizing the matching between the first count value and the timestamp, that is, also being understood as realizing the matching between the clock of the audio device and the clock of the wireless access point.

The gradual updating mode is suitable for the audio equipment after formally working or accessing the wireless access point, and when the audio equipment receives the time stamp for the first time, the first count value should be directly updated to be matched with the time stamp, at this time, because the time stamp is received for the first time, the audio data is not played or is less played, and the influence of the direct updating of the first count value on the playing quality of the audio data can be ignored.

The first time stamp is to be broadly understood, and includes, but is not limited to, a first time stamp after the audio device accesses the wireless access point, or a first time stamp after the audio device plays the audio data of the music, or a first time stamp after the audio device receives the audio data of the call and plays the audio data, which is only an example, and is not limited to the present application.

In the above embodiment, the counter is incremented with each period of the audio device, and the period nominal value may be used to characterize the accumulated value of the counter per clock period of the audio device. The period nominal value is a preset value, and in an ideal state, the received difference value of every two time stamps is converted into a value under the clock period of the audio device, for example, the receiving period of 1 time stamp corresponds to the clock period of 10 audio devices, and the difference value of the two time stamps is 1, and the characterization value is 1/10, namely 0.1.

In some embodiments of the present application, updating the first count value of the counter based on the timestamp may be determining the latest first count value based on the current first count value in the counter and a preset periodic nominal value; the latest first count value is updated to the first count value in the counter. Illustratively, if the current first count value is 9 and the period nominal value is 0.1, then in each clock period of the audio device, the current count value is increased by 0.1, that is, the first count value is updated to 9.1, 9.2, 9.3, etc., until the first count value is 10, at which time, the next timestamp is received, and the first count value is adjusted according to the timestamp.

It should be distinguished that the nominal value of the period is not equal to the value used for gradually updating the first count value as described above. For example, the period nominal value is 0.2, the timestamp is 10, the current first count value is 9, in the process of gradually updating, the latest first count value=the current count value+the period nominal value+the preset value, the preset value is related to the difference between the timestamp and the first count value at the moment of receiving the timestamp, for example, the difference is 1, if the difference needs to be compensated for in two audio device periods, the preset value can be 0.5, then in the first clock period after the audio device receives the timestamp, the latest count value=9+0.2+0.5=9.7, the latest count value=9.7+0.2+0.5=10.4, at this time, the difference between the timestamp and the first count value has been compensated for, and only the period nominal value needs to be increased in the subsequent steps, for example, the latest count value=10.4+0.2=10.6 in the third clock period. It is to be understood that the foregoing is only exemplary and is not to be considered as limiting the application.

It should be noted that the above values are merely examples for easy understanding, and the count value and the timestamp in the actual implementation may be other values, and the two values may not be equal, but have a corresponding difference relationship. For example, for a WiFi protocol, its period nominal value=1e6/nominal frequency of the audio device's own clock, the nominal frequency characterizes the proportional relationship of the period duration of the audio device's reception timestamp to the own running period, where 1e6 represents the power of a hexagon of 10. The first count value and the timestamp may then be of a certain difference, and the difference is maintained throughout the subsequent matching process. For example, the first count value is updated by the period nominal value 1 to be 1, and the clock maintains the first count value and the timestamp difference 2 in the subsequent process.

In addition, the wireless access point or the GO device sends a counting clock corresponding to the time stamp, the counting clock is influenced by a hardware clock or a frequency offset corresponding to the wireless access point, the audio device operation processing period of the audio data is influenced by a hardware clock or a frequency offset corresponding to the audio device, and the hardware clocks or the frequency offsets of the wireless access point and the audio devices are different. The frequency offset or clock may be affected by temperature, circuit aging, etc., after the hardware clock runs for a period of time, some deviation may occur more or less, and the preset period nominal value may not conform to the actual clock updating speed or frequency of the current wireless access point or audio device, so in some embodiments of the present application, the period nominal value may be further modified to update the first count value based on the modified period nominal value.

In some embodiments of the application it may be determined whether the time stamp sent by the wireless access point was received for the first time, thereby determining whether the audio device has been operating for a period of time. Then, when the first count value is updated, the corresponding relation between the timestamp and the first count value can be used for obtaining a correction period nominal value, and then the latest first count value is determined based on the current first count value in the counter and the correction period nominal value; the latest first count value is updated to the first count value in the counter.

The correspondence of the timestamp to the first count value characterizes a difference between the timestamp and the first count value, such as how much the first count value differs from the timestamp. The clock frequencies of both the wireless access point and the audio device may deviate, which may be due to environmental factors such as temperature, circuit aging, etc. The period nominal value is a preset value in an ideal situation, when the clock frequency of the wireless access point or the audio device changes, if the first count value is still updated with the period nominal value, the deviation between the timestamp and the first count value may be gradually increased, so that the playing of each audio device is not synchronous. In the embodiment of the application, if there is a difference between the timestamp and the first count value, the deviation of the period nominal value can be determined through the corresponding relation between the preset period nominal value and the correction period nominal value, so as to adjust the period nominal value according to the deviation. Illustratively, the original period nominal value is 2.000000, and the modified period nominal value may be 1.999999 or 2.000001. The corresponding relationship may be determined according to a relative magnitude relationship between the first count value and the timestamp, if the first count value is greater than the timestamp, the counting speed of the characterization counter is greater than the clock updating speed of the wireless access point, and at this time, the corrected periodic nominal value may be made smaller than the preset nominal value, so that the respective accumulated speeds of the first count value of the counter and the timestamp of the wireless access point are matched. Otherwise, if the first count value is smaller than the timestamp, the counting speed of the characterization counter is smaller than the clock updating speed of the wireless access point, and at this time, the corrected periodic nominal value can be made to be larger than the preset nominal value, so that the respective accumulation speeds of the first count value of the counter and the timestamp of the wireless access point are matched.

In some embodiments provided by the present application, the correspondence may be: correction period nominal value = previous period nominal value + (difference between previous and subsequent time stamps-first count value difference corresponding to previous and subsequent time stamps)/previous and subsequent time stamp difference; or, the correction period nominal value=the previous period nominal value + (difference between the previous and subsequent time stamps-first count value difference between the previous and subsequent time stamps)/first count value difference between the previous and subsequent time stamps. The above example is to determine the modification period nominal value with reference to an audio device or a wireless access point or GO device, respectively. In some embodiments, the modification period nominal value may also be determined with other reference parameters, such as an initial clock/factory clock of the audio device or wireless access point, etc.

The above content is updated by the first count value of the local counter of the audio device, and the first count value is updated according to the timestamp, so that each audio device records the clock of the wireless access point or the GO device, and obtains a standard clock which can be shared, so as to synchronize the playing of the audio data based on the clock. The first count value is a record of the wireless access point time stamp by the audio device, which is equivalent to the record of the wireless access point clock, the first count value is related to the time stamp provided by the wireless access point and the clock period of the wireless access point, and the clock period of the wireless access point is in a proportional relation with the clock period of the audio device, so that the first count value increases along with the clock period of the audio device, and in fact, the first count value is a clock tracking the wireless access point or the GO device.

Next, some embodiments of adjusting the playback of the audio data based on the first count value at S120 will be described.

Since the transmission of the time stamp is not performed every clock period, the wireless access point or the GO device needs to allocate more transmission resources to the transmission of the audio data, and correspondingly, the audio device receives the time stamp at intervals of a plurality of clock periods, and further, in the embodiment of the present application, the time for adjusting the playing of the audio data may be further configured. When the adjustment time of playing the audio data is reached, the first count value of the counter at the moment is acquired again, and the playing of the audio data is adjusted according to the first counter.

For example, in an embodiment of the present application, a preset clock signal may be configured in the audio device, a trigger point may be configured in the preset clock signal, and when the audio device works to the trigger point, a trigger signal is generated to obtain a first count value from the counter based on the trigger signal to adjust audio playing.

In some embodiments of the application, a trigger circuit may be provided within the audio device, based on which a preset clock signal within the audio device may control the trigger circuit to generate the trigger signal. The trigger signal may be generated immediately or after a certain period of time.

The generation of the trigger signal is controlled by the hardware circuit, so that the trigger signal can be stably triggered, the situation that the trigger signal cannot be generated due to the abnormality of the audio equipment software is reduced, the reliability of the trigger signal is improved, and in addition, the stable trigger signal can enable the audio data to be updated regularly, and the synchronous playing accuracy of the audio equipment is maintained.

In some embodiments of the present application, the playing of the audio data is adjusted based on the first count value, and in addition to directly adjusting the clock of the audio playing, the first count value may be compared with a preset count value; if the first count value is not matched with the preset count value, the playing of the audio data is adjusted based on the difference value between the first count value and the preset count value. In some embodiments, the first count value of the trigger signal indicating the trigger time is compared with a preset count value.

In this embodiment, the preset count value characterizes a time when the audio device plays a preset amount of audio data. The preset count value is irrelevant to the time stamp, the time of the preset number of audio data is influenced by the length of the playing clock period of the audio equipment and the number of the audio data, and 1 data is played in one playing clock period, so that the preset count value is accumulated according to the working clock period of the audio equipment, the accumulation speed is the same as that of the first count value, the preset count value can be understood to be the record of the audio equipment on the clock period, the first count value is the record of the wireless access point or the GO equipment on the clock period, and the recorded objects are different. For example, the preset count value=the previous preset count value+1e6 is a preset nominal period, and the preset nominal period may be a preset period matched with the generation period of the trigger signal, for example, the preset nominal period may be 10ms,20ms, or the like, or N1/fs1 (N1, such as 20, 40, 80, etc., represents the playing number of the audio data in the preset time), and fs1 represents the audio sampling frequency, such as 48KHz/s,44.1KHz/s, etc. Illustratively, the preset nominal period is a time of N play clock times, such as 10ms, because the preset count value unit is also microseconds, consistent with the first count value. Therefore, the difference between the front and back preset count values is 0.01s×10ζ6=1ten thousand, i.e. the preset nominal period is 1 ten thousand, and 0.01s is 10ms.

Accordingly, the difference between the first count value and the preset count value may represent the difference between the clock of the audio device and the wireless access point, if the difference is not 0, it represents that the audio device is not synchronized with the wireless access point, and the audio device may be not synchronized with the other audio devices. Otherwise, if the difference is 0, the audio equipment is represented to be synchronous with the wireless access point, and if the calculated difference of all the audio equipment is 0, audio data are synchronously played among the audio equipment.

Furthermore, whether the difference is 0 is merely an example of one of the determination of whether the synchronization is provided in the present application, and in some embodiments, it may be determined whether the difference is another number. The essence is to judge whether the difference value between the first counter and the preset count value between different audio devices is the same or not, if the difference value calculated by each audio device is 1, the different audio devices are synchronized.

If the access is asynchronous, the audio equipment needs to adjust the playing of the audio data. The audio data playing synchronization comprises two parts, namely clock synchronization for playing audio data and playing speed synchronization. The clock is used for controlling the playing of the audio data, for example, according to the clock signal, the audio device can control the playing of the corresponding audio data, and the clock synchronization is represented by the same playing time of different audio devices on the same audio data. The play speed synchronization is manifested as the same time duration for the same amount of audio data.

Thus, when adjusting the playing of the audio data, the clock of the playing of the audio data and/or the playing speed of the audio data can be adjusted. If the playing speeds of different audio devices are the same, the clock for playing the audio data can be directly adjusted so as to synchronize the clocks for playing the audio data of all the audio devices. If the playing speeds of different audio devices are different, the playing speed and the clock for playing the audio data are adjusted, for example, the playing speed is adjusted to be consistent with the playing speeds of other audio devices, and then the clock is adjusted to be consistent. Therefore, in different embodiments of the present application, the corresponding adjustment manners may be selected according to the actual situations, respectively.

In addition, the adjustment of the playing speed also has the effect of adjusting the clock for playing the audio data, so that the clocks for playing the audio data are synchronized among different audio devices. For example, the playing speeds of all audio devices are all 0.2/period, the difference between the first count value of a certain audio device and the preset count value is 1, and the playing speed of the audio device can be adjusted to be 0.4/period, and after the clock period of 5 audio devices, the difference is 0, and at this time, the playing speed is adjusted to be 0.2/period, and the audio devices are synchronously played.

The play speed characterizes the amount of audio data played per unit time, and thus, the play speed can be achieved by adjusting the amount of audio data played within a predetermined time or the time required to play a predetermined amount of audio.

In an alternative embodiment, adjusting the play speed includes: the playback clock of the audio device is adjusted based on the difference.

In the foregoing, the operation within the volume audio device is controlled by its own clock period, whereas in practice the audio device itself comprises various types of clocks, for example, a clock that receives audio data, a clock that plays audio data, or a clock that has other functions. In this embodiment, the play clock is a clock for controlling the play of audio data. The preset clock signal for controlling the trigger circuit to generate the trigger circuit can be a clock signal of a playing clock.

The number of played audio data is defined in the audio device according to the playing clock, for example, the clock period of one playing clock is t, and 20 audio data are played. Adjusting the play clock may be adjusting the clock period of the play clock, such as changing t to 0.99999999 t,1.000001t, etc., thereby achieving an increase or decrease in play speed.

If the first count value is larger than the preset count value, the audio equipment is characterized to be slower than other audio equipment in playing of the audio data, and the period of a playing clock can be reduced so as to improve the playing speed. Otherwise, if the first count value is smaller than the preset count value, the period of the playing clock can be increased to reduce the playing speed.

The first count value and the preset count value are equal, and then the first count value and the preset count value are synchronous, and will not be described later.

In some embodiments of the present application, to accurately adjust the playing speed, a phase-locked loop may be disposed in the audio device, so that the phase-locked loop determines the updated playing clock.

The pll is a hardware circuit, and the specific structure and principle of the pll may refer to the prior art, and will not be described in detail herein. The phase-locked loop is provided with a crystal clock, the crystal clock is a hardware clock, the operation of the crystal clock is not influenced by audio equipment software, and the accuracy is high. When the phase-locked loop is used for determining the playing clock, the difference value between the first count value and the preset count value can be input into the phase-locked loop, the phase-locked loop can adjust the oscillator clock or the integer frequency division clock according to the difference value and the crystal clock, and the oscillator clock or the integer frequency division clock can be used as the output clock of the phase-locked loop so as to replace the playing clock of the audio data with the oscillator clock or the integer frequency division clock.

As an alternative embodiment, the adjustment of playing of the audio data may also be to adjust the playing amount of the audio data in unit time of the audio device. For example, the original audio device plays 80 data in one play clock period, and plays 80.000001 data, 79.999999 data, etc. in 1 play period after adjustment, thereby increasing or decreasing the play speed.

In some embodiments of the application, a resampling module is disposed in the audio device, where the resampling module is configured to change a sampling rate corresponding to the audio data through the audio data, and the resampling module may further obtain a playing frequency of the audio data by the audio device through a crystal clock of the audio device, where the sampling rate corresponding to the audio data may represent the audio data sampling frequency of the audio data that is sent by the audio source device to the audio device for playing, and the playing frequency may determine a time of playing the audio data once. The playing frequency is also equal to the sampling rate of the audio data after passing through the resampling module. The playing frequency of the audio device is compared with the corresponding sampling rate of the audio data before the resampling module, so that the resampling rate can be obtained, and the changing proportion of the sampling rate of the audio data before and after the resampling module can be represented by the resampling rate. In the application, when the resampling module is arranged, the audio data sampling rate is agreed to the audio data sampling rate before the resampling module. For example, the crystal clock of the audio device is 26MHz/s, the corresponding playing frequency is determined to be about 50.78125KHz by 512 frequency division, and if the audio data sampling rate is determined to be 48KHz by the audio data, the resampling rate is 48/50.78125. Thus, the adjustment of the playback speed of the audio data can be achieved by adjusting the resampling rate.

The resampling rate may then be adjusted by first determining a resampling ratio and/or a resampling weight and then adjusting the resampling ratio and/or the resampling weight based on the difference. For example, if the difference characterizes the first count value to be greater than the preset count value, the resampling weight and/or the resampling ratio are reduced; if the difference value represents that the first count value is smaller than the preset count value, increasing the resampling weight and/or the resampling ratio; if the difference is 0, no adjustment is needed.

In some embodiments, the resampling module operates on a first audio clock that is N2 times the frequency of the playback clock, i.e., N2 times the clock period of the playback clock and the first audio clock period (N2 is a positive integer greater than 1, e.g., 64, 128, 256, 384, 512, etc.). When the resampling module works, every first audio clock period, the resampling module accumulates a preset value for a predefined first accumulated value, and the preset value is one-half of N2 of the resampling ratio. When every N3 audio data (N3 is a preset value, such as 20, 40, 80, etc., and can be set according to the requirement), the decimal part of the first accumulated value reaches a preset value 2 (such as 0,0.1,0.2,0.3, etc.), the first audio clock controls the trigger circuit to generate a trigger signal to trigger the comparison between the first count value and the preset count value, and at the same time, the audio device is considered to complete the playing of the audio data (i.e., the audio data before N3 resamples). I.e. the playing time of the audio data is determined every time N3 passes of the audio data before resampling and the fractional part of the first accumulated value reaches a predetermined value 2 for the first time. Thus, as long as the first count value of all the audio devices is the same (for example, all the first count values are equal to the preset count value) at the moment when the trigger circuit generates the trigger signal, the audio devices realize the audio playing synchronization.

The resampling ratio is an influence preset value, the preset value accumulated each time is adjusted through adjusting the resampling ratio, the fixed value N3 is unchanged, the time for the first accumulated value to reach N3 is reduced, if T is needed to reach N3 originally, the current time change is 0.9T, the corresponding number of the audio data played originally is 20, and the current playing 18 is regarded as completing the sequential playing of the audio data.

And the fractional portion of the first accumulated value is a resampling weight. Completing the playing of the audio data only needs to see whether the integral part of the first accumulated value is increased by N3, and does not need to pay attention to the fractional part, but increasing or decreasing the fractional part may enable the audio data to be increased to 3.8 only by accumulating the original first accumulated value for 0.9 for three times, if the fractional part of the first accumulated value is adjusted to be 1.2, the integral parts of 3.0,3.0 and 3.8 can be the same only by accumulating for two times, and the integral parts are regarded as completing the playing of the audio data once, and at the moment, the integral parts are different by 0.9 once, and the cycle time of accumulating for two times is shorter than that of accumulating for three times, at the moment, the played audio data is less, thereby realizing the reduction of the playing amount of the audio data.

Therefore, in the embodiment of the application, the playing quantity of the word audio data can be adjusted based on the resampling weight and/or the resampling ratio, so that the adjustment of the audio playing speed is realized, and further, the synchronous playing of the audio data by different audio devices is realized. If the difference value represents that the first count value is larger than the preset count value, reducing the resampling weight and/or the resampling ratio; if the difference value represents that the first count value is smaller than the preset count value, increasing the resampling weight and/or the resampling ratio; if the difference is 0, no adjustment is needed.

In some embodiments, when the resampling module works, the resampling module accumulates the preset value to the first predefined accumulated value every a certain playing clock period, the preset value is a resampling ratio, and when the audio data entering the resampling module is every N3 (N3 is a preset value, such as 20, 40, 80, etc., and can be set according to the requirement), the triggering circuit is controlled to generate the triggering signal to trigger the comparison between the first count value and the preset count value. Obviously, the fractional part of the first accumulated value is different at the moment when the trigger circuit generates the trigger signal, and the fractional part of the first accumulated value determines the weighting weight of the audio data played after resampling the audio data obtained by weighted averaging before and after resampling, so that the audio data played by the trigger circuit has different time delays at the moment when the trigger circuit generates the trigger signal, and the time delays correspond to the fractional part of the first accumulated value. In some embodiments of the application, the first count value may be further compensated to obtain a compensated first count value, and then the difference between the compensated first count value and the preset count value is determined by the compensated first count value, so as to adjust the playing of the audio data, thereby improving the effect of audio synchronous playing by improving the accuracy of the first count value. The compensation value for the first count value may be a fractional part of the first accumulated value, which is a resampling weight, 1e 6/pre-resampling audio sampling rate e.

In the above embodiments, the adjustment of the playing speed may be achieved by adjusting either the playing clock or the resampling rate, and in some embodiments, the playing speed may also be adjusted by both the two methods, which is merely an example and is not a limitation of the present application.

In the above embodiment of the present application, in response to receiving the beacon frame, each audio device accurately aligns with the timestamp of the beacon frame of the wireless access point or the GO device based on the first count value of the counter, and accurately obtains the first count value of the counter to adjust the audio signal to play based on the accurate timing of the periodic hardware trigger signal or the compensation of the first count value, so that the audio signal is accurately and synchronously played by a plurality of audio devices, and the synchronization precision can be less than 5us or 2us or 1 us. The periodic hardware trigger signal may be generated by the trigger circuit in the foregoing embodiment based on a preset clock signal; the accurate timing may refer to that in the foregoing embodiment, the first audio clock is triggered when the N3 pieces of audio data before the resampling module pass through the first accumulated value fractional part reaches a predetermined value 2 for the first time; compensating the first count value refers to compensating based on resampling weights in the previous embodiments.

Based on the same inventive concept, the embodiment of the application also provides another audio synchronous playing method which is applied to each audio device in the audio playing system; the audio playing system comprises at least two audio devices, and each audio device is connected with the same sound source device based on a WiFi protocol.

The audio synchronous playing method comprises the following steps: receiving the time stamp of the connected sound source equipment, wherein the time stamp received by each audio equipment is consistent; the playing of the audio data is adjusted based on the time stamp so that each audio device synchronously plays the same audio data of the respective sound.

It will be appreciated that configuring the audio source device as a wireless access point is configuring a communication module within the audio device as a wireless access point such that the communication module has the functionality of a wireless access point. In practice, some devices may be directly connected through a WiFi protocol, which is called WiFi direct connection, where the audio source device is not required to be configured as a wireless access point, the audio source device may be configured as a GO device based on the WiFi protocol, and the audio device may be configured as a GC device, so that the audio source device and the audio device are connected through a WiFi direct connection function, and the two devices may be directly communicated, and the wireless access point is not required to be used to forward audio data. The WiFi direct may refer to the description in the foregoing embodiments and the prior art, and will not be further described herein.

In this embodiment, the audio source device is configured as a GO device to send out a beacon frame, where the beacon frame carries a time stamp, and in the WiFi protocol, the data frame is used to send data, and the beacon frame and the data frame are sent in a time-sharing manner, so that the audio source device can be synchronized with the audio source device according to the time stamp by carrying the time stamp with the beacon frame, and the clock of the audio source device replaces the clock of the wireless access point, thereby implementing the function of the audio synchronization playing method.

In one embodiment, after receiving the timestamp of the connected GO device, the audio synchronous playing method further includes: updating a first count value of the counter based on the timestamp; the counter is arranged in the audio equipment, and the first count value is synchronous with the timestamp in the beacon frame of the audio equipment; adjusting playback of audio data based on the time stamp, comprising: and adjusting playing of the audio data based on the first count value.

In one embodiment, updating the first count value of the counter based on the timestamp includes: gradually updating the first count value in a plurality of clock cycles until the first count value is matched with the time stamp, and finishing updating the first count value; the total duration of the plurality of clock cycles is less than the receive period of the timestamp.

In one embodiment, after updating the first count value of the counter based on the timestamp, the method further comprises: determining the latest first count value based on the current first count value in the counter and a preset period nominal value; updating the latest first count value to the first count value in the counter; the period nominal value characterizes an accumulated value of the counter per clock period of the audio device.

In an embodiment, before updating the first count value of the counter based on the timestamp, the method further comprises: judging whether the time stamp sent by the GO equipment is received for the first time; if the timestamp sent by the GO device is not received for the first time, updating the first count value of the counter based on the timestamp, including: obtaining a correction period nominal value based on the corresponding relation between the timestamp and the first count value; determining a latest first count value based on a current first count value in the counter and the correction period nominal value; and updating the latest first count value to the first count value in the counter.

In one embodiment, adjusting playing of the audio data based on the first count value includes: comparing the first count value with a preset count value; the preset count value represents the time of playing the preset number of audio data by the audio equipment; if the first count value is not matched with the preset count value, the playing speed of the audio data is adjusted based on the difference value between the first count value and the preset count value.

In an embodiment, before comparing the first count value with the preset count value, the method further includes: controlling a trigger circuit to generate a trigger signal based on a preset clock signal in the audio equipment; the trigger circuit is arranged in the audio equipment; the trigger signal is used for indicating the first count value of the trigger time to compare with a preset count value.

In an embodiment, adjusting the playing speed of the audio data based on the difference between the first count value and a preset count value includes: and adjusting a playing clock of the audio equipment based on the difference value, wherein the playing clock is used for controlling the time for playing the preset quantity of audio data.

In one embodiment, a phase-locked loop is configured in an audio device, and adjusts a play clock of the audio device based on a difference value, including: inputting the difference value into a phase-locked loop to obtain an output clock of the phase-locked loop; the phase-locked loop is configured with a crystal clock, and is used for generating an output clock based on the difference value and the crystal clock; and updating the playing clock to the output clock of the phase-locked loop.

In an embodiment, a resampling module is disposed in the audio device, and adjusts a playing speed of the audio data based on a difference between the first count value and a preset count value, including: and adjusting the resampling rate of the audio data playing based on the difference value, wherein the resampling rate is used for representing the playing amount of the audio data in unit time, and the resampling module is used for determining the resampling rate.

In one embodiment, adjusting the resampling rate of the audio data playback based on the difference value includes: determining a resampling ratio and/or a resampling weight; the resampling rate is related to the resampling ratio and the resampling weight; adjusting the resampling ratio and/or the resampling weight based on the difference; if the difference value represents that the first count value is larger than the preset count value, reducing the resampling weight and/or the resampling ratio; if the difference value represents that the first count value is smaller than the preset count value, the resampling weight and/or the resampling ratio are/is increased.

In an embodiment, before adjusting the resampling ratio and/or the resampling weight based on the difference value, the method further comprises: the first count value is compensated based on the resampling weight to determine a difference based on the compensated first count value.

It will be appreciated that the audio synchronization method implemented based on the WiFi protocol direct connection is similar to the audio synchronization method implemented based on the wireless access point, and for brevity and brevity, reference is made to the foregoing for details.

Based on the same inventive concept, an embodiment of the present application further provides an audio device, as shown in fig. 2, the audio device 200 includes: a wireless access module 210 and a processor 220.

The wireless access module 210 is configured to connect to a wireless access point or connect to a GO device through a WiFi direct connection, so as to receive a timestamp transmitted by the wireless access point or the GO device. Wherein the wireless access module 210 may also be used to receive audio data.

The processor 220 is connected to the wireless access module 210, and is configured to perform the audio synchronous playing method provided in any of the foregoing embodiments.

In some embodiments, the audio device 200 may further include a counter coupled to the wireless access module 210, the counter configured to update the first count value of the counter based on the timestamp. The counter may be implemented as various types of counting circuits, which are not further described herein.

In an embodiment, the wireless access module 210 may be a WiFi module, where the WiFi module is configured to receive a beacon frame transmitted by a wireless access point or GO device, and the beacon frame carries a timestamp.

In some embodiments, the audio device 200 may further include a phase-locked loop, where the phase-locked loop is connected to the processor 220, and the phase-locked loop is configured to determine an output clock based on the processor 220 and its own crystal clock through a difference between the first count value and the preset count value, and the processor 220 may determine the output clock as a play clock for the audio data.

In some embodiments, the audio device 200 may further include a resampling module, coupled to the wireless access module 210 and the processor 220, respectively, for determining a resampling rate of the audio data, such that the processor 220 adjusts the playback of the audio data based on the resampling rate.

The functions implemented by the audio device 200, the relationship between the audio device 200 and the wireless access point, and the like may refer to the description of the foregoing audio synchronized playback method section, and will not be further developed herein. In addition, the audio device 200 may further include structures or circuits of various types of audio devices 200 such as microphones, speakers, memories, etc., which are not further developed herein.

In an embodiment of the present application, the audio device 200 may be a wireless earphone.

Compared with devices such as a sound box, when a user listens to sound through headphones of two ears, the propagation path of the sound is shorter, and the user can clearly feel whether the playback of the audio device 200 is synchronized. In the embodiment of the application, when the audio synchronous playing method is applied to the wireless earphone, the synchronous effect of playing audio data among a plurality of wireless earphone can be effectively improved, and the advantages of the audio synchronous playing method are clearly embodied.

In other embodiments, the audio device 200 is another wireless device capable of playing audio data, and the earphone is an application scenario of the present application, and should not be taken as a limitation of the present application.

Based on the same inventive concept, the embodiment of the present application further listens to an audio synchronous playing system 300, as shown in fig. 3, the audio synchronous playing system 300 includes: at least two audio devices 200 and a wireless access point 310. Wherein the audio device 200 may be the audio device 200 described in the previous embodiments.

Wireless access point 310 is wirelessly coupled to audio device 200, and wireless access point 310 may be an access point for a different wireless networking, e.g., a bluetooth, cellular, etc., networking access point. Accordingly, the wireless access module 210 of the audio device 200 has a corresponding communication function, for example, when the wireless access point 310 is a bluetooth access point, the wireless access module 210 has a bluetooth connection function.

In the present application, the wireless access point 310 may be a WiFi access point, and the audio device 200 is communicatively connected to the wireless access point 310 through WiFi. The WiFi access point may periodically send beacon frames to the audio device 200 based on the WiFi protocol. In the embodiment of the present application, the beacon frame of WiFi may be configured to carry a timestamp, so that the audio device 200 plays audio data synchronously based on the timestamp.

In the audio synchronized playback system 300, the audio synchronized playback system further includes a sound source device, which may be a device such as bluetooth, a tablet computer, or a server that may send audio data to the audio device 200, where the sound source device is communicatively connected to the wireless access point 310.

In some embodiments, wireless access point 310 may be the same device as the audio source device. It will be appreciated that some audio source devices currently have the functionality of the wireless access point 310 or may be configured as a wireless access point 310, and thus, such as a cell phone, tablet computer, etc. Thus, in embodiments of the present application, wireless access point 310 may be the same device as the audio source device. When the audio source device and the wireless access point 310 are the same device, the audio source device is configured to transmit audio data and time stamps to the audio device 200 on different channels or at different times.

Based on the same inventive concept, the embodiment of the application also provides another audio synchronous playing system, which comprises: a sound source device and a plurality of audio devices. The audio source device is configured as a GO device to send a beacon frame to the audio device based on the WiFi direct function in the WiFi protocol, wherein the beacon frame carries a timestamp. Each audio device is configured to perform the audio synchronized playback method in any of the foregoing embodiments.

Based on the same inventive concept, the embodiment of the present application further provides a readable storage medium, in which instructions are stored, the instructions being executable by one or more processors to implement the audio synchronous playing method as provided in the above embodiment.

The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy Disk, a hard Disk, a magnetic tape), an optical medium (e.g., a DVD (digital videodisc, digital versatile Disk)), or a semiconductor medium (e.g., an SSD (Solid State Disk)), or the like.

The audio synchronized playback method may be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.

In the embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other manners. The device embodiments described above are merely illustrative. The functional modules in the embodiments of the present application may be integrated together to form a single part, or the functional modules may exist alone, or two or more modules may be integrated to form a single part.

The above embodiments can be freely combined without conflict, and the combined embodiments are covered in the protection scope of the present application.

The above detailed description of embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the application as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.

In the description of the present application, it should also be noted that, unless explicitly specified and limited otherwise, the term "connected" should be construed broadly, and may be a fixed connection, a removable connection, or an integral connection, for example; may be an electrical connection; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present application will be understood in specific cases by those of ordinary skill in the art.

The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and variations will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. An audio synchronous playing method is characterized by being applied to each audio device in an audio playing system; the audio playing system comprises at least two audio devices, and each audio device is connected with the same wireless access point; the method comprises the following steps:

receiving a time stamp of the connected wireless access point, wherein the time stamp received by each audio device is consistent;

Adjusting the playing of the audio data based on the time stamp so that each audio device synchronously plays the respective audio data;

wherein the time stamp is received different from the audio data or the time stamp is received through a different channel from the audio data.

2. The audio synchronized playback method of claim 1, wherein the wireless access point is coupled to the audio device via a WiFi connection, the wireless access point configured to transmit a beacon frame to the audio device based on a WiFi protocol, the beacon frame carrying the timestamp.

3. The method of audio synchronized playback of claim 1, wherein after receiving the timestamp of the connected wireless access point, the method further comprises:

updating a first count value of a counter based on the timestamp; wherein the counter is disposed within the audio device, the first count value being synchronized with a timestamp to the wireless access point;

adjusting playing of the audio data based on the timestamp, comprising:

and adjusting playing of the audio data based on the first count value.

4. The audio synchronized playback method of claim 3, wherein said updating the first count value of the counter based on the time stamp comprises:

Gradually updating the first count value in a plurality of clock cycles until the first count value is matched with the timestamp, and finishing updating the first count value;

the total duration of the plurality of clock cycles is less than the receive period of the timestamp.

5. The audio synchronized playback method of claim 3, wherein after said updating the first count value of the counter based on the time stamp, the method further comprises:

determining the latest first count value based on the current first count value in the counter and a preset period nominal value;

updating the latest first count value to a first count value in the counter;

the period nominal value characterizes an accumulated value of the counter per clock period of the audio device.

6. The audio synchronized playback method of claim 3, wherein prior to said updating the first count value of the counter based on the timestamp, the method further comprises:

judging whether the time stamp sent by the wireless access point is received for the first time;

if the timestamp sent by the wireless access point is not received for the first time, updating the first count value of the counter based on the timestamp, including:

Obtaining a correction period nominal value based on the corresponding relation between the timestamp and the first count value, and obtaining the correction period nominal value;

determining a latest first count value based on a current first count value in the counter and the correction period nominal value;

and updating the latest first count value to the first count value in the counter.

7. The audio synchronized playback method of any one of claims 3-6, wherein adjusting playback of the audio data based on the first count value includes:

comparing the first count value with a preset count value; the preset count value characterizes the time of playing a preset number of the audio data by the audio equipment;

and if the first count value is not matched with the preset count value, adjusting the playing speed of the audio data based on the difference value between the first count value and the preset count value.

8. The method for audio synchronized playback of claim 7, wherein prior to comparing the first count value with a predetermined count value, the method further comprises:

controlling a trigger circuit to generate a trigger signal based on a preset clock signal in the audio equipment; the trigger circuit is arranged in the audio equipment;

The trigger signal is used for indicating the first count value of the trigger time to be compared with the preset count value.

9. The method of audio synchronized playback of claim 7, wherein the adjusting the playback speed of the audio data based on the difference between the first count value and the preset count value comprises:

and adjusting a playing clock of the audio equipment based on the difference value, wherein the playing clock is used for controlling the time for playing the preset quantity of the audio data.

10. The method of audio synchronized playback of claim 9, wherein a phase-locked loop is configured within the audio device, and wherein adjusting the playback clock of the audio device based on the difference value comprises:

inputting the difference value into a phase-locked loop to obtain an output clock of the phase-locked loop; the phase-locked loop is configured with a crystal clock, and the phase-locked loop is used for generating the output clock based on the difference value and the crystal clock;

and updating the playing clock to the output clock of the phase-locked loop.

11. The method according to claim 7, wherein a resampling module is disposed in the audio device, and the adjusting the playing speed of the audio data based on the difference between the first count value and the preset count value includes:

And adjusting the resampling rate of audio data playing based on the difference value, wherein the resampling rate is used for representing the playing amount of the audio data in unit time, and the resampling module is used for determining the resampling rate.

12. The method of audio synchronized playback of claim 11, wherein said adjusting a resampling rate of audio data playback based on the difference value comprises:

determining a resampling ratio and/or a resampling weight; the resampling rate is related to a resampling ratio and a resampling weight;

adjusting the resampling ratio and/or resampling weight based on the difference;

wherein if the difference value characterizes that the first count value is larger than the preset count value, the resampling weight and/or the resampling ratio are reduced; and if the difference value represents that the first count value is smaller than the preset count value, increasing the resampling weight and/or the resampling ratio.

13. The audio synchronized playback method of claim 12, wherein prior to said adjusting the resampling ratio and/or the resampling weight based on the difference value, the method further comprises: and compensating the first count value based on the resampling weight to determine the difference value based on the compensated first count value.

14. An audio synchronous playing method is characterized by being applied to each audio device in an audio playing system; the audio playing system comprises at least two audio devices, and each audio device is connected with the same sound source device based on a WiFi direct connection function in a WiFi protocol; the sound source device is configured as a GO device, each of the audio devices is configured as a GC device, the method comprising:

receiving a time stamp of the connected sound source equipment and audio data sent by the sound source equipment, wherein the time stamps received by the audio equipment are consistent; the sound source device is configured to send out a beacon frame, and the beacon frame carries the timestamp;

and adjusting the playing of the audio data based on the time stamp so that each audio device synchronously plays the respective audio data.

15. An audio device, comprising:

the wireless access module is used for being connected with the wireless access point to receive the time stamp transmitted by the wireless access point; or the wireless access module has the function of WiFi direct connection;

a processor, connected to the wireless access module, for executing the audio synchronous playing method according to any one of claims 1-14.

16. The audio device of claim 15, further comprising a counter coupled to the wireless access module, the counter configured to update a first count value of the counter based on the timestamp.

17. The audio device of claim 15, wherein the wireless access module is a WiFi module configured to receive a beacon frame transmitted by the wireless access point or GO device, the beacon frame carrying the timestamp.

18. The audio device of any of claims 15-17, wherein the audio device is a wireless headset.

19. A storage medium having instructions stored therein, the instructions being executable by one or more processors to implement the audio synchronized playback method of any one of claims 1-14.

20. An audio synchronized playback system, comprising:

at least two audio devices according to any of claims 15-18 for playing audio data transmitted by a playback source device;

and the wireless access point is in wireless communication connection with each audio device and is used for sending the time stamp to the audio device.

21. The audio synchronized playback system of claim 20, wherein the wireless access point is configured to transmit a beacon frame to the audio device based on WiFi, the beacon frame carrying the timestamp.

22. The audio synchronized playback system of claim 20 or 21, wherein the wireless access point is the audio source device.