WO2023273591A1

WO2023273591A1 - Audio synchronization method, audio playing device and storage medium

Info

Publication number: WO2023273591A1
Application number: PCT/CN2022/090448
Authority: WO
Inventors: 许超杰
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-06-29
Filing date: 2022-04-29
Publication date: 2023-01-05
Also published as: CN115549832A

Abstract

Provided in the embodiments of the present application are an audio synchronization method, an audio playing device and a storage medium. The method comprises: receiving a group of synchronization data packets sent by an audio source, wherein the group of synchronization data packets comprises at least one synchronization data packet, and sequentially determining at least one piece of timestamp information corresponding to the at least one synchronization data packet; playing the group of synchronization data packets, and recording at least one playing start time of the at least one synchronization data packet; and on the basis of the at least one piece of timestamp information and the at least one playing start time, implementing an audio synchronization operation between an audio playing device and the audio source.

Description

An audio synchronization method, audio playback device, and storage medium

Cross References to Related Applications

This application is based on a Chinese patent application with application number 202110723845.3 and a filing date of June 29, 2021, and claims the priority of this Chinese patent application. The entire content of this Chinese patent application is hereby incorporated into this application by reference.

technical field

The present application relates to the audio field, and in particular to an audio synchronization method, an audio playback device, and a storage medium.

Background technique

In order to realize the audio synchronization of the left and right ears of the wireless Bluetooth headset, the existing solution is to periodically send the local playback information of the main headset to the secondary headset during the initial synchronization and synchronization tracking stages, and the secondary headset uses the playback information of the primary headset and its own playback information The difference between them is used to determine the adjustment value of the playback progress, and based on the adjustment value, the playback speed of the secondary earphones is adjusted, so that the secondary earphones can follow the playback of the main earphones.

However, the existing solutions require the main earphone to periodically send playback information to the auxiliary earphones, which increases the burden on the data link between a pair of earphones, and may lead to lost data when the data link between a pair of earphones is not good. packets, leading to poor audio sync performance.

Contents of the invention

Embodiments of the present application provide an audio synchronization method, an audio playback device, and a storage medium, which can improve audio synchronization performance between earphones.

The technical scheme of the present application is realized like this:

In the first aspect, the embodiment of the present application proposes an audio synchronization method for an audio playback device, the method comprising:

Receive a group of synchronization data packets sent by the audio source; wherein, the group of synchronization data packets includes at least one synchronization data packet; and sequentially determine at least one timestamp information corresponding to the at least one synchronization data packet;

Play the group of synchronization data packets, and record at least one start playing time of the at least one synchronization data packet;

The audio synchronization operation between the audio playback device and the audio source is implemented based on the at least one time stamp information and the at least one playback start time.

In the second aspect, the embodiment of the present application proposes an audio playback device, the device includes:

The receiving unit is configured to receive a group of synchronization data packets sent by the audio source; wherein, the group of synchronization data packets includes at least one synchronization data packet;

a playback unit, configured to play the group of synchronization data packets;

A recording unit, configured to record at least one playback start time corresponding to the at least one synchronization data packet;

A determining unit, configured to sequentially determine at least one timestamp information corresponding to the at least one synchronization data packet; realize the connection between the audio playback device and the audio source based on the at least one timestamp information and the at least one playback start time audio sync operation between them.

In the third aspect, the embodiment of the present application proposes an audio playback device, the device includes: a receiver, a processor, a memory, and a communication bus; when the processor executes the running program stored in the memory, it realizes any of the above-mentioned Methods.

In a fourth aspect, the embodiment of the present application provides a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the method described in any one of the above is implemented.

Description of drawings

Fig. 1 is a flow chart of an audio synchronization method provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of an exemplary synchronous playback provided by an embodiment of the present application;

Fig. 3 is a schematic block diagram of initialization synchronization of an exemplary audio source and a TWS earphone provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of an exemplary data flow information provided by an embodiment of the present application;

FIG. 5 is a structural schematic diagram 1 of an audio playback device 1 provided in an embodiment of the present application;

FIG. 6 is a second structural schematic diagram of an audio playback device 1 provided in an embodiment of the present application.

detailed description

In the above method, implementing the audio synchronization operation between the audio playback device and the audio source based on the at least one timestamp information and the at least one playback start time includes:

Based on the at least one time stamp information and the at least one start playing time, respectively determine the initial playing time difference and the target playing time difference every preset time period;

The audio synchronization operation between the audio playback device and the audio source is implemented according to the target playback time difference and the initial playback time difference.

In the above method, the determining the initial play time difference based on the at least one time stamp information and the at least one play start time includes:

The initial play time difference is determined according to the first play start time corresponding to the first played first synchronization data packet and the first time stamp information corresponding to the first synchronization data packet.

In the above method, the determination of the target play time difference every preset time period based on the at least one time stamp information and the at least one play start time includes:

The target playing time difference is determined according to the second playing start time corresponding to the currently played second synchronization data packet and the second time stamp information corresponding to the second synchronization data packet every preset time period.

In the above method, implementing the audio synchronization operation between the audio playback device and the audio source according to the target playback time difference and the initial playback time difference includes:

If the target playing time difference is equal to the initial playing time difference, the audio playing speed of the audio playing device is not adjusted;

If the target playing time difference is greater than the initial playing time difference, then speed up the audio playing speed of the audio playing device;

If the target play time difference is smaller than the initial play time difference, slow down the audio play speed of the audio play device.

In the above method, the sequentially determining at least one timestamp information corresponding to the at least one synchronization data packet includes:

determining a data packet type corresponding to the at least one synchronization data packet;

If the data packet type is the first type, then sequentially search for the corresponding at least one timestamp information from the at least one synchronization data packet;

If the data packet type is the second type, then sequentially determine at least one timestamp information corresponding to the at least one synchronization data packet according to a preset data packet sending interval;

If the data packet type is the third type, then determine a time stamp information corresponding to each synchronization data packet according to the preset playback speed, the last time stamp information corresponding to the last synchronization data packet, and the length of the last data packet, Obtain the at least one time stamp information.

In the above method, after receiving a group of synchronization data packets sent by the audio source; before determining at least one time stamp information corresponding to the at least one synchronization data packet in sequence, the method further includes:

calculating a frequency error and a clock error between the audio source and the audio playback device;

Compensating the system frequency of the audio playback device based on the frequency error; and compensating the system clock of the audio playback device based on the clock error.

In the above method, the audio playback device includes a first Bluetooth module, the audio source includes a second Bluetooth module, and the audio playback device and the audio source are connected by the first Bluetooth module and the second Bluetooth module. Bluetooth module to interact.

In the above method, the number of the audio playback device is one or more.

In the above method, the first type of synchronous data packet is a broadcast synchronous data stream BIS or a connection-oriented synchronous data stream CIS data packet; the second type of synchronous data packet is a connection-oriented synchronous SCO data packet or an extended The Bluetooth connection-oriented synchronous data ESCO data packet; the third type of synchronous data packet is the Bluetooth Audio Transmission Model Protocol A2DP data packet.

a playback unit, configured to play the group of synchronization data packets;

In the above device, the determining unit is further configured to respectively determine an initial play time difference and a target play time difference every preset time period based on the at least one time stamp information and the at least one play start time; according to the The target playback time difference and the initial playback time difference enable an audio synchronization operation between the audio playback device and the audio source.

In the above device, the determining unit is further configured to determine the initial Play time difference.

In the above device, the determining unit is further configured to, every preset time period, according to the second playback start time corresponding to the currently played second synchronization data packet and the second time stamp corresponding to the second synchronization data packet information to determine the target play time difference.

In the above device, the device further includes: an adjustment unit;

The adjustment unit is configured to not adjust the audio playback speed of the audio playback device if the target playback time difference is equal to the initial playback time difference; The audio playback speed of the audio playback device; if the target playback time difference is less than the initial playback time difference, slow down the audio playback speed of the audio playback device.

In the above device, the determining unit is further configured to determine the data packet type corresponding to the at least one synchronization data packet; if the data packet type is the first type, then sequentially search from the at least one synchronization data packet The corresponding at least one timestamp information; if the data packet type is the second type, sequentially determine the at least one timestamp information corresponding to the at least one synchronization data packet according to the preset data packet sending interval; if the The data packet type is the third type, then according to the preset playback speed, the last timestamp information corresponding to the last synchronization data packet and the length of the last data packet, determine a time stamp information corresponding to each synchronization data packet, and obtain the described At least one timestamp information.

In the above device, the device further includes: a calculation unit and a compensation unit;

The calculation unit is used to calculate a frequency error and a clock error between the audio source and the audio playback device;

The compensation unit is configured to compensate the system frequency of the audio playback device based on the frequency error; and compensate the system clock of the audio playback device based on the clock error.

In the above device, the audio playback device includes a first bluetooth module, the audio source includes a second bluetooth module, and the audio playback device and the audio source are connected by the first bluetooth module and the second bluetooth module. Bluetooth module to interact.

In the above device, the number of the audio playback device is one or more.

In the above device, the first type of synchronous data packet is a broadcast synchronous data stream BIS or a connection-oriented synchronous data stream CIS data packet; the second type of synchronous data packet is a connection-oriented synchronous SCO data packet or an extended The Bluetooth connection-oriented synchronous data ESCO data packet; the third type of synchronous data packet is the Bluetooth Audio Transmission Model Protocol A2DP data packet.

In the third aspect, the embodiment of the present application proposes an audio playback device, the device includes: a receiver, a processor, a memory, and a communication bus; when the processor executes the running program stored in the memory, the following method is implemented:

Determine in turn at least one timestamp information corresponding to the at least one synchronization data packet; play the group of synchronization data packets, and record at least one start playing time of the at least one synchronization data packet; based on the at least one timestamp information and the at least one start time to implement audio synchronous operation between the audio playback device and the audio source.

In the above device, the processor is further configured to respectively determine an initial play time difference and a target play time difference every preset time period based on the at least one time stamp information and the at least one play start time; according to the The target playback time difference and the initial playback time difference enable an audio synchronization operation between the audio playback device and the audio source.

In the above device, the processor is further configured to determine the initial Play time difference.

In the above device, the processor is further configured to, every preset time period, according to the second playback start time corresponding to the currently played second synchronization data packet and the second time stamp corresponding to the second synchronization data packet information to determine the target play time difference.

In the above device, the processor is further configured to not adjust the audio playback speed of the audio playback device if the target playback time difference is equal to the initial playback time difference; if the target playback time difference is greater than the initial playback time difference time difference, then speed up the audio playback speed of the audio playback device; if the target playback time difference is less than the initial playback time difference, then slow down the audio playback speed of the audio playback device.

In the above device, the processor is further configured to determine the data packet type corresponding to the at least one synchronization data packet; if the data packet type is the first type, then sequentially search from the at least one synchronization data packet The corresponding at least one timestamp information; if the data packet type is the second type, sequentially determine the at least one timestamp information corresponding to the at least one synchronization data packet according to the preset data packet sending interval; if the The data packet type is the third type, then according to the preset playback speed, the last timestamp information corresponding to the last synchronization data packet and the length of the last data packet, determine a time stamp information corresponding to each synchronization data packet, and obtain the described At least one timestamp information.

In the above device, the processor is further configured to calculate a frequency error and a clock error between the audio source and the audio playback device; compensate the system frequency of the audio playback device based on the frequency error; and based on The clock error compensates the system clock of the audio playback device.

In the above device, the number of the audio playback device is one or more.

An embodiment of the present application provides an audio synchronization method, an audio playback device, and a storage medium. The method includes: receiving a group of synchronization data packets sent by an audio source; wherein, a group of synchronization data packets includes at least one synchronization data packet; and Determine in turn at least one timestamp information corresponding to at least one synchronization data packet; play a group of synchronization data packets, and record at least one start playback time of at least one synchronization data packet; realize audio based on at least one timestamp information and at least one start playback time Audio sync operation between playback device and audio source. Using the above implementation scheme, the audio source sends a group of synchronization data packets to the audio playback device, and the audio playback device realizes the communication between the audio playback device and the audio source based on the time stamp information determined by at least one synchronization data packet in a group of synchronization data packets The audio is played synchronously, thereby achieving synchronous playback between a pair of audio playback devices, reducing the load on the data link between a pair of audio playback devices, and further reducing The problem of out-of-sync playback caused by stabilization has improved the audio synchronization performance between headphones.

It should be understood that the specific embodiments described here are only used to explain the present application. It is not intended to limit the application.

An embodiment of the present application provides a method for searching a network, which is applied to a terminal. In some embodiments, the terminal may be called user equipment (User Equipment, UE). The terminal can be a personal communication service (Personal Communication Service, PCS) phone, a cordless phone, a session initiation protocol (Session Initiation Protocol, SIP) phone, a wireless local loop (Wireless Local Loop, WLL) station, a personal digital assistant (Personal Digital Assistant) Assistant, PDA) and other equipment, the terminal can also be a smart phone, tablet computer, palmtop computer, mobile station (Mobile Station, MS), mobile terminal (Mobile Terminal) and so on, the terminal can be connected via the wireless access network (Radio Access Network, RAN) communicates with one or more network devices. For example, the terminal can be a mobile phone (or called a "cellular" phone) or a computer with terminal equipment, etc., for example, the terminal can also be a portable, pocket, hand-held, computer built-in or vehicle-mounted mobile device, which are connected to wireless The access network exchanges voice and/or data. The terminal can also be a handheld device with wireless communication function, a computing device or other processing device connected to a wireless modem, a vehicle device, a wearable device, a terminal in a future evolving network, etc., which are not limited in the implementation of this application.

An embodiment of the present application provides an audio synchronization method for an audio playback device. The audio playback device may be a device capable of wireless audio playback such as a True Wireless Stereo (TWS) headset, a Bluetooth speaker, etc., wherein the audio The playback device includes a first Bluetooth module, and the audio source includes a second Bluetooth module, and the audio playback device and the audio source interact through the first Bluetooth module and the second Bluetooth module, as shown in Figure 1, the method may include:

S101. Receive a group of synchronization data packets sent by an audio source; wherein, a group of synchronization data packets includes at least one synchronization data packet; and sequentially determine at least one time stamp information corresponding to the at least one synchronization data packet.

In the embodiment of the present application, the audio source sends an audio data stream supported by the Bluetooth standard to the audio playback device through the second Bluetooth module. The audio data stream is composed of a group of synchronous data packets, and a group of synchronous data packets includes at least one synchronous data packet , wherein the audio source can be a Bluetooth device such as a tablet computer, a mobile phone, a personal computer (Personal Computer, PC), a notebook computer, and a wearable device. As shown in Figure 2, the audio source sends audio streams to the left and right TWS earphones at the same time.

In the embodiment of the present application, the audio playback device receives the audio data stream through the first Bluetooth module, and then the audio playback device sequentially determines a time stamp information corresponding to each synchronization data packet in the audio data stream, and obtains the time stamp information corresponding to at least one synchronization data packet. At least one timestamp information.

In the embodiment of the present application, different data packet types correspond to different forms of time stamp acquisition strategies, wherein, at present, the data packet types of the synchronous data packet may include Broadcast Isochronous Stream (Broadcast Isochronous Stream, BIS)/connection-oriented synchronous data Stream (Connected Isochronous Stream, CIS) data packets (that is, the first type of synchronous data packets), Bluetooth connection-oriented synchronous data (Synchronous Connection-Oriented, SCO) data packets / extended Bluetooth connection-oriented synchronous data (Extended Synchronous Connection-Oriented , ESCO) data packets (i.e. the second type of synchronous data packets) and Bluetooth audio transmission model agreement (Advanced Audio Distribution Profile, A2DP) data packets (i.e. the third type of synchronous data packets), etc., the specific can be carried out according to the actual situation Optional, the embodiment of the present application does not limit the specific data packet type, it only needs to meet the Bluetooth standard support.

It should be noted that, since the BIS/CIS audio data packet itself carries timestamp information and the sequence number information of the data packet, if it is determined that the data packet type is the first type, then it is directly searched from at least one synchronous data packet in turn. Corresponding at least one timestamp information.

It should be noted that since the Bluetooth SCO/ESCO audio data packet only contains the serial number information of the data packet, and the Bluetooth SCO/ESCO audio data packet is sent at a time interval of 7.5ms, if it is determined that the data packet If the type is the second type, at least one time stamp information corresponding to at least one synchronization data packet is sequentially determined according to the preset data packet sending interval. Afterwards, at least one time stamp information can be respectively filled into corresponding data packets, so as to participate in the subsequent audio synchronization process.

Specifically, the initial value of the index of the Bluetooth SCO/ESCO audio data packet is 0, and after receiving a Bluetooth SCO/ESCO audio data packet at every preset data packet transmission interval, the value of the index is increased by one, and then, according to index realizes the calculation of the timestamp information corresponding to the synchronization data packet, as shown in formula (1),

time_stamp=index*7.5ms (1)

Among them, time_stamp is timestamp information, and for possible packet loss, the operation of formula (2) needs to be completed.

index=index+1 (2)

It should be noted that, since the Bluetooth A2DP audio data packet only contains the serial number information of the data packet, and the sending time interval of the Bluetooth A2DP audio data packet is inconsistent, if it is determined that the data packet type is the third type, then according to the preset The playback speed, the last time stamp information corresponding to the last synchronization data packet and the length of the last data packet are determined to determine a time stamp information corresponding to each synchronization data packet to obtain at least one time stamp information.

Specifically, the time_stamp information is calculated according to the packet length of the received Bluetooth A2DP audio packet, as shown in formula (3),

time_stamp(n)=time_stamp(n-1)+length(n-1)/play_speed (3)

Wherein, time_stamp(n) represents the timestamp information of the nth synchronization data packet; length(n) represents the packet data length of the nth synchronization data; play_speed represents the playback speed.

Further, after receiving a group of synchronization data packets sent by the audio source, an initial alignment between the audio source and the audio playback device is performed first, and then at least one time stamp information corresponding to at least one synchronization data packet is sequentially determined.

Specifically, the initial alignment process between the audio source and the audio playback device includes: calculating the frequency error and clock error between the audio source and the audio playback device; compensating the system frequency of the audio playback device based on the frequency error; and compensating the audio frequency based on the clock error The system clock of the playback device. Further, frequency alignment and clock alignment between the audio source and the audio playback device are realized.

Exemplarily, as shown in Figure 3, the audio source includes an application (Application, AP) module, a digital signal processor (DSP, Digital Signal Processor) module and a Bluetooth (Bluetooth, BT) module, wherein the DSP module is provided with a An audio phase-locked loop (Phase Locked Loop, PLL) device that controls the speed of audio playback. The TWS headset includes a codec (COder-DECoder, CODEC) module, a DSP module, and a BT module. The DSP module is also equipped with an audio PLL device . The BT module of the audio source sends the mobile phone initialization frequency offset and the mobile phone initialization clock offset to the BT module of the TWS earphone, as well as a synchronous playback instruction.

S102. Play a group of synchronization data packets, and record at least one start playing time of at least one synchronization data packet.

After determining at least one time stamp information corresponding to at least one data packet, receive a synchronous playback instruction sent by the audio source, and play a group of synchronous data packets based on the synchronous playback instruction, and record during the playback of the group of synchronous data packets The start playing time of each synchronization data packet is obtained at least one start playing time corresponding to at least one synchronization data packet.

S103. Realize an audio synchronization operation between the audio playback device and the audio source based on at least one time stamp information and at least one playback start time.

After playing a group of synchronization data packets and recording at least one start time of at least one synchronization data packet in real time, the audio synchronization operation between the audio playback device and the audio source is realized based on at least one timestamp information and at least one start time.

In the embodiment of the present application, based on at least one timestamp information and at least one start playing time, the initial play time difference and the target play time difference of each preset time period are determined respectively; Audio sync operation between sources.

In the embodiment of the present application, the initial playback time difference is determined according to the first playback start time corresponding to the first synchronous data packet played first and the first time stamp information corresponding to the first synchronous data packet.

It should be noted that, in order to achieve synchronization between the audio source and the audio playback device, the time point play_time(1) to start playing is set to time_stamp(1) (that is, the first timestamp information corresponding to the first synchronization data packet) plus A fixed audio processing delay audio_process_delay, the audio processing delay is the initial playback time difference, which is used as a benchmark for playback tracking.

In the embodiment of the present application, in the process of playing a group of synchronous data packets, playback tracking is performed based on the above-mentioned audio processing delay. Specifically, for each preset time period, according to the second The start time of playing and the second time stamp information corresponding to the second synchronization data packet are used to determine the target playing time difference.

It should be noted that, in the process of playing a group of synchronous data packets, after a certain playing time, the frequency difference between the audio source and the audio playback device may be caused by the difference of the crystal itself, temperature and other factors. And with the accumulation of time, the frequency difference will be reflected in the playback progress between the left and right ears. Therefore, the preset time period for playback tracking is set in advance, and when the preset time period arrives, the second synchronization of the current playback is determined. data packet, determine the second start time and second time stamp information corresponding to the second synchronous data packet, and then determine the target play time difference based on the second start time and the second time stamp information.

In the embodiment of the present application, the difference between the second start playing time and the second time stamp information is calculated, and the difference is the target playing time difference.

In the embodiment of the present application, the audio playback device compares the target playback time difference with the initial playback time difference, and if the target playback time difference is equal to the initial playback time difference, the audio playback speed of the audio playback device is not adjusted; if the target playback time difference is greater than the initial playback time difference, then Speed up the audio playback speed of the audio playback device; if the target playback time difference is smaller than the initial playback time difference, slow down the audio playback speed of the audio playback device.

It should be noted that the target playback time difference can be compared with the initial playback time difference by calculating the difference between the target playback time difference and the initial playback time difference, and comparing the difference with 0. The specific comparison method can be based on actual The selection is made according to the situation, and the embodiment of the present application does not make specific limitations.

Based on the above embodiments, the embodiment of this application proposes an exemplary audio synchronization method for TWS earphones. The specific data flow information is shown in Figure 4. The data flow consists of a set of synchronization data packets with serial number 1-serial number 14 , each synchronous data packet includes the corresponding timestamp information and data volume. When starting to play the data stream information, record the start playback time 1 of the synchronous data packet with serial number 1 and obtain the time of the synchronous data packet with serial number 1 Stamp 1, calculate the difference 1 between the start time 1 and the time stamp 1; determine the sequence number 11 of the synchronization data packet separated by the preset time period, and record the start time 11 of the synchronization data packet with the sequence number 11 and obtain the sequence number The time stamp 11 of the synchronous data packet of 11, calculate the difference 11 between the start time of playback 11 and the time stamp 11, and then calculate the playback error between the difference 11 and the difference 1, if the playback error is equal to 0, it means that the TWS headset and The playback progress of the mobile phone is consistent, and no adjustment is required at this time; if the playback error is greater than 0, it means that the playback progress of the TWS headset is lagging behind, and the audio PLL of the TWS headset needs to be adjusted faster; if the playback error is less than 0, it means that the playback progress of the TWS headset is ahead. The audio PLL of the TWS headset needs to be slowed down.

It should be noted that the number of audio playback devices can be one or more, that is, the audio source can implement the audio synchronization process of one or more audio playback devices at the same time, only the audio source broadcasts a Group synchronization data packets and synchronous playback instructions, one or more audio playback devices can realize audio synchronization by themselves according to a set of synchronization data packets received, and for multi-link multi-audio playback scenarios, it can realize synchronization between multiple devices Playing, there is no need for a device to distribute to other devices, which greatly improves the convenience and real-time performance of audio synchronization.

It can be understood that this application directly realizes the synchronization of the audio playback progress between the TWS earphones and the mobile phone based on the time stamp information carried in a group of synchronization data packets sent by the audio source, without the need for interaction between the earphones, which reduces the need for interaction between the earphones. The load of the data link reduces the playback out-of-sync problem caused by the unstable air interface link transmission between the earphones.

The embodiment of the present application provides an audio playback device 1 . As shown in Figure 5, the device 1 includes:

The receiving unit 10 is configured to receive a group of synchronization data packets sent by the audio source; wherein, the group of synchronization data packets includes at least one synchronization data packet;

Playing unit 11, is used for playing described one group of synchronous data packets;

A recording unit 12, configured to record at least one playback start time corresponding to the at least one synchronization data packet;

The determination unit 13 is configured to sequentially determine at least one timestamp information corresponding to the at least one synchronization data packet; realize the audio playback device and the audio source based on the at least one timestamp information and the at least one start playing time Audio synchronization between operations.

Optionally, the determining unit 13 is further configured to respectively determine an initial play time difference and a target play time difference every preset time period based on the at least one time stamp information and the at least one play start time; according to the The target playback time difference and the initial playback time difference enable an audio synchronization operation between the audio playback device and the audio source.

Optionally, the determining unit 13 is further configured to determine the initial playback time according to the first playback start time corresponding to the first synchronous data packet played first and the first time stamp information corresponding to the first synchronous data packet. Play time difference.

Optionally, the determining unit 13 is further configured to, at intervals of a preset time period, according to the second playback start time corresponding to the currently played second synchronization data packet and the second time stamp corresponding to the second synchronization data packet information to determine the target play time difference.

Optionally, the device 1 further includes: an adjustment unit;

Optionally, the determining unit 13 is further configured to determine the data packet type corresponding to the at least one synchronous data packet; if the data packet type is the first type, then sequentially search for the at least one synchronous data packet The corresponding at least one timestamp information; if the data packet type is the second type, sequentially determine the at least one timestamp information corresponding to the at least one synchronization data packet according to the preset data packet sending interval; if the The data packet type is the third type, then according to the preset playback speed, the last timestamp information corresponding to the last synchronization data packet and the length of the last data packet, determine a time stamp information corresponding to each synchronization data packet, and obtain the described At least one timestamp information.

Optionally, the device 1 further includes: a calculation unit and a compensation unit;

Optionally, the audio playback device includes a first Bluetooth module, the audio source includes a second Bluetooth module, and the audio playback device and the audio source are connected by the first Bluetooth module and the second Bluetooth module. Modules interact.

Optionally, there is one or more audio playback devices.

Optionally, the first type of synchronous data packet is a broadcast synchronous data stream BIS or a connection-oriented synchronous data stream CIS data packet; the second type of synchronous data packet is a connection-oriented synchronous SCO data packet or an extended Bluetooth A connection-oriented synchronous data ESCO data packet; the third type of synchronous data packet is a Bluetooth Audio Transmission Model Protocol A2DP data packet.

An audio playback device provided by an embodiment of the present application receives a group of synchronous data packets sent by an audio source; wherein, a group of synchronous data packets includes at least one synchronous data packet; and sequentially determines at least one corresponding to at least one synchronous data packet Timestamp information; play a set of synchronization data packets, and record at least one start time of at least one synchronization data packet; realize audio synchronization between an audio playback device and an audio source based on at least one time stamp information and at least one start time . It can be seen that, in the audio playback device proposed in this embodiment, the audio source sends a group of synchronization data packets to the audio playback device, and the audio playback device implements audio based on the time stamp information determined by at least one synchronization data packet in a group of synchronization data packets. The audio between the playback device and the audio source is played synchronously, thereby achieving synchronous playback between a pair of audio playback devices, reducing the load on the data link between a pair of audio playback devices, and reducing the load caused by a pair of audio playback devices. The problem of out-of-sync playback caused by the unstable transmission of the air interface link between them improves the audio synchronization performance between the earphones.

Fig. 6 is a schematic diagram of the composition and structure of an audio playback device 1 provided by the embodiment of the present application II. In practical applications, based on the same disclosed concept of the above embodiment, as shown in Fig. 6, the device 1 of this embodiment includes: Receiver 14 , processor 15 , memory 16 and communication bus 17 .

In the process of a specific embodiment, the above-mentioned playback unit 11, recording unit 12, determination unit 13, calculation unit and compensation unit can be realized by a processor 15 located on the audio playback device 1, and the above-mentioned receiving unit 10 can be implemented by a processor located on the device 1 Receiver 14 realizes, and above-mentioned processor 15 can be application-specific integrated circuit (ASIC, Application Specific Integrated Circuit), DSP, digital signal processing image processing device (DSPD, Digital Signal Processing Device), programmable logic image processing device (PLD, At least one of Programmable Logic Device), Field Programmable Gate Array (FPGA, Field Programmable Gate Array), CPU, controller, microcontroller, and microprocessor. It can be understood that, for different devices, the electronic device used to implement the above processor function may also be other, which is not specifically limited in this embodiment.

In the embodiment of the present application, the above-mentioned communication bus 17 is used to realize connection and communication between the receiver 14, the processor 15 and the memory 16; the above-mentioned receiver 14 is used to receive a group of synchronous data packets sent by the audio source; wherein, At least one synchronous data packet is included in the group of synchronous data packets; the above-mentioned processor 15 implements the following audio synchronization method when executing the running program stored in the memory 16:

Further, in the above embodiment, the processor 15 is further configured to determine the initial play time difference and the target play time difference every preset time period based on the at least one time stamp information and the at least one play start time, respectively. Time difference: realize the audio synchronization operation between the audio playback device and the audio source according to the target playback time difference and the initial playback time difference.

Further, in the above embodiment, the processor 15 is further configured to, according to the first playing start time corresponding to the first synchronous data packet played first and the first time stamp information corresponding to the first synchronous data packet , to determine the initial playback time difference.

Further, in the above embodiment, the processor 15 is further configured to, every preset time period, according to the second start time corresponding to the currently played second synchronization data packet and the second synchronization data packet corresponding The second timestamp information to determine the target play time difference.

Further, in the above embodiment, the processor 15 is further configured to not adjust the audio playback speed of the audio playback device if the target playback time difference is equal to the initial playback time difference; if the target playback time difference If the target playback time difference is greater than the initial playback time difference, then adjust the audio playback speed of the audio playback device; if the target playback time difference is smaller than the initial playback time difference, then slow down the audio playback speed of the audio playback device.

Further, in the above-mentioned embodiment, the processor 15 is further configured to determine the data packet type corresponding to the at least one synchronization data packet; if the data packet type is the first type, sequentially from the at least one synchronization data packet Find the corresponding at least one timestamp information in the synchronization data packet; if the data packet type is the second type, then determine at least one time stamp corresponding to the at least one synchronization data packet in sequence according to the preset data packet sending interval information; if the data packet type is the third type, then determine a timestamp corresponding to each synchronization data packet according to the preset playback speed, the last timestamp information corresponding to the last synchronization data packet, and the length of the last data packet information, to obtain the at least one time stamp information.

Further, in the above embodiment, the processor 15 is also configured to calculate a frequency error and a clock error between the audio source and the audio playback device; compensate the audio playback device based on the frequency error system frequency; and compensating the system clock of the audio playback device based on the clock error.

Further, in the above embodiment, the audio playback device includes a first Bluetooth module, the audio source includes a second Bluetooth module, and the audio playback device and the audio source are connected by the first Bluetooth module and the audio source. The second bluetooth module interacts.

Further, in the above embodiment, the number of the audio playback device is one or more.

Further, in the above embodiment, the first type of synchronous data packet is a broadcast synchronous data stream BIS or a connection-oriented synchronous data stream CIS data packet; the second type of synchronous data packet is a connection-oriented synchronous SCO data packet packet or an extended Bluetooth connection-oriented synchronization data ESCO data packet; the third type of synchronization data packet is a Bluetooth Audio Transmission Model Protocol A2DP data packet.

An embodiment of the present application provides a storage medium on which a computer program is stored. The computer-readable storage medium stores one or more programs. The one or more programs can be executed by one or more processors and are applied to audio In the playback device, the computer program realizes the above audio synchronization method.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present disclosure can be embodied in the form of a software product in essence or the part that contributes to the related technology. The computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk, etc.) ) includes several instructions to make an image display device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in various embodiments of the present disclosure.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the protection scope of the present application.

Claims

An audio synchronization method for an audio playback device, the method comprising:

Receiving a group of synchronization data packets sent by the audio source, wherein the group of synchronization data packets includes at least one synchronization data packet; and sequentially determining at least one timestamp information corresponding to the at least one synchronization data packet;

Play the group of synchronization data packets, and record at least one start playing time of the at least one synchronization data packet;

The audio synchronization operation between the audio playback device and the audio source is implemented based on the at least one time stamp information and the at least one playback start time.
The method according to claim 1, wherein said implementing the audio synchronization operation between the audio playback device and the audio source based on the at least one timestamp information and the at least one start playback time comprises:

Based on the at least one time stamp information and the at least one start playing time, respectively determine the initial playing time difference and the target playing time difference every preset time period;

The audio synchronization operation between the audio playback device and the audio source is implemented according to the target playback time difference and the initial playback time difference.
The method according to claim 2, wherein said determining an initial play time difference based on said at least one time stamp information and said at least one play start time comprises:

The initial play time difference is determined according to the first play start time corresponding to the first played first synchronization data packet and the first time stamp information corresponding to the first synchronization data packet.
The method according to claim 2, wherein, based on the at least one time stamp information and the at least one start playing time, determining the target playing time difference every preset time period comprises:

The target playing time difference is determined according to the second playing start time corresponding to the currently played second synchronization data packet and the second time stamp information corresponding to the second synchronization data packet every preset time period.
The method according to claim 2, wherein said implementing the audio synchronization operation between the audio playback device and the audio source according to the target playback time difference and the initial playback time difference comprises:

If the target playing time difference is equal to the initial playing time difference, the audio playing speed of the audio playing device is not adjusted;

If the target playing time difference is greater than the initial playing time difference, then speed up the audio playing speed of the audio playing device;

If the target play time difference is smaller than the initial play time difference, slow down the audio play speed of the audio play device.
The method according to claim 1, wherein said determining at least one timestamp information corresponding to said at least one synchronous data packet in turn comprises:

determining a data packet type corresponding to the at least one synchronization data packet;

If the data packet type is the first type, then sequentially search for the corresponding at least one timestamp information from the at least one synchronization data packet;

If the data packet type is the second type, then sequentially determine at least one timestamp information corresponding to the at least one synchronization data packet according to a preset data packet sending interval;

If the data packet type is the third type, then determine a time stamp information corresponding to each synchronization data packet according to the preset playback speed, the last time stamp information corresponding to the last synchronization data packet, and the length of the last data packet, Obtain the at least one time stamp information.
The method according to claim 1, wherein, after receiving a group of synchronization data packets sent by the audio source; before determining at least one timestamp information corresponding to the at least one synchronization data packet in sequence, the method further comprises :

calculating a frequency error and a clock error between the audio source and the audio playback device;

Compensating the system frequency of the audio playback device based on the frequency error; and compensating the system clock of the audio playback device based on the clock error.
The method according to claim 1, wherein the audio playback device includes a first Bluetooth module, the audio source includes a second Bluetooth module, and the audio playback device and the audio source are connected via the first Bluetooth module. The module interacts with the second Bluetooth module.
The method according to claim 1, wherein the number of the audio playback devices is one or more.
The method according to claim 6, wherein the first type of synchronous data packet is broadcast synchronous data stream BIS or connection-oriented synchronous data stream CIS data packet; the second type of synchronous data packet is connection-oriented synchronous An SCO data packet or an extended Bluetooth connection-oriented synchronous data ESCO data packet; the third type of synchronous data packet is a Bluetooth Audio Transmission Model Protocol A2DP data packet.
An audio playback device, the device comprising:

A receiving unit, configured to receive a group of synchronization data packets sent by the audio source, wherein the group of synchronization data packets includes at least one synchronization data packet;

a playback unit, configured to play the group of synchronization data packets;

A recording unit, configured to record at least one playback start time corresponding to the at least one synchronization data packet;

A determining unit, configured to sequentially determine at least one timestamp information corresponding to the at least one synchronization data packet; realize the connection between the audio playback device and the audio source based on the at least one timestamp information and the at least one playback start time audio sync operation between them.
The apparatus of claim 11, wherein,

The determining unit is further configured to respectively determine an initial play time difference and a target play time difference every preset time period based on the at least one time stamp information and the at least one play start time; according to the target play time difference and the set The initial playback time difference realizes the audio synchronization operation between the audio playback device and the audio source.
The apparatus of claim 12, wherein,

The determining unit is further configured to determine the initial playing time difference according to the first playing start time corresponding to the first played first synchronization data packet and the first time stamp information corresponding to the first synchronization data packet.
The apparatus of claim 12, wherein,

The determining unit is further configured to determine the second playback start time corresponding to the second synchronization data packet currently played and the second time stamp information corresponding to the second synchronization data packet every preset time period. Target play time difference.
The apparatus according to claim 12, wherein the device further comprises: an adjustment unit;

The adjustment unit is configured to not adjust the audio playback speed of the audio playback device if the target playback time difference is equal to the initial playback time difference; The audio playback speed of the audio playback device; if the target playback time difference is less than the initial playback time difference, slow down the audio playback speed of the audio playback device.
The apparatus of claim 11, wherein,

The determining unit is further configured to determine the data packet type corresponding to the at least one synchronization data packet; if the data packet type is the first type, then sequentially search for the corresponding at least one synchronization data packet from the at least one synchronization data packet. A time stamp information; if the data packet type is the second type, at least one time stamp information corresponding to the at least one synchronization data packet is sequentially determined according to the preset data packet sending interval; if the data packet type is the second type Three types, according to the preset playback speed, the last time stamp information corresponding to the last synchronization data packet and the length of the last data packet, determine a time stamp information corresponding to each synchronization data packet, and obtain the at least one time stamp information .
The device according to claim 11, wherein the device further comprises: a calculation unit and a compensation unit;

The calculation unit is used to calculate a frequency error and a clock error between the audio source and the audio playback device;

The compensation unit is configured to compensate the system frequency of the audio playback device based on the frequency error; and compensate the system clock of the audio playback device based on the clock error.
The device according to claim 11, wherein the audio playback device includes a first Bluetooth module, the audio source includes a second Bluetooth module, and the audio playback device and the audio source are connected via the first Bluetooth module. The module interacts with the second Bluetooth module.
An audio playback device, the device comprising: a receiver, a processor, a memory, and a communication bus; when the processor executes a running program stored in the memory, the method according to any one of claims 1-10 is implemented.
A storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method according to any one of claims 1-10 is realized.