WO2023273601A1 - 一种音频同步方法及音频播放设备、音频源、存储介质 - Google Patents

一种音频同步方法及音频播放设备、音频源、存储介质 Download PDF

Info

Publication number
WO2023273601A1
WO2023273601A1 PCT/CN2022/091137 CN2022091137W WO2023273601A1 WO 2023273601 A1 WO2023273601 A1 WO 2023273601A1 CN 2022091137 W CN2022091137 W CN 2022091137W WO 2023273601 A1 WO2023273601 A1 WO 2023273601A1
Authority
WO
WIPO (PCT)
Prior art keywords
data packet
audio
synchronization data
synchronization
playback device
Prior art date
Application number
PCT/CN2022/091137
Other languages
English (en)
French (fr)
Inventor
许超杰
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2023273601A1 publication Critical patent/WO2023273601A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W56/00Synchronisation arrangements
    • H04W56/001Synchronization between nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W56/00Synchronisation arrangements

Definitions

  • the present application relates to the audio field, and in particular to an audio synchronization method, an audio playback device, an audio source, and a storage medium.
  • the existing solution is to use the clock consistency between the Bluetooth headset and the Bluetooth system of the mobile phone as the basis to complete the playback of the secondary ear to the main ear; or use the headset Bluetooth and the mobile phone Bluetooth
  • the frequency synchronization feature between the earphones allows the audio playback in the earphones to follow the frequency of the Bluetooth to complete the synchronous playback between the earphones and the Bluetooth of the mobile phone, and then realize the synchronous playback between multiple earphones.
  • Embodiments of the present application provide an audio synchronization method, an audio playback device, an audio source, and a storage medium, which can improve audio synchronization performance between a terminal and an earphone.
  • the embodiment of the present application proposes an audio synchronization method for an audio playback device, the method comprising:
  • an audio synchronization operation between the audio source and the audio playback device is realized.
  • an audio synchronization method for an audio source including:
  • the embodiment of the present application proposes an audio playback device, the device comprising:
  • a receiving unit configured to receive at least one synchronous data packet sequentially sent by the audio source
  • the first recording unit is configured to record at least one receiving time corresponding to at least one synchronization data packet when at least one synchronization data packet sequentially sent by the audio source is received;
  • An obtaining unit configured to obtain the generation time of at least one synchronization data packet carried in the at least one synchronization data packet
  • a synchronization unit configured to implement an audio synchronization operation between the audio source and the audio playback device based on the at least one receiving time and the at least one synchronization data packet generation time.
  • the embodiment of the present application proposes an audio source, and the audio source includes:
  • the second recording unit is used to record the generation time of the synchronization data packet that generates each synchronization data packet
  • a sending unit configured to sequentially send at least one synchronization data packet to which the generation time of the synchronization data packet has been added to the audio playback device, for the audio playback device to generate based on the at least one synchronization data packet carried in the at least one synchronization data packet.
  • the time and at least one receiving time of receiving the at least one synchronization data packet realize the audio synchronization operation between the audio source and the audio playback device.
  • the embodiment of the present application proposes an audio playback device, which includes: a first processor, a first memory, and a first communication bus; when the first processor executes the running program stored in the first memory, it realizes Audio sync method as above.
  • the embodiment of the present application proposes an audio source, the audio source includes: a transmitter, a second processor, a second memory, and a second communication bus; the second processor executes the operation stored in the second memory
  • the program implements the audio synchronization method as described above.
  • the embodiment of the present application provides a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the audio synchronization method as described in any one of the foregoing is implemented.
  • Fig. 1 is a structural schematic diagram of bluetooth audio playback between a mobile phone and an earphone
  • FIG. 2 is a flow chart of an audio synchronization method for an audio playback device provided in an embodiment of the present application
  • FIG. 3 is a schematic diagram of an exemplary synchronous playback provided by an embodiment of the present application.
  • FIG. 4 is a flowchart of an audio synchronization method for an audio source provided in an embodiment of the present application
  • FIG. 5 is an interactive flowchart of an audio synchronization method provided in an embodiment of the present application.
  • FIG. 6 is a first structural schematic diagram of an audio playback device provided by an embodiment of the present application.
  • FIG. 7 is a second structural schematic diagram of an audio playback device provided by an embodiment of the present application.
  • FIG. 8 is a first structural schematic diagram of an audio source provided by an embodiment of the present application.
  • FIG. 9 is a second structural schematic diagram of an audio source provided by an embodiment of the present application.
  • the embodiment of the present application proposes an audio synchronization method for an audio playback device, the method comprising:
  • an audio synchronization operation between the audio source and the audio playback device is realized.
  • implementing the audio synchronization operation between the audio source and the audio playback device based on the at least one reception time and the at least one synchronization packet generation time includes:
  • the second synchronization data packet is the at least one synchronization data Synchronous data packets other than the first synchronous data packet in the packet;
  • an audio synchronization operation between the audio source and the audio playback device is realized.
  • determining the target timestamp difference according to the second synchronization data packet generation time corresponding to the second synchronization data packet and the second synchronization reception time corresponding to the second synchronization data packet includes:
  • the target time stamp difference is determined according to the second synchronization data packet generation time and the second synchronization reception time corresponding to the second synchronization data packet received when the preset time interval arrives.
  • implementing the audio synchronization operation between the audio source and the audio playback device according to the initial timestamp difference and the target timestamp difference includes:
  • the target time stamp difference is smaller than the initial time stamp difference, then speed up the audio playback speed of the audio playback device;
  • the audio playback speed of the audio playback device is not adjusted.
  • the audio playback device includes a first Bluetooth module
  • the audio source includes a second Bluetooth module
  • the audio playback device receives the second Bluetooth module of the audio source through the first Bluetooth module The at least one synchronization data packet sent.
  • an audio synchronization method for an audio source including:
  • the audio source includes a second bluetooth module
  • the audio playback device includes a first bluetooth module
  • the audio source communicates to the first bluetooth module of the audio playback device through the second bluetooth module Transmitting the at least one synchronization data packet.
  • the audio source includes the application subsystem APSS, and the recording generates the synchronization data packet generation time of each synchronization data packet, including:
  • the method before the synchronization data packet generation time of each synchronization data packet generated by the recording application subsystem, the method also includes:
  • the initial data packet generation speed corresponding to the APSS in the audio source and the initial data packet transmission speed corresponding to the second Bluetooth module in the audio source are respectively set.
  • the embodiment of the present application proposes an audio playback device, the device comprising:
  • a receiving unit configured to receive at least one synchronous data packet sequentially sent by the audio source
  • the first recording unit is configured to record at least one receiving time corresponding to at least one synchronization data packet when at least one synchronization data packet sequentially sent by the audio source is received;
  • An obtaining unit configured to obtain the generation time of at least one synchronization data packet carried in the at least one synchronization data packet
  • a synchronization unit configured to implement an audio synchronization operation between the audio source and the audio playback device based on the at least one receiving time and the at least one synchronization data packet generation time.
  • the device further includes: a determining unit;
  • the determining unit is configured to determine the initial time stamp difference according to the generation time of the first synchronization data packet corresponding to the first received first synchronization data packet and the first receiving time corresponding to the first synchronization data packet;
  • the second synchronization data packet generation time corresponding to the two synchronization data packets and the second synchronization reception time corresponding to the second synchronization data packet determine the target timestamp difference;
  • the second synchronization data packet is in the at least one synchronization data packet Synchronous data packets other than the first synchronous data packet;
  • the synchronization unit is further configured to implement an audio synchronization operation between the audio source and the audio playback device according to the initial time stamp difference and the target time stamp difference.
  • the determining unit is further configured to determine the second synchronous data packet generation time and the second synchronous reception time corresponding to the second synchronous data packet received when the preset time interval arrives. The target timestamp difference.
  • the synchronization unit is further configured to slow down the audio playback speed of the audio playback device if the target time stamp difference is greater than the initial time stamp difference; if the target time stamp difference If the value is less than the initial timestamp difference, then adjust the audio playback speed of the audio playback device; if the target timestamp difference is equal to the initial timestamp difference, then do not adjust the audio playback speed of the audio playback device Play speed.
  • the audio playback device includes a first Bluetooth module
  • the audio source includes a second Bluetooth module
  • the audio playback device receives the second Bluetooth module of the audio source through the second Bluetooth module The at least one synchronization data packet sent.
  • the embodiment of the present application proposes an audio source, and the audio source includes:
  • the second recording unit is used to record the generation time of the synchronization data packet that generates each synchronization data packet
  • a sending unit configured to sequentially send at least one synchronization data packet to which the generation time of the synchronization data packet has been added to the audio playback device, for the audio playback device to generate based on the at least one synchronization data packet carried in the at least one synchronization data packet.
  • the time and at least one receiving time of receiving the at least one synchronization data packet realize the audio synchronization operation between the audio source and the audio playback device.
  • the audio source includes a second bluetooth module
  • the audio playback device includes a first bluetooth module
  • the audio source communicates to the first bluetooth module of the audio playback device through the second bluetooth module
  • the module transmits at least one isochronous data packet.
  • the audio source includes an APSS
  • the second recording unit is further configured to record the generation time of a synchronization data packet every time the APSS generates a synchronization data packet.
  • the audio source further includes: a setting unit;
  • the setting unit is used to respectively set the initial data packet generation speed corresponding to the APSS in the audio source and the initial data packet transmission speed corresponding to the second Bluetooth module in the audio source.
  • the embodiment of the present application proposes an audio playback device, which includes: a first processor, a first memory, and a first communication bus; when the first processor executes the running program stored in the first memory, it realizes The following methods:
  • At least one reception time corresponding to at least one synchronization data packet and obtain at least one synchronization data packet generation time carried in the at least one synchronization data packet; based on the at least one reception time and the at least one synchronization data packet generation time , implementing audio synchronization operations between the audio source and the audio playback device.
  • the first processor is further configured to determine according to the first synchronization data packet generation time corresponding to the first received first synchronization data packet and the first reception time corresponding to the first data synchronization data The initial time stamp difference; according to the second synchronization data packet generation time corresponding to the second synchronization data packet and the second synchronization reception time corresponding to the second synchronization data packet, determine the target time stamp difference; the second synchronization data packet is Synchronous data packets in the at least one synchronous data packet except the first synchronous data packet; realize the audio source and the audio playback device according to the initial time stamp difference and the target time stamp difference Audio synchronization between operations.
  • the first processor is further configured to generate the second synchronization data packet and the second synchronization reception time corresponding to the second synchronization data packet received when the preset time interval arrives, Determine the target timestamp difference.
  • the first processor is further configured to slow down the audio playback speed of the audio playback device if the target time stamp difference is greater than the initial time stamp difference; if the target time Stamp difference is less than the initial time stamp difference, then speed up the audio playback speed of the audio playback device; if the target time stamp difference is equal to the initial time stamp difference, then do not adjust the audio playback device audio playback speed.
  • the audio playback device includes a first Bluetooth module
  • the audio source includes a second Bluetooth module
  • the audio playback device receives the second Bluetooth module of the audio source through the second Bluetooth module The at least one synchronization data packet sent.
  • the embodiment of the present application proposes an audio source, the audio source includes: a transmitter, a second processor, a second memory, and a second communication bus; the transmitter is used to sequentially add the synchronization data packets At least one synchronization data packet of the generated time is sent to the audio playback device for the audio playback device to generate time based on the at least one synchronization data packet carried in the at least one synchronization data packet and the time of receiving the at least one synchronization data packet At least one receiving time to realize the audio synchronization operation between the audio source and the audio playback device; the second processor implements the following method when executing the running program stored in the second memory:
  • the audio source includes a second bluetooth module
  • the audio playback device includes a first bluetooth module
  • the audio source communicates to the first bluetooth module of the audio playback device through the second bluetooth module
  • the module transmits the at least one synchronization data packet.
  • the audio source includes an APSS
  • the second processor is further configured to record the generation time of a synchronization data packet every time the APSS generates a synchronization data packet.
  • the second processor is also used to respectively set the initial data packet generation speed corresponding to the APSS in the audio source and the initial data packet transmission speed corresponding to the second Bluetooth module in the audio source .
  • the embodiment of the present application provides a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the audio synchronization method as described in any one of the foregoing is implemented.
  • An embodiment of the present application provides an audio synchronization method, an audio playback device, an audio source, and a storage medium.
  • the method includes: receiving at least one synchronization data packet sequentially sent by the audio source; recording at least one reception time corresponding to the at least one synchronization data packet , and acquire at least one synchronization data packet generation time carried in at least one synchronization data packet; based on at least one reception time and at least one synchronization data packet generation time, the audio synchronization operation between the audio source and the audio playback device is realized.
  • At least one synchronization data packet sent by the audio source to the audio playback device carries at least one synchronization data packet generation time, and the audio playback device records at least one synchronization data packet when receiving at least one synchronization data packet sent by the audio source.
  • At least one reception time corresponding to the data packet at this time, the audio playback device estimates the offset value between the frequency when the data packet is generated and the frequency of the Bluetooth transmission data packet based on at least one synchronous data packet generation time and at least one reception time, Therefore, the audio synchronization strategy determined by the audio playback device based on at least one synchronization data packet generation time and at least one reception time can keep the playback speed of the earphone end consistent with the playback speed of the mobile phone end, thereby improving the audio synchronization performance between the mobile phone and Bluetooth.
  • the Bluetooth audio playback between the mobile phone and the headset is shown in Figure 1.
  • the mobile phone terminal includes an application (Application, AP) module, a digital signal processing (Digital Signal Processing, DSP) module and a Bluetooth (BlueTooth, BT) module, wherein the AP module And the DSP module controls the frequency through the AP phase-locked loop (Phase Locked Loop, PLL) device, and the BT module controls the frequency through the BT PLL device; while the true wireless Bluetooth headset (True Wireless Stereo, TWS) headset includes a BT module, a DSP module and Codec (COder-DECoder, CODEC) module, wherein, the BT module controls the frequency through the BT PLL device, and the DSP module and the CODEC module control the frequency through the AP PLL device.
  • the BT PLL of the mobile phone and the BT PLL of the earphone are synchronized through the air interface, but the application subsystem (Application Subsystem, APSS) and the advanced digital signal processor (Advanced Digital Signal Processor, ADSP) submit data to the BT according to their respective frequencies.
  • Application Subsystem Application Subsystem
  • ADSP Advanced Digital Signal Processor
  • SoC System-on-Chip
  • the use of different source clocks between APSS, ADSP and BT SoC will lead to differences in the transmission frequency of BT and the frequency of original data generated by APSS, which may cause an offset between the AP PLL and BT PLL that generate original data on the mobile phone.
  • an embodiment of the present application provides an audio synchronization method, which is applied to an audio playback device.
  • the audio playback device can be a device that can realize wireless audio playback, such as a TWS earphone or a Bluetooth speaker, wherein the audio playback device includes the first A bluetooth module, the audio source includes a second bluetooth module, and the audio playback device and the audio source interact by the first bluetooth module and the second bluetooth module, as shown in Figure 2, the method may include:
  • An audio synchronization method proposed in the embodiment of the present application is applicable to the scenario of synchronizing audio playback progress between an audio source and a Bluetooth audio playback device. It should be noted that the audio synchronization method proposed in the embodiment of the present application requires that the audio source and the audio playback device have and activate the Bluetooth function at the same time.
  • the audio source may be a Bluetooth device such as a tablet computer, a mobile phone, a personal computer (Personal Computer, PC), a notebook computer, or a wearable device.
  • a Bluetooth device such as a tablet computer, a mobile phone, a personal computer (Personal Computer, PC), a notebook computer, or a wearable device.
  • the audio playback device receives the audio data stream supported by the Bluetooth standard sent by the audio source through the second Bluetooth module through the first Bluetooth module, and the audio data stream is composed of at least one synchronous data packet, as shown in FIG. 3 ,
  • the terminal sends audio data streams to the left and right TWS earphones at the same time.
  • S102 Record at least one reception time corresponding to the at least one synchronization data packet, and obtain at least one generation time of the synchronization data packet carried in the at least one synchronization data packet.
  • the audio playback device after the audio playback device receives at least one synchronization data packet through the first Bluetooth module, the audio playback device sequentially records the receiving time of each synchronization data packet in the received audio data stream, and obtains at least one synchronization data packet at least one receiving time corresponding to the packet, and sequentially acquire the receiving time carried in each synchronous data packet in the audio data stream, and obtain at least one synchronous data packet generation time corresponding to at least one synchronous data packet.
  • the generation time of the synchronization data packet is the generation time of the synchronization data packet recorded by the audio source when the application subsystem (Application subsystem, AP) of the audio source generates the synchronization data packet, and the generation time of the synchronization data packet is added by the audio source into the corresponding synchronous data packet, and send it to the audio playback device through the second bluetooth module.
  • application subsystem Application subsystem, AP
  • the initial data packet generation rate corresponding to the application subsystem and the initial data packet transmission rate corresponding to the second Bluetooth module are respectively set. It means that there is no error between the data packet generation speed corresponding to the application subsystem and the data packet transmission speed corresponding to the second Bluetooth module during the initial generation and transmission of synchronous data packets by the audio source to the audio playback device.
  • the audio playback device determines at least one reception time and at least one synchronization data packet generation time
  • the audio synchronization operation between the audio source and the audio playback device is realized based on the at least one reception time and at least one synchronization data packet generation time.
  • the initial time stamp difference is determined according to the first synchronization data packet generation time corresponding to the first received first synchronization data packet and the first reception time corresponding to the first synchronization data packet.
  • the difference between the generation time of the first synchronization data packet and the first reception time is calculated, and the difference is the initial time stamp difference.
  • the audio playback device when the audio playback device receives the first synchronization data packet, the audio playback device records the first receiving time timestamp_bt_0, and at the same time, the audio playback device analyzes the first synchronization data packet, and obtains the terminal in the first synchronization data packet The time timestamp_ap_0 is generated in the first synchronization data packet filled; after that, the difference init_delta_timestamp between timestamp_bt_0 and timestamp_ap_0 is calculated, which is used as one of the parameters for subsequently determining the audio synchronization strategy.
  • the audio playback device determines the target time stamp difference according to the generation time of the second synchronization data packet corresponding to the second synchronization data packet and the second reception time corresponding to the second synchronization data packet; wherein, the second synchronization data
  • the packet is a synchronous data packet except the first synchronous data packet in at least one synchronous data packet.
  • the audio playback device when the audio playback device receives the nth synchronization data packet after the first synchronization data packet, the audio playback device records the receiving time timestamp_bt_n of the nth synchronization data packet, and starts from the nth synchronization data packet Parse the nth synchronization data packet generation time timestamp_ap_n from the packet, and then calculate the delta_timestamp_n difference between timestamp_bt_n and timestamp_ap_n, as one of the parameters for subsequent determination of the audio synchronization strategy.
  • the audio playback device realizes the audio synchronization operation between the audio source and the audio playback device according to the initial timestamp difference and the target timestamp difference. Specifically, the audio playback device compares the target timestamp difference with the initial timestamp difference. Time stamp differences are compared, and different types of audio synchronization operations between the audio source and the audio playback device are implemented according to different comparison results.
  • the audio playback device can compare each target timestamp difference with the initial timestamp difference; it can also preset a synchronization data packet reception interval, and receive The target timestamp difference corresponding to the synchronization data packet is compared with the initial timestamp difference.
  • the specific comparison strategy can be selected according to the actual situation, and is not specifically limited in this embodiment of the present application.
  • the audio playback device compares the target time stamp difference with the initial time stamp difference, if the target time stamp difference is greater than the initial time stamp difference, it indicates that the BT PLL of the audio source is relative to the AP PLL of the audio source Slow down, slow down the audio playback speed of the audio playback device at this time; if the target timestamp difference is smaller than the initial timestamp difference, it indicates that the BT PLL of the audio source is faster than the AP PLL of the audio source, and the audio playback speed is adjusted at this time The audio playback speed of the device; if the target timestamp difference is equal to the initial timestamp difference, the audio playback speed of the audio playback device will not be adjusted.
  • At least one synchronization data packet sent by the audio source to the audio playback device carries at least one synchronization data packet generation time, and the audio playback device records at least one synchronization data packet when receiving at least one synchronization data packet sent by the audio source.
  • At least one reception time corresponding to the data packet at this time, the audio playback device estimates the offset value between the frequency when the data packet is generated and the frequency of the Bluetooth transmission data packet based on at least one synchronous data packet generation time and at least one reception time, Therefore, the audio synchronization strategy determined by the audio playback device based on at least one synchronization data packet generation time and at least one reception time can keep the playback speed of the earphone end consistent with the playback speed of the mobile phone end, thereby improving the audio synchronization performance between the mobile phone and Bluetooth.
  • the embodiments of the present application further provide an audio synchronization method for an audio source, where the audio source may be a Bluetooth device such as a tablet computer, a mobile phone, a PC, a notebook computer, or a wearable device.
  • the audio source includes a second Bluetooth module
  • the audio playback device includes a first Bluetooth module
  • the audio source transmits at least one synchronization data packet to the first Bluetooth module of the audio playback device through the second Bluetooth module.
  • the method may include:
  • the audio source further includes an application subsystem for generating a synchronization data packet, and the audio source records the generation time of the synchronization data packet each time the application subsystem generates a synchronization data packet.
  • the audio source initially sets the AP PLL and BT PLL of the audio source before recording the generation time of each synchronous data packet generated by the application subsystem, wherein the AP PLL is used to represent the generation speed of the synchronous data packet , BT PLL is used to represent the transmission speed of the synchronous data packet, that is, the audio source sets the initial data packet generation speed corresponding to the application subsystem and the initial data packet transmission speed corresponding to the second Bluetooth module.
  • the synchronization data packet When the application subsystem initially generates a synchronization data packet, the synchronization data packet is generated according to the initial data packet generation speed, and when the second bluetooth module initially sends the synchronization data packet, the synchronization data packet is sent to the audio playback device according to the initial data packet transmission speed; Over time, the offset between AP PLL and BT PLL may be different. At this time, in the case of audio PLL synchronization between the audio playback device and the audio source, it will cause the audio playback speed of the audio playback device to be different from the audio The actual application playback speed of the source varies.
  • each synchronization data packet generation time is added to a corresponding synchronization data packet.
  • S203 Sequentially send at least one synchronization data packet to which the generation time of the synchronization data packet has been added to the audio playback device, so that the audio playback device generates time based on at least one synchronization data packet carried in at least one synchronization data packet and receives at least one synchronization data packet At least one receiving time of the data packet realizes the audio synchronization operation between the audio source and the audio playback device.
  • the audio source sequentially sends at least one synchronous data packet to the audio playback device through the second Bluetooth module.
  • the application subsystem sequentially transmits at least one synchronous data packet to the second Bluetooth module, and the second Bluetooth The module sequentially sends at least one synchronous data packet to the audio playback device based on the data packet transmission speed.
  • the audio playback device determines at least one synchronization data packet generation time and at least one reception time corresponding to the at least one synchronization data packet based on at least one synchronization data packet sent by the audio source, and based on the at least one synchronization data packet generation time and At least one reception time is used to estimate the offset value of AP PLL and BT PLL, and then realize the audio synchronization operation between the audio source and the audio playback device.
  • the specific process refer to the description of S101-S103, and will not repeat them here.
  • the embodiment of the present application proposes an audio synchronization scheme between an audio playback device and an audio source, as shown in FIG. 5 , the implementation process specifically includes:
  • the audio source initially sets the value of AP PLL and the value of BT PLL.
  • the synchronization data packet generation time timestamp_ap of each synchronization data packet is determined according to the APSS system time, and the timestamp_ap is inserted into the corresponding synchronization data packet.
  • the BT module of the audio source sends the synchronization data packet to the audio playback device.
  • the audio playback device records the receiving time timestamp_bt of each synchronization data packet, and parses out the corresponding timestamp_ap from each synchronization data packet.
  • the audio playback device calculates the difference between the first receiving time timestamp_bt_0 corresponding to the first synchronization data packet and the generation time timestamp_ap_0 of the first synchronization data packet to obtain init_delta_timestamp.
  • the audio playback device calculates the difference between the nth receiving time timestamp_bt_n corresponding to the nth synchronous data packet and the generation time timestamp_ap_n of the nth synchronous data packet to obtain delta_timestamp_n.
  • the audio playback device compares the difference between delta_timestamp_n and init_delta_timestamp, which is used to reflect the offset of the AP PLL and BT PLL of the audio source.
  • delta_timestamp_n>init_delta_timestamp it indicates that BT PLL is slower than AP PLL. Then slow down the rate of the audio PLL of the audio playback device.
  • delta_timestamp_n ⁇ init_delta_timestamp it indicates that BT PLL is faster than AP PLL. Then speed up the rate of the audio PLL of the audio playback device.
  • delta_timestamp_n init_delta_timestamp, it indicates that the BT PLL has not changed relative to the AP PLL. Then the rate of the audio PLL of the audio playback device is not adjusted.
  • At least one synchronization data packet sent by the audio source to the audio playback device carries at least one synchronization data packet generation time, and the audio playback device records at least one synchronization data packet when receiving at least one synchronization data packet sent by the audio source.
  • At least one reception time corresponding to the data packet at this time, the audio playback device estimates the offset value between the frequency when the data packet is generated and the frequency of the Bluetooth transmission data packet based on at least one synchronous data packet generation time and at least one reception time, Therefore, the audio synchronization strategy determined by the audio playback device based on at least one synchronization data packet generation time and at least one reception time can keep the playback speed of the earphone end consistent with the playback speed of the mobile phone end, thereby improving the audio synchronization performance between the mobile phone and Bluetooth.
  • the embodiment of the present application provides an audio playback device 1 .
  • the device 1 includes:
  • a receiving unit 10 configured to receive at least one synchronous data packet sequentially sent by the audio source
  • the first recording unit 11 is configured to record at least one receiving time corresponding to at least one synchronization data packet
  • An obtaining unit 12 configured to obtain the generation time of at least one synchronization data packet carried in the at least one synchronization data packet;
  • the synchronization unit 13 is configured to implement an audio synchronization operation between the audio source and the audio playback device based on the at least one receiving time and the at least one synchronization data packet generation time.
  • the device further includes: a determination unit;
  • the determining unit is configured to determine the initial time stamp difference according to the first synchronization data packet generation time corresponding to the first received first synchronization data packet and the first reception time corresponding to the first synchronization data packet; according to the second The generation time of the second synchronization data packet corresponding to the synchronization data packet and the second synchronization reception time corresponding to the second synchronization data packet determine the target timestamp difference; Synchronous data packets other than the first synchronous data packet;
  • the synchronization unit 13 is further configured to implement an audio synchronization operation between the audio source and the audio playback device according to the initial time stamp difference and the target time stamp difference.
  • the determining unit is further configured to determine the second synchronization data packet generation time and the second synchronization reception time corresponding to the second synchronization data packet received when the preset time interval arrives. Target timestamp delta.
  • the synchronization unit 13 is further configured to slow down the audio playback speed of the audio playback device if the target time stamp difference is greater than the initial time stamp difference; if the target time stamp difference is If the value is less than the initial timestamp difference, then adjust the audio playback speed of the audio playback device; if the target timestamp difference is equal to the initial timestamp difference, then do not adjust the audio playback speed of the audio playback device Play speed.
  • the audio playback device includes a first bluetooth module
  • the audio source includes a second bluetooth module
  • the audio play device receives the audio signal sent by the second bluetooth module of the audio source through the first bluetooth module.
  • An audio playback device receives at least one synchronization data packet sequentially sent by an audio source; records at least one receiving time corresponding to at least one synchronization data packet, and obtains at least one synchronization data carried in at least one synchronization data packet Data packet generation time: based on at least one receiving time and at least one synchronization data packet generation time, the audio synchronization operation between the audio source and the audio playback device is realized. It can be seen that, in the audio playback device proposed in this embodiment, at least one synchronization data packet sent by the audio source to the audio playback device carries at least one synchronization data packet generation time, and the audio playback device receives at least one synchronization data packet sent by the audio source.
  • the audio playback device estimates the frequency when the data packet is generated and the Bluetooth transmission data packet based on at least one synchronous data packet generation time and at least one reception time.
  • the offset value between the frequencies so that the audio synchronization strategy determined by the audio playback device based on at least one synchronization data packet generation time and at least one reception time can keep the playback speed of the earphone end consistent with the playback speed of the mobile phone end, thereby improving the performance of the mobile phone. Audio sync performance with bluetooth.
  • Fig. 7 is a schematic diagram of the composition and structure of an audio playback device 1 provided by the embodiment of the present application II.
  • the device 1 of this embodiment includes: A receiver 14 , a first processor 15 , a first memory 16 and a first communication bus 17 .
  • the first recording unit 11, the acquiring unit 12, the synchronizing unit 13 and the determining unit can be implemented by the first processor 15 located on the audio playback device 1, and the receiving unit 10 can be implemented by the first processor located on the device 1
  • the receiver 14 is realized, and the above-mentioned first processor 15 can be an application-specific integrated circuit (ASIC, Application Specific Integrated Circuit), DSP, digital signal processing image processing device (DSPD, Digital Signal Processing Device), programmable logic image processing device At least one of (PLD, Programmable Logic Device), Field Programmable Gate Array (FPGA, Field Programmable Gate Array), CPU, controller, microcontroller, microprocessor. It can be understood that, for different devices, the electronic device used to implement the above processor function may also be other, which is not specifically limited in this embodiment.
  • ASIC Application Specific Integrated Circuit
  • DSP digital signal processing image processing device
  • DSPD Digital Signal Processing Device
  • programmable logic image processing device At least one of (PLD, Programmable Logic Device), Field Programmable Gate Array (FPGA,
  • the above-mentioned first communication bus 17 is used to realize connection and communication between the receiver 14, the first processor 15 and the first memory 16; the above-mentioned receiver 14 is used to receive at least A synchronous data packet; the above-mentioned first processor 15 implements the following audio synchronization method when executing the running program stored in the first memory 16:
  • an audio synchronization operation between the audio source and the audio playback device is realized.
  • the first processor 15 is further configured to generate the time and the first synchronous data packet corresponding to the first synchronous data packet corresponding to the first received synchronous data packet.
  • Receiving time determine the initial timestamp difference; according to the second synchronization data packet generation time corresponding to the second synchronization data packet and the second synchronization reception time corresponding to the second synchronization data packet, determine the target time stamp difference;
  • the second The synchronous data packet is a synchronous data packet except the first synchronous data packet in the at least one synchronous data packet; according to the initial time stamp difference and the target time stamp difference, realize the audio source and the Audio synchronization between audio playback devices described above.
  • the first processor 15 is further configured to generate the second synchronization data packet corresponding to the second synchronization data packet received when the preset time interval arrives and the first 2. Synchronize receiving time, and determine the target timestamp difference.
  • the first processor 15 is further configured to slow down the audio playback speed of the audio playback device if the target timestamp difference is greater than the initial timestamp difference; If the target time stamp difference is less than the initial time stamp difference, then speed up the audio playback speed of the audio playback device; if the target time stamp difference is equal to the initial time stamp difference, then do not adjust The audio playback speed of the audio playback device.
  • the audio playback device includes a first Bluetooth module
  • the audio source includes a second Bluetooth module
  • the audio playback device receives the audio data from the audio source through the first Bluetooth module.
  • the embodiment of the present application provides an audio source 2 .
  • the audio source 2 includes:
  • the second recording unit 20 is used to record the generation time of the synchronous data packet that generates each synchronous data packet;
  • the adding unit 21 is used to add the generation time of the synchronization data packet in each synchronization data packet;
  • the sending unit 22 is configured to sequentially send at least one synchronization data packet to which the generation time of the synchronization data packet has been added to the audio playback device, so that the audio playback device is based on the at least one synchronization data packet carried in the at least one synchronization data packet.
  • the generation time and the at least one receiving time of receiving the at least one synchronization data packet realize the audio synchronization operation between the audio source and the audio playback device.
  • the audio source includes a second Bluetooth module
  • the audio playback device includes a first Bluetooth module
  • the audio source transmits to the first Bluetooth module of the audio playback device through the second Bluetooth module at least one isochronous packet.
  • the audio source includes an APSS
  • the second recording unit 20 is further configured to record a synchronization data packet generation time of each synchronization data packet generated by the APSS.
  • the audio source also includes: a setting unit;
  • the setting unit is used to respectively set the initial data packet generation speed corresponding to the APSS in the audio source and the initial data packet transmission speed corresponding to the second Bluetooth module in the audio source.
  • An audio source provided by the embodiment of the present application records the generation time of each synchronization data packet; and adds the generation time of the synchronization data packet to each synchronization data packet; sequentially adds the generation time of the synchronization data packet
  • the at least one synchronization data packet is sent to the audio playback device, for the audio playback device to realize the audio source based on at least one synchronization data packet generation time carried in at least one synchronization data packet and at least one reception time of receiving at least one synchronization data packet Synchronous operation of audio between audio playback devices.
  • the audio source proposed in this embodiment carries at least one synchronization data packet generation time in at least one synchronization data packet sent to the audio playback device, so that when the audio playback device receives at least one synchronization data packet sent by the audio source , record at least one reception time corresponding to at least one synchronization data packet, at this time, the audio playback device estimates the frequency between the frequency when the data packet is generated and the frequency of the Bluetooth transmission data packet based on at least one synchronization data packet generation time and at least one reception time The offset value, so the audio synchronization strategy determined by the audio playback device based on at least one synchronization data packet generation time and at least one reception time can keep the playback speed of the earphone end consistent with the playback speed of the mobile phone end, thereby improving the connection between the mobile phone and Bluetooth. Audio synchronization performance between
  • Fig. 9 is a schematic diagram of the composition and structure of an audio source 2 provided by the embodiment of the present application.
  • the audio source 2 of this embodiment includes: A transmitter 23 , a second processor 24 , a second memory 25 and a second communication bus 26 .
  • the above-mentioned second recording unit 20, adding unit 21 and setting unit can be realized by a second processor 24 located on the audio source 2, and the above-mentioned sending unit 22 can be realized by a transmitter 23 located on the audio source
  • the above-mentioned second processor 24 may be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. It can be understood that, for different devices, the electronic device used to implement the above processor function may also be other, which is not specifically limited in this embodiment.
  • the above-mentioned second communication bus 26 is used to realize connection communication between the transmitter 23, the second processor 24 and the second memory 25; At least one synchronization data packet of the generated time is sent to the audio playback device for the audio playback device to generate time based on the at least one synchronization data packet carried in the at least one synchronization data packet and the time of receiving the at least one synchronization data packet At least one receiving time realizes the audio synchronization operation between the audio source and the audio playback device; the above-mentioned second processor 24 implements the following audio synchronization method when executing the running program stored in the second memory 25:
  • the audio source includes a second Bluetooth module
  • the audio playback device includes a first Bluetooth module
  • the audio source sends data to the audio playback device through the second Bluetooth module.
  • the first Bluetooth module transmits the at least one synchronization data packet.
  • the audio source includes an APSS
  • the second processor 24 is further configured to record the generation time of a synchronization data packet every time the APSS generates a synchronization data packet.
  • the second processor 24 is also used to respectively set the initial data packet generation speed corresponding to the APSS in the audio source and the initial data packet generation speed corresponding to the second Bluetooth module in the audio source. Packet transmission speed.
  • An embodiment of the present application provides a storage medium on which a computer program is stored.
  • the computer-readable storage medium stores one or more programs.
  • the one or more programs can be executed by one or more processors and are applied to audio In the playback device and/or the audio source, the computer program implements the above audio synchronization method.
  • the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk, etc.) ) includes several instructions to make an image display device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in various embodiments of the present disclosure.
  • a storage medium such as ROM/RAM, magnetic disk, optical disk, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Synchronisation In Digital Transmission Systems (AREA)

Abstract

本申请实施例提供了一种音频同步方法及音频播放设备、音频源、存储介质,包括:接收音频源依次发送的至少一个同步数据包;记录至少一个同步数据包对应的至少一个接收时间,并获取至少一个同步数据包中携带的至少一个同步数据包产生时间;基于至少一个接收时间和至少一个同步数据包产生时间,实现音频源和音频播放设备之间的音频同步操作。

Description

一种音频同步方法及音频播放设备、音频源、存储介质
相关申请的交叉引用
本申请基于申请号为202110725673.3、申请日为2021年06月29日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此以引入方式并入本申请。
技术领域
本申请涉及音频领域,尤其涉及一种音频同步方法及音频播放设备、音频源、存储介质。
背景技术
为了实现无线蓝牙耳机的左右耳音频同步,现有的方案是利用蓝牙耳机和手机蓝牙系统之间的时钟一致性作为基础,来完成副耳对主耳播放的跟随;或者利用耳机蓝牙和手机蓝牙之间的频率同步特性,让耳机内的音频播放跟随蓝牙的频率,来完成耳机和手机蓝牙之间的同步播放,进而实现多耳机之间的同步播放。
然而,若手机蓝牙的频率和手机音频数据产生的频率不一致,则会导致手机与蓝牙之间的音频同步性能差的问题。
发明内容
本申请实施例提供一种音频同步方法及音频播放设备、音频源、存储介质,能够提高终端与耳机之间的音频同步性能。
第一方面,本申请实施例提出一种用于音频播放设备的音频同步方法,所述方法包括:
接收音频源依次发送的至少一个同步数据包;
记录至少一个同步数据包对应的至少一个接收时间,并获取所述至少一个同步数据包中携带的至少一个同步数据包产生时间;
基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
第二方面,本申请实施例提出一种用于音频源的音频同步方法,包括:
记录产生每个同步数据包的同步数据包产生时间;
在每个同步数据包中添加同步数据包产生时间;
依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频 播放设备,以供所述音频播放设备基于所述至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到所述至少一个同步数据包的至少一个接收时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
第三方面,本申请实施例提出一种音频播放设备,所述设备包括:
接收单元,用于接收音频源依次发送的至少一个同步数据包;
第一记录单元,用于在接收到音频源依次发送的至少一个同步数据包的情况下,记录至少一个同步数据包对应的至少一个接收时间;
获取单元,用于获取所述至少一个同步数据包中携带的至少一个同步数据包产生时间;
同步单元,用于基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
第四方面,本申请实施例提出一种音频源,所述音频源包括:
第二记录单元,用于记录产生每个同步数据包的同步数据包产生时间;
添加单元,用于在每个同步数据包中添加所述同步数据包产生时间;
发送单元,用于依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备,以供所述音频播放设备基于所述至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到所述至少一个同步数据包的至少一个接收时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
第五方面,本申请实施例提出一种音频播放设备,所述设备包括:第一处理器、第一存储器及第一通信总线;所述第一处理器执行第一存储器存储的运行程序时实现如上述的音频同步方法。
第六方面,本申请实施例提出一种音频源,所述音频源包括:发送器、第二处理器、第二存储器及第二通信总线;所述第二处理器执行第二存储器存储的运行程序时实现如上述的音频同步方法。
第七方面,本申请实施例提出一种存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现如上述任一项所述的音频同步方法。
附图说明
图1为一种手机与耳机之间的蓝牙音频播放的结构示意图;
图2为本申请实施例提供的一种用于音频播放设备的音频同步方法的流程图;
图3为本申请实施例提供的一种示例性的同步播放的示意图;
图4为本申请实施例提供的一种用于音频源的音频同步方法的流程图;
图5为本申请实施例提供的一种音频同步方法的交互流程图;
图6为本申请实施例提供的一种音频播放设备的结构示意图一;
图7为本申请实施例提供的一种音频播放设备的结构示意图二;
图8为本申请实施例提供的一种音频源的结构示意图一;
图9为本申请实施例提供的一种音频源的结构示意图二。
具体实施方式
本申请的技术方案是这样实现的:
第一方面,本申请实施例提出一种用于音频播放设备的音频同步方法,所述方法包括:
接收音频源依次发送的至少一个同步数据包;
记录至少一个同步数据包对应的至少一个接收时间,并获取所述至少一个同步数据包中携带的至少一个同步数据包产生时间;
基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
在上述方法中,所述基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作,包括:
根据首个接收到的第一同步数据包对应的第一同步数据包产生时间和第一同步数据包对应的第一接收时间,确定初始时间戳差值;
根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二同步接收时间,确定目标时间戳差值;所述第二同步数据包为所述至少一个同步数据包中除所述第一同步数据包外的同步数据包;
根据所述初始时间戳差值和所述目标时间戳差值,实现所述音频源和所述音频播放设备之间的音频同步操作。
在上述方法中,所述根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二同步接收时间,确定目标时间戳差值,包括:
根据预设时间间隔到达时接收到的第二同步数据包对应的所述第二同步数据包产生时间和所述第二同步接收时间,确定所述目标时间戳差值。
在上述方法中,所述根据所述初始时间戳差值和所述目标时间戳差值,实现所述音频源和所述音频播放设备之间的音频同步操作,包括:
若所述目标时间戳差值大于所述初始时间戳差值,则调慢所述音频播放设备的音频播放速度;
若所述目标时间戳差值小于所述初始时间戳差值,则调快所述音频播放设备的音频播放速度;
若所述目标时间戳差值等于所述初始时间戳差值,则不调整所述音频播放设备的音频播放速度。
在上述方法中,所述音频播放设备包括第一蓝牙模块,所述音频源包括第二蓝牙模块,所述音频播放设备通过所述第一蓝牙模块接收所述音频 源的所述第二蓝牙模块发送的所述至少一个同步数据包。
第二方面,本申请实施例提出一种用于音频源的音频同步方法,包括:
记录产生每个同步数据包的同步数据包产生时间;
在每个同步数据包中添加同步数据包产生时间;
依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备,以供所述音频播放设备基于所述至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到所述至少一个同步数据包的至少一个接收时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
在上述方法中,所述音频源包括第二蓝牙模块,所述音频播放设备包括第一蓝牙模块,所述音频源通过所述第二蓝牙模块向所述音频播放设备的所述第一蓝牙模块传输所述至少一个同步数据包。
在上述方法中,所述音频源包括应用子系统APSS,所述记录产生每个同步数据包的同步数据包产生时间,包括:
记录所述APSS每产生一个同步数据包的同步数据包产生时间。
在上述方法中,所述记录应用子系统每产生一个同步数据包的同步数据包产生时间之前,所述方法还包括:
分别设置所述音频源中的APSS对应的初始数据包产生速度和所述音频源中的第二蓝牙模块对应的初始数据包传输速度。
第三方面,本申请实施例提出一种音频播放设备,所述设备包括:
接收单元,用于接收音频源依次发送的至少一个同步数据包;
第一记录单元,用于在接收到音频源依次发送的至少一个同步数据包的情况下,记录至少一个同步数据包对应的至少一个接收时间;
获取单元,用于获取所述至少一个同步数据包中携带的至少一个同步数据包产生时间;
同步单元,用于基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
在上述设备中,所述设备还包括:确定单元;
所述确定单元,用于根据首个接收到的第一同步数据包对应的第一同步数据包产生时间和第一数同步据包对应的第一接收时间,确定初始时间戳差值;根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二同步接收时间,确定目标时间戳差值;所述第二同步数据包为所述至少一个同步数据包中除所述第一同步数据包外的同步数据包;
所述同步单元,还用于根据所述初始时间戳差值和所述目标时间戳差值,实现所述音频源和所述音频播放设备之间的音频同步操作。
在上述设备中,所述确定单元,还用于根据预设时间间隔到达时接收到的第二同步数据包对应的所述第二同步数据包产生时间和所述第二同步接收时间,确定所述目标时间戳差值。
在上述设备中,所述同步单元,还用于若所述目标时间戳差值大于所 述初始时间戳差值,则调慢所述音频播放设备的音频播放速度;若所述目标时间戳差值小于所述初始时间戳差值,则调快所述音频播放设备的音频播放速度;若所述目标时间戳差值等于所述初始时间戳差值,则不调整所述音频播放设备的音频播放速度。
在上述设备中,所述音频播放设备包括第一蓝牙模块,所述音频源包括第二蓝牙模块,所述音频播放设备通过所述第二蓝牙模块接收所述音频源的所述第二蓝牙模块发送的所述至少一个同步数据包。
第四方面,本申请实施例提出一种音频源,所述音频源包括:
第二记录单元,用于记录产生每个同步数据包的同步数据包产生时间;
添加单元,用于在每个同步数据包中添加所述同步数据包产生时间;
发送单元,用于依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备,以供所述音频播放设备基于所述至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到所述至少一个同步数据包的至少一个接收时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
在上述音频源中,所述音频源包括第二蓝牙模块,所述音频播放设备包括第一蓝牙模块,所述音频源通过所述第二蓝牙模块向所述音频播放设备的所述第一蓝牙模块传输所至少一个同步数据包。
在上述音频源中,所述音频源包括APSS,所述第二记录单元,还用于记录所述APSS每产生一个同步数据包的同步数据包产生时间。
在上述音频源中,所述音频源还包括:设置单元;
所述设置单元,用于分别设置所述音频源中的APSS对应的初始数据包产生速度和所述音频源中的第二蓝牙模块对应的初始数据包传输速度。
第五方面,本申请实施例提出一种音频播放设备,所述设备包括:第一处理器、第一存储器及第一通信总线;所述第一处理器执行第一存储器存储的运行程序时实现以下方法:
记录至少一个同步数据包对应的至少一个接收时间,并获取所述至少一个同步数据包中携带的至少一个同步数据包产生时间;基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
在上述设备中,所述第一处理器,还用于根据首个接收到的第一同步数据包对应的第一同步数据包产生时间和第一数同步据包对应的第一接收时间,确定初始时间戳差值;根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二同步接收时间,确定目标时间戳差值;所述第二同步数据包为所述至少一个同步数据包中除所述第一同步数据包外的同步数据包;根据所述初始时间戳差值和所述目标时间戳差值,实现所述音频源和所述音频播放设备之间的音频同步操作。
在上述设备中,所述第一处理器,还用于根据预设时间间隔到达时接 收到的第二同步数据包对应的所述第二同步数据包产生时间和所述第二同步接收时间,确定所述目标时间戳差值。
在上述设备中,所述第一处理器,还用于若所述目标时间戳差值大于所述初始时间戳差值,则调慢所述音频播放设备的音频播放速度;若所述目标时间戳差值小于所述初始时间戳差值,则调快所述音频播放设备的音频播放速度;若所述目标时间戳差值等于所述初始时间戳差值,则不调整所述音频播放设备的音频播放速度。
在上述设备中,所述音频播放设备包括第一蓝牙模块,所述音频源包括第二蓝牙模块,所述音频播放设备通过所述第二蓝牙模块接收所述音频源的所述第二蓝牙模块发送的所述至少一个同步数据包。
第六方面,本申请实施例提出一种音频源,所述音频源包括:发送器、第二处理器、第二存储器及第二通信总线;上述发送器,用于依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备,以供所述音频播放设备基于所述至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到所述至少一个同步数据包的至少一个接收时间,实现所述音频源和所述音频播放设备之间的音频同步操作;所述第二处理器执行第二存储器存储的运行程序时实现以下方法:
记录产生每个同步数据包的同步数据包产生时间;在每个同步数据包中添加所述同步数据包产生时间。
在上述音频源中,所述音频源包括第二蓝牙模块,所述音频播放设备包括第一蓝牙模块,所述音频源通过所述第二蓝牙模块向所述音频播放设备的所述第一蓝牙模块传输所述至少一个同步数据包。
在上述音频源中,所述音频源包括APSS,所述第二处理器,还用于记录所述APSS每产生一个同步数据包的同步数据包产生时间。
在上述音频源中,所述第二处理器,还用于分别设置所述音频源中的APSS对应的初始数据包产生速度和所述音频源中的第二蓝牙模块对应的初始数据包传输速度。
第七方面,本申请实施例提出一种存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现如上述任一项所述的音频同步方法。
本申请实施例提供了一种音频同步方法及音频播放设备、音频源、存储介质,该方法包括:接收音频源依次发送的至少一个同步数据包;记录至少一个同步数据包对应的至少一个接收时间,并获取至少一个同步数据包中携带的至少一个同步数据包产生时间;基于至少一个接收时间和至少一个同步数据包产生时间,实现音频源和音频播放设备之间的音频同步操作。采用上述实现方案,音频源向音频播放设备发送的至少一个同步数据包中携带有至少一个同步数据包产生时间,音频播放设备在接收到音频源发送的至少一个同步数据包时,记录至少一个同步数据包对应的至少一个接收时间,此时,音频播放设备基于至少一个同步数据包产生时间和至少 一个接收时间来估算数据包产生时的频率与蓝牙传输数据包的频率之间的偏移值,由此音频播放设备基于至少一个同步数据包产生时间和至少一个接收时间确定出的音频同步策略,能够保持耳机端的播放速度与手机端的播放速度一致,进而提高了手机与蓝牙之间的音频同步性能。
应当理解,此处描述的具体实施例仅仅用以解释本申请。并不用于限定本申请。
手机与耳机之间的蓝牙音频播放如图1所示,手机端包括应用(Application,AP)模块、数字信号处理(Digital Signal Processing,DSP)模块和蓝牙(BlueTooth,BT)模块,其中,AP模块和DSP模块通过AP锁相环(Phase Locked Loop,PLL)器件来控制频率,BT模块通过BT PLL器件来控制频率;而真无线蓝牙耳机(True Wireless Stereo,TWS)耳机包括BT模块、DSP模块和编码译码器(COder-DECoder,CODEC)模块,其中,BT模块通过BT PLL器件来控制频率,DSP模块和CODEC模块通过AP PLL器件来控制频率。目前,手机BT PLL和耳机BT PLL之间通过空口同步保持一致,但是应用子系统(Application Subsystem,APSS),高级数字信号处理器(Advanced Digital Signal Processor,ADSP)按照各自的频率将数据递交给BT系统级芯片(System on Chip,SoC)。APSS,ADSP和BT SoC之间使用不同源时钟会导致BT的发送频率和APSS产生原始数据的频率存在差异,进而导致手机端产生原始数据的AP PLL和BT PLL之间可能存在偏移。
为解决上述问题,本申请实施例提供一种音频同步方法,应用于音频播放设备,该音频播放设备可以为TWS耳机、蓝牙音箱等可实现无线音频播放的设备,其中,音频播放设备中包括第一蓝牙模块,音频源包括第二蓝牙模块,音频播放设备与音频源之间通过第一蓝牙模块和第二蓝牙模块进行交互,如图2所示,该方法可以包括:
S101、接收音频源依次发送的至少一个同步数据包。
本申请实施例提出的一种音频同步方法适用于音频源与蓝牙音频播放设备之间进行音频播放进度同步的场景下。需要说明的是,本申请实施例提出的一种音频同步方法需要音频源和音频播放设备同时具备且启动蓝牙功能。
本申请实施例中,音频源可以为平板电脑、手机、个人计算机(Personal Computer,PC)、笔记本电脑、可穿戴设备等蓝牙设备。
本申请实施例中,音频播放设备通过第一蓝牙模块接收音频源通过第二蓝牙模块发送的蓝牙标准支持的音频数据流,该音频数据流由至少一个同步数据包组成,如图3所示,终端同时向左右两只TWS耳机发送音频数据流。
S102、记录至少一个同步数据包对应的至少一个接收时间,并获取至少一个同步数据包中携带的至少一个同步数据包产生时间。
本申请实施例中,在音频播放设备通过第一蓝牙模块接收到至少一个同步数据包之后,音频播放设备依次记录接收到音频数据流中、每一个同步数据包的接收时间,得到至少一个同步数据包对应的至少一个接收时间,并依次获取音频数据流中、每一个同步数据包中携带的接收时间,得到至少一个同步数据包对应的至少一个同步数据包产生时间。
需要说明的是,同步数据包产生时间为音频源的应用子系统(Application subsystem,AP)生成同步数据包时,音频源记录的同步数据包的生成时间,该同步数据包产生时间被音频源添加至对应的同步数据包中、并通过第二蓝牙模块发送给音频播放设备。
需要说明的是,音频源在播放音频数据流之前,先分别设置应用子系统对应的初始数据包产生速度和第二蓝牙模块对应的初始数据包传输速度。表征在音频源在初始生成并向音频播放设备发送同步数据包的过程中,应用子系统对应的数据包产生速度和第二蓝牙模块对应的数据包传输速度之间是不存在误差的。
S103、基于至少一个接收时间和至少一个同步数据包产生时间,实现音频源和音频播放设备之间的音频同步操作。
在音频播放设备分别确定出至少一个接收时间和至少一个同步数据包产生时间之后,基于至少一个接收时间和至少一个同步数据包产生时间实现音频源和音频播放设备之间的音频同步操作。
本申请实施例中,根据首个接收到的第一同步数据包对应的第一同步数据包产生时间和第一同步数据包对应的第一接收时间,确定初始时间戳差值。
本申请实施例中,计算第一同步数据包产生时间和第一接收时间之间的差值,该差值即为初始时间戳差值。
需要说明的是,在音频播放设备接收到第一个同步数据包时,音频播放设备记录第一接收时间timestamp_bt_0,同时,音频播放设备解析第一同步数据包,得到终端在第一同步数据包中填充的第一同步数据包产生时间timestamp_ap_0;之后,计算timestamp_bt_0和timestamp_ap_0之间的差值init_delta_timestamp,作为后续确定音频同步策略的参数之一。
本申请实施例中,音频播放设备根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二接收时间,确定目标时间戳差值;其中,第二同步数据包为至少一个同步数据包中除第一同步数据包外的同步数据包。
需要说明的是,在音频播放设备接收到第一个同步数据包之后的第n个同步数据包时,音频播放设备记录接收第n个同步数据包的接收时间timestamp_bt_n,并从第n个同步数据包中解析出第n同步数据包产生时间timestamp_ap_n,之后计算timestamp_bt_n和timestamp_ap_n之间的差值delta_timestamp_n,作为后续确定音频同步策略的参数之一。
本申请实施例中,音频播放设备根据初始时间戳差值和目标时间戳差值,实现音频源和音频播放设备之间的音频同步操作,具体的,音频播放设备将目标时间戳差值与初始时间戳差值进行比较,并根据不同的比较结果实现音频源和音频播放设备之间不同类型的音频同步操作。
需要说明的是,音频播放设备可以将每一个目标时间戳差值均与初始时间戳差值进行比较;也可以预设一个同步数据包接收间隔,将该同步数据包接收间隔到达时接收到的同步数据包对应的目标时间戳差值与初始时间戳差值进行比较,具体的比较策略可以根据实际情况进行选择,本申请实施例不做具体的限定。
本申请实施例中,音频播放设备将目标时间戳差值与初始时间戳差值进行比较,若目标时间戳差值大于初始时间戳差值,表明音频源的BT PLL相对于音频源的AP PLL变慢,此时调慢音频播放设备的音频播放速度;若目标时间戳差值小于初始时间戳差值,表明音频源的BT PLL相对于音频源的AP PLL变快,此时调快音频播放设备的音频播放速度;若目标时间戳差值等于初始时间戳差值,则不调整音频播放设备的音频播放速度。
可以理解的是,音频源向音频播放设备发送的至少一个同步数据包中携带有至少一个同步数据包产生时间,音频播放设备在接收到音频源发送的至少一个同步数据包时,记录至少一个同步数据包对应的至少一个接收时间,此时,音频播放设备基于至少一个同步数据包产生时间和至少一个接收时间来估算数据包产生时的频率与蓝牙传输数据包的频率之间的偏移值,由此音频播放设备基于至少一个同步数据包产生时间和至少一个接收时间确定出的音频同步策略,能够保持耳机端的播放速度与手机端的播放速度一致,进而提高了手机与蓝牙之间的音频同步性能。
基于上述实施例,本申请实施例还提供一种用于音频源的音频同步方法,该音频源可以为平板电脑、手机、PC、笔记本电脑、可穿戴设备等蓝牙设备。其中,音频源包括第二蓝牙模块,音频播放设备包括第一蓝牙模块,音频源通过第二蓝牙模块向音频播放设备的第一蓝牙模块传输至少一个同步数据包。具体的如图4所示,该方法可以包括:
S201、记录产生每个同步数据包的同步数据包产生时间。
本申请实施例中,音频源中还包括应用子系统,该应用子系统用于产生同步数据包,音频源在应用子系统每产生一个同步数据包的情况下,记录同步数据包产生时间。
需要说明的是,音频源在记录应用子系统每产生一个同步数据包的同步数据包产生时间之前,初始设置音频源的AP PLL和BT PLL,其中,AP PLL用于表征同步数据包的产生速度,BT PLL用于表征同步数据包的传输速度,即音频源分别设置应用子系统对应的初始数据包产生速度和第二蓝牙模块对应的初始数据包传输速度。在应用子系统初始产生同步数据包时,按照初始数据包产生速度生成同步数据包,在第二蓝牙模块初始发送同步 数据包时,按照初始数据包传输速度向音频播放设备发送同步数据包;随着时间的推移,AP PLL和BT PLL之间的偏移量可能不同,此时,在音频播放设备和音频源之间的音频PLL同步的情况下,会导致音频播放设备的音频播放速度与音频源实际的应用播放速度不同。
S202、在每个同步数据包中添加同步数据包产生时间。
在音频源记录产生每个同步数据包的同步数据包产生时间之后,将每一个同步数据包产生时间添加至对应的一个同步数据包中。
S203、依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备,以供音频播放设备基于至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到至少一个同步数据包的至少一个接收时间,实现音频源和音频播放设备之间的音频同步操作。
本申请实施例中,音频源通过第二蓝牙模块,依次将至少一个同步数据包发送至音频播放设备,具体的,应用子系统将至少一个同步数据包依次传输至第二蓝牙模块,第二蓝牙模块基于数据包传输速度,将至少一个同步数据包依次发送至音频播放设备。
需要说明的是,音频播放设备基于音频源发送的至少一个同步数据包确定出至少一个同步数据包对应的至少一个同步数据包产生时间和至少一个接收时间,并基于至少一个同步数据包产生时间和至少一个接收时间来估算AP PLL和BT PLL的偏移值、进而实现音频源和音频播放设备之间的音频同步操作,具体的的过程参考S101-S103的描述,在此不再赘述。
基于上述实施例,本申请实施例提出一种音频播放设备和音频源之间的音频同步方案,如图5所示,实现过程具体包括:
1、音频源初始设置AP PLL的取值和BT PLL的取值。
2、音频源的AP模块每产生一个同步数据包时,根据APSS的系统时间确定每一个同步数据包的同步数据包产生时间timestamp_ap,并将timestamp_ap插入对应的同步数据包中。
3、音频源的BT模块将同步数据包发送至音频播放设备。
4、音频播放设备记录每一个同步数据包的接收时间timestamp_bt,并从每一个同步数据包中解析出对应的timestamp_ap。
5、音频播放设备计算第一个同步数据包对应的第一接收时间timestamp_bt_0和第一同步数据包产生时间timestamp_ap_0之间的差值,得到init_delta_timestamp。
6、音频播放设备计算第n个同步数据包对应的第n接收时间timestamp_bt_n和第n同步数据包产生时间timestamp_ap_n之间的差值,得到delta_timestamp_n。
7、音频播放设备比较delta_timestamp_n和init_delta_timestamp之间的差值,该差值用于反映出音频源的AP PLL和BT PLL的偏移情况。具体的,
如果delta_timestamp_n>init_delta_timestamp,表明BT PLL相对AP  PLL变慢。则调慢音频播放设备的音频PLL的速率。
如果delta_timestamp_n<init_delta_timestamp,表明BT PLL相对AP PLL变快。则调快音频播放设备的音频PLL的速率。
如果delta_timestamp_n=init_delta_timestamp,表明BT PLL相对AP PLL没发生变化。则不调整音频播放设备的音频PLL的速率。
可以理解的是,音频源向音频播放设备发送的至少一个同步数据包中携带有至少一个同步数据包产生时间,音频播放设备在接收到音频源发送的至少一个同步数据包时,记录至少一个同步数据包对应的至少一个接收时间,此时,音频播放设备基于至少一个同步数据包产生时间和至少一个接收时间来估算数据包产生时的频率与蓝牙传输数据包的频率之间的偏移值,由此音频播放设备基于至少一个同步数据包产生时间和至少一个接收时间确定出的音频同步策略,能够保持耳机端的播放速度与手机端的播放速度一致,进而提高了手机与蓝牙之间的音频同步性能。
在另一种实施例中,本申请实施例提供一种音频播放设备1。如图6所示,该设备1包括:
接收单元10,用于接收音频源依次发送的至少一个同步数据包;
第一记录单元11,用于记录至少一个同步数据包对应的至少一个接收时间;
获取单元12,用于获取所述至少一个同步数据包中携带的至少一个同步数据包产生时间;
同步单元13,用于基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
可选的,所述设备还包括:确定单元;
所述确定单元,用于根据首个接收到的第一同步数据包对应的第一同步数据包产生时间和第一同步数据包对应的第一接收时间,确定初始时间戳差值;根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二同步接收时间,确定目标时间戳差值;所述第二同步数据包为所述至少一个同步数据包中除所述第一同步数据包外的同步数据包;
所述同步单元13,还用于根据所述初始时间戳差值和所述目标时间戳差值,实现所述音频源和所述音频播放设备之间的音频同步操作。
可选的,所述确定单元,还用于根据预设时间间隔到达时接收到的第二同步数据包对应的所述第二同步数据包产生时间和所述第二同步接收时间,确定所述目标时间戳差值。
可选的,所述同步单元13,还用于若所述目标时间戳差值大于所述初始时间戳差值,则调慢所述音频播放设备的音频播放速度;若所述目标时间戳差值小于所述初始时间戳差值,则调快所述音频播放设备的音频播放速度;若所述目标时间戳差值等于所述初始时间戳差值,则不调整所述音频播放设备的音频播放速度。
可选的,所述音频播放设备包括第一蓝牙模块,所述音频源包括第二蓝牙模块,所述音频播放设备通过所述第一蓝牙模块接收所述音频源的所述第二蓝牙模块发送的所述至少一个同步数据包。
本申请实施例提供的一种音频播放设备,接收音频源依次发送的至少一个同步数据包;记录至少一个同步数据包对应的至少一个接收时间,并获取至少一个同步数据包中携带的至少一个同步数据包产生时间;基于至少一个接收时间和至少一个同步数据包产生时间,实现音频源和音频播放设备之间的音频同步操作。由此可见,本实施例提出的音频播放设备,音频源向音频播放设备发送的至少一个同步数据包中携带有至少一个同步数据包产生时间,音频播放设备在接收到音频源发送的至少一个同步数据包时,记录至少一个同步数据包对应的至少一个接收时间,此时,音频播放设备基于至少一个同步数据包产生时间和至少一个接收时间来估算数据包产生时的频率与蓝牙传输数据包的频率之间的偏移值,由此音频播放设备基于至少一个同步数据包产生时间和至少一个接收时间确定出的音频同步策略,能够保持耳机端的播放速度与手机端的播放速度一致,进而提高了手机与蓝牙之间的音频同步性能。
图7为本申请实施例提供的一种音频播放设备1的组成结构示意图二,在实际应用中,基于上述实施例的同一公开构思下,如图6所示,本实施例的设备1包括:接收器14、第一处理器15、第一存储器16及第一通信总线17。
在具体的实施例的过程中,上述第一记录单元11、获取单元12、同步单元13和确定单元可由位于音频播放设备1上的第一处理器15实现,上述接收单元10可由位于设备1上的接收器14实现,上述第一处理器15可以为特定用途集成电路(ASIC,Application Specific Integrated Circuit)、DSP、数字信号处理图像处理装置(DSPD,Digital Signal Processing Device)、可编程逻辑图像处理装置(PLD,Programmable Logic Device)、现场可编程门阵列(FPGA,Field Programmable Gate Array)、CPU、控制器、微控制器、微处理器中的至少一种。可以理解地,对于不同的设备,用于实现上述处理器功能的电子器件还可以为其它,本实施例不作具体限定。
在本申请实施例中,上述第一通信总线17用于实现接收器14、第一处理器15和第一存储器16之间的连接通信;上述接收器14,用于接收音频源依次发送的至少一个同步数据包;上述第一处理器15执行第一存储器16中存储的运行程序时实现如下的音频同步方法:
记录至少一个同步数据包对应的至少一个接收时间,并获取所述至少一个同步数据包中携带的至少一个同步数据包产生时间;
基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
进一步地,在上述实施例中,所述第一处理器15,还用于根据首个接 收到的第一同步数据包对应的第一同步数据包产生时间和第一同步数据包对应的第一接收时间,确定初始时间戳差值;根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二同步接收时间,确定目标时间戳差值;所述第二同步数据包为所述至少一个同步数据包中除所述第一同步数据包外的同步数据包;根据所述初始时间戳差值和所述目标时间戳差值,实现所述音频源和所述音频播放设备之间的音频同步操作。
进一步地,在上述实施例中,所述第一处理器15,还用于根据预设时间间隔到达时接收到的第二同步数据包对应的所述第二同步数据包产生时间和所述第二同步接收时间,确定所述目标时间戳差值。
进一步地,在上述实施例中,所述第一处理器15,还用于若所述目标时间戳差值大于所述初始时间戳差值,则调慢所述音频播放设备的音频播放速度;若所述目标时间戳差值小于所述初始时间戳差值,则调快所述音频播放设备的音频播放速度;若所述目标时间戳差值等于所述初始时间戳差值,则不调整所述音频播放设备的音频播放速度。
进一步地,在上述实施例中,所述音频播放设备包括第一蓝牙模块,所述音频源包括第二蓝牙模块,所述音频播放设备通过所述第一蓝牙模块接收所述音频源的所述第二蓝牙模块发送的所述至少一个同步数据包。
在另一种实施例中,本申请实施例提供一种音频源2。如图8所示,该音频源2包括:
第二记录单元20,用于记录产生每个同步数据包的同步数据包产生时间;
添加单元21,用于在每个同步数据包中添加所述同步数据包产生时间;
发送单元22,用于依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备,以供所述音频播放设备基于所述至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到所述至少一个同步数据包的至少一个接收时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
可选的,所述音频源包括第二蓝牙模块,所述音频播放设备包括第一蓝牙模块,所述音频源通过所述第二蓝牙模块向所述音频播放设备的所述第一蓝牙模块传输所至少一个同步数据包。
可选的,所述音频源包括APSS,所述第二记录单元20,还用于记录所述APSS每产生一个同步数据包的同步数据包产生时间。
可选的,所述音频源还包括:设置单元;
所述设置单元,用于分别设置所述音频源中的APSS对应的初始数据包产生速度和所述音频源中的第二蓝牙模块对应的初始数据包传输速度。
本申请实施例提供的一种音频源,记录产生每个同步数据包的同步数据包产生时间;并在每个同步数据包中添加同步数据包产生时间,;依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备, 以供音频播放设备基于至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到至少一个同步数据包的至少一个接收时间,实现音频源和音频播放设备之间的音频同步操作。由此可见,本实施例提出的音频源,向音频播放设备发送的至少一个同步数据包中携带有至少一个同步数据包产生时间,使得音频播放设备在接收到音频源发送至少一个同步数据包时,记录至少一个同步数据包对应的至少一个接收时间,此时,音频播放设备基于至少一个同步数据包产生时间和至少一个接收时间来估算数据包产生时的频率与蓝牙传输数据包的频率之间的偏移值,由此音频播放设备基于至少一个同步数据包产生时间和至少一个接收时间确定出的音频同步策略,能够保持耳机端的播放速度与手机端的播放速度一致,进而提高了手机与蓝牙之间的音频同步性能。
图9为本申请实施例提供的一种音频源2的组成结构示意图二,在实际应用中,基于上述实施例的同一公开构思下,如图9所示,本实施例的音频源2包括:发送器23、第二处理器24、第二存储器25及第二通信总线26。
在具体的实施例的过程中,上述第二记录单元20、添加单元21和设置单元可由位于音频源2上的第二处理器24实现,上述发送单元22可由位于音频源上的发送器23实现,上述第二处理器24可以为ASIC、DSP、DSPD、PLD、FPGA、CPU、控制器、微控制器、微处理器中的至少一种。可以理解地,对于不同的设备,用于实现上述处理器功能的电子器件还可以为其它,本实施例不作具体限定。
在本申请实施例中,上述第二通信总线26用于实现发送器23、第二处理器24和第二存储器25之间的连接通信;上述发送器23,用于依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备,以供所述音频播放设备基于所述至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到所述至少一个同步数据包的至少一个接收时间,实现所述音频源和所述音频播放设备之间的音频同步操作;上述第二处理器24执行第二存储器25中存储的运行程序时实现如下的音频同步方法:
记录产生每个同步数据包的同步数据包产生时间;在每个同步数据包中添加所述同步数据包产生时间。
进一步地,在上述实施例中,所述音频源包括第二蓝牙模块,所述音频播放设备包括第一蓝牙模块,所述音频源通过所述第二蓝牙模块向所述音频播放设备的所述第一蓝牙模块传输所述至少一个同步数据包。
进一步地,在上述实施例中,所述音频源包括APSS,所述第二处理器24,还用于记录所述APSS每产生一个同步数据包的同步数据包产生时间。
进一步地,在上述实施例中,所述第二处理器24,还用于分别设置所述音频源中的APSS对应的初始数据包产生速度和所述音频源中的第二蓝牙模块对应的初始数据包传输速度。
本申请实施例提供一种存储介质,其上存储有计算机程序,上述计算机可读存储介质存储有一个或者多个程序,上述一个或者多个程序可被一个或者多个处理器执行,应用于音频播放设备和/或音频源中,该计算机程序实现如上述音频同步的方法。
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本公开的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台图像显示设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本公开各个实施例所述的方法。
以上所述,仅为本申请的较佳实施例而已,并非用于限定本申请的保护范围。

Claims (20)

  1. 一种用于音频播放设备的音频同步方法,所述方法包括:
    接收音频源依次发送的至少一个同步数据包;
    记录所述至少一个同步数据包对应的至少一个接收时间,并获取所述至少一个同步数据包中携带的至少一个同步数据包产生时间;
    基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
  2. 根据权利要求1所述的方法,其中,所述基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作,包括:
    根据首个接收到的第一同步数据包对应的第一同步数据包产生时间和第一同步数据包对应的第一接收时间,确定初始时间戳差值;
    根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二同步接收时间,确定目标时间戳差值;所述第二同步数据包为所述至少一个同步数据包中除所述第一同步数据包外的同步数据包;
    根据所述初始时间戳差值和所述目标时间戳差值,实现所述音频源和所述音频播放设备之间的音频同步操作。
  3. 根据权利要求2所述的方法,其中,所述根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二同步接收时间,确定目标时间戳差值,包括:
    根据预设时间间隔到达时接收到的第二同步数据包对应的所述第二同步数据包产生时间和所述第二同步接收时间,确定所述目标时间戳差值。
  4. 根据权利要求2所述的方法,其中,所述根据所述初始时间戳差值和所述目标时间戳差值,实现所述音频源和所述音频播放设备之间的音频同步操作,包括:
    若所述目标时间戳差值大于所述初始时间戳差值,则调慢所述音频播放设备的音频播放速度;
    若所述目标时间戳差值小于所述初始时间戳差值,则调快所述音频播放设备的音频播放速度;
    若所述目标时间戳差值等于所述初始时间戳差值,则不调整所述音频播放设备的音频播放速度。
  5. 根据权利要求1所述的方法,其中,所述音频播放设备包括第一蓝牙模块,所述音频源包括第二蓝牙模块,所述音频播放设备通过所述第一蓝牙模块接收所述音频源的所述第二蓝牙模块发送的所述至少一个同步数据包。
  6. 一种用于音频源的音频同步方法,包括:
    记录产生每个同步数据包的同步数据包产生时间;
    在每个同步数据包中添加同步数据包产生时间;
    依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备,以供所述音频播放设备基于所述至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到所述至少一个同步数据包的至少一个接收时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
  7. 根据权利要求6所述的方法,其中,所述音频源包括第二蓝牙模块,所述音频播放设备包括第一蓝牙模块,所述音频源通过所述第二蓝牙模块向所述音频播放设备的所述第一蓝牙模块传输所述至少一个同步数据包。
  8. 根据权利要求6所述的方法,其中,所述音频源包括应用子系统APSS,所述记录产生每个同步数据包的同步数据包产生时间,包括:
    记录所述APSS每产生一个同步数据包的同步数据包产生时间。
  9. 根据权利要求6所述的方法,其中,所述记录应用子系统每产生一个同步数据包的同步数据包产生时间之前,所述方法还包括:
    分别设置所述音频源中的APSS对应的初始数据包产生速度和所述音频源中的第二蓝牙模块对应的初始数据包传输速度。
  10. 一种音频播放设备,所述设备包括:
    接收单元,用于接收音频源依次发送中的至少一个同步数据包;
    第一记录单元,用于记录至少一个同步数据包对应的至少一个接收时间;
    获取单元,用于获取所述至少一个同步数据包中携带的至少一个同步数据包产生时间;
    同步单元,用于基于所述至少一个接收时间和所述至少一个同步数据包产生时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
  11. 根据权利要求10所述的设备,其中,所述设备还包括:确定单元,
    所述确定单元,用于根据首个接收到的第一同步数据包对应的第一同步数据包产生时间和第一数同步据包对应的第一接收时间,确定初始时间戳差值;根据第二同步数据包对应的第二同步数据包产生时间和第二同步数据包对应的第二同步接收时间,确定目标时间戳差值;所述第二同步数据包为所述至少一个同步数据包中除所述第一同步数据包外的同步数据包;
    所述同步单元,还用于根据所述初始时间戳差值和所述目标时间戳差值,实现所述音频源和所述音频播放设备之间的音频同步操作。
  12. 根据权利要求11所述的设备,其中,
    所述同步单元,还用于若所述目标时间戳差值大于所述初始时间戳差值,则调慢所述音频播放设备的音频播放速度;若所述目标时间戳差值小于所述初始时间戳差值,则调快所述音频播放设备的音频播放速度;若所述目标时间戳差值等于所述初始时间戳差值,则不调整所述音频播放设备的音频播放速度。
  13. 根据权利要求10所述的设备,其中,所述音频播放设备包括第一蓝牙模块,所述音频源包括第二蓝牙模块,所述音频播放设备通过所述第二蓝牙模块接收所述音频源的所述第二蓝牙模块发送的所述至少一个同步数据包。
  14. 一种音频源,所述音频源包括:
    第二记录单元,用于记录产生每个同步数据包的同步数据包产生时间;
    添加单元,用于在每个同步数据包中添加所述同步数据包产生时间;
    发送单元,用于依次将已添加同步数据包产生时间的至少一个同步数据包发送至音频播放设备,以供所述音频播放设备基于所述至少一个同步数据包中携带的至少一个同步数据包产生时间和接收到所述至少一个同步数据包的至少一个接收时间,实现所述音频源和所述音频播放设备之间的音频同步操作。
  15. 根据权利要求14所述的音频源,其中,所述音频源包括第二蓝牙模块,所述音频播放设备包括第一蓝牙模块,所述音频源通过所述第二蓝牙模块向所述音频播放设备的所述第一蓝牙模块传输所至少一个同步数据包。
  16. 根据权利要求14所述的音频源,其中,所述音频源包括APSS,
    所述第二记录单元,还用于记录所述APSS每产生一个同步数据包的同步数据包产生时间。
  17. 根据权利要求14所述的音频源,其中,所述音频源还包括:设置单元;
    所述设置单元,用于分别设置所述音频源中的APSS对应的初始数据包产生速度和所述音频源中的第二蓝牙模块对应的初始数据包传输速度。
  18. 一种音频播放设备,所述设备包括:接收器、第一处理器、第一存储器及第一通信总线;所述第一处理器执行第一存储器存储的运行程序时实现如权利要求1-4任一项所述的方法。
  19. 一种音频源,所述音频源包括:发送器、第二处理器、第二存储器及第二通信总线;所述第二处理器执行第二存储器存储的运行程序时实现如权利要求5-8任一项所述的方法。
  20. 一种存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现如权利要求1-4或5-8任一项所述的方法。
PCT/CN2022/091137 2021-06-29 2022-05-06 一种音频同步方法及音频播放设备、音频源、存储介质 WO2023273601A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110725673.3 2021-06-29
CN202110725673.3A CN115551066A (zh) 2021-06-29 2021-06-29 一种音频同步方法及音频播放设备、音频源、存储介质

Publications (1)

Publication Number Publication Date
WO2023273601A1 true WO2023273601A1 (zh) 2023-01-05

Family

ID=84692470

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/091137 WO2023273601A1 (zh) 2021-06-29 2022-05-06 一种音频同步方法及音频播放设备、音频源、存储介质

Country Status (2)

Country Link
CN (1) CN115551066A (zh)
WO (1) WO2023273601A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007040222A1 (ja) * 2005-10-05 2007-04-12 Matsushita Electric Industrial Co., Ltd. 音声伝送システムにおけるクロック同期システム及び方法
JP2007306497A (ja) * 2006-05-15 2007-11-22 Oki Electric Ind Co Ltd パケット伝送におけるクロック同期方法及び回路
CN111918261A (zh) * 2020-08-13 2020-11-10 南京中感微电子有限公司 蓝牙音频设备同步播放方法、系统及蓝牙音频主、从设备

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090135854A1 (en) * 2007-11-27 2009-05-28 Mark Bettin System and method for clock synchronization
CN102130735A (zh) * 2010-11-09 2011-07-20 华为技术有限公司 一种传送设备及其实现时钟和时间同步的方法
CN103441833B (zh) * 2013-08-26 2016-08-10 瑞斯康达科技发展股份有限公司 一种主从设备频率同步方法及系统
US11064228B2 (en) * 2019-04-02 2021-07-13 Qualcomm Incorporated Audio playback timing adjustment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007040222A1 (ja) * 2005-10-05 2007-04-12 Matsushita Electric Industrial Co., Ltd. 音声伝送システムにおけるクロック同期システム及び方法
JP2007306497A (ja) * 2006-05-15 2007-11-22 Oki Electric Ind Co Ltd パケット伝送におけるクロック同期方法及び回路
CN111918261A (zh) * 2020-08-13 2020-11-10 南京中感微电子有限公司 蓝牙音频设备同步播放方法、系统及蓝牙音频主、从设备

Also Published As

Publication number Publication date
CN115551066A (zh) 2022-12-30

Similar Documents

Publication Publication Date Title
US11375312B2 (en) Method, device, loudspeaker equipment and wireless headset for playing audio synchronously
CN111147907B (zh) 多智能终端同步播放的方法、装置、系统及智能终端
JP7120997B2 (ja) オーディオとビデオのマルチモード同期レンダリング
JP6640359B2 (ja) ワイヤレスオーディオ同期
US11546682B2 (en) Method and system for synchronous audio playback of TWS earphones
US9338208B2 (en) Common event-based multidevice media playback
US8762580B2 (en) Common event-based multidevice media playback
US10644867B2 (en) Method, device, and system for synchronizing clocks of processors
CN109565466B (zh) 多设备间唇音同步方法及设备
JP6290915B2 (ja) 共通イベントベースのマルチデバイスメディア再生
JP2009521882A (ja) ワイヤレスネットワークにおけるメディアデータ同期化
JP2019526844A (ja) アイソクロナスデータストリームを制御するためのシステムおよび方法
CN110636600B (zh) 一种无线设备音频同步播放的方法
US9804633B2 (en) Indirect clock measuring and media adjustment
TWI545926B (zh) 時間同步方法及系統
EP3868043B1 (en) Wireless audio synchronization
WO2023273601A1 (zh) 一种音频同步方法及音频播放设备、音频源、存储介质
EP4018677A1 (en) Audio synchronization between wireless audio devices
WO2018188365A1 (zh) 同步播放方法、装置和系统
WO2023273591A1 (zh) 一种音频同步方法及音频播放设备、存储介质
WO2024046120A1 (zh) 一种通信装置、同步方法及系统
CN112235685B (zh) 一种音箱组网方法及音箱系统
TWI813499B (zh) 在視訊設備和無線音訊設備之間進行音視訊同步的方法及設備
US20230034311A1 (en) Communication apparatus, server system, control method for communication apparatus, and storage medium
WO2018072098A1 (zh) 一种音视频同步方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22831428

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE